input: Summarize the discussion about releasing meeting data and allowing people to cut things out
  Grad F: OK.
  PhD C: Adam, what is the mike that, uh, Jeremy's wearing?
  Grad F: It's the ear - plug mike.
  Postdoc A: Ear - plug.
  PhD E: That's good.
  PhD C: Is that a wireless, or {disfmarker}? Oh.
  Grad F: No.
  Grad G: It's wired.
  Professor B: Oh!
  Postdoc A: Is that {disfmarker} Does that mean you can't hear anything during the meeting?
  Grad D: It's old - school.
  Grad F: Huh? What? Huh?
  Professor B: Should we, uh, close the door, maybe?
  Grad F: It {disfmarker} it's a fairly good mike, actually.
  Professor B: So it's {disfmarker} Yeah. Huh.
  Grad F: Well, I shouldn't say it's a good mike. All I really know is that the signal level is OK. I don't know if it's a {disfmarker} the quality.
  Professor B: Well, that's a
  Grad F: Ugh! So I didn't send out agenda items because until five minutes ago we only had one agenda item and now we have two. So. {vocalsound} And, uh.
  Professor B: OK. So, just to repeat the thing bef that we said last week, it was there's this suggestion of alternating weeks on {vocalsound} more, uh, automatic speech recognition related or not? Was that sort of {pause} the division?
  Grad F: Right.
  Professor B: So which week are we in?
  Grad F: Well {disfmarker} We haven't really started, but I thought we more {disfmarker} we more or less did Meeting Recorder stuff last week, so I thought we could do, uh {disfmarker}
  Professor B: I thought we had a thing about speech recognition last week too.
  PhD C: Yeah.
  Grad F: But I figure also if they're short agenda items, we could also do a little bit of each.
  Professor B: Yeah.
  Grad F: So. I seem to be having difficulty getting this adjusted. Here we go.
  Professor B: OK.
  Grad F: So, uh, as most of you should know, I did send out the consent form thingies and, uh, so far no one has made any {disfmarker} Ach! {comment} {comment} any comments on them. So, no on no one has bleeped out anything.
  Professor B: Um. Yeah.
  Grad F: So. I don't expect anyone to. But.
  Professor B: Um. {vocalsound} So, w what follows? At some point y you go around and get people to sign something?
  Grad F: No. We had spoken w about this before
  Professor B: Yeah, but I've forgotten.
  Grad F: and we had decided that they have {disfmarker} they only needed to sign once. And the agreement that they already signed simply said that we would give them an opportunity. So as long as we do that, we're covered.
  Professor B: And how long of an opportunity did you tell them?
  Grad F: Uh, July fifteenth.
  Professor B: July fifteenth. Oh, so they have a plenty of time, and y
  Grad F: Yep.
  Professor B: Given that it's that long, um, um {disfmarker} Why was that date chosen? You just felt you wanted to {disfmarker}?
  Grad F: Jane told me July fifteenth. So, that's what I set it.
  Postdoc A: Oh. I just meant that that was {pause} the release date that you had on the {pause} data.
  Professor B: Oh, OK.
  Grad F: Oh. I {disfmarker} I didn't understand that there was something specific.
  Postdoc A: I, uh {disfmarker} I thought {disfmarker}
  Grad F: You {disfmarker} y you had {disfmarker}
  Professor B: I don't {disfmarker}
  Grad F: I had heard July fifteenth, so that's what I put.
  Postdoc A: Mm - hmm.
  Professor B: No, the only {disfmarker} th the only {pause} mention I recall about that was just that July fifteenth or so is when {vocalsound} this meeting starts.
  Grad F: So.
  Postdoc A: That's right. That's why.
  Professor B: Oh, I see.
  Postdoc A: You said you wanted it to be available then.
  Professor B: OK.
  Postdoc A: I didn't mean it to be the hard deadline.
  Professor B: Right.
  Postdoc A: It's fine with me if it is, or we cou But I thought it might be good to remind people two weeks prior to that
  Professor B: w
  Postdoc A: in case, uh {disfmarker} you know," by the way {pause} this is your last {disfmarker}" Professor B: Right.
  Postdoc A: Uh. Yeah.
  Professor B: We probably should have talked about it, cuz i because if we wanna be able to give it to people July fifteenth, if somebody's gonna come back and say" OK, I don't want this and this and this used" , uh, clearly we need some time to respond to that. Right?
  Grad F: Yeah. As I said, we {disfmarker} I just got one date
  Professor B: Yeah.
  PhD H: Damn!
  Grad F: and that's the one I used.
  Professor B: Yeah.
  Grad F: So. But I can send a follow - up. I mean, it's almost all us. I mean the people who are in the meeti this meeting was, uh, these {disfmarker} the meetings that {disfmarker} in {disfmarker} are in set one.
  PhD C: Was my {disfmarker} was my response OK?
  Postdoc A: That's right.
  PhD C: I just wrote you {disfmarker} replied to the email saying they're all fine.
  Grad F: Right. I mean, that's fine.
  PhD C: OK, good.
  Grad F: I {disfmarker} we don't {disfmarker} My understanding of what we {pause} had agreed upon when we had spoken about this months ago was that, uh, we don't actually need a reply.
  PhD C: That makes it easy.
  Grad F: We just need to tell them that they can do it if they want.
  Professor B: OK. I just didn't remember, but {disfmarker}
  Grad F: And so no reply is no changes.
  Postdoc A: And he's got it so that the default thing you see when you look at the page is" OK" .
  Professor B: OK.
  Postdoc A: So that's very clear all the way down the page," OK" . And they have two options they can change it to. One of them is {pause}" censor" , and the other one is" incorrect" . Is it {disfmarker} is {disfmarker} your word is" incorrect" ?
  Grad F: Right.
  Postdoc A: Which means also we get feedback on {pause} if {pause} um, there's something that they w that needs to be {pause} adjusted, because, I mean, these are very highly technical things. I mean, it's an added, uh, level of checking on the accuracy of the transcription, as I see it. But in any case, people can agree to things that are wrong.
  Grad F: Well {disfmarker}
  Postdoc A: So.
  Grad F: Yeah. The reason I did that it was just so that people would not censor {disfmarker} not ask to have stuff removed because it was transcribed incorrectly,
  Postdoc A: And the reason I liked it was because {disfmarker}
  Grad F: as opposed to, uh {disfmarker}
  Postdoc A: was because it, um {disfmarker} it gives them the option of, uh, being able to correct it.
  Grad F: Right.
  Postdoc A: Approve it and correct it. And {pause} um. So, you have {pause} it nicely set up so they email you and, uh {disfmarker}
  Grad F: When they submit the form, it gets processed and emailed to me.
  Postdoc A: Mm - hmm. Mm - hmm. And I wanted to say the meetings that are involved in that set are Robustness and Meeting Recorder.
  Grad F: So.
  Postdoc A: The German ones will be ready for next week. Those are three {disfmarker} three of those. A different set of people. And we can impose {disfmarker}
  PhD C: The German ones?
  Postdoc A: Uh, well.
  PhD H: Yeah. Those {disfmarker} uh {disfmarker}
  Professor B: NSA.
  Postdoc A: OK. I spoke loosely. The {disfmarker} the German, French {disfmarker} Sorry, the German, {vocalsound} Dutch, and Spanish ones.
  PhD E: Spanish. Yeah.
  Grad F: Mm - hmm.
  PhD C: Oh, those are the NSA meetings?
  PhD E: The non - native {disfmarker}
  PhD H: Those are {disfmarker}
  Postdoc A: Yeah. Uh - huh.
  Professor B: German, Dutch, Swiss and Spanish.
  PhD C: Oh, oh! OK.
  PhD E: The all non - native {disfmarker}
  Postdoc A: That's {disfmarker} that's {disfmarker} that's r
  Grad F: Mm - hmm.
  PhD H: Uh - huh.
  PhD C: OK. I'd {disfmarker} I d
  Postdoc A: Yeah. {pause} It's the other group.
  Professor B: I It was the network {disfmarker} network services group.
  PhD C: OK.
  Postdoc A: Uh - huh. Yeah, exactly. Yeah.
  Professor B: Yeah.
  Postdoc A: I didn't mean to {pause} isolate them.
  Professor B: Otherwise known as the German, Dutch, and Spanish.
  Postdoc A: Yeah. Sorry. It was {disfmarker} it was not the best characterization.
  Grad F: Mm - hmm.
  Postdoc A: But what {disfmarker} {vocalsound} what I meant to say was that it's the other group that's not {disfmarker} n no m no overlap with our present members. And then maybe it'd be good to set an explicit deadline, something like {pause} a week {pause} before that, uh, J July fifteenth date, or two weeks before.
  Professor B: I mean, I would suggest we discuss {disfmarker} I mean, if we're going to have a policy on it, that we discuss the length of time that we want to give people,
  Grad F: Mm - hmm.
  Professor B: so that we have a uniform thing. So, tha that's a month, which is fine. I mean, it seems {disfmarker}
  PhD C: Twelve hours.
  Grad F: Well, the only thing I said in the email is that {pause} the data is going to be released on the fifteenth. I didn't give any other deadline.
  Postdoc A: Mm - hmm.
  Grad F: So my feeling is if someone after the fifteenth says," wow I suddenly found something" , we'll delete it from our record. We just won't delete it from whatever's already been released.
  Postdoc A: Hmm. That's a little bit difficult.
  Grad F: What else can we do?
  Postdoc A: Yeah.
  Grad F: If someone says" hey, look, I {pause} found something in this meeting and {pause} it's libelous and I want it removed" . What can we do?
  Postdoc A: Well. {pause} That's true.
  Grad F: We have to remove it.
  Postdoc A: I {disfmarker} I agree with that part, but I think that it would {disfmarker} it, uh {disfmarker} we need to have, uh, a {disfmarker} a {disfmarker} a message to them very clearly that {vocalsound} beyond this date, you can't make additional changes.
  Professor B: I mean, um, I {disfmarker} I {disfmarker} {vocalsound} i I think that somebody might {pause} request something even though we say that. But I think it's good to at least start some place like that.
  Postdoc A: Mm - hmm. Good.
  Professor B: So if we agreed, {vocalsound} OK, how long is a reasonable amount of time for people to have {disfmarker} if we say two weeks, or if we say a month, I think we should just say that {disfmarker} say that, you know, i a as {pause} um, {vocalsound}" per the {disfmarker} the {disfmarker} the, uh, page you signed, you have the ability to look over this stuff" and so forth" and, uh, because we w" these, uh {disfmarker} I would {disfmarker} I would imagine some sort of generic thing that would say" because we, uh, will continually be making these things available {vocalsound} to other researchers, uh, this can't be open - ended and so, uh, uh, please give us back your response within this am you know, within this amount of time" , whatever time we agree upon.
  Grad F: Well, did you read the email and look at the pages I sent?
  Professor B: Did I? No, I haven't yet. No, just {disfmarker}
  Grad F: No. OK, well why don't you do that and then make comments on what you want me to change?
  Professor B: No, no. I'm not saying that you should change anything. I I'm {disfmarker} what I'm {disfmarker} what I'm {disfmarker} {vocalsound} I'm trying to spark a discussion hopefully among people who have read it so that {disfmarker} that you can {disfmarker} {vocalsound} you can, uh, decide on something.
  Postdoc A: Mm - hmm.
  Professor B: So I'm not telling you what to decide.
  Postdoc A: Mm - hmm.
  Professor B: I'm just saying you should decide something,
  Postdoc A: OK.
  Professor B: and then {disfmarker}
  Grad F: I already did decide something, and that's what's in the email.
  Postdoc A: Yeah, yeah. OK, so {disfmarker}
  Grad F: And if you disagree with it, why don't you read it and give me comments on it?
  Postdoc A: Yeah. Well {disfmarker} I {disfmarker} I think that there's one missing line.
  Professor B: Well, the one thing that I did read and that you just repeated to me {pause} was that you gave the specific date of July fifteenth.
  Grad F: Mm - hmm.
  Professor B: And you also just said that the reason you said that was because someone said it to you. So what I'm telling you {pause} is that what you should do is come up with a length of time that you guys think is enough
  Grad F: Right.
  Professor B: and you should use that rather than {pause} this date that you just got from somewhere. That's all I'm saying.
  Grad F: OK.
  Professor B: OK?
  Postdoc A: I ha I have one question. This is in the summer period and presumably people may be out of town. But we can make the assumption, can't we? that, um, they will be receiving email, uh, most of the month. Right? Because if someone {disfmarker}
  Professor B: It {disfmarker} well, it {disfmarker} well, you're right. Sometimes somebody will be {pause} away and, uh, you know, there's, uh {disfmarker} for any length of time that you {vocalsound} uh, choose {pause} there is some person sometime who will not {pause} end up reading it.
  Postdoc A: OK.
  Professor B: That's {disfmarker} it's, you know, just a certain risk to take.
  PhD H: S so maybe when {disfmarker} Am I on, by the way?
  Grad F: I don't know. You should be.
  PhD H: Oh. Hello? Hello?
  Grad F: You should be channel B.
  PhD H: Oh, OK. Alright. So. The, um {disfmarker} Maybe we should say in {disfmarker} w you know, when the whole thing starts, when they sign the {disfmarker} {vocalsound} the agreement {vocalsound} that {disfmarker} you know, specify exactly uh, what, you know, how {disfmarker} how they will be contacted and they can, you know {disfmarker} they can be asked to give a phone number and an email address, or both. And, um, then {disfmarker}
  Postdoc A: We did that, I {disfmarker} I believe.
  PhD H: Right.
  PhD E: Yeah.
  PhD H: So. {vocalsound} A And, then, you know, say very clearly that if they don't {disfmarker} if we don't hear from them, you know, as Morgan suggested, by a certain time or after a certain {vocalsound} period after we contact them {vocalsound} that is implicitly giving their agreement.
  Grad F: Well, they've already signed a form.
  Postdoc A: And the form says {disfmarker}
  PhD E: And nobody {disfmarker} nobody really reads it anyway.
  PhD H: Right.
  Grad F: So. And the s and the form was approved by Human Subjects,
  PhD H: Says that. Right.
  Postdoc A: Uh, the f
  PhD H: Well, if that's i tha if that's already {disfmarker} if {disfmarker}
  Grad F: so, eh, that's gonna be a little hard to modify.
  Postdoc A: Well, the form {disfmarker} Well, the form doesn't say, if {disfmarker} uh, you know," if you don't respond by X number of days or X number of weeks {disfmarker}" PhD H: I see. Uh {disfmarker} Oh, OK. So what does it say about the {disfmarker} the {disfmarker} the process of {disfmarker} of, uh {disfmarker} {vocalsound} y the review process?
  Postdoc A: It doesn't have a time limit. That you'll be provided access to the transcripts and then, uh, allowed to {pause} remove things that you'd like to remove, before it goes to the general {disfmarker} uh, larger audience.
  PhD H: Oh, OK. Hmm. Right.
  Grad F: Here.
  Postdoc A: There you go.
  Grad F: You can read what you already signed.
  PhD H: Oh.
  PhD E: I guess when I {pause} read it, um {disfmarker}
  PhD H: OK.
  PhD E: I'm not as diligent as Chuck, but I had the feeling I should probably respond and tell Adam, like," I got this and I will do it by this date, and if you don't hear from me by then {disfmarker}" You know, in other words responding to your email {pause} once, right away, saying" as soon as you get this could you please respond." Grad F: Right.
  PhD E: And then if you {disfmarker} if the person thinks they'll need more time because they're out of town or whatever, they can tell you at that point? Because {disfmarker}
  Grad F: Oh, I just {disfmarker} I didn't wanna do that, because I don't wanna have a discussion with every person {pause} if I can avoid it.
  PhD E: Well, it's {disfmarker}
  Grad F: So what I wanted to do was just send it out and say" on the fifteenth, the data is released,
  Postdoc A: Mm - hmm.
  Grad F: if you wanna do something about it, do something about it, but that's it" .
  Postdoc A: I {disfmarker} I kind of like this.
  PhD E: Well {disfmarker}
  Postdoc A: Yeah.
  PhD E: OK. So, we're assuming that {disfmarker}
  PhD H: Well, that's {disfmarker} that would be great if {disfmarker} but you should probably have a {pause} legal person look at this and {pause} make sure it's OK. Because if you {disfmarker} if you, uh, do this {vocalsound} and you {disfmarker} then there's a dispute later and, uh, some {disfmarker} {vocalsound} you know, someone who understands these matters concludes that they didn't have, uh, you know, enough opportunity to actually {vocalsound} exercise their {disfmarker} their right {disfmarker}
  PhD E: Or they {disfmarker} they might never have gotten the email, because although they signed this, they don't know by which date to expect your email. And so {pause} someone whose machine is down or whatever {disfmarker} I mean, we have no {disfmarker}
  Professor B: Mm - hmm.
  PhD E: in internally we know that people are there,
  Grad F: Well, OK. l Let me {disfmarker} Let me reverse this.
  PhD E: but we have no confirmation that they got the mail.
  Grad F: So let's say someone {disfmarker} I send this out, and someone doesn't respond. Do we delete every meeting that they were in?
  PhD E: Well, then {disfmarker}
  Grad F: I don't think so.
  PhD E: It {disfmarker} we're hoping that doesn't happen,
  PhD H: No.
  PhD E: but that's why there's such a thing as registered mail
  Grad F: That will happen.
  PhD E: or {disfmarker}
  PhD H: That will happen.
  PhD E: Right.
  Grad F: That will absolutely happen. Because people don't read their email, or they'll read and say" I don't care about that, I'm not gonna delete anything" and they don just won't reply to it.
  PhD H: Maybe {disfmarker} uh, do we have mailing addresses for these people?
  Grad F: No. We have what they put on the speaker form,
  PhD H: No.
  Postdoc A: Well {disfmarker} {comment} {vocalsound} Most {disfmarker}
  Grad F: which was just generic contact information.
  PhD H: Oh.
  Postdoc A: But the ones that we're dealing with now are all local,
  PhD H: Well, then {disfmarker}
  Postdoc A: except the ones who {disfmarker} I mean, we {disfmarker} we're totally in contact with all the ones in those two groups.
  PhD H: Mmm. OK.
  Postdoc A: So maybe, uh, I {disfmarker} you know, that's not that many people and if I {disfmarker} if, uh {disfmarker} i i there is an advantage to having them admit {disfmarker} and if I can help with {disfmarker} with processing that, I will. It's {disfmarker} it's {disfmarker} there is an advantage to having them be on record as having received the mail and indicating {disfmarker}
  Grad F: Yeah. I mean I thought we had discussed this, like, a year ago.
  Postdoc A: Yes, we did.
  Grad F: And so it seems like this is a little odd for it to be coming up yet again.
  Postdoc A: You're right. Well, I {disfmarker} you know. But sometimes {disfmarker}
  Professor B: Well, we {disfmarker} we haven't experienced it before.
  Grad F: So.
  Postdoc A: That's right.
  Professor B: Right? So {disfmarker}
  PhD E: You'll either wonder {pause} at the beginning or you'll wonder at the end.
  Postdoc A: Need to get it right.
  PhD E: I mean, there's no way to get around {disfmarker} I It's pretty much the same am amount of work except for an additional email just saying they got the email.
  Postdoc A: Yeah.
  PhD E: And maybe it's better legally to wonder before {disfmarker} you know, a little bit earlier than {disfmarker}
  Grad F: Well {disfmarker}
  Postdoc A: It's much easier to explain {pause} this way.
  Grad F: OK. Well, why don't you talk {pause} t
  Postdoc A: T t to have it on record.
  Grad F: Morgan, can you talk to our lawyer about it, and find out what the status is on this? Cuz I don't wanna do something that we don't need to.
  Postdoc A: Yeah, but w Mmm.
  Grad F: Because what {disfmarker} I'm telling you, people won't respond to the email. No matter what you do, you there're gonna be people who {pause} you're gonna have to make a lot of effort to get in contact with.
  Postdoc A: Well, then we make the effort.
  Grad D: I mean, i it's k
  Grad F: And do we want to spend that effort?
  PhD H: Hmm.
  Postdoc A: We make the effort.
  Grad D: It's kind of like signing up for a mailing list. They have opt in and opt out. And there are two different ways. I mean, and either way works probably, I mean.
  Postdoc A: Except I really think in this case {disfmarker} I {disfmarker} I'm agr I agree with Liz, that we need to be {pause} in the clear and not have to after the fact say" oh, but I assumed" , and" oh, I'm sorry that your email address was just accumulating mail without notifying you" , you know.
  Professor B: If this is a purely administrative task, we can actually have administration do it.
  Postdoc A: Oh, excellent.
  Professor B: But the thing is that, you know, I {disfmarker} I {disfmarker} I think, without going through a whole expensive thing with our lawyers, {vocalsound} from my previous conversations with them, my {disfmarker} my sense very {pause} much is that we would want something on record {pause} as indicating that they actually were aware of this.
  Postdoc A: Yes.
  Grad F: Well, we had talked about this before
  Professor B: Mm - hmm.
  Grad F: and I thought that we had even gone by the lawyers asking about that and they said you have to s they've already signed away the f with that form {disfmarker} that they've already signed once.
  Postdoc A: I don't remember that this issue of {pause} the time period allowed for response was ever covered.
  Grad F: Yeah.
  Professor B: Yeah. We never really talked about that.
  Grad F: OK.
  PhD E: Or the date at which they would be receiving the email from you.
  Postdoc A: Or {disfmarker} or how they would indicate {disfmarker}
  Professor B: Yeah.
  PhD E: They probably forgot all about it.
  Professor B: We certainly didn't talk, uh, about {disfmarker} with them at all about, uh, the manner of them being {disfmarker} {vocalsound} made the, uh, uh, materials available.
  PhD E: Yeah.
  PhD H: We do it like with these {disfmarker}
  Professor B: That was something that was sort of just within our implementation.
  Grad F: OK.
  PhD H: We can use it {disfmarker} we can use a {disfmarker} a ploy like they use to, um {disfmarker} you know, that when they serve, like {disfmarker} uh, uh, uh {disfmarker} {comment} uh, you know, like dead - beat dads, they {disfmarker} they {disfmarker} they make it look like they won something in the lottery and then they open the envelope
  Grad D: And they're served.
  PhD H: and that {disfmarker} Right? Because {disfmarker} and then the {disfmarker} the {disfmarker} the {disfmarker} the thing is served. So you just make it, you know," oh, you won {disfmarker} you know, go to this web site and you've, uh {disfmarker} you're {disfmarker}" PhD E: That's why you never open these things that come in the mail.
  Postdoc A: That one.
  Professor B: Yeah.
  Grad F: Well, it's just, we've gone from one extreme to the other, where at one point, a few months ago, Morgan was {disfmarker} you were saying let's not do anything,
  PhD H: Right. {vocalsound} Right. No, it I {disfmarker} it might {disfmarker}
  Postdoc A: Well, it doesn't matter.
  PhD H: i i it {disfmarker} it might well be the case {disfmarker}
  Grad F: and now we're {disfmarker} we're saying we have to follow up each person and get a signature?
  PhD H: it might {disfmarker} Right.
  Grad F: I mean, what are we gonna doing here?
  PhD H: It might well be the case that {disfmarker} that this is perfectly {disfmarker} you know, this is enough to give us a basis t to just, eh, assume their consent if they don't reply.
  Professor B: Well.
  Grad F: Mm - hmm.
  PhD H: But, I'm not {disfmarker} you know, me not being a lawyer, I wouldn't just wanna do that without {pause} having the {disfmarker} the expert, uh, opinion on that.
  Postdoc A: And how many people? Al - altogether we've got twenty people. These people are people who read their email almost all the time.
  Grad F: Then I think we had better find out, so that we can find a {disfmarker}
  PhD H: Yeah.
  Professor B: Let me look at this again.
  Grad F: Right.
  Postdoc A: I {disfmarker} I really don't see that it's a problem. I {disfmarker} I think that it's a common courtesy to ask them {disfmarker} uh, to expect for them to, uh, be able to have @ @ {comment} us try to contact them,
  Grad F: For {disfmarker} for th
  Postdoc A: u just in case they hadn't gotten their email. I think they'd appreciate it.
  Professor B: Yeah. My {disfmarker} Adam, my {disfmarker} my view before was about {pause} the nature of what was {disfmarker} of the presentation,
  Grad F: Mm - hmm.
  Professor B: of {disfmarker} of how {pause} my {disfmarker} my {disfmarker} the things that we're questioning were along the lines of how easy {disfmarker} uh, h how m how much implication would there be that it's likely you're going to be changing something, as opposed to {disfmarker}
  Grad F: Mm - hmm.
  Professor B: That was the kind of dispute I was making before.
  Postdoc A: Mm - hmm. I remember that.
  Professor B: But, um, the attorneys, I {disfmarker} uh, I can guarantee you, the attorneys will always come back with {disfmarker} and we have to decide how stringent we want to be in these things, but they will always come back with saying {vocalsound} that, um, you need to {disfmarker} you want to have someth some paper trail or {disfmarker} which includes electronic trail {disfmarker} {vocalsound} that they have, uh, in fact {pause} O K'd it.
  Grad F: Mm - hmm.
  Professor B: So, um, I think that if you f i if {pause} we send the email as you have and if there's half the people, say, who don't respond {pause} at all by, you know, some period of time, {vocalsound} we can just make a list of these people and hand it to, uh {disfmarker} you know, just give it to me and I'll hand it to administrative staff or whatever,
  Grad F: Right.
  Professor B: and they'll just call them up and say, you know," have you {disfmarker} Is {disfmarker} is this OK? And would you please mail {disfmarker} you know, mail Adam that it is, if i if it, you know, is or not." So, you know, we can {disfmarker} we can do that.
  PhD E: The other thing that there's a psychological effect that {disfmarker} at least for most people, that if they've responded to your email saying" yes, I will do it" or" yes, I got your email" , they're more likely to actually do it {comment} {pause} later {pause} than to just ignore it.
  Professor B: Mm - hmm.
  PhD E: And of course we don't want them to bleep things out, but it {disfmarker} it's a little bit better if we're getting the {disfmarker} their, uh, final response, once they've answered you once than if they never answer you'd {comment} at al at all. That's how these mailing houses work. So, I mean, it's not completely lost work because it might benefit us in terms of getting {pause} responses.
  Postdoc A: Mm - hmm.
  PhD E: You know, an official OK from somebody {pause} is better than no answer, even if they responded that they got your email. And they're probably more likely to do that once they've responded that they got the email.
  Postdoc A: I also think they'd just simply appreciate it. I think it's a good {disfmarker} a good way of {disfmarker} of fostering goodwill among our subjects. Well, our participants.
  Professor B: I think the main thing is {disfmarker} I mean, what lawyers do is they always look at worst cases.
  Grad F: Sending lots of spam.
  Professor B: So they s so {disfmarker} so {disfmarker} Tha - that's what they're paid to do.
  Grad F: Yep.
  Professor B: And so, {vocalsound} it is certainly possible that, uh, somebody's server would be down or something and they wouldn't actually hear from us, and then they find this thing is in there and we've already distributed it to someone. So, {vocalsound} what it says in there, in fact, is that they will be given an opportunity to blah - blah - blah,
  Postdoc A: Mm - hmm.
  Professor B: but if in fact {disfmarker} if we sent them something or we thought we sent them something but they didn't actually receive it for some reason, {vocalsound} um, then we haven't given them that.
  Grad F: Well, so how far do we have to go? Do we need to get someone's signature? Or, is email enough?
  Professor B: I i i em email is enough.
  Grad F: Do we have to have it notarized? I mean {disfmarker} OK.
  Professor B: Yeah. I mean, I've been through this {disfmarker} I mean, I'm not a lawyer, but I've been through these things a f things f like this a few times with lawyers now
  Grad F: Mm - hmm.
  Professor B: so I {disfmarker} I {vocalsound} I I'm pretty comfortable with that.
  PhD C: Do you track, um, when people log in to look at the {disfmarker}?
  Grad F: Uh. If they submit the form, I get it.
  PhD C: Uh - huh.
  Grad F: If they don't submit the form, it goes in the general web log. But that's not sufficient.
  PhD C: Hmm.
  Grad F: Right? Cuz if someone just visits the web site that doesn't {pause} imply anything in particular.
  PhD C: Except that you know they got the mail.
  Postdoc A: Mm - hmm. That's right.
  Grad F: Right.
  Postdoc A: I {disfmarker} I could get you on the notify list if you want me to.
  Grad F: I'm already on it.
  Postdoc A: For that directory? OK, great.
  Grad F: Mm - hmm.
  Professor B: So again, hopefully, um, this shouldn't be quite as odious a problem either way, uh, in any of the extremes we've talked about because {vocalsound} uh, we're talking a pretty small {pause} number of people.
  Grad F: W For this set, I'm not worried, because {pause} we basically know everyone on it.
  Professor B: Mm - hmm.
  Postdoc A: Hmm.
  Professor B: Mm - hmm.
  Grad F: You know, they're all more or less here or it's {disfmarker} it's Eric and Dan and so on. But for some of the others, you're talking about visitors who are {pause} gone from ICSI, whose email addresses may or may not work,
  Professor B: Mm - hmm.
  Postdoc A: Oh.
  Professor B: Mm - hmm.
  Grad F: and {disfmarker} So what are we gonna do when we run into someone that we can't get in touch with?
  Postdoc A: I don't think, uh {disfmarker} They're so recent, these visitors.
  Grad F: Mm - hmm.
  Postdoc A: I {disfmarker} and {disfmarker} and I {disfmarker} they're also so {disfmarker}
  Professor B: Mm - hmm.
  Postdoc A: They're prominent enough that they're easy to find through {disfmarker} I {disfmarker} I mean, I {disfmarker} I w I'll be able to {disfmarker} if you have any trouble finding them, I really think I could find them.
  Grad F: Other methods? OK.
  Professor B: Yeah. Cuz it {disfmarker} what it {disfmarker} what it really does promise here is that we will ask their permission. Um, and I think, you know, if you go into a room and close the door and {disfmarker} and ask their permission {vocalsound} and they're not there, it doesn't seem {comment} that that's the intent of, uh, meaning here. So.
  Grad F: Well, the qu the question is just whether {disfmarker} how active it has to be. I mean, because they {disfmarker} they filled out a contact information and that's where I'm sending the information.
  Professor B: Right.
  Grad F: And so far everyone has done email. There isn't anyone who did, uh, any other contact method.
  Professor B: Well, the way ICSI goes, people, uh, who, uh, were here ten years ago still have acc {vocalsound} have forwards to other accounts and so on.
  Grad F: Yeah.
  Professor B: So it's unusual that {disfmarker} that they, uh {disfmarker}
  Grad F: So my original impression was that that was sufficient, that if they give us contact information and that contact information isn't accurate that {pause} we fulfilled our burden.
  Professor B: Yeah.
  PhD E: Then they just come back.
  PhD C: All my files were still here.
  PhD E: Same as us.
  Postdoc A: I just {disfmarker}
  Professor B: So if we get to a boundary case like that then maybe I will call the attorney about it.
  PhD C: Yeah.
  Grad F: OK.
  Professor B: But, you know, hopefully we won't need to.
  Postdoc A: I d I just don't think we will. For all the reasons that we've discussed.
  Grad F: Alright.
  Professor B: So we'll {disfmarker} we'll see if we do or not.
  Grad F: Yep. And we'll see how many people respond to that email.
  Postdoc A: Yeah.
  Grad F: So far, two people have.
  Professor B: Yeah. I think very few people will
  Grad F: So.
  Professor B: and {disfmarker} and {disfmarker} and, you know, people {disfmarker} people see long emails about things that they don't think {vocalsound} is gonna be high priority, they typically, uh, don't {disfmarker} don't read it, or half read it.
  Grad F: Right.
  Professor B: Cuz people are swamped.
  Postdoc A: And actually,
  Professor B: But {disfmarker}
  Postdoc A: um, I {disfmarker} I {disfmarker} didn't anticipate this so I {disfmarker} that's why I didn't give this comment, and it {disfmarker} I {disfmarker} this discussion has made me think it might be nice to have a follow - up email within the next couple of days saying" by the way, you know, we wanna hear back from you by X date and please {disfmarker}" , and then add what Liz said {disfmarker}" please, uh, respond to {disfmarker} please indicate you received this mail." Professor B: Uh, or e well, maybe even additionally, uh, um," Even if you've decided you have no changes you'd like to make, if you could tell us that" .
  Grad F: Respond to the email. {comment} Yep.
  Postdoc A: Mm - hmm. It is the first time through the cycle.
  Professor B: Yeah.
  PhD E: Right. That would {disfmarker} that would definitely work on me. You know, it makes you feel m like, um, if you were gonna p if you're predicting that you might not answer, you have a chance now to say that. Whereas, I {disfmarker} I mean, I would be much more likely myself,
  PhD C: And the other th
  PhD E: given all my email, t to respond at that point, saying" you know what, I'm probably not gonna get to it" or whatever, rather than just having seen the email, thinking I might get to it, and never really, {vocalsound} uh, pushing myself to actually do it until it's too late.
  PhD C: Yeah. I was {disfmarker} I was thinking that it also {pause} lets them know that they don't have to go to the page to {pause} accept this.
  PhD E: Right. R Right. That's true.
  Professor B: Right.
  PhD C: I mean, I {disfmarker} I {disfmarker} Yeah. So that way they could {disfmarker} they can see from that email that if they just write back and say" I got it, no changes" , they're off the hook.
  Professor B: Yeah.
  PhD C: They don't have to go to the web page
  Professor B: I mean, the other thing I've learned from dealing with {disfmarker} dealing with people sending in reviews and so forth, uh, is, um, {vocalsound} if you say" you've got three months to do this review" , {vocalsound} um, people do it, you know, {vocalsound} two and seven eighths months from now.
  PhD C: and {disfmarker}
  PhD E: Yeah. That's true.
  Professor B: If you say" you've got three weeks to do this review" , they do {disfmarker} do it, you know, two and seven eighths weeks from now {disfmarker} {vocalsound} they do the review.
  Grad F: Right.
  Professor B: And, um {disfmarker} So, if we make it {pause} a little less time, I don't think it'll be that much {disfmarker}
  Grad F: Well, and also if we want it ready by the fifteenth, that means we better give them deadline of the first, if we have any prayer of actually getting everyone to respond in time.
  Professor B: There's the responding part and there's also what if, uh, I mean, I hope this doesn't happen, what if there are a bunch of deletions that have to get put in and changes?
  Grad F: Right.
  Professor B: Then {vocalsound} we actually have to deal with that
  Postdoc A: Mm - hmm. Some lead time.
  Professor B: if we want it to {disfmarker}
  Grad F: Ugh! Disk space,
  Postdoc A: By the way, has {disfmarker} has Jeremy signed the form?
  Grad F: oh my god! I hadn't thought about that.
  Postdoc A: OK.
  Grad F: That for every meeting {disfmarker} any meeting which has any bleeps in it we need yet another copy of.
  PhD H: Oh.
  PhD C: Just that channel.
  Grad D: Can't you just do that channel?
  PhD C: Oh, no. We have to do {disfmarker}
  Grad F: No, of course not.
  PhD E: Yeah. You have to do all of them,
  Grad F: You need all the channels.
  Grad D: Oh.
  PhD C: Do you have to do the other close - talking?
  PhD E: as well as all of these.
  Grad D: Yeah.
  PhD E: You have to do all {disfmarker} You could just do it in that time period, though,
  Grad F: Yes. Absolutely. There's a lot of cross - talk.
  Grad G: Wow.
  Postdoc A: Well {disfmarker}
  PhD E: but I guess it's a pain.
  Grad F: Well, but you have to copy the whole file.
  PhD E: Yeah.
  Grad F: Right? Because we're gonna be releasing the whole file.
  PhD E: Yeah. You're right.
  Postdoc A: Well {disfmarker} {vocalsound} I {disfmarker} you know, I think at a certain point, that copy that has the deletions will become the master copy.
  Grad F: Yeah. It's just I hate deleting any data. So I {disfmarker} I don't want {disfmarker} I really would rather make a copy of it, rather than bleep it out
  Professor B: Are you del are you bleeping it by adding?
  Grad F: and then {disfmarker} Overlapping. So, it's {disfmarker} it's exactly a censor bleep. So what I really think is" bleep" Professor B: I I I I understand, but is {disfmarker} is it summing signals
  Grad F: and then I want to {disfmarker}
  Professor B: or do you {pause} delete the old one and put the new one in?
  Grad F: I delete the old one, put the new one in.
  Professor B: Oh, OK. Cuz {disfmarker}
  Grad F: There's nothing left of the original signal.
  Professor B: Oh. Cuz if you were summing, you could {disfmarker} No. But anyway {disfmarker}
  Grad F: Yeah. It would be qui quite easy to get it back again.
  Postdoc A: But {disfmarker} {vocalsound} And then w I was gonna say also that the they don't have to stay on the system, as you know,
  Professor B: Yeah.
  PhD E: Then someday we can sell the {pause} unedited versions.
  Postdoc A: cuz {disfmarker} cuz the {disfmarker} the ones {disfmarker}
  Grad F: Say again?
  Postdoc A: Once it's been successfully bleeped, can't you rely on the {disfmarker}?
  PhD C: Or {pause} we'll tell people the frequency of the beep
  Professor B: Encrypt it.
  PhD C: and then they could subtract the beep out.
  Grad D: You can hide it. Yeah.
  Postdoc A: Can't you rely on the archiving to preserve the older version?
  PhD H: Oh, yeah.
  Grad D: It wouldn't be that hard to hide it.
  PhD E: Right. Exactly. I see.
  Grad F: Yeah, that's true. Yeah. Yep, that's true.
  PhD E: See, this is good. I wanted to create some {pause} side conversations in these meetings.
  Postdoc A: OK.
  Professor B: Yeah. You could encrypt it, you know, with a {disfmarker} with a two hundred bit {disfmarker} {vocalsound} thousand bit, uh {disfmarker}
  Grad D: You can use spread spectrum.
  PhD C: Uh - huh.
  Grad D: Hide it.
  PhD E: So {disfmarker}
  PhD C: Here we go.
  PhD E: Yeah. Yeah.
  Grad D: Yeah, there you go.
  PhD E: Cuz we don't have enough asides.
  PhD H: I have an idea. You reverse the signal,
  Grad D: There you go.
  PhD H: so it {disfmarker} it lets people say what they said backwards.
  Grad F: Backwards.
  Grad D: Then you have, like, subliminal, uh, messages,
  Grad F: But, ha you've seen the {disfmarker} this {disfmarker} the speech recognition system that reversed very short segments.
  PhD H: Yeah.
  Grad D: like.
  Grad F: Did you read that paper? It wouldn't work.
  PhD H: No.
  Grad F: The speech recognizer still works.
  PhD E: Yeah. And if you do it backward then {disfmarker}
  Professor B: Yeah.
  PhD C: That's cuz they use forward - backward.
  PhD E: H - good old HMM.
  Grad F: Forward but backward. That's right.
  PhD E: No, it's backward - forward.
  Grad F: Good point. A point. Well, I'm sorry if I sound a little peeved about this whole thing. It's just we've had meeting after meeting after meeting a on this and it seems like we've never gotten it resolved.
  Postdoc A: Hmm.
  Professor B: Well, but we never also {disfmarker} we've also never done it.
  PhD E: Uh.
  Grad F: So.
  Postdoc A: This is the first cycle.
  PhD E: If it makes {disfmarker}
  Grad F: Yeah.
  Postdoc A: There're bound to be some glitches the first time through.
  Professor B: So. {vocalsound} And, uh {disfmarker} and I'm sorry responding without, uh, having much knowledge, but the thing is, uh, I am, like, one of these people who gets a gazillion mails and {disfmarker} and stuff comes in as
  Grad F: Well, and that's exactly why I did it the way I did it, which is the default is if you do nothing we're gonna release it.
  Professor B: Yeah.
  Grad F: Because, you know, I have my {pause} stack of emails of to d to be done, that, you know, fifty or sixty long, and the ones at the top I'm never gonna get to.
  Professor B: Right.
  Grad F: And, uh {pause} So {disfmarker} so {disfmarker}
  PhD C: Move them to the bottom.
  Professor B: So {disfmarker} so the only thing we're missing is {disfmarker} is some way to respond to easily to say, uh," OK, go ahead" or something.
  Grad F: Yeah, right. So, i this is gonna mean {disfmarker}
  PhD C: Just re - mail them to yourself and then they're at the bottom.
  Professor B: Yeah.
  Grad F: Yeah.
  Postdoc A: Yeah.
  Grad F: Yeah. That's actually definitely a good point. The m email doesn't specify that you can just reply to the email, as op as opposed to going to the form
  Postdoc A: Mm - hmm.
  PhD H: In {disfmarker}
  Postdoc A: And it also doesn't give a {disfmarker} a specific {disfmarker} I didn't think of it.
  PhD E: Right.
  Grad F: and {disfmarker}
  Postdoc A: S I think it's a good idea {disfmarker} an ex explicit time by which this will be considered definite.
  Grad F: Yeah, release.
  Postdoc A: And {disfmarker} and it has to be a time earlier than that endpoint.
  Professor B: Yeah. It's converging.
  Postdoc A: Yeah. That's right.
  PhD H: This {disfmarker} um, I've seen this recently. Uh, I got email, and it {disfmarker} i if I use a MIME - capable mail reader, it actually says, you know, click on this button to confirm receipt {pause} of the {disfmarker} of the mail.
  Postdoc A: Oh, that's interesting.
  Grad D: Hmm.
  PhD H: So {disfmarker}
  Grad F: You {disfmarker} you can {disfmarker}
  Grad D: It's like certified mail.
  Grad F: A lot of mailers support return receipt.
  Postdoc A: Could do that.
  PhD H: Right.
  Grad F: But it doesn't confirm that they've read it.
  PhD H: No, no, no. This is different. This is not {disfmarker} So, I {disfmarker} I know, you can tell, you know, the, uh, mail delivery agent to {disfmarker} to confirm that the mail was delivered to your mailbox.
  Postdoc A: Mmm.
  Grad F: Right.
  PhD H: But {disfmarker} but, no. This was different. Ins - in the mail, there was a {disfmarker}
  Grad F: Oh, just a button.
  PhD H: uh, th there was a button that when you clicked on it, it would send, uh, you know, a actual acknowledgement to the sender that you had actually looked at the mail.
  Grad F: Oh, yeah. Yeah. Unfor - Yeah, we could do that. But I hate that.
  PhD H: But it o but it only works for, you know, MIME - capable {disfmarker} you know, if you use Netscape or something like that for your n
  Grad F: Yeah.
  Professor B: And {disfmarker}
  PhD E: You might as well just respond to the mail.
  Professor B: And we actually need a third thing.
  PhD E: I mean
  PhD H: Right.
  Professor B: It's not that you've looked at it, it's that you've looked at it and {disfmarker} and {disfmarker} and agree with one of the possible actions.
  PhD H: No, no. You can do that.
  Professor B: Right?
  PhD H: You know, you can put this button anywhere you want,
  Professor B: Oh? Oh, I see.
  PhD H: and you can put it the bottom of the message and say" here, by {disfmarker} you know, by clicking on this, I {disfmarker} I agree {disfmarker} {vocalsound} uh, you know, I acknowledge {disfmarker}" Professor B: That i i my first - born children are yours, and {disfmarker} Yeah. Yeah.
  PhD E: Quick question. Are, um {disfmarker}
  Grad F: Well, I could put a URL in there without any difficulty and {pause} even pretty simple MIME readers can do that. So.
  Postdoc A: But why shouldn't they just {pause} email back? I don't see there's a problem.
  Professor B: Yeah.
  Grad F: Yeah. Reply.
  PhD H: Right.
  Postdoc A: It's very nice. I {disfmarker} I like the high - tech aspect of it,
  Professor B: Yeah.
  Postdoc A: but I think {disfmarker}
  PhD H: No, no, no. {vocalsound} I actually don't.
  Postdoc A: I appreciate it.
  PhD H: I'm just saying that
  Grad F: Well, I {disfmarker} cuz I use a text mail reader.
  PhD H: if ev but I'm {disfmarker}
  PhD E: Don't you use VI for your mai?
  PhD H: Yeah.
  Professor B: Wow. That's {disfmarker} that's my guy. Alright.
  Grad F: You {disfmarker} you read email {pause} in VI?
  PhD H: Yeah.
  Postdoc A: Yeah. {vocalsound} I like VI.
  PhD H: So {disfmarker} I {disfmarker} i There's these logos {pause} that you can put at the bottom of your web page, like" powered by VI" .
  Grad D: Yeah.
  Professor B: Wow.
  Grad D: I see.
  PhD E: Anyway, quick question.
  Grad F: You could put wed bugs in the email.
  PhD E: How m
  PhD H: Yeah.
  PhD E: Like, there were three meetings this time, or so
  Postdoc A: Six.
  PhD E: or how many? Six? But, no of different people. So I guess if you're in both these types of meetings, you'd have a lot. But {disfmarker} {vocalsound} How {disfmarker} I mean, it also depends on how many {disfmarker} Like, if we release {disfmarker} this time it's a fairly small number of meetings, but what if we release, like, twenty - five meetings to people? In th
  Grad F: Well, what my s expectation is, is that we'll send out one of these emails {pause} every time a meeting has been checked and is ready.
  PhD E: I don't know. Oh. Oh, OK. So this time was just the first chunk. OK.
  Grad F: So. Tha - that was my intention. It's just {disfmarker} yeah {disfmarker} that we just happened to have a bunch all at once.
  PhD E: Well, that's a good idea.
  Grad F: I mean, maybe {disfmarker} Is that {pause} the way it's gonna be, you think, Jane?
  Postdoc A: I agree with you. It's {disfmarker} we could do it, uh {disfmarker} I I could {disfmarker} I'd be happy with either way, batch - wise {disfmarker} What I was thinking {disfmarker} Uh, so this one {disfmarker} That was exactly right, that we had a {disfmarker} uh, uh {disfmarker} I {disfmarker} I had wanted to get the entire set of twelve hours ready. Don't have it. But, uh, this was the biggest clump I could do by a time where I thought it was reasonable.
  Professor B: Mm - hmm.
  Postdoc A: People would be able to check it and still have it ready by then. My, um {disfmarker} I was thinking that with the {pause} NSA meetings, I'd like {disfmarker} there are three of them, and they're {disfmarker} uh, I {disfmarker} I will have them done by Monday. Uh, unfortunately the time is later and I don't know how that's gonna work out, but I thought it'd be good to have that released as a clump, too, because then, {vocalsound} you know, they're {disfmarker} they {disfmarker} they have a {disfmarker} it it's in a category, it's not quite so distracting to them, is what I was thinking, and it's all in one chu But after that, when we're caught up a bit on this process, then, um, I could imagine sending them out periodically as they become available.
  PhD E: OK.
  Postdoc A: I could do it either way. I mean, it's a question of how distracting it is to the people who have to do the checking.
  Professor B: We heard anything from IBM? at all?
  PhD C: Uh. Let's see. We {disfmarker} Yeah, right. So we got the transcript back from that one meeting. Everything seemed fine. Adam {pause} had a script that will {pause} put everything back together and there was {disfmarker} Well, there was one small problem but it was a simple thing to fix. And then, um, {vocalsound} we, uh {disfmarker} I sent him a pointer to three more. And so he's {pause} off and {pause} working on those.
  Grad F: Yeah. Now we haven't actually had anyone go through that meeting, to see whether the transcript is correct and to see how much was missed and all that sort of stuff.
  Postdoc A: That's on my list.
  Grad F: So at some point we need to do that.
  PhD C: Yeah.
  Postdoc A: Well, that's on my list.
  PhD C: Yeah. It's gonna have to go through our regular process.
  Grad F: I mean, the one thing I noticed is it did miss a lot of backchannels. There are a fair number of" yeahs" and" uh - huhs" that {disfmarker} it's just {disfmarker} that aren't in there. So.
  Postdoc A: Hmm.
  Professor B: But I think {disfmarker} Yeah. Like you said, I mean, that's {disfmarker} that's gonna be our standard proc that's what the transcribers are gonna be spending most of their time doing, I would imagine,
  Postdoc A: Mm - hmm. Mm - hmm, mm - hmm.
  Professor B: once {disfmarker} once we {disfmarker}
  Grad F: Yes, absolutely. Yeah.
  Postdoc A: One question about the backchannels.
  Professor B: It's gonna {disfmarker}
  Postdoc A: Do you suppose that was because they weren't caught by the pre - segmenter?
  Grad F: Yes, absolutely. Absolutely.
  Postdoc A: Oh, interesting. Oh, interesting. OK.
  Grad F: Yeah. They're {disfmarker} they're not in the segmented.
  Postdoc A: OK.
  Grad F: It's not that the {pause} IBM people didn't do it.
  Postdoc A: OK.
  Grad F: Just they didn't get marked.
  Postdoc A: OK. So maybe when the detector for that gets better or something {disfmarker} I w I {disfmarker} There's another issue which is this {disfmarker} we've been, uh, contacted by University of Washington now, of course, to, um {disfmarker} We sent them the transcripts that correspond to those {pause} six meetings and they're downloading the audio files. So they'll be doing that. Chuck's {disfmarker} Chuck's, uh, put that in.
  PhD C: Mm - hmm. Yeah, I pointed them to the set that Andreas put, uh, on the {vocalsound} web so th if they want to compare directly with his results they can. And, um, then once, uh, th we can also point them at the, um, uh, the original meetings and they can grab those, too, with SCP.
  PhD E: Wait. So you put the reference files {disfmarker}?
  PhD C: No, no. They d they wanted the audio.
  PhD E: Or the {disfmarker}?
  PhD C: Jane sent them the, uh, transcripts.
  PhD E: No, I mean of the transcripts. Um. Well, we can talk about it off - line.
  PhD C: Mm - hmm.
  Grad F: There's another meeting in here, what, at four? Right? Yeah, so we have to finish by three forty - five.
  PhD H: D d So, does Washi - does {disfmarker} does UW wanna u do this {disfmarker} wanna use this data for recognition or for something else?
  PhD C: Uh, for recognition.
  PhD E: I think they're doing w
  PhD H: Oh.
  PhD E: didn't they want to do language modeling on, you know, recognition - compatible transcripts
  PhD H: Oh. I see.
  Postdoc A: This is to show you, uh, some of the things that turn up during the checking procedure.
  Professor B: Yeah.
  PhD E: or {disfmarker}?
  Postdoc A: Um @ @ {comment} So, this is from one of the NSA meetings and, uh, i if you're familiar with the diff format, the arrow to the left is what it was, and the arrow to the right is {pause} what it was changed to. So, um. {vocalsound} And now the first one." OK. So, then we started a weekly meeting. The last time, uh {disfmarker}" And the transcriber thought" little too much" But, {vocalsound} uh, really, um, it was" we learned too much" , which makes more sense syntactically as well.
  PhD H: And these {disfmarker} the parentheses were f from {disfmarker}
  Postdoc A: Then {disfmarker} Oh, this {disfmarker} that's the convention for indicating uncertain.
  Grad F: U uncertains.
  Postdoc A: So the transcriber was right.
  PhD H: S
  Postdoc A: You know, she was uncertain about that.
  PhD H: OK.
  Postdoc A: So she's right to be uncertain. And it's also a g a good indication of the {disfmarker} of that.
  PhD H: Oh. {comment} OK.
  Postdoc A: The next one. This was about, uh, Claudia and {pause} she'd been really b busy with stuff, such as waivers. Uh, OK. Um, next one. Um. {vocalsound} This was {pause} an interesting one. So the original was" So that's not {disfmarker} so Claudia's not the bad master here" , and then he laughs, but it really" web master" .
  Grad F: Web master.
  Grad D: Oh. {comment} Uh - oh.
  Postdoc A: And then you see another type of uncertainty which is, you know, they just didn't know what to make out of that. So instead of" split upon unknown" , {comment} it's" split in principle" .
  Grad F: Yep.
  Grad D: Jane, these are from IBM?
  Grad F: Spit upon?
  Grad D: The top lines?
  Postdoc A: No, no. These are {disfmarker} these are our local transcriptions of the NSA meetings.
  Grad F: No, these are {pause} ours.
  Postdoc A: The transcribers {disfmarker} transcriber's version ver versus the checked version.
  Grad D: Oh. Oh, I see.
  Postdoc A: My {disfmarker} my checked version, after I go through it.
  Grad D: OK.
  Postdoc A: Um, then you get down here. Um. Sometimes some speakers will insert foreign language terms. That's the next example, the next one. The, uh, version beyond this is {disfmarker} So instead of saying" or" , especially those words," also" and" oder" and some other ones. Those sneak in. Um, the next one {disfmarker}
  Grad F: That's cool.
  PhD H: Discourse markers.
  Postdoc A: S
  PhD H: Discourse markers.
  Postdoc A: Sorry, what? Discourse markers? Sure. Sure, sure, sure.
  PhD H: Discourse markers.
  Postdoc A: And it's {disfmarker} and it makes sense
  PhD H: Yeah. Yeah.
  Postdoc A: cuz it's, like, below this {disfmarker} it's a little subliminal there.
  PhD H: Yeah. Yeah, yeah.
  Postdoc A: Um. OK, the next one, uh, {vocalsound} this is a term. The problem with terminology. Description with th the transcriber has" X as an advance" . But really it's" QS in advance" . I mean, I {disfmarker} I've benefited from some of these, uh, cross - group meetings. OK, then you got, um, {vocalsound} uh, instead of" from something - or - other cards" , {comment} it's" for multicast" . And instead of" ANN system related" , it's" end system related" . This was changed to an acronym initially and it should shouldn't have been. And then, you can see here" GPS" was misinterpreted. It's just totally understanda This is {disfmarker} this is a lot of jargon. Um, and the final one, the transcriber had th" in the core network itself or the exit unknown, not the internet unknown" . And it {disfmarker} it comes through as" in the core network itself of the access provider, not the internet backbone core" . Now this is a lot of {pause} terminology. And they're generally extremely good,
  PhD H: Mmm.
  Postdoc A: but, you know in this {disfmarker} this area it really does pay to, um {disfmarker} to double check and I'm hoping that when the checked versions are run through the recognizer that you'll see s substantial improvements in performance cuz the {disfmarker} you know, there're a lot of these in there.
  PhD H: Yeah. So how often {disfmarker}?
  Grad F: Yeah, but I bet {disfmarker} I bet they're acoustically challenging parts anyway, though.
  Postdoc A: No, actually no.
  Grad D: Mmm.
  Postdoc A: Huh - uh.
  Grad F: Oh, really? Uh, it's {disfmarker} Oh, so it's just jargon.
  Postdoc A: It's jargon. Yeah. I mean this is {disfmarker} cuz, you know you don't realize in daily life how much you have top - down influences in what you're hearing.
  PhD H: Well, but {disfmarker}
  Postdoc A: And it's jar it's jargon coupled with a foreign accent.
  PhD H: But {disfmarker} but {disfmarker} But we don't {disfmarker} I mean, our language model right now doesn't know about these words anyhow. So,
  Professor B: Yeah.
  PhD H: you know, un until you actually {pause} get a decent language model, @ @ {comment} Adam's right.
  Grad F: It probably won't do any better.
  PhD H: You probably won't notice a difference. But it's {disfmarker} I mean, it's definitely good that these are fixed. I mean, {vocalsound} obviously.
  Postdoc A: Well, also from the standpoint of getting people's approval,
  Professor B: Yeah.
  Postdoc A: cuz if someone sees a page full of uh, um, barely decipherable w you know, sentences, and then is asked to approve of it or not, {vocalsound} it's, uh, uh {disfmarker}
  Grad F: Did I say that?
  Professor B: Yeah.
  Postdoc A: OK.
  Professor B: Yeah. That would be a shame if people said" well, I don't approve it because {pause} the {disfmarker} it's not what I said" .
  Grad F: Well, that's exactly why I put the extra option in,
  Professor B: Yeah.
  Postdoc A: Exactly. That's why we discussed that.
  Professor B: Yeah.
  Grad F: is that I was afraid people would say," let's censor that because it's wrong" ,
  Professor B: Yeah.
  Grad F: and I don't want them to do that.
  Postdoc A: And then I also {disfmarker} the final thing I have for transcription is that I made a purchase of some other headphones
  PhD H: C
  Postdoc A: because of the problem of low gain in the originals. And {disfmarker} and they very much appro they mu much prefer the new ones, and actually I {disfmarker} I mean, I {disfmarker} I think that there will be fewer things to correct because of the {disfmarker} the choice. We'd originally chosen, uh, very expensive head headsets
  Grad F: Yeah. Ugh!
  Postdoc A: but, um, they're just not as good as these, um, in this {disfmarker} with this respect to this particular task.
  PhD H: Well, return the old ones.
  Grad F: It's probably impedance matching problems.
  Postdoc A: I don't know exactly,
  Grad F: But {disfmarker}
  Postdoc A: but we chose them because that's what's been used here by prominent projects in transcription.
  Professor B: Could be.
  Postdoc A: So it i we had every reason to think they would work.
  Grad F: Mm - hmm.
  PhD H: So you have spare headsets?
  Postdoc A: Sorry, what?
  PhD H: You have spare headsets?
  Grad F: They're just earphones. They're not headsets. They're not microphones.
  PhD E: Right.
  PhD H: No, no. I mean, just earphones? Um, because I, uh, I could use one on my workstation, just to t because sometimes I have to listen to audio files and I don't have to b go borrow it from someone and {disfmarker}
  Postdoc A: We have actua actually I have {disfmarker} W Well, the thing is, that if we have four people come to work {pause} for a day, I was {disfmarker} I was hanging on to the others for, eh {disfmarker} for spares,
  PhD H: Oh, OK.
  Postdoc A: but I can tell you what I recommend.
  Professor B: No, but you'd {disfmarker} If you {disfmarker} Yeah, w we should get it.
  PhD H: Sure. No problem.
  Grad F: But if you need it, just get it.
  PhD H: I just {disfmarker}
  Grad F: Come on.
  PhD H: Right.
  Professor B: Yeah. If you need it.
  PhD H: Yeah.
  Professor B: Yeah.
  Postdoc A: It'd just have to be a s a separate order {disfmarker} an added order.
  Grad D: Yeah, I still {disfmarker} I still need to get a pair, too.
  Professor B: They're {disfmarker} they're {disfmarker} they're {disfmarker} they're pretty inexpensive.
  PhD E: Yeah, that {disfmarker} We should order a cou uh, t two or three or four, actually.
  Professor B: Yeah.
  Grad D: I'm using one of these. Yeah.
  PhD E: We have {disfmarker}
  PhD H: I think I have a pair that I brought from home, but it's f just for music listening
  Professor B: No. Just {disfmarker} just {disfmarker} just {disfmarker} just buy them.
  PhD E: Sh - Just get the model number
  PhD H: and it's not {disfmarker} Nnn. Yeah.
  Professor B: Just buy them.
  PhD E: and {disfmarker} Where do you buy these from?
  PhD H: Yeah.
  Postdoc A: Cambridge SoundWorks, just down the street.
  PhD E: Like {disfmarker}? You just b go and b
  Postdoc A: Yeah. They always have them in stock.
  PhD E: Oh.
  Professor B: Yeah.
  PhD E: That'd be a good idea.
  PhD H: Anyway.
  Professor B: Yeah.
  Grad F: W uh, could you email out the brand?
  Postdoc A: Oh, sure. Yeah. OK.
  Grad F: Cuz I think {disfmarker} sounds like people are interested.
  Grad D: Yeah.
  Professor B: Yeah.
  Grad D: Definitely.
  Grad F: So.
  Postdoc A: It's made a difference in {disfmarker} in how easy. Yeah.
  Professor B: I realized something I should talk about. So what's the other thing on the agenda actually?
  Grad F: Uh, the only one was Don wanted to, uh, talk about disk space yet again.
  Grad D: Yeah. u It's short. I mean, if you wanna go, we can just throw it in at the end.
  Professor B: No, no. Why don't you {disfmarker} why don't you go ahead since it's short.
  Grad D: Um, well, uh.
  Grad F: Oh, I thought you meant the disk space. Yeah, we know disk space is short.
  PhD H: The disk space was short. Yeah. That's what I thought too.
  PhD E: That's a great ambiguity.
  Professor B: Yeah.
  PhD E: It's one of these {disfmarker} it's {disfmarker} it's social
  Professor B: It's {disfmarker} I i i it i
  PhD E: and, uh, discourse level
  Grad D: Yeah.
  PhD E: and {disfmarker}
  Professor B: Yeah, it's great. Yeah,
  PhD E: Sorry.
  Professor B: double {disfmarker} double {disfmarker}
  Grad F: Yeah, it was really goo
  PhD E: See, if I had that little {pause} scratch - pad, I would have made an X there.
  Grad D: Thank you, thank you.
  Grad F: Uh, well, we'll give you one then.
  Professor B: Yeah.
  Grad D: Um. {vocalsound} So, um, without thinking about it, when I offered up my hard drive last week {disfmarker}
  Grad F: Oh, no.
  Grad D: Um, this is always a suspect phrase.
  PhD E: It was while I was out of town.
  Grad D: But, um, no. I, uh {disfmarker} I realized that we're going to be doing a lot of experiments, um, {vocalsound} o for this, uh, paper we're writing, so we're probably gonna need a lot more {disfmarker} We're probably gonna need {vocalsound} that disk space that we had on that eighteen gig hard drive. But, um, we also have someone else coming in that's gonna help us out with some stuff.
  Professor B: We've just ordered a hundred gigabytes.
  Grad D: So {disfmarker} OK. We just need to {disfmarker}
  PhD E: I think we need, like, another eighteen gig disk {pause} to be safe.
  Professor B: Well, we're getting three thirty {disfmarker} thirty - sixes.
  PhD E: So.
  Professor B: Right?
  Grad D: OK.
  Professor B: That are going into the main f file server.
  PhD E: OK.
  Professor B: So.
  PhD C: Markham's ordering and they should be coming in soon.
  Grad D: W Well. So {disfmarker} so {disfmarker}
  Grad F: Soon?
  Grad D: Yeah. I mean, I guess the thing is is, all I need is to hang it off, like, {vocalsound} the person who's coming in, Sonali's, computer.
  PhD H: Oh, so {disfmarker} so, you mean the d the internal {disfmarker} the disks on the machines that we just got?
  Grad D: Whew. Or we can move them.
  Grad F: No.
  PhD C: These are gonna go onto Abbott.
  Grad F: Ne - new disks.
  PhD H: Or extra disk?
  Professor B: Onto Abbott, the file server.
  Grad D: So are we gonna move the stuff off of my hard drive onto that when those come in?
  Grad F: On {disfmarker}
  PhD H: Oh, oh. OK.
  Grad F: Yeah.
  PhD E: Uh, i
  Grad F: Once they come in. Sure.
  Grad D: OK. That's fine.
  PhD E: Do {disfmarker} when {disfmarker} when is this planned for {pause} roughly?
  PhD C: They should be {disfmarker} I {disfmarker} I imagine next week or something.
  Grad D: OK.
  PhD E: OK. So {disfmarker}
  Grad F: If you're {disfmarker} if you're desperate, I have some space on my drive.
  Grad D: I think if I'm {disfmarker}
  Grad F: But I {disfmarker} I vacillate between no space free and {pause} a few gig free.
  Grad D: Yeah. I think I can find something if I'm desperate
  PhD E: Yeah.
  Grad F: So.
  Grad D: and, um, in the meantime I'll just hold out.
  Grad F: OK.
  Grad D: That was the only thing I wanted to bring up.
  PhD C: It should be soon. We {disfmarker} we should {disfmarker}
  Grad D: OK.
  Professor B: So there's another hundred gig. So.
  Grad D: Alright. Great.
  PhD H: Mm - hmm.
  Professor B: OK. It's great to be able to do it,
  Grad D: That's it.
  Professor B: just say" oh yeah, a hundred gig,
  PhD E: Good.
  Professor B: no big deal" .
  Grad D: Yeah.
  Grad F: Yeah. A hundred gig here, a hundred gig there.
  PhD E: Well, each meeting is like a gig or something,
  Grad F: It's eventually real disk space.
  Professor B: Yeah.
  PhD E: so it's really {disfmarker}
  Professor B: Yeah. Um. Yeah. I was just going to comment that I I'm going to, uh, be on the phone with Mari tomorrow, late afternoon.
  Grad F: Oh, yeah.
  Professor B: We're supposed to {vocalsound} get together and talk about, uh, where we are on things. Uh, there's this meeting coming up, uh, and there's also an annual report. Now, I never actually {disfmarker} I {disfmarker} I was asking about this. I don't really quite understand this. She was re she was referring to it as {disfmarker} I think this actually {pause} didn't just come from her, but this is {pause} what, uh, DARPA had asked for. Um, she's referring to it as the an annual report for the fiscal year. But of course the fiscal year starts in October, so I don't quite understand w w why we do an annual report that we're writing in July.
  PhD C: She's either really late or really early.
  Grad F: Huh. Or she's getting a good early start.
  Professor B: Uh, I think basically it it's none of those. It's that the meeting is in July so they {disfmarker} so DARPA just said do an annual report. So. So. So anyway, I'll be putting together stuff. I'll do it, uh, you know, as much as I can without bothering people, just by looking at {disfmarker} at papers and status reports. I mean, the status reports you do are very helpful.
  PhD H: Hmm.
  Professor B: Uh, so I can grab stuff there. And if, uh {disfmarker} if I have some questions I'll {disfmarker}
  Grad F: When we remember to fill them out.
  Professor B: Yeah. If {pause} people could do it as soon as {disfmarker} as you can, if you haven't done one si recently. Uh. {vocalsound} Uh, but, you know, I'm {disfmarker} I'm sure before {pause} it's all done, I'll end up bugging people for {disfmarker} for more clarification about stuff. Um. {vocalsound} But, um, I don't know, I guess {disfmarker} I guess I know pretty much what people have been doing. We have these meetings and {disfmarker} and there's the status reports. Uh. But, um. Um. Yeah. So that wasn't a long one. Just to tell you that. And if something {vocalsound} hasn't, uh {disfmarker} I'll be talking to her late tomorrow afternoon, and if something hasn't been in a status report and you think it's important thing to mention on {vocalsound} this kind of thing, uh, uh, just pop me a one - liner and {disfmarker} and {disfmarker} and I'll {disfmarker} I'll have it in front of me for the phone conversation.
  PhD H: OK.
  Professor B: Uh. I guess, uh, you you're still pecking away at the {pause} demos and all that, probably.
  Grad F: Yep. And Don is {pause} gonna be helping out with that.
  Professor B: Oh, that's right.
  Grad F: So.
  Professor B: OK.
  Grad F: Did you wanna talk about that this afternoon?
  Grad D: Um.
  Grad F: Not here, but later today?
  Grad D: We should probably talk off - line about when we're gonna talk off - line.
  Grad F: OK. OK.
  Professor B: OK. Yeah, I might want to get updated about it in about a week cuz, um, I'm actually gonna have a {disfmarker} {vocalsound} a few days off the following week, a after the {disfmarker} after the picnic. So.
  Grad F: Oh, OK.
  Professor B: That's all I had.
  Grad F: So we were gonna do sort of status of speech transcription {disfmarker} automatic transcription, but we're kind of running late. So.
  PhD E: How long does it take you to save the data?
  Grad F: Fifteen minutes.
  PhD E: Yeah.
  Grad F: So. If you wanna do a quick
  PhD E: Yeah.
  Grad F: ten minute {disfmarker}
  PhD E: Guess we should stop, like, twenty of at the latest.
  Professor B: Uh {disfmarker}
  PhD E: We {disfmarker} we have another meeting coming in that they wanna record.
  Professor B: And there's the digits to do.
  PhD E: So.
  Professor B: So maybe {disfmarker} may maybe {disfmarker} maybe {disfmarker}
  Grad F: Yeah. Well, we can skip the digits.
  Professor B: We could. Fi - five minute report or something.
  PhD E: It's up to you. I don't {disfmarker}
  Professor B: Yeah, yeah.
  Grad F: Whatever you want.
  Professor B: Well, I would love to hear about it,
  Grad F: What do you have to say?
  Professor B: especially since {disfmarker}
  Grad F: I'm interested, so {disfmarker}
  Professor B: Yeah. Well, I'm gonna be on the phone tomorrow, so this is just a {pause} good example of {pause} the sort of thing I'd like to {pause} hear about.
  PhD E: Wait. Why is everybody looking at me?
  PhD C: I don't know.
  Grad F: Sorry.
  Professor B: Cuz he looked at you
  PhD H: What?
  Professor B: and says you're sketching.
  PhD E: Uh. I'm not sure what you were referring to.
  PhD H: I {disfmarker} I {disfmarker} I {disfmarker} I'm not {disfmarker} actually, I'm not sure what {disfmarker}? Are we supposed to have done something?
  Grad F: No. We were just talking before about alternating the subject of the meeting.
  PhD H: Oh.
  PhD E: Uh - huh.
  Grad F: And this week we were gonna try to do {pause} t automatic transcription {pause} status.
  PhD H: Alternating.
  PhD E: I wasn't here last week. Sorry.
  PhD H: Oh!
  PhD E: Oh.
  Grad F: But we sort of failed.
  PhD H: We did that last week. Right?
  PhD E: Hhh.
  Grad F: No.
  Professor B: I thought we did.
  Grad F: Did we? OK.
  PhD H: Yeah. We did.
  Grad F: OK. So now {disfmarker} now we have the schedule. So next week we'll do automatic transcription status, plus anything that's real timely.
  PhD H: OK.
  PhD E: Oh. OK.
  Postdoc A: OK.
  Professor B: OK. Whew!
  PhD C: Good update.
  Grad F: Whew!
  Professor B: That was {disfmarker}
  Grad F: Dodged that bullet.
  Professor B: Yeah. Nicely done, Liz.
  Postdoc A: A woman of few words.
  Professor B: But {disfmarker} but lots of prosody. OK. {vocalsound} OK.
  Grad F: Th
  PhD H: Uh, I mean, we {disfmarker} we really haven't done anything.
  Grad F: Excuse me?
  PhD H: Sorry.
  Postdoc A: Well, since last week.
  PhD E: Yeah, we're {disfmarker}
  PhD H: I mean, the {disfmarker} the next thing on our agenda is to go back and look at the, um {disfmarker} {vocalsound} the automatic alignments because, uh, I got some {disfmarker} I {disfmarker} I {disfmarker} I learned from Thilo what data we can use as a benchmark to see how well we're doing on automatic alignments of the background speech {disfmarker} or, of the foreground speech with background speech.
  Grad F: Yeah.
  PhD H: So.
  PhD E: And then, uh, I guess, the new data that Don will start to process {disfmarker}
  PhD H: But, we haven't actually {disfmarker}
  PhD E: the, um {disfmarker} when he can get these {disfmarker} You know, before we were working with these segments that were all synchronous and that caused a lot of problems
  PhD H: Mmm.
  PhD E: because you have timed sp at {disfmarker} on either side.
  Grad F: Oh. Right, right. Mm - hmm.
  PhD E: And so that's sort of a stage - two of trying the same kinds of alignments with the tighter boundaries with them is really the next step.
  Grad F: Right.
  Postdoc A: I'll be interested.
  PhD E: We did get our, um {disfmarker} I guess, good news. We got our abstract accepted for this conference, um {disfmarker} workshop, ISCA workshop, in, um, uh, New Jersey. And we sent in a very poor abstract, but they {disfmarker} very poor, very quick. Um, but we're hoping to have a paper for that as well, which should be an interesting {disfmarker}
  Grad F: When's it due?
  PhD E: The t paper isn't due until August. The abstracts were already due. So it's that kind of workshop.
  Grad F: Mm - hmm.
  PhD E: But, I mean, the good news is that that will have sort of the European experts in prosody {disfmarker} sort of a different crowd, and I think we're the only people working on prosody in meetings so far, so that should be interesting.
  Postdoc A: What's the name of the meeting?
  PhD E: Uh, it's ISCA Workshop on Prosody in Speech Recognition and Understanding, or something like that {disfmarker}
  PhD H: It's called Prosody to {disfmarker}
  Grad F: Mm - hmm.
  Postdoc A: Good.
  PhD E: some generic {disfmarker} Uh, so it's focused on using prosody in automatic systems and there's a {disfmarker} um, a web page for it.
  Professor B: Y you going to, uh, Eurospeech? Yeah.
  Grad F: I don't have a paper
  PhD H: Yeah.
  Grad F: but I'd kinda like to go, if I could. Is that alright?
  Professor B: We'll discuss it.
  Grad F: OK. {vocalsound} I guess that's" no" .
  Professor B: My {disfmarker} my {disfmarker} my car {disfmarker} my car needs a good wash, by the way.
  Grad F: OK. Well, that th Hey, if that's what it takes, that's fine with me.
  Professor B: Um.
  Grad F: I'll pick up your dry - cleaning, too. Should we do digits?
  Professor B: Yeah.
  Grad F: Uh.
  PhD H: Can I go next? Because I have to leave, actually.
  Grad F: Yep. Go for it. Hmm! Thanks. Thank you.
  Professor B: So you get to be the one who has all the paper rustling. Right?
output: The team decided to release their data on July 15th, but they still wanted to give people time to bleep things from the transcripts. There was skepticism that they could actually reach out to people and get everyone's consent that they were okay with whatever was being released.