4
$\begingroup$

Situation A: Once only, I toss 2 identical fair coins and don't look at the outcomes. A truthful observer looks at one of the coins and tells me that at least one of the coins is a head.

Situation B: Once only, I toss 2 identical fair coins and don't look at the outcomes. A truthful observer looks at both of the coins and tells me that at least one of the coins is a head.

In A, what is the probability that there are 2 heads?

In B, what is the probability that there are 2 heads?

Aren't both probabilities 1/2?

EDIT

Let me refine the question. The agreement I have with the observer is this: 1) I will toss 2 identical coins.
2) In situation A a third party will cover the coins with a cloth. The observer will look only at the outcome of the coin that comes to rest nearest him and report it to me. What is the probability that the second outcome will be the same as the first?
3) In situation B the observer will look at both outcomes and report only the state (heads or tails) of the coin that came to rest nearest him. What is the probability that the second outcome will be the same as the first?

2nd EDIT

Changing 3) above to: 3) In situation B the observer will look at both outcomes, choose one of them, and truthfully report, "There is at least one heads", or "There is at least one tails", whichever is the case. What is the probability that the second outcome (that of the other coin) will be the same as the first?

  • 2
    You've just confused the issue with your edit, NotSuper. In situation B, why should the observer look at both coins, when the state of the farther coin is irrelevant? It might as well be covered by your cloth. This is really beginning to look like a Monty Hall debate.2010-12-24
  • 0
    @TonyK So what are the probabilities for A and B as of my first edit? I'll now edit again and have the observer look at both coins in B and pick one, about which he will tell me, if it's heads, "There is at least one heads", or if tails, "There is at least one tails". What is the probability of the other outcome being heads or tails, respectively?2010-12-24

3 Answers 3

8

No. There are four possibilities with two coins. For the time being identify one coin as X and one coin as Y. You have either

X = 1, Y = 1

X = 0, Y = 1

X = 1, Y = 0

X = 0, Y = 0

(where 1 is heads and 0 is tails). A truthful observer who only looks at coin X and ignores coin Y will say: "there is at least one head" in cases 1 and 3. A truthful observer who only looks at coin Y and ignores coin X will say: "there is at least one head" in cases 1 and 2. In either of those situations, only one of the two cases have the other coin as a head. So the probability of two heads is 1/2.

On the other hand, a truthful observer who looks at both coins will say: "there is at least one head" in cases 1, 2, and 3. Out of those only 1 case has two heads. So the probability of that is 1/3.


By choosing only one of the coins to look at, you are looking at the probability

$$ \mathbb{P}\{ X = 1 | \mbox{ Observer chooses }Y\mbox{ and }Y = 1\} $$

plus the same with $X$ and $Y$ swapped. Since $X$ and $Y$ are independent, it is equal to

$$ \mathbb{P}\{X = 1\} \cdot \mathbb{P}\{\mbox{ Observer chooses } Y\} + \mathbb{P}\{Y = 1\} \cdot \mathbb{P}\{\mbox{ Observer chooses } X\} = 1/2$$

In the case where the observer sees both coins, you are looking at the conditional probability

$$ \mathbb{P}\{ Y + X = 2 | Y + X \geq 1 \} $$

that the sum of the variables $Y$ and $X$ is 2 when we know their sum is at least 1. Clearly the conditioning is not independent of what you are testing! You can establish that the above is 1/3 by counting the total number of ways $A+B$ can be at least 1 as was done above.

  • 0
    Of course, part of the problem is semantics. Let me make the intuition clearer for you by adding a 3rd neutral party. Neutral party tosses two coins. And covers up each coin with a piece of cloth. Situation (A) your truthful observer picks one piece of cloth, the neutral party reveals the answer under that piece of cloth. Truthful observer reports back to you. Situation (B) your truthful observer looks under both pieces of cloth, and reports back to you. By adding the piece of cloth I am making it clear that in (A), the observer makes his report with *no knowledge whatsoever* of the other coin2010-12-24
  • 0
    whereas in (B), the observer has knowledge of both coins. So this emphasizes how when the truthful observer decides one coin to observe ad to ignore the other coin, he makes whatever result he will report independent of the outcome in the other coin.2010-12-24
  • 0
    @Willie It seems absurd to me that the probabilities could be different due to the different knowledge the observer has of the outcomes: knowing about only one of the coins versus knowing about both the coins. What he tells me is identical (and truthful) in both situations: "At least one of the coins is a head".2010-12-24
  • 0
    @NotSuper: But what *information* that statement gives you is different in the two situations. Think of it this way, perhaps. In situation A, there was *a priori* only a 50-50 chance that the observer would be able to state that one of the coins is heads. So when he does make that claim, it gives you some more information about the state of the coins. In situation B, the observer has it easier: in 3 out of 4 cases, he'll be able to state that at least one of two coins is heads. When he does, it's not as surprising, and so less informative; you know less about the state of the coins than in A.2010-12-24
  • 0
    @NotSuper: This applies only to your original question, not to your edit.2010-12-24
  • 0
    @Rahul Thank you for not giving up on me. I thought I'd written the question (before the edits) to indicate that in A and B the coins had already been tossed, with at least one heads in both cases, as reported by the observer. In A, the situation is such that the one coin the observer looks at IS heads; in B at least one of the 2 coins he looks at IS heads. Those are givens. Their probabilities are irrelevant, IMO. Therefore my claim that I receive exactly the same information from the observer in both cases.2010-12-24
  • 0
    @NotSuper: Actually, let me correct myself. What the observer tells you is *not* identical in both situations. In A, what you learn from the observer is "The first coin is heads", which implies but is not implied by "At least one of the coins is heads".2010-12-25
  • 0
    @Rahul: In A the observer only knows about the one coin he looks at. He tells me that at least one of the coins is heads, which in A must mean that the coin he looked at is heads. IOW "At least one of the coins is heads" DOES imply "The first coin is heads". No?2010-12-25
  • 0
    @all: It suddenly hit me that I didn't need that truthful observer. I could more clearly think about the problematic situation B if I 1) Removed he truthful observer (and also Willie Wong's helpful 3rd party with the piece of cloth). 2) Did the coin tossing myself -- tossing both coins myself, ignoring the 2 tails 0 heads outcomes until I had an outcome of at least one heads. This is exactly equivalent to the situation B of my original question (before my unfortunate edits). It may be difficult for some of you patient and not-so-patient people to believe, but as soon as2010-12-26
  • 0
    I saw this equivalence, I realized that an outcome of 2 heads was twice as likely as an outcome of 1 heads. But just so I could report on it, I decided to run a test. I got out 2 Roosevelt dimes (a ten-cent U.S. coin with FDR's head on one side), and a smallish, topless, cylindrical bottle, about 1.5 inches in diameter and 2 inches high, with which I could shake the dimes before dumping them out on a flat surface. The plan was to keep tossing (more like dumping dice from a dice cup) the pair of dimes, ignoring 2-tails outcomes, and tallying the number of heads (1 or 2) in the2010-12-26
  • 0
    at-least-one-heads outcomes. I would continue until I had tallied 100 at-least-one-heads outcomes. The result, if anyone's curious, was 70 1-heads, 30 2-heads. As for situation A, its equivalence could be tossing the coins together but only tallying the number of heads (1 or 2) of those outcomes where the nearest coin was heads. An outcome where the nearest coin was tails would be ignored. But of course this is equivalent to just tossing one coin and considering the probability of heads (1/2).2010-12-26
2

A is easy.
In B, if you know in advance that the observer is just going to let you know whether the number of heads is zero or non-zero, then the probablity is 1/3.
If you don't know in advance what the observer is going to reveal, then the probability calculation involves the observer's strategy (what information the observer intends to reveal depending on the number of heads). So you can't calculate the probability. This is at the heart of the Monty Hall problem.

  • 0
    With my edit I believe I've removed any possible analogy with the Monty Hall problem. How about it?2010-12-24
0

I'm posting this as a separate answer so as to stop bothering Willie with incessant comment notifications. Of course, the other answers that have been posted are completely correct, and I'm only trying to help you reconcile your intuitive reasoning with their results.

In situation A, the information you obtain about the state of the coins is, "The first coin is heads."

In situation B, the information you obtain is, "At least one of the coins is heads."

These are not equivalent; the former is not implied by the latter, because in B you cannot conclude that the first coin is heads. In other words, the observer's statement in conjunction with your knowledge of the observer's strategy enables you to make a stronger conclusion about the coins in situation A.

If you wish, I can clarify (a) how the observer's strategy affects things, as TonyK has also mentioned, and/or (b) why in situation B the probability is 1/3 and not 1/2 as you expect.

  • 0
    @Rahul Sure I want what you have to say. In my last comment both of us were dealing only with situation A. You aren't disagreeing with my argument there, are you? As for the observer's strategy, I don't believe I've left room for him to have one. So please clarify. As for probability spaces, I was familiar with them before I asked the question -- I just don't agree that they are of much use here, or have been used in a way that doesn't reflect the situations I've posed. For example, in the one-or-two girls problem, some were allowing for boy-boy to be an original possibility --2010-12-25
  • 0
    whereas I was presenting situations where to begin with there already is one girl. So I visit a family who have two kids. One comes in the living room to meet me. She's a girl. So I'm wondering to myself if the other child is a girl -- and thinking that the probability of the other child being a girl is 1/2. There is no boy-boy. Only girl or boy. Some have set the situation up as examining a random sample of 2-child families. But there is no study. This is a one-off. I just happened to visit this family one day. Examining the gender or number of their kids was not on my mind.2010-12-25
  • 0
    However, I meet one of their children and wonder about the other one. Similarly with the coins. The situations are given, as I've stated. There IS one heads (this is a given), no matter whether the observer looks at only one (it may be misleading to call this one coin "the first coin") or both. In both A and B he supplies me with information which together with some logical deduction on my part, informs me that there is at least one heads. The observer has no strategy. He simply reports. It doesn't matter whether he looked at both coins or only one before reporting. Your turn. Thanks, Rahul.2010-12-25
  • 0
    @NotSuper: Well, no, in *my* last comment, I was comparing situations A and B, responding to your proposition that "I receive exactly the same information from the observer in both cases". I was trying to show that your knowledge of the coins is different in situations A and B. Do you disagree with this?2010-12-25
  • 0
    @NotSuper: As for the rest of your comments, it seems you are running up against a deeper issue here, namely that when you speak of probabilities, you *are* implicitly considering a random sample in a space of possibilities! It makes no sense to ask of the probability of a single one-off event in a vacuum. For example, what is the probability is that I have a brother? The question can only make sense if you consider me a random person from a large sample space, and ask instead the probability that a random person from that set has a brother.2010-12-25
  • 0
    @Rahul: I believe you want to deal with my original question, in its pristine state before I confused things (so said TonyK) by editing it. So lets do that. Also, when we refer to a comment by one of us, lets definitively identify which comment. What I've tried to make clear is that both A and B BEGIN with the coins already having been tossed, resulting in at least one heads. In addition, the observer has already reported as specified -- telling me that at least one of the coins is heads.2010-12-26
  • 0
    (continuing) Both the probability of the toss resulting in A and probability of the toss resulting in B are not under consideration, and are irrelevant to the question I asked. In addition, my position is that both A and B are equivalent to a situation C, in which one coin is tossed, and I consider the probability of the outcome being heads (1/2). You and others don't seem willing to accept either A or B as givens. I think I'll stop here to see how you respond.2010-12-26
  • 0
    @NotSuper: I'm going to find it impossible to have this discussion if you don't respond to anything I say and just start making your own statements every time. Can you state whether or not you agree with my latest two comments ("Well, no, in my last comment..." and "As for the rest of your comments...")?2010-12-26
  • 0
    @Nahul: Sorry. As for your "Well, no, in my last comment..." comment, my answer is "Yes, I disagree". As for your "As for the rest of your comments..." comment, you say, "It makes no sense to ask of the probability of a single one-off event in a vacuum. For example, what is the probability that I have a brother?" I agree. It also makes no sense to ask the probability that one of the coins is heads if I already know that there is at least one heads. That's the given. I know how to compute the probability of tossing 2 coins and getting at least one heads. But that's not relevant to my question.2010-12-26
  • 0
    (continuing) The toss in A and the toss in B have already been made that produce at least one heads each. THESE are the tosses being reported on. It matters not what the sample space of tossing 2 coins is. The observer is to ignore any toss that does not produce at least one heads. The relevant sample space is the sample space of tossing one coin.2010-12-26
  • 0
    @NotSuper: "Yes, I disagree"... Can you elaborate? What part of my explanation in the answer I posted do you disagree with?2010-12-27
  • 0
    @NotSuper: "It matters not what the sample space of tossing 2 coins is. The observer is to ignore any toss that does not produce at least one heads. The relevant sample space is the sample space of tossing one coin." That's the very thing we're arguing about, so it's disingenuous to simply assert it as true. The relevant sample space is in fact the sample space of tossing two coins, where the samples that do not produce at least one heads have been removed. This is *not* equivalent to the sample space of tossing one coin.2010-12-27
  • 0
    @NotSuper: I see that you are still coming at this from the perspective that you are correct, and not from the perspective that your reasoning is flawed and you are trying to understand why. I encourage you to do a practical experiment, whether in real life or programmatically, and actually test your hypothesis.2010-12-27
  • 0
    @Rahul: Please read my long comment (posted some 3 hours before your last, beginning with "@all: It suddenly hit me that I didn't need that truthful observer." and tell me what you think. I put it under Willie Wong's answer because I wanted to credit him belatedly with the first (and good) answer. I also want to give you an "up" vote for yours (really for sticking with me), but apparently I screwed up at some time before. When I click the up-arrow by your answer I'm told I've already voted and can do nothing unless the answer is edited. I'm sure that I didn't intentionally do any voting at all2010-12-27
  • 0
    for or against anyone's answer, but I may have accidentally pressed the left button of my mouse when the cursor was over an arrow. But if you make even a tiny edit to your answer I'll be able to give you an up vote.2010-12-27
  • 0
    @NotSuper: It's no problem. I'm just glad you were able to come to the right conclusion.2010-12-27