6
$\begingroup$

I just got my statistics test back and I am totally confused about one of the questions!

A study was done that took a simple random sample of 40 people and measured whether the subjects were right-handed or left-handed, as well as their ages. The study showed that the proportion of left-handed people and the ages had a strong negative correlation. What can we conclude? Explain your answer.

I know that we can't conclude that getting older causes people to become right-handed. Something else might be causing it, not the age. If two things are correlated, we can only conclude association, not causation. So I wrote:

We can conclude that many people become right-handed as they grow older, but we cannot tell why.

That's exactly what association means, but my teacher marked me wrong! What mistake did I make? Is 40 too small of a sample size to make any conclusions?

  • 0
    We had a discussion over on mathoverflow about whether or not this exact question has any mathematical merit. We concluded that it does not and is therefore off topic.2010-07-22
  • 0
    It might be off-topic on MO, but I'm not sure if there is a consensus yet on MU whether or not to allow statistics-related questions. However, there is already a [Statistics StackExchange 2.0 Site](http://area51.stackexchange.com/proposals/33/statistical-analysis) in Beta that will be public before this one, so this question might be more proper for that.2010-07-22
  • 2
    @Harry: I am not at all surprised that this question was deemed inappropriate for MathOverflow. However, that doesn't necessarily makes it off-topic here. @Justin: stats.stackexchange is intended for professionals in statistics-related fields. I think that such an elementary question would be a much better fit here.2010-07-22
  • 0
    @Kaestur -- ah, I guess I misunderstood what stats was about. In that case, I don't see anywhere that this mathematics-related question could possibly be asked. Undoubtedly, this question was asked in a Math class. But in regards to @Harry, it is important to note that MO and MU have different criteria for valid questions.2010-07-22
  • 0
    @Justin: We did not deem it inappropriate for MO. We deemed it "lacking mathematical content". Any answer to this question cannot be mathematical. It only requires a little bit of thought to see this.2010-07-22
  • 0
    @Harry the criteria for mathematical content might vary across sites, and it seems premature to conclude that they are the same without proper community discussion. I honestly do not see *much* mathematics behind the answer to this question at all, and am wondering whether this is an appropriate question for this site. But undoubtedly the question arose from Math-related concerns, and it's a grey line that might be better left for the community to decide as a whole.2010-07-22
  • 0
    @Justin: I am saying that no possible answer can be math-related. The example in this question proves why.2010-07-22
  • 4
    Maybe there's a difference between "math-related" and "of interest and direct relevance to those studying/using math or related things." I dislike this question as asked, as I did the corresponding one on MO, but there were several useful answers about mathematical measures of causation versus correlation on MO, and I think several people benefitted from the discussion. Part of learning math is dealing personally with the choices and philosophical issues it raises, so within reason, I think questions addressing those can be valuable.2010-07-22
  • 0
    That said, it'd be case-by-case, and there are several typical, terrible "philosophical" math questions that I would vote to close.2010-07-22
  • 2
    It's certainly not a math question. The 'correct' answer, as far as I'm concerned, should address the difference between longitudinal and cross-sectional studies, which is clearly in the realm of statistics. Whether we consider statistics questions to be math-related is less clear. Personally, I would consider anything covered in a freshman statistics course (regression, probability, box models, confidence intervals) to be fair game for math.stackexchange, and that is the context in which I get asked this question.2010-07-22
  • 0
    @Katie: I'm glad to hear more about how it worked out on MathOverflow. Half the reason I asked this question was to elicit such responses. Of course, the other half was to spark this exact discussion on what statistics questions to allow.2010-07-22
  • 0
    @Kaestur: I think that "mathematical statistics" is on-topic, but philosophical questions about statistics (not mathematics) are not.2010-07-22
  • 0
    FWIW, we were having the same exact discussion on stats.stackexchange.com. While there is no consensus as yet I posted the answer below in response to "How do we handle overlap with mathoverflow?"2010-07-22
  • 0
    "My feeling is that this will depend on the kind of 'experts' that use this site. A few examples: (a) Theoretical questions on measure theory can be bounced to MO if no one here can answer them, (b) Very basic questions involving probability can be bounced to http://math.stackexchange.com/ or perhaps answered here itself. Anything in between basic probability and measure theory we should be able to handle."2010-07-22
  • 0
    BTW, the above question with some changes to make it a bit more specific would, I think, be welcome on stats.stackexchange.com. Mind you this is just my opinion and obviously I am not in any sense speaking for the community over there.2010-07-22
  • 0
    @Srikant: Thanks for reposting that, for some reason I don't have access to stats.stackexchange even though I committed a while ago. In the class I taught for, this topic was covered before we got touched on probability. Whether it is more basic is hard to answer though.2010-07-22

4 Answers 4

3

This is wrong: "We can conclude that many people become right-handed as they grow older." We cannot conclude this at all from the given data.

For one, the study only takes a sample at one point in time, rather than selecting a sample and monitoring their progress through many decades. This is what would be needed for us to even entertain the possibility that aging causes a change in handedness.

Other possible causes include that left handed people might have a shorter life expectancy, or perhaps there was a spike in the birth rate of right handed people in the past. There are many other possibilities that have been mentioned in others answers which would also account for the skewed proportions without requiring people to change handedness with age, which is what you falsely concluded in the test.

Also, just an observation, but it appears the "study" was conducted under false pretenses. Handedness is a false dichotomy, people can also be ambidextrous.

  • 1
    observations like this should probably be left as comments.2010-07-22
  • 0
    @Katie Noted, edited so answer comes before observation.2010-07-22
  • 0
    Why can't I conclude that? All I am saying is that there is association! Isn't that what correlation means?2010-07-22
  • 1
    @Kaestur, you cannot conclude that people *become* right handed, only that the proportion of right handed people to left handed people appears larger. Sure, left handed people learning to use their right hands is one possibility, but definitely not the only one, and I give two other possibilities in my answer.2010-07-22
  • 0
    It was directly stated that there is a negative correlation. AKA association. Isn't that what my conclusion says?2010-07-22
  • 0
    This is wrong: "We can conclude that many people become right-handed as they grow older." We cannot conclude this at all from the given data. For one, the study only takes a sample at one point in time, rather than selecting a sample and monitoring their progress through many decades. This is what would be needed for us to even entertain the possibility that aging causes a change in handedness. There are many other possibilities in my answer and in others which account for the skewed proportions *without* requiring people to change handedness with age, which is what you falsely concluded.2010-07-22
  • 0
    @Kaestur Done :)2010-07-23
1

Here is one example of a plausible explanation that disagrees with your analysis:

Cultural expectations for left- and right-handedness have changed over time. Older people may have gone to school at a time where left-handedness was discouraged and students were forced to write with their right hands, training children never to use the left hand instead of the right. Younger participants in the study were in school more recently and learned to write at a time where left-handedness was not discouraged, creating a positive correlation between left-handedness and youth.

0

We can only conclude that the result is interesting and it deserves more research.

Without further study we can not say if right-handedness causes age (ie. being left handed causes biological alterations that shorten the life span), age causes right-handedness (ie. as people age they become right handed), they are correlated because they are caused by another variable (ie. older people became educated in a different system that discouraged left-handedness), the study had bad luck selecting its sample, the study sample was bad designed, the study was bad designed, etc.

  • 0
    So strong correlation only means "interesting?" I understand that we need an experiment before we decide there is causation, but I thought correlation meant there was association! Isn't that what I wrote?2010-07-22
  • 0
    Not really what you wrote. You wrote that "people become right handed as they grow older" which either means age -> right-handedness or age <-> right-handedness. But if there is another factor that influences both, those statements may be false. With the question as stated nothing can be concluded, more information is needed. Or do you believe in http://en.wikipedia.org/wiki/Paul_the_octopus ?2010-07-22
  • 0
    I didn't say that getting older made them right handed, just that they happen to show up together.2010-07-22
0

Without getting much into conclusions that can be drawn from correlation coefficients, I wanted to point out a few things about sample size...

10% of people are left-handed. https://www.huffingtonpost.com/2012/10/29/left-handed-facts-lefties_n_2005864.html

That means, unless you have specific data stating otherwise, it is likely that this hypothetical study sampled 36 right-handed people and 4 left-handed people. The sampled ages of 4 left-handed people will tell you basically nothing about their mortality rate. The difference in longevity between left-handed and right-handed people is probably not very high, so accurately approximating the difference would require quite a high sample size of each population (probably about 100-300 of each). For further reading, see how to select sample size based on standard error (if it is known or can be reasonably estimated) and confidence level.

There is also an experimental design error. Taking a survey of the ages of a few living people doesn't give a very good estimation of the life expectancy of these populations. If you went to the morgue and surveyed the age of the last N people who died, you would be somewhat closer to having an accurate measure of life expectancy.

You also made a serious error in how you worded your conclusion, which others have pointed out.

Also, this is far beyond the scope of the pure math that you're being tested on, but it happens that the left-handed portion of the population declined to about 3% during the Victorian era, before rising back up to 10% in the present. This could be largely because people of the time were pressured to become right-handed, and could also correlate to the design of industrial tools of the time. Correlation doesn't necessarily imply causation, and the most common reason why is that there might be a third variable that is unnaturally forcing the correlation. In this case, the life expectancy of people living in the present may not vary greatly between the left-handed and right-handed; but lack of knowledge about historical context might increase the likelihood of making a correlation = causation mistake, or historical data might imply a difference in life expectancy that once existed but now does not. https://www.snopes.com/fact-check/left-hand-right-hand-death/