Opinion



By Steven D. Levitt October 17, 2006, 9:04 am

TV causes autism? I doubt it.

An article in Slate yesterday argued that TV watching causes autism. The Slate article is based on research done by Cornell economists Michael Waldman, Sean Nicholson, and Nodir Adilov. You can download the academic working paper here.

The paper gives some theories why TV and autism might be linked, but the more interesting part of the paper is the data analysis. The researchers are trying to find a “natural experiment” that shifts around TV watching, but otherwise has no impact on whether a child is diagnosed as autistic. Rainfall is one of the things they use. In places where it rains a lot, kids watch more TV. Maybe rainfall doesn’t affect autism in any other way. This is a creative approach, although it suffers from the weakness (which they acknowledge in the paper), that rainfall changes other things, like how much time you spend indoors doing other things besides watching TV. They also use the arrival of cable TV in an area. This approach is potentially stronger, although it would be better if they used availability of cable TV, rather than the number of people who actually subscribe.

These are intriguing approaches, but personally I did not find the empirical evidence in the paper very compelling.

The rainfall evidence is based off of three states: Washington, Oregon, and California. It rains a lot in some parts of these states, but not others. There is more autism in the parts of the states where it rains more. The problem is that it rains on the coast of Oregon and Washington, and in Northern California. But there are a million other differences between the coast of Washington and the Eastern part of the state, and between Northern and Southern California. The researchers also look at how much rain there was when you were between the ages of 0-2, controlling for your county. This is more promising. The impact of rain gets smaller, but it is the most convincing evidence in the paper.

The data analysis of cable TV is limited to California and Pennsylvania and also finds positive results. The difficulty with the cable TV analysis is that there is an incredibly strong positive trend in autism. The cable TV data are basically on an upward trend. The regression analysis is going to have a very hard time sorting out between a steady rise in cable TV penetration and the time trend. In the current version they only include a linear time trend, which is an extremely powerful predictor. My guess is that if they generalize their specification to allow for non-linear time trends, the cable TV result will disappear.

The authors have done some interesting work, but the nature of the problem makes it a really hard one to answer convincingly. For instance, you might think that Oregon and California should have similar autism rates. Nope, Oregon’s rate is four times higher. That sort of gap is almost certainly due to differences in what is called autism in the official data in one state versus the other. The increasing time trend is also heavily influenced by what is labeled autism. When the outcome of interest is measured so poorly, it is hard to know what the analysis is really picking up — differences in the underlying symptoms or just in the reporting of them.

The more I thought about it, the more it seemed to me that there might be a causal link between rainfall, TV, and autism, but not the one suggested by the paper.

My theory: when it rains a lot, parents watch more TV, see more shows about autism, and this leads them to seek out a diagnosis of autism for their kids. They have the same kids, it is just that TV makes them believe that their kids are autistic.

I don’t mean to sound overly negative on this research. I applaud the authors for asking a daring hypothesis and gathering data to try to test it. My gut, though, tells me that this is a result which will not stand up to scrutiny.


From 1 to 25 of 36 Comments

  1. 1. October 17, 2006 9:43 am Link

    The Slate link is broken.

    This is a fascinating study. That they even find these partial correlations for diagnosis and rain is itself interesting (even if they are, as you not, just picking up a causal relationship between TV and doctor visits, and not actual autism itself).

    — scott cunningham
  2. 2. October 17, 2006 9:58 am Link

    Thank you for the thoughtful analysis. I am taking this study with some grains of salt as it relies so much on data analysis and not on actual observation and experience of autistic children and persons watching TV (which I tried to describe in this post).

    — Autism Vox
  3. 3. October 17, 2006 10:58 am Link

    The study is hogwash. Besides not establishing a causal relationship of any kind, it fails the most basic kind of test … what about all the people that watch TV but don’t have autism?

    TV is so pervasive, it seems like it would be a correlating factor in any study. I also agree that someone with TV would be more likely to seek help when they see a display of autism on TV. Someone who doesn’t have TV? Probably doesn’t have the money to seek that kind of help.

    I completely reject the notion, however, that this was a “daring hypothesis”. TV is a firebrand. Why not go after something truly daring, like drinking water or some other environmental cause? Heck, even high voltage power lines are a tougher target than TV.

    I’d like to see a study really go on a limb and pursue the results, rather than just present them. OK, so autistic kids tend to be in states where there is higher-on-average rainfall. That would tend to drive people indoors. Now lets look deeper. Sure, TV is a factor, but what are other factors? What are the relative ages of the homes? What building materials were in common use when those homes were built? What are the pipes made of? The insulation? TV was a cop-out result.

    — SuperRob
  4. 4. October 17, 2006 1:15 pm Link

    Did the study control for the occupations of the parents?

    As for example, here:
    http://www.autism.org/temple/jobs.html

    High-functioning or borderline autistic people tend to be better at handling certain jobs than others. For example, engineering and computer programming are good fields for autistic people who may lack some people skills but may excel at math, visual thinking or memorizing facts.

    Parents who may may have some autistic traits are more likely to have autistic children.

    So areas of the country that just happen to be located near Silicon Valley, Microsoft, Boeing, etc. might just happen to have more of these types of people who are more likely to have autistic children.

    Any slight trend in that direction is likely to be reinforced by the fact that an elevated population in one area of people who have an increased risk of having a child with autistism, there is going to be more couples where *both* parents have this increased risk. Furthermore, in an area where there is more autism, there will be a greater tendency for there to be resources allocated to testing for autism, services for autism, centers for studying autism, etc. These extra resources mean that there will be more screening for autism and more cases will be found. And even further, parents of autistic children may choose to deliberately move to such areas in order to make use of these enhanced services.

    — meomaxy
  5. 5. October 17, 2006 1:29 pm Link

    Nice work, sir.

    How about something along these lines:

    When it rains a lot, parents watch more TV and also spend more time with their kids, which makes them more inclined to seek out a diagnosis for possible signs for autism.

    Good hand.

    — Rainman
  6. 6. October 17, 2006 1:31 pm Link

    A much more convincing study is here http://archpsyc.ama-assn.org/cgi/content/abstract/63/9/1026

    They find a significant correlation between age of the father and autism. They use a uniform definition of “autism”.

    This paper reminds of some studies done in the 1930’s and 40’s, showing the “link” between automobiles sold and lung cancer. A significant correlation existed between the two.

    — nobugme
  7. 7. October 17, 2006 1:45 pm Link

    I think the paper attempts new ground and we should have a space for it. Note that we have an outdated model of truth for thes items. If the paper were entitled, “We’re f#$@ed: why the data on autism is bogus”, no one would read it.

    — CharlesMerriam
  8. 8. October 17, 2006 1:52 pm Link

    This is what epidemiology refers to as an “ecologic” study, for reasons lost in the depths of history. The primary problem is that it is a group-level study, ie there is no direct link between individuals with and without autism, and tv watching or lack thereof. In other words there is no way to determine if the autistic kids are getting the higher TV hours or that their non-autistic counterparts are, I don’t know, playing video games instead.

    The preferred approach, since the question has arisen, would be to assemble two groups of subjects, one group with autism & another without, then look at whatever exposure you’re interested in. Folks in Seattle read, especially used books, and drink coffee, especially dark roast, a lot more than people elsewhere; maybe those are possible causes.

    With this type of study, one can uncover interesting ideas for further work, but equally can overreact to results and get led far astray.

    — snow
  9. 9. October 17, 2006 2:29 pm Link

    Slate posted a follow-up where a bunch of commentors leveled some withering criticisms at the report:

    http://www.slate.com/id/2151595/

    Here’s one I particularly liked:

    ***
    Easterbrook consistently refers to the increase in autism that begins “around 1980, about the same time cable television and VCRs became common”. If Easterbrook had done his homework he would have found that 1980 was also the year the diagnosis of “Autism” actually became a diagnostic entry in its own right in the DSM-III. It was reclassified from being part of “psychotic” disorders (like schizophrenia) to having a specific heading in “developmental” disorders. Furthermore, in 1980’s the ‘autism spectrum’ (autism, PDD-NOS, and the newly-minted Asperger’s syndrome) definitions were changed or created to include persons with normal range IQ, and less severe symptoms. All of these changes to diagnosis would significantly impact the makeup of the population called “autism spectrum disorders” (ASD)– sometimes just called “autism” by the media. (to the confusion of many readers). All of these changes coincided with the increase in television-watching, but (am i going out on a limb here?) weren’t caused by television. […]

    — sppeterson
  10. 10. October 17, 2006 4:09 pm Link

    TV as a contributor to autism sounds like a long shot, but autism is such a severe problem that it deserves to be investigated. So, here’s a more promising historical natural experiment, with a much sharper increase in television watching:

    The South African experience. The regime allowed no television until experimental broadcasts in 1975, followed by full-time broadcasting in 1976. South Africa is unique among countries with a large modern health system in its late, sudden adoption of television during an era when autism’s defintion was more clear than during the 1940s and 1950s when TV-watching was growing in America. I have no idea what the autism trends were in South Africa, but this might provide a good test.

    — SteveSailer
  11. 11. October 17, 2006 5:08 pm Link

    DNA and the Brain — If you’re looking for offbeat but ‘genius’ insights into the causes of autism, watch this Google video of Dr. James Watson. He talks about the high incidence of autism in Silicon Valley and relates it to the many super-smart people living and reproducing there.

    http://video.google.ca/videoplay?docid=-8220394453782681101&q=google+autism+video

    — Franke
  12. 12. October 17, 2006 8:26 pm Link

    As a breast cancer survivor, I have become increasingly cynical about these types of studies. I suppose it’s acceptable that some researchers at a university did a study that concluded women who ate french fries before the age of 5 were more likely to develop breast cancer (they used the empirically sound method of depending on the respondents’ memory) — What bothers me is that they are using scarce grant monies and seem to have no problem getting their questionable correlations published in the main stream media.

    There is seemingly no end to the worthless flawed “studies” that get air-time these days.

    — cosmo
  13. 13. October 17, 2006 8:27 pm Link

    To clarify my previous comment — this study reminds me of the one that was published last year about breast cancer and french fries.

    — cosmo
  14. 14. October 17, 2006 8:50 pm Link

    I didnt have the time to properly look for any studies that may support this but could it be possible that an increase in rainfall could result in a higher birth rate?

    — IaM0816
  15. 15. October 17, 2006 10:45 pm Link

    There may or may not be something to this study, but I suspect that in any case it is probably a good idea to limit TV viewing for children 3 and under. BTW, all autism by definition manifests by the age of 3.

    Remember the rainbow man and how much TV he watched? That’s anecdotal, but suggestive. I really do believe in moderation in all things. Even things that are good for you in moderation become bad if you get too much. That’s not to say that I always follow my own advice, but I should.

    — Gaijin51
  16. 16. October 17, 2006 10:55 pm Link

    Could it be that people with autistic children find some advantage to being subscribed to TV? I don’t know. However I believe this is the case with ADD and ADHD. I like the authors creativity, and it adds a small piece to a big puzzle. Seems to me though there are a lot of people who are letting their emotions on the issue get in the way of evaluating the paper and ranting about other studies. Before they should be allowed to rant about questionable empirics, they should have to identify themselves as qualified to do so. Something simple, like answering the question: “What is b=(x’x)^(-1)x’y?”

    — Justin Ross
  17. 17. October 18, 2006 3:06 am Link

    What about power failure during rains?How has that been accounted for?

    — harini
  18. 18. October 18, 2006 9:49 am Link

    I have two daughters, one has an Autism Spectrum Disorder, while the other doesn’t. (Asperger’s, very mild, high functioning.) Anyway, she rarely if ever watches TV, while the other, non-ASD child is a couch potato.

    Go figure.

    (This anecdote about as valid as the study for drawing meaningful results.)

    — 711buddha
  19. 19. October 18, 2006 11:39 am Link

    I have to admit that I don’t think it’s got much to do with TV either. I tend to the same thoughts as meomaxy up above. This paper does a good job:

    http://www.eqsq.com/uploads/pdfs/wheelwright_2006_brain_research.pdf

    And yes, I’ll admit I’m biased. I write a blog based on Simon Baron-Cohen’s EQ/SQ theories. But still, the inheritability and assortive mating sound a much more likely explanation to me.

    — tim worstall
  20. 20. October 18, 2006 8:04 pm Link

    What about mold and fungus and other side effects of rainy places? As you say, the cable TV one makes no sense since it has been steadily trending upwards with time and so has Autism. Unless you can go into a country with no TV that added it, you cannot say there is more than time based correlation (two things trending together with time).

    But, rain and modern house construction makes more sense. In rainy places, people are trapped in humid indoor environments with modern construction materials and semi-air-tight houses. So, you have more exposure to the same possibly contaminated air, etc. One ought to look at cases of Autism and the age of the houses in the area to see if there is enough correlation to look for causality.

    — pkimelma
  21. 21. October 19, 2006 9:25 am Link

    sppeterson noted it best: The diagnosis of Autism and the definition of what autism is will be the downfall of this paper (ignoring the rest of the hihgy suspect factors).

    Based on no particular evidence that I can think of to reference just now, but on my experience, Diagnosis of ASD has been on the increase for a good few years now as detection methods improve, and as more people’s idiosyncrasies are recognised as ASD of varying degrees of intensity.

    — rabidstoat
  22. 22. October 19, 2006 11:05 am Link

    Expanding on what rabidstoat wrote, it seems to me (me, having no other qualifications to comment other than having read some Oliver Sacks, Temple Grandin and “The Curious Incident of the Dog in the Night-Time”), that rates of autism are not increasing.

    The increased attention to autism naturally means more will be diagnosed with it. The expanding diagnosis naturally means that more will be diagnosed with it. The increased availability of free services such as early intervention or special ed. for children diagnosed with autism spectrum disorders naturally gives incentive to try to push more children into that category.

    On the other side, people are randomly fingering every random thing from immunizations (even the ones that don’t contain thimerosol) to TV, to too many rainy days as the “cause” of the “epidemic”. As a bonus, if you can put the blame on a product rather than the weather, that gives lawyers somebody to sue.

    Given all the parental hysteria and media’s willingness to headline half-baked study results, I think that I have every reason to be very skeptical. Somebody should study the effects of the availability of early intervention programs or changing diagnostic criteria on the reported rates of autism.

    — meomaxy
  23. 23. October 19, 2006 11:37 am Link

    And the alternative theory is more plausible?

    “..when it rains a lot, parents watch more TV, see more shows about autism, and this leads them to seek out a diagnosis of autism for their kids. They have the same kids, it is just that TV makes them believe that their kids are autistic.”

    This is a joke, right?

    As the parent of an autistic child, I can assure you parents don’t seek out bogus diagnoses for their kids, nor would we eagerly seek out early intervention/special ed services because they are “free.” You only get quality early intervention for megabucks. No, this is not something we eagerly seek–this is a multifactorial disorder–genetic susceptibility to an increasingly toxic environmental load (yes, that does include an ever increasing load of childhood vaccines, with and without mercury: Aluminum for starters). The genetic susceptibility hasn’t increased over the decades, but the toxic load has and this accounts for the increased rate of autism spectrum disorders.

    — Wade
  24. 24. October 19, 2006 1:15 pm Link

    Wade is giving an example of what I’m talking about here.

    Firt of all, nobody is arguing that autism doesn’t exist or that Wade’s child’s autism is a bogus invention of Wade’s media-influenced imagination.

    I’ve seen some autistic children. The behavior I’ve seen ranges widely. One child was completely non-verbal, would rock and hand flap constantly and never look other people in the eye. I have also seen an autistic child who intellectually would be considered considerably gifted. I knew an adult who is probably autistic who everybody agreed was a pretty strange fellow to talk to, but when he applied for a temporary job working for the 2000 census, they made him retake the entrace exam because they couldn’t believe that he scored so high without cheating.

    In a past era, such high-functioning autistic people might have been labelled as being socially inept or having eccentric personalities. Lower functioning autistic people might have been labelled as mentally retarded. Now that we know better, more people get identified as autistic and hopefully get the right kind of therapy. I seem to recall that Temple Grandin herself writes about how she might have stayed mute her entire life were it not for people who gave her the right kind of help when she was young.

    That said, being an autistic person or a parent of an autistic person does not give one any more insight into what causes autism than anybody else has. Or to put it another way, “the toxic load has [increased over the decades] and this accounts for the increased rate of autism spectrum disorders” is an interesting theory, but the fact that Wade has an autistic child doesn’t make that theory more likely to be true than if I say it.

    I have no reason to doubt that Wade never sought out this diagnosis for his child. My experience is slightly different. My wife insisted that my daughter get some shots differently because she heard that one type had been suspected of a link to autism. My 1 year old baby was sitting on the floor one day and bounced on butt for about 5 seconds before crawling off. My wife asked me if I thought our daughter might be autistic because she was rocking. If my wife is in any way representative, those child development specialists must spend a great deal of their time reassuring panicked parents that their children are doing just fine.

    I have two small children, and we and all the other parents around us get all worked up over whether our children are hitting their milestones, matching the right height and weight percentiles and whatnot. I know of at least five examples of other parents that I know who have had their child evaluated, but only because early intervention would do it for free, and agree that their child should have therapy, but would only do it if early intervention would pay for it.

    Every parent who has an autistic child should do whatever they can to help their child. Reporting unsubstantiated causes of autism not only needlessly panics parents of all children, but is cruel to the parents who do have autistic children, who will now blame themselves for turning their child autistic because they let their toddler watch Dora the Explorer.

    — meomaxy
  25. 25. October 19, 2006 2:08 pm Link

    I’ve heard of infants being diagnosed with autism, and they don’t watch much TV. I always assumed autism was something you were born with, NOT something that developed as a toddler. Usually autistic children are first diagnosed as toddlers. That being said, perhaps the parents should be studied.

    What are the affects of the so-called minor amounts of radiation emitted from common appliances like TV’s and microwaves on our reproductive systems? The microwaves in most households are on countertops, so if you’re an average sized person standing in front of it, the waves are going directly towards your midsection.

    Just a thought.

    — bettychilds

Add your comments...

Required

Required, will not be published

FREAK Shots:

What Does 75 Cents Do?

This week's FREAK Shot.

Photo: Justin Smith

About Freakonomics

Stephen J. Dubner is an author and journalist who lives in New York City.

Bio | Contact

Steven D. Levitt is a professor of economics at the University of Chicago.

Bio | Contact

Their book Freakonomics has sold 3 million copies worldwide. This blog, begun in 2005, is meant to keep the conversation going. Recurring guest bloggers include Ian Ayres, Jessica Hagy, Daniel Hamermesh, Sudhir Venkatesh, and Justin Wolfers.

Annika Mengisen is the site editor.

Naked Self-Promotion

Freakonomics is bolstering book sales at airports because it’s sexy, reports TheBookseller.com -- with or without its Turkish cover.

Wikio - Top of the Blogs freakonomics
Freakonomics: A Rogue Economist Explores the Hidden Side of Everything

Buy from Amazon Learn more

Archive

Recent Posts

November 19
(0 comments)

Eric Oliver on the “Bigot Belt”

Eric Oliver is a colleague of mine at the University of Chicago. He is the author of the absolutely fantastic book Fat Politics: The Real Story Behind America’s Obesity Epidemic.
He has some new and interesting insights on the “Bigot Belt,” which he has generously written up for the Freakonomics blog.
The Bigot Belt
By Eric Oliver
A [...]

November 19
(8 comments)

Bacon Ice Cream and Intertemporal Choice

Photo: lilivanili and shawnzam Yesterday I suggested that tastes may not be stable. And then last night, I had the chance to confront the data directly; my local restaurant was serving bacon ice cream.
Bacon: Delicious! Ice cream: My favorite! The combination of bacon and ice cream: a direct threat to my views of economics. [...]

November 19
(1 comment)

The FREAK-est Links

Here are the stats, algorithms, and numbers that explain why Kevin Garnett is an MVP. (HT: Phil Notick) (Earlier)
Justin Wolfers’s alumni magazine dubs him “The Seeker.” (Earlier)
Who’s making the fat jokes?
Stanley Druckenmiller is happy he didn’t buy the Steelers.
Chicago’s schools have third-world math scores. (Earlier)

November 18
(27 comments)

Would a Market for Organs Punish the Poor More Than They Are Already Punished?

Below is a fascinating statement issued by Physicians for a National Health Program, “a membership organization of over 15,000 physicians [which] supports a single-payer national health insurance program.”
You should read the whole thing but, in a nutshell: The people who receive donated organs in the U.S. nearly always have health insurance, while a significant fraction [...]

November 18
(33 comments)

Larry Summers for Treasury Secretary

Larry Summers
There is a lot of speculation about whether President-elect Barack Obama will choose Larry Summers to be his Treasury Secretary. But some people are openly opposing Summers’s appointment, in part because of controversial comments he made about women in science.
It’s a close question, but I’m hoping that Obama appoints Summers. I have three reasons:
First, [...]

Stuff We Weren't Paid to Endorse

1. Go to Hulu.com. 2. Choose Arrested Development. 3. Start with Season 1 and then watch every episode of all three seasons. 4. You can thank me later. (SJD)

I can scarcely tell a scarlet tanager from Scarlett O’Hara, but The Life of the Skies had me transfixed from the first page. Jonathan Rosen -- who happens to be a friend of mine -- writes with astounding insight, wit, and compassion. The story he tells here is the best kind of odyssey, an outward journey that ends up highlighting the beauty and daring that live inside of us. Here's a Times review of the book, and here's an earlier blog post about the book and the power of suggestion. (SJD)

Even if you don’t have a son fighting in Iraq, even if you don’t read poetry, even if you think you are immune to the power of a mother’s lament – pick up The Warrior and read it right away. Fran Richey has written some of the most powerful stories I’ve ever encountered. It is obvious that her life was changed by living these poems; yours may well be changed by reading them. (SJD)

From the Opinion Blogs

Necessary Steps
Inching Along the Edge of the World

In his last walk of the series, the author manages to avoid stepping out into thin air.

Abstract City
New York Cheat Sheets

All New Yorkers develop tricks that allow them to stay ahead of the pack in daily life. Here I offer some of mine in a couple of handy charts.

Feeds

  • Subscribe to the RSS Feed
  • Subscribe to the Atom Feed