Opinion



By Stephen J. Dubner December 5, 2006, 10:44 am

“A YouTube for Data”

If you go to your Web browser and type in www.swivel.com, all you get is a pretty little “coming soon” banner. But if you read about Swivel here on TechCrunch, it sounds like a godsend — or at least a tremendous way to waste time — for data freaks.

Michael Arrington at TechCrunch says that Swivel’s founders describe the forthcoming website as “YouTube for data,” but it’s really much better than that. Here, according to Arrington, is how Swivel will work:

[T]he site allows users to upload data — any data — and display it to other users visually. The number of page views your website generates. Or a stock price over time. Weather data. Commodity prices. The number of Bald Eagles in Washington state. Whatever. Uploaded data can be rated, commented and bookmarked by other users, helping to sort the interesting (and accurate) wheat from the chaff. And graphs of data can be embedded into websites. So it is in fact a bit like a YouTube for Data.

But then the real fun begins. You and other users can then compare that data to other data sets to find possible correlation (or lack thereof). Compare gas prices to presidential approval ratings or UFO sightings to iPod sales. Track your page views against weather reports in Silicon Valley. See if something interesting occurs.

And better yet, Swivel will be automatically comparing your data to other data sets in the background, suggesting possible correlations to you that you may never have noticed.

Academic types are going to go nuts over this. I spent a summer in college running regression analysis models on economic data. Being able to simply upload data to Swivel and then begin to slice and dice the data would have saved a lot of time. And being able to compare our data to what others were doing in related fields could have yielded results that we would never have aimed for. Big companies, small companies, think tanks and non-classified government organizations are going to be similarly dazzled.

Swivel is putting significant computing power behind the scenes to run the data analysis. “We use farms of powerful computers and algorithms at the Swivel data centers to transform a lonely grid of numbers and letters into hundreds - sometimes thousands - of graphs that can be explored and compared with any other public data in Swivel.”

The possibilities seem endless. As do the deceptions. I wonder, e.g., how long it takes for people to start uploading fake data to fool competitors.

(Thanks to Pete Davias and Trey Ratcliff for the tip, and to Mike Arrington for the nice write-up.)


10 Comments

  1. 1. December 5, 2006 11:03 am Link

    “Coming soon” on a website is similar to “Closed for renovations” in a restaurant’s window. It’s a safe bet that the restaurant will never reopen, and it’s at least a semi-safe bet that the website will never be up. I’ll believe Swivel when I see it.

    — prosa
  2. 2. December 5, 2006 11:32 am Link

    I could really get excited about the possibility of a site like that. Here’s to hoping Swivel is up and running soon. I wonder if there will be any freakonomics.com related data, i.e. which topics solicit the most comments, book sales in relation to comments on the site, etc….

    — wesleyb41
  3. 3. December 5, 2006 12:29 pm Link

    Wouldn’t the threat of ‘bad’ or ‘deceptive’ data be somewhat regulated by the rating system being proposed?
    Very cool project–I hope it gets off the ground.

    — barneycoopersmith
  4. 4. December 5, 2006 1:14 pm Link

    “Big companies, small companies, think tanks and non-classified government organizations are going to be similarly dazzled.”

    In theory, but I would be suprised if many of these types of organizations (particularly companies) post data to the site for all to see. I think the utility of the tool will be limited to the “academic types”.

    — nerdynerdelson
  5. 5. December 5, 2006 1:28 pm Link

    Hi there,

    Thanks for the post on Swivel. Folks have picked up on YouTube for data, but Dmitry, my cofounder, and I have much humbler ambitions. We both dig data and we have a team of folks here who love data too. Our goal is to build a Web site that we can get absolutely lost in for hours while exploring data and making crazy correlations. We’re hard at work right now tweaking performance bugs (they’re a real pain). We’re likely going to miss some, but hope that folks who really love data will stick with us through the hard times. Stay tuned and please swing on over to Swivel once we launch.

    Brian Mulloy
    CEO & Cofounder
    http://www.swivel.com

    — brianmulloy
  6. 6. December 5, 2006 1:30 pm Link

    Prosa,

    I am skeptical too, but that’s only because I wrote some of the code in Swivel. :-) Please, wish us luck.

    Brian Mulloy
    CEO & Cofounder
    http://www.swivel.com

    — brianmulloy
  7. 7. December 5, 2006 3:09 pm Link

    I read about this site and start salivating. I’m such a dork! Here’s hoping you can pull this off Brian. Best of luck.

    — AKecon
  8. 8. December 5, 2006 4:30 pm Link

    It is awesome to be able to explore such correlations. I will probably be one of the first guys to wallow around once the site opens.

    — girish.mallapragada
  9. 9. December 5, 2006 6:20 pm Link

    Gotta Have It!!!

    @6: Pullleeeze tell us (non-academic types) when we can start; I can out-salivate dogs already ;-)

    May I suggest that your website include a way to grab email addy’s of potential “early adopters”? I’d sign up in a second, but if it falls off of “the top of my mind”, it might get broken, and I’d guess that would be bad for both of us.

    Best wishes for the success of your implementation of a brilliant idea.

    — dbswinford
  10. 10. December 6, 2006 8:30 am Link

    “how long it takes for people to start uploading fake data to fool competitors.”

    Why would anyone want to believe uncited data? That would be like telling the examiner in a theory exam that you study from wikipedia.

    The bigger danger, I’d say, is people believing whatever is put up. Just like the way digg front page stories are of a greater percentage of spam these days.

    — nimishbatra

Add your comments...

Required

Required, will not be published

FREAK Shots:

What Does 75 Cents Do?

This week's FREAK Shot.

Photo: Justin Smith

About Freakonomics

Stephen J. Dubner is an author and journalist who lives in New York City.

Bio | Contact

Steven D. Levitt is a professor of economics at the University of Chicago.

Bio | Contact

Their book Freakonomics has sold 3 million copies worldwide. This blog, begun in 2005, is meant to keep the conversation going. Recurring guest bloggers include Ian Ayres, Jessica Hagy, Daniel Hamermesh, Sudhir Venkatesh, and Justin Wolfers.

Annika Mengisen is the site editor.

Naked Self-Promotion

Freakonomics is bolstering book sales at airports because it’s sexy, reports TheBookseller.com -- with or without its Turkish cover.

Wikio - Top of the Blogs freakonomics
Freakonomics: A Rogue Economist Explores the Hidden Side of Everything

Buy from Amazon Learn more

Archive

Recent Posts

November 19
(0 comments)

FREAK Shots: Who Are You Calling Third-World?

Blog reader Nick Turner sent along this photo of a Body Shop ad in San Francisco:
Photo: Nick Turner He was surprised that the ad guarantees fair-labor conditions for workers in Italy: I thought fair-trade protections were for third-world workers. I
wonder how the Italians feel about this designation.
The ad didn’t outright call Italy third-world; but if it had, [...]

November 19
(14 comments)

Eric Oliver on the “Bigot Belt”

Eric Oliver is a colleague of mine at the University of Chicago. He is the author of the absolutely fantastic book Fat Politics: The Real Story Behind America’s Obesity Epidemic.
He has some new and interesting insights on the “Bigot Belt,” which he has generously written up for the Freakonomics blog.
The Bigot Belt
By Eric Oliver
A [...]

November 19
(11 comments)

Bacon Ice Cream and Intertemporal Choice

Photo: lilivanili and shawnzam Yesterday I suggested that tastes may not be stable. And then last night, I had the chance to confront the data directly; my local restaurant was serving bacon ice cream.
Bacon: Delicious! Ice cream: My favorite! The combination of bacon and ice cream: a direct threat to my views of economics. [...]

November 19
(1 comment)

The FREAK-est Links

Here are the stats and algorithms that explain why Kevin Garnett is an MVP. (HT: Phil Notick) (Earlier)
Justin Wolfers’s alumni magazine dubs him “The Seeker.” (Earlier)
Who’s making the fat jokes?
Stanley Druckenmiller is happy he didn’t buy the Steelers.
Chicago’s schools have third-world math scores. (Earlier)

November 18
(30 comments)

Would a Market for Organs Punish the Poor More Than They Are Already Punished?

Below is a fascinating statement issued by Physicians for a National Health Program, “a membership organization of over 15,000 physicians [which] supports a single-payer national health insurance program.”
You should read the whole thing but, in a nutshell: The people who receive donated organs in the U.S. nearly always have health insurance, while a significant fraction [...]

Stuff We Weren't Paid to Endorse

1. Go to Hulu.com. 2. Choose Arrested Development. 3. Start with Season 1 and then watch every episode of all three seasons. 4. You can thank me later. (SJD)

I can scarcely tell a scarlet tanager from Scarlett O’Hara, but The Life of the Skies had me transfixed from the first page. Jonathan Rosen -- who happens to be a friend of mine -- writes with astounding insight, wit, and compassion. The story he tells here is the best kind of odyssey, an outward journey that ends up highlighting the beauty and daring that live inside of us. Here's a Times review of the book, and here's an earlier blog post about the book and the power of suggestion. (SJD)

Even if you don’t have a son fighting in Iraq, even if you don’t read poetry, even if you think you are immune to the power of a mother’s lament – pick up The Warrior and read it right away. Fran Richey has written some of the most powerful stories I’ve ever encountered. It is obvious that her life was changed by living these poems; yours may well be changed by reading them. (SJD)

From the Opinion Blogs

Necessary Steps
Inching Along the Edge of the World

In his last walk of the series, the author manages to avoid stepping out into thin air.

Abstract City
New York Cheat Sheets

All New Yorkers develop tricks that allow them to stay ahead of the pack in daily life. Here I offer some of mine in a couple of handy charts.

Feeds

  • Subscribe to the RSS Feed
  • Subscribe to the Atom Feed