Brier Dudley's Blog
Brier Dudley offers a critical look at technology and business issues affecting the Northwest.
Blog Home
|
E-mail Brier|
206.515.5687
|
Subscribe |
Twitter feed | Microsoft Pri0 blog
Jump links: Columns| Interviews | Product reviews | Blog roll
Comments (0)
E-mail article
Print
Share
"Looming data tsunami" coming, UW prof warns
Posted by Brier Dudley
At the Grand Challenges Summit in Seattle today, the University of Washington's Ed Lazowska channeled Bill Gates.
Lazowska resurrected Gates' "digital decade" line to describe the advances that computer science will bring to scientific research.
"You're going to see a revolution in discovery in the next 10 years," said Lazowska, the Bill & Melinda Gates Chair in Computer Science.
He opened a discussion of "eScience" and new systems for doing research with massive amounts of data, a "looming data tsunami" that's pushing scientists to develop shared computing clusters at schools and ultrafast dedicated Internet lines between research centers.
Dedicated supernetworks are needed to handle data generated by systems such as gene sequencers that produce a terabyte of data per day -- and the UW has 25 of them -- or the Hadron Collider, which produces 20 petabytes of data per year.
Among the speakers in the session, part of a National Academy of Engineering event hosted by the UW, was Facebook data architect, Jonathan Chang, who said the social network's vast data could be a boon to social scientists.
Chang said the site has the "richest social data set in the world," with more than a petabyte of data about its users and more than 1 terabyte generated every day.
This has the potential to "really get to and anwer a lot of the longstanding questions in things like social science, which we've been unable to answer before." It's also easier to slice Facebook data than it is to do conduct surveys.
Among the tidbits revealed by Chang were terms used in discussions of vodka. Younger males tend to use the word "drunk" and older females mention "cranberry" when discussing vodka, for instance.
Plotting the terms "party" and "hangover," the data show people mention party regularly on Saturdays, and on Sundays people mention "hangovers" "with incredible regularity," he said.
More seriously, the site's also done work correlate negative and positive sentiment in status updates with surveys of users' self-reported happiness. Survey responses were predictive of status updates," he said.
Catharine van Ingen, an architect in Microsoft Research's eScience group, said there's an amazing flow of data from satellites, sensors, computers and Web services.
"While we're at the center of this perfect storm," she said, "there's a lot of challenges left turning those ones and zeroes into actual science."
Feb 9 - 4:34 PM The full FBI report on Steve Jobs
Feb 9 - 3:30 PM Ghastly plunge for video games, Xbox holds lead
Feb 9 - 10:27 AM Apple iPad 3 surfacing in March, report says
Feb 9 - 6:00 AM WTIA award finalists revealed
Feb 8 - 5:24 PM Q&A: Microsoft Flight boss on "rebooting franchise"


- Lakewood cop accused of embezzling $150K meant for slain officers' families
- 3 big health insurers stockpile $2.4 billion as rates keep rising
- Agency set to investigate handling of 911 call about Josh Powell
- Quick decisions: How Washington hired its new football staff
- Historic day for gay marriage as another fight looms
- Justin Wilcox's versatile defensive style is the right fit for Huskies | Jerry Brewer
- It's Terrence Time: Enigmatic Ross leads Huskies
- Social worker recounts minutes before Powell fire
- $25B settlement reached over foreclosure abuses
- Club promoter convicted in brutal 2010 murder of Des Moines prostitute
- Gay-marriage bill passes House, awaits Gregoire's signature
434 - Historic day for gay marriage as another fight looming
346 - Sheriff's office unhappy with 911 dispatcher in caseworker's call
282 - 3 big health insurers stockpile $2.4 billion as rates keep rising
235 - Source: NY, California to sign mortgage settlement
208 - Oregon live game thread
153 - Pac-12 picks ... including the UW game
140 - Lakewood cop accused of taking donations for slain officers' families
114 - Department of Justice owes the Seattle Police Department an apology
88 - Thursday morning links --- and a video!!!
72
- 3 big health insurers stockpile $2.4 billion as rates keep rising
- State Medicaid program to stop paying for unneeded ER visits
- One man's audacious pursuit of sailing history
- Darren Berg gets 18-year sentence for Ponzi scheme
- $25B settlement reached over foreclosure abuses
- A wandering gene's destructive path | Book review
- 'Gauguin and Polynesia': dazzling mix-and-match | Art review
- UW opening incubator facility for startups
- Controversial principal at Lowell Elementary takes job in Tacoma
- Lakewood cop accused of embezzling $150K meant for slain officers' families


