Internet search engines have focused largely on crawling text on Web pages, but Google is knee-deep in research about how to analyze and organize structured data, a company scientist said Friday.
"There's a lot of structured data out on the Web and we're not doing a good job of presenting it to our users," said Alon Halevy during a talk at the New England Database Day conference at the Massachusetts Institute of Technology,
Halevy was referring in part to so-called "deep Web" sources, such as the databases that sit behind form-driven Web sites like Cars.com or Realtor.com. Google has been submitting queries to various forms for some time, retrieving the resulting Web pages and including them in its search index if the information looks useful.
But the company also wants to analyze the data found in structured tables on many Web sites, Halevy said, offering as an example a table on a Web page that lists the U.S. presidents.
And there are reams of those tables -- Google's index turned up 14 billion of them, according to Halevy. He "realized very quickly that over 98 percent of these are not that interesting," but even after significant filtering there remain about 154 million tables worth indexing, he said.
One of Google's ultimate goals is to provide results that organize "aspects" of a search query, particularly an exploratory one such as "Vietnam travel," as opposed to a query for a specific fact such as "Vietnam population," Halevy said. The former query would produce information about visa requirements, weather and tour packages, for example.
The idea has echoes of the search service offered by Kosmix, but Google wants to go further, according to Halevy. "Kosmix will give you an 'aspect,' but it's attached to an information source," he said.
Searching for "Vietnam travel" on Kosmix gives an organized set of results including restaurant reviews from the New York Times, images from Yahoo and Flickr, shopping information from Shopping.com and general Web results from Google.
"In our case, all the aspects might be just Web search results, but we'd organize them differently," Halevy said.
Latest on Search
- Google renews licensing deal with AP for news content
- Google expands Voice Search with new actions
- Google improves Gmail contacts manager
- Google buys Metaweb, chases more complicated search
- Google moves encrypted search to a new site
- Google's Commerce Search gives admins more control
- Google's Caffeine: a transition from months to seconds
- Microsoft brings Facebook into social search
- The Yahoo-Facebook Marriage: Social Networking Overload?
- Massive new Yahoo campus approved by Santa Clara
Software Essentials
- Ballmer: Yahoo acquisition won't happen
- Sun is a software company, new top shareholder says
- Forecast has Office, Vista going in opposite directions
- Interview with The Pirate Bay founder
- The future of software testing
- Bill Gates predicts software revolution
- 'Warez' software pirate sentenced to probation
- Mobile app development moves beyond CRM, but slowly
- Tibco backing Microsoft Silverlight
- Most top banks already using virtualization
- WebSphere Solution Design (S20) - CBD, contract role3/09/2010
Other
I.T. & T
WebSphere Solution Design (S20) - CBD, contract role - Solution Architect - Web Application Architecture Project!3/09/2010
Other
I.T. & T
Solution Architect to provide strategic and operational consulting for the end-to-end Web Application System project! Experienced with J2EE or .NET?! - Principal Consultant - ITIL2/09/2010
Other
I.T. & T
Excellent opportunity for an experienced ITIL Principal Consultant to join an innovative leading IT Service management consultancy. Attractive packag - Mainframe Developer - COBOL - 12 Month Contract2/09/2010
Other
I.T. & T
Mainframe Developer - COBOL - 12 Month Contract - Business Systems Analyst2/09/2010
Other
I.T. & T
Perm CBD based role for an experienced Business Systems Analyst - Senior SAP Project Manager2/09/2010
Other
I.T. & T
Senior SAP Project Manager - SAP FICO Consultant - 6 week contract - West Sydney2/09/2010
Other
I.T. & T
SAP FICO Consultant - 6 week contract - West Sydney
TechWorld Blogs
Recent blog posts
- Windows Phone 7: how big can it get?
- NBN gets a turn at political football
- Internet filter gets caught up in politics
- TechWorld Forums goes live
- Selective sourcing the hybrid of cloud services
- Social networks catch more business attention
- RIP Kin
- Telstra’s copper and NBN’s fibre: will the two ends meet?
- RIP Windows 2000, XP lives on
- Does the world need another iPhone? Why not
Recent comments
- java development
11 hours 49 min ago - When mine called they
12 hours 32 min ago - 3D TV cannot fall - no way! Why?
15 hours 46 min ago - Thanks for taking the time to
1 day 4 hours ago - Windows scam
1 day 11 hours ago - My only anti fraud method is
2 days 6 hours ago - Private Cloud Taxonomies
2 days 6 hours ago - ...however...
2 days 15 hours ago - This Guy
2 days 15 hours ago - Glasses Free technology
2 days 16 hours ago - FOSS community
2 days 23 hours ago - i have dv6000 with nvidia
3 days 51 min ago - i have dv6000 and suddenly
3 days 55 min ago - This is an awesome comment.
3 days 4 hours ago - Real Estate
3 days 6 hours ago - Scam - eventvwr scammers
3 days 11 hours ago - Well I never...
5 days 1 hour ago - Too bad Microsoft was mentioned
5 days 3 hours ago - Phone card is a better option to make calls at a lower rate
5 days 7 hours ago - In other words: "Developers,
5 days 13 hours ago










Comments
Post new comment