Snappy newsletters. Simple Facebook sharing. Spirited comments. Sweet features are waiting… GET THEM NOW!

New Web Trend Sparks David vs. Goliath 2.0

Web giants mobilize to stop developers from 'scraping' their content

By Wesley Oliver,  Newser Staff

Posted Dec 31, 2007 4:14 PM CST

(Newser) – Some call it “scraping,” others call it “importing.” Either way, it’s a controversial process pitting independent software developers against the titans of the cyber world: Techies compile, or scrape, loads of data from search engines and social networking sites and pool the data on their own websites, Wired reports. Some companies, relishing the increased traffic, love the service.

But others, charging copyright infringement, are cutting the web ties that allow developers access to their data and have begun developing ways to control how their content is distributed. Many companies like Google use interfaces that formally regulate how much data developers can use. One insider warns that large firms will begin competing with small developers, sparking “an unfair fight.”

Craigslist ordered one software developer to discontinue his website that pooled various information from the online community site onto one page. They didn't even talk to me about trying to work something out, Ryan Sit says. They just banned me.
Craigslist ordered one software developer to discontinue his website that pooled various information from the online community site onto one page. "They didn't even talk to me about trying to work something...   (Getty Images)
  (Index Stock)
Scraping allows web application developers to compile data from search engines and social networking sites and organize on their own websites.
Scraping allows web application developers to compile data from search engines and social networking sites and organize on their own websites.   (Index Stock)
« Prev« Prev | Next »Next » Slideshow
To report an error on this story, notify our editors.
A snapshot of the day's best news stories.
 
COMMENTS
Be the first to comment on this story.

More Newser Stories

25 Essential Websites

Paul Allen Re-Sues Apple, Google, Facebook

Google Looking to Buy Yahoo

Google Sets Record: 1B Unique Visitors in Month

Google, Facebook Bicker Over Contacts


NEWS FROM OUR PARTNERS
Other Sites We Like:   24/7 Wall St.   |   Betty Confidential   |   BuzzFeed   |   Cracked   |   Fark   |   Timelines   |   The Frisky   |   Geek Sugar   |   NewsOne