The Guardian
trending topics
Inside Word

Inside Word: What The Netflix Prize Says About The Shortfalls Of Ad-Targeting Startups

  • Comments Comments (View)
  • Text Size: A A

The Inside Word is a weekly feature that looks at compelling industry debates and discussions unfolding on the blogs of employees at digital-media companies.

SEE ALSO: Inside Word: Some Advice For Yahoo From An Ex Evangelist

Blogger: Andrew Chen

Position: A self-described entrepreneur-out-of residence, Chen is a former entrepreneur-in-residence at early-stage VC firm Mohr Davidow Ventures and was a director of product marketing at behavioral ad targeting firm AudienceScience.

Blog name: Andrew Chen

Backstory: In October 2006, Netflix (NSDQ: NFLX) offered a $1 million prize to anybody who could build an algorithm that would improve on its system of predicting a user’s movie ratings by 10 percent. Last month, Netflix declared a winner, handing out the prize money to a team that had beat its algorithm by 10.5 percent.

Blog post: In a blog post, Chen writes that the story of the prize should put a damper on ad networks’ claims that they can distinguish themselves by offering better ad-targeting technology. “This means if you combine dozens of the best machine-learning people in the world, some of the cleanest datasets, you get a measly 10.5 percent increase,” he writes. “Compare this to starting a new ad network where you end up with noisy datasets, lots of crappy traffic, and a small team looking at the problem – that’s not an easy path to disruptive change.”

“In general, 10 percent is not a big enough number to counteract the other economic drivers in the ad market, which revolves around better deal terms, a larger selection of advertisers, better ad inventory, etc.”

Post-script: I asked Chen why—if there is, in fact, not much difference between the targeting technology of various ad networks—the ad networks nevertheless were making those claims. He responded: “First off, they are geeks and prefer to emphasize targeting. Second, they (and by extension, their investors) have Google (NSDQ: GOOG) envy, and they think data + algos can solve everything. Third, they look at the ad industry and see how backward it is from a technology standpoint, but don’t appreciate the tremendous amount of sales and marketing excellence in the industry. So as geeks, of course they think they can one-up the ad industry on technology, even though that’s not sufficient to win in the ad industry.

There are just a ton of variables that go into the performance of an actual campaign, of which targeting is merely one variable. And because most ad networks are black-boxes, you can’t really say, ‘we’ll run both of these campaigns side by side but use different targeting techniques and we’ll compare them.’ Furthermore, some of these variables clearly swamp the other ones - for example where the ads run has a huge effect, larger than the targeting technique in most cases.”

Know of an insightful employee blog? Please e-mail the URL to .(JavaScript must be enabled to view this email address), so that I can include it in a future edition of the Inside Word.

Oct 23, 2009 3:10 PM ET

Andrew Chen


Posted In: Advertising, Features, Inside Word

(Page 1 of 1)


The Bestsellers

From iTunes and YouTube to Facebook and Kindle, the most popular content on the web, free and paid.

Android Apps (Free) Android Apps (Free)
1. Facebook for Android
2. Pandora® internet radio
3. Angry Birds
4. Words With Friends Free
5. Voxer Walkie-Talkie PTT
See The Other Bestsellers »

Jobs RSS Job Listings

Social Standing

Which media brands are getting a lift from Tweeters and bloggers right now -- and which are getting panned?

"Sentiment" Scores for All the Companies »

Sponsors

Staff