The Science of Display – Introduction

The Science of Online Advertising Technology

With this blog post, I’d like to begin a series of posts on the technology and data-science that power modern display advertising (especially at Turn, where we’ve always been at the cutting-edge of innovation in this area). We will explore why the advances we’re making in the new field of computational advertising matter and how they matter. We will also try to de-mystify some of the concepts and the technologies that go into building a scalable, high performance demand side platform (DSP).

Computational advertising is an emerging field that spans multiple scientific disciplines – machine learning, optimization, statistics, information retrieval, economics, game theory, risk management, and many more. In the past, most of the work done in this field concentrated on search advertising and text ads, and not much attention was paid to display. It turns out display is a very different beast (but you already knew that). Although, ultimately, the problem is the same – how do we deliver the right message to the right person in the right situational context (not to forget, at the right price as well!)

At this point, one may wonder: what does game theory have to do with advertising? Or for that matter, how about risk management? Well, in this post, let’s examine risk with a simplified example.

With the advent of real-time bidded exchanges (RTBE),  the ability to examine and bid on several billion possible ad impressions every day offers agencies and advertisers both a unique opportunity and a challenge. It allows them to cherry pick the best possible impressions (if they have sophisticated enough prediction technology), but it also exposes them to enormous risk. Simplistically speaking, even an extremely tiny error rate of 0.1% when examining 10 billion RTBE bids is 10 million wasted impressions. Without the right risk management algorithms, real-time controls, corrective feedback, and pacing algorithms, things can go south very quickly.

This is one reason why many platforms will not be able to scale up to examine every single impression available on RTBEs. Many platforms will be forced to restrict their bids to small audience segments or bid on a much smaller universe of impressions (restricted by QPS or queries per second). To truly scale performance and be able to bid effectively on a large volume of impressions, risk management science and algorithms need to be built into the platform as an integral element. At Turn, risk management is intertwined into several key components of our DSP platform.

In the next post we will examine why learning is required and how more efficient learning reduces wasted impressions (duh!).

Editor's Note: This blog post originally appeared on the Turn Blog.


 

Goutham KurraGoutham Kurra is director of technology at Turn, Inc. where he focuses on developing cutting-edge technology for digital advertising including machine learning, predictive real-time bid optimization, and contextual and behavioral targeting among others. Over the last decade, Goutham has built innovative products and technology in diverse areas such as online advertising, enterprise search and e-discovery, distributed systems, computational biology, computer vision, and robotics. Prior to Turn, he was the first employee and an architect at the e-discovery pioneer Kazeon Systems (acquired by EMC) and also a founding member of the technical team at Adeosoft, where he built the world's first distributed common-language-runtime virtual computer. Goutham holds an MS degree in Computer Science from the University of Cincinnati, an MS in Physics and a BS degree in Engineering from the Birla Institute of Technology and Science, Pilani.



Rob Beeler is Vice President of Content and Media for AdMonsters and has worked in Ad Operations for over 10 years. Rob started attending AdMonsters events in 2004 as a member. In his role, Rob develops content for events, training classes and the website and works with AdMonsters members to share best practices and innovation in Ad Operations with their peers. Rob Beeler joined AdMonsters in October 2008 after nearly 10 years at Advance Internet, a leading creator of local news and information web sites across the United States. At Advance Internet, Rob started as the only Ad Operations person and developed a department of 15 people in 8 locations across the country responsible for operations, project management, business development, web analytics and financial reporting, becoming Executive Director of Ad Operations and Analytics in early 2007. Prior to Advance Internet, Rob held a number of positions related to advertising and publishing ranging from electronic prepress to an ad agency multimedia specialist. Rob graduated from Syracuse University in 1990 with a dual major in Producing for Electronic Media/English. Rob currently resides in Hazlet, NJ, with his wife Nancy and their three children.


Comments

We will also try to de-mystify some of the concepts and the technologies that go into building a scalable..US file search

examiner et de miser sur plusieurs milliards d'impressions publicitaires possible offre tous les jours agences et les annonceurs à la fois une occasion unique et un défi. Il leur permet de choisir aléatoirement les meilleures impressions possibles (si elles ont une technologie sophistiquée de prédiction assez), mais il les expose également à des risques énormes
bankruptcy information

This part of the story I find very intriguing"This is one reason why many platforms will not be able to scale up to examine every single impression available on RTBEs. Many platforms will be forced to restrict their bids to small audience segments or bid on a much smaller universe of impressions (restricted by QPS or queries per second).Nevertheless I like your delivery and I hope we find solutions to our problems.
Tenant Screening Services

Formed in 1998 from a Fetzer Institute seed grant, it is one of the only centers to promote an out-of-the-box approach by exploring all implications of human consciousness from the scientific to the philosophical, from the spiritual to the arts. It has also furthered innovative research by inspiring other associations to take the same open point of view. bicycle trailer Thanks

Thanks Goutham. Advertising is changing for sure. Display advertising should be measured carefully.
Jenny
amika flat iron info

There is so much that is remarkable about Avatar that its failings - clunky writing, clumsy love story - are easily brushed away. Online marketing Malaysia

I never really thought that game theory had anything to do with advertising. Game Theory can be applied to many things. Great example about identifying risk with game theory. Jane @ best flat iron resellers of the farouk chi 1 inch ceramic flat hairstyling iron thanks.

Thank you for taking the chance to deliver this affair. I am pleased I discovered your site on this material. It does seem that everybody is into this kind of stuff lately. seo

I absolutely adore your site! You aggressive me as able-bodied as all the others actuality and your broiled PS is absolutely nice. Thank you for afflatus and accumulate up the acceptable work thanks!
Toronto Website Design

I am very happy i find your site. I like to read and your article is very helpfull for my essay. Thanks for sharing, i bookmarked your site. spielzeug

This is a great inspiring article.I am pretty much pleased with your good work.You put really very helpful information. Discount Gift Cards

Thanks for making such a killer blog. I arrive on here all the time and am floored with the fresh information here! You are great!
close-up magic

Eric of course it would incorporate geo targeting, nowadays you have to have geo targeting. With the introduction of real-time bidded exchanges (RTBE) all I see is a huge opportunity.

Kevin Lynch
Site - credit repair

Another great set, I appreciate all the work you put into this site, helping out others with your fun and creative works.
Muebles

Very good and informative article. IT Dienstleistungen

I like your posts Beton versiegeln

File search..try to de-mystify some of the concepts and the technologies that go into building a scalable, high performance demand side platform (DSP)..

This only shows the importance of right risk management algorithms, real-time controls and corrective feedback. They really make things go really quickly. // silver coins | silver bullion

I like your posts Technische Übersetzung

Its always good to have tips on good blog posting. As I just started posting comments for blog and faced a lot of rejections. I think your suggestion would be helpful for me. I will let you know if this works for me.tienda de informatica

Short on atmosphere but huge on beefy goodness, the quirky Mission Burger opened behind the butcher case of the Duc Loi supermarket in August. This fine specimen is seared in beef fat, then topped with jack cheese, caramelized onions, and housemade caper aioli. topspot Thanks

Great post, and great website. Thanks for the information!

Mobile Broadband Coverage

Fun is the enjoyment of pleasure and, according to Johan Huizinga, "an absolutely primary category of life, familiar to everybody at a glance right down to the animal level."Fun may be encountered in many human activities during work, social functions, recreation and play, and even seemingly mundane activities of daily living. The distinction between enjoyment and fun is difficult to articulate but real, fun being a more spontaneous, playful, and active event.
Fun can also refer to the activity itself that is enjoyable, thus "skiing is fun", however, a bad fall may "take the fun out of skiing".
The perception of time is shortened when one is "having fun"
360 Waves
unlocked cell phones
Hot Springs Hotels

I can only recommend everyone to read every and each of the posts. Thanks, Kurra. Lisa
meriahkan pesta ulang tahun bersama garudafood

Great information! I have been looking for something like this for a while now. Thanks!
Patrick, server rack and server cabinet from RMS

It allows them to cherry pick the best possible impressions (if they have sophisticated enough prediction technology), but it also exposes them to enormous risk. Simplistically speaking, even an extremely tiny error rate of 0.1% when examining 10 billion RTBE bids is 10 million wasted impressions. Without the right risk management algorithms, real-time controls, corrective feedback, and pacing algorithms, things can go south very quickly. How to get rid of bed bugs

I was very encouraged to find this site. I wanted to thank you for this special read. I definitely savored every little bit of it and I have you bookmarked to check out new stuff you post.
nikon d3100

The couple got engaged in March 2008 and was supposed to wed in October 2009. But they split, and Cavalieri promised that she would return the ring. When she later refused to give it back, Gunther took her to court. Cavalieri filed a counterclaim this past winter, saying she deserved the ring because Gunther allegedly had an affair. birthday wishes Thanks

This is my first time i visit here. I found so many interesting stuff in your blog especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here! keep up the good work.
driving lessons in cannock

management science and algorithms need to be built into the platform as an integral element. At Turn, risk management is intertwined into several key components of our DSP platform.blog commenting service | link building services

At one point, Clements-Hart scribbles on the board behind her, “Pursuing fulfillment is a radical act.” Then she turns back around, her face full of emotion. “Chances are, doing this upsets the balance,” she says. “Not everybody is going to like it.” But, she adds, hands on hips, “figuring this out is the big game.” angry birds Thanks

Of course, what a great site and informative posts, I will bookmark this site. keep doing your great job and always gain my support. Thank you for sharing this beautiful article
USP Labs OxyElite Pro

Awesome and interesting article. Great things you've always shared with us. Thanks. Just continue composing this kind of post.

casino en ligne

I am especially intrigued by this statement: "With the advent of real-time bidded exchanges (RTBE), the ability to examine and bid on several billion possible ad impressions every day offers agencies and advertisers both a unique opportunity and a challenge." Not only would this revolutionize the way we advertise online as we know it, but having that kind of power will mean the ability to instantly get an ad message out. I am curious to know if this would incorporate some form of geo targeting? I find the concept of computational advertising very interesting indeed. Thanks paid surveys

This is my first time i visit here. I found so many entertaining stuff in your blog, especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here! Keep up the good work.
Meriahkan pesta ulang tahun bersama GarudaFood

I am really happy to find your blog.This domain was alaways my favourite and your nice article made my day.I bookmarked your site and wish you luck in your future work. Check my collection of villas for rent in Europe and prepair for your desired summer holiday with secure online bookings.about quran

Best-O-Burger, with its Angus patties seared on cast-iron skillets, opened a second location, at One Market, in November. Its flagship Belden Place outpost has already served nearly half a million burgers in just a year and a half—that’s almost a thousand a day.
find a gym

This is a great inspiring article.I am pretty much pleased with your good work.You put really very helpful information.

Korg

The people who have to wear suits, like bankers, still wear suits, but there’s been a backlash against the informality of Casual Fridays. Now men who don’t have to wear suits and all the trappings are wearing them as a fashion statement. minecraft Thanks

I think you did an awesome job explaining it. Sure beats having to research it on my own. Thanks
money lender

Your post really informative.It will be a growing area to watch this year. Like you say, comments keep the conversation going
Seo

This is a great inspiring article.I am pretty much pleased with your good work.You put really very helpful information.

testosterone supplements

Even if it’s nothing more than sitting users down with mockups drawn on paper, you’ll learn a lot about how users expect to interact with your app – and your ads. Be sure to have a steady flow of user testing during and after development.
verizon ringtones

" Great post, I hope to see this continued. I am very interested in the technology side of RTBE. "

Best Man Speeches

I am really happy to find your blog. I am workin in a translation agency (Übersetzung Deutsch Englisch) are you interested to translate your website? Into german or french. I think the ideas behind this type of advertising is so good.

Advertising is very important to a lot of companies. The ideas that you are pushing are so good. There is so much that you can get from it. Keep up the good work on this.
word games

The ideas and tehnology involved is just perfect. I love your blog and your work. Browse my collection of vacation homes to rent a villa online for your desired summer holiday with your partner.

I am really happy to find your blog.This domain was alaways my favourite and your nice article made my day.I bookmarked your site and wish you luck in your future work. Check my collection of villas for rent in Europe and prepair for your desired summer holiday with secure online bookings.

I think the ideas behind this type of advertising is so good. People will be taking advantage of this in the future. Keep up the good work. depuy recall

The technology behind this is so good. There is so much that we can do with this. The ideas are so good behind this. Handgun Safe

Rocket Fuel