Using Data in a Digital Society

1. Using Data in a Digital Society Mike Rich and Scott Finer October 2010

2. Let’s look at just one web page Returning user? Browser Time on site Pages viewed Geo-location Ads Searches Clicks Purchases

3. Terabytes of data!

4. Today’s agenda What comScore does How data are used How we collect data and create our offerings

5. comScore Digital Business Analytics Audience Measurement Site Analytics Vertical Market Solutions Social Analytics User Analytics Copy Testing Campaign Verification Ad Effectiveness Cross Media Advertising Analytics • Unified Digital Measurement™ Mobile Audience Measurement Network Analytics & Optimization Customer Experience & Retention Management Mobile Analytics V0910

6. Many uses

7. Selected Clients Media Agencies Telecom/Mobile Financial Retail Travel CPG Pharma Technology V0910

8. Three primary methodologies • Behavioral data • Passively observing actions • Panel of 2mm worldwide users who consent to participate • Survey data • Actively collecting opinions • Panel of millions of e-mail addresses “opted in” • Survey + Behavioral data • Combining both methods for sophisticated insights (using Multivariate methods)

9. Our Scenario Hangover 2 debutsMemorial Day 2011! Mission: Raise awareness among key audience Find 18 – 24 year olds online Determine what we should do in mobile Reach Xbox gamers when they are not playing Xbox Develop a list of recommendations of where to run campaign

10. Key Measures Internet Behavioral Data

11. Key Measures for 18-24, rank-ordered by Composition Index “Key Measures” is the name of one of our company’s most heavily used online tools, …. It is one of 20-25 types of reports that we collectively refer to as the “interface” Highest reach and engagement sites (over-indexed) for 18-24 year olds in the US

12. Two steps, six ingredients, one caveat Gather the data Recruitment Find people willing to be counted Collection Monitor and transmit Identification Separate data by person Correct for bias Enumeration Determine the size of the universe Calibration Data for target estimates Projection Weight to the universe

13. Proprietary Data Collection Technology Passively track actual consumer behavior Actively survey consumers anytime, anywhere Internet activity, system information “cProxy” comScore Software upgrades, survey invitations Panelist Private and ConfidentialPersonally Identifiable Information strippedusing procedures audited by outside parties

14. Protecting privacy is a core value • TRUSTe compliant disclosure: • Describes what the software does • Describes how the data is used • Links to privacy policy and user agreement • Start/Programs menu entry • Displayed under Add/Remove Programs • Removed immediately on selection • No files left behind • Welcome Pop or Welcome e-mail • Icon displayed in System Tray • WebTrust Privacy seal • Independent audit of our privacy policies, practices and procedures • Assures adherence to high standards in the protection of personally identifiable information

15. Enumeration Survey: • Telephone study using RDD, plus “cell phone only” supplemental data • Target of 1100 completed interviews per month • Information collected includes demographics, number of computers in the home, number connected to Internet • 12 months of enumeration data (in red) are used to create the curve against which the Universe Projection is then fit (in black) How large is the universe we will project to from our panel (the sample) ?

16. Calibration Panel: Removes Inherent Biases • Online recruitment carries with it inherent biases, • For example, the recruitment technique is itself self-selecting…. • In the US we have a standalone Calibration panel, offline random recruited, to provide metrics on, e.g., quartiles of time spent online, which become weighting variables • Outside the US, we are considering strategies to introduce improved calibration procedures • Small random persons panel or cookie panel Calibration Panel Recruited offline, Used as a ‘yardstick’ Overall Panel Adjusted to reflect metrics of the Calibration Panel

17. Assigning weights to “Project” from Sample to Universe; in our case, from Panel to Population To qualify for sample: Must have complete demography. Must be active. Persons without activity are excluded At least 90% of computer activity must be successfully assigned to a member of the household Stratification variables: Age Gender Duration Categories And several others,…. Final Step, Assign “weights” to each machine Weights change each month

18. MobiLens Mobile trends via survey

19. DEMO

20. Measuring Attitudes and Opinions via Survey Invite users E-mail lists Web site intercepts Gather responses Thousands of users surveyed each month for MobiLens Survey flows customized based on phone type Process the data Weight and project Load into interface

21. Segment Metrix Social trends using survey and behavioral

22. Combine attitudinal and passively observed traffic behavior • Visitation to sites by content category; • Heaviness of online use; • Frequency of searching; • Frequency and volume of purchasing • Etc….. • Feelings, • Perceptions, • Attitudes, • Preferences, • Example; Generally, I prefer to shop online for most of my household needs Seek permission from survey respondent (observe privacy as disclosed to recruited panelists) for both observations and survey

23. Analyze combined data set Exploratory analysis k Means Cluster (reduce a large data set to meaningful subgroups of individuals or objects) Factor Analysis (reduce data set to best variables) Analysis of Variance (many types) Segmentation (optimize differentiation between segments) Discriminant Analysis (correctly classify observations or people into homogeneous groups) Baysian or probabilistic methods (http://en.wikipedia.org/wiki/Bayesian_model_comparison) A key objective is to construct “Predictive models” (A model made up of a number of predictors variables that influence future behavior, such as an online product sale)

24. Research outcomes and Actionable outcomes Why go to all this trouble? Because these techniques, lead to management actions that improve revenue or lower costs; they help managers optimize efficiency. How? For example, increase “lift” for advertising campaigns, and thereby, Increase the “return on investment” ROI in marketing. Compare relationships between selected attitudes and behaviors Both Narrowly and broadly (DR vs Brand) Perform segmentation Score panelists with segment membership Profile segments • In terms of Demographics, search behavior, traffic patterns, online purchasing Actionable outcomes of segmentation Report traffic or search by marketing segments Target marketing segments

25. Segment Metrix, 18-24, Gaming Aficionados Segment Metrix is the name of an online tool that reports traffic by Segment,. Often, the segments are formulated by a combination of survey and behavioral data Here sites are rank-ordered by their composition Index strengths

26. Conclusions

27. Our Media Plan Recommendations Web Sites Twitter, MySpace, Vevo and Hulu are just a few of the key web sites that hit our target audience well Mobile About a third of 18 – 24 year olds have a smartphone, so use this medium but supplement with other ad buys Within mobile, look for the usual suspects (social, search, entertainment) but also consider news and reference sites Gaming Aficionados Look to video heavy sites like Craveonline and Vevo. Also look for ways to target gaming blogs on Technorati and Six Apart

28. In Summary Data is everywhere in the digital world Respecting privacy can open the door to new knowledge Behavioral data gives us massive information Survey data helps fill in the blanks for what we can’t observe Combining behavioral and survey allows for highly sophisticated insights

29. Thanks! comscore.com comscorecareers.com

30. Appendix

31. Building MobiLens

32. MobiLens

33. Example of segment output by selected sites traffic For four 18-24 high indexing Amusement sites,….the High Ambition group has the smallest indexes.