big data kansas city: the future of insights - keynote: "big data: what's the big...

41
Big Data Kansas City: The Future of Insights Big Data, what's the big deal?

Post on 17-Oct-2014

4.548 views

Category:

Technology


1 download

DESCRIPTION

Kansas City IT Professionals, a grassroots tech community of 9,000+ members held an event on August 30th, 2012 entitled Big Data: The Future Of Insights (see: http://kcitp.me/M67S9M). The event consisted of 2 keynotes & a panel with expert data scientists, engineers, and data analysts from companies like Adknowledge and Cerner. This talk, entitled "Big Data, what's the Big Deal?" was delivered by Scott Kahler, Data Platforms Administrator w/ Adknowledge. Watch the video here: http://www.youtube.com/watch?v=hQZ-4NMMtBo See the blog post here: http://www.kcitp.com/2012/09/03/big-data-kansas-city-technology-events/

TRANSCRIPT

Page 1: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 2: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Big Data, what's the big deal?

Page 3: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Introducing Adknowledge

A leading online network offering: unique ad formats, data analysis, targeting algorithms, and creative approaches.

Adknowledge provides advertisers with quality leads from hard to-reach places on the Web via multiple channels, including social networks, display, games, mobile, apps, and email.

Since its founding in 2004, Adknowledge has grown organically and through acquisitions (including Miva, Hydra, and AdParlor) to become the largest privately-owned Internet advertising network. With hundreds of employees located throughout North America, plus growing offices in Europe and Asia, Adknowledge aims to set the standard in optimizing online advertiser ROI.

Ready for 2013’s Internet

Internet usage, and Internet advertising, is expected to see double digit growth in 2013.

2.2 Billion Internet Users

1 Billion Facebook Users

500 Million Windows 8 Users

Page 4: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Why are we talking about Big Data?

Page 5: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 6: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 7: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 8: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 9: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 10: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 11: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 12: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 13: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

What is Big Data?

Page 14: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 15: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Big Data

Page 16: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Big Data

Page 17: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 18: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Gartner defines Big Data as:

Big Data is high-volume, high-velocity, and/or high-variety information assets that require new forms of processing to enable enhanced decision making, insight discovery and process optimization.

Page 19: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

3 Vs of Big Data

Volume – It's big, big enough traditional storage methods need reconsideration

Velocity – Churn, input and/or output surpasses normal data loading mechanisms

Variety – Data formats are not always uniform

Page 20: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Scott says:

Big Data is scale-out architecture applied to data processing and storage

Page 21: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

What is the big deal with Big

Data?

Page 22: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

42 x 100M ~ 4.2Gb

Page 23: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

42 x 300M ~ 12.6Gb

Page 24: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

42 x 400M ~ 16.4Gb

Page 25: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Do not drive insights from rollupsSource data is the best source

Which of these do you want an expert

literary analysis to come from

Hadoop LexisNexis(HPCC) Greenplum

1. Store and process massive amounts of data

Page 26: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Split or A/B Testing

Page 27: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

2. Event ingestion pipelines turning hourly if not daily event reporting into real-time data

streams.

Storm S4 Flume

Page 28: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Data Mashups

Page 29: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

3. Massive in-memory data stores and distributed databases are allowing for immediate update and joining of large

data sets

Couchbase MongoDB HBase

Page 30: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

What makes any of these tools work , the people

Page 31: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Where does the leave us with Big Data?

Page 32: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

VirtualizationBiggest Impact: Enterprise

Cloud ComputingBiggest Impact: Small Business

Where will the impact be?

Page 33: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Page 34: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Big Data

Where to start with Big Data?

Page 35: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

"The Next Google” - CNBC

The $100M Revenue Club: "Adknowledge Weaves Web of Ads"

Top 20 CPA Affiliate Network

One of the “Fastest Growing Companies”

Recent Awards & Press 4th largest performance marketplace

A one-stop-shop for hard-to-reach places on the web

Similar ROI to search

Key Facts

60+ Billion impressions per month

10,000 advertisers

Reach over 400 Million people

$300MM revenue and highly profitable

Corporate Locations

Offices in Kansas City, Los Angeles, San Francisco, Ft. Myers, New York, Toronto, London, Shanghai

Sales presence in France, Germany, Brazil, and Australia

Experienced Leadership

International executive team with 150 years of combined executive experience from top companies, including: Google, Microsoft, AOL, Fox, Intermix, Travelport, Acxiom, Coca-Cola

35

Page 36: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

36

• Sophisticated, fast algorithmsUtilizing past behavioral data and sophisticated probability models, our algorithms are designed for dynamic analysis and continuous ad & bid optimization delivering compelling results for future performance – we can predict future responses based on past clicks

• Massive Historical DatabaseAnonymous historical data on over 600 Million users allowing us to truly optimize segmentation, ad targeting, and more

• Large ScaleEnabling better matching of advertiser offers with publisher inventory

• Highest Response Rates & Better Overall ResultsProprietary technology paired with thousands of ads and landing page optimization provides predictable lead volume and increased ROI

• We do not sell our consumer data

Targeting Technology, Unique Data, and Expertise

Page 37: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

Top Categories : USA

Financial Services

Online Coupons

Telecommunications

Education

Home & Garden

Legal

Target by any combination of: City, State, Market, Category, and more

True targeting that uses advanced analytics – the science of online advertising – and not assumptions or guess work.

Top Categories : Dallas, TX

Online Coupons

Apartment Search

Job Search

Career Planning

Education

Medical Assistant

Extensive Market Segmentation for Tailored Targeting

Page 38: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

38

Our Advertisers : Direct Response, Brands, and Games

Page 39: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

39

• Fantastic Employee Benefits & PerksAdknowledge not only provides amazing healthcare, dental, eye and retirement benefits, but also provides a variety of extras to make our team members lives more enjoyable – both at and away from the office – including:• Choice of operating environment (Mac, Linux, or Windows)• Catered lunches (all locations)• After hours drinks & happy hours• Team LAN gaming• Company outings, parties, and team events• Company sponsorships & community involvement • KC Corporate Challenge participation

• Extensive Enrichment OpportunitiesWe recognize the value and importance of growth and encourage our employees to take advantage of numerous opportunities in our offices such as: Yoga classes, Exercise classes, Fitness rooms, Team Fitness

• We’re a FamilyMany of the great events and activities are conceived and organized by our own employees. Great stuff like pool & dart tournaments, KC Corporate Challenge, Operation Breakthrough, Habitat for Humanity, and more!

Dynamic Culture & Workplace

Page 40: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Q & A

Page 41: Big Data Kansas City: The Future Of Insights - Keynote: "Big Data: What's The Big Deal?"

Big Data Kansas City: The Future of Insights

Big Data, what's the big deal?

41

Adknowledge4600 Madison Avenue, 10th Floor

Kansas City, MO 64112

[email protected]

866-730-2109

www.adknowledge.com