adtech pipeline: kafka->apex->geode
TRANSCRIPT
Prepared for:© 2016, Ampool, Inc. All Rights Reserved
A Distributed, Memory-Centric, Object Store for Closed Loop Analytics
Prepared for:© 2016, Ampool, Inc. All Rights Reserved
In-Memory Distributed Sys
Low-latency Comms.
Key-Value Store
Function Pushdown
+
High Throughput
Table Store
Native InterfacePluggable Store Manager
Java API
MASH (CLI Ext)
Java API
Building on PROVEN In-memory Technology…
Smart Data Tiering
Mature Event Model
Tunable Consistency
Metadata/ Catalog
Security AuthZ
Prepared for:© 2016, Ampool, Inc. All Rights Reserved
In-Memory Distributed Sys
Low-latency Comms.
Key-Value Store
Function Pushdown
+
High Throughput
Table Store
Native InterfacePluggable Store Manager
Java API
MASH (CLI Ext)
Java API
Smart Data Tiering
Mature Event Model
Tunable Consistency
Metadata/ Catalog
Security AuthZ
…makes it ENTERPRISE READY
✅Ease of Use
✅Security
✅High Availability
✅Dynamic Scaling
Prepared for:© 2016, Ampool, Inc. All Rights Reserved
Users
View ContentHave InterestsServed Ads
Publishers
Add ContentUpdate Interests
ACME CorpServe Ads/ ContentCapture EventsServe analytics
Ad Tech: A simple illustrative analytics use-case
Ad Server Infra/ Logs
Ad Ad Ad …
Ad Ad Ad …
Advertisers
Create AdsUpdate InterestsAd Performance
Data/ Admin
Monitor data flow service & infrastructure
Events
Prepared for:© 2016, Ampool, Inc. All Rights Reserved
Analytics: Kafka, Apex, Ampool serving Advertisers
Kafka
Advertisers
Ad Logs& Updates
DT RTSAd Performance
Top AdsTop Camp.$ Revenue
Prepared for:© 2016, Ampool, Inc. All Rights Reserved
Demo Pipeline Setup: Detailed Data Flow
KafkaData Generator
Ingest Streaming Analytics Ad-hoc Queries
Use
rs
Ads
Cont
ent
Ad Server Logs
U-C-A Updates
Ad Server Logs
Batch ProcessingContent-Ad
Apex
Ad Server
Users
Ads
Content
Kin Ad Server
Kin Users
Kin Ads
Kin Content
Mout Ad LogMout Users Mout Ads Mout Content
User-Ad Top Events
StrCounter
TopCamps TopAds
AD/Content Meta LookupFrom Ampool Table
Enrichment/TransformationsAnalytics of interest
(TBD)Mout Camp Mout Ad