identv capabilities overview 2017 (with demos)

THE NEXT EVOLUTION IN VIDEO ANALYSIS & BIG DATA ANALYTICS

MISSIONProviding powerful & transformative video analytic capabilities:

Real-time Indexing, Matching and Exploitation of Video

A.I. Enabled Technologies with brand/logo, facial & object detection, recognition and Exploitation.

IDenTV 2017Contact: Amro Shihadah [email protected]

IDenTVConfidential&Proprietary2017

“To make video data into useful big data, we need to leap beyond this (human intervention).

We need true video analytics, powered by computer vision.”

Source: Wired

Technology OverviewIntelligentVideoPlatform(IVP):TheIVPisacommercial-ready,breakthroughtechnologythatenableshigh-speedvisualcontentrecognitionandindexing,withreal-timesearchandidentification

AutomaticNewAdsDetectionSystemdesignedtofindandcutnewunseenbeforeadsfortaggingandidentification

ArtificialIntelligence&ComputerVisionSupportforreal-timebrand/logorecognition,OCR,facialandobjectidentification

Scalable&HighAvailabilitySupportthousandsofchannelsidentifyingtensofthousandsofads/clipswithextremeaccuracy,efficiency,andscalabilityasneededTotallyover-the-top,reportingonvariablelengthclips

TheBigVideoIndex(BVI):Videoindexingandreal-timeidentificationcapableofrunningonmillionsofSmartTVs &mobiledevicesorin-appecosystems.


The Intelligent Video PlatformAfullsuiteofmarketprovenAutomatedContentRecognition(ACR)basedonvideoandaudiofingerprintingtechnologieswithA.I.integratedcapabilitiesincreasingthevalueofdataproducedsuchas:

• OCR,Brand/LogoRecognition,AutomaticSpeechRecognition,CCcapture/creation,aswellasFacial&Object,brand/logotracking,identification/recognition.

• Real-timeabilitytoprocessthousandsofliveTVchannels,videostreams,archivedvideo.

• Abilitytosimultaneouslyidentifythousandsofads/clipswithinmillisecondsacrossmillionsofhoursoflivestreamingorpre-recorded/archivedvideo.

• Performs40millionimagecomparisonspersecondusingonecoreofcommodityhardware(lowcost)

• Automaticextractionofrichvisualmetadataandcreationofcloud-basedindexesathyper-fastspeeds.

• Cleveruseofdeeplearningmakesautomatedin-videorecognitionsignificantlylessornothumandependentatall!


The Intelligent Video Platform (IVP): For the Automated Creation of Rich Metadata in-Video

5

Broadcast,SVOD,VOD,Archived,UserGeneratedVIDEO Ad-Cutter&ClipUploader/Tagging

CONTEXTUALMETADATA:OBJECTS,SCENESCLOSEDCAPTIONSANDMORE

• AutomatedIn-linefirstairingadcuttingsystem

• Usingourpowerfulscenedetectiontechnology,oursystemautomaticallydetectsindividualadvertisementswithinanadbreak/pod,andcutsthemintovideoclipsthelengthoftheadvertisement.

• NLPbasedAutomaticrichmeta-dataiscreatedthenclipsroutedtoQAandadtaggingsystemusingrichindustryacceptedtaxonomy

Automatic New Ad Detection Feature


- 13:01:40,3/01/2017,WED,Apple,Applie iPadPro:Tablet

- 13:02:10,3/01/2017WED,TrueCar,TrueCar :HowCarBuyingShouldBe

- 13:02:40,3/01/2017WED,Unilever,VenusEmbrace

- 13:01:40,3/01/2017,WED,Audi,AudiA4:Untouchable

- 12:50:31,3/01/2017WED,Tide,Tide:StainRemover

- 12:50:01,3/01/2017,WED,T-Mobile,T-Mobile:Un-carrier

Closed Caption Program & Ad Keyword Search for Contextual Re-TargetingFeature

8

Scene Detection, Identification/Recognition for Contextual Metadata Extraction

Feature

EmbeddedVideoPresentations

Real-TimeAutomatedCreationofRichVisualMetadataForContextualAnalyticsFromBigVideoData(Live/VOD/SVOD,UserGeneratedContent,Archival,CCTV/Aerial)ForNumerousApplicationsIncluding:

• WorkflowOptimizations:ReducesMillionsofLaborHours– Logging,SearchingandIdentifyingVideo(Broadcast,OnlineMedia,CCTV/AerialSecurity,andmore)enableshumaninterventiontobeminimal!

• AugmentServices:Vastlyimproveexistingservicesusingourtrulyunparalleled&actionableinsightsforincreasedrevenuegenerationviacontextualcuesfromthevideocontentitself.

• VerifiedPlayout– paststatisticalorpixeltracking.Capableofmonitoringmillionsoftargetedstreams&billionsofhoursofvideoinreal-timetoensurehighfidelityplayout

• BrandSafety– ensureyourplacementisnotonexplicitcontent.

• Anti-Piracy– Monitoringpeertopeerandothernetworksforcopyprotectedmaterial,canflagprotectedcontentfromsecondsofreferencevideo.

• NewServices: Tietovariousdatasetstounlocknewrevenuegeneratingproducts/servicesforclientspoweredbythemostcuttingedgevideoanalysis.

• ContextualMetadata&VideoSearchEngine– querybytextorbyvideocliptorecallexactvideofrommassiverepositoriesinstantly!Pasttitle,tagsordescriptionsearchesonwhatactualhappensinvideo!“TheGoogle&GoogleAnalyticsofVideo”

Artificial Intelligence Powered Automated Content, Object and Facial Recognition Across Real-Time or Historic Volumes of Video for Contextual Metadata Creation


Feature Applications



• Currentlydeployedasacontentandad-detectionplatformon292TVstations24/7ingestingandmatchingframebyframereferencedata.

• OCR. CC. ASR, Brand/logo, Facial and Object Recognition – Across real Time or Historic Volumes of Video

• Streaming Recognition matching at .4 seconds recognition and tracking of faces and logos and other objects in real-time across hundreds of thousands of hours of video.

• The big video indexing technology allows for rapid retrospective search across voice or image in milliseconds.

• Allows for the “real-estate” of video enabled devices to be monitored producing user-level data while keeping privacy intact

Artificial Intelligence & Automated Content, Object, Facial and Brand/Logo Recognition Across Real-Time or Historical Volumes of Video for Contextual Metadata Creation


Feature Applications

To index and identify all the footage on a mobile device as it is streaming (Social or Traditional Media, or the Device Camera)

To use image search, not audio (avoid difference in languages issue)

To index new added videos at the same rate they are produced (real time object and or facial detection of reference data)

Scalable to millions of devices

Can be in-device or in-app ecosystems

To Enable Cross-Platform TV Measurement

In-Device: Mobile & Smart TV Video Indexing and Tracking


Feature Application

Computer Video Vision Search and Indexing Performance CapabilitiesVideo Search Time:On a laptop, with 3000 hours of video, the query time is below 25 milliseconds.

Indexing Time:It is immediate and real time. Indexing can be done while watching a TV channel or the media source.

How does it scale:-It is designed to allow billions of hours of video and millions of clients.- If memory based: A single server will take thousands of indexed hours of video and around 15,000 simultaneous clients.- If DB driven: A single server will serve billions of indexed hours.-In summary, the scaling ability depends on external factors: mainly, network and database.- 40,000,000 image comparisons per second per core


The Future is Now

Big Video Index (BVI)– Computer Vision & A.I. Applied to Live TV, VOD, Social/User Generated Content & More. On Smart TVs, Set-top boxes & Mobile Devices and even In-Application Ecosystems For the Extraction Unparalleled User-Level Analytics.

The Future is Now


IDenTVhasalreadyprocessedmorethan1.7Millionhoursofvideoduringitsshortlifeasacompany(internalexplanation:100channelsonaveragex24hours/dayx365days/yearx2years).

EveryhourIDenTVmakesmorethan56TRILLIONimage-comparisonsjustonitsvideosearchengine

IDenTVautomaticallycapturesthousandsofnewclipsperday(thesearetheadsautomaticallycutfromtheTVstreams).Beforeanyhumanevenlooksatthem,theyareautomaticallyincorporatedtothemainsystemandtheystartprovidingfeedback.

IDenTVexpandsitsproprietaryreal-timeexecutionframework.Itnowincorporatestheabilitytorunnativeapplications(likeGPUintensiveprocessing)inanyoperatingsystem.Theseextensionsallowthesystemtoautomaticallyextractobjects,brands,logos,text,facesandotherthingsinanintegratedenvironment.

Computer Video Vision Search and Indexing Performance Capabilities


The Future is Now

AGENCIES & BRANDSAdvertisementtracking&Advancedanalytics

• Providingtruereal-timevideoverifiedreporting• StandardizingTV&digitaldataacrossmarketingchannels

foroptimizeddata-drivenmarketing.• Instantaneousverificationofairingsenablesoptimized

targeting&real-timeOmni-channelsynchronizedmarketing.• UnparalleledIntelligenceonyouorcompetitor’scampaigns.

• MEDIAAGENCIES,theIVPprovidesbetter,moretransparentvalue-addedservicestotheirclientsfordecisionsupportpurposes

• AugmentservicesdirectlytoBRANDSallowingthemfullTRANSPARENCY&controloftheirvideomediabuying,targeting/placements.

Actionable&BestInClassAnalyticsDatacanbeaccessedanywhereviaour web-enabledplatform,schedulereports(atanytimeinterval)orPuhReportingviaAPIorWebhook.

Real-timeSpottrackingQuicklyandeasilyseeexactspotairingtimeswithvideoverificationoranas-broadcastedclipofeachtimeanadvertisement aired.

BetterDecisiononMediaBuysSimplestandpowerfulwaytotrackyourmediabuyingwithconfidenceandTRANSPARENCY.

Product Vertical


Big Video Indexing and Video Fingerprinting: 24/7/365 Deployed Across National Buys for Cross-Channel Synchronization of Marketing Activities

• PROBLEM:BSThadclientssaturatingdigitalspendbuthesitanttobuyonTVduetolackofdata,unknownair-timesandinherent,lackoftransparency

• SOLUTION:Introducedhypertargetedcreativetestingandsynchronizedcross-channelmarketingremediedvia ONLY transparentreal-timevideoverifiedreal-timereportingforTV.

• RealTimeframebyframedetection24/7/365across200Channelsand asetof25creativestargetedtodifferentdemographics

• RESULTS:Real-timedataenabledinstantanalysis&re-targetingonothermarketingchannelsleadingtomaximizedROI– Aliftof20%indownloadsand16%inusageoverthe baseline weekoverweek!

Use-Case: Solution for Marketers

Business Intelligence: Real-time & Historic Insights via Custom Dashboards & Reporting

TRANSPARENY withasbroadcastedclipsoftheadastheyplayedout.

COMPETITORTRACKINGtrackyourcompetitorsairings,spendandstayaheadwithreal-timereporting!

DECISIONSUPPORT:Accessibleanywheremonitoringdetectedads,competitors,campaigns,industries&morealldisplayedinourweb-enabledcustomizableB.I.dashboards,includingallthepertinentmetadataandinsightsfordata-drivenandadvancedadvertising!

CUSTOMIZABLEREPORTS:VisualizationsofdataforfasterandmoreeasilyingestibleandactionableanalyticscreatedtodisplayclientspecificKPIsandanynumberofcriteria,suchasadsacrossaspecificnetwork,asingleadsperformanceacrossallnetworks,industryviews,competitortracking,andmuchmore.

Feature: Customized & Actionable Real-Time Reporting


TV Stations and NetworksMarketingAutomation,Ad Logging&Sales Intelligence

01

Easytouseplatformproducesreportsinnumerousformats&alladsarevideoverifiedforincreased transparency

03

REAL-TIME LANGUAGEAGNOSTIC EASYTOUSE OVERTHETOP

VIDEOFEED TheIVPingests streamsofachannel(s)toprovidereal-timeAd-LoggingServices

Ads can be cut from the stream or processed directly from networks’ current and growing advertisement database

Seamless integration with existing Trafficking & Billing & Broadcast Management Solutions, Drag and Drop FTP for dynamic scheduling and playout

Cost & Time Savings: Automation reduces manual intervention while remaining cost effective

New Revenue Generation: Web-based DVR recordings (14 days – 1 year) for multiplatform delivery of TV ads allowing for improved cross-platform measurement & compliance capabilities

Product Vertical: Advanced Analytics & Video Technology Services


UsingIVP,ourproprietaryVideoFingerprintingtechnology– AdsorVideoClipsaredetectedinReal-Time

NOWATERMARKING,SPECIALIZEDENCODING,RELIANCEONDELAYEDUNVERIFIEDMANUALINTENSIVEREPORTS

LANGUAGEAGNOSTIC:Theblendofourvideoanalysissolutionsallowourservicestobedeployedinanylanguagearoundtheworld!

AUTOMATION IDenTV’sAutomatedAdLogging& AdvancedAnalytics solutionenablestelevisionnetworkstoeliminatethetedious,expensive,andantiquatedanalogprocessofloggingadsmanuallyorviaunverifiedplayoutreports.

OPTIMIZESALESusingreal-timedata-drivenintelligencetoretaincustomersthickeningrevenuestreamsandgainnewcustomersbyofferingdata-drivencompetitiveintelligencetomaketheirbuysatapremium.

CONTEXTUALTARGETINGTie1st partydatasuchasviewershiporsimplybasedonthecontextextractedinreal-timefromstreams A.I.backedservicesincludingOBJECT,FACIAL,BRAND/LOGOrecognitionoffersmoreeffectivetargetingandad-placementsfornewrev.generatingservices.

DynamicAd-Insertions&Multi-PlatformDelivery:IPconversionallowsfordistributioninstantlyacrossmediums,additionallyA.I.servicesenableenhancedcontextualre-targetingtoensureclientsachieveKPIsandreachhighintenthighvalueend-users.

DecisionSupport:FullyintegratedREAL-TIMEVIDEOVERIFIEDreportingofaNetworkorGroupsentiread-libraryenableshigheractionabilityandcertaintyindata-drivenmarketingservices.

TV Stations and NetworksMarketingAutomation,Ad Logging&Sales Intelligence


ActionableAdvancedAnalyticsThickenGenerateNewRevenueStreams&Services

Product Vertical: Advanced Analytics & Video Technology Services

The Future is Now

TechnologiesprovidetheTRANSPARENCY&ACTIONABILITYneededtocreateaclosedloopmeasurableyetdynamiccross-platformvideomarketingecosystem-ContentDistributorsandOwners(Sellers)canprovidemorevaluabletargeting,dynamicad-insertionsonopeninventoryachievinganepremiumforeachsaleandAgencies/Brands/Marketers(Buyers)nowcanadjustontheflybasedonreal-timevideoverifieddatarealizingincreasedROIviaAUTOMATION&SYNCHRONIZATIONofDYNAMICHYPER-TARGETEDcross-platformvideoadvertising.

Synchronizecross-platformTVviaIPconversiontocross-channelmarketingmediumsandsocialmediausingdatafromthelargestspending&reachingchannelofmarketing- TV.WhetheryouarerunningaTVcampaignornot,synchronizeanytypeofmarketingbuyagainstcompetitorcampaign’sinreal-timewithactionablecompetitorintelligenceanddata-drivendecisionsupporttotargetthesameaudiences&deliverontheflypromotionsfornewrevenuegeneration!

Bridging TV & Digital Video Analytics for Real-Time Dynamic Data-Driven Contextual Targeted Insertions & Facilitating Programmatic Marketplaces in TV!

Synchronize&MeasureCross-PlatformVideoMarketing

Data-Driven not Driven by Data

National security

State of play

Real time video matching for special operations community. Initial pilot in 2 countries has expanded to Middle East, Africa and North Africa

IDenTV successfully deployed its machine learning and object recognition technology into a real time aerial C4ISR sensor – creating VID-INT or video intelligence that alerts analysts of threats or irregular activities in real-tme.

Product Vertical


Big Video Indexing and Video Fingerprinting: 24/7/365 Deployed Across USG Special Program w/ Analytics of Matches

RealTimeframebyframedetection24/7/365acrossagrowingcorpusof480,000hoursofrawvideofromaustereenvironments• Preforming40Millionimage

comparisonspersecondononeservercore

• DeploymentofScalablePlatformbasedreal-timespawningvirtualmachinesnodesasneeded.

• HIGHLYACTIONABLEDASHBOARDFORDATA-DRIVENREPORTINGOFVID-INT(videointelligence)


Use-Case : National Security

§ RealtimeObjectDetection§ Detectedobjectsidentifiedwithinthevideo§ ObjectsidentifiedagainstObjectLibrary§ Track1000’softrackupdatespersecond

§ Track identified objects of interest§ Create reports, real-time & forensic§ Continuous training of Object Library

National Security: IDenTV Object Detection Integrated SolutionAerial Video

23


UAVProgram§ Candetectandidentifyvehicleswith50x50pixels§ Cancontinuouslytrainobjectlibrary(car,truck,tank,boat,

plane)

Integrated Solution: Object Detection and Identification from Fixed Wing Aerial Surveillance Based on Reference Sample

AWSEnabledandFederated

Videodetectionsannotatedonlivemap

Tracksassignedauniqueidentifiers



Mohammad Shihadah Chairman and CEOOver 35 years experience in private and public company management for technology companies. Co-founder of AppTek, acquired by eBay.

Bob MilaniCTOOver 20 years experience in software development and design including enterprise entertainment/TV, mobile, VOIP.

Marco BaenaChief Scientist22 years experience in the field of software invention, development including software security systems, distributed computing, machine learning and enterprise web development.

Dr. Mark HughesComputer Vision Lead10 years experience in image and video search technologies.IBM Research Engineer at IBM’s Watson Health System.

Harish SeshadriChief Architect21 years experience in software invention, development and consulting including development of software security systems, distributed computing, machine learning.

Amro Shihadah Co-founder and COOExperience in M&A and Financial Accounting , serial entrepreneur with first start-up at age 16 and working on various tasks at an operational & leadership capacity.

Oliver Myers, EsqVP of Business DevelopmentExecutive Director of The US Chamber of Commerce in Turkey, Former Counsel to the Board of Large Turkish-Investment Group involved in Real Estate, Aerospace, Defense and Entertainment.

Mudar Yaghl Board MemberDecades of natural language processing (NLP) and human language technology (HLT) experience. Co-founded several technology companies, including AppTek, acquired by eBay

Hassan SawafAdvisorFormer Head of Artificial Intelligence, Scientific Advisor - eBay LabsCurrently Artificial Intelligence Director at Amazon

Stephanie Bellistri AdvisorInternational Affairs, Counterintelligence and Security expert. Former senior advisor to Palantir Technologies and former Senior Operations Officer at the CIA.

LeadershipandAdvisoryTeam

25


THANK YOU!

IDENTV.COM599 3rd St. 203

San Francisco CA [email protected]

Contact Us To Learn More!

http://www.identv.com/

http://www.identv.com/

mailto:[email protected]?subject=I'm Interested In Learning More

https://www.slideshare.net/secret/JouBFrE2yNTiKh

https://www.youtube.com/c/identv

http://www.twitter.com/identvsf

http://www.linked.com/in/identvsf

identv capabilities overview 2017 (with demos)

Data & Analytics