the evolution of music continues

BigDataintheMusicandAutomo3veIndustries-MusicDNAFromB2Bdatacapturingtosophis3catedB2B2CServices

DagfinnBach

Musiconline-shortintro

•  Themainstandardsince1991:MPEG

•  MovingPictureExpertsGroup

•  Morethan350industryanduniversitymembers

•  Officialname:ISO/IECJTC1/SC29WG11

•  Format:

•  MPEG-1->Layer3(”mp3”)

•  MPEG-2

•  MPEG-4

•  hVp://www.mp3-history.com/en/the_mp3_team.html

•  A[erMPEG-4

•  Metadataisbecomingmoreandmoreimportant

•  ThisisthebasisforMusicDNA

Confiden3alinfo 2

MusicDNABigData

MusicDNAofferstodayamethodfor:

•  Capturingaudio•  Analysingandproducingmetadata(MusicDNAdescriptors)

•  fingerprin3ngandcapturingmoredata

•  structuring•  storing

”BigData”aboutmusic

forcrea3ng:

1. Stand-aloneB2Bservices2. U3lizingthedatabasetopowerservicestargetedforendconsumerstoenhancetheuserexperiencewithinsearch,sharing,transferandvisualiza3on.

3

TheMusicDNADatabase

Threecomponents:

1.  Apowerfuldatabasecontaining2fingerprintsand15MPEG-7descriptorsofeachsegmentwithineachsoundtrackwithinacollec3onof27Milliontracksisoneofthemostextensiveopera3vemetadatabasesformusicinthemarket.

2.  20.000RadioChannelsindexedinanaddi3onalradio-monitoringdatabase,currentlyrunningareal-3memonitoringof18.000radiochannelsacrosstheworld.

3.  Recognizingaudioofairplaysevery10seconds(fingerprin3ngofen3retrack)andmatchesanddisplayrightsdataandotherassociateddata,andcreatesanewdatabaseshowingthehistoryofairplaysacrosstheworld.

Alldatabasesaregrowingincrementally

4

MusicDNAData(MPEG-7–ISO/IEC15938)

•  Genre,subgenre•  Tempo-/Beatdetermina3on

•  Aggressiveness•  Mood

•  Hardness•  Speech-/musicdiscrimina3on

•  Musiccolor

•  Segmenta3on

•  SoloInstrument

•  InstrumentDensity

•  Percussiveness

5

•  Vocaldetec3on•  Key•  Synthe3city•  RhythmpaVern*

•  VocalDetec3on;singertype(male,female,child,choir)*

•  Vocalstyle(singing,rap,opera,screamingetc...)*

•  CoverSongdetec3on*•  +4-6newdescriptorseveryyearenablingincrementallymoreadvancedrecommenda3onandrecogni3on;

•  ID3Data•  SoundslikeFingerprint

*tobelaunchedin2016

MPEG-7fingerprint

Confiden3alinfo 6

RadioAirplayData

•  Foreachairplayrecogni3onevery10secondacross18.000channels:•  TrackTitle•  Ar3stName

•  ISRC(similarasISBN)

•  ChannelName

•  CountryofChannel•  AirPlay(dd.mm.yyyy),3meanddura3on(fromhh.mm.sstohh.mm.ss)

•  Cityofchannelloca3on(includingGPSdata)•  MorefieldstobeaddedbymeansofMusicDNAtracking/matching

7

BigDataBasisforapplica3ondevelopment

•  27milliontracks

•  15tags•  Average5segmentspersong

•  1,5Billion“datapoints”fordescribing/classifyingmusic

•  Canbematchedandcombinedwith6to7datafieldsforRadiomonitoringfrom18.000channelsacrosstheworldfrom100.000matcheseveryminute(24/7)–1Billionmatchesperweek

•  willcon3nuouslygeneratebillionsofnew“datapoints”everydaywithparameterslikecityofairplay,reachofaudience,3meofthedayforairplay(local3me->morning,day,a[ernoon,night)

•  whichcanbeusedfurtherforgenera3ngmoreandmoresophis3catedindexes,andsearch/recommenda3onsolu3onsbyworkingwith“affiliated”par3es

8

the evolution of music continues

MusicDNARadioMonitoring(somescreenshots-Kygo:StoletheShow)

3325Airplaysduringoneday

Confiden3alinfo 10

Across866channels

Confiden3alinfoforGVL 11

Across62countries

Confiden3alinfo 12

Sortedbyregions

Confiden3alinfo 13

Exportofreport

Confiden3alinfoforGVL 14

Thismorningworld-wide

Confiden3alinfoforGVL 15

ThismorningFrance

Confiden3alinfoforGVL 16

the evolution of music continues

MusicDNAAutomo3veRadioTuner

Applica3onsfortheAutomo3veIndustries(1)

A:MusicDNATuner:

•  Asmartradioindexinstalledineachcar

•  UpdatedregularlyfromBigDataapplica3onscalcula3ngtheprofile(MusicDNA+speech/musicrate)ofeachradiosta3onateveryhour,duringeveryday,duringtheweek.

•  LicensedtoPanasonicAutomo3veSystemsforlaunchin2016(wasprelaunchedatCESinLasVegasinJanuary2015andatDetroitMotorShowinFeb2015,installedinJaguarandLandRover)

B:MusicDNARadioAssistance:

•  AnonlinedatabaseguidingtheprofileofavailablesimilarterrestrialchannelsbasedontheGPSposi3onofthecar

•  Willautoma3callychangetoasimilarchanneltotheonethatislostwhenthecarismovingoutofreachoftheradiotransmiVer

•  Licensenego3a3onswithoneoftheworld´slargestcarmanufacturers,forlaunchin2018.PrototypewaslaunchedinternallyinOctober2015)

Confiden3alinfo 18

Applica3onsfortheAutomo3veIndustries(2)

C:MusicDNATunercombinedwithOnlinemusicservice:

•  Canfindradiochannelsimilartofavouriteplaylistinthemusiconlineservice

•  Cancreateplaylistfromradiolistening(curatedplaylists)

•  Cancreateplaylistbasedonlocalpopularityinareaofdriving.•  Currentlyinini3aldiscussionwithaEuropeanhigh-endcarbrandforlaunchin2018

D:Moreuserscenariosbeingexplored….

•  Greenersolu3ons•  Newbusinessmodels

•  Portable(outofthecar)solu3ons•  Etc…

Confiden3alinfo 19

ISOStandards-MusicDNAandBlue`ords

MusicDNA:Classifica3onforsearch,data-op3miza3onandmatching:

•  ISO/IEC15938:“MPEG-7”

•  SpecifiesMetadatasystemfordescribingmul3mediacontent

•  Descrip3onDefini3onLanguage(DDL)•  MusicDNAMPEG-7descriptors

•  MusicDNAMPEG-7fingerprint

Blue`ords:Datecentresecurity:

•  ISO/IEC27001:"Informa3ontechnology—Securitytechniques—Informa3onsecuritymanagementsystems—Requirements”

•  ISO/IEC27017:2015/ITU-TX.1631—Informa3ontechnology—Securitytechniques—Codeofprac3ceforinforma3onsecuritycontrolsbasedonISO/IEC27002forcloudservices

•  ISO9001:“Qualitymanagementsystems—Requirements”

Confiden3alinfo 20

MusicDNAClients

Mostmusicclients:

•  XML(ExtensibleMarkupLanguage)

•  API(Applica3onProgrammingInterface)

•  MPEG-7forsearch/recommenda3on(exportedfromMusicDNA)

Automo3veClients:

•  MIB(ManagementInforma3onBase):Variousstandards

•  FM/DABIntegra3on:Variousstandards

•  XMLandAPI

•  MPEG-1andMPEG-4foraudioplayback

•  MPEG-7forsearch/recommenda3on(exportedfromMusicDNA)

Confiden3alinfo 21

the evolution of music continues

ThankYou!