john schneider - dodccrp.orgenel engage technologies enigma enn corporation entrust technologies,...

John SchneiderPrincipal Investigator, Efficient XML

[email protected]://www.agiledelta.com

John SchneiderJohn SchneiderPrincipal Investigator, Efficient XMLPrincipal Investigator, Efficient XML

[email protected]@agiledelta.comhttp://www.agiledelta.comhttp://www.agiledelta.com

“POWER TO THE EDGE”““POWER TO THE EDGEPOWER TO THE EDGE””

Efficient XMLTaking Net-Centric Operations to the Edge

Efficient XMLEfficient XMLTaking NetTaking Net--Centric Operations to the EdgeCentric Operations to the Edge

mailto:[email protected]

mailto:[email protected]

http://www.agiledelta.com/

http://www.agiledelta.com/

Great Moments in Evolution

OverviewOverview

•• XML benefits and challengesXML benefits and challenges•• Efficient XMLEfficient XML•• JEFX JEFX ’’06 Results06 Results•• JRAE JRAE ’’06 Results06 Results•• Summary and questionsSummary and questions

XML is EverywhereXML is Everywhere

ABNABN--AMRO BankAMRO BankAccessAccessAccess Company LimitedAccess Company LimitedAcuityAcuityAdobe Systems Inc.Adobe Systems Inc.AGF.SIAGF.SIAgfa Division, Bayer Corp.Agfa Division, Bayer Corp.AgileDelta, Inc.AgileDelta, Inc.Agile SoftwareAgile SoftwareAgranat Systems, Inc.Agranat Systems, Inc.Alcatel Alsthom RechercheAlcatel Alsthom RechercheAlfaAlfa--Omega FoundationOmega FoundationAliaron, Inc.Aliaron, Inc.Alis Technologies, Inc.Alis Technologies, Inc.Allaire CorporationAllaire CorporationAmerica Online, Inc.America Online, Inc.American ExpressAmerican ExpressAND Data LtdAND Data LtdANDAND--USA, Inc.USA, Inc.APACSAPACSAplix CorporationAplix CorporationApple Computer, Inc.Apple Computer, Inc.ArborText, Inc.ArborText, Inc.Architecture Projects Management Ltd.Architecture Projects Management Ltd.Ardent Software, Inc.Ardent Software, Inc.ArrowPoint CommunicationsArrowPoint CommunicationsArt Technology GroupArt Technology GroupAsymetrix CorporationAsymetrix CorporationAT&TAT&TAttachmate CorporationAttachmate CorporationAutodesk, Inc.Autodesk, Inc.BackWeb Technologies, Inc.BackWeb Technologies, Inc.British Broadcasting CorporationBritish Broadcasting CorporationBEA Systems, Inc.BEA Systems, Inc.BELGACOMBELGACOMBitstream, Inc.Bitstream, Inc.Bluestone SoftwareBluestone SoftwareThe Boeing CompanyThe Boeing CompanyBow Street, Inc.Bow Street, Inc.Bowne Internet SolutionsBowne Internet SolutionsUniversity of BristolUniversity of BristolBritish Telecommunications LaboratoriesBritish Telecommunications LaboratoriesBull S.A.Bull S.A.Calico Technology, Inc.Calico Technology, Inc.Canal +Canal +Canal/WebCanal/WebCanon, Inc.Canon, Inc.Cap Gemini InnovationCap Gemini InnovationCCTACCTACenter for Democracy and TechnologyCenter for Democracy and TechnologyCenter for Mathematics and Computer Science (CWI)Center for Mathematics and Computer Science (CWI)Center for Telematics and Information Technology (CTIT)Center for Telematics and Information Technology (CTIT)Centraal CorporationCentraal CorporationCERNCERNChina Times Interactive Co., Ltd.China Times Interactive Co., Ltd.Chunghwa Telecom Company, Ltd.Chunghwa Telecom Company, Ltd.Cisco SystemsCisco SystemsCiTECCiTECCITIBANK, N.A.CITIBANK, N.A.CNET CNET -- The Computer NetworkThe Computer NetworkCNRCNR----Instituto Elaborazione dellInformazioneInstituto Elaborazione dellInformazioneCNRSCNRSCoalition for Networked InformationCoalition for Networked InformationCOLLEGIS Research InstituteCOLLEGIS Research InstituteCommerce OneCommerce OneCommerceNetCommerceNet

GMD National Research Center for Information TechnologyGMD National Research Center for Information TechnologyGraphic Communications AssociationGraphic Communications AssociationGrenoble Network InitiativeGrenoble Network InitiativeGroove Networks, Inc.Groove Networks, Inc.Groupe ESC GrenobleGroupe ESC GrenobleGTW AssociatesGTW AssociatesHarlequin Inc.Harlequin Inc.Health Level Seven, Inc.Health Level Seven, Inc.The Hebrew University of JerusalemThe Hebrew University of JerusalemHelsinki Telephone CorporationHelsinki Telephone CorporationHewlett Packard CompanyHewlett Packard CompanyHitachi, Ltd.Hitachi, Ltd.Hong Kong Jockey ClubHong Kong Jockey ClubHong Kong Productivity CouncilHong Kong Productivity CouncilHong Kong University of Science & TechnologyHong Kong University of Science & TechnologyHTML Writers Guild, Inc.HTML Writers Guild, Inc.Hyperwave Information Management, Ges. m.b.H.Hyperwave Information Management, Ges. m.b.H.IBERDROLA S.A.IBERDROLA S.A.IBM CorporationIBM CorporationIBM Taiwan CorporationIBM Taiwan CorporationIEEE Computer SocietyIEEE Computer SocietyILOG, S.A.ILOG, S.A.IMALLIMALLIMG SRC, Inc.IMG SRC, Inc.Industrial Technology Research InstituteIndustrial Technology Research InstituteInfopartnersInfopartnersInformation Broadcasting Laboratories, Inc. (IB Labs)Information Broadcasting Laboratories, Inc. (IB Labs)Infoteria, Inc.Infoteria, Inc.Innosoft International Inc.Innosoft International Inc.Inso Corporation, ProvidenceInso Corporation, ProvidenceInstitut FrancoInstitut Franco--Russe A.M. LiapunovRusse A.M. LiapunovIntel CorporationIntel CorporationIntelink Management Office (IMO)Intelink Management Office (IMO)Interleaf, Inc.Interleaf, Inc.IntermindIntermindThe International DOI FoundationThe International DOI FoundationInternational Integrated Systems, Inc.International Integrated Systems, Inc.Internet Lawyers Conference (ILC)Internet Lawyers Conference (ILC)Interval Research CorporationInterval Research CorporationIntraspect Software, Inc.Intraspect Software, Inc.iReady CorporationiReady CorporationJetFormJetFormJoint Info. Systems Comm. of the UK Higher Ed. Funding Joint Info. Systems Comm. of the UK Higher Ed. Funding

CouncilCouncilKnowledgeCite, Inc.KnowledgeCite, Inc.Lawrence Berkeley National LaboratoryLawrence Berkeley National LaboratoryLexmark International, Inc.Lexmark International, Inc.Los Alamos National LaboratoryLos Alamos National LaboratoryLotus Development CorporationLotus Development CorporationLucent TechnologiesLucent TechnologiesMacKichan Software, Inc.MacKichan Software, Inc.MacromediaMacromediaMarimba, Inc.Marimba, Inc.MatchLogic, Inc.MatchLogic, Inc.Matra HachetteMatra HachetteMatsushita Electric Industrial Co., Ltd. (MEI)Matsushita Electric Industrial Co., Ltd. (MEI)MBED SoftwareMBED SoftwareMedicalData Service GmbHMedicalData Service GmbHMerrill LynchMerrill LynchMetropolitan Police ServiceMetropolitan Police ServiceMicroelectronics and Computer Technology Corporation Microelectronics and Computer Technology Corporation

(MCC)(MCC)Microsoft CorporationMicrosoft CorporationMicrostar Software Ltd.Microstar Software Ltd.Microsystems Software, Inc.Microsystems Software, Inc.

Corel CorporationCorel CorporationCorporation for National Research Initiatives (CNRI)Corporation for National Research Initiatives (CNRI)Council for the Central Laboratory of the Research Councils Council for the Central Laboratory of the Research Councils

(CCL)(CCL)CrystalizCrystaliz, Inc., Inc.CSIRO AustraliaCSIRO AustraliaCyberCashCyberCash, Inc., Inc.Daewoo Electronics CompanyDaewoo Electronics CompanyData ChannelData ChannelData Interchange Standards Association, Inc. (DISA)Data Interchange Standards Association, Inc. (DISA)Data Research Associates, Inc.Data Research Associates, Inc.DatafusionDatafusion, Inc., Inc.DatalogicsDatalogics, Incorporated, IncorporatedDefense Information Systems Agency (DISA)Defense Information Systems Agency (DISA)Department of Communications, Information Technology Department of Communications, Information Technology

and the Artsand the ArtsDeutsche Telekom Deutsche Telekom -- Online Service GmbH (TOnline Service GmbH (T--Online)Online)DFN DFN VereinVereinDigital Vision Laboratories CorporationDigital Vision Laboratories CorporationDirect Marketing Association, Inc.Direct Marketing Association, Inc.Distributed Systems Technology Centre (DSTC Pty Ltd)Distributed Systems Technology Centre (DSTC Pty Ltd)DoubleClickDoubleClickEE--centre UKcentre UKEastman Kodak CompanyEastman Kodak CompanyEC Cubed, Inc.EC Cubed, Inc.ÉÉcolecole NationaleNationale SupSupéérieurerieure dInformatiquedInformatique et de et de

MathMathéématiquesmatiques AppliquAppliquééeses (ENSIMAG)(ENSIMAG)University of Edinburgh (HCRC Language Technology University of Edinburgh (HCRC Language Technology

Group)Group)EEIG/ERCIMEEIG/ERCIMElectricitElectricitéé de Francede FranceElectronic Network ConsortiumElectronic Network ConsortiumENELENELEngage TechnologiesEngage TechnologiesEnigmaEnigmaENN CorporationENN CorporationEntrust Technologies, Inc.Entrust Technologies, Inc.EpicentricEpicentric, Inc., Inc.EpriseEprise CorporationCorporationERICSSONERICSSONErnst & Young LLPErnst & Young LLPETNOTEAM S.p.A.ETNOTEAM S.p.A.EUnetEUnet International BVInternational BVExcosoftExcosoftFederal Geographic Data CommitteeFederal Geographic Data CommitteeFermi National Accelerator LaboratoryFermi National Accelerator LaboratoryFIZ Karlsruhe (FIZ Karlsruhe (FachInformationsZentrumFachInformationsZentrum))ForschungszentrumForschungszentrum InformatikInformatik (FZI)(FZI)Foundation for Research and Technology (FORTH)Foundation for Research and Technology (FORTH)France TelecomFrance TelecomFraunhoferFraunhofer IGDIGDFretwellFretwell--Downing Data Systems Ltd.Downing Data Systems Ltd.FSTC (Financial Services Technology Consortium)FSTC (Financial Services Technology Consortium)Fujitsu LimitedFujitsu LimitedFulcrum Technologies, Inc.Fulcrum Technologies, Inc.GE Information Services, Inc.GE Information Services, Inc.GEMPLUSGEMPLUSGeneral Magic, Inc.General Magic, Inc.GEO Interactive Media Group Ltd.GEO Interactive Media Group Ltd.George Washington UniversityGeorge Washington UniversityGeoworksGeoworksGlobeIDGlobeID SoftwareSoftware

MindQuakeMindQuake Interactive, Inc.Interactive, Inc.MITRE CorporationMITRE CorporationMitsubishi Electric CorporationMitsubishi Electric CorporationMotorolaMotorolaMTA SZTAKIMTA SZTAKINASA Ames Research CenterNASA Ames Research CenterNational National ChiaoChiao Tung UniversityTung UniversityNational Security Agency (NSA)National Security Agency (NSA)National University of SingaporeNational University of SingaporeNCompassNCompass Labs, Inc.Labs, Inc.NCRNCRNEC CorporationNEC CorporationNETAWAYNETAWAYNetscape CommunicationsNetscape CommunicationsNetStudioNetStudio CorporationCorporationNetwork Computer, Inc. (NCI)Network Computer, Inc. (NCI)Network SolutionsNetwork SolutionsUniversity of New South WalesUniversity of New South WalesNHS (National Health Service, UK)NHS (National Health Service, UK)Nippon Telegraph & Telephone Corp. (NTT)Nippon Telegraph & Telephone Corp. (NTT)NOKIA CorporationNOKIA CorporationNortelNortelNovell, Inc.Novell, Inc.NTT Data CorporationNTT Data CorporationNTT Mobile Communications Network, Inc. (NTT NTT Mobile Communications Network, Inc. (NTT DoCoMoDoCoMo))OReillyOReilly & Associates, Inc.& Associates, Inc.Organization for the Advancement of Structured Information Organization for the Advancement of Structured Information

Standards (OASIS)Standards (OASIS)Object DesignObject DesignObject Management Group, Inc. (OMG)Object Management Group, Inc. (OMG)Object Services and Consulting, Inc.Object Services and Consulting, Inc.OCLC (Online Computer Library Center, Inc.)OCLC (Online Computer Library Center, Inc.)OmniMarkOmniMark Technologies CorporationTechnologies CorporationONION S.p.A.ONION S.p.A.The Open GroupThe Open GroupOpen Market, Inc.Open Market, Inc.Open Software Associates, Inc.Open Software Associates, Inc.Open Text CorporationOpen Text CorporationOracle CorporationOracle CorporationPacific Pacific SoftworksSoftworksParadigm Development CorporationParadigm Development CorporationPartners HealthCare System, Inc.Partners HealthCare System, Inc.PencomPencom Web WorksWeb WorksPerspectaPerspecta, Inc., Inc.Pervasive SoftwarePervasive SoftwarePhilips Electronic N.V.Philips Electronic N.V.Phoenix Technologies Ltd.Phoenix Technologies Ltd.Poet Software CorporationPoet Software CorporationPointCast IncorporatedPointCast IncorporatedPretty Good Privacy, Inc.Pretty Good Privacy, Inc.The Productivity Works, Inc.The Productivity Works, Inc.Qualcomm Inc.Qualcomm Inc.Quark, Inc.Quark, Inc.Rapid Logic, Inc.Rapid Logic, Inc.Raptor Systems, Inc.Raptor Systems, Inc.RealNetworksRealNetworksReed ElsevierReed ElsevierReuters LimitedReuters LimitedRivcomRivcomRiverlandRiverland Holding NV/SAHolding NV/SARoyal Melbourne Institute of TechnologyRoyal Melbourne Institute of TechnologyRoyal National Institute for the Blind (RNIB)Royal National Institute for the Blind (RNIB)S.W.I.F.T. scS.W.I.F.T. scSAIC/SAIC/BellcoreBellcore

Sandpiper Networks, Inc.Sandpiper Networks, Inc.SAP AGSAP AGSBC Technology ResourcesSBC Technology ResourcesSecurity Dynamics Technologies, Inc.Security Dynamics Technologies, Inc.Segue SoftwareSegue SoftwareSemaSema GroupGroupSharp CorporationSharp CorporationSICSSICSSitaraSitara Networks, Inc.Networks, Inc.SnapSnapSoftQuadSoftQuad Software, Inc.Software, Inc.Software AGSoftware AGSoftware Publishers Association (SPA)Software Publishers Association (SPA)SonnetechSonnetech, Ltd., Ltd.Sony CorporationSony CorporationUniversity of SouthamptonUniversity of SouthamptonSpeech Works International, Inc.Speech Works International, Inc.Spyglass, Inc.Spyglass, Inc.SqribeSqribe TechnologiesTechnologiesStarBurstStarBurst CommunicationsCommunicationsStrategic Interactive GroupStrategic Interactive GroupStuart McIntoshStuart McIntoshSun Microsystems, Inc.Sun Microsystems, Inc.surfCONTROLsurfCONTROLSURFnetSURFnet bvbvSwedish Institute for Systems Development (SISU)Swedish Institute for Systems Development (SISU)Sybase, Inc.Sybase, Inc.SynthSynth--BankBankTandem Computers, a division of CompaqTandem Computers, a division of CompaqTechnischeTechnische UniversitatUniversitat GrazGrazTeknemaTeknema CorporationCorporationTelecom ColombiaTelecom ColombiaTelecom ItaliaTelecom ItaliaTexcelTexcel GroupGroupThe Thomson CorporationThe Thomson CorporationTIAATIAA--CREFCREFTNO Multimedia and TelecommunicationsTNO Multimedia and TelecommunicationsToshiba CorporationToshiba CorporationToyota Motor CorporationToyota Motor CorporationTrilogy Technologies, Inc.Trilogy Technologies, Inc.TRUSTeTRUSTe2Bridge Software2Bridge SoftwareUKERNAUKERNAUNI.CUNI.CUnited States Environmental Protection Agency (EPA)United States Environmental Protection Agency (EPA)Unwired PlanetUnwired PlanetUWI.ComUWI.ComVeonVeon, Inc., Inc.VeriSign, Inc.VeriSign, Inc.Verity, Inc.Verity, Inc.Victor Data Systems Co., Ltd.Victor Data Systems Co., Ltd.Vignette CorporationVignette CorporationVisio CorporationVisio CorporationVTT Information TechnologyVTT Information TechnologyWall Data IncorporatedWall Data IncorporatedWaterloo MapleWaterloo MaplewebMethodswebMethods, Inc., Inc.WebTV Networks Inc.WebTV Networks Inc.WinWritersWinWritersWolfram Research, Inc.Wolfram Research, Inc.worldwebworldwebWWW WWW -- KRKRXerox CorporationXerox CorporationXionicsXionics Document Technologies, Inc.Document Technologies, Inc.

MicrosoftMicrosoft

SunSunOracleOracle

IntelIntel IBMIBM

BEABEA RIMRIM

AT&TAT&T

ApacheApache

NovellNovellCiscoCisco

AdobeAdobe MacromediaMacromediaSybaseSybase

HPHPGoogleGoogle

CorelCorel

PalmPalm

MozillaMozilla

NokiaNokia

MotorolaMotorolaSonySony

Universal adoption, thriving community, fantastic products, rapid innovation













MicrosoftMicrosoft

SunSunOracleOracle

IntelIntel IBMIBM

BEABEA RIMRIM

AT&TAT&T

ApacheApache



HPHPGoogleGoogle

CorelCorel

PalmPalm

MozillaMozilla

NokiaNokia



Sold!

There is a vast range of information and services available via XML













MicrosoftMicrosoft

SunSunOracleOracle

IntelIntel IBMIBM

BEABEA RIMRIM

AT&TAT&T

ApacheApache



HPHPGoogleGoogle

CorelCorel

PalmPalm

MozillaMozilla

NokiaNokia



Sold!

^Not Quite













MicrosoftMicrosoft

SunSunOracleOracle

IntelIntel IBMIBM

BEABEA RIMRIM

AT&TAT&T

ApacheApache

NovellNovell

CiscoCisco


HPHPGoogleGoogle

CorelCorel

MozillaMozilla

NokiaNokia


Sold!BEABEASold!

Benefits of XML are not available where efficiency is critical

XMLXML

XX

XX

XX

XX

XX

XX

MicrosoftMicrosoft

SunSunOracleOracle

IntelIntel IBMIBM

BEABEA RIMRIM

AT&TAT&T

ApacheApache


AdobeAdobe XeroxXeroxSybaseSybase

GEGEHPHP

CorelCorel

PalmPalm

MozillaMozilla

NokiaNokia

ATO

ACO

GCCS COP (TDBM)

Air Picture (Link 16)ASR

Land Picture(Army FBCB2)

XML-MTF

XML-VMF

Cursor on Target

Army AFATDS

Intel - Targets - Threats(IBS CMF)

SOF Positions (BAO Kit)

AODB(TBONE - TBMCS)

USMC C2PC

And Net-Centric Operations don’t work at the edge

XMLGateway Gateway

Gateway Gateway

Gateway

Gat

eway

Gatew

ay

Gat

eway

XX

XX

XX

XX

XML is EverywhereXML is EverywhereNot Quite^

XMLXML

1,122

51

JVMF Target Nomination22 times larger!

Size

in b

ytes

XML JVMF format

WhatWhat’’s the Problem?s the Problem?XML vs. Existing Tactical MessagesXML vs. Existing Tactical Messages

11,408,021

674,233

JSTARS Ground Targets17 times larger!

Size

in b

ytes

XML GMTI format

1,094

9

TDL Air Track122 times larger!

Size

in b

ytes

XML TDL format

7,663,647

729,871

Air Tasking Order (ATO)10 times larger!

Size

in b

ytes

XML USMTF format

22x More 22x More Bandwidth!Bandwidth!

121x More 121x More

Bandwidth!Bandwidth!

17x More 17x More Bandwidth!Bandwidth!10x More 10x More

Bandwidth!Bandwidth!

Net-Centric web standards require 10-100x more bandwidth

OverviewOverview


What is Efficient XML (EFX)?What is Efficient XML (EFX)?•• A COTS XML optimization product that improves:A COTS XML optimization product that improves:

•• NetworkNetwork bandwidth, throughput and scalabilitybandwidth, throughput and scalability•• ServerServer scalability, throughput and CPU utilization scalability, throughput and CPU utilization •• DeviceDevice battery life, storage, heat and responsivenessbattery life, storage, heat and responsiveness•• Data centerData center power consumption, heat, bandwidthpower consumption, heat, bandwidth

•• Requires no proprietary interfaces or protocolsRequires no proprietary interfaces or protocols•• A major improvement over previous approachesA major improvement over previous approaches

Bandwidth Utilization

20%

13%

1%

NCES SOAP Message (213 KB)

% O

rigin

al B

andw

idth

Fast Infoset GZIPPED XML Efficient XML

Server Throughput

33

369

67

NCES SOAP Message (213 KB)

Mes

sage

per

sec

ond


Battery Life

8529 7720

33680

Nokia 6800 Mobile PhoneTr

ansa

ctio

ns p

er b

atte

ryXML GZIPPED XML Efficient XML

1%

369 33680

•• Works very well where previous approaches failWorks very well where previous approaches fail(e.g., high volume streams of small messages)(e.g., high volume streams of small messages)•• Tactical messages (VMF, TDL, IBS, GMTI, etc.)Tactical messages (VMF, TDL, IBS, GMTI, etc.)•• GeoGeo--location datalocation data•• Sensor dataSensor data•• Asynchronous event processingAsynchronous event processing

•• Extends NetExtends Net--Centric Operations to far edge of networkCentric Operations to far edge of networkGeo-location data

2362%

1754%

96%

24 byte VMF message

% B

inar

y Si

ze


Aircraft radar tracks6244%

4400%

100%

9 byte TDL message

% B

inar

y Si

ze


JSTARS GMTI data

613%

451%

26%

96 byte STANAG 4607 message%

Bin

ary

Size


What is Efficient XML (EFX)?What is Efficient XML (EFX)?

OverviewOverview


Efficient XML in JEFX Efficient XML in JEFX ’’0606

CNETTTNT

JTIDSLOS

UHF SATCOMCAOC

BACNFutureCombatSystems

IBS

Army PASSCoTRouters

ADSITBMCS AFTRSEfficient XML

Efficient XML

Efficient XML

Special Tacticswith BAO Kit

Efficient XML

JTIDS

Efficient XML

JSOTF

F-15E1 & FA-18F1E-2C XHAWKEfficient

XML

BAO KitWEEMC

Brigade / ASOC (Bullpen)

Efficient XML

Efficient XML

Efficient XML

CombatSkySAT

TACSAT

Efficient XML

Efficient XML

Special Tacticswith BAO Kit

JEFX JEFX ’’06 Performance Example06 Performance ExampleCursorCursor--onon--Target (Target (CoTCoT) Tracks) Tracks

100,000+ CoT Efficient XML messages processed per day during JEFX

JEFX '06 Efficient XML ACO sizes

0

200,000

400,000

600,000

800,000

1,000,000

1,200,000

17 apr ch0 18 apr ch0 20 apr ch0 19 apr ch0 25 apr ch0 22 apr ch0 24 apr ch0 26 apr ch0

ACO Identifier (sorted by size)

Siz

e in

byt

es

XMLEfficient XML

JEFX JEFX ’’06 Performance Example 06 Performance Example Airspace Control Orders (Airspace Control Orders (ACOsACOs))

1,145,433 bytes

13,338 bytes

On Average, Efficient XML ACOs were over 80 times smaller

85 times smaller

JEFX '06 MainEx ATO Sizes (XML and Efficient XML)

0

1,000,000

2,000,000

3,000,000

4,000,000

5,000,000

6,000,000

7,000,000

8,000,000

9,000,000

24 aprch0

(2000)

25 aprch0

(2000)

26 aprch0

(2000)

21 aprch0

(2000)

22 aprch0

(2000)

21 aprch1

(2000)

24 aprch0

(2004)

20 aprch0

(2000)

25 aprch0

(2004)

22 aprch0

(2004)

26 aprch0

(2004)

21 aprch1

(2004)

21 aprch2

(2004)

20 aprch0

(2004)

ATO Identifier (sorted by size)

Size

in b

ytes

XML

Eff icient XML

JEFX JEFX ’’06 Performance Example 06 Performance Example Air Tasking Orders (Air Tasking Orders (ATOsATOs))

7,663,647 bytes

71,261 bytes

On Average, Efficient XML ATOs were over 100 times smaller

107 times smaller

Transfer Speed Measured in JEFX Transfer Speed Measured in JEFX ‘‘0606ACO to EACO to E--2C over TTNT airborne network2C over TTNT airborne network

Notes: Notes: Without Efficient XML, transmission is impossible with current rWithout Efficient XML, transmission is impossible with current radiosadiosATOsATOs are 5are 5--7 times larger than the ACO shown here7 times larger than the ACO shown here

Efficient XML

XML2:23

0:01

JEFX '06 CAS ATO Mission sizes (XML and Efficient XML)

0

200,000

400,000

600,000

800,000

1,000,000

1,200,000

1,400,000

25 ap

r ch0

(200

0)

24 ap

r ch0

(200

0)

20 ap

r ch0

(200

0)

21 ap

r ch0

(200

0)

21 ap

r ch1

(200

0)

22 ap

r ch0

(200

0)

20 ap

r ch0

(200

4)

24 ap

r ch0

(200

4)

26 ap

r ch0

(200

0)

22 ap

r ch0

(200

4)

21 ap

r ch1

(200

4)

21 ap

r ch2

(200

4)

26 ap

r ch0

(200

4)


Size

in b

ytes

XML CAS Missions

Efficient XML CAS Missions

JEFX JEFX ’’06 Performance Example06 Performance ExampleATO CAS missions extracted from ATOATO CAS missions extracted from ATO

1,165,927 bytes

5,584 bytes

On average, CAS missions extracted from ATO were over 180 times smaller

208 times smaller and faster

Note: CAS missions query took only 15 minutes to develop using a free, open-source XML tool

Note: CAS missions query took only 15 minutes to develop using a free, open-source XML tool

JEFX '06 CAS ATO Mission logarithmic sizes (XML and Efficient XML)

1

10

100

1,000

10,000

100,000

1,000,000

10,000,000

1 2 3 4 5 6 7 8 9 10 11 12 13


Size

in b

ytes

(log

arith

mic

)

XML ATO

XML CAS Missions

Eff icient XML ATO

Efficient XML CAS Missions

JEFX JEFX ’’06 Performance Example06 Performance ExampleCombined effect of Efficient XML with queriesCombined effect of Efficient XML with queries

7,663,647 bytes

71,261 bytes

1,165,927 bytes

5,584 bytes

1372 times smaller and faster

Combining Efficient XML with query results produced extremely good results

7 times smaller

Efficient XMLEfficient XMLATO size reductionATO size reductionATO CAS fragmentsATO CAS fragments

JEFX JEFX ’’06 Assessment Results06 Assessment Results

I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Assessment Results

FieldBACN**CSSNTISR-ISSWIPE

GSATSOFTNet

NCWIBaS&E

More WorkFAOC

Fielding Recommendation

Operational AssessmentTechnical Readiness

Cross Cutting TechBinary XML*** TTNTRAIDER

Ready for transition

Incomplete programmatics

No sustainment path

Fielding RecommendationMature capability / Ready for testing

Require system/subsystem development

More research required

Technical ReadinessFills warfighter need

Limited utility

No benefit to warfighter

Operational Assessment

AOC 10.1.1TBONEWEEMCIWPCDLARS

*

CSAFInitiatives

****

* BACN – Long-term platform to be determined** Merge BACN & Adaptive Joint C4ISR Node (AJCN) *** Binary XML - Immediate, interim DoD fielding while

waiting on commercial standard**** Require more testing / sensor availability to evaluate

Taken from JEFX ’06 CSAF Fielding Recommendations Briefing

OverviewOverview


Efficient XML in JRAE Efficient XML in JRAE ’’0606Scenario : Joint Target Management (JTM)Scenario : Joint Target Management (JTM)

JRAE 06 11

Compressed XMLNotional JCAS MISSION

123456

654321PDA Device

Blue Force Tracks & Filtered Target

InformationDown Load from SOA

123456

654321Heads Up Display

9 LineTarget Information Upload to A/C from

PDA

Target

Sights Target and publish to JTLM; subscribe to

JTLM; update target list

BPEL Filtering for JTLM Targeting Info

Highly Efficient XML

Munitions on Target

SOABFT/ JTLM / DCGS

IA: Role Based Access

NCCP II C2 services: Orchestration, Op Context, Adaptors, Association

JRAE ’06 focused on a NCES SOA pub-sub architecture for nominating, coordinating and prosecuting targets

Efficient XML in JRAE Efficient XML in JRAE ’’06 06 Tactical Web ServicesTactical Web Services

TBMCS C2PCPDA

JTM ServiceJTM

Service

TBMCS-JTMClient C2PC-JTM

Client

AFATDS

AFATDS-JTMClient

JTLMXML / EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

(Micro-Lite Tablet PCRunning AFATDS

JTM Client)

GCCS-MWeb Browser

JTLMXML/EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

Efficient XML

Efficient XML Efficient

XMLEfficient

XML

JTM-MIP/C2IEDM

AdaptorC2IEDMC2IEDM

JTM-MIP/C2IEDM

Adaptor

JETS-JTMAdapter

JETTS

C2IEDMSchema

C2IEDMSchema

JTT

JTT-JTMClient

JTLMXML/EFX

WSDLSchema

PDADDACT

With VMF

JTM-VMFAdaptor

SimulatedLow BandwidthSINGARS Radio

Efficient XML

Efficient XML

Efficient XML

Efficient XML

JRAE ’06 successfully used Efficient XML to extend the reach of web services to tactical users

JRAE JRAE ’’06 Performance Examples06 Performance ExamplesJTM Tactical Web ServicesJTM Tactical Web Services

10,485

253

Publish 5 targets41 times smaller

XML Efficient XML

38,243

79

Existance results for 911 targets484 times smaller

XML Efficient XML

2,009,574

16,276


XML Efficient XML

213,123

2,193


XML Efficient XML

In aggregate, Efficient XML messages were 100+ times smaller

123x 123x smaller!smaller!




JRAE JRAE ’’06 Performance Examples06 Performance ExamplesTADIL, JVMF and GMTITADIL, JVMF and GMTI

Efficient XML provides the benefits of XML and the efficiency of hand-optimized binary formats

24 times this height8752 bits

Over 3 times this height1,122 bytes

Over 2 times this height 11,408,021 bytes

Why XML

doesn't work

at the edge

674,233

103,3760

NATO 4607 GMTI110 times smaller

XML Existing Binary Efficient XML

0

51 48

JVMF K4.01 ObsRep23 times smaller


0

7059

TADIL J3.2 AirTrack152 times smaller


Efficient XML Performance Examples

Why EFX

does work

at the edge

Taken from SPAWAR JRAE ’06 Results Presentation

Efficient XMLEfficient XMLJTM, VMF and TDL compactnessJTM, VMF and TDL compactnessPerformance and browser integrationPerformance and browser integration

JRAE JRAE ’’06 Recommendation06 RecommendationA single standard for data transferA single standard for data transfer

Efficient XML Performance Examples

2,260,430

24,738

JTM Publish91 times smaller

XML Efficient XML

1,860

138

FBCB2 PASS Message13 times smaller

XML Efficient XML

7,663,647

71,261

MTF ATO108 times smaller

XML Efficient XML

Efficient XML compared to existing binary formats and XML

13,157

6,563

CoT Imagery2 times smaller

XML Efficient XML

EFX ACROSS THE BOARDWITH A SINGLE STANDARD

DATA EXCHANGE BETWEEN SYSTEMS BECOMES A NON ISSUE

To fightusing the web as a weapon

systemWe must a have a single standard

For all data transfer Needs:

MTF, TADIL,JVMF,CoT, etc.

EFXprovides that

standard


JRAE JRAE ’’06 Recommendations06 Recommendations


Quick Look Recommendations1) Joint Target Management Service – support planned transition path and promote

it as model for other services to use in migration from “as is” to “to be”2) Efficient XML (EFX) - Military Services / Acquisition Agencies move to require

EFX be incorporated as a standard for all future near real time applications; and current applications as feasible– OSD / DISA / Services / Acquisition Agencies require that EFX be incorporated into a

variety of applications and utilized by the warfighter during the final stage of W3C Standards Approval Process (approximately 2 years) to ensure military needs are included

– DISA / DoD become actively involved in the W3C Standards Approval Process for this capability

– Applicability to real time applications be assessed3) C2IEDM Data Dictionary be a required starting point for developing common data

elements across the Services and Coalition in support of SOA operations4) NSA investigate integration with EFX and digital signature approaches that

support bandwidth disadvantaged users (under 14Kb) 5) For current IA capability in low bandwidth operations, a secure circuit and/or SSL

architecture be offered as an SOA option6) An individual message (data package) prioritization capability must be developed

that operates across the GIG if time sensitive tactical missions are to be executable on an IP based network

The warfighter must consistently get the right information at the right time if he is expected to embrace net-centric warfare operations

MUST HAVE!

Efficient XML SummaryEfficient XML Summary

EfficiencyEfficiency

ReducedReducedCostsCosts

InteroperabilityInteroperability

A new breed of technologyA new breed of technology

Information Theory

FormalLanguage

Theory

Efficient XML SummaryEfficient XML SummaryEfficient XMLEfficient XML


ReducedReducedCostsCosts

InteroperabilityInteroperability

•• Achieves unprecedented Achieves unprecedented compression and speedcompression and speed

•• Up to 100Up to 100--400 times smaller 400 times smaller and fasterand faster

•• More bandwidth, battery More bandwidth, battery life, storage, memorylife, storage, memory

•• Less CPU, power, heatLess CPU, power, heat

•• One web data format for One web data format for allalldata and data and allall devicesdevices

•• Efficient enough to replace Efficient enough to replace handhand--optimized formatsoptimized formats

•• Can plug transparently into app Can plug transparently into app servers and XML interfacesservers and XML interfaces

•• Can interoperate with systems Can interoperate with systems still using plainstill using plain--oldold--XMLXML

•• Lower bandwidth costsLower bandwidth costs•• Lower device costsLower device costs•• Replace proprietary binaries Replace proprietary binaries

with open web technologieswith open web technologies•• Eliminate format gatewaysEliminate format gateways

A new breed of technologyA new breed of technology

Information Theory

FormalLanguage

Theory


Questions?Questions?Resources:Resources:

Efficient XML: Efficient XML: http://http://www.agiledelta.com/product_efx.htmlwww.agiledelta.com/product_efx.htmlDownload: Download: http://http://www.agiledelta.com/efx_download.htmlwww.agiledelta.com/efx_download.htmlW3C Standard: W3C Standard: http://www.w3.org/TR/exi/http://www.w3.org/TR/exi/

http://www.agiledelta.com/product_efx.html

http://www.agiledelta.com/efx_download.html

http://www.w3.org/TR/exi/


Backup SlidesBackup SlidesBackup Slides

Independent Assessment and AdoptionIndependent Assessment and AdoptionU.S. Air ForceU.S. Air Force

Air Operation Center

BACN

RAIDER

Efficient XML

IBS

WEEMCCoTRouters


Efficient XML

CNETTTNT

JTIDSLOS

UHF SATCOM

Efficient XML

SOF Teamwith BAO Kit

Efficient XML

JTIDS

Efficient XML

Special Ops


XML

BAO KitWEEMC

TACPwith CASS Kit

Deployed HQ

Efficient XML

Efficient XML

Efficient XML


BACN

RAIDER

Efficient XML

RAIDER

Efficient XML

IBS

WEEMCCoTRouters


Efficient XML

CNETTTNT

JTIDSLOS

UHF SATCOM

Efficient XML


Efficient XML


Efficient XML

JTIDS

Efficient XML

Special Ops


XML

BAO KitWEEMC

TACPwith CASS Kit

Deployed HQ

Efficient XML

Efficient XML

Special Ops


XML

BAO KitWEEMC

TACPwith CASS Kit

Deployed HQ

Efficient XML

Efficient XML

Efficient XML

U.S. NavyU.S. Navy

TBMCS C2PCPDA

JTM ServiceJTM

Service


Client

AFATDS

AFATDS-JTMClient

JTLMXML / EFX

WSDLSchema


JTM Client)

JTLMXML / EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

GCCS-MWeb Browser

JTLMXML/EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

Efficient XML


XMLEfficient

XML

JTM-MIP/C2IEDM

AdaptorC2IEDMC2IEDM

JTM-MIP/C2IEDM

AdaptorJETS-JTM

Adapter

JETTS

C2IEDMSchema

C2IEDMSchema

JTT

JTT-JTMClient

JTLMXML/EFX

WSDLSchema

PDADDACT

With VMF

JTM-VMFAdaptor


Efficient XML

Efficient XML

Efficient XML

Efficient XML

TBMCS C2PCPDA

JTM ServiceJTM

Service


Client

AFATDS

AFATDS-JTMClient

JTLMXML / EFX

WSDLSchema


JTM Client)

JTLMXML / EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

GCCS-MWeb Browser

JTLMXML/EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

Efficient XML


XMLEfficient

XML

JTM-MIP/C2IEDM

AdaptorC2IEDMC2IEDM

JTM-MIP/C2IEDM

AdaptorJETS-JTM

Adapter

JETTS

C2IEDMSchema

C2IEDMSchema

JTT

JTT-JTMClient

JTLMXML/EFX

WSDLSchema

PDADDACT

With VMF

JTM-VMFAdaptor


Efficient XML

Efficient XML

Efficient XML

Efficient XML

World Wide Web ConsortiumWorld Wide Web Consortium Example CustomersExample Customers

Independent Assessment and AdoptionIndependent Assessment and AdoptionU.S. Air ForceU.S. Air Force


BACN

RAIDER

Efficient XML

IBS

WEEMCCoTRouters


Efficient XML

CNETTTNT

JTIDSLOS

UHF SATCOM

Efficient XML


Efficient XML

JTIDS

Efficient XML

Special Ops


XML

BAO KitWEEMC

TACPwith CASS Kit

Deployed HQ

Efficient XML

Efficient XML

Efficient XML


BACN

RAIDER

Efficient XML

RAIDER

Efficient XML

IBS

WEEMCCoTRouters


Efficient XML

CNETTTNT

JTIDSLOS

UHF SATCOM

Efficient XML


Efficient XML


Efficient XML

JTIDS

Efficient XML

Special Ops


XML

BAO KitWEEMC

TACPwith CASS Kit

Deployed HQ

Efficient XML

Efficient XML

Special Ops


XML

BAO KitWEEMC

TACPwith CASS Kit

Deployed HQ

Efficient XML

Efficient XML

Efficient XML

U.S. NavyU.S. Navy

TBMCS C2PCPDA

JTM ServiceJTM

Service


Client

AFATDS

AFATDS-JTMClient

JTLMXML / EFX

WSDLSchema


JTM Client)

JTLMXML / EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

GCCS-MWeb Browser

JTLMXML/EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

Efficient XML


XMLEfficient

XML

JTM-MIP/C2IEDM

AdaptorC2IEDMC2IEDM

JTM-MIP/C2IEDM

AdaptorJETS-JTM

Adapter

JETTS

C2IEDMSchema

C2IEDMSchema

JTT

JTT-JTMClient

JTLMXML/EFX

WSDLSchema

PDADDACT

With VMF

JTM-VMFAdaptor


Efficient XML

Efficient XML

Efficient XML

Efficient XML

TBMCS C2PCPDA

JTM ServiceJTM

Service


Client

AFATDS

AFATDS-JTMClient

JTLMXML / EFX

WSDLSchema


JTM Client)

JTLMXML / EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

GCCS-MWeb Browser

JTLMXML/EFX

WSDLSchema

JTLMXML / EFX

WSDLSchema

Efficient XML


XMLEfficient

XML

JTM-MIP/C2IEDM

AdaptorC2IEDMC2IEDM

JTM-MIP/C2IEDM

AdaptorJETS-JTM

Adapter

JETTS

C2IEDMSchema

C2IEDMSchema

JTT

JTT-JTMClient

JTLMXML/EFX

WSDLSchema

PDADDACT

With VMF

JTM-VMFAdaptor


Efficient XML

Efficient XML

Efficient XML

Efficient XML

World Wide Web ConsortiumWorld Wide Web Consortium Example CustomersExample Customers

““The real winners in JEFX The real winners in JEFX ’’06 06 that filled our capability goals that filled our capability goals are BACN and are BACN and Binary XMLBinary XML””

RecommendationRecommendationImmediate fieldingImmediate fielding

““Efficient XML is a Efficient XML is a transformational capabilitytransformational capability””

“…“… should be incorporated as a should be incorporated as a standard in all future data standard in all future data sharing systems ...sharing systems ...””

““the best performer for nearly the best performer for nearly all test documents in all all test documents in all application classesapplication classes””

Selected as basis for global web Selected as basis for global web standard for binary XMLstandard for binary XML


FAQFAQ

FAQFAQHow does EFX size compare to previous approaches?How does EFX size compare to previous approaches?

•• EFX consistently performs better than previous approachesEFX consistently performs better than previous approaches•• W3C tests found Efficient XML consistently performed better thanW3C tests found Efficient XML consistently performed better than

every every candidate on candidate on everyevery test group and test group and every every application classapplication class•• Candidates:Candidates: FastInfosetFastInfoset, ASN.1 PER, ASN.1 BER, FXDI, , ASN.1 PER, ASN.1 BER, FXDI, XebuXebu, , esXMLesXML, ,

gzippedgzipped XML, XML, gzippedgzipped FastInfosetFastInfoset, , gzippedgzipped ASN.1 PER/BER, etc.ASN.1 PER/BER, etc.•• Test groups:Test groups: webweb--services, finance, geoservices, finance, geo--location, scientific, military, location, scientific, military,

electronic documents (electronic documents (OpenOfficeOpenOffice, SVG), broadcast, data storage, SVG), broadcast, data storage•• Applications:Applications: With and without schemas. With and without compression.With and without schemas. With and without compression.

Web-services / military

12% 12%

0.8%

2 MB SOAP message

% X

ML

Size


Finance

16%

20%

6%

6 KB FpML message

% X

ML

Size


GeoLocation

53%

106%

14%

100 byte Location message%

XM

L Si

zeFast Infoset GZIPPED XML Efficient XML

FAQFAQHow does EFX size compare to previous approaches?How does EFX size compare to previous approaches?

•• EFX works well where data compression fails EFX works well where data compression fails (e.g., high volume streams of small messages)(e.g., high volume streams of small messages)•• Financial exchange dataFinancial exchange data•• GeoGeo--location datalocation data•• Sensor dataSensor data•• Asynchronous event processingAsynchronous event processing

•• Can replace best proprietary binary formats with open web standaCan replace best proprietary binary formats with open web standardsrds

Geo-location data2362%

1754%

96%

24 byte VMF message

% B

inar

y Si

ze


Aircraft radar tracks6244%

4400%

100%

9 byte TDL message

% B

inar

y Si

ze


JSTARS GMTI data

613%

451%

26%

96 byte STANAG 4607 message%

Bin

ary

Size


FAQFAQHow much processing overhead does EFX introduce?How much processing overhead does EFX introduce?

DecompressCompress

XML Compressed XML

XML

Traditional compression adds processing overhead for compression/decompression

Data

XML

API

Data

XML

API

Efficient XML event stream

EFX event streams are read/written directly via standard XML APIs

Data

XML

API

Data

XML

API

FAQFAQHow much processing overhead does EFX introduce?How much processing overhead does EFX introduce?

•• It depends on your implementationIt depends on your implementation•• EFX 1.0 was slower than EFX 1.0 was slower than gzippedgzipped XMLXML•• EFX 2.0 was faster than EFX 2.0 was faster than gzippedgzipped XML XML and and XML (up to 9x)XML (up to 9x)•• EFX 3.0 is up to 90x faster than XML!EFX 3.0 is up to 90x faster than XML!

•• W3C tests found EFX 3.0 was one of the fastest processors, W3C tests found EFX 3.0 was one of the fastest processors, even compared to those optimized for speed over compactnesseven compared to those optimized for speed over compactness

Web-services / military

0.5 0.5

24

2 MB SOAP message

Mes

sage

s pe

r sec

ond

XML GZIPPED XML Efficient XML

Finance

3,244 2,095

22,609

6 KB FpML message

Mes

sage

s pe

r sec

ond

XML GZIPPED XML Efficient XML

GeoLocation

9,244 6,911

274,595

100 byte Location messageM

essa

ges

per s

econ

dXML GZIPPED XML Efficient XML

48x 48x faster!faster!



FAQFAQDo I have to change my code to use EFX?Do I have to change my code to use EFX?

Webservice

code

Web Service Web Service Client

WS Integration

KitXML

Bin

ding

API

XML or EFX

Efficient XML integration kits

plug-in transparently

ClientcodeWS

Integration Kit XM

L B

indi

ng A

PI

•• No. No. •• EFX web service plugEFX web service plug--ins add EFX natively to web service platformsins add EFX natively to web service platforms•• EFX proxies (HTTP, TCP and UDP) add EFX to existing applicationsEFX proxies (HTTP, TCP and UDP) add EFX to existing applications

Integration using Efficient XML Integration Kits requires no code modifications

FAQFAQDo I have to change my code to use EFX?Do I have to change my code to use EFX?

Servercode

Server

Client

Proxy

Clientcode

Proxy

XML or EFXXML

XML

Client

Clientcode

XML

Integration using Efficient XML Proxies requires no code modifications

FAQFAQWonWon’’t EFX break compatibility with plaint EFX break compatibility with plain--oldold--XML?XML?

ServerServer ClientClientI support XML and EFX

I’m sending you EFX

ClientClientI support XML

I’m sending you XML

•• No.No.•• EFX tools detect and use EFX when available EFX tools detect and use EFX when available

and automatically falland automatically fall--back to XML otherwiseback to XML otherwise•• Clients that donClients that don’’t support EFX never see itt support EFX never see it

FAQ FAQ Can I read EFX with standard XML tools?Can I read EFX with standard XML tools?

Efficient XML in Internet ExplorerXML in Internet Explorer

This kind of transparency and tool support makes testing, debugging and using Efficient XML far easier than other binary formats

•• Yes. With appropriate plugYes. With appropriate plug--ins and converters.ins and converters.

FAQFAQDoes EFX work with XML Security?Does EFX work with XML Security?

•• Yes. Unlike most binary XML technologies, EFX was designed to Yes. Unlike most binary XML technologies, EFX was designed to work with existing XML Security standards and libraries, includiwork with existing XML Security standards and libraries, including ng XML Digital Signatures and XML Encryption. XML Digital Signatures and XML Encryption.

•• AgileDelta also provides Efficient XML Digital Signature and AgileDelta also provides Efficient XML Digital Signature and Efficient XML Encryption products that leverage EFX to eliminateEfficient XML Encryption products that leverage EFX to eliminatesignificant XML Security processing bottlenecks and increase thesignificant XML Security processing bottlenecks and increase thebandwidth efficiency of XML Security protocols.bandwidth efficiency of XML Security protocols.

> Download

Efficient XML SDK: Efficient XML SDK: http://www.agiledelta.com/efx_download.htmlhttp://www.agiledelta.com/efx_download.htmlIncludes all the following:Includes all the following:•• Developer API docs and toolsDeveloper API docs and tools•• Runtime for Java EE/SERuntime for Java EE/SE•• Runtime for Java MERuntime for Java ME•• Runtime for Microsoft .NETRuntime for Microsoft .NET•• Runtime for Microsoft .NET Compact FrameworkRuntime for Microsoft .NET Compact Framework•• Integration Kit for Apache Axis1Integration Kit for Apache Axis1•• Integration Kit for Apache Axis2Integration Kit for Apache Axis2•• Integration Kit for Microsoft WCFIntegration Kit for Microsoft WCF•• Integration Kit for BEA Integration Kit for BEA WebLogicWebLogic•• HTTP Server and Client ProxiesHTTP Server and Client Proxies•• EFX commandEFX command--lineline•• EFXPerfEFXPerf micromicro--benchmarkbenchmark

http://www.agiledelta.com/efx_download.html

Efficient XML IntegrationsEfficient XML IntegrationsExamples of where its been usedExamples of where its been used

http://www.testmy.net/articles/wp-content/uploads/2006/04/internet-explorer-large-logo.jpg

http://ws.apache.org/

http://www.jboss.com/index

http://images.google.com/imgres?imgurl=http://www.langamers.ch/img/news/2005.11.30/firefox_logo.jpg&imgrefurl=http://www.langamers.ch/langamers/news-firefox_15-6828.php&h=970&w=1024&sz=296&tbnid=vIr4Vm5_Z2ROxM:&tbnh=142&tbnw=150&prev=/images%3Fq%3Dfirefox%2Blogo&start=1&sa=X&oi=images&ct=image&cd=1

What do we Mean by Efficiency?What do we Mean by Efficiency?

•• Dictionary definition:Dictionary definition:•• Acting or producing effectively with a minimum of waste, expenseActing or producing effectively with a minimum of waste, expense, or , or

unnecessary effort. unnecessary effort. •• Exhibiting a high ratio of output [results] to input [resources]Exhibiting a high ratio of output [results] to input [resources]

•• Mathematical definition: Mathematical definition:

•• ResultsResults include web pages, web service calls, messages, etc.include web pages, web service calls, messages, etc.•• ResourcesResources include bandwidth, processor cycles, memory (code, include bandwidth, processor cycles, memory (code,

data and heap limits), battery life, disk space, etc.data and heap limits), battery life, disk space, etc.•• So, for example, system A is So, for example, system A is more efficientmore efficient than system B ifthan system B if

•• A produces the same result as B using fewer resourcesA produces the same result as B using fewer resources•• A produces more results than B using the same resourcesA produces more results than B using the same resources•• A produces more results than B using fewer resourcesA produces more results than B using fewer resources

Efficiency = Efficiency = Results

Resources

Why Worry About Efficiency?Why Worry About Efficiency?

•• Resources cost moneyResources cost money•• Bandwidth, processor power, memory (code, data and heap), Bandwidth, processor power, memory (code, data and heap),

battery life, disk space, etc.battery life, disk space, etc.•• Less resources == better cost / performance ratio Less resources == better cost / performance ratio

== lower prices and/or more profit== lower prices and/or more profit

•• Many systems donMany systems don’’t have resources to sparet have resources to spare•• Cost sensitive, mass market devices: mobile handsets, setCost sensitive, mass market devices: mobile handsets, set--top top

boxes, consumer electronics, game consoles, automobiles, etc.boxes, consumer electronics, game consoles, automobiles, etc.•• Physical constraints: battery life, size, weight, heat, etc.Physical constraints: battery life, size, weight, heat, etc.•• Less resources == cheaper, smaller, lighter, cooler, etc.Less resources == cheaper, smaller, lighter, cooler, etc.

•• Faster & more scalable without more hardwareFaster & more scalable without more hardware

Reduced Bandwidth

Red

uced

Pro

cess

ing

Pow

erThe Value of EfficiencyThe Value of Efficiency

10 gbps 1 gbps 100 mbps 10 mbps 1 mbps 1kbps10 kbps100 kbps

10 ghz

100 mhz

10 mhz

1 ghz

1 mhz

100 ghz

1 thzCorp data center

Corp HQ

Broadband home Dial-up home

Smartdust

Sensor-nets

Smartcard

Mobilehandset

Smartphone

UAV

DVR

Militaryvessel

Networkaudio device

Game console

MilitaryC2 aircraft

PDA

Submarine

Solder

Surveillance Satellite

Tactical aircraft

Militaryvehicle

Commercialvehicle

Value of efficiency increases as available bandwidth and processing power decrease

Reduced Bandwidth

Red

uced

Pro

cess

ing

Pow



10 ghz

100 mhz

10 mhz

1 ghz

1 mhz

100 ghz


Corp HQ


Smartdust

Sensor-nets

Smartcard

Mobilehandset

Smartphone

UAV

DVR

Militaryvessel

Networkaudio device

Game console

MilitaryC2 aircraft

PDA

Submarine

Solder


Tactical aircraft

Militaryvehicle

Commercialvehicle

New applications,new markets,

new customersbetter awarenessbetter decisions

Better cost / performance for

existing customers and applications

Benefits of efficiency are widely applicable, but unevenly distributed

Reduced Bandwidth

Red

uced

Pro

cess

ing

Pow



10 ghz

100 mhz

10 mhz

1 ghz

1 mhz

100 ghz


Corp HQ


Smartdust

Sensor-nets

Smartcard

Mobilehandset

Smartphone

UAV

DVR

Militaryvessel

Networkaudio device

Game console

MilitaryC2 aircraft

PDA

Submarine

Solder


Tactical aircraft

Militaryvehicle

Commercialvehicle

Battery, size, cost, heat and

bandwidthconstrained

Moore’s lawAmdahl’s law

XML hardware

Battery, bandwidth, size, cost and other constraints will widen the value gap


DesignDesign

Efficient XML Design PrinciplesEfficient XML Design Principles

•• GeneralityGenerality•• OneOne format for format for allall applicationsapplications

•• PerformancePerformance•• Replace handReplace hand--optimized binary formats with XMLoptimized binary formats with XML

•• SimplicitySimplicity•• Small footprint for mobile and embedded applicationsSmall footprint for mobile and embedded applications

•• EfficiencyEfficiency•• Bandwidth, battery, CPU, memory, storageBandwidth, battery, CPU, memory, storage

•• RobustRobust•• Always works, regardless of data & schema issuesAlways works, regardless of data & schema issues

Efficient XML RootsEfficient XML Roots

InformationTheory

Formal Language

Theory

Efficient XML a new breed of technology that unifies concepts from formal language theory and information theory

Efficient XML ApproachEfficient XML Approach

•• Generalized AlgorithmGeneralized Algorithm•• Use a grammar to determine the language constructs (not Use a grammar to determine the language constructs (not

characters) most likely to occur at any given point in the streacharacters) most likely to occur at any given point in the streamm•• Assign variableAssign variable--length codes to represent most likely language length codes to represent most likely language

constructs in fewer bitsconstructs in fewer bits•• Concept works for any regular language that can be described Concept works for any regular language that can be described

by a grammar (e.g., XML, HTTP, CORBA IDL, Java, by a grammar (e.g., XML, HTTP, CORBA IDL, Java, ……))•• Efficient XML is specialized for XMLEfficient XML is specialized for XML

•• BuiltBuilt--in knowledge of XML grammarin knowledge of XML grammar•• BuiltBuilt--in knowledge of XML data typesin knowledge of XML data types•• Can augment grammar and type knowledge using schemasCan augment grammar and type knowledge using schemas•• Refines grammar knowledge based on experienceRefines grammar knowledge based on experience•• Does not require accurate, complete or current schemas Does not require accurate, complete or current schemas

(schemas describe things that are (schemas describe things that are likelylikely to occur)to occur)

john schneider - dodccrp.orgenel engage technologies enigma enn corporation entrust technologies,...

Documents