a differentiated services implementation for high- performance tcp flows volker sander, ian foster,...

39
A Differentiated Services Implementation for High-Performance TCP Flows Volker Sander, Ian Foster, Alain Roy and Linda Winkler Forschungszentrum Jülich GmbH Argonne National Laboratory The University of Chicago

Upload: corey-chase

Post on 28-Dec-2015

221 views

Category:

Documents


2 download

TRANSCRIPT

  • A Differentiated Services Implementation for High-Performance TCP FlowsVolker Sander, Ian Foster,Alain Roy and Linda WinklerForschungszentrum Jlich GmbHArgonne National LaboratoryThe University of Chicago

    the GARAproject

    OutlineThe GARA quality of service architectureGARA and network quality of serviceExperimental resultsSummary and future directions

    the GARAproject

    GARAGeneral-purpose Architecture for Reservation and AllocationDeveloped as part of the Globus Projectwww.globus.orgGlobus Toolkit provides enabling security and directory servicesOtherwise independent of GlobusGoal: Provide end-to-end Quality of Service (QoS) to high-end applications

    the GARAproject

    Example High-end ApplicationsTeleimmersion: Virtual reality collaborationDistributed Scientific ComputingAnalysis of large data setsReal-time simulation steeringRemote control of scientific instrumentsReal-time visualizationCollaboration: Multiple people visualizing & steeringWe have to address UDP and TCP flows

    the GARAproject

    How does GARA Help?Resource discoveryNetworkComputersDisksAdvance reservationsSecurity: control over who gets reservationsMonitoring of reservationsCoordination of multiple reservations

    }Not just Network QoS!

    the GARAproject

    Resource ManagerThe Resource Manager is the core of GARAAdmission controlConfigures resourceMonitors resourceAssumes exclusive access to the resourceOtherwise no guarantees can be made

    GARAs network resource manager is a Bandwidth Broker

    the GARAproject

    Network Resource ManagerAdmission controlHas knowledge of topology within a domainTracks reservations on path through domainConfigures routersDifferentiated services (more detail soon)Currently telnet with command-line interfaceCOPS/SNMP in the futureMonitors resourceQuery edge router for flow statisticsConforming and exceeding (dropped) packets

    the GARAproject

    Network QoS ImplementationWe use differentiated servicesExpedited forwarding to implement premium serviceWe use Cisco 7507 routers (thanks Cisco!)Edge routers controlled with resource manager, as described abovePackets that exceed the reservation are dropped

  • Experiments

    the GARAproject

    The GARNET Testbed

    the GARAproject

    Evaluation ToolsUDP Traffic GeneratorModified Version of Andy Adamsons gen_send and gen_recvEvaluate admission controlCreating competing trafficMGEN/DrecEvaluate Delay and Jitter for Premium UDP FlowIPERFModified Version of ttcp GARA-enabled (wait for reservation)Support for a desired application rateConsecutive bandwidth reportingBulk transfer ttcp

    the GARAproject

    Basic Experiment IUDP SenderGARA Diffserv Resource ManagerUDPReceiver

    the GARAproject

    Basic Experiment IGoal: Proof of Admission Control

    Chart-100K

    303112563732942438369408383233443881162438751760

    298435923706086437444208381160323822424038706960

    301627923724028837658288380347203849467238345984

    300031923739835238113208383048643838950438303136

    299968083704377637615472381674883836696838560896

    300031923703096037551248380990403835945638354576

    298882803713776037856312379961283836696838388944

    300829923718048037615472380903043806330438165552

    300000003744961637834904382276803861486438629520

    299968083717193637850960381054723836696838560784

    300063843682590437893776381054723836696838569488

    299712723717193637599416379768323831438438208512

    299585043706513637540544378224643791306437950864

    300031923711640037792088385019523851720838414832

    300798003724456037754624381054723836696838414832

    300000003739408037668992379639683836696838423424

    300063843701814437556600382212483836696838543600

    299202003706086437396040379382403825428838294544

    300829923721892838241656381119043847646438457792

    300000003744961637572656381569283835945638311728

    299202003687716837599416377903043836696838277248

    300861843726164837963352380797443837129638260064

    299202003689852837235480380581443835945638346096

    300829923718902438081096382704003836696838500640

    300000003713776037743920381031683836696838208624

    300000003713776037861664379896963827682438251472

    299712723706086437551248379382403828115238242880

    299202003702668837674344381096003808902438389056

    300829923739835237470968383756163864491238526416

    300031923721892838081096380066883836696838483456

    Desired Rate

    30M

    40M

    50M

    60M

    70M

    80M

    Time (s)

    Actual Rate (bps)

    Rate vs Time(UDP, Limit=40Mbps, Burst=100KB)

    bw-100K

    123456789101112131415161718192021222324252627282930

    30303112984330162300032999630003298882803008299230000000299968083000638429971272299585043000319230079800300000003000638429920200300829923000000029920200300861842992020030082992300000003000000029971272299202003008299230003192

    31313249123092089631085696310000003092089631082400310000003100000031000000308319043117139231000000310000003100329630914304310856963092089631088992310000003091430431085696310032963099670431003296309176003108569631000000310000003089340830917600

    32323111683200681632003408319965923200000032003408319795523208860832003408319965923191480032003408320852003200340832000000320000003184664032000000320920163200000032000000319182083208520032000000319148003208860831914800320886083200000032000000

    33333251683300702432926248329157123300000033087800330000003300351232908688330913123300000033003512330000003291220033087800330035123300000033000000329122003309482433000000330035123300000032912200324719523309482433000000330000003291220033094824

    34343238323400362434000000340036243390215234094224340072483400000034003624339383923400362434000000340000003390940034094224339746323409422434000000340000003396738433905776340942243400000034000000340036243390215234003624340978483400000034000000

    35353300003489934435003728350969283500000035003728349664483486206435007456351006563500000035000000349068003509692834903072350969283500000034906800350969283500000035000000349105283500000035074560350037283500000035000000349030723500372835096928

    36363217763600384036007680359001603600384036099840360038403600768035969280359040003609600036003840358886403609600035907840360960003600384036000000359961603580800036199680359961603600384036000000359040003609984036000000360000003600384035900160

    37373249283690928836932952370039443700000036854072368225203698816837102544370000003691323236854072371064883685407236676592369802803675547236905344369014003698028037000000367278643719720036988168369605603674364036581936368028003680674436846184

    38374206723686432036791312371076803714012837071176369657203681564837006280367385843708740037245584369211043686432037091456368156483690893636795368371036243721719236981944367264163681564836693968367548083698194436937328368115923699411236908936

    39375024803714880036978240371363203687424036882560372486403705312036803520367036803696576036936640371196803724448037169600367369603734848037028160371155203706976037152960372569603704896036999040367910403710304037211200372028803706976037073920

    40373294243706086437240288373983523704377637030960371377603718048037449616371719363682590437171936370651363711640037244560373940803701814437060864372189283744961636877168372616483689852837189024371377603713776037060864370266883739835237218928

    41375933603731978437328536373066563704409637407304372672723726727237507952368384243744231237315408371797523680341636917192376261043727602437065976368734323720163237184128374291843715787237017840371097363735041637322904369434483738104837254144

    42374596323714398437574832374177523706320037386336372247683742672837537632372337443726516037305552373638963723823237278624375882963699139237574832372997683722476837034976372068163761073637130520374312163728760037067688376511283730106437233744

    43378905123713142437328880373288803751256037480416371911203733347237034992375814403744368037397760372140803723704037429904374253123771920037103872372462243767328037085504374574563734724837122240373013283745286437480416371084643731510437576848

    44376212483783776037419104374708483706160037541408374520323735324837597856374002883733443237579040372403523743792037579040372920963764489637466144371509763731091237409696376307843745203237254464375367043728739237541408376637123735324837174496

    45378090003756971237475480376245283755721637249504372975843759568037706264374081683768510437321624370475683776876837403360375860643748990437079296373120083771876037502400374225923736970437744728374995203738893637648568372110403750913637768768

    46378969203766552037621240372768403743628037557280378397203740676037552360374047603772948037401840374490403799024036898000378889203743920037517920374215203738708037778680376606003756220037453960373211203773440037709800374342803727192037426440

    47377423363727353638036704371630083759004837600096374845443777091237780960373338243786134437263488379517763747449637605120372986563751971237941728376754563761014437434304373388483804220837419232377905283731875237248416378362243768048037434304

    48377628963808238437353072374311683782044837825584374712003759038437800960378625923763041637383888376355523730171238056704375585123772800037440384374403843798480037332528380207523754824037112736379796643776908837354128375276963764688038066976

    49379080643782832037942840375872803756108037461520380903203749744037859760376711203771304037681600376816003747200037728760375768003803792037702560375715603761872037498200380484003782832037692080376396803728860037943600378178403752440037849280

    50383694083744420837658288381132083761547237551248378563123761547237834904378509603789377637599416375405443779208837754624376689923755660037396040382416563757265637599416379633523723548038081096377439203786166437551248376743443747096838081096

    51383280163765462437480032376027523793288037938336378892323784012837610976374800323809110437905600377746563764371237480032380583683795470437774656376437123764916838036544376928163758915237924656373517763817294437791024376982723762188837430928

    52383051363751206438213632378294403775148837601152380465923743968037890688381189763752876837717632380577283790739237617856379352323776774438085568375232003801318437478656374174083826374437706944379519363752876837584448382915843761785637662400

    53383505123758267237855760379124803809398437623208379862163766291237566488382187683786710437867104374700643752595238122344379181523790680837470064381620483785008838019416378784483778769637277216382244403808264037498424375713283760052038167720

    54383708163817497637706472379667523769490437914696378395043797196038059296378048003782793637972536380066643775274438059296374693283804194438007240381691923761392837827936381807603789734437764312377758803764284838013024381576243794940037758528

    55381958723800723238266304380307843777760037789376377187203806611237924800378423683824864037577408379954563777760038360512375067523805433637771712381956483794246437930688381424643745964838095552380543363797190437795264378070403815443237948352

    56385415683771800038240000376820003825800037974000376700003817400037742000382220003805400037974000378620003780800038216000381260003796800037970000376400003802400038186000379640003797000037898000374400003831200038058000378980003789200037832000

    57383453923785785638321760380043523801045638004352375770723843773638010456380043523793025637955520381386403795552038058440380043523782123238144744380592883800435238003504380043523801571238004352379188963809591237632008382668243801045638004352

    58386339043803570437967328380217763814137638015560378912403800462438251768380404243803420837785568381585283798448038257984379782643811501637878808377917843840716837953400381212323803420837773136380404243829528038027992380404243800934438066784

    59386970723797336037954400379480803832728038200880380808003801128037926320381692803804920038156640380744803765736038229680377648003840664037973360381945603806816037983200381980803782168038308320380681603786592038264080380681603797968038112400

    60383233443811603238034720383048643816748838099040379961283809030438227680381054723810547237976832378224643850195238105472379639683822124837938240381119043815692837790304380797443805814438270400381031683798969637938240381096003837561638006688

    61386449683779115238457824379022643810439238399000381436083798020837967624383592963805864038182824381174643807824838143608379736723848348038144096379802083806517638124000382225283811092838058640377972003858152038032984382220403803952037497032

    62384191363831317638153624382666403815362438153624380472563832647238053904381602723808714438153624383331203816692038153624378877043812703238359712381868643815362438160272379874243800736838471976381536243804650438140328382865843816027238107088

    63386173443810537637865216380542723815555238706304379568323819606438189312383552003802435238020512383687043826742438243328381893123818931237885472377031683847673638132384381661443840246437875808383176003822982438368704382066563795008038260672

    64385430403817076838218816382188163821881638218816382188163797171238218816382188163821881638218816382188163821881638218816382119523821881638218816382188163821881638218816382188163821881638211952382188163821881638218816382188163821881638218816

    65385659283803384038242880382986243822894438242880381453283744156037971128379850643824984838242880382428803824288038242880382498483824288038242880382428803824038438242880382010723824984838284688382428803824288038242880379268243855644038249848

    66385651843831720038388000381048003825348038465640381189603828180038083560384517203835968038345520382747203786408038104800384517203855084038246400382676403786408038678280380198403851544038260560380906403836676038303040381331203843048037941960

    67386457123817779238414864382999203844360038156240381706083843641638335840383861283812750438019744387094083822808038120320382855523806284838664288382691683831227238103936381131363863756838299920382927363801974438206528382065283855652838292736

    68387359203823961637976960384949763817996838479104383198723805721638283392385228803840742438318592380645123823833638508288381885443843532838165376383271683854476838318592381082883828940838325888385022723799155238333184384220163803404838325888

    69382629523857860038346800382604003839360037957000387118003833440038341800383418003786820038563800382876003838380038341800383344003833440038334400383418003815440038356600384972003834180038339400383418003801620038667400383418003834180038341800

    70388116243822424038494672383895043836696838359456383669683806330438614864383669683836696838314384379130643851720838366968383669683836696838254288384764643835945638366968383712963835945638366968383669683827682438281152380890243864491238366968

    71387026883838828838281664384608003837305638426368383273603838067238258816380495363859027238388288383882883809888038140928384608003838828838388288383882883826643238445568383882883833497638384640383806723839590438384640383882883838828838384640

    72386398403833088038446800384004323849316838392704382209123842361638421840384081603813590438298192384295683817454438190000384699843808358438599584383986563841411238106768384236163866318438406384384141123840816038261328385532163841588838408160

    73386433123844521638165336382885763850787238429552382572483842955237959632386723443842955238429552382749843809484838619592384295523843162438423792381710963839039238165336385470323841388838343400385157043842955238319904384295523843162438431624

    74387934643861742438299664384426563867303237942184380931203867303238331440385141523817256038418824382599443865714438363216383076083869686438236112384108803816461638236112386730323860948038299664379580723810106438355272382996643814872838347328

    75384649603816430438059680385023203816430438091872380677283805163238276976381643043822868837995296380999203830112038276976385177283832457638212592384935843844598438325264382125923835745638470128382206403843793638075776381160163836550438469440

    76385633603820512038366080383089603849664038335680383008003834384038300800382681603854560038496640385968003803152038303040387006403849072038188800382051203802560038237760386761603825408038278560379254403880672038374240384476803848848038039680

    77385250163867156838605456382005203852281638192256378534323872115238353224385228163836148838200520387046243839059238167464384814963834927238667256385062883851024038076560379773923887816838506288384236483842760038183992384071203850628838468920

    78387274563820562438222376381386163847365638415024384736563833695238331264386663043845690438490408384317763838152038482032385322883852960038423400383898963819724838532288384150243834801638264256385239123853228838523912380548563854904038364768

    79384279203877936038380800384825603855040038245120389150403839776038694560382960003833840038584320386436803830448038033120383977603852496038558880386012803821120038024640389150403823664038575840384486403812640038541920385928003852496038499520

    80387517603870696038345984383031363856089638354576383889443816555238629520385607843856948838208512379508643841483238414832384234243854360038294544384577923831172838277248382600643834609638500640382086243825147238242880383890563852641638483456

    Chart-1M

    302414804029179244901472455339204540160045217328

    299968083989320037947296377944323836378439222368

    300893763825702437529840381031683835945638500752

    300031923730864037872368379575363837129638612448

    300000003740563237599416379318083834443238294432

    299202003682590437893776383305923836696838423424

    300829923724883237797440380926083836696838809952

    300000003706086437850960383241603835945638440496

    299202003754360037695752380710083836696838715552

    300829923716339237535192384077763835194438620928

    299170083721038437872368379704003835945638414832

    300829923742398437733216377324163835945638483456

    300000003711640037711808380604483836696838500752

    300031923731718437636880386779203836696838577968

    300000003710785637561952381054723835194438397648

    299170083705659237963352378996483835945638732624

    298643523734708837840256380861763835945638595152

    300893763691988837765328381633603835945638775584

    300000003759486437679696381440643835945638569376

    300000003701814437358576380540163833692038543600

    299170083741116838068776382019523839383238285840

    300861843735136037749272379318083836696838629632

    300000003656104037747656380025603835945638483456

    300000003742398437465616383820483836696838655408

    300031923730436837481672379768323805897638715552

    299170083721038438032928378417603867496038569488

    300829923722320037899128383048643836696838363168

    300000003714203237749272379060803835945638835840

    300000003737272037679696383627523836696838345984

    300031923709504037802792382276803836696838775584

    Desired Rate

    30M

    40M

    50M

    60M

    70M

    80M

    Time (s)

    Actual Rate (bps)

    Rate vs Time(UDP, Limit=40Mbps, Burst=1MB)

    bw-1M

    123456789101112131415161718192021222324252627282930

    30302414802999680830089376300031923000000029920200300829923000000029920200300829922991700830082992300000003000319230000000299170082986435230089376300000003000000029917008300861843000000030000000300031922991700830082992300000003000000030003192

    31313187843092419231000000310824003100329631003296309967043092089630996704310856963100000031003296309176003108240030917600310000003092636830917600310659203108899231003296309176003099670431006592310856963099670431000000308319043100329631171392

    32323054723208860832000000320034083182619232119280320886083200340831771664321942563199659232088608320034083199659231925024319148003208860832000000319148003208860831914800320852003200000032006816320068163182619232177216320000003200340831918208

    33333176483291922433003512330913123299648833003512330000003291220033091312329157123309131233000000329122003306899233000000329192243308780032912200330913123300351232996488330035123291220033087800330035123300000033000000329122003309131232912200

    34343212163400362434003624340000003381155234192072339963763400362434000000339094003408335233916648340906003400362433905776340942243400000034000000339130243400000034090600340036243400000034000000338151763412684034090600339963763400724833905776

    35353255203491052835096928350000003500372834903072350037283509320035003728350000003500372834906800350820163490307235096928350000003490680035096928350000003490680035093200349068003509320035003728350037283500000034914256350969283500372834996272

    36363206083599616035996160359040003610368035996160360038403600000035904000360998403600000036000000360000003590784036096000359040003609600036000000359040003609984036003840359961603590784036023040359462403605376036003840360000003596160035904000

    37372188083710648837003944368974563710254436948728369408403710254437000000370039443689745637003944371025443700000035808912369960563690140037007888370749363700394436996056368974563711043237000000368974563710254436897456371025443700394437000000

    38383228563800405637935104378945443810545638004056378945443721313636880544376146803680348037200968367507523676292037188800373388723722124836543896373348163729831237286144368805443676697637545728369616643699816836912992372212483697788836961664

    39392631523911232039000000383427203706560037036480372444803726112036978240368908803714880037331840370323203707392037024000374108803726528037182080370572803710720036920000376521603704064037040640370656003701984037148800374233603722784036953280

    40402917923989320038257024373086403740563236825904372488323706086437543600371633923721038437423984371164003731718437107856370565923734708836919888375948643701814437411168373513603656104037423984373043683721038437223200371420323737272037095040

    41413252164026045637424808369346963722351237783640370791043726727237153496370659763765236037100984373635443705722437381048372847763734166437284776369959603724539237468568374423123748607236902808372016323749920037188504372585203730228037258520

    42423201683911421637794744372100083712603237435704373504323728311237139496378530883712154437350432374132643734145637045248377588403701832037444680373414563752546437045248372786243748956037467120373638963717988837130520371035923784860037345944

    43433276323861923237388576373610243716356837811040373885763720489637090096371497923793502437287552373702083748500837282960375079683728296037406432374896003726000037429904376732803718652837094688375676643762276837397760372875523739776037039584

    44443278083737206437486176377543043755081637354464368828483791772837437920372497603777190437127456377624963763670436967520375602243730150437795424375144003745324837489664371274563741910437480256375602243757433637373280374567363748025637246272

    45445351843736489637581256375764483751394437610104375860643733124037263928376870323752836837662992371341123757164037600488376149123748990437489904372927763753317637627408375091363744182437211040377735763743989637802424372783523743028037387008

    46444139203743920037977480374392003764584037399840374244403792628037367400376360003726700037842640376950403754744037355560377885203731128037468720378446403755728037562200373358803767536037542520373506403746088037655680376852003756712037616320

    47449837443717808037871392376101443746947237911584375046403735894437615168378261763737904037811104375347843716803237906560375850243793670437303680377759363760009637514688373991363780608037645312377357443750966437559904375599043745440037881440

    48445574083805262437455792374260323788208037615008379026243766228837640688374147043739416038134800377485443765096037502016372144003813888037544160377588163765096037512288377033763739929638082384374917443756878437738272376355523752769637820448

    49448391123782308037561080375977603787024037702560373776803777592038058880377392403741436037613480376449203784404037807360377078003749820037608240379750403757080037896440377497203743008037807360375768003804240037388160378754803759776037744480

    50449014723794729637529840378723683759941637893776377974403785096037695752375351923787236837733216377118083763688037561952379633523784025637765328376796963735857638068776377492723774765637465616374816723803292837899128377492723767969637802792

    51448404803778556838031088377964803775283237780112374990883778825638080192377637443779648037687360373381763814835237703728378619523789468837638256379601603759729637796480379219683743092837900144379983523782376037458208375836963827660837801936

    52452791203781830437517632375900163802988837996480377904643783500837812736378405763783456037879552379129603762899237684672382247683756217637729216379909123765126437951936380465923775705637166848382359043786284838041024378294403767910437389568

    53451070403762320838196080379805443736229637952184377479923840594437708288377876963805428037492752379294963805995237765008378444163792382438014576378614323767992838037264377082883800323237861432377706803749842437719632384456483776500837951352

    54453222003778744837937832377296083794361638094000377180403808243237700688381055683790312837862640378799923764284838169192377758803790891238076648374230563838320037868424376659843817497637700688381055683801880837804800379667523753295238099784

    55448731843786003238283968380248963785414437736384376892803817798437854144382309763773638437848256380720003800723237942464378541443787769638213312375185283834284837536192379954563803667238242752378776963784825637865920378718083794246437971904

    56454090243797600037532000381860003820400037976000379760003771800037790000382700003812000037974000379140003795200038000000378200003818600037976000379740003795600037994000378200003813000037814000381200003798800037976000377600003810800037952000

    57450290963806539238065392380043523800435237650320381630563819968037998248380104563780292038211888380043523801045638004352378639603799214438168312380043523801045637894480378517523827292838010456380043523800435238010456380043523801045638004352

    58454047843767989637923816385128403797826438110296379906963789745638239336380093443802948837636384382905603822840038091648380466403775448837916104379347523845689637829080382470483811651237961112380543523789124038090152381088003794718438234616

    59450198083850424038068160380744803798320037998640381538403805904038137680380744803794176038200880380744803806816037922800382008803809344038074480379417603793544038042880383652003807168038036560381124003797688038156640380780003807448038049200

    60455339203779443238103168379575363793180838330592380926083832416038071008384077763797040037732416380604483867792038105472378996483808617638163360381440643805401638201952379318083800256038382048379768323784176038304864379060803836275238227680

    61453230803824164838117464382089683796108838352760379213843832661637921384376865763876501638137560381375603799376838111416382939363798674438280864381305363786304838104392384316803805912837307000383789043847694438110928381436083807824837712232

    62454893603777468838565800381595203808049638099688379342403853920838160272381669203816027237628432386987603816027238166920381602723781457638512616380804963824004838166920381329283819351238286584381536243816692038033960382334003821345638160272

    63453611363835520038186400379500803841596838189312381893123813238438250080381893123818931238112128382674243798384038179648384159683817964838193152381864003795683238412128380040963818931238189312377205123865904038189312381864003819606438088032

    64452542403822568038205088382188163821195238211952381364483828745638218816381982243821195238211952382188163821881638218816382188163811585638314912383492323821881638205088382188163815017638266864382188163799916838417872382119523821195238211952

    65454608563824288038242880382219763826378438242880382428803824984838054744384310163824288038240384382428803788054438612184383961763824038438242880380965523831256038242880383264963824288038242880382428803824288038242880382428803824288038242880

    66451770563853668038218080385720803814728038133120383172003840216038012760385579203798444038550840380481603818976038274720382110003832428038437560380764803826764038211000385154403816144038529600383172003786408038529600381614403810480038147280

    67456703203807721638192160386303843806284838493888380484803834302438558544379981923830508838264000383286563839129638455952382927363829273637847328384292323829992038393312382927363813468838077216386734883829273638292736381059523819216038529808

    68455587043835635238312576381958403827609638392832384512003831987238318592383198723800614438626304382979843828339238378240382760963836364838312576383198723832716838188544384439043831987238319872383198723795507238684672383198723831987238318592

    69455143123834180038341800383418003834180038319600383640003834180038346800383344003831720038349200382086003849720038341800383418003834180037994000386896003834180038339400383418003809760038586000383394003834180038341800383418003834180038295000

    70454016003836378438359456383712963834443238366968383669683835945638366968383519443835945638359456383669683836696838351944383594563835945638359456383594563833692038393832383669683835945638366968380589763867496038366968383594563836696838366968

    71453449923852537638555840381369603863200038380672379657603879193638411136383882883838067237969408388111363836179238395904383121283843398438384640384339843838828838384640383882883838828838388288382551683851776038270400385025283838828838384640

    72455587043849316838408160381049923870955238315424384931683840816037990848387636483842956838431344382304163821496038769600383986563840638438068128387404643839092838414112383909283841411238122224386150403846998438415888383522883833683238483664

    73453185283824365638844648384295523824941638233752388133203842955238406056381554323872716838186760386822483843945638327736383298083839246438656680384316243842172038100608381966643898562438304240385000403822799238533440385470323847078438202424

    74454941923844265638093120386174243869686438442656384506003845060038093120387604163814078438776304384506003844265638448960384489603845060038442656383552723853798438434712384506003845060038458544384426563845060038418824384664883801998438862048

    75457333283843793638397696381562563876790438220640386793763878400038067728385747523827697638840336384137923826088038140160385828003880814438317216385264643843793638172352389208163831721638784000383413603826892838598896387196163847012838470128

    76457395523828448038162080390025603840096038498880383742403802336039084160385292803847216038327520382028803879040038570080385396803825184038556000386435203848256038227360383764803807456039233280385374403845808038260000385048003870880038260000

    77450052803861767238498024384980243851850438473232385228163851024038514552385062883849802438510240384980243851024038498024385145523849802438501976384980243850628838498024385019763849371238514552385062883850628838514552385019763851455238506288

    78453408563828100838934336385239123851553638515536383647683868305638289384387390003852960038523912385239123852391238482032385574163815536838917584386830563853228838521224385322883844852838607672385239123853228838523912385322883852960038523912

    79452092803852496038558880385249603849952038703040385419203855040038541920385504003854192038541920385504003854192038541920385504003854192038550400385419203854192038550400385419203855040038541920385419203855008038541920385504003854192038541920

    80452173283922236838500752386124483829443238423424388099523844049638715552386209283841483238483456385007523857796838397648387326243859515238775584385693763854360038285840386296323848345638655408387155523856948838363168388358403834598438775584

    Chart-2M

    302396564032713650326888528691685312107253117440

    300414964000427239847256381096003875759238560896

    300031924000000037845608381031683836696838560784

    300000004000000037690400380668803836696838569488

    300000003989320037417448381417603826180038560896

    300000003730436838107856381826563814593638560896

    299840403742699237631528381054723869749638569488

    300000003725737638000816380926083836696838535008

    300000003713348837733216379488003836696838586560

    300000003706513638000816381826563836696838569488

    300031923725310437283648381633603834443238560784

    299968083721038437321112380990403838199238560896

    299202003717620838364752380926083830687238432016

    300829923735136037529840381054723838950438698256

    300031923709076837838640379832643841636838560896

    300000003740689637636880382148163830687238569488

    300000003723174437449560380926083833373638560784

    300031923708222438048984380990403844208838560896

    300000003692416037711808380990403836696838569488

    300000003739835237958000380990403836696838560896

    300000003765467237540544381054723820170438560896

    300031923698396837594064380990403862237638569376

    300000003722320038022224380861763835945638560896

    300000003711212837824200380926083836696838560784

    300000003678745637711808381376323835945638569376

    300000003773030437690400380990403796132038560896

    300031923721766437610120381054723870933638560784

    299680803709504038043632381054723841204038432016

    300893763732572837738568379575363835945638698368

    300000003680881637604768382534083835945638560896

    Desired Rate

    30M

    40M

    50M

    60M

    70M

    80M

    Time (s)

    Actual Rate (bps)

    Rate vs Time(UDP, Limit=40Mbps, Burst=2MB)

    bw-2M

    123456789101112131415161718192021222324252627282930

    30302396563004149630003192300000003000000030000000299840403000000030000000300000003000319229996808299202003008299230003192300000003000000030003192300000003000000030000000300031923000000030000000300000003000000030003192299680803008937630000000

    31312610723108569631003296310000003091430431056032309769283108240031000000309176003108899231003296309143043108569630914304310856963100329631000000310000003083520031168096310000003100000031003296308319043116809631000000310032963100000030917600

    32323214883192161632085200320000003200000032003408318261923217380832006816320000003200340831914800320000003205112032085200320034083191139232088608320034083191139232088608319113923209201631996592320034083200000031914800320852003200000032003408

    33333211443291571233091312329157123308780033000000330035123290868833003512330913123300000033000000329964883291571232557488330913123300351233000000329086883309131233000000329122003308780032922736330000003308780033003512329086883309131232908688

    34342531283381880034192072340036243400000034003624339094003409060033909400340942243400362433905776340906003400362433905776340000003400000034097848340000003400000034003624338151763418844833996376340036243400000033902152340072483400000034094224

    35353261603500372835003728348098723509320035096928350000003500372834906800350932003490680035059648351043843490680035100656350000003500372834903072350037283509692835000000350000003500000034813600351901283500000034996272350037283491052835100656

    36361291203620352036000000360000003600000035904000360998403590400036099840360000003590016036099840360000003590784036096000359040003609600036003840360000003590400036000000360998403600384035996160359961603580800036180480360998403600000036000000

    37373248963700394436897456371025443690140037102544370078883690140037102544370000003692112036897456370039443711043237000000370000003700000036798856372090323700000037003944369960563690534437003944371025443700000037000000369014003710254437000000

    38383208243798783238004056380000003789860038105456380000003800000038000000378945443800405638105456380000003800405637894544373672643692516037026560373226483696166437172576369089363737132036766976370022243728614436937328370022243721719236912992

    39393288483889600039108160390041603900000039000000389542403821792037319360371571203685344036944960374524803735264037132160370822403706976037627200365830403735264036986560370822403723616037281920369033603699488037360960371529603735264036878400

    40403271364000427240000000400000003989320037304368374269923725737637133488370651363725310437210384371762083735136037090768374068963723174437082224369241603739835237654672369839683722320037112128367874563773030437217664370950403732572836808816

    41412108804100437641113776403173443753858436820920371316163749044837376672371491203738980037171000373985523717975237311032370090883725852037280400371797523759984837271648371009843738542437468568372804003678153637363544374773203717100037267272

    42423292404200448842004488374042883750302437305552374312163735043237193352375703443722028037130520376017603699139237516488375299523706320037139496376242003731452837341456375299523709910437188864374267283733248037435704371709123741326437161936

    43432034884309643240800432372048963696611237884512369156003782940837374800372921443741153637370208376962403731510436828352378248163738398437608992374941923712224037250816372691843782022437296736372829603749419237145200378523683717275237296736

    44443258404400940838364608372074243806476837456736370568963746144037428512375614403755552037343840374626563733443237861280372356483763548837061600373955843771545637437920374520323725916837414400377966403720272037691936372262403725446437851872

    45451940804467305637499520373937443722065637571640377206883731681637763960373023923713892038033208374947123750913637110072374802883766299237735112373168163752836837110072377639603749952037812040373504723723796037898584374706723725912037437016

    46463302164358920037257160376901203729160038064040372079603759664037569120376212403769504037030840376458403797548037682280372473203750316037498240375376003786432037458880376360003739000037557280376999603748348037645840373555603763108037749160

    47471988964278988837514688377307203737904037358944379367043777091237600096372886083751468837600096379367043757497637082624379969923773072037605120372735363764028837278560380974723774076837590048373087043735392038037184373087043810752037313728

    48483246244148755237774224379283043747120037866672374301123765096037882080376560963753388837820448372606243800534437573920377228643735307237594464380002083749688037799904374722563763555237697184378461283746712037825584371116803817996837537968

    49493317524097232037603000376973203736720038111280376134803755584037498200378754803784404037697320376763603760748037650160377025603774972037765440374877203776020037938360375296403763444037980280373252803801696037828320375506003751392037540120

    50503268883984725637845608376904003741744838107856376315283800081637733216380008163728364837321112383647523752984037838640376368803744956038048984377118083795800037540544375940643802222437824200377118083769040037610120380436323773856837604768

    51513228643900771237856496376328003792196837842816377828003762734437720096381402083779648037480032376546243786195237900144379137443785649637289072377964803796561637875552379001443749640038047456378019363754273637924656379355683754004837731008

    52521064643843033637823872378238723770137637851712376624003813568037651264377848963775148837679104378071683799648037974208377236483783500837740352383468163737286437823872376512643812454437907392377403523769024037823872378350083782944037929664

    53525382083771396037957856377650083797971237730976380656243777635237583504380712963792382438054280375608163807129637867104380194163756648838008904378387443803726437912480378954643748708037765008380089043794651237980544379635283749842438105328

    54524461443819811237937832379551843777009637804800380997843752138438267520376081443803037638059296375792243822703237752744378562803796675238036160377874483782793637758528381402723797253637897344376717683782215237949400381460563789156037908912

    55529184963760096037995456380896643808947237701056379306883772460838107328379777923815443237877696376304003821331238019008375538563830752037500864382780803802489637865920376362883794246437830592382427523786003237871808378600323795424038107328

    56528854083780200038154000380360003781800037976000381200003798200037904000375680003823400038018000382220003789800037748000378680003841400037970000378800003780200037824000383720003774000038192000379080003782400038180000379260003781800038130000

    57530230323783259237601488386330643794941638053184379982483788227237931104380043523813864037949416379127923819357637906688379311043815084838022664380096083799824838003504378264883769915238480464379982483800435237998248375892803841332038004352

    58528439923822690438077720378305763816474438090152379844803793624838009344380046243827663238102584379658323801556037773136381274483810258438170960380590723765503238264200380419203788030438400952378788083819582438027992379844803801556037885024

    59528552483808432038428400379860003780272038099760378406403859904037774640383750403766368038017600385611203795440037884880383525603715176038801280379607203815032037929120381187203821352037882080382198403782800038194560383968003788488038074480

    60528691683810960038103168380668803814176038182656381054723809260837948800381826563816336038099040380926083810547237983264382148163809260838099040380990403809904038105472380990403808617638092608381376323809904038105472381054723795753638253408

    61524685043879067238124000381244883793445638202432380586403832008038124000381310243806517638176776381370723803249638039032379475283849050438124488381310243787563238065176384442643812400038131024381370723783690438425144381370723813053638137072

    62529515523809379238273288382068083824669637940888383065283791429638412896383198243806055237874408382599923847197638020664381595203804060837874408384594323847272838160272381669203791429638120384383198243829323238127032380073683802731238439488

    63532546563805136038159392383416963805811238196064381893123800409638193152382201603813913638591520377812803841596837977088381593923829734438085120384092163808512037889312384969923826067238118880378922243831468838216320383214403823366438175808

    64532092323796484838479648383286403810899238218816380678083819822438520832380952003836982438060944379030723878852838177632382462723822568037752064386100643819822438321776380815363811585638211952383286403828059238040352380472163846592038301184

    65531489363842404838242880381522963816623238298624382986243828468838298624382428803823341638235912381453283806868038472824382707523824288038159264379362883836830438512136382428803824038438242880381592643832649638033840384588883824288037922352

    66532311043795612038310120382605603853668038274720382110003832428038041080383242803814728038288880385508403816852038083560385579203799860038416320383950803826764038211000380198403857916038267640380481603849420038161440383809203826764038267640

    67531745923847233638206528380341123832865638292736382208963842204838060832384795203860164838378944380628483782577638736128385585443821371237832960384220483868067237983824384148643846515237940720386355523799819238220896382783683812032038953664

    68526726563831987238319872383198723831987238318592383198723831987238318592383198723831257638319872383198723831987238319872382615043837824038319872383198723831257638319872383198723831987238319872383198723831987238319872383198723847180838319872

    69533556403833440038127200385638003834180038341800383196003820860038497200383418003834180038275200381050003861560038371400383418003834920038139600381716003873400038341800383122003835660038156800385046003834920038341800383394003820120038482400

    70531210723875759238366968383669683826180038145936386974963836696838366968383669683834443238381992383068723838950438416368383068723833373638442088383669683836696838201704386223763835945638366968383594563796132038709336384120403835945638359456

    71525199683837702438377024383730563839590438373056383846403838828838388288383806723839225638388288383806723838828838388288383846403838828838388288383882883838828838384640383882883838464038388288383882883838828838384640383882883838464038388288

    72531548323840043238406384383986563840638438390928384158883840638438406384383909283843134438406384384141123840638438408160384141123824409638576400384063843840638438415888384063843840638438415888384081603836179238452752384158883840638438390928

    73529789123842955238429552385726003843162438431624384237923838256038460880384217203842172038421720384316243842955238423792384295523842955238421720384159603842955238421720384237923842955238429552384159603842172038421720384217203842955238421720

    74533887523840293638371160382202243869686438099424388160243859989638244056387127523827583238371160386889203807723238792192385459283838704837948488386492003845854438442656383076083851415238426768382678883883985638180504386333123823611238315552

    75528520323847012838470128384701283847012838469440384701283847012838470128384701283847012838470128384701283847012838470128384701283847012838470128385586563847012838470128384540323842184038502320384701283846208038470128384218403850232038470128

    76531835523849072038488480381888003879040038490720384907203849072038423200385560003849664038490720384907203845584038529280384803203849664038382400384417603864352038490720380990403849072038400960385804803864576038488480384884803844768038539680

    77526950483908476838415384385476083820878438613720388616403836975238758160384193363831621638671568385558723851024038353224384484403873336838407120383575363861372038303640385145523874594438506288384567043806829639059976384110723864677638217048

    78533156723861604838297760387751923852960038440152386160483831451238741688385239123853228838197248388562643843177638708184385239123828100838607672385322883866630438515536385212243846528038336952387668163851553638532288385155363847096838582544

    79531030883869456038550400385419203854192038550400385419203854192038550400385419203851648038575840385419203855040038541920385504003854192038541600385504003854192038541920385504003854192038550400385419203854192038550400385419203855040038541920

    80531174403856089638560784385694883856089638560896385694883853500838586560385694883856078438560896384320163869825638560896385694883856078438560896385694883856089638560896385693763856089638560784385693763856089638560784384320163869836838560896

    Chart-Comp-40M

    37329.42440291.79240327.136

    37060.86439893.240004.272

    37240.28838257.02440000

    37398.35237308.6440000

    37043.77637405.63239893.2

    37030.9636825.90437304.368

    37137.7637248.83237426.992

    37180.4837060.86437257.376

    37449.61637543.637133.488

    37171.93637163.39237065.136

    36825.90437210.38437253.104

    37171.93637423.98437210.384

    37065.13637116.437176.208

    37116.437317.18437351.36

    37244.5637107.85637090.768

    37394.0837056.59237406.896

    37018.14437347.08837231.744

    37060.86436919.88837082.224

    37218.92837594.86436924.16

    37449.61637018.14437398.352

    36877.16837411.16837654.672

    37261.64837351.3636983.968

    36898.52836561.0437223.2

    37189.02437423.98437112.128

    37137.7637304.36836787.456

    37137.7637210.38437730.304

    37060.86437223.237217.664

    37026.68837142.03237095.04

    37398.35237372.7237325.728

    37218.92837095.0436808.816

    Buffer size

    100KB

    1MB

    2MB

    Time (s)

    Actual Rate (Kbps)

    UDP Rate comparison for different CAR buffer sizes(Desired rate: >40Mbps; Average rate limit 40 Mbps)Packet size 530 Bytes

    Compare-40M

    123456789101112131415161718192021222324252627282930

    100KB37329.42437060.86437240.28837398.35237043.77637030.9637137.7637180.4837449.61637171.93636825.90437171.93637065.13637116.437244.5637394.0837018.14437060.86437218.92837449.61636877.16837261.64836898.52837189.02437137.7637137.7637060.86437026.68837398.35237218.928

    1MB40291.79239893.238257.02437308.6437405.63236825.90437248.83237060.86437543.637163.39237210.38437423.98437116.437317.18437107.85637056.59237347.08836919.88837594.86437018.14437411.16837351.3636561.0437423.98437304.36837210.38437223.237142.03237372.7237095.04

    2MB40327.13640004.272400004000039893.237304.36837426.99237257.37637133.48837065.13637253.10437210.38437176.20837351.3637090.76837406.89637231.74437082.22436924.1637398.35237654.67236983.96837223.237112.12836787.45637730.30437217.66437095.0437325.72836808.816

    the GARAproject

    Basic Experiment IIGARA Diffserv Resource ManagerUDP SenderUDP ReveiverUDP SenderUDP-Realtime-Receiver

    the GARAproject

    Basic Experiment IIGoal: Demonstrate Low-Latency for UDP flows

    the GARAproject

    TCP Issue:Exceeding the Reservation 0510152025303540450Slow StartExponential GrowthTCP Congestion Window SizetimeCongestion ControlLinear Growth

    the GARAproject

    Basic Experiment IIIGARA Diffserv Resource ManagerTCP SenderUDP ReceiverTCP Receiver

    the GARAproject

    Chart-40M

    5992.9055764882.8125

    4474.17264882.8125

    3653.0985614882.8125

    4651.6101124882.8125

    5163.6028684882.8125

    4270.1614074882.8125

    4595.4031474882.8125

    6165.1820524882.8125

    5001.8030544882.8125

    3347.4769114882.8125

    4610.6202064882.8125

    4658.6513084882.8125

    4884.7822514882.8125

    6016.4139054882.8125

    3285.7594884882.8125

    5422.749544882.8125

    4073.7287074882.8125

    4649.6041444882.8125

    4706.7006614882.8125

    6447.2744134882.8125

    3264.4224174882.8125

    4595.4812094882.8125

    5118.2896764882.8125

    5173.7765144882.8125

    5438.8716094882.8125

    3239.8412534882.8125

    5272.3533064882.8125

    5985.5333114882.8125

    3206.2800624882.8125

    4686.7975894882.8125

    4620.5671844882.8125

    5968.8270134882.8125

    3674.8512724882.8125

    4682.4316864882.8125

    4700.1404884882.8125

    5463.7318714882.8125

    5706.6155964882.8125

    3290.0008714882.8125

    4613.5510214882.8125

    5550.6289374882.8125

    3976.3986944882.8125

    4668.8869514882.8125

    4700.5559384882.8125

    6282.015184882.8125

    3446.5577884882.8125

    4693.5767614882.8125

    4642.3130684882.8125

    5836.6000554882.8125

    3659.1162164882.8125

    5071.7399084882.8125

    5661.9233164882.8125

    5025.9490784882.8125

    3149.6217824882.8125

    4729.9812274882.8125

    5824.1032114882.8125

    4950.6262214882.8125

    3570.9929564882.8125

    4612.3658414882.8125

    5997.9294734882.8125

    3639.239714882.8125

    4609.7441554882.8125

    6318.4563464882.8125

    3432.4081484882.8125

    4692.0605194882.8125

    4722.6082414882.8125

    5594.6477434882.8125

    5339.2850624882.8125

    4895.6151584882.8125

    4765.484314882.8125

    3115.6914184882.8125

    4679.5147784882.8125

    4683.191924882.8125

    6133.8998794882.8125

    3632.16074882.8125

    4691.7692974882.8125

    4639.2681994882.8125

    4688.5575344882.8125

    5739.0333054882.8125

    3926.1064314882.8125

    4890.8308894882.8125

    5854.8927354882.8125

    5108.0765374882.8125

    4427.8013214882.8125

    4804.2603264882.8125

    3334.5951474882.8125

    4678.6902734882.8125

    5208.5098744882.8125

    5908.1747054882.8125

    4555.2361794882.8125

    3267.491954882.8125

    4638.8525014882.8125

    6446.2290294882.8125

    3161.4677394882.8125

    4671.6360864882.8125

    5275.5205114882.8125

    5919.6644974882.8125

    4675.1495094882.8125

    3863.5501834882.8125

    5272.6518754882.8125

    3298.2011634882.8125

    Rate

    Limit

    Time

    Actual Rate (KB/s)

    Example of Oversubscribing with TCP(Attempted Rate: 6000KB/s, Buffer size: 2000000 bytes)

    Chart-45M

    5982.730994

    6021.907733

    3551.640071

    4947.692617

    5055.546409

    4960.303814

    6967.650256

    5432.91599

    5167.087452

    3516.163449

    4807.445027

    7861.39196

    4444.004242

    4641.174183

    4906.393325

    4649.622306

    4363.080495

    4901.240789

    6927.458922

    4041.29913

    4600.347277

    4879.94546

    5543.700005

    5595.565625

    3673.763762

    4984.326057

    4976.53039

    4961.429419

    4922.724322

    5092.34747

    5322.291352

    5414.785211

    5435.007721

    4021.118669

    4972.609833

    5034.768011

    4951.532278

    4922.824915

    5047.020262

    5109.517961

    5440.462494

    5686.598933

    3929.760863

    4930.218863

    4968.968354

    5009.111242

    4971.851694

    5169.437196

    5428.828125

    5190.519376

    5680.223323

    3916.805571

    4951.213787

    4973.400648

    4948.392144

    4945.707626

    5103.378141

    5377.534469

    5331.002374

    5640.450309

    4894.5873

    3607.244608

    4907.196707

    5013.318701

    6914.665121

    3598.53935

    4560.339031

    4986.168798

    5477.134079

    6397.843815

    3452.270809

    4961.553447

    5588.608729

    5901.084414

    3638.306013

    4882.336695

    5507.777397

    4534.430066

    4977.429128

    4899.984356

    4810.771476

    6216.981127

    3886.083944

    5000.609363

    5018.190244

    4966.203506

    5620.012874

    5859.972717

    3884.114541

    4874.753013

    5435.734474

    4908.959823

    6374.7225

    5073.639814

    3447.208706

    5627.581873

    4446.00244

    8091.170594

    4614.477429

    5317.91267

    CAR rate limit = 45Mbps

    Time (sec)

    Actual Rate (KB/s)

    Long term TCP Performance with CAR(Desired Rate: 6000KB/s, Buffer size: 200000 bytes)

    Chart-50M

    5961.910026

    6122.123738

    5935.464128

    5972.950044

    6060.551777

    5935.773039

    5972.570097

    6054.947863

    6060.570054

    5935.695808

    5972.884737

    6060.624885

    6054.384781

    5935.660164

    4718.659566

    5055.1659

    4692.207078

    5236.16915

    5245.891524

    7520.731328

    3767.489463

    5388.814145

    5299.535506

    7702.543433

    5233.783397

    4024.484591

    5290.678347

    7692.49232

    5307.203281

    4454.461675

    4728.339303

    7188.675409

    4453.304433

    5311.084081

    5415.863938

    5384.806258

    8408.145421

    4793.790127

    4769.117862

    4952.660338

    5054.361829

    5289.602448

    5324.306102

    5436.715592

    7668.835004

    5501.788913

    4358.17212

    4608.216785

    5371.93561

    7158.879394

    4499.152365

    8356.359799

    5097.088282

    5039.391062

    5033.350975

    4790.317427

    5211.816439

    5269.935364

    5283.333435

    5409.124755

    5394.477823

    5326.604985

    5374.039812

    5386.31471

    7752.672022

    4678.393262

    4830.839301

    5435.617817

    5336.15581

    5345.196072

    7822.8788

    4967.126448

    4772.541691

    4682.007125

    5483.576365

    5347.311406

    5394.823516

    5378.565805

    5167.108219

    7949.092352

    4919.493301

    4929.506236

    4959.145121

    4969.107594

    5342.269242

    5317.956365

    5423.502122

    7722.435352

    5275.600496

    4585.86801

    4725.705815

    5183.948838

    7134.772699

    6314.309143

    3791.385638

    5456.236025

    5359.059214

    7907.324542

    4916.347635

    4858.761016

    CAR rate limit = 50Mbps

    Time (sec)

    Actual Rate (KB/s)

    Long term TCP Performance with CAR(Desired Rate: 6000KB/s, Buffer size: 200000 bytes)

    Chart-55M

    6002.175

    6038.33664

    5939.840722

    5990.53466

    5995.119988

    6099.920347

    5939.941711

    5990.297252

    6038.781518

    5939.656572

    5990.772088

    6054.923642

    6038.409766

    5939.793198

    5990.778024

    6038.178207

    5940.024882

    6054.717774

    5990.510919

    6038.531647

    5939.698153

    5991.045152

    5994.241568

    6100.380565

    5939.769437

    5990.807703

    6038.391485

    5939.906068

    5990.582144

    5994.508628

    6100.374346

    5938.182555

    5992.481269

    6038.421954

    5938.295417

    5991.863936

    6054.820706

    6038.440236

    5938.515214

    5991.887677

    6038.903413

    5938.176615

    6054.633008

    5992.220074

    6038.300078

    5938.645912

    5991.638404

    5995.042819

    6100.082038

    5938.414224

    5992.457523

    6038.245235

    5938.420165

    5992.113228

    5994.645134

    6099.90791

    5938.461749

    5992.392223

    6036.432405

    5940.227005

    5992.077614

    6054.675391

    6037.903171

    5937.623494

    5993.489319

    6035.998445

    5939.514013

    6054.748047

    5993.513062

    6037.195298

    5938.604326

    5992.872069

    5994.621394

    6100.480081

    5936.814773

    5993.311253

    6036.938272

    5939.002811

    5993.245965

    5994.556108

    6099.679402

    5937.688838

    5993.507126

    6035.760755

    5939.585292

    5993.34093

    6054.626954

    6037.268431

    5938.776616

    5993.180678

    6035.204731

    5940.286404

    6054.735938

    5993.085718

    6036.785893

    5937.587852

    5994.906294

    5994.734164

    6099.511475

    5936.231611

    CAR rate limit = 55Mbps

    Time (sec)

    Actual Rate (KB/s)

    Long term TCP Performance with CAR(Desired Rate: 6000KB/s, Buffer size: 200000 bytes)

    chart

    5992.9055765982.7309945961.9100266002.175

    4474.17266021.9077336122.1237386038.33664

    3653.0985613551.6400715935.4641285939.840722

    4651.6101124947.6926175972.9500445990.53466

    5163.6028685055.5464096060.5517775995.119988

    4270.1614074960.3038145935.7730396099.920347

    4595.4031476967.6502565972.5700975939.941711

    6165.1820525432.915996054.9478635990.297252

    5001.8030545167.0874526060.5700546038.781518

    3347.4769113516.1634495935.6958085939.656572

    4610.6202064807.4450275972.8847375990.772088

    4658.6513087861.391966060.6248856054.923642

    4884.7822514444.0042426054.3847816038.409766

    6016.4139054641.1741835935.6601645939.793198

    3285.7594884906.3933254718.6595665990.778024

    5422.749544649.6223065055.16596038.178207

    4073.7287074363.0804954692.2070785940.024882

    4649.6041444901.2407895236.169156054.717774

    4706.7006616927.4589225245.8915245990.510919

    6447.2744134041.299137520.7313286038.531647

    3264.4224174600.3472773767.4894635939.698153

    4595.4812094879.945465388.8141455991.045152

    5118.2896765543.7000055299.5355065994.241568

    5173.7765145595.5656257702.5434336100.380565

    5438.8716093673.7637625233.7833975939.769437

    3239.8412534984.3260574024.4845915990.807703

    5272.3533064976.530395290.6783476038.391485

    5985.5333114961.4294197692.492325939.906068

    3206.2800624922.7243225307.2032815990.582144

    4686.7975895092.347474454.4616755994.508628

    4620.5671845322.2913524728.3393036100.374346

    5968.8270135414.7852117188.6754095938.182555

    3674.8512725435.0077214453.3044335992.481269

    4682.4316864021.1186695311.0840816038.421954

    4700.1404884972.6098335415.8639385938.295417

    5463.7318715034.7680115384.8062585991.863936

    5706.6155964951.5322788408.1454216054.820706

    3290.0008714922.8249154793.7901276038.440236

    4613.5510215047.0202624769.1178625938.515214

    5550.6289375109.5179614952.6603385991.887677

    3976.3986945440.4624945054.3618296038.903413

    4668.8869515686.5989335289.6024485938.176615

    4700.5559383929.7608635324.3061026054.633008

    6282.015184930.2188635436.7155925992.220074

    3446.5577884968.9683547668.8350046038.300078

    4693.5767615009.1112425501.7889135938.645912

    4642.3130684971.8516944358.172125991.638404

    5836.6000555169.4371964608.2167855995.042819

    3659.1162165428.8281255371.935616100.082038

    5071.7399085190.5193767158.8793945938.414224

    5661.9233165680.2233234499.1523655992.457523

    5025.9490783916.8055718356.3597996038.245235

    3149.6217824951.2137875097.0882825938.420165

    4729.9812274973.4006485039.3910625992.113228

    5824.1032114948.3921445033.3509755994.645134

    4950.6262214945.7076264790.3174276099.90791

    3570.9929565103.3781415211.8164395938.461749

    4612.3658415377.5344695269.9353645992.392223

    5997.9294735331.0023745283.3334356036.432405

    3639.239715640.4503095409.1247555940.227005

    4609.7441554894.58735394.4778235992.077614

    6318.4563463607.2446085326.6049856054.675391

    3432.4081484907.1967075374.0398126037.903171

    4692.0605195013.3187015386.314715937.623494

    4722.6082416914.6651217752.6720225993.489319

    5594.6477433598.539354678.3932626035.998445

    5339.2850624560.3390314830.8393015939.514013

    4895.6151584986.1687985435.6178176054.748047

    4765.484315477.1340795336.155815993.513062

    3115.6914186397.8438155345.1960726037.195298

    4679.5147783452.2708097822.87885938.604326

    4683.191924961.5534474967.1264485992.872069

    6133.8998795588.6087294772.5416915994.621394

    3632.16075901.0844144682.0071256100.480081

    4691.7692973638.3060135483.5763655936.814773

    4639.2681994882.3366955347.3114065993.311253

    4688.5575345507.7773975394.8235166036.938272

    5739.0333054534.4300665378.5658055939.002811

    3926.1064314977.4291285167.1082195993.245965

    4890.8308894899.9843567949.0923525994.556108

    5854.8927354810.7714764919.4933016099.679402

    5108.0765376216.9811274929.5062365937.688838

    4427.8013213886.0839444959.1451215993.507126

    4804.2603265000.6093634969.1075946035.760755

    3334.5951475018.1902445342.2692425939.585292

    4678.6902734966.2035065317.9563655993.34093

    5208.5098745620.0128745423.5021226054.626954

    5908.1747055859.9727177722.4353526037.268431

    4555.2361793884.1145415275.6004965938.776616

    3267.491954874.7530134585.868015993.180678

    4638.8525015435.7344744725.7058156035.204731

    6446.2290294908.9598235183.9488385940.286404

    3161.4677396374.72257134.7726996054.735938

    4671.6360865073.6398146314.3091435993.085718

    5275.5205113447.2087063791.3856386036.785893

    5919.6644975627.5818735456.2360255937.587852

    4675.1495094446.002445359.0592145994.906294

    3863.5501838091.1705947907.3245425994.734164

    5272.6518754614.4774294916.3476356099.511475

    3298.2011635317.912674858.7610165936.231611

    CAR rate limit

    40M

    45M

    50M

    55M

    Time (seccond)

    Actual Rate (KB/s)

    Long term TCP Performance with CAR(Desired Rate: 6000KB/s, Buffer size: 200000 bytes)

    dslnet2-1-40M-6K

    ttcp-r: buflen=200000 nbuf=2097152 align=16384/0 port=5001 sockbufsize=200000 tcp0

    5992.9055761.01078547943.2446084882.8125

    4474.17262.00015735793.38084882.8125

    3653.0985613.21072529224.7884884882.8125

    4651.6101124.00083737212.8808964882.8125

    5163.6028685.00002241308.8229444882.8125

    4270.1614076.32077434161.2912564882.8125

    4595.4031477.04082136763.2251764882.8125

    6165.1820528.00023849321.4564164882.8125

    5001.8030549.00010440014.4244324882.8125

    3347.47691110.36080726779.8152884882.8125

    4610.62020611.18082736884.9616484882.8125

    4658.65130812.02085137269.2104644882.8125

    4884.78225113.00001639078.2580084882.8125

    6016.41390514.00021648131.311244882.8125

    3285.75948815.16085926286.0759044882.8125

    5422.7495416.00003243381.996324882.8125

    4073.72870717.29103132589.8296564882.8125

    4649.60414418.19094837196.8331524882.8125

    4706.70066119.00028737653.6052884882.8125

    6447.27441320.00506651578.1953044882.8125

    3264.42241721.33094926115.3793364882.8125

    4595.48120922.06091236763.8496724882.8125

    5118.28967623.00014140946.3174084882.8125

    5173.77651424.00011741390.2121124882.8125

    5438.87160925.00115443510.9728724882.8125

    3239.84125326.19100325918.7300244882.8125

    5272.35330627.00003642178.8264484882.8125

    5985.53331128.00015947884.2664884882.8125

    3206.28006229.25092725650.2404964882.8125

    4686.79758930.38096337494.3807124882.8125

    4620.56718431.08104736964.5374724882.8125

    5968.82701332.00013247750.6161044882.8125

    3674.85127233.31099529398.8101764882.8125

    4682.43168634.28102337459.4534884882.8125

    4700.14048835.16094637601.1239044882.8125

    5463.73187136.00009143709.8549684882.8125

    5706.61559637.00112945652.9247684882.8125

    3290.00087138.3110726320.0069684882.8125

    4613.55102139.03106636908.4081684882.8125

    5550.62893740.00013244405.0314964882.8125

    3976.39869441.35105731811.1895524882.8125

    4668.88695142.15106737351.0956084882.8125

    4700.55593843.00119537604.4475044882.8125

    6282.0151844.00018450256.121444882.8125

    3446.55778845.36106427572.4623044882.8125

    4693.57676146.17114337548.6140884882.8125

    4642.31306847.00061437138.5045444882.8125

    5836.60005548.00011946692.800444882.8125

    3659.11621649.22116529272.9297284882.8125

    5071.73990850.00007940573.9192644882.8125

    5661.92331651.00020545295.3865284882.8125

    5025.94907852.0000940207.5926244882.8125

    3149.62178253.13123425196.9742564882.8125

    4729.98122754.00018437839.8498164882.8125

    5824.10321155.0001246592.8256884882.8125

    4950.62622156.00024639605.0097684882.8125

    3570.99295657.36121228567.9436484882.8125

    4612.36584158.07119236898.9267284882.8125

    5997.92947359.00007747983.4357844882.8125

    3639.2397160.29125529113.917684882.8125

    4609.74415561.01122736877.953244882.8125

    6318.45634662.00016750547.6507684882.8125

    3432.40814863.36125727459.2651844882.8125

    4692.06051964.14121937536.4841524882.8125

    4722.60824165.05137337780.8659284882.8125

    5594.64774366.00007244757.1819444882.8125

    5339.28506267.00002342714.2804964882.8125

    4895.61515868.00002939164.9212644882.8125

    4765.4843169.0001238123.874484882.8125

    3115.69141870.14128824925.5313444882.8125

    4679.51477871.06134737436.1182244882.8125

    4683.1919272.05131137465.535364882.8125

    6133.89987973.00306949071.1990324882.8125

    3632.160774.37133629057.28564882.8125

    4691.76929775.29142337534.1543764882.8125

    4639.26819976.07134837114.1455924882.8125

    4688.55753477.15139637508.4602724882.8125

    5739.03330578.00021645912.266444882.8125

    3926.10643179.24135231408.8514484882.8125

    4890.83088980.00010639126.6471124882.8125

    5854.89273581.00014146839.141884882.8125

    5108.07653782.00237240864.6122964882.8125

    4427.80132183.00016935422.4105684882.8125

    4804.26032684.00020138434.0826084882.8125

    3334.59514785.23148126676.7611764882.8125

    4678.69027386.04139937429.5221844882.8125

    5208.50987487.00021941668.0789924882.8125

    5908.17470588.00016147265.397644882.8125

    4555.23617989.00040536441.8894324882.8125

    3267.4919590.17145826139.93564882.8125

    4638.85250191.00001137110.8200084882.8125

    6446.22902992.0000951569.8322324882.8125

    3161.46773993.24153425291.7419124882.8125

    4671.63608694.0514537373.0886884882.8125

    5275.52051195.00025342204.1640884882.8125

    5919.66449796.00018147357.3159764882.8125

    4675.14950997.00007837401.1960724882.8125

    3863.55018398.00006430908.4014644882.8125

    5272.65187599.00021342181.2154882.8125

    3298.201163100.17160226385.6093044882.8125

    4684.101371101.000061

    6424.661163102.0015

    3235.916611103.301611

    4651.541477104.131582

    4661.417733105.061632

    4767.86355106.000228

    4582.200457107.381622

    4592.868621108.115415

    5872.996941109.000218

    3768.998667110.221603

    4695.820432111.051638

    5272.269833112.000211

    5388.51843113.000022

    5238.176353114.000221

    3015.677202115.101711

    5798.026332116.000168

    3785.503626117.211708

    4679.842965118.021727

    6339.826063119.000137

    4782.217769120.001797

    3238.790188121.241771

    4657.490698122.171691

    4660.029588123.000452

    6520.796409124.000246

    2991.032851125.111765

    4712.066202126.011852

    5515.033027127.000099

    5511.65398128.000334

    3326.695416129.271825

    4573.014132130.000074

    5177.862375131.000087

    5749.532348132.000097

    3437.365684133.251805

    4651.566337134.061848

    4688.545343135.00203

    5668.395089136.000008

    5550.124193137.003839

    4615.949752138.000811

    3496.546002139.000151

    4183.505996140.301915

    4655.726517141.001914

    6343.809449142.006452

    3297.354486143.271967

    4580.584591144.00088

    4691.760987145.391953

    4662.64981146.211992

    4698.8448147.121894

    4970.693228148.000104

    4414.489838149.351951

    4594.266165150.061935

    6062.657773151.000187

    3547.919666152.27196

    4689.38519153.031996

    6574.403286154.000216

    3030.770345155.082114

    6116.343187156.000242

    3604.70279157.32198

    4673.049035158.292125

    4681.968284159.102085

    4795.897982160.000114

    6215.817908161.001255

    3477.335398162.382066

    4674.448031163.192109

    5223.887538164.000187

    4264.308732165.322083

    4690.393006166.242136

    5012.462021167.000114

    4491.003151168.222271

    4716.094611169.03211

    4685.346504170.000013

    6360.663067171.001441

    3189.763797172.212211

    5160.193833173.00015

    5803.630244174.000174

    3294.164045175.162184

    5526.021286176.000123

    5734.477594177.000272

    3268.342372178.292289

    4679.295488179.002169

    5469.042031180.00003

    5584.678382181.000203

    3290.341692182.292248

    4626.517258183.116226

    5716.701653184.000033

    5505.181711185.000149

    3229.388514186.262276

    4661.008843187.082302

    5079.59172188.00006

    4390.663481189.152412

    5669.353571190.000096

    5571.807579191.002327

    3325.291619192.322371

    4657.608441193.042291

    6199.653952194.000053

    3487.193579195.272303

    4638.399369196.07235

    4917.301356197.000101

    6016.126712198.000115

    4590.404572199.000146

    5057.001245200.000094

    3052.341866201.122452

    5826.342923202.00015

    5314.404246203.000218

    3187.770474204.142425

    4827.527213205.000015

    5934.626871206.000068

    3661.768707207.372457

    4641.145778208.092473

    5204.933638209.000183

    5904.483509210.000029

    3119.686607211.142484

    5569.86923212.000189

    4075.18507213.362445

    4659.68702214.062461

    5182.141982215.000022

    5956.937806216.000159

    3313.92875217.322578

    4703.173015218.092512

    4654.841596219.012547

    5539.654123220.000005

    3935.735898221.25259

    4683.393224222.062608

    4934.946323223.000043

    4415.275153224.062667

    6124.53641225.000053

    4845.461151226.000111

    3338.251141227.232611

    7066.299468228.000276

    3187.866243229.242621

    4688.347505230.032624

    4660.419773231.132654

    5004.079758232.000161

    5828.409973233.000092

    3560.357895234.272628

    4655.544971235.000213

    5845.947312236.000071

    3759.654421237.292743

    4653.014801238.002649

    6490.365576239.000101

    3328.937439240.372665

    4599.2413241.082811

    6053.613931242.000093

    3534.987332243.202714

    5052.112658244.000172

    4387.002153245.312723

    4626.240787246.022731

    6291.972995247.000201

    3459.35876248.352748

    4670.52287249.322803

    4710.106215250.112789

    4679.672453251.032817

    4704.339257252.022877

    6376.074207253.000197

    4706.909938254.000007

    3292.469788255.232762

    4639.928214256.052822

    6641.972921257.000462

    4536.453431258.000133

    3298.323311259.242798

    4670.140098260.032828

    6105.514395261.00022

    3516.365646262.272863

    4641.992624263.072905

    5053.618865264.000176

    5277.001458265.000041

    3920.583064266.322922

    4661.47226267.042857

    6290.027895268.000002

    4511.552913269.000134

    5141.409506270.000027

    3357.199226271.372922

    4681.501863272.06298

    5157.007446273.000134

    5891.39024274.000024

    3441.441589275.352984

    4686.784447276.232985

    5081.910309277.00024

    6099.460068278.000146

    3200.645502279.21303

    4675.712886280.013096

    6282.199724281.000027

    3365.998996282.263025

    4700.675896283.073098

    5950.870789284.000224

    5157.620912285.000015

    4590.939695286.00024

    3183.167298287.153057

    5049.407816288.00007

    5890.742188289.00007

    3488.60426290.353125

    4669.985566291.053128

    4876.511192292.000042

    5823.590703293.000066

    3710.787718294.373153

    7635.9698295.000281

    3154.870071296.213138

    5068.384502297.000163

    6024.914791298.000135

    3249.132877299.243183

    4676.042314300.243194

    4723.116487301.000217

    6312.50946302.001153

    3234.438867303.243242

    4664.535899304.073342

    5319.156646305.000423

    5799.41187306.000191

    3104.821961307.123318

    4664.835951308.023353

    6342.154036309.000055

    3322.697477310.253343

    4648.795656311.12336

    5577.241623312.000127

    4028.947419313.303352

    4686.419609314.00333

    6345.281195315.000223

    4211.319702316.000225

    5369.536869317.000384

    2988.25036318.133448

    4555.191932319.000063

    5797.141004320.000226

    5233.93434321.000146

    3407.911607322.353448

    4708.527285323.063463

    5019.154058324.000226

    5933.991968325.000386

    3475.065172326.373483

    4713.372206327.173509

    4672.438518328.000069

    6472.43468329.001606

    3369.01705330.373494

    4632.187267331.203547

    5002.496369332.000079

    5492.982788333.00008

    5239.468234334.001393

    3352.460924335.283526

    4605.342135336.003567

    6491.954516337.000116

    3373.539469338.373546

    4638.208054339.173626

    5180.984327340.000229

    5170.23843341.000062

    3858.664828342.253653

    4701.592114343.000192

    6305.490847344.001793

    3341.259963345.323636

    4661.142066346.043622

    6139.239388347.000126

    5024.06589348.000102

    3254.050499349.273695

    4605.342283350.093726

    5893.992939351.000048

    5373.541323352.001319

    3161.12097353.203659

    4688.462166354.023749

    5395.168249355.000129

    4139.009687356.353775

    4680.35047357.173759

    4650.961759358.163839

    4682.049706359.163785

    4713.166528360.000143

    6460.427226361.002438

    3538.422726362.000019

    5730.04654363.000696

    4708.469718364.001693

    3164.637152365.173869

    4660.093456366.093785

    5055.393732367.000146

    4379.276428368.053924

    4706.446404369.00022

    5752.460938370.00022

    3819.67243371.324087

    4692.520641372.224277

    5096.121263373.000024

    5966.676642374.000198

    3795.810164375

    5707.374285376.002154

    3347.579642377.334279

    4673.931265378.394218

    4683.635912379.084266

    5245.298595380.000209

    5568.966791381.000135

    3624.322607382.36428

    4669.683434383.224303

    4663.458126384.154256

    4686.777573385.124293

    6735.126013386.000193

    3172.542525387.000038

    5754.930408388.000101

    5117.998673389.000389

    3222.207053390.234361

    4683.907039391.124339

    4686.628658392.234337

    4697.138059393.0001

    5761.960918394.00018

    5285.16086395.00012

    3323.027097396.234405

    4660.763995397.044379

    5236.940534398.000168

    5947.072963399.001964

    3174.537134400.224374

    4648.211326401.034384

    6108.855038402.00008

    5024.845735403.004157

    3331.629853404.364485

    4660.292844405.06441

    4674.764688406.084519

    4690.225138407.002477

    6464.905204408.000108

    3166.802951409.234508

    4804.638993410.000345

    5936.627408411.000061

    3655.283057412.374495

    4681.426998413.194595

    5103.949879414.000156

    5800.10913415.000053

    3538.686645416.354507

    4646.602391417.074598

    5072.993017418.000014

    4367.770746419.384601

    4676.11489420.084597

    6074.940502421.000067

    3753.249549422.384586

    4689.331285423.224587

    4675.50614424.054569

    6177.723459425.000037

    3447.220939426.16463

    4657.383115427.000903

    6464.263368428.000177

    3044.987058429.104637

    5176.660663430.000232

    5885.649296431.000125

    4733.80284432.000283

    3293.604368433.254685

    4661.651041434.084687

    4692.45675435.024693

    5616.37087436.000186

    5416.462751437.001416

    3394.614421438.274768

    4649.096453439.001833

    5738.584224440.000024

    4464.494949441.000159

    5688.917292442.001805

    3253.489112443.334773

    4723.241984444.024766

    5512.466663445.000027

    3990.496407446.254717

    7123.946914447.002163

    3333.996611448.344847

    4666.38323449.164841

    4659.899126450.2448

    4720.065826451.144876

    5756.547213452.00003

    5456.679824453.002242

    4301.717297454.000122

    4717.256771455.000157

    3611.873796456.314934

    4685.39635457.12491

    4677.872797458.034929

    5450.896257459.000019

    5717.876615460.000831

    3148.211709461.204931

    4645.043548462.125065

    5070.26851463.000088

    5780.922346464.000094

    3551.244626465.344946

    4695.69632466.144943

    5412.955956467.000125

    5782.284514468.000142

    4623.584894469.000089

    3259.24966470.255027

    4663.274391471.08505

    5859.505199472.000113

    3756.952353473.204921

    4979.046155474.000054

    5792.160556475.000089

    5030.893107476.000125

    3076.266137477.135068

    4706.261111478.000222

    6441.327868479.001726

    3376.780715480.405077

    4673.371559481.105183

    5772.397877482.000219

    5290.046852483.000044

    4743.224049484.000019

    3369.572226485.325142

    4718.693082486.025167

    5599.524786487.00003

    5467.048505488.001906

    3185.673938489.185139

    5356.089113490.000154

    5748.385332491.000863

    3324.388906492.255223

    4695.926181493.055185

    5408.825246494.000107

    4156.212458495.375251

    4695.667216496.185273

    5184.193898497.000092

    5995.367136498.000236

    4564.147492499.000089

    3290.661902500.225283

    4692.216338501.165333

    4716.573441502.00018

    4634.763814503.385288

    4588.217411504.09528

    5866.777942505.00022

    5391.496595506.000004

    3154.399429507.205358

    4990.315153508.000124

    6015.692166509.000444

    4723.664266510.002145

    3279.713426511.255339

    4582.607881512.00042

    5971.981766513.000183

    3751.496436514.385349

    4610.034904515.21537

    4671.024203516.035465

    5489.225127517.00005

    4083.30531518.385431

    4603.234136519.105492

    4918.166681520.000039

    5882.340441521.000013

    4379.436916522.000039

    3775.203451523.305515

    4660.206288524.005453

    4691.567735525.205445

    5193.446277526.000144

    5933.871657527.000084

    3293.969541528.265595

    4631.693392529.000625

    4673.606124530.385509

    4685.52933531.08562

    4668.905395532.000746

    5680.848402533.00005

    3933.814463534.365599

    4619.442191535.075726

    6006.309944536.000229

    5214.697962537.001654

    3213.090913538.235571

    4681.88571539.275746

    4741.738761540.000032

    4629.579777541.375604

    4655.811765542.085696

    5248.08332543.00007

    5733.510638544.000139

    3208.349992545.145685

    4676.411688546.115738

    5930.528265547.000135

    4576.211267548.000152

    5403.919758549.000276

    3285.136795550.245759

    4644.580465551.075746

    5953.422561552.000083

    5082.564986553.000051

    3235.271407554.145754

    4646.016216555.045748

    5340.334269556.000119

    5762.648862557.000083

    3422.716654558.395847

    4674.682771559.305877

    4668.584723560.165797

    5326.408716561.000076

    5837.118551562.000225

    3337.312944563.345847

    4633.163926564.045874

    5932.162458565.000199

    3500.212147566.185847

    5200.533736567.000025

    5387.785591568.000233

    5085.445781569.000756

    3285.193748570.175915

    4699.514717571.075983

    6025.868442572.000088

    3643.708923573.315894

    4591.227728574.035979

    4670.551758575.006028

    6448.364792576.00003

    3015.050813577.115929

    4736.838413578.000176

    4850.101983579.000159

    4462.817062580.345993

    4659.774831581.046

    6286.495576582.000054

    3251.285645583.165981

    5365.657253584.000007

    4186.959718585.396036

    4659.178142586.216074

    5031.544642587.000077

    5801.47933588.000226

    4934.690899589.002137

    3281.053003590.256123

    4656.587272591.056107

    5974.440693592.000099

    4917.100089593.000085

    4980.154466594.000003

    3123.81861595.206209

    4664.707035596.026192

    4936.912908597.00022

    4421.270202598.356121

    4609.440288599.196143

    4688.419104600.006205

    5807.76583601.000116

    3764.642413602.386126

    4643.142068603.086184

    5225.553458604.000131

    6014.135198605.000002

    3142.701997606.206213

    4684.439977607.046178

    6115.98826608.000024

    3397.622532609.186228

    4688.95388610.006232

    5323.66004611.000012

    5800.32335612.002081

    3099.604368613.176311

    4680.033618614.096268

    6063.501473615.000062

    3687.015673616.326322

    4683.362186617.126299

    5606.193992618.000064

    5462.80101619.001153

    4842.509418620.000054

    3015.180851621.106454

    5898.195193622.000047

    3854.365764623.36637

    4646.056456624.196396

    4661.511609625.116338

    4920.61313626.000009

    5778.539537627.000184

    3678.420848628.376438

    4689.164744629.286394

    4660.693867630.000025

    5694.117789631.000005

    5478.062145632.000127

    3122.567666633.226444

    4820.619991634.000094

    4477.186641635.366448

    4606.193941636.176418

    5181.863759637.000133

    4341.290483638.386597

    4639.982021639.086513

    6042.494031640.000056

    5203.3921641.000091

    3194.606354642.196529

    4657.543584643.286524

    4623.997006644.000885

    4713.429104645.006572

    6509.348705646.000239

    4612.234471647.000178

    4644.940014648.000439

    3123.15374649.136604

    5614.423585650.0002

    5464.481343651.001503

    3446.15846652.366678

    4517.261954653.121586

    5626.308698654.000083

    5522.695022655.002449

    4724.603385656.002442

    4730.247553657.000032

    3182.383684658.216746

    4998.628482659.000207

    6127.090543660.000022

    4694.375636661.002202

    3290.961497662.276674

    4573.761282663.001375

    5611.418417664.000085

    5420.479416665.000047

    4739.60458666.000184

    3104.065488667.1268

    4677.306387668.000049

    6438.078054669.00228

    3213.89477670.256739

    4698.188916671.076952

    5053.312498672.000047

    4363.732081673.326781

    4659.54058674.026819

    6393.659579675.000116

    3161.870227676.126872

    5799.54531677.000021

    3848.862227678.226804

    4678.445541679.366781

    4676.655871680.146869

    4621.289461681.001706

    4689.432549682.0168

    6563.951213683.000029

    3146.767908684.216915

    4652.723849685.036869

    4833.61343686.000151

    5509.153677687.00006

    5574.890569688.000458

    3126.981494689.236899

    4683.733849690.256881

    4726.615586691.000071

    5816.270035692.000128

    3717.716697693.326941

    4653.457011694.026975

    6331.813369695.000093

    3227.31528696.126979

    4660.552439697.196997

    4617.627482698.125373

    5733.686232699.0001

    5551.170427700.000146

    4429.330918701.000178

    4967.261771702.000108

    3058.910778703.127041

    5779.827026704.000212

    5541.933003705.000124

    3144.190673706.237053

    4619.611297707.15701

    4649.108618708.087069

    6009.022939709.000006

    5257.893288710.000793

    3251.675822711.27707

    4660.883363712.197136

    4683.294935713.007171

    6159.784953714.000059

    3434.411596715.187262

    5397.961505716.000181

    4805.758146717.000198

    5732.693333718.000907

    3271.118404719.317102

    4687.27128720.14713

    5433.675739721.000097

    4037.085001722.087404

    5997.783748723.00015

    5215.181577724.001205

    3359.002706725.357239

    4649.525094726.077184

    4909.939001727.000232

    6048.229947728.000121

    4686.444448729.000042

    3176.758197730.137226

    5678.303754731.000146

    3796.746737732.017346

    6559.742973733.000119

    3353.140545734.387432

    4646.528547735.257264

    4718.458383736.05733

    4995.021532737.000046

    5904.929141738.000058

    3388.763991739.287389

    4677.927404740.077323

    4650.333831741.001929

    6205.97488742.000063

    4911.166057743.000096

    3321.280523744.357365

    4677.655828745.197329

    4642.59298746.02736

    5440.990753747.000234

    4088.552314748.367447

    4678.68926749.29742

    4597.296801750.000113

    5736.851923751.0001

    4606.410119752.000061

    5370.401366753.000059

    3182.851356754.217484

    5062.530628755.000068

    4436.730118756.147525

    4864.553471757.000057

    5902.692894758.000203

    3504.867145759.287598

    4642.520927760.00003

    6457.265154761.001491

    4484.283697762.000392

    3028.59944763.000216

    6515.221402764.000206

    3370.278386765.377509

    4666.826946766.207507

    4699.39794767.047529

    6091.08557768.000125

    3540.374324769.307626

    4646.727753770.017572

    4968.115104771.000115

    5995.046035772.000078

    3255.01827773.147585

    4795.546402774.000199

    5900.22728775.000038

    3490.30931776.197634

    4675.145499777.017616

    4676.294966778.337684

    4727.628238779.02764

    5666.108282780.000106

    5343.7295781.001623

    3235.801462782.187676

    5178.463148783.000089

    5243.480363784.000092

    3750.813717785.237662

    4908.320499786.000099

    6079.728475787.000436

    4726.181941788.000095

    3384.943196789.337734

    4688.664939790.247787

    4694.120399791.047753

    4690.243355792.000054

    6025.123504793.000228

    3696.815229794.387761

    4606.893601795.107869

    5771.977436796.000253

    5482.329881797.001677

    3106.818207798.227792

    4812.879907799.00002

    4482.981096800.367784

    4678.795998801.25782

    4754.492758802.000251

    6235.758687803.000477

    3442.817194804.357866

    4614.861855805.197828

    5098.881336806.000275

    5620.118857807.000233

    3601.756226808.27793

    4651.30776809.20786

    4711.056187810.178047

    4710.078739811.067919

    6202.204563812

    3357.247327813.177967

    4654.983794814.001811

    5807.381446815.000207

    4923.093761816.000134

    5130.943496817.001507

    3371.582334818.357979

    7509.156652819.001961

    4541.023203820.000626

    3336.334909821.268016

    4677.341208822.058049

    4753.01015823.000174

    6276.774495824.00136

    3196.73791825.18808

    5222.884572826.000135

    4236.976152827.308017

    4593.94264828.018051

    5320.80981829.000305

    5320.818172830.000243

    3602.981685831.298083

    4672.651581832.28814

    4615.021536833.001423

    4631.963037834.398142

    4671.764763835.218107

    4864.845606836.000253

    4908.692545837.000209

    5822.327977838.000205

    4912.427128839.000852

    3118.281848840.188167

    4593.824129841.000943

    5685.663549842.000153

    3925.83854843.398252

    4646.793812844.288281

    4621.311111845.000589

    4818.523247846.000024

    5468.542195847.000062

    5535.866202848.001846

    3217.858579849.208242

    4674.626927850.018254

    5488.21551851.000159

    4067.195539852.368246

    7450.185161853.002018

    3341.516182854.338267

    4652.851269855.058306

    6165.700175856.000071

    3552.357391857.278277

    7163.321689858.000121

    3376.103654859.000066

    5876.731198860.000024

    4854.180375861.000048

    3100.38543862.238358

    4687.474586863.06835

    5374.436215864.000221

    4067.871343865.278358

    4649.399566866.208363

    5183.525607867.000182

    4293.41456868.31843

    4604.365471869.028405

    6236.413393870.00018

    4874.56491871.000117

    3176.589023872.22847

    4680.541571873.238486

    4728.824943874.108553

    5705.242028875.000133

    3817.908051876.248434

    4663.343059877.218458

    5045.376956878.000029

    5706.927248879.000013

    3638.183741880.398542

    4672.575883881.328507

    4670.728599882.128511

    5590.969729883.000065

    4