Can we hack open source cloud platforms to help reduce emissions? cloudstack collab
Post on 12-May-2015
Embed Size (px)
DESCRIPTIONTo over come the lack of transparency around energy and emissions in the cloud space, we need to hack the open source cloud platforms, and write that transparency in.
- 1.Can we hack opensource #cloud platformsto help reduceemissions? Tom Raftery cloudstack collaboration conference 2012, Las Vegas1Saturday 1 December 12
2. Tom Raftery Lead analyst, energy andsustainability practice,RedMonk CIX, Chip & Zenith GreenMonk.net twitter.com/tomraftery firstname.lastname@example.org +34 677 695 468 SlideShare.net/TomRaftery 2Saturday 1 December 12CIX, Chip & Zenith - involvement with Cloud, going back to mid 90s 3. Data? http://www.wspenvironmental.com/media/docs/ourlocations/usa/NRDC-WSP_Cloud_Computing.pdf3Saturday 1 December 12WSP Environmental & NRDC report on cloud says cloud can reduce emissions - goodHowever:Lots of assumptionsNo real data 4. Garret FitzGerald 1926-20114Saturday 1 December 12Unlikely politician - highly intelligent academic, unimpeachable integrity, head in the clouds(!) 5. Garret FitzGerald Photo http://www.flickr.com/photos/caribb/5391899550/5Saturday 1 December 12Before he became a politician -In 1949 analyzed the earliest published Aeroot timetables, and produced one of the rst accurateestimations of the size of Russias airliner eet - previously a closely guarded secret 6. Garret FitzGeraldPhoto http://www.flickr.com/photos/steve_brace/2568478072/6Saturday 1 December 12KGB thought he was a spy!And look an image with KGB logo - and a sleeping cat!Proving theres no such thing as security by obscurity & the internet rocks! 7. Cloud problem No transparency7Saturday 1 December 12 8. Problemhttp://greenmonk.net/2011/07/21/carbon-disclosure-projects-emissions-reduction-claims-for-cloud-computing-are-awed/ 8Saturday 1 December 12Something I have been blogging about for quite a while 9. Problemhttp://greenmonk.net/2012/01/09/is-cloud-computing-green/ 9Saturday 1 December 12And giving conference talks about it as well 10. Problem http://www.nytimes.com/2012/09/23/technology/data-centers-waste-vast-amounts-of-energy-belying-industry-image.html10Saturday 1 December 12Data centers use vast amounts of electricityTypically only 6-12% of the electricity powering their servers goes to perform computations - McKinsey &Co.Rest used to keep servers idling and ready in case of a surge in activity - dynamic provisioning - i.e. theelastic in ec2! 11. Energy Emissions11Saturday 1 December 12NYT article was good but concentrated on energyBear in mind that energy use and emissions are not necessarily relatedEnergy is not a proxy for emissions 12. Facebook Photo http://www.facebook.com/album.php?id=193287527693&aid=18302612Saturday 1 December 12A practical example of this is...Prineville siteOpen Compute - open sourced the design of DC & hardware! 13. EnergyAs of the end of Q3 2011, the Prineville data centerhad a power usage effectiveness (PUE)of 1.08...much lower than the industry standard of 1.5.Facebooks energy consumption per unit of computingpower has declined by 38%http://opencompute.org/about/energy-efficiency/13Saturday 1 December 12 14. Emissionshttp://www.pacificorp.com/es/mining.html 14Saturday 1 December 1258% of its energy from coal12% from gas=> over 70% from fossil fuel directly.22.5% is purchased from other suppliers so could also be fossil fuel. 15. Dublin http://www.datacenterknowledge.com/archives/2011/08/07/lightning-in-dublin-knocks-amazon-microsoft-data-centers-offline/15Saturday 1 December 12MicrosoftAmazonGoogleIBMSunGardDigital Realty TrustAll have signicant DCs in Dublin 16. Emissions Ireland sources 84% of electricity from fossil fuelshttp://www.eirgrid.com/operations/systemperformancedata/electricitystatistics/16Saturday 1 December 12 17. EmissionsUK sources >90% of its electricity from fossil fuelshttps://restats.decc.gov.uk/cms/national-renewables-statistics/17Saturday 1 December 12Renewables contribution to UK electricity generation was 9.4% in 2011 18. Emissionshttp://www.pacificorp.com/es/mining.html 18Saturday 1 December 12The carbon intensity of a data centers electricity is more important than its efficiency! 19. Cloud providers19Saturday 1 December 12Partial list of cloud companies 20. Clean cloud providers20Saturday 1 December 12Rackspaces UK data center runs on 100% renewable powerGoogle have large renewable investments and their operations are carbon neutral 21. Clean cloud providers21Saturday 1 December 12Greenqloud are based in Iceland where elec is 100% renewable 22. Clean cloud providers http://aws.amazon.com/about-aws/sustainable-energy/22Saturday 1 December 12Amazon claim 0 carbon for two of their regions 23. Clean cloud providers https://twitter.com/jeffbarr/status/251306461836222464 23Saturday 1 December 12 but demur when asked to back up the claimHow can we verify it is true?*Sound of crickets chirping* 24. ProblemData?24Saturday 1 December 12 25. Cloud emissions data25Saturday 1 December 12Partial list of cloud companies 26. Cloud emissions data providers http://www.sapsustainabilityreport.com/greenhouse-gas-footprint 26Saturday 1 December 12This is as granular as the data gets! 27. Cloud emissions data providers http://www.salesforce.com/company/sustainability/savings.jsp 27Saturday 1 December 12Completely inaccurate depending on where in EU on premise is being hostedIf hosted in France or Spain with low carbon intensity - move to Salesforce could increase emissionsWothout Salesforce emissions data, how do we know? 28. Cloud emissions data providershttp://www.salesforce.com/company/sustainability/impact.jsp 28Saturday 1 December 12Reports 2 weeks lateGives data for carbon saved, not carbon emitted 29. Cloud emissions data providers http://my.greenqloud.com 29Saturday 1 December 12Also publishing CO2 savings, as opposed to emissions 30. Why dont they?Photo http://www.ickr.com/photos/pahudson/7742561802/ 30Saturday 1 December 12Competitive intelligence 31. Why dont they? Photo http://www.ickr.com/photos/nathanmarciniak/2207977707/ 31Saturday 1 December 12Hide their emissions 32. Why dont they?http://www.ickr.com/photos/jwgreen/340528570/ 32Saturday 1 December 12Lack of reporting standards 33. OutcomeIf you cant measure it, youcant manage it 33Saturday 1 December 12Lack of focus on emissions => increased emissions 34. ReminderA quick recap of 2012 so far...34Saturday 1 December 12 35. Recap 35Saturday 1 December 12In the third quarter alone, crop produc2on dropped $12 billion due to this summers severe heat and drought. Drop in US farm inventories was so sharp in the last quarter that it wiped 0.2% o of U.S. GDP in the latest revision.In Texas, the drought has killed more than 300 million trees. Nearly 98% of Nebraska is in extreme to excep2onal drought 3 months ago, none of it was!hSp://thinkprogress.org/climate/2012/09/30/929381/epic-dust-bowl-of-2012-con2nues/ 36. Recap http://www.reuters.com/article/2012/06/27/us-usa-wildres-idUSBRE85L1DD20120627http://www.bbc.co.uk/news/world-europe-19433715 36Saturday 1 December 12One of the worst wildre seasons on recordWildres in US and EU 37. Recap http://edition.cnn.com/2012/09/29/world/asia/pakistan-oods/index.htmlhttp://www.bbc.co.uk/news/world-europe-1976762737Saturday 1 December 12Serious oods 38. Recap http://phys.org/news/2012-11-sea-levels-faster-ipcc.html 38Saturday 1 December 12Sea-levels rising 60% faster than IPCC projections28 November in journal Environmental Research Lettersrate of 3.2mm/year compared to 2mm/year in IPCC report 39. Recaphttp://www.reuters.com/article/2012/07/02/us-usa-weather-records-idUSBRE8611EL20120702 39Saturday 1 December 12From June 25th - July 1st 2012 in US 2,171 US records broken or matchedIn June 2012 that number is 3,215 40. Recaphttp://nsidc.org/arcticseaicenews/2012/09/arctic-sea-ice-extent-settles-at-record-seasonal-minimum/40Saturday 1 December 12Huge issues of ice loss in the arctic 41. Recap http://nsidc.org/arcticseaicenews/2012/09/arctic-sea-ice-extent-settles-at-record-seasonal-minimum/41Saturday 1 December 12Lack of focus on emissions => increased emissions 42. Recap http://nsidc.org/arcticseaicenews/2012/09/arctic-sea-ice-extent-settles-at-record-seasonal-minimum/42Saturday 1 December 12Minimum was 760,000 square kilometers (293,000 square miles) below previous record minimum extentin the satellite record, which occurred on September 18, 2007. This is an area about the size of the stateof Texas.3.29 million square kilometers (1.27 million square miles) below the 1979 to 2000 average minimum,representing an area nearly twice the size of the state of Alaska18% below 2007 and 49% below the 1979 to 2000 average 43. Recaphttp://www.youtube.com/watch?v=YegdEOSQotE 43Saturday 1 December 12Thats not to mention the issue of arctic methane - what its effects will be are, as yet, unknown (but theywont be good!) 44. Recap http://www.unep.org/newscentre/Default.aspx?DocumentID=2698&ArticleID=9338&l=en 44Saturday 1 December 12Not factored into emissions accounting or climate models before nowCan lead to infrastructure failureclimate projections indicate substantial loss of permafrost by 2100Positive feedback 45. Cloud? Cloud computings emissions dont directly cause all theseissues.But they do play a significant part. 45Saturday 1 December 12 46. Solution? Open Source46Saturday 1 December 12Heres where we can help 47. Solution?47Saturday 1 December 12 48. Solution? http://www.ickr.com/photos/fabricio/3549693646/ 48Saturday 1 December 12Why write patches foropen source cloud platforms? 49. Solution?http://www.ickr.com/photos/dixieroadrash/3769522479/49Saturday 1 December 12Get the update accepted back into the core 50. Solution? http://www.amee.com/products/50Saturday 1 December 12Companies like AMEE already provide APIs for this kind of info 51. Solution?http://www.eucalyptus.com/about/customers51Saturday 1 December 12And thus distributed with next update 52. Solution?http://www.cloudstack.org/users.html52Saturday 1 December 12And thus distributed with next update 53. Solution?http://www.openstack.org/foundation/companies/ 53Saturday 1 December 12And thus distributed with next update 54. btwhttps://www.mastodonc.com/dashboard 54Saturday 1 December 12The Mastodon C dashboard gives stats on emissions from various cloud providers - in case youreinterested in keeping your cloud emissions down.Lot of it is guestimated data - need real data. 55. Carbon http://www.pwc.com/gx/en/sustainability/publications/low-carbon-economy-index/index.jhtml 55Saturday 1 December 12PwC - largest of the "Big Four" accountancy firms2012 carbon report found CO2 emissions reductions of 0.8% from 2000-2011To stop Global Warming exceeding 2CNeed to reduce CO2 emissions by 5.1% every year until 2050 56. Good News http://www.ickr.com/photos/traftery/7202866726/ 56Saturday 1 December 12Jim Hagemann Snabe - co-CEO of SAPWants SAP to be a leader in this space 57. Good News http://solidre.com/fueled-by-solidre/cloudsigma/ 57Saturday 1 December 12Robert Jenkins, CEO of CloudSigma (Swiss based Carbon Neutral cloud co.)Getting ready to implement this 58. Good Newshttp://my.greenqloud.com58Saturday 1 December 12GreenQloud are going to contribute their code to CloudStack in Q2 next year 59. ConclusionAdding emissions metrics & reporting tocloud computing will help reduce emissions. Question is - is anyone up for it? 59Saturday 1 December 12 60. Thanks! Contact information: Tom Raftery Principal Analyst, Energy & Sustainability, RedMonk Tom@redmonk.com, GreenMonk.net,Twitter.com/tomraftery +34 677 695 468 60Saturday 1 December 12