Storage Reimagined..

Data..

some say it’s the new oil..

New era of data storage options“It wasn’t very long ago that even the idea of a Petabyte of data storage was the stuff of science fiction..”

•Mas long term storage was done on tape– First we had drums– Next we had reel to reel tape– Then came high density tape cartridges

•The last 2x decades saw us jump from– Megabytes– Gigabytes– Terabytes– Petabytes, and we are planning for Exabytes !!

•One PB of data = approx. 1,000 LTO 5 tapes

Ultra scale storage is now normal

“Just how many zeros are there in a Petabyte..”

•Modern File-systems of seemingly infinite Scale

Byte (B) = 1 (8x zeros or ones)

Kilobyte (KB) = 1,000 (10^3)

Megabyte (MB) = 1,000,000 (10^6)

Gigabyte (GB) = 1,000,000,000 ( 10^9)

Terabyte (TB) = 1,000,000,000,000 (10^12)

Petabyte (PB) = 1,000,000,000,000,000 (10^15)

Exabyte (EB) = 1,000,000,000,000,000,000 (10^18)

There’s only approx. 10^78 atoms in the Universe !!

Aviation..

creating data out of thin air..

Creating data out of thin air 1/2

“Today’s aircraft are literally creating data out of thin air, and they are doing it by the Petabyte, every single day..”

•Boeing 787 Dreamliner– 4,000 sensors p/aircraft– 500 GB p/flight

• FAA says reboot them once a month !!

•87,400 domestic flights p/day in USA– 787 = 43.5 PB of data p/day

Creating data out of thin air 2/2

“Introducing the IoT to aircraft with sensor counts in the tens of thousands, created a Cambrian* event for data..”

•Airbus A330-1000– 10,000 sensors in each wing !!– 2.5 TB p/flight

• Yes that’s two and a half Terabytes !!

•87,400 domestic flights p/day in USA– A330-1000 = 220 PB of data p/day !!

* The Cambrian period lasted from about 570 to 510 million years ago

Automotive..

driving data off the charts..

How much data can one car make“If you thought aircraft creating Terabytes per flight was scary, wait till you see what autonomous cars can do..”

•One autonomous car will = 4 PB p/day !!– Radar, Sonar, LiDAR– Wifi, 3G, 4G, Bluetooth– Cameras, GPS, Logging

•4 x PB per day?– 28 PB p/week– 120 PB p/month– 360 PB p/quarter & 720 PB p/6mths!!– 1.45 Exabyte p/year !?

That’s approx. the same amount of data per day asthree thousand people watching Netfix for 24 hours..

What do do?

storing today’s volume & types of data at the current rate of growth needs a new filesystem..

Modern data needs a modern FS“The definition of insanity is to continue to do the same thing over and over, and expect a different outcome..”

Today’s businesses need new storage options:•Start small & scale over time

•Low cost of entry

•Run on commodity hardware

•Linear growth cost model

•Fault tolerant of hardware failure

•Built in data protection & redundancy

•Ideally open source with open API’s

•Suitable for Enterprise, Cloud, Big Data & the IoT

Cloud, Big Data & IoT never sleep

“If there is one thing we can bank on, it’s that the Cloud, Big Data, and the Internet of Things will never sleep..”•The Internet, Telco & Industrial networks•Content delivery & Streaming Networks•Smart Apps & Social Media / Social Networks•Advertising, Tracking & Media Metadata•Anti-Spam & Cyber Security, Data Breaches•Blockchain, Fraud detection, AML & KYC•Content Personalization, Celebrity Experience•Health, Aged Care & Life Monitoring•The “always on” FitBit generation•In-car navigation, Roads & Transport Hubs•Emergency Monitoring & Warning Systems•Power, Water, Public Utilities•Smart Cities & Smart Infrastructure

Filesystems..

it’s now time to think differently..