unix in the cloud — ignorance, stagnation, obsolescence
DESCRIPTION
A partial video is available at http://www.youtube.com/watch?v=9XhGEWg5HQkTRANSCRIPT
![Page 1: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/1.jpg)
Unix in the CloudIgnorance, Stagnation,
Obsolescence
![Page 2: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/2.jpg)
Synopsis▪ cloud in the broad sense of ideology
▪ not quite about running BSD on EC2
▪ very limited to skills and experience of yourshumbly
![Page 3: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/3.jpg)
Multi-core▪ installation?
▪ configuration management?
▪ load balancing?
![Page 4: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/4.jpg)
Multi-node▪ installation?
▪ configuration management?
▪ load balancing?
▪ why multi-node?
![Page 5: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/5.jpg)
Large ComputingNeeds
▪ Facebook, Google, ...
▪ more than any OS can provide
![Page 6: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/6.jpg)
Happy Hardware Vendor LawThe amount of nodes needed to solve a given task doubles every now and again.
![Page 7: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/7.jpg)
OS Scalability Limit▪ 1 node only
▪ multi-socket and stacks approaching NUMA
▪ E25K, z10, etc — fail for most purposes
![Page 8: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/8.jpg)
Operating System — ?▪ traditional definition no more relevant
▪ the notion itself on the brink of obsolescence
▪ field heavily eroded by current distributed apps
![Page 9: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/9.jpg)
DistributedApplications
▪ forced to be an OS unto themselves
▪ huge overlap
▪ huge opportunity for sharing and consolidation
![Page 10: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/10.jpg)
Anti-Patterns▪ virtualization
▪ chefs and puppets
▪ thick abstraction
![Page 11: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/11.jpg)
Attempts▪ z/OS
▪ Plan 9, Inferno
▪ Clustrx, E1, DYSEAC, ...
▪ OpenStack (~~)
![Page 12: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/12.jpg)
Species Survival PlanFreeze the bodies and leave them for future generations to fix.
![Page 13: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/13.jpg)
Don't Panic:Incremental
▪ perfection v. done
▪ still a decade or more till a good AI
▪ no practical need for POSIX over a cloud
![Page 14: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/14.jpg)
Mindful Approach▪ immediate practicality
▪ long-term perspective
▪ sustained, integrally rich effect
![Page 15: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/15.jpg)
Operating System▪ major abstraction repository
▪ overlapping code distillery
▪ pre-production architecture research
![Page 16: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/16.jpg)
Increments
![Page 17: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/17.jpg)
Machine GeneratedData
▪ logs, error messages, status monitors
▪ meant for humans... no more
▪ rethinking for better aggregation and analysis
![Page 18: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/18.jpg)
Identity andAuthentication
▪ YP, LDAP outdated and poorly supported
▪ no distributed model
▪ passwd in git as a first stab
![Page 19: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/19.jpg)
Remote Procedure Call▪ ssh losing relevance, HPN or not
▪ all-mighty agent daemon worse than rsh
▪ capabilities, RBAC, WoT
![Page 20: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/20.jpg)
Hardware Failures▪ no culture for low-level fault-tolerance
▪ watchdogd as state-of-the-art self-healing
▪ focus on self-diagnostics: disk error counters, etc
![Page 21: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/21.jpg)
DistributedConfiguration
▪ current anti-patterns worsen the problem
▪ role-aware configuration
▪ / in git as a second stab
![Page 22: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/22.jpg)
Storage▪ intra-node redundancy irrelevant
▪ no appropriate local multi-disk FS
▪ no fast path for data exchange
▪ nginx + curl + dispatcher
![Page 23: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/23.jpg)
Error Handling▪ cf MGD and hardware failures
▪ software is 10x more prone to failures
▪ serious problem at scale
![Page 24: Unix in the Cloud — Ignorance, Stagnation, Obsolescence](https://reader036.vdocuments.net/reader036/viewer/2022081511/557f0e56d8b42ac0728b50bf/html5/thumbnails/24.jpg)
☺