zops intelligent platform
TRANSCRIPT
ZOPS Intelligent Platform
Gökhan Boranalp, http://www.zetaops.iohttps://tr.linkedin.com/in/gokhanboranalp @[email protected] Haziran 2016
* This project in incubation stage and we are currently working on it. The features mentioned in this presentation shouldn’t be taken as ready for production use.
Contents
●Problem●Solution●Underlying magic/technology●Status●Business model●Team●Projects
Problem definition
● Business applications should “merge” with data science tools
● Sooner or later, IOT platforms should be “controlled” by business layer of system.
● Good old “expert systems” becoming smart systems. Because of this, every system “will” be adopted to AI in near future.
● Data related apps should be distributed and cloud operated, period!
ZOPS Intelligent Platform
ZOPS Intelligent Platform
● ZOPS is a Python based, Open Source Intelligent microservice Platform to manage, “BPMN 2 business processes (workflows)”, “business data” and “IOT generated data” with data analysis and AI capabilities.
● ZOPS can easily connected an existing IOT platform to collect data.
● ZOPS also operates with or without IOT part in vertical sectors.
● ZOPS is horizontally distributed platform, designed for cloud (Openstack, GCE, Amazon etc.) environments.
● No need for additional services (Amazon SQS, Elastic Cloud etc.)
● No cloud vendor lock-in with ZOPS.
Why another platform?● Data science should be done with live data. ● Machine learning results should reflect back to system
behaviour.● Neural nets should be natural part of system.● Resource utilization is a must in cloud envs.● Traditional RDBMS for business, NoSQL power to
collect IOT data is an obligation.● Release often, release early with strong dynamically
typed Python.● The first and only platform, developed with Python with
these components.
➔Designed for millions of users
Underlying magic/technology
ZOPS Technology Stack
Underlying magic/technology
● Zengine, Python based, advanced BPMN workflow engine.
● Pyoko, Riak NoSQL ORM.● Zato ESB.● Real time stream processing with directly
connected data, Apache Spark.● Basho Riak, Riak TS, Riak S2 for data storage● Tornado async web server● Cloud centric system architecture.
Status
● Finalize Spark integration● Redesign of metric collector● Mesos integration for Spark jobs.●Automate Chef books●Implementation of SQL Alchemy
Business Model
Open source business model is on the rise!
● SAAS, PAAS deployment options.
● Dual licensing, ● OSS with Apache 2 license ● Enterprise with BSD license
Team
● 8 developers● 1 project manager● 4 students working half time for project● 2 designers for UI design and coding● 2 remote coders● 4 advisers
Resourceshttp://sandhill.com/article/2017-will-be-the-launchpad-for-iot-edge-analytics/http://basho.com/resources/http://basho.com/products/riak-ts/http://www.slideshare.net/maxdemarzi/introduction-to-graph-databases-12735789https://github.com/thinkaurelius/titan/wiki/Downloadshttps://docs.basho.com/riak/1.2.1/references/appendices/comparisons/Riak-Compared-to-Neo4j/ https://www.quora.com/What-are-some-use-cases-for-graph-databaseshttp://stackoverflow.com/questions/19570654/do-graph-databases-deprecate-relational-databaseshttps://pythonconquerstheuniverse.wordpress.com/2009/10/03/python-java-a-side-by-side-comparison/http://paulbuchheit.blogspot.com/2007/05/amazingly-bad-apis.html https://archive.org/details/SeanKellyRecoveryfromAddiction http://twistedmatrix.com/users/glyph/rant/python-vs-java.html https://www.python.org/doc/essays/comparisons/https://smartbear.com/learn/api-design/what-are-microservices/http://cloudacademy.com/blog/microservices-architecture-challenge-advantage-drawback/http://eugenedvorkin.com/seven-micro-services-architecture-advantages/http://martinfowler.com/articles/microservice-trade-offs.html http://www.workflowpatterns.com/https://en.wikipedia.org/wiki/Workflowhttps://www.quora.com/Is-it-true-that-Apache-spark-is-10-times-faster-than-Hadoophttps://postscapes.com/internet-of-things-market-size/
Resourceshttp://basho.com/posts/technical/riak-vs-cassandra/https://www.quora.com/What-are-the-differences-between-Cassandra-and-Riak http://arstechnica.com/information-technology/2016/04/power-tools-sorting-through-the-crowded-specialized-database-toolbox/ https://www.iotivity.org/ http://basho.com/about/customers/http://platformio.org/https://www.kaaproject.org/http://www.postscapes.com/internet-of-things-award/open-source/http://www.riot-os.org/#featureshttp://kinoma.com/https://workflow.wordpress.com/2008/11/24/the-size-of-the-bpm-market/ http://www.mckinsey.com/industries/high-tech/our-insights/the-internet-of-things-sizing-up-the-opportunityhttp://www.forbes.com/sites/gilpress/2014/08/22/internet-of-things-by-the-numbers-market-estimates-and-forecasts/#26e08c582dc9http://www.clustrix.com/resources/white-papers/why-traditional-sql-databases-fail-to-scale-writes-reads-effectively/ http://readwrite.com/2014/11/28/internet-of-things-nosql-data/https://wiki.python.org/moin/Why%20is%20Python%20a%20dynamic%20language%20and%20also%20a%20strongly%20typed%20language http://stackoverflow.com/questions/11328920/is-python-strongly-typed https://en.wikipedia.org/wiki/Strong_and_weak_typing https://pythonconquerstheuniverse.wordpress.com/2009/10/03/python-java-a-side-by-side-comparison/ https://stackshare.io/zetaops/zetaops