Upload File

the evolution of speedycloud resources scheduling system

  • Home
  • Technology
  • The Evolution of SpeedyCloud Resources Scheduling System
12
北北北北北北北北北北北北 www.speedycloud.cn Beijing SpeedyCloud Technology Co., Ltd., www.speedycloud.cn 2015.8 @ Beijing WELCOME The Evolution of SpeedyCloud Resources Scheduling System

Upload: speedycloud

Post on 11-Jan-2017

164 views

Category:

Technology


2 download

Report

TRANSCRIPT

Page 1: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cn

Beijing SpeedyCloud Technology Co., Ltd., www.speedycloud.cn 2015.8 @

Beijing

WELCOME

The Evolution of SpeedyCloud Resources

Scheduling System

Page 2: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cn

What is a Scheduling System

Page 3: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cn

What does Scheduling System of Cloud Platform usually do?

Page 4: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cn

CloudServer

CloudStorage

SDNNetwork Firewall Other

ServicesLoadBalancing

CloudCDN

Page 5: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cn

Page 6: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cn

How?

Roman wasn’t built in one day

Let’s find out how it evolves from scratch!

Page 7: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cnScenario 1:

Description:Provision Cloud server for client using Web

Context:1. Have developers dedicated for

presentation layer2. Only develop back-end

business logics3. Parameters validation and

exceptions omitted

Web

DB Physical Server

1

23

45

6

Python + Django + ShellKVMMySQL

Page 8: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cn

Scenario 2:

Description:Long time waiting when client provisions several cloud servers

Solution: Change sequential allocation to multi-thread

Page 9: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cnScenario 3:

Description:Multi datacenters deployed to satisfy increasing customers; long time waiting occurred till timeout, but PDB can’t be used to debug

Solution:Change to multi-process from multi-thread

Web

DB Physical Server

Web

DB

Datacenter A

Datacenter B

Datacenter C

Datacenter D

Datacenter E

Page 10: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cnScenario 4:

Description:Failure occurred due to network jittering from some datacenters to control center, and control center can’t be notified even if cloud servers successfully were provisioned.Solution:

1. Change to BGP datacenter2. Message Queue introduced to

solve the timeout

Web

DB

Datacenter A

Datacenter B

Datacenter C

Datacenter D

Datacenter E

Datacenter B

Datacenter C

Datacenter D

Datacenter E

Web

DB

Datacenter A

MQ

Worker

Page 11: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cnScenario 5:

Description:1. More devices upgrades and

maintenances needed.2. Client resource application

need to be handled even when upgrading web front-end.

Datacenter B

Datacenter C

Datacenter D

Datacenter E

Web

DB

Datacenter A

MQ

Worker

Solution:1. Live migration of host and hot

patch for OS2. Add System Halt Status3. Add Node Halt Status

Datacenter B

Datacenter C

Datacenter D

Datacenter E

Web

DB

Datacenter A

MQ

Worker

Job Tracker

1. Add System Halt Status2. Add Node Halt Status

Page 12: The Evolution of SpeedyCloud Resources Scheduling System

北京迅达云成科技有限公司 www.speedycloud.cn

Thanks!

Beijing SpeedyCloud Technology Co., Ltd.,

www.speedycloud.cn


Joint User Scheduling and Beam Selection Optimization … · Joint User Scheduling and Beam Selection Optimization for Beam-Based ... as compared with an entire current long-term-evolution

Scheduling Scheduling

LONG TERM EVOLUTION (LTE) PROTOCOL - · PDF fileLONG TERM EVOLUTION (LTE) PROTOCOL ... long term evolution (LTE) cellular communication system scheduling the user transmission on

LOOKING FOR AN EVOLUTION OF GRID SCHEDULING: META …sadjadi/Publications/... · the application level scheduling. GridBus [18] is an economy-capable Data Grid service broker for

Scheduling Algorithems First Come First Serve Scheduling Shortest Job First Scheduling Priority Scheduling Round-Robin Scheduling Multilevel Queue Scheduling

Basics of Scheduling Scheduling algorithms …soc.eurecom.fr/OS/docs/CourseOS_III_Scheduling_2.pdfBasics of Scheduling Scheduling algorithms Scheduling in Windows, Linux and Android

The CPU Scheduling CPU Scheduling

Scheduling Scheduling (cont.)

OS6-1 Chapter 6 CPU Scheduling OS6-2 Outline Basic Concepts Scheduling Criteria Scheduling Algorithms Multiple-Processor Scheduling Real-Time Scheduling

Spring, 2007 8-1 Scheduling Operations. Spring, 2007 8-2 Scheduling Problems in Operations Job Shop Scheduling. Personnel Scheduling Facilities Scheduling

Chapter 5: Process Scheduling. 5.2 Chapter 5: Process Scheduling Basic Concepts Scheduling Criteria Scheduling Algorithms Multiple-Processor Scheduling

Using Simulated Annealing and Evolution Strategy scheduling capital products with complex product structure By: Dongping SONG Supervisors: Dr. Chris Hicks

Mobile Broadband Communications - KMUTTwebstaff.kmutt.ac.th/~suwat.pat/material/IMB_Week_10.pdf · •Long-Term Evolution of 3GPP –LTE MAC Layer •Scheduling • Part III Application

Computing at Scale: Resource Scheduling Architectural Evolution …act.buaa.edu.cn/yangrenyu/talks/20140819_Tsinghua.pdf · Scheduling Architectural Evolution and Introduction to

Basics of Scheduling Scheduling algorithms Scheduling in

CPU Scheduling Basic Concepts Scheduling Criteria Scheduling Algorithms Thread Scheduling Multiple-Processor Scheduling Operating Systems Examples Algorithm

Evolution of OAI Software towards 5G NR2018.wons-conference.org/docs/knopp_5G-day5.pdf · Evolution of OAI Software towards 5G NR ... – Scheduling and transmission of paging messages

Differential Evolution: A Method for Optimization of real … · 2000-08-16 · Proj.-Nr.: 10247. Differential Evolution: A Method for Optimization of real Scheduling Problems

Elementary Scheduling Master And Scheduling

CPU Scheduling Chapter 5. CPU Scheduling Basic Concepts Scheduling Criteria Scheduling Algorithms Multiple-Processor Scheduling Thread Scheduling UNIX

Saurav Karmakar. Chapter 5: CPU Scheduling Basic Concepts Scheduling Criteria Scheduling Algorithms Thread Scheduling Multiple-Processor Scheduling

Utilizing Geometric Mean in Proportional Fair Scheduling ......Abstract—In this paper we address the challenge of multiuser scheduling in the downlink of Long Term Evolution (LTE)

Scheduling. Outline What is scheduling Why we need it Requirements of a scheduling discipline Fundamental choices Scheduling best effort connections Scheduling

Performance Analysis of Packet Scheduling Algorithms for ... · Performance Analysis of Packet Scheduling Algorithms for Long Term Evolution (L TE) A Thesis submitted to University

Ch11 IO Management and Disk Scheduling - pudn.comread.pudn.com/downloads55/ebook/189854/Slides/Ch11_IO...5 2005-11-30 Input/Output Management and Disk Scheduling (Ch11) 9 Evolution

OF SCHEDULING 1/3 Iomlllllllllll Iolllllmllsl llllllIImlllol … · 2014-09-27 · -a188 265 design evolution of a fighter training scheduling 1/3 decision support systenlu) air force

How to Design and Develop DNS System in CDN by SpeedyCloud

Chapter 5: CPU Scheduling. Basic Concepts Scheduling Criteria Scheduling Algorithms Multiple-Processor Scheduling Real-Time Scheduling Thread Scheduling

EVOLUTION OF SCHEDULING HEURISTICS FOR THE RESOURCE CONSTRAINED SCHEDULING PROBLEM · 2016. 11. 21. · One extension of the CPM model can be made by adding resource constraints which

Packet Scheduling under Imperfect Channel Conditions … · Packet Scheduling under Imperfect Channel Conditions in Long Term Evolution ... performance for practical downlink LTE

Scheduling Konzepte :CPU Scheduling

SpeedyCloud 云计算平台资源调度系统要点解析

Scheduling Algorithms - Uppsala University · ... Multi-Processor Scheduling Priority Scheduling Algorithms ... Algorithms Multi-Processor Scheduling ... Symmetric MPs (SMP) scheduling

6.1 CPU Scheduling Basic Concepts Scheduling Criteria Scheduling Algorithms Multiple-Processor Scheduling Real-Time Scheduling Algorithm Evaluation

Scheduling / Project Management Scheduling / Project