hpc in thailand€¦ · universities and the national science and technology ... fs1 fs2 fs3 fs4 4...
TRANSCRIPT
HPC in Thailand
Putchong Uthayopas, Ph.D
Acting Vice President for Information,
Kasetsart University Bangkok, Thailand
First Generation: The dawn of HPC• 1994 NECTEC put Thailand's first vectorized multiprocessor
supercomputer, the Cray EL98
• Computational Chemistry
• Computational Physics
• 1996 Thai Meteorological Department (TMD) use IBMSP
• NWP (Numerical Weather Prediction) project
• 1997 the Computational Science and Engineering Program Consortium was established as a cooperative effort among Thai universities and the National Science and Technology Development Agency (NSTDA).
• 1999 Kasetsart University built 72 nodes Beowulf Cluster “Pirun”
• Academic and research applications
• Start of the booming of Beowulf Cluster in Thailand
• 2001 Thailand transition into Grid Era by the start of “ThaiGrid” Project between KMITNB and KU later many universities join : AIT, KMUTT, Burapa, Chula
Second Generation: Grid Computing
ThaiGrid projectStart
2000
Linking KMITNB-KU
2001 2002 2003 2004 2005
Virtual Screening On Grid
National Grid project approved
National Grid project started
ThaiGrid has 5 members
ThaiGrid link more than 100 processors from 5 universities
PRAGMA participation byNECTEC/KU
Forming National Grid project proposal ThaiGrid Join
SCGlobal2004ThaiGrid forming the first function globus grid of 14 universities
2006
ThaiGrid reach 1000 processors core
2007 2008 2009
Thailand has a First SC exhibit at RENO SC2007
SILA Cluster (TERAFLOP) on line
Tera Server: The First Teraflop machine went on-line given 2.5 Rmax and 4.5 Rpeak on HPL benchmark
Thai National grid Center start working in temporary office
ThaiGrid has 22 members
10TF cluster at BIOTEC online
Edge Switch 1Gbps Ethernet
FESunyata
FEAraya
WinHPC(FE)
TERA(FE)
SPARE1(FE)
SPARE2(FE)
FS1 FS2 FS3 FS4
4 nodes 4 nodes64
nodes
96 nodes +
16 sparenodes
200 Ports Gigabit Ethernet switch
Storage Tier 5TB Lustre FS
Anatta(FE)
15nodes
KU Fiber Backbone(1Gbps Fiber)
2.5Gbps to UninetStorage 48 TB
1 Gbps Ethernet/Fiber
Automotive Grid
Animation Grid
Financial Grid
Argricultural Grid
Environmental Grid
Friendship Grid is the Lasting one
Third Generation: Uninet2 and National E-science Infrastructure Consortium
National Education Network
• Thai Government approved Stimulus Package (SP2) in 2009• 116 M US$ to Integrate all Education Network to National Education Network
(NEdNet)
• This project belong to Uninet a government agency under the Ministry of Education.
• Road Map
• Fiber optic to accommodate the core network (Backbone) that can support bandwidth 20 - 50 Gbps.
• Interconnecting educational institutes on fiber optic with the following target• 293 Universities (1,000 Mbps each of the N x 1,000 Mbps).
• 415 Vocational Education (100 - 1,000 Mbps)
• 3,000 schools (10 - 100 Mbps).
National Research and Education Network : NREN
• Optical Network Backbone with DWDM
@ N x 10 Gbps
• Fiber to the University @ Gbps
(NxGbps)
• Fiber to the school @ 100-1000 Mbps
• Public libraries @ 100-10000 Mbps
Members Number of Members
Universities/Institutes 194
Vocational Education 415
Educational Service Area 185
Basic Education (schools) 9 749
Municipality Public Library 151
Research and other Education 51
Total 10,745
BK_NIX CAT_NIX CAT_IIG JGN Asi@connect
ThaiRENUniNet/NEdNet
ThaiSARN
20G 40G 100G 1 Gbps 1.6 Gbps
1G
1G1G
MOE_Net
:National Internet Exchanged
:International Internet Gateway
:Research and Education Network
10G
Internet2
1G
National Research and Education NetworkNetwork Peering
Examples of Network Services, Applications, and Project Collaborations
• Project E-Science
• IPv4/IPv6
• eduroam
• E-learning/Tele-education
• Tele-medicine
• Live video stream transmission
• Earth observation data transfer
• Cloud Education
• Future Internet technology
• Founded in 2011 • 8 member institutes• Objective
• Develop the computing, data storage, and fundamental data set as a sustainable infrastructure to support research in Thailand
• Project Area• High Energy Physics• Computational science and engineering• Computer science and engineering • Water resources• Energy and environmental• Climate change
• Collaboration with CERN• High Energy Physics – ALICE project
• part of European Data Grid
4,100 CPU core; 1,254 TBsupport 3 application areas
SUT656 C, 150 TB
TINT80 C, 3.6 TB
KMUTT224 C, 30 TB
HAII896 C, 112 TB
CU340 C,106 TB
NARIT540 C, 100 TB
NSTDA688 C, 660 TB
SLRI596 C, 80 TB
EGA80 C, 13 TB
960 Core
200 TB, 15MB(2018)
High Energy Particle Physic
Computational Science & Engineering
Computer Science & Engineering
e-Science National e-Science Infrastructure Consortium (2011-present)
1.32.5
4.15.3
8.4 8.9
14.8
2011 2012 2013 2014 2015 2016 2017Million Hours Expon. (Million Hours)
Users 31 organiations
Usage statisticsProjects
246
Average Utilization86%
Users25164 Researcher
187 Students
e-Science National e-Science Infrastructure Consortium (2011-present)
Hydro and Agro Informatics Institute (HAII)
Vision: Developing and applying S&T knowledge for agricultural and water resource management to cope with critical climate change
Ministry of Science and Technology
Missions: 1. Developing and applying S&T for agricultural and water resource management2. R&D in water management technology and system3. Promoting collaboration on S&T research and development4. Expanding services and disseminating the R&D outcomes
2012 to present
National Hydroinformaticsand Climate Data Center (NHC)
www.thaiwater.net
1999 20032004 2006 2007
2008-092010-11
1 TB +1 TB +1 TB +4 TB +8 TB +12TB
+15TB
+24TB
+10TB
HAII’s High Performance Computing
Over 1000 CPU cores; 2088 GPU cores; 100 VMs; 300 TB storage
Server farms, clustering-GRID environment
Current Capacity
2014-16
+38TB
+72TB
Applications of HAII’s HPC
http://thaiwater.net/v3/wrfroms/rain_forecast_pre/tab1/image1
http://thaiwater.net/v3/wrf/swan
Coupled Model (WRF-ROMS)
Rainfall forecast
Wind forecast
Pressure forecastWave Height
WRF: Weather Research and Forecasting ROMS: Regional Ocean Modeling System
SWAN: Simulating WAve Near shore
SWAN
22
2. HPC TMD’s System.
System computer types-HPE Apollo 2000 series
Proliant XL170r Gen 9
- 192 Nodes (compute) (3 types)
- Performance : 228 TF
-Main memory : 128 GiB per node
-High-speed storage: 3PB
Operating system : Linux
Model : WRF-ARW
Thai Meteorological Department (TMD) have been running the Weather Research and
Forecasting (WRF) Model version 3.8.1 was made fully operational in October 2017. Now,
Weather Research and Forecast (WRF) Model is running and generate daily output on Website
and utilize daily weather forecast and special weather forecast. Necessary arrangements for the
physical parameterization and sensitivity testing on the performance of the Model need to carry
out. TMD run WRF with data assimilation technique by Grid point Statistical Interpolation System
(GSI) 3DVAR Assimilation, and future plan to run 4DVAR and Hybrid
(Forecasting System (HPC + Model))Forecasting Process
HPC
Storage (3PB)
Computer graphics
High speed interconnection
NCEP/GTS/FTP
SYNOP, SHIP, BUOY,…
TEMP, PILOT, WIND-
PROFILER
Aircraft (AMDAR, AIREP)
Satellite (ATOVS, AIRS, IASI,
SSMI, HIMAWARI. Etc.)
Decoding Pre/Post Process Sever
API Decoded Files (OOB)
Observation data Preprocessing (NCEP)
VAR: FDDA
SURF: Surface A nalysis
WRF
Local (WRF)
Regional Model (WRF)
Post-
preprocessing/Application models User
internet
HPC system for simulation WRF Model
GSI
HPC-WRF
OPS: QC Test
Data Assimilation(3/4 DVAR)
TMD Weather Forecast API
The Fourth Generation?
• Expansion of Traditional HPC
• CFD, Computational Chemistry, Physics, Biology
• Big Data
• Banking, Retail, Telco
• AI and machine learning
• Advanced data analytics
• Specialized GPU system for deep learning
• NSTDA Platform is a new exciting project
NSTDA Computing Infrastructure Roadmap
InfraDev.
Computing Infrastructure Development(1994-2011)
e-Science National e-Science Infrastructure Consortium (2011-present)
NSTDACI
NSTDA Computing Infrastructure(2018-2020)
CCSCenter for Computational Science(Future)
EECi EECi-ARIPOLIS Center for Computing Innovation
• Nanomaterials
• Catalysis and adsorbent
• Biofuel from biomass
• Carbon-based materials
• Engineering testing
• Industrial design
• Computer-aided engineering
• Salinity intrusion management
• Computer vision
• Deep learning for FR & NLP
• Precision medicine
• Biobank
• Bioinformatics
• Plant genome
BIOTEC NECTEC
NANOTECMTEC
Nanomaterials Design and SimulationsNanoscale Simulation Laboratory (NANOTEC) aims to design and predict the properties of functional nanomaterials, and to create a unique understanding of the physicochemical processes at nanoscale regime by using:
first principle computational chemistry molecular dynamics simulations
computational method development mathematical modeling based on continuum approach
Impact
HPC for Computer-Aided Engineering (CAE)
Finite element analysis (FEA) of dynamic structural problems Computational fluid dynamics (CFD) of fluid flow problems
Contact: Dr. Somboon Otarawanna, MTEC
The Wheel Impact Test O2 Gas Distribution in A Chemical Reaction Tank
NECTEC State-of-the-Art NLP
Optical
Character Recognition
Technology Readiness
Machine
Translation
Exis
ting D
ata
Siz
e Speech
Recognition
Sentiment
Analysis
Text-to-
speech SynthesisQuestion
Answering
Fundamental
Text Processing
denotes the technology advanced by Deep Learning
Artificial Intelligence & Big Data Technologies
Computer Vision
ComputerVision
CCTV image analytics• Vehicle classification• Vehicle tracking• Surveillance
Particle analysis• Rice breed classification• Car park monitoring• Silk egg monitoring• Plant-hopper detection
Contact: Dr. Chai Wutiwiwatchai, NECTEC
National BioBank
Thailand’s Biodiversity: 10% of the world
How to maintain rich biodiversity in Thailand?
National Biobank for conservation, research, and utilization
Finite element analysis
Computational fluid dynamics
Molecular dynamics
Bioinformatics
Water resource simulations
Natural language processing
Density functional theory
AI & data analytics
Stencil & finite difference method
N-body problem
Sparse matrix
I/O & memory intensive computing
Dense matrix operations
Tensor computation
Graph computing
Compute-Intensive
nodes
Memory & IO intensive
nodes
GPGPU nodes
User Applications
Computing Characteristics
NSTDA Computing Infrastructure
• Genome Database Service• Data Analytics Platform as a Service• AI Research : Deep Learning,
Language Processing, Behavior Analysis
Computing Platform for Data Analytics (DA)Data Driven and Statistical Analysis
• Analytics of National Genome• Computational Fluid Dynamics• Quantum chemistry simulation for adsorbent material
design• Catalytic mechanism & design for biomass conversion
High Performance Computing (HPC)
Computational Model and Scientific Computing
NSTDACI
NSTDA Computing Infrastructure(2018-2020)
Link with National e-Science Infrastructure Consortium that NSTDA supported
National HPC infrastructure
Center for Computational Scinece
National Research Facility
e-Science
Open serviceFocus Area: Computational Science and Data Analytic
CCSCenter for Computational Science(Future)
Present Solution Future Benefit
Enabling Platform for Smart Thailand
Free graphic: www.freepik.com/free-vector/city-buildings-in-flat-design_764231.htm'>Designed by Freepik</a>
ARIPOLIS
Smart Factory
Smart Farm
Smart Living
Center for System &
Service Innovation
Center for Sensing
Innovation
Center for Computing Innovation
System
Inte
grators
Industry 2.0
Traditional Farming
Unsustainable-citiesand-communities
Productive Growth
Inclusive Growth
Green Growth
EECi EECi-ARIPOLIS Center for Computing Innovation
Summary
• HPC in Thailand is increasingly more active
• Driven by• New demand on data science , AI, IOT• More government spending in R&D
• Thailand 4.0• EEC/EECi
• Main collaboration platform• National e-science infrastructure consortium• Uninet Wunca conference• PRAGMA consortium (KU/TU/MU)
• Expected to see more HPC activities, more people• Team from Kasetsart University , Thailand is selected for
student cluster competition in ISC2018 and ASC2018
Reference
1. Panjai Tantasanawong, NREN update, The 3rd ASI@Connect Project Meeting/ March 26 2018,Matrix Building, Biopolis, Singapore
2. Somkuan Tonjan, “Development of Weather Forecasting System with High Performance Computing (Phase 1) “, Numerical Weather Prediction Sub-Division,Weather forecast Bureau , Thai Meteorological Department, Thailand (TMD)
3. Chalee Vorakulpipat, Thailand National E-science Consortium ,, National Electronics and Computer Technology Center (NECTEC)
4. Piyawut Srichaikul, NSTDA and Thailand HPC infrastructure, NAC2018
5. Manaschai Kunaseth, NSTDA HPC & DA Research, Development, and Engineering, NAC2018.
6. Kanoksri Sarinnapakorn,HAII Infrastructure and Project , HAII, Thailand
Thank you