roadmap ibm i et nouveautés 7 - mini... · multi-cloud services cam public, private & hybrid...
TRANSCRIPT
IBM Systems
Roadmap IBM i et nouveautés 7.4
4Q 2019 - 1Q 2020
Benoit MAROLLEAU - Cloud Architect IBM Systems – IBM Systems Center Montpellier, France
@ : [email protected] : linkedin.com/in/benoitmarolleau : @MarolleauBenoit
https://www.ibm.com/systems/clientcenterdemonstrations
Visit my Blog - https://ibm.biz/bma-wiki
Dans cette présentation:
2
- IBM i – Roadmap de la prochaine décennie
- IBM i 7.4 - Nouveautés et quelques exemples d’utilisation
- Détail des nouvelles fonctionnalités- Availability- Security- ILE Development- Open Source- Db2 for i - New I/O Support- Automation & Cloud- Analytics
Db2
Business Continuity
& Availability Virtualization & Automation
Cloud
SecurityApplication Development
Performance
Modernization
& API
Analytics & AI
Open Source on IBM i
Roadmap
IBM i 7.4 – “Fondations Solides pour l’innovation”
3
Continuité d’activité – HA/DR• PowerHA supporte des clusters configurés en Hyperswap, automatise l’administration des user profile• IBM Db2 Mirror for i reduit le RTO à zero en fournissant de la ‘continuous availability’
Securité• Implemente les derniers standards de l’industrie , afin de securiser les données business critiques• Authority collection ajoute maintenant du controle au niveau objet (object based control)
Support du matériel POWER9
Cloud• Support des initiatives cloud IBM Cognitive Systems – IBM i dans IBM Cloud, MSPs, Private & Hybrid Cloud
Développement de Solutions• Amélioration du RPG et COBOL, afin de rendre le traitement des données plus efficace• Ameliorations des fonctions Db2, incluant des fonctions de HASH (crypto) , gestions par SQL Services etc.• Nouveaux environnements Open Source permettant le portage de Nouvelles applications sur IBM i
Connectivité• Amélioration de multiples produits se connectant depuis et vers les applications IBM i et Db2
Social• Support de Domino 10 , disponible sur IBM i
IBM Systems
………7.4
………
2014
7.2
2016
iNext
…iNext + 1
…
7.3
Technology Refreshes
IBM i Release Roadmap
4
……… ………
** All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
** Arrows indicate “ongoing status and do not imply any specific dates.
2019
Nov 15th
7.4 TR1
IBM Systems
IBM i Support Roadmap
5
** All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
** Arrows indicate “ongoing status” and do not imply any specific dates.
© 2018 IBM Corporation
IBM i System Support
Servers IBM i 7.2 IBM i 7.3 IBM i 7.4
POWER9S914, S922 (VIOS only), H922 (VIOS only), S924, H924, E980, IBM Cloud (S922, E980)
POWER8S812, S814, S822 (VIOS only), S824, E870, E870C, E880, E880C
POWER7/7+710, 720, 730, 740, 750, 760, 770, 780, 795
POWER7 BladeCenter PS700/701/702/703/704 (all VIOS only)
POWER7/7+ Flex p260/270/460 (all VIOS only)
POWER6+ 520, 550, 560, 570, JS23/43 (VIOS only)
POWER6 520, 550, 570, 595, JS12/22 (VIOS only)
http://www-01.ibm.com/support/docview.wss?uid=ssm1platformibmi
1 – no IOP or HSL support
1Current as of 2019-04-23
6
IBM Systems
IBM i 7.4 – Nouveautés et illustrations…
https://www.ibm.com/systems/clientcenterdemonstrations
Visit my Blog - https://ibm.biz/bma-wiki
IBM Systems
IBM i – Old platform☺ ?The IBM i market is highly stable with slightly more than 1.5% annual attrition.
Development on IBM i is evolvingwith 75% of respondents using open source development tools.
IBM Systems
Help Systems Market Survey
IBM Systems
App Modernization: Map and document existing
IBM Systems
“API-ize” RPG / COBOL programs
• Integrated Web services server (+ RPG, Cobol ILE)
– The goal of the wizard is to create a recommended production level server configuration while requiring minimal information from the user.
• Expose RPG / COBOL program as a Web Service• SOAP and REST• New: SWAGGER document for REST
IBM Systems
Open-source & IBM i
• Why open-source– Rapid growth
– Important adoption
– Communities
– Free
• Why open-source under IBM i?– Skills available
– IBM i openness
– New possibilities
– Easy integration with the existing (data, programs)
– Integration made by IBM
• How?
https://www.ibm.com/support/pages/open-source-support-ibm-i
IBM Systems
New Packages Available on IBM i
• Node.js v10+. : Web Dev
• Python v3.6. : Admin, Data Science
• GCC / chroot : Porting, IFS Containers
• Git : Versioning. DevOps era
• Free Web IDE for ILE & OSS
• cloud-init. : Openstack
• Scikit-learn , Pandas, Scipy: Data Science
• Ansible for automation
IBM Systems
Modernization – New Skills Needed?
• Key messages
– Skills rejuvenation on IBM i is a real concern for IBM
• News
– Initiatives: OCSI (BP France 2015-2020…), iAcademy (France), Fresh Faces (IBM WW)
https://www.ocsigroup.fr/blog/p%C3%A9nurie-de-comp%C3%A9tences-ibm-i-vive-la-p%C3%A9pini%C3%A8re-ibm-i-d%E2%80%99ocsi
IBM Systems
New Apps on IBM i
M o b i l e W e bA p p l i c a t i o n
Client
Intranet (Stores)
Data
DMZ
(SoE, Front Office)
Beacons
(in store)
API
consumers
IT Solution(Partners)
iPad (Mobile
App.)
“IoT”
(SoR, Back Office)
CRM + RMS
(client data,
product, stock,
…)
Internet
Local / Intranet
DB2
.js
IBM Cloud Services
.js .js
Mobile
App.
Beacon
App.
.js
Natural Language
Understanding
Language TranslatorWeather Company
Data
Geospatial
Analytics
Secure Gateway
API
Gateway
.js
IBM Systems
New Apps on IBM i
USER DEVICE
API
API
Sla
ck
API
Tw
ilio
Nodes(Watson, Slack, Twilio, HTTP REST)
No
de
-RE
D
APPLICATION LOGIC
ENTERPRISE APIs
SERVICES
[Text Authentication Code]
[Communicate with user]
[Retrieve IBM i
system status]
API
Wa
tso
n
CONVERSATION
[understands natural-
language and responds in
human-like conversation]
IBM Systems
New Apps on IBM i
Node.js Core
DB2 for iAccess Library
Node.js ToolkitFor IBM i
Built-inModules
IBM i
DB2 for i CLI XMLServices
acme-mobile.js
Push Notifications
IBM Cloud Push ServiceOr
MobileFirst Push Service
REST
Events table populated by any program on IBM iEx: DB2 Trigger inserts a line when a user is booking
✓ Micro-Service Approachusing Node.JS & API calls
✓ Invoke API & enrich data & applications running on IBM i. Easy & Secure.
✓ Use Cases: Weather API, Watson API, Mobile API….innovation without limits
Check every 30 seconds
HTTPS
IBM Systems
OtherVM Based
Apps
Containerized cloud native application CAM is installed into an IBM Cloud Private worker node with a Helm chartLeverages IBM Cloud Private services for enterprise capabilities
IBM Cloud Private
Core Services
LoggingIAM
Encryption & Key Management
API & Data Connect
UsageMetering
Monitoring
Event
Audit
Data & Analytics Services
Databases/ Analytics
Tenant Svcs
Kubernetes
Infrastructure Service catalog
Multi-cloudServices
CAM
Public, Private & Hybrid Clouds
Deployment & Process Orchestration
Flow Engine
3rd Party Integrations
Service Composer
Template Management
Template API
Terraform
Instance Management
Workload
Service
IaaS Management
Helm
Serv
ice
& T
emp
late
Li
bra
ry
VM Based Apps
VM Based Apps
IBM Cloud Automation Manager
HMC managed
Openstack Cloud provider
Compute & StorageAutomation
New Apps on IBM iNeed a new IBM i VM to build your application?
IBM Systems
Node.js on IBM i
IBM Systems
Node.js on IBM i
• Node-RED:– A visual programming tool for
wiring together hardware devices, APIs and online services in new and interesting ways.
– A browser-based editor that makes it easy to wire together flows using the wide range of nodes in a palette
– Flows can be deployed to its runtime (Node.js) in a single-click.
IBM Systems
Why only 2 hours to build a prototype on IBM i?
• IBM i
– Open Source !!• Integrated by IBM (yum repo)
• Very popular solutions (Node.js + GIT + community support)
• Easy integration with existing solution (data, programs, objects)
– IBM DB2® for i access library
– Node.js toolkit for IBM i
– DB2 for i• IBM i Services:
Easily get system infoswith SQL SELECT
IBM Systems
AugmentedBusiness ApplicationsWith AI & Predictive
Capabilities
DB2 for iBusiness Data©◊
Machine Learning Libraries &
Framework (PASE)
Data & Scientific Packages Available
Numpy, Pandas : Data Processing
Scipy, Scikit-Learn
IPython : interactive Python
NLTK : Natural Language Processing
Matplotlib, jupyter : Data Visualization
R Language (Interpreter, Runtime)
More to come? ☺
AI Apps on IBM i?
IBM Systems
IBM i 7.4 – Details des fonctionnalités
https://www.ibm.com/systems/clientcenterdemonstrations
Visit my Blog - https://ibm.biz/bma-wiki
Dans cette présentation:
24
- IBM i – Roadmap de la prochaine décennie
- IBM i 7.4 - Nouveautés et quelques exemples d’utilisation
- Détail des nouvelles fonctionnalités- Availability- Security- ILE Development- Open Source- Db2 for i - New I/O Support- Automation & Cloud- Analytics
Db2
Business Continuity
& Availability Virtualization & Automation
Cloud
SecurityApplication Development
Performance
Modernization
& API
Analytics & AI
Open Source on IBM i
Roadmap
IBM SystemsIBM Systems
Availability
| 25
IBM Systems
High Availability topology classification & positioning
26
Technology Active/Active Clustering Active/Passive Clustering Active/Inactive
Definition Application level clustering;
applications in the cluster have
simultaneous access to the
production data therefore no app
restart upon an app node outage.
Certain types enable read-only
access from secondary nodes
OS level clustering; one OS in the cluster
has access to the production data, multiple
active OS instances on all nodes in the
cluster. Application is restarted on a
secondary node upon outage of a
production node.
VM level clustering, One VM in a cluster
pair has access to the data, one logical OS,
one or two physical copies. OS and
applications must be restarted on a
secondary node upon a primary node outage
event. LPM enables the VM to be moved
non-disruptively for a planned outage event.
Outage Types SW,HW,HA, planned, unplanned
RTO 0, limited distance
SW,HW,HA,DR, planned, unplanned,
RTO>0, multi-site
HW,HA,DR, planned, unplanned, RTO>0,
multi-site
OS integration Inside the OS Inside the OS OS agnostic
RPO Sync mode only Sync/Async Sync/Async
RTO 0 Fast (minutes) Fast Enough (VM Reboot)
Licensing* N+N licensing N+1 licensing N+0 licensing
Industry Examples Oracle RAC, Db2 Mirror, pureScale PowerHA, Redhat HA, Linux HA VMware, VMR HA, LPM,
…VM partition
Active …
Active/Active
VM partition
Active …VM partition
Active …
Active/Passive
VM partition
Active
VM partition
Active …Restart
Active/inactive
…
• N = number of licensed processor cores on each system in the cluster• llustrations represent two-node shared-storage configurations for conceptual simplicity. There are many other topologies and data resiliency combinations
IBM Systems 27
Db2 Mirror for i - Continuous Availability
• Operating System Synchronous Replication
• Continuous Availability
• 24 x 7 Up Time
• Rolling Upgrades
• RTO / RPO Near 0
• 5770DBM Priced Product
• 2 LPARs Communicating via RoCEDb2 Synchronous Updates
IBM Db2 Mirror for i
IBM Systems
PowerHA on IBM i 7.4 - Enhancements
IBM PowerHA SystemMirror for i enhancements (IBM i 7.4 BASE, not available on 7.2/7.3): ❑ Support for DS8000 HyperSwap with a Global Mirror link❑ Automation of administrative domain operations (PowerHA Policies) ❑ Support for disaster recovery of a Db2 Mirror deployment❑ Support for replication of IFS data in a Db2 Mirror deployment❑ For more details, see the PowerHA 7.4 Wiki page
IBM SystemsIBM Systems
Security
| 29
IBM Systems
Pervasive Security
|
30
➢New “view” in Authority Collection
✓Based on object vs user
➢New Communication Protocols
✓TLSv1.3 higher encryption
✓SNMPv3 trap and inform messages
✓ JTOpen
✓SMB3
➢Access Client Solutions and RDi
✓Uses newest secure protocols
➢Password rules enforced
✓DST and SST passwords
✓apply 27 rules➢Digital Certificate Manager increases automation
IBM Systems
DCM : New User Interface
31
http://ip_address:2006/dcm
32
Authority Collection
• A utility that captures pertinent data associated with an authority check– Covers all native IBM i file systems– Capture unique instances of the authority check
• The collection will include one key piece of information… – “What authority does the OS require for this authority check?”
• A security administrator or application provider can determine minimum authority required to the objects to allow the application to run successfully.
• Allows “locking down” authority with no impact to existing workflow.
33
Authority Collection Usage Overview
•Turn on the authority collection
•Collect authority info
•Examine the results via SQL or Navigator
Authority Collection – Interrogate the collected data
Leverage Navigator to do basic data investigation
Use SQL to get more details
34
35
Authority Collection by Object
• As of IBM i 7.4 authority collection support allows the collection of authority information for specific
objects when accessed by any user
• The authority collection value for an object set with the new Change Authority Collection
(CHGAUTCOL) command.
• Object types:
– QSYS file system
– "root" (/)
– QOpenSys
– user-defined file system
– document library objects
IBM SystemsIBM Systems
Solution EnablementModernization, ILE/RPG, ACS, Db2 for i,
Open Source
| 36
IBM SystemsIBM Systems
ILE Development
| 37
38
RPG Editor Feature Comparison(Non exhaustive)
https://gist.github.com/kskuhlman/d2cc089a95bae04431b1c231de488a18
39
RPGInnovation continues to give RPG developers client-requested options
• Varying-dimension arrays – RFE 90712
− DIM(*VAR:n)
− DIM(*AUTO:n)
− %ELEM
• SAMEPOS – position subfields - RFE 121317
40
COBOL− SORT table elements according to specified table keys
− New LEADING and TRAILING keywords for COPY & REPLACE
− Conditional compilation provides a way to include or omit selected lines of code based on the
value of literals specified by the DEFINE directive
− New ALLOCATE and FREE statements to obtain/free dynamic storage
− INITIALIZE enhancement
− EXIT enhancement
− Inline comments
41
ILE compiler updates in 7.4: CL
• Supports building CLLE program and CL
command from IFS source file
− Supports both absolute and relative IFS
path name
− SRCSTMF parameter is added for
• Create command (CRMCMD)
• Create CL Module (CRTCLMOD)
• Create Bound CL Program
(CRTBNDCL)
− INCDIR parameter is added for
• Include CL source (INCLUDE)
− Also available in 7.3 via PTF SI67337,
SI67358
• New built-in function %PARMS for CLLE
program
• Examples:
2. Create CL command from IFS source file
CRTCMD CMD(TEST/HELLO) PGM(TEST/HELLO)
SRCSTMF('hello.cmd’)
1. Create CLLE program from IFS source file
CRTBNDCL PGM(TEST/HELLO)
SRCSTMF('/tmp/examples/hello.clle’)
3. New %PARMS built-in
42
System Debugger updates in 7.4
• Change Program Data (QBNCHGPD) API
is enhanced to update the debug source
location
− Supports both library physical file and
IFS stream file
− Compile a program from an IFS stream
source file or library physical file with
DBGVIEW(*SOURCE)
− Move the source file to another location
− Use API QBNCHGPD to update the old
source location to the new one with new
format CHGP0200
− Debug the target program. System
debugger will show the source file
correctly from the new location
• Examples:
CHGSRCLOC.C
43
Rational Developer for i• Strategic Development Environment for IBM i
• Improvements in many areas
• Answered many RFEs from clients including
− Code coverage improved web faced view
− Code coverage source view displays in “browse”
− PDM Perspective, added in 2019, further refinements
− Supports added enhancements to RPG and COBOL
− Improved SQL formatting
− New smart keys to improve programmer productivity
IBM SystemsIBM Systems
IBM i Services
| 44
IBM i Services – A Brief History• What: Use SQL, SQL DDL and SQE to provide alternatives to IBM i APIs and CL Commands
• Dawn of the 1st IBM i Service (2013) – QSYS2.PTF_INFO
• Alternative to the DISPLAY PTF (DSPPTF) command
• Proof of concept that SQL Views paired with SQL UDTFs provide significant value, for low
cost
• IBM i Services take root (2015)
• Enhancements delivered with every Technology Refresh
• Examples shift from IBM presentations into ACS’s Insert from Examples
• IBM i Services begin to be used as a modernization technology (2017)
• IBM i Services consist of 13 topical categories (2019)
• Significant ISV adoption
• RFEs too numerous to count45
IBM Systems
Services in 4Q/2017:
• Syslog detail returned from
DISPLAY_JOURNAL &
HISTORY_LOG_INFO
• ASP_INFO
• ASP_VARY_INFO
• JOB_QUEUE_INFO
• STACK_INFO
• And more…
http://ibm.biz/Db2foriServices
Services in 3Q/2018:
• JOB_DESCRIPTION_INFO
• ACTIVE_JOB_INFO
enhancements
• NETSTAT_INFO &
NETSTAT_JOB_INFO
enhancements
• And more…
SF99703 Level 16SF99704 Level 1
7.3 – TR67.4 – GA2018 2019
Services in 2Q/2019:
• DATA_AREA_INFO
• ASP_JOB_INFO
• MESSAGE_FILE_DATA
• SYSTOOLS.FIRMWARE_CURRENCY
• SYSTOOLS.SPLIT
• SYSTOOLS.SPOOLED_FILE_DATA
• IBM i 7.4 only services
• And many enhanced services
SF99702 Level 20SF99703 Level 8
7.2 – TR87.3 – TR4
7.2 – TR97.3 – TR5
SF99702 Level 23SF99703 Level 11
IBM i Services – Timeline
46
IBM Systems
IBM i Services
47
•QSYS2.ADD_TIME_SERVER
•QSYS2.REMOVE_TIME_SERVER
•QSYS2.TIME_PROTOCOL_INFO
•QSYS2.AUTHORITY_COLLECTION_DLO
•QSYS2.AUTHORITY_COLLECTION_FSOBJ
•QSYS2.AUTHORITY_COLLECTION_LIBRARIES
•QSYS2.AUTHORITY_COLLECTION_OBJECT
•QSYS2.DATA_AREA_INFO()
•QSYS2.DATA_AREA_INFO
•QSYS2.GET_JOB_INFO()
•QSYS2.OBJECT_PRIVILEGES
•QSYS2.MESSAGE_FILE_DATA
•QSYS2.ASP_INFO
•QSYS2.ASP_JOB_INFO
•SYSTOOLS.FIRMWARE_CURRENCY
•SYSTOOLS.SPLIT()
•SYSTOOLS.SPOOLED_FILE_DATA()
•QSYS2.SYSLIMTBL
•QSYS2.SYSLIMITS
•QSYS2.ACTIVE_DB_CONNECTIONS
•QSYS2.BOUND_MODULE_INFO
•QSYS2.BOUND_SRVPGM_INFO
•QSYS2.CLEAR_DATA_QUEUE
•QSYS2.DATA_QUEUE_INFO
•QSYS2.IFS_JOB_INFO
•QSYS2.IFS_OBJECT_LOCK_INFO
•QSYS2.IFS_OBJECT_REFERENCES_INFO
•QSYS2.IFS_OBJECT_STATISTICS
•QSYS2.OBJECT_OWNERSHIP
•QSYS2.OBJECT_PRIVILEGES
•QSYS2.OBJECT_STATISTICS
•QSYS2.PROGRAM_EXPORT_IMPORT_INFO
•QSYS2.PROGRAM_INFO
•QSYS2.RECEIVE_DATA_QUEUE
•QSYS2.SEND_DATA_QUEUE
•QSYS2.SERVER_SBS_CONFIGURATION
•QSYS2.SET_SERVER_SBS_ROUTING
•QSYS2.SYSTEM_STATUS
•QSYS2.SYSTEM_STATUS_INFO
•SYSTOOLS.LPRINTF
TR1
IBM SystemsIBM Systems
ACS
| 48
IBM Systems
Access Client Solutions – Strategic Interface
49
End Users
System Managers
Database Engineers
WHO?
WHERE?
http://ibm.biz/IBMi_ACS
WHAT?5250IFSSpool Run SQL Scripts Create Excel SpreadsheetsSchemasConsole
GONE
IBM i Access for Windows
(5733XE1)
End of Life – April 30, 2019
Access Client Solutions – What's New• New Formatter!
− It works
• Validates Syntax!
• IASP and DB Connections Remembered
50
Journal Services
QSYS2.DISPLAY_JOURNAL – UDTF
QSYS2.JOURNAL_INFO – VIEW
Storage Services
QSYS2.ASP_INFO – VIEW
QSYS2.ASP_JOB_INFO – VIEW
QSYS2.ASP_VARY_INFO – VIEW
QSYS2.MEDIA_LIBRARY_INFO – VIEW
QSYS2.SYSDISKSTAT – VIEW
QSYS2.SYSTMPSTG – VIEW
QSYS2.USER_STORAGE – VIEW
Librarian Services
QSYS2.LIBRARY_LIST_INFO – VIEW
QSYS2.OBJECT_STATISTICS – UDTF
Java Services
QSYS2.JVM_INFO – VIEW
QSYS2.SET_JVM – PROCEDURE
System Health Services
QSYS2.SYSLIMITS – VIEW
QSYS2.SYSLIMTBL – TABLE
QSYS2.OUTPUT_QUEUE_ENTRIES – VIEW
QSYS2.OUTPUT_QUEUE_ENTRIES_BASIC – VIEW
QSYS2.OUTPUT_QUEUE_ENTRIES – UDTF
QSYS2.OUTPUT_QUEUE_INFO – VIEW
SYSTOOLS.SPOOLED_FILE_DATA – UDTF
Spool Services
Security Services
QSYS2.AUTHORITY_COLLECTION – VIEW
QSYS2.AUTHORITY_COLLECTION_DLO – VIEW
QSYS2.AUTHORITY_COLLECTION_FSOBJ – VIEW
QSYS2.AUTHORITY_COLLECTION_LIBRARIES – VIEW
QSYS2.AUTHORITY_COLLECTION_OBJECT – VIEW
QSYS2.AUTHORIZATION_LIST_INFO – VIEW
QSYS2.AUTHORIZATION_LIST_USER_INFO – VIEW
QSYS2.DRDA_AUTHENTICATION_ENTRY_INFO – VIEW
QSYS2.FUNCTION_INFO – VIEW
QSYS2.FUNCTION_USAGE – VIEW
QSYS2.GROUP_PROFILE_ENTRIES – VIEW
QSYS2.OBJECT_PRIVILEGES – VIEW
QSYS2.SQL_CHECK_AUTHORITY – UDF
QSYS2.USER_INFO – VIEW
SYSPROC.SET_COLUMN_ATTRIBUTE – PROCEDURE
IBM i Services – ACS Run SQL Scripts!!• All in ACS! No more posters required.
51
52
ACS – Edit Table• Edit Table Contents from ACS
IBM Systems53
ACS : SQL Content Assist
Prompting in Run SQL Scripts
54
ACS Version 1.1.8.2• Open/Save from Run SQL Scripts to IFS stream files and Source Physical files
55
ACS – Run SQL Scripts – IFS 1. Developed in ACS
2. Saved to the IFS
3. Deployed via RUNSQLSTM
IBM SystemsIBM Systems
Db2 for i
| 56
Db2 for i – What’s in IBM i 7.4?• Everything in IBM i 7.3 TR1 →TR6
• Db2 Mirror
• New HASH built-in functions
• SQL Precompiler enhancements for RPG and COBOL
• Reorganize Physical File Member enhance
• Authority Collection by Object
• Quality Improvements related to Db2 Mirror
• SQE
− Enforcing job temporary storage limits
− Improved paging within the SQL Plan Cache
− Improved paging for plans with Random I/O
− Improved estimates (costing) of plans with temporary objects
− Improved management of stale plans
− Improved optimization on busy partitions
N
e
w
S
t
u
f
f
I
m
p
r
o
v
e
d
S
t
u
f
f
57
IBM Systems
Db2 for i
|
58
Db2 for i - Functional Enhancements
•Add PROGRAM NAME for SQL Routines
•Add Scalar function synonyms for Db2 family
consistency
•Add Synonym predicates ISNULL and NOTNULL
•Support greater than 32 routines over an external
service program
•Allow UTF8 source for SQL precompiles
Db2 for i - Database Management Enhancements
•Extend ALLOW_DDL_WHILE_OPEN for grant and
revoke authorities
•Add SUPPRESS_INQUIRY_MESSAGES
•Allow RI children to be added without an exclusive
lock
Db2 for i - Services (new and enhanced)
•QSYS2.SWAP_DYNUSRPRF
•QSYS2.SYSINDEXSTAT
•QSYS2.SYSPARTITIONINDEXES
•QSYS2.SYSPARTITIONINDEXSTAT
Db2 for i - Functional Enhancements•HASH Built-in functions•SQE Improvements•INSERT with DEFAULT VALUES•CREATE INDEX - optional alias and rename controls for field names•New QSQPRCED() - QAQQINI statement level override controls•SQL Precompiler enhancementsDb2 for i - Performance Enhancements•IASP vary on performance is improvedDb2 for i - Database Management Enhancements
•Reorganize while active - enhanced
•System Limits - by Table Size
•System Limits - QSYSOPR warning uses a new message -
SQL7062
•Health attributes added to the SQL Plan Cache Properties
Db2 for i - Database Security Enhancements
•Authority Collection by Object
Db2 for i - Services (enhanced)
•QSYS2.PARSE_STATEMENT() table function enhanced
•SYSPROC.WLM_SET_CLIENT_INFO() Procedure enhanced
TR1
IBM Systems
Hash Built in Functions
59
The HASH function returns a 128-bit, 160-bit, 256-bit or 512-bit hash of the input data, depending on the algorithm selected, and is intended for cryptographic purposes.
IBM SystemsIBM Systems
Integrated Web Service Server
and Integration
| 60
IBM Systems
REST APIs - Today
61
RPG PGM / SRVPGM
COBOL PGM / SRVPGM
Java / C / C++
IWS
Server
Built in REST APIs connection for program calls
IBM Systems
Connect to the Database - Today
62
RPG PGM / SRVPGM
COBOL PGM / SRVPGM
Java / C / C++
IWS
Server
From Web need to use Db connection to access DB directly
Db2 for i
Need to connect with - JDBC - ODBC
Db2
Server
Jobs
IBM Systems
REST APIs – New SQL Access Using REST
63
RPG PGM / SRVPGM
COBOL PGM / SRVPGM
Java / C / C++
IWS
Server
Use 1 connection from Web to IBM i – All HTTP based
Db2 for i
Db2
Server
JobsIWS server handles the connection to the database. Use SQL directly from a REST connection
IBM Systems
IWS Wizard Updated
64
IBM Systems
Specify SQL
65
66
IBM i Application Connectivity Improvements• JTOpen JDBC
− Previously - when connection lost, a new connection had to be re-established with the backup
server
− IBM i 7.4 – Connection is NOT lost in the application, the ‘backup’ server just takes over
• Application and Data Connections
− Previously – use REST APIs for program connections
and Db connections (ODBC or JDBC) for data connections
− IBM i 7.4 – Both applications and Db2 can use 1 HTTP
based connection from Web to IBM i
• SMB3
− Support for larger read and write sizes providing
encryption and performance improvements
IBM SystemsIBM Systems
Open Source on IBM i
| 67
IBM Systems
Open Source
68
• Node.js v10 and updated Python packages
• Midnight Commander
• 2-pane file manager
• R
• Language for analytics and statistical computing
• vim
Popular terminal based editor
• Active MQ
• Open source message broker
IBM Systems
Open Source RPMs
69
5733-OPS is sunsetted, and no longer needed!
Now delivered with RPMs (just like RedHat packages) and the ‘yum’ package manager
− MUCH more technology available
− Faster security fixes
− Industry-standard
− IBM and third-party distribution
Manage with command-line tools or ACS
Install or update an entire open source ecosystem in a matter of minutes!!
To get started:
http://ibm.biz/ibmi-rpms
Node.js version 10• Long-term-support (LTS) release
− Performance improvements
− New version of node package manager (NPM)
− JavaScript language enhancements
• Buildable from community source
− Anyone can use a tool like nvm to manage their own versions, including feature releases
• Expecting version 12 soon!
70
R: a new programming language on IBM i!
• Great for:
– Data analysis
– Statistical computing
– Data mining
– Big Data
• Ranked #7 by IEEEhttps://spectrum.ieee.org/at-work/innovation/the-2018-top-programming-languages
71
Introduction to Ansible— Ansible is a radically simple IT automation platform that makes your applications and
systems easier to deploy.
• It is a free open source application
• Agent-less – No need for agent installation and management
• Python/YAML based
• Highly flexible and configuration management of systems.
• Configuration roll-back in case of error
— It support configuration management with examples as below.
• Configuration of servers
• Application deployment
• Continuous testing of already install application
• Provisioning
• Orchestration
• Automation of tasks
— An online quick start video provided by Ansible
• https://www.ansible.com/resources/videos/quick-start-video
Ansible Tower
REAL-TIME JOB STATUS UPDATES
MULTI-PLAYBOOK WORKFLOWS
WHO RAN WHAT JOB WHEN
YOUR ANSIBLE DASHBOARD
SUPPORT IBM i TASKS
• Common IBM i administrator tasks
• Initial Install of IBM i; LPP, PTF and TR installation; License management
• Security management, eg. User profiles
• IBM i work management for jobs, subsystems, etc.
• IBM i Open Source package installation and update via YUM or PIP for Python
• IPL management
• Adhoc CL and SQL commands for very specific IBM i admin tasks
• Create Ansible playbooks to run a workflow with multiple actions performed via available modules
• Common IBM i development tasks
• Continuous development and testing – automate build, unit test, deploy process, etc.
• Easy re-setup / re-clone application dev/testing environment in different stage of product life cycle
• IBM i cloud tasks
• Integrates with CAM and Terraform for VM provision and configuration in IBM cloud platforms
• Fixes and application management in cloud
• Orchestrations to form cloud solutions
Ansible for IBM i Use CasesIBM i use cases with Ansible Tower or Engine
74
• A set of IBM i modules will be created in short term
• CL Command: Execute a CL command
• SQL Command: Execute a SQL command or query
• Save/Restore objects
• Copy/Fetch object To/From IBM i systems
• Find specific object
• Submit jobs
• Schedule a job
• Manage devices
• The core modules from Ansible will be tested for IBM i
PASE
• Where to get the IBM i modules and related samples
• All the IBM i modules are open source
• Link for modules and their related samples in public github:
• https://github.com/IBM/ansible-for-i
Detail information
75
• Manage servers, Eg. TCP servers, Host servers
• Manage user profiles and groups
• Object synchronize between systems
• Manage authorities
• Manage fixes / PTFs / LPPs
• IBM i messages
• Manage sub system
• Manage network configuration
vim
• Popular terminal-based editor
76
Midnight Commander
• Two-pane file manager
• Abilities include:
– FTP access
– Compare files
– Compare directories
– Edit files
– Move, copy, delete, etc
– Subshell
– Scroll wheel
– Mouse
– Directory side-by-side and tree views
– See and modify file info
– …………. Tons more!!
77
ActiveMQ
• Open source message broker (Java-based)
• Supported protocols:
– OpenWire
– STOMP
– MQTT
– AMQP
– REST
– WebSockets
78
IBM iIFS Containers
IFS Containers are like micro PASE virtual machines.
automation Combine yum and IFS containers and you have a solid automation plan!
#
# create_nodejs_container.sh <container-name> <UPPERCASE-USER-NAME>
#
export CHROOT_DIR=/QOpenSys/ibmichroot_containers/$1
chroot_setup.sh chroot_minimal.lst $CHROOT_DIR
chroot_setup.sh chroot_nls.lst $CHROOT_DIR
chroot_setup.sh chroot_OPS_SC1.lst $CHROOT_DIR
yum -y --installroot=$CHROOT_DIR install wget curl nano rpm openssh make-gnu
less openssl openssh gzip bash git nodejs python2
chroot $CHROOT_DIR /usr/bin/sh -c "ln -s /QOpenSys/pkgs/bin/bash
/usr/bin/bash"
# Create a user inside this chroot
chroot_setup.sh chroot_add_developer.lst $CHROOT_DIR mydir="$CHROOT_DIR"
myuser=$2
# Setup SSL certs
chroot $CHROOT_DIR /usr/bin/bash -c "cd /tmp && curl -k -L
https://gist.github.com/kadler/547bb36ddadb/git_ssl_setup.sh | ksh"
chroot $CHROOT_DIR /usr/bin/bash -c "cd ~ && git clone
https://bitbucket.org/litmis/nodejs-idb-connector.git"
chroot $CHROOT_DIR /usr/bin/bash -c "chown -Rh $2 ."
.NET on i Open source implementation of Microsoft's .NET Framework based on the ECMA standards for C# and the Common Language Runtime.
Sponsored by Microsoft
Included:Mono (pre-release version 5.13; built from master branch)
mcs (non-Roslyn C# compiler; supports C# 7)
xbuild (non-Microsoft solution/project make tool)
vbnc (non-Roslyn Visual Basic.NET compiler; supports VB 2005, partial VB 2010 support)
xsp (stand-alone ASP.NET server)
FastCGI Server
NUnit (unit testing library and toolchain)
ILEditor
krengel.tech/ileditor - Home page
Open source and free development environment for ILE (RPG, COBOL, C, C++) languages.
RPG Syntax highlighter for VS Code.VS Code & RPG
krengel.tech/rpg-for-vscode - Git repo
sshfs (Secure Shell File System)
basedir="/Users/aaronbartell/"
sshfsname="remote_app1"
remotedir="/home/aaron/git/app1"
mkdir $basedir$sshfsname
umount -f $basedir$sshfsname
sshfs -o volname=$sshfsname -o
allow_other,defer_permissions,IdentityFile=~/.ssh/id_rsa
aaron@ibmi1:$remotedir $basedir$sshfsname
File ssh_connections.sh:
● Acts like a mapped drive, use any editor● Communicates over SSH (secure)
Article: bit.ly/mcpress-edit-ifs-files Automate with a script!
ssl
krengel.tech/mcpress-node-db-pool - Article
Clone, install, log out
$ cd git
$ git clone https://github.com/Neilpang/acme.sh.git
$ cd ./acme.sh
$ ./acme.sh --install --force
$ exit
Use LetsEncrypt.org to apply SSL certs. Free certs!
$ cd git/acme.sh
$ acme.sh --issue -d domain.com -w /www/domain.com/htdocs/letsencrypt
$ cp ~/.acme.sh/domain.com/domain.com.cer /www/domain.com
$ cp ~/.acme.sh/domain.com/domain.com.key /www/domain.com
$ cp ~/.acme.sh/domain.com/fullchain.cer /www/domain.com
Log in, issue cert, copy to app directory
$ openssl req -new -sha256 -key domain.com.key -out domain.com.csr
$ openssl x509 -req -in domain.com.csr -signkey domain.com.key -out domain.com.cer
Or self-signed certs (great for internal web servers)
Nginx
nginx.com - Article
pid /www/mydomain/nginx.pid;
events {}
http {
server {
listen 443 ssl;
ssl on;
ssl_certificate /www/mydomain/mydomain.com.cert;
ssl_certificate_key /www/mydomain/mydomain.com.key;
ssl_protocols TLSv1.2;
ssl_ciphers ECDHE-RSA-AES256-GCM-SHA384;
ssl_session_cache shared:SSL:50m;
ssl_prefer_server_ciphers on;
}
}
Nginx + SSL setup can be completely automated. Apache on IBM i can't.
$ yum install nginx
nginx.conf
$ nginx -c /path/to/nginx.conf
nano Small and friendly text editor. Interactive search-and-replace, undo/redo, syntax coloring, smooth scrolling, auto-indentation, go-to-line-and-column-number, feature toggles, file locking, backup files, and internationalization support.
Get syntax coloring for all your languages.
$ git clone https://github.com/scopatz/nanorc.git ~/.nano
$ cat ~/.nano/nanorc >> ~/.nanorc
Visual Studio Code
code.visualstudio.com - Visual Studio Codesocket.io - Node.js WebSocket implementation
An excellent editor with integrated Node.js debugger and integrated Git.
sftp
marketplace.visualstudio.com/VSCode - VS Code Extensions
Develop code locally and automatically sync with IBM i using SFTP.
{
"protocol": "sftp",
"host": "myIBMi",
"username": "aaron",
"remotePath": "/home/AARON/node1",
"uploadOnSave": true,
"privateKeyPath": "/Users/aaronbartell/.ssh/id_rsa",
"ignore": [
".vscode",
".git",
"node_modules"
],
"watcher": {
"files": "**/*",
"autoUpload": true,
"autoDelete": true
}
}
sftp.json
install
I like this approach because it keeps the Git repo on my local machine. Mirroring the .git directory of a project is very expensive if done remotely.
db2util
bitbucket.org/litmis/db2util - Repo
Shell command DB2 access.
JSON output (-o json)
$ db2util "select CUSNUM from QCUSTCDT where LSTNAM=? or LSTNAM=?" -p
Jones Vine -o json
Result{
"records":[
{
"CUSNUM":"839283"
},
{
"CUSNUM":"392859"
}
]
}
ML Technologies & IBM i & AIX
AugmentedBusiness ApplicationsWith AI & Predictive
Capabilities
DB2 for iBusiness Data
Machine Learning Libraries &
Framework (PASE)
Data & Scientific Packages Available
Numpy, Pandas : Data Processing
Scipy, Scikit-Learn
IPython : interactive Python
NLTK : Natural Language Processing
Matplotlib, Jupyter : Data Visualization
R Language (Interpreter, Runtime)
More to come? ☺
➔ Useful in all phases of a ML project on AIX/IBM i
➔ Especially for Data Preparation
➔ GPU Acceleration often needed
Use integrated frameworks , languages on AIX & IBM i
Data Science tools
Get started with Data Science onPower (AIX/IBM i)using Open Source Technologies
April 2019
IBM SystemsIBM Systems
Infrastructure,
Automation & Cloud
| 94
IBM Systems
What’s new !!
95
F9 F8
Retrieve Opposite Retrieve
Workload groups on JOBD in 7.4
96
• Configure by Job description – CRTJOBD, CHGJOBD
• Workloads can now run in different groups within same subsystem
QUSRWRK SBS
WLCGRP(*NONE)
JOBD1WLCGRP(GRP1)
JOBD2WLCGRP(GRP2)
JOBD3WLCGRP(GRP3)
Easy to set up, just create a group and then CHGJOBD to use the workload group.
No need to restart the subsystem!
IBM Systems
What’s new !!
|
97
IBM Power S924 model 9009-42A adds 11-core and 22-core configurations
HMC and Novalink injection of license keys to an IBM i LPARIBM i 7.4 TR 1 or IBM i 7.3 TR 7HMC level: 9.1.940
Dedicated and VIOS support for selected PCIe3 x8 SSD NVMe adapters - IBM i 7.4 TR 1IBM i 7.4 TR1 natively supports PCIe3 x8 SSD NVMe adapters that provide multiple capacity points for enterprise workloads on selected Power servers with POWER9™ technology. Support is for selected dedicated and VIOS VSCSI attached NVMe devices.
New Enterprise SSDs – 387 GB, 775 GB, 1.55 TB - IBM i 7.4, IBM i 7.3 TR 3, and IBM i 7.2 TR 7
Support for SR-IOV logical ports on a restricted I/O LPAR - IBM i 7.4 TR 1, IBM i 7.3 TR 7System firmware level: FW940HMC level: 9.1.940
98
Reminder - Retranslate Programs in IBM i 7.4
Can get minor improvements to generated sequences of machine instructions
• Typical for a new release
• Provide better optimizations for isolated sequences of instructions
• Especially for newer generations of hardware
Identify programs that are performance sensitive
• Simply retranslate them, even if you do not have the source code
• Run them on the new IBM i 7.4 release for a possible performance benefit
QBNCVTPGM tool makes it easier to retranslate a set of programs
• See the Simplified program conversion article on developerWorks for details
Hardware and I/O – IBM i 7.4 and IBM i 7.3 TR 6• Support for POWER9 Systems in 1H2019
– IBM i, 7.4, 7.3, and 7.2
– FW930 support
– More legacy I/O support
– Making the internal DASD backplane optional for Scale Out models
• New I/O
– PCIe gen4 dual port 100 Gb Ethernet adapter
• Adds Native NIC (both Dedicated and SR-IOV)
• Adds Native RoCE (both Dedicated and SR-IOV) for use in IBM i 7.4’s Db2 Mirror configurations
– Dedicated & SR-IOV RoCE support is added for PCIe gen3 Ethernet adapters in IBM i 7.4
• Sharing this adapter allows more configuration flexibility for use in IBM i 7.4’s Db2 Mirror
configurations
• 2-port 100 Gb, 2-port 25/10 Gb, 2-port 10 Gb
– New PCIe3 6-Slot Fan-out Module for the PCIe3 expansion drawer
– New Single-wide Optical Cable cards for attaching the PCIe3 drawer with the new Fan-out module
• For Scale Out models, allows I/O drawer to be attached without blocking an additional adjacent
PCIe gen4 x16 card slot.
– New 387 GB, 775 GB, and 1.55TB Enterprise SAS 4k SFF-3 and SFF-2 SSDs.
– New 931 GB, 1.86 TB, and 3.72 TB Mainstream SAS 4K SFF-2 and SFF-3 SSDs.
• Also new 7.45 TB capacity, but support is only with IBM i 7.4, where max LUN limit is increased
7.3 TR6
7.3 TR6
7.3 TR6
7.3 TR6
7.3 TR6
IBM Systems
Business need:Simplify management of multiple clouds (private
& public)
IBM Cloud Automation
Manager
VMware vRealize
IBM Multicloud Manager
MULTI-CLOUD
Business need:Modernize existing
apps, build newcloud-native, AI apps
IBM Cloud Private
Red Hat OpenShift
IBM Cloud Private
for Data
PRIVATE (PaaS)
100
Business need:AIX, i, Linux workloads on
Power in Public Cloud
Business need:On-premises, cloud-like
provisioning, agility, simplicity
IBM PowerVCIBM Cloud
Power Systems Virtual Server
Google CloudPower Infra.-as-a-Service
Partner Clouds(Skytap, Nimbix, +++)
IBM Cloud Next GenAccelerated Virtual Priv. Cloud
Enterprise Pools
Capacity on Demand
PRIVATE (IaaS)“CLOUD-LIKE” CONSUMPTION MODELS
Business need:Increase flexibility,
competitiveness and reduce costs
PUBLIC(IaaS)
Cloud Management
Console
Hybrid Multicloud Solutions on Power Systems
IBM Systems
IBM i & IBM Cloud
101
https://www.ibm.com/blogs/bluemix/2019/02/ibm-power9-on-ibm-cloud/
With IBM i access in the IBM Cloud:
1) Reach new markets with the global IBM Cloud data center footprint2) Enable their core applications in the cloud without migration disruption3) Leverage our leadership in cloud-native services4) Rely on our built-in security for highly sensitive, compliance-heavy data
IBM Systems
IBM Cloud Storage Solutions for i (5733ICC)
102
TCP/IPCloud StorageVirtual
Tape
Save your IBM i data into a Cloud or FTP Server
• Two modes
1. BRMS to Cloud for backup operations
2. GUI dashboard for storing files in the Cloud (think of BOX-like usage cases)
FTP Server
IBM i
http://www.ibm.com/support/knowledgecenter/ssw_ibm_i_73/icc/topics/iccuoverview.htm
IBM Systems
Analytics Solutions
|10
3
104
Data Studio and Db2 for i
• Enhancement: Support for table partition in Db2 for i database in Data Studio
http://www-01.ibm.com/support/docview.wss?uid=ibm10742699
• Data Studio Latest Version:
– Software version: 4.1.3
– Operating system(s): Linux, Windows
• Debugging with Data Studio and Db2 for i
ibm.biz/DataStudioandDb2fori
• Download it here:
ibm.com/developerworks/downloads/im/data
105
IBM Db2 Web Query for i – Version 2.2.1
• IBM i Business Intelligence and Data Warehousing family of products
– IBM i Licensed Program Product (5733-WQX)
– You probably already own a limited use license*
• Empower End Users with self service managed reporting
• Data driven analysis with interactive dashboards
• Get Started Quickly with Db2 Web Query EZ-Install
– 100+ business and I/T reports and supporting tutorials
– Query/400 Discovery Tool
– Systems Administrator sample monitoring reports
• Email [email protected] for details
Learn more at: ibm.biz/db2webqueryi
Db2 Web Query – System and Security Management
106
20
1
0
7