Wonderware Historian 2014 R2 (11.6)Storage Infrastructure Changes

Presented byYevgeny Naryzhny

Schneider ElectricWonderware Historian Team15 December, 2014

• Current Position on Historian Technology Roadmap• A Farewell to Classic Storage• Classic Data Redirection• Reduced System Clock Dependency• History Block Management• Detailed Storage Tracing

Agenda

Wonderware Historian 10.0 (2010)

New Features for tier-2 tags:• New Data Model• New Architecture• New Storage (T2E)• New Retrieval (HLR)• New Communication Layer (MDAS2)• Tier-1 Data Sources• 150,000 tags

Moving Towards Next Generation Historian

Wonderware Historian 11.0 (2012)

WAS & SDK Tags Moved to Storage:• No ActiveImage• No Real-time Window• High Performance• 64-bit OLE-DB and Storage• HCAL Redundancy Support• Tagid Indexing• 500,000 tags

Wonderware Historian 11.5 (2013)

Storage Vertical Scalability:• Tag Versioning in Runtime• Metadata Server• Alarms & Events HCAL Support• 250,000 pt/s Data Rate• 2,000,000 tier-2 tags

Wonderware Historian 11.6 (2014)

All Tags Handled by Storage:• No ActiveImage Tags• Classic Data Redirector• Reduced System Clock Dependency• History Block Management• HSAL I/O API• Cloud Worker Roles

Wonderware Historian 11.? (201?)

Anticipated New Features:• HCAL-based IDAS• Horizontal Scalability (20M+ tags)• High Availability• High Data Rate (1M+ pt/s)• Built-in History Merge/Backup• Separated Channel Status

Historian 11.5 Storage Data Flow

Historian 11.5

IDAS

named pipes

Configuration ServiceMDAS (DCOM)

WAS 3.1 / SDK 1.0

HCAL (TCP/IP)

History Blocks

Microsoft TDS

ADO / SSMS

Historian Client Access Point (HCAP)

CSVClassicS/F

Classic Manual Storage (aahManStSvc.exe)

AITag=0

OLE DB Provider (SQL)

Tier-1WAS 2012 R2+SDK 2012 R2+

Historian Storage (aahStorage.exe)

AITag=1

AITag=1

AITag=0

outside RTW

inside RTW

AITag=0

AI

Classic Storage(aahStoreSvc.exe)

Historian 11.6 Storage Data Flow

Historian 11.6

IDAS

named pipes

Configuration ServiceMDAS (DCOM)

WAS 3.1 / SDK 1.0

HCAL (TCP/IP)

Microsoft TDS

ADO / SSMS

Historian Client Access Point (HCAP)

Data Import(aahManStSvc.exe)

OLE DB Provider (SQL)

Tier-1WAS 2012 R2+SDK 2012 R2+aahImport.exe

Classic Data Redirector(aahStoreSvc.exe)

CSR

CSVClassicS/F

CSR

CSR

Historian Storage (aahStorage.exe)

History Blocks

CSV

Classic Storage System Clock Dependency

• Storage Relied on Classic History Block Infrastructure• Complicated Classic History Block Sync Protocols

– Classic Storage Created New “Current” Blocks– Classic Storage Updates End Time every 20s – Indexing Service Created Old “Patch” Blocks

• Future VTQs Get Overwritten (QualityDetail 448)• INSERTs/UPDATEs/CSV Rejected if Too Close• History Block Changeovers• VM Issues (time sync/suspend/resume)• Disconnect NULL Injection by Current Server Time

A

History Block CreationHistorian 11.5(Indexing Service)

Historian 11.6(Storage)

A block B

currenttime

20s

patchblock

created byIndexing Service

created & updatedby Classic Storage

block C block D

Current System Time Driven

Data Driven

configured duration

aligned by server’stime zone midnight

configured duration

block P block B block C block D

A’ block P

Historian 11.6 System Clock Independence

• Future VTQs Can Be Stored And Retrieved• INSERTs/UPDATEs/CSV Can Be Anywhere in Time• No Block Changeovers• No Current History Block• Block Creation is Data Driven

• HCAP Injects Disconnect NULLs with Current Server Time for Tags of ChannelStatus=1

• Time Synchronization is Needed if You Care!• No Future Time for IDAS in Store/Forward

Free Bonus Features

• Deprecated AITag Column in Tag Table• No ActiveImage Settings in Config Editor• All Tags Get Upgraded During Product Installation• Data Can Be Stored on Top of Legacy• No Waiting for Next Block On Commit• Reliable Daylight Savings Transitions• History Blocks of Any Duration (next release)

History Block StructureHistorian 11.5

Historian 11.6blockstatus.dat

block80.inf

Classic Data & Metadata

History Block List Management

Historian Storage (aahStorage.exe)

Indexing Service (aahIndexSvc.exe)

Circular AlternateBuffer Permanent

get,subscribe notify

block A block B block Cmaster list

block A block B block Clist copy

Event Storage (aahEventStorage.exe)

get,subscribe notify

block A block B block Clist copy

Historian ManagementConsole UI

get

Alarms & Events Retrieval Legacy Retrieval

getget

Storage Activity Tracing

• TraceSessions – trace storage session creation/deletion• TraceQueries – trace tagids and start/end queries during LLR• TraceBlocks – trace history block search during LLR• TraceDiskManager – trace Circular/Alternate block movement/deletion• TraceGetSnapshots – trace S/F snapshot enumeration done by HCAL• TraceMerge – more detailed info on snapshot merge management• TraceTagPipeline – more detailed info on in-memory snapshot management• TraceTimeManager – trace block boundary calculations (DST change)• TraceMemory – set to 0 to exclude memory stats from the global trace

HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\ArchestrA\Historian\Programs\aahStorage

DWORD Values (0 = disabled by default, 1 = enabled)TraceGlobal must be 1 for the others Traces to work

Thank You!