hotchips 2009 xeon socket filler fpga accelerators€¦ · common function library over fsb, qpi ,...
TRANSCRIPT
![Page 1: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/1.jpg)
HotChips 2009Xeon Socket Filler FPGA Accelerators
www.nallatech.com
Copyright ©2009, Nallatech.
![Page 2: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/2.jpg)
Copyright ©2009, Nallatech. 22
Intel Xeon Accelerator Modules
64-bit 1066MHz FSB interface 8GB/s peak bandwidth 105ns host latency 256GB direct system memory access Intel MP platform compatible
Modular product – optimization for different applications
Xilinx Virtex-5 FPGA technology Supported by Intel QuickAssist AAL C FPGA compiler support
Intel Front Side Bus FPGA AcceleratorsThe Industry’s only Xilinx Virtex-5 FSB Accelerator Module
![Page 3: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/3.jpg)
Copyright ©2009, Nallatech.
Intel QuickAssist Initiative
What is Intel QuickAssist? Comprehensive initiative that enables optimized use and deployment of
accelerators (primarily FPGAs) on Intel platforms
QuickAssist Accelerator Abstraction Layer (AAL) Standard C/C++ API for inclusion with user application Device discovery support CPU initiated data transfer to FPGA (send data to accelerator) CPU initiated data transfer from FPGA (receive data back from accelerator)
Benefits Common software interface supporting multiple processing technologies Easy migration between different technologies and form factors Transparent – Open source approach
![Page 4: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/4.jpg)
Copyright ©2009, Nallatech.
Intel’s Quickassist Accelerator Model
Applicat ion
Funct ion Librar ies
( AFU Msgs )
Funct ion Librar ies
( AFU Msgs )
Physical I nter face Protocol ( FSB)
Applicat ionDevice
Services( e.g. Boot Loaders)
AHM - FSBAFU AFU
AI A ( QPI )
Uniform Accelerator I / F
Physica l I nterconnect
Service API s
Com m on Funct ion API se.g., MKL, I PP…
Other Services
( e.g. Config Database)
Physical I nter face Protocol ( PCI e)
AHM - PCI eAFU AFU
Com m on funct ion library over FSB, QPI , PCI e or t radit iona l I A based
a lgor ithm s
Physical I nter face Protocol ( QPI )
AHM - QPIAFU AFU
Accelerator I nter face Adapters
AI A ( FSB) AI A ( PCI e)
Accelerator Abst ract ion Layer
Accelerators
![Page 5: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/5.jpg)
Copyright ©2009, Nallatech. 5
Integrated Development Platform
Pre-installed FPGA hardware
Linux operating system
Intel QuickAssist AAL
VHDL IP cores
Reference designs
Documentation
1 year warranty
1 year technical support
Optional design service assistance
![Page 6: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/6.jpg)
Copyright ©2009, Nallatech. 6
Inside the 4U server
![Page 7: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/7.jpg)
Copyright ©2009, Nallatech. 7
FSB Configuration Options
North Bridge
FSB8.5GB/s(peak)
21GB/s(peak)
System Memory
South Bridge
2x PCIex84GB/s
Intel’s Caneland MP Xeon platform
10GB/s
10GB/s
10GB/s
switch switch
4x PCIex8 Slots1x PCIex4 Slot
2x PCIex4 Slots
4x SATA
Use
r D
efin
eabl
e I/O
e.
g. 6
0x 1
GbE
Por
ts
![Page 8: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/8.jpg)
Copyright ©2009, Nallatech. 8
FSB-Base Module
Compatible with Intel MP platforms Intel Xeon mPGA604 socket Fits within Xeon heat sink footprint
Front Side Bus interface 64-bit 1066MHz 8GB/s peak bandwidth* 105ns latency Direct access to system memory Encrypted FSB core
Virtex -5 Interface/User FPGA FF1738 package, 42.5mm2
LX110-3
* 8GB/sec for 2 cache-line bursts
Flash
JTAG
Power
Virtex-5 Interface /
User FPGA
64-bit/1,066MHzFront Side Bus
FSB-Computeor
FSB-Expansion
64 LVDS pairs = 6.4GB/sec
FSB-Base
![Page 9: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/9.jpg)
Copyright ©2009, Nallatech. 9
FSB-Compute Module
Virtex -5 User FPGAs Supports Largest LX or SX or FX
FPGAs Up to 207,360 LUT6’s Up to 384 DSP48’s Up to 1032 18Kbit Block Rams
4 independent banks of DDR -II SRAM 2 banks per FPGA Up to 8MBytes per bank 2x 32-bit data buses 8GB/sec total bandwidth
Total Off Module B/W = 25.6GB/s Scalability
Ability to stack multiple FSB-Compute modules
DDR-IISRAM
DDR-IISRAM
DDR-IISRAM
DDR-IISRAM
Virtex-5 User
FPGA
Virtex-5 User
FPGA
64 LVDS pairs = 6.4GB/sec
FSB-Compute
![Page 10: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/10.jpg)
Copyright ©2009, Nallatech. 10
FSB-Expansion Module
Virtex -5 User FPGA Supports Largest LX or SX or FX FPGA >> 1TOP Fixed Precision/Bit Manipulation Up to 100GF Single Precision FP Up to 40GF Double Precision FP
4 banks of QDR -II SRAM Up to 16 MByte per bank 16GB/sec total bandwidth
2 off -module GTP connectors 10 lanes @ 3.125Gbps per connector 20 lanes total = 62.5 Gbps total
2 off -module digital connectors 40 pins per connector Single-ended or LVDS I/O E.g. For High Speed Video Capture E.g. Ultra low latency, <20ns, point to
point Comms
GTP
GTP
QDR-IISRAM
QDR-IISRAM
QDR-IISRAM
QDR-IISRAM
LVDS
LVDS
Virtex-5 User
FPGA
128 LVDS pairs = 12.8GB/sec
FSB-Expansion
![Page 11: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/11.jpg)
Copyright ©2009, Nallatech. 11
Building the accelerator stack - 1
Intel Xeon Server Socket 73XX MP Xeon Series Compatible MPGA-604 Socket Zero Insertion Force Socket, ZIF
![Page 12: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/12.jpg)
Copyright ©2009, Nallatech. 12
Building the accelerator stack - 2
An Interposer is required to be fitted to the ZIF Socket This provides the primary mating interface for the FPGA module stack.
![Page 13: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/13.jpg)
Copyright ©2009, Nallatech. 13
Building the accelerator stack - 3
FSB-BASE module plugs directly into Intel Xeon socket
Deals with low level FSB interface
Referred to as the “Bridge” from the host to the user logic
![Page 14: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/14.jpg)
Copyright ©2009, Nallatech. 14
Heatsink fitted to FSB interface FPGA
Building the accelerator stack - 4
![Page 15: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/15.jpg)
Copyright ©2009, Nallatech. 15
ISI high density Custom Interconnect 1526 pin HILO Connector 0.8mm pitch
Provides LVDS links to upper module(s)
Building the accelerator stack - 5
![Page 16: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/16.jpg)
Copyright ©2009, Nallatech. 16
Building the accelerator stack - 6
Fits onto connectors of FSB-BASE module
![Page 17: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/17.jpg)
Copyright ©2009, Nallatech. 17
Building the accelerator stack - 7
FSB-COMPUTE module #1 mates with connector Heatsinks applied to user FPGAs
![Page 18: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/18.jpg)
Copyright ©2009, Nallatech. 18
Building the accelerator stack - 8
Another ISI high density connector mates with FSB-COMPUTE #1 providing LVDS links to another upper module
![Page 19: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/19.jpg)
Copyright ©2009, Nallatech. 19
Building the accelerator stack - 9
FSB-COMPUTE #2 mates with the connector
Heatsinks applied to user FPGAs
![Page 20: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/20.jpg)
Copyright ©2009, Nallatech. 20
Building the accelerator stack - 10
The final ISI high density connector provides another LVDS link
![Page 21: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/21.jpg)
Copyright ©2009, Nallatech. 21
Building the accelerator stack - 11
The FSB-EXPANSION module mates with the connector, completing the stack of 5 Xilinx user FPGAs + FSB interface FPGA
![Page 22: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/22.jpg)
Copyright ©2009, Nallatech. 22
Building the accelerator stack - 12
Heatsinks are fitted to user FPGA of FSB-Expansion module
![Page 23: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/23.jpg)
Copyright ©2009, Nallatech. 23
Building the accelerator stack - 13
The complete stack… Raw Compute Performance
> 500GF SPFP > 200GF DPFP >> 5TOPs Integer / Bit Manipulation
Power Consumption Up to 130 Watts Maximum
24 Watts Max per FPGA/Memory
Stack is currently factory configured Updating for Customer Configuration
Insertion / Extraction Tool
Calibration Software
90mm
60mm
70mm
![Page 24: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/24.jpg)
Copyright ©2009, Nallatech. 24
Stack Level Functional Block Diagram
DDR-IISRAM
DDR-IISRAM
DDR-IISRAM
DDR-IISRAM
Virtex-5 User FPGA
Virtex-5 User FPGA
Flash
JTAG
Power
Virtex-5 Interface / User FPGA
64-bit/1,066MHzFront Side Bus
GTP
GTP
QDR-IISRAM
QDR-IISRAM
QDR-IISRAM
QDR-IISRAM
LVDS
LVDS
Virtex-5 User FPGA
DDR-IISRAM
DDR-IISRAM
DDR-IISRAM
DDR-IISRAM
Virtex-5 User FPGA
Virtex-5 User FPGA
64 LVDS pairs @ 800MHz = 6.4GB/sec
Latency = 20ns
128 LVDS pairs @ 800MHz = 12.8GB/sec
Latency = 20ns
![Page 25: HotChips 2009 Xeon Socket Filler FPGA Accelerators€¦ · Common function library over FSB, QPI , ... VHDL IP cores Reference designs ... Nallatech. 10 FSB-Expansion Module](https://reader031.vdocuments.net/reader031/viewer/2022022601/5b458d877f8b9a4b558bbe80/html5/thumbnails/25.jpg)
Thank You
www.nallatech.com
Headquarters Design & Sales Manufacturing