í ô r ò ð ï > µ ï w &w' } v d } } [ >...

18-643-F20-L03-S1, James C. Hoe, CMU/ECE/CALCM, ©2020

18-643 Lecture 3:FPGA on Moore’s Law

James C. HoeDepartment of ECE

Carnegie Mellon University


Housekeeping

• Your goal today: get caught up on 3 decades of progress (upto 2010’ish)

• Notices– Complete survey on Canvas, past due– Handout #2: lab 0, due noon, 9/11– Handout #3: term project on Canvas– Look for Lab 1 handouts on Friday

• Readings– Ch 1, Reconfigurable Computing– for next time: skim [Ahmed, et al., 2016] and

[Gaide, et al. 2019]


Where we stopped last time:FPGA as Universal Fabric

I

I/O pins

programmable lookup tables (LUT) and flip-flops (FF)

aka “soft logic” or “fabric”

Inte

rcon

nect

LUT FF

programmable routing


Fast-forward through Moore’s Law

[Table 1, UltraScale Architecture and Product Datasheet: Overview]

wha

t hap

pene

d is

m

ore

than

Moo

re

XC2064/XC2018 Logic Cell Arrays: Product Specification


30 Years of Becoming Hardwired


Why Hardwired Logic

• LUTs can do everything (digital)• Why hardwired flip-flop in CLB?

– would take 4 LUTs to make 1 M-S flip-flop– LUT-built FF would have poor timing– almost all designs affected in cost and speed

• Makes sense to hardwire a functionality– needed by everyone (or by the big customers)– expected benefit outweigh displaced LUT area, i.e.,

• much more expensive/slow in LUTs • easy/cheap to ignore when not in use

Hardwiring is a great thing if it is usable and is used


E.g., Special Support for Addition

• A full-adder fits perfectly in 1 CLB with 2x3LUTs• But carry propagation slow---flow through several

configurable connections and two switch blocks• Addition is pretty important to most designs

3-LUT

3-LUT

cinab

sum

cout

*

FF

sum

cout


3-LUT

3-LUT

sum

*

FF

sum

Fast Carry Logic (1990s)

ab

*

fast-carry path

• Cost = 1 (real) wire and 1 mux• Huge win in adder performance

If arithmetic is so important, why not put in real adders? How about multipliers?

cout


Hard Multipliers (2000s)

• Motivating forces– DSP became an important domain– very expensive and slow to multiply in LUTs– dies large enough to spare some area

• Virtex-II hardwired multiplier “macro” blocks– 18-bit inputs, full 36-bit product– explicit instantiation or inferable from RTL– relatively cheap (since native implementation)– but no hard adders, why?

Adders came later as a part of MAC in DSP slicesIn the meanwhile, multiply faster/cheaper than add!!


Ultrascale DSP48E2

+

x +post-adder

(accumulate)27x18

pre-adder

27

27

2718 45

48

48

optional pipeline stagesinferable from RTL and retiming Where are these hard DSP slices?

How to get to them?


SRAM• Flip-flops relatively scarce (only 1-bit per CLB)• Need more storage when applications moved

beyond FSM controllers and glue logic• Option A: LUTs repurposable as 16x1-bit SRAMs• Option B: 4Kb (now 32Kb) 2-ported SRAM blocks

– very compact, very fast because native in silicon– explicit instantiation or inferable from RTL

(tool can even decide which SRAM option to use)– configurable and combinable to a wide range of

sizes and aspect ratiosWhere are they? How to connect up to them?


MACROs: a disturbance in the force . . .

[Figure 48: Virtex-II Platform FPGAs: Complete Data Sheet]

Too much vs not enough?Benefit of using macro outweigh cost of getting to one?


Processor Cores

• Not everything needs to be in hardware; not everything improves when made into hardware

• Augment fabric with simple embedded CPUs– provide universality of functionality– easy handling of irregular, sequential operations– easy handling anything that doesn’t need to be fast

• Interests developed in early 2000s when FPGA applications grew to whole systems with DRAM, video, and Ethernets, etc.

Hard or soft core?


Hardcore vs Softcore• First came PowerPC hardcores on Virtex-II

– you got 2 whether you needed it or not– new tool promote IP-based system building– entirely soft-logic built surroundings: busses and IPs

(DRAM controller, Ethernet, video, . . . .)

• Microblaze softcores took over in later rounds– Xilinx proprietary ISA (runs OS, gcc and all that)– configurable for cost-performance tradeoff– available in RTL to some folks– by this time, softcore footprint and performance

was acceptable Several 3rd-party softcores existed in that era, e.g., LEON SPARC


BRAMor logicin fabric

I/OI/O

Embedding PowerPC in Fabric

• everything else is soft • two hierarchies of

soft-logic busses (slow and slower)

• special on-chip memory (OCM) port allows ld/st directly into fabric

• CoreGen Library of IPs to hang off the busses

PPC405

I$

OCM

DMAbridge

DDRcontrl

D$

VideoEthernet

on-chip peripheral bus

processor local bus

2x


Hardcores Return in Virtex7 (~2010)

• This time in a complete, full-speed, fully-capable, two-core Cortex-A9 system

• Latest Ultrascale uses 64-bit ARMv8 Cortex-A53 + ARM R5 + Mali GPU

• Why ARMs?

[Figure 3-1, Zynq-7000 All Programmable SoC Technical Reference Manual]


Hardcore vs Softcore• Table 4.2: The Zynq Book

• Table 4.3: The Zynq Book

Processor Configuration DMIPs

MicroBlaze900LUT/700FF/

2BRAMto

3800LUT/3200FF/6DSP/21BRAM

area optimized (3-stage) 196

perf. optimized (5-stage) with branchoptimizations 228

perf. optimized (5-stage) without branch optimizations 259

ARM Cortex-A9 1GHz; both cores combined 5000

??from book

Processor Configuration CoreMark

MicroBlaze 125MHz; 5-stage (Virtex-5) 238

ARM Cortex-A9 1GHz; both cores combined 5927

ARM Cortex-A9 800MHz; both cores combined 4737

PPC405 about 1/5 of ARM in Figure 4.3 of The Zynq Book


Hardwired IPs Added Over Time

• 1990s– fast carry– LUT RAM– block RAM

• 2000s– programmable clock

generator– PowerPC core– gigabit transceiver– multiplier and DSP splices– Ethernet and PCI-E

• 2010s– system monitor – ADC– power management– ARM cores and GPU– DRAM controller– floating point arithmetic– “UltraRAM” hierarchy

(up to 500Mbits)– HBM controllers

• 2020s . . . . next lecture


Chicken or Egg First?• 1990s: glue logic, embedded cntrl, interface logic

– reduce chip-count, increase reliability– rapid roll-out of “new” products

• 2000s: DSP and HPC– strong need for performance– abundant parallelism and regularity– low-volume, high-valued

• 2010s: communications and networking– throughput performance– fast-changing designs and standards– price insensitive– $value in field updates and upgrades


SoC with reconfigurable fabric (2010s)

[http://www.xilinx.com/products/silicon-devices/soc/zynq-ultrascale-mpsoc.html]


Die Area “Return on Investment”

[Viv

ado

scre

ensh

ot X

C7z0

20]

Soft-logic logic dominates die area, but compute/storage concentrated in DSP and BRAMconsider what if 100% soft or 100% hard


Xilinx ASMBL Architecture(Application Specific Modular Block Arch.)

• Xilinx fabric assembled from composable tall-and-thin strip types, CLB, BRAM, DSP, I/O, etc.

• Derivative products at the cost of just new masks– vary capacity by composing

more or less strips– domain-specialization by

varying ratios of strips e.g., {DSP+IP} vs logic for

DSP vs ASIC replacement market – variations handled by parameterization in design

tool algorithms


Stacked Silicon Interconnect (SSI)

[Figure 1, Stacked & Loaded: Xilinx SSI, 28-Gbps I/O Yield Amazing FPGAs, Xcell, Q1 2011]

• 2.5D stacking: multiple dies on passive interposer– lower latency, higher bandwidth, lower power than

crossing package– much better yield than equivalent

capacity monolithic device– mix dies for domain-specialization– possible to insert customer

proprietary dies?


Intel’s take on 2.5D with EMIB

[Figure 8, Enabling Next-Generation Platforms Using Altera’s 3D System-in-Package Technology]

• monolithic fabric• displace noisy, hot

analog IPs• connect same-

package HBMs• connect 3rd-party

chiplets?


Xilinx Ultrascale Offerings

[Table 1, UltraScale Architecture and Product Datasheet: Overview]


Intel Stratix-10 Offerings

[Intel Stratix 10 Product Table]


Today’s Diverging Architectures

Are they FPGAs?• spatial data/compute

• highly concurrent• finely controllable• reprogrammable

[Xilinx Versal] [Intel Agilex]

[Achronix Speedster MLP]


Parting Thoughts

• FPGAs steadily moved away from universal fabric – efficiency of hardwired logic (driven by application

demands) complements flexibility of reconfig. logic– architected deliberately to play up this advantage

• Retain a high degree of regularity to ease design and manufacturing– fastest way to use up transistors from Moore’s Law– power and performance advantage by just being

first on new process

• Architectural evolution both push-and-pull with applications

í ô r ò ð ï > µ ï w &w' } v d } } [ >...

Documents

v Z ] oD } } & µ o o ] Z u v ñ l ñ l î ì î ì - Michigan · >> ' e ð õ ì í ì z > z ð õ ï í í kzz ð õ ï î ï kzz ð õ ï î ï kzz ð õ ï î ï kzz ð õ ï

Basket Class - University of Kentuckypike.ca.uky.edu/files/fcs1217.pdf · Pikeville, KY ð í ñ ì í- í î ó í ~ ò ì ò ð ï î- î ñ ï ð ~ ô ì ì î ï ï- í ï õ

2019-07 July DRAFT · W P ï } ( í í Z W l l µ ] o o o Z X } u W XK X } Æ ð ï î ð U d o o Z U &> ï î ï í ñ r ð ï î ð ] o ] Ç Y µ ] o ^ Z } Á

SCIENTIFIC INSTRUMENT NEWS Vol.61No · Î Ï ¡« amp¥u¦ w È Î ++ Ò Ñ& Ð ¹ w Ñ @4 Ï Îå Ï¡« amp ÍÓ È " Î ++ Ò Ñ& Ð ¹ w Ñ @4 Ï ¢ 4 Ñ §îb ¤ ¢ ¡¥ ¥ ¦

2018-05 May Newsletter FINAL · w p ï } ( í î z w l l µ ] o o o z x } u w xk x } Æ ð ï î ð u d o o z u &> ï î ï í ñ r ð ï î ð 6krz dqg 7hoo 5hplqghu ,q rughu wr

K } W } P u l í X d/s/ ^ D/ ^ ~ ð U ì î X WZK h K / Ed1&/ ~ î U ñ ï X d/s/ … · 2017. 2. 1. · í í í í í d } o î î î î d } o ï d } o ð ð ð ð ð ð ( d } o

Y^]@fizika.imfm.si/jeromen/nse.pdfÞß à á âVãäJå,æç èé ê ë â ì íâ ß î/ï ð/â>ñ â è ñî/ï ð/âVñ ï á/ò ó ôõà îöíó ï î/è/ì âbï î/ï ó ð/à

ð î ð ï - Simrad Yachting

v : W Z Ç ] } Z Z î ì í ó U s } o ñ ~ ï W î í ï ï r ð ï ... · / v : W Z Ç ] } Z Z î ì í ó U s } o ñ ~ ï W î í ï ï r ð ï X /^^E î ï î í r í ô î

EjDKZd : ZK^ K^ · 2020. 5. 21. · ò ï ñ & >/W ~DKdK d y/ ñ õ í ñ î ì ï ï ð í ð ð î } ò ð ñ &> s/K ~D E/ K í î ñ í ì î ð ï õ ð ï î } ò ñ õ&Z E /^

î õ v } À u î ì î í í ð ï KE'Z ^

Aaa - VARIEDADES DE PITAYA ed fev19 · Z u ] } > } } ~h ' ! v } ] ^ } í î ï ð ñ W } µ } í î ï ð ñ Z } µ Ì í î ï ð ñ

í X î X ï X ð X í X î X ï X

VITÃ RIA OFFICE FINAL - SME · ð ï $17Ï1,&$ 1'21*$/$ -2$48,0 e î ñ ï ð ò ï ð d/^^ k ð ð $1721,&$ 3$75,&,$ /285(1d2 1(72 E î ñ ð ô ò õ î D/^^ K ð ñ $5,$1$ 9$/e5,$

BCIT 201 ô Entry Student Survey - READ ME · í õ or younger î ô 9 î ì - î ð ð ï 9 î ñ - î õ í ô 9 ï ì - ï ð ò 9 ï ñ - ï õ î 9 ð ì - ð ð í 9 ð ñ -

E&KZD ' ^d/ME · í X î ð ì í X î ð ì í X î ð ì ~ ô µ v } P } u ] o Ç } µ v } P ð X ó õ ð X í ò ó ï X í ð ï X õ ì õ ï X ð ð ì X õ ï ï

webbook.me.go.krwebbook.me.go.kr/DLi-File/099/004/001/5565738.pdf- iv - YZ# Ï Î ÔÏÐ ÜÝ ÏÏ Ü ¾ÎÜ Ð Ï ¾ÎÜ Ü Ô¾ ^ Ï Î ¾Ï Ï Î Ô ÐÜ ÏÔ Ô Ð x¾ Ï Ï Î

7KH EDVLFV WKH PRGHO - Power BI Gebruikersgroep ·

í ó ð ï õ ì ð l ì ñ l î ì î ì î ì W î ð î í ò ð ô ó r ì ð ì ... · 2020-05-22 · í ó ð ï õ ì ð l ì ñ l î ì î ì î ì W î ð î í ò ð ô

0.#+,& - polimold.com.br · BXC D1 D2 D3 D4 E H F(Dimensãomm) í ì í ð î ì î ô î õ ï î U ñ í ô ï U î y î ì î ñ ï ô ï ò ð ó î ï ñ y î ñ

Henry Jensen [Read-Only] · D o v } u u o ] P v v ð U ð ñ ñ ô ï ~ í X õ '/ î ô ~ ï ï X ó ò ~ ó X î E^ ~ ] v î U ï õ î í í ï ~ ð X ó > µ v P ï ô ~ ï ï

AÃ±o acadÃ©mico en Reino Unido 2021-2022 · o o W v u ] v } î ó U X / Ì X U ï } ï X î ô ì î ì rD ] = ï ð ò í õ î ó ð ó ï ì l l = ï ð ò î õ ò ï ô î

o [ v ] } v o - Polycert client V13.pdf · W P ð µ î í WK>z Zd t î î À v µ W Ì v ï ð ï î ì ZKh: E d o X W = ï ï ð ò ó î ñ ò ð ó ì r r u ] o W } v } o Ç X

FÂ æG?G0 ¶ 9 1 Fþ0b%$FçFûFôFÔFöFÃ€¦ · ï ð x ð ó x ï ï õ x í í í x ï î í x ñ î ò x ó ó x ð ð ð x ô í ì x ð î î x õ î í x î ó x ì ñ ì

D^ ] ] } } W ] u v ] } µ o µ o t > ] µ o í ô X ì ï ì l î ...§ão... · E, E, E, E, W W W W / / / / D D D ñ ô í î í ò î ï ð ñ î ð ò ô í î ï î ï ð

ðê ø Ü ø ÷î ðõ Ù ø ÷îì ð ð ð ðø é ïß î ð < î ï ú ð < ð Ý ø ... · Ù ï ó Ö ó Ö ì ÷Ü ó Ö üú ð ð ð ð ð ð ð ð ð ð ð ð ð ð ð

Ύσερη Βζανινή Περίοδος · Θράκη ( ï ð î-1345) –με τον εμίρη της Βιθυνίας Ορχάν ( ï ð ò- í ï ð ó): τα συμμαχικά

ð ð ò ô î' Z/ > EdKE/K >s ^ K^d î ï ò ó ï õ í í î ó ñ · 2018. 5. 2. · ð ð ò ô î' z/ > edke/k >s ^ k^d î ï ò ó ï õ í í î ó ñ ð ð ò ô ï' z/ >

Earnings Presentation Supplement - 4Q 2019 - …...^ u o o > } v ~ G ¨ î U ñ ì ì ¨ ï ò ï ¨ ï ó ò ¨ ï ò ì ¨ ï ô ñ ¨ ð í ð ¨ ð ï ô ¨ ð î î ¨ ð ï í

µ Ð Ð Ï Ö Ä Ý Î Ð © Â Î Â Ñ Î Ð ¿ Æ Ñ Ê Õ Ò ¾ Ñ Æ Ê …gym-geroskipou-paf.schools.ac.cy/images/2019-2020/1.YLIKO...Title Microsoft PowerPoint - Î Î½Î±Ï

Ð Ñ ÐºÐ¾Ð²Ð¾Ð´Ñ Ñ Ð²Ð¾ Business.Online (Draft 01062020) - UniCredit … · ¼ » Ä ¥ É £ ¤ í û Ó ë Ü ý î Ô Ñ î Ó ï Ñ ï ÷ î î Ö ö ÿ í ÷

Basket Class - University of Kentucky · Pikeville, KY ð í ñ ì í- í î ó í ~ ò ì ò ð ï î- î ñ ï ð ~ ô ì ì î ï ï- í ï õ ì. Fax: ~ ò ì ò ð ï î- î

Investor Presentation Q2-2019 v2 · 2019-08-02 · ò 4 · 0dlq +ljkoljkwv 0loolrq75/ ï u í ð ï u ï ó î u õ ð î u ò î î u í õ ï u ï ñ ï u ð ô î u ô î u ñ

EF Bril...î ð l ì ï l î ì î ì î å. î ð l ì ï l î ì î ì ï Æ X á ^

undergraduate program in physics...Project î î Gained 96 credits 25. 0824399 Summer Training ï ï Gained 79 credits Supportive ourses í ð 1. 0827202 alculus î ð ì ð 0827101