physical layer aggregation update -...
TRANSCRIPT
![Page 1: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/1.jpg)
1IEEE 802.3 HSSG
Physical Layer Aggregationupdate
Howard FrazierShimon MullerDrew Perkins
November, 2006Dallas, TX
![Page 2: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/2.jpg)
2IEEE 802.3 HSSG
Outline
• Application needs• Resources• 802.3ad Link Aggregation• 802.3ah PME Aggregation• Aggregation at the Physical Layer (APL)• Configuration examples• Application with various PHYs• Summary
![Page 3: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/3.jpg)
3IEEE 802.3 HSSG
Application needsBackplane
Scalable speedResiliencyMany ports in small spaceTrade-off cost of signaling rate vs. number of channels
Copper (data center)Scalable speedResiliencyRelatively inexpensive mediumCable characteristics limit signaling rate
Short Haul FiberScalable speedResiliencyRelatively inexpensive mediumCable characteristics limit signaling rate
Long Haul FiberScalable speedResiliencyRelatively expensive mediumEconomics limits signaling rate
![Page 4: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/4.jpg)
4IEEE 802.3 HSSG
ResourcesBackplane
4 x 2.5 G common todayVariable lane widths common
XAUI, IB, PCI-e10GBASE-KR nearing completionSignaling rates > 10 G will be challenging
Copper (data center)10GBASE-T, 10GBASE-CX4With time, cost and power consumption will declineSignaling rates > 10 G will be challenging
Short Haul Fiber10GBASE-SR, 10GBASE-LX4, 10GBASE-LRMMultimode fiber at 850 & 1300 nmSignaling rates > 10 G will be challenging
Long Haul Fiber10GBASE-LR, 10GBASE-ER, 10GBASE-LW, 10GBASE-EWSingle mode fiber at 1300 & 1550 nmSignaling rates > 10 G will be expensive
![Page 5: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/5.jpg)
5IEEE 802.3 HSSG
ResourcesBackplane
25 G serial may require multilevel signaling, higher cost channels, more signal processing
higher power, cost and complexityn x 25 G will not be economically feasible any time soon
Copper (data center)Quad (octal?) 10GBASE-T PHYsdrive growth of multi-port switchesPackaging in multiples of four fits well with aggregation in multiples of four
Short Haul FiberParallel ribbon fiber VCSEL arrays demonstratedMulti-port (quad?) 10GBASE-LRM
Long Haul FiberPhotonic Integrated Circuits
10 x 10 G demonstratedDeclining cost of WDM
![Page 6: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/6.jpg)
6IEEE 802.3 HSSG
802.3ad Link Aggregation• Specified in Clause 43
• LAG is performed above the MAC
• LAG assumes all links are:– full duplex– point to point– same data rate
• Provides graceful recovery from link failures
• Traffic is distributed packet by packet
• All packets associated with a given “conversation” are transmitted on the same link to prevent mis-ordering
![Page 7: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/7.jpg)
7IEEE 802.3 HSSG
802.3ad Link Aggregation
![Page 8: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/8.jpg)
8IEEE 802.3 HSSG
802.3ad Link AggregationMAC Client
PHY
MAC
PHY
MAC
PHY
MAC
PHY
MAC
distributor collector
MAC Client
PHY
MAC
PHY
MAC
PHY
MAC
PHY
MAC
distributor collector
![Page 9: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/9.jpg)
9IEEE 802.3 HSSG
802.3ad Link Aggregation43.2.4 Frame Distributor…This standard does not mandate any particular distribution algorithm(s); however, any distribution algorithm shall ensure that, when frames are received by a Frame Collector as specified in 43.2.3, the algorithm shall not cause
a) Mis-ordering of frames that are part of any given conversation, orb) Duplication of frames.
The above requirement to maintain frame ordering is met by ensuring that all frames that compose a given conversation are transmitted on a single link in the order that they are generated by the MAC Client; hence, this requirement does not involve the addition (or modification) of any information to the MAC frame, nor any buffering or processing on the part of the corresponding Frame Collector in order to re-order frames.…
![Page 10: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/10.jpg)
10IEEE 802.3 HSSG
802.3ad Link Aggregation• Does not change packet format
– No added headers or sequence numbers– Type/Length interpretation unchanged
• Does not require added buffers– No fragmentation or reassembly
• Does not re-order or mis-order packets• Does not add significant latency• Does not increase the bandwidth for a single
conversation• Achieves high utilization only when carrying multiple
simultaneous conversations• Is not transparent to some 802.1 sub-layers
![Page 11: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/11.jpg)
11IEEE 802.3 HSSG
802.3ad Link Aggregation• Can link aggregation be “fixed”?• Not so easy to accomplish
– Inspect headers deep into packetor
– Add sequence number to packet• Change the packet format, start a food fight with dot1
and– Add LARGE buffers to receiver– Add LONG delay
• Still will not achieve linear scaling
![Page 12: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/12.jpg)
12IEEE 802.3 HSSG
802.3ad Link Aggregation• Is a very good thing
– It does what it was intended to do– It is relatively easy to implement and use
• Does not always provide a linear multiple of the data rate of a single link– N aggregated links usually do not provide
N times the bandwidth
• Incurs a linear multiple of the cost of a single link– N aggregated links cost N times as much as a single link,
because everything must be replicated
• Appears to the user as N individual links, which must be individually managed
![Page 13: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/13.jpg)
13IEEE 802.3 HSSG
802.3ah PME Aggregation • Specified in Clause 61• Supports multi-pair bonding for
10PASS-TS and 2BASE-TL• Performed in the Physical Layer• Aggregates up to 32 Physical Medium Entities
(PMEs)• Ensures low packet latency and preserves
packet sequence• Scalable and resilient to PME failure
![Page 14: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/14.jpg)
14IEEE 802.3 HSSG
802.3ah PME Aggregation
MII
γ
![Page 15: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/15.jpg)
15IEEE 802.3 HSSG
802.3ah PME Aggregation
MAC Client
MAC
PME
PME Aggregation
PMEPMEPME
MAC Client
MAC
PME
PME Aggregation
PMEPMEPME
![Page 16: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/16.jpg)
16IEEE 802.3 HSSG
802.3ah PME Aggregation
![Page 17: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/17.jpg)
17IEEE 802.3 HSSG
802.3ah PME Aggregation• Fragments can vary in size from 64 to 512 octets• 16 or 32 bit Fragment Check Sequence (FCS)
provided by the underlying TC sublayer• Data rate can vary by 4:1 between fastest and
slowest PME in an aggregation• Differential delay restricted to 15,000 bits• The combination of fragment size, differential
delay, and speed ratio limits the size of the reassembly buffer to 214 bits (2 kB) per PME
![Page 18: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/18.jpg)
18IEEE 802.3 HSSG
802.3ah PME Aggregation
• Fragmentation and reassembly supports much higher link utilization compared to 802.3ad
• Traffic in a single conversation is not limited to traversing a single link
• Provides a nearly linear increase in bandwidth for a (less than) linear increase in cost
![Page 19: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/19.jpg)
19IEEE 802.3 HSSG
Aggregation at the Physical Layer (APL)
• The PME aggregation concept can be used with existing 10GBASE PHYs
• Will need a fragment CRC (or equivalent) to protect against fragment loss or corruption– must protect fragmentation header at the very least
• Fragmentation header can be changed if desired• Preamble should be propagated, not stripped
– various standards-based and proprietary uses
• maxFragmentSize, minFragmentSize, maxDifferentialDelay and maxSpeedRatio can be changed as needed to balance efficiency vs. buffer size and latency
![Page 20: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/20.jpg)
20IEEE 802.3 HSSG
APL fragment format
IPG Preamble MAC headers & data IPG
Fragment 1Frag Hdr Frag Hdr
Frag Hdr Frag Hdr
Frag Hdr Frag Hdr
PCS 1
PCS 2
PCS n
Seq # S E
14 1 1
Preamble
CRC-8
FCSSFD
Fragment n+1CRC-8
Fragment 2CRC-8
Fragment nCRC-8
Fragment n+2CRC-8
Fragment n+nCRC-8
![Page 21: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/21.jpg)
21IEEE 802.3 HSSG
Fragment format considerations• Shorter fragment header + longer
fragment length = lower overhead• Longer fragment sequence #
= greater skew tolerance– Estimate of required skew tolerance
= 10 us
Eff (%)*Frag size
95.564
9132
8416
738
* assuming 14 bit sequence #
• 16 or 32 byte fragment size seems reasonable• 14 bit sequence number seems reasonable• Fragments are delimited just like packets on any
given interface
![Page 22: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/22.jpg)
22IEEE 802.3 HSSG
Fixed vs. variable fragment size
Efficiency as a function of packet length for fixed size fragments
00.10.20.30.40.50.60.70.80.9
1
64 192 320 448 576 704 832 960 1088 1216 1344 1472
8163264
min=65.6% avg=72.2% max=72.7%min=68.4% avg=82.9% max=84.2%min=61.9% avg=88.6% max=91.4% min=48.5% avg=89.8% max=95.5%
![Page 23: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/23.jpg)
23IEEE 802.3 HSSG
Fixed vs. variable fragment size
Efficiency as a function of packet length for variable size (64, 32, 16, 8) fragments
00.10.20.30.40.50.60.70.80.9
1
64 192 320 448 576 704 832 960 1088 1216 1344 1472
min=83.3% avg=94.2% max=95.5% CAIDA avg=94.1%
(Cooperative Association for Internet Data Analysis packet size probability distribution courtesy of Glen Kramer)
![Page 24: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/24.jpg)
24IEEE 802.3 HSSG
Fragment size summary
• Decimation into variable size fragments yields the highest efficiency for all packet sizes
• The bulk of a packet is always decimated into the largest size fragments
• The tail of a packet is decimated into the optimal combination of fragments
• Will need to indicate fragment size in the fragment header
![Page 25: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/25.jpg)
25IEEE 802.3 HSSG
APL location
MAC Client
MAC
PCS
APL
PCSPCSPCS
PMAPMAPMAPMA
PMDPMDPMDPMD
MAC Client
MAC
PCS
APL
PCSPCSPCS
PMAPMAPMAPMA
PMDPMDPMDPMD
Existing10GBASE PHY
new
![Page 26: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/26.jpg)
26IEEE 802.3 HSSG
APL summary
• Packet fragmentation, distribution, collection and reassembly similar to 802.3ah PME aggregation
• Accommodates reasonable differential delay
• Assumes equal speed links• Assumes point to point, full duplex links• Resilient and scalable
![Page 27: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/27.jpg)
27IEEE 802.3 HSSG
APL summary
• Ensures ordered delivery• Detects lost or corrupted fragments• Minimal added latency• Fits well with multi-port (quad/octal) PHYs• Line code independent thus providing
compatibility with all existing PHYs• Uses existing compatibility interfaces (e.g.
XGMII, XAUI)
![Page 28: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/28.jpg)
28IEEE 802.3 HSSG
APL control protocol• Will need a protocol to:
– detect aggregation link partners– configure aggregations– detect failures– reconfigure
• Link Aggregation Control Protocol (LACP) uses Slow Protocol frames for these functions– Existence proof, see 43.4
• Clause 61 PME Aggregation Discovery relies on remote PHY register access– Probably do not want to assume this
![Page 29: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/29.jpg)
29IEEE 802.3 HSSG
Configuration Examples
![Page 30: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/30.jpg)
30IEEE 802.3 HSSG
Default configuration
MAC
10GBASE-R PHY
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
X-point
(example implementation for illustrative purposes)
![Page 31: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/31.jpg)
31IEEE 802.3 HSSG
40Gb/s Agg link connected
MAC
X-point
10GBASE-R PHY
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
PLA
(example implementation for illustrative purposes)
![Page 32: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/32.jpg)
32IEEE 802.3 HSSG
20Gb/s Agg link added
MAC
X-point
10GBASE-R PHY
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
APL
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
APL
10GBASE-R PHY
10GBASE-R PHY
(example implementation for illustrative purposes)
![Page 33: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/33.jpg)
33IEEE 802.3 HSSG
Port reconfigured
MAC
X-point
10GBASE-R PHY
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
MAC
APL
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
APL
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
10GBASE-R PHY
APL
10GBASE-R PHY
10GBASE-R PHY
(example implementation for illustrative purposes)
![Page 34: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/34.jpg)
34IEEE 802.3 HSSG
Application with various PHYs
![Page 35: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/35.jpg)
35IEEE 802.3 HSSG
…….…….
Multi-wavelength PHY
MAC
RECONCILIATION
APL
PMD
PMA
PCS
PMD
PMA
PCS
PMD
PMA
PCSMultiwavelength
PHY
Optical Mux / DeMUX
MEDIUMMDI
…….
![Page 36: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/36.jpg)
36IEEE 802.3 HSSG
…….
Multi-wavelength PHY, XGMIIMAC
RECONCILIATION
APL
PMD
PMA
PCS
PMD
PMA
PCS
PMD
PMA
PCSMultiwavelength
PHY
Optical Mux / DeMUX
MEDIUMMDI
…….…….…….
XGMII
![Page 37: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/37.jpg)
37IEEE 802.3 HSSG
…….
Multi-wavelength PHY, XAUIMAC
RECONCILIATION
APL
PMD
PMA
PCS
PMD
PMA
PCS
PMD
PMA
PCSMultiwavelength
PHY
Optical Mux / DeMUX
MEDIUMMDI
…….XGXSXGXS XGXS
XGXSXGXS XGXS
…….…….…….…….
XAUI
![Page 38: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/38.jpg)
38IEEE 802.3 HSSG
Multi-wavelength PHY, nXAUIMAC
RECONCILIATION
APL
nXGXS
nXGXS
nXAUI
…….PMD
PMA
PCS
PMD
PMA
PCS
PMD
PMA
PCSMultiwavelength
PHY
Optical Mux / DeMUX
MEDIUMMDI
…….
![Page 39: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/39.jpg)
39IEEE 802.3 HSSG
Multi-channel PHY
MAC
RECONCILIATION
PMD
PMA
PCS
MEDIUM
PMD
MDI
PMA
PCS
PMD
PMA
PCS
Multiconductor Cu CableRibbon Fiber
MultichannelPHY…….…….
…….APL
![Page 40: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/40.jpg)
40IEEE 802.3 HSSG
…….
Multiple 10GBASE-T PHYsMAC
RECONCILIATION
APL
Auto-Negotiation
PMA
PCS
Auto-Negotiation
PMA
PCS
Auto-Negotiation
PMA
PCS
10GBASE-T PHY
MEDIUM
MDI
…….…….…….
XGMII
MEDIUM
MDI
MEDIUM
MDI…….
![Page 41: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/41.jpg)
41IEEE 802.3 HSSG
…….
Multiple 10GBASE-CX4 PHYsMAC
RECONCILIATION
APL
PMD
PMA
10GBASE-X PCS
PMD
PMA
10GBASE-X PCS
PMD
PMA
10GBASE-X PCS
10GBASE-CX4 PHY
MEDIUM
MDI
…….…….…….
XGMII
MEDIUM
MDI
MEDIUM
MDI…….
![Page 42: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/42.jpg)
42IEEE 802.3 HSSG
Summary• There is a broad set of applications for
aggregated links– Backplanes, data centers, short and long haul
optical
• Existing 10GBASE Physical layers can be aggregated
• 802.3ad LAG does not fully address the need
• 802.3ah PME aggregation is optimized for DSL-based links
![Page 43: Physical Layer Aggregation Update - IEEE-SAgrouper.ieee.org/groups/802/3/hssg/public/nov06/frazier_01_1106.pdf · 6 IEEE 802.3 HSSG 802.3ad Link Aggregation • Specified in Clause](https://reader031.vdocuments.net/reader031/viewer/2022030613/5ade44847f8b9ae1408e250d/html5/thumbnails/43.jpg)
43IEEE 802.3 HSSG
Summary
• Concepts from 802.3ad LAG and 802.3ah PME aggregation can be re-used to define Aggregation at the Physical Layer (APL)
• APL can provide a scalable, resilient interface using existing 10G PHYs
• APL can also be used with newly defined PHYsthat provide higher serial rates