PCIe memo

Here’s a quick ref for PCIe Lanes, rates and bandwidths. The lower bandwidth than what may usually be thought of is because of the electrical/data encoding. Bits is shown at the top, and Bytes blow.

PCIe versionYearTransfersEncoding x1 speedx4 speedx8 speedx16 speed
120042.5GT/s8b/10b2Gb/s8Gb/s16Gb/s32Gb/s
220075GT/s8b/10b4Gb/s16Gb/s32Gb/s64Gb/s
320108GT/s128b/130b7.88Gb/s31.52Gb/s63.04Gb/s126.08Gb/s
4201716GT/s128b/130b15.76Gb/s63.04Gb/s126.08Gb/s252.16Gb/s
5201932GT/s128b/130b31.52Gb/s126.08Gb/s252.16Gb/s504.32Gb/s
6202264GT/s242B/256B
PCIe versionYearTransfersx1 speedx4 speedx8 speedx16 speed
120042.5GT/s250MB/s1GB/s2GB/s4GB/s
220075GT/s500MB/s2GB/s4GB/s8GB/s
320108GT/s985MB/s3.94GB/s7.88GB/s15.76GB/s
4201716GT/s1.97GB/s7.88GB/s15.76GB/s31.52GB/s

If you need to know what devices are in slots and what they are capable of speed/width vs what they have negotiated to use ‘sudo lspci -vv’ in linux. LnkCap and LnkSta are what you’re looking for. use lspci -tv to see any ‘switch’ devices.

If you need to compare IB devices…

InfiniBandYearrate Gb/s/linkEncoding x1 bandwidth Gb/sx4 bandwidth Gb/sx8 bandwidth Gb/sx12 bandwidth Gb/s
SDR2001-32.5Gb/s8b/10b281624
DDR20055Gb/s8b/10b4163248
QDR200710Gb/s8b/10b8326496
FDR10201110.31Gb/s8b/10b104080120
FDR201114.06Gb/s64b/66b13.654.5109.8163.6
EDR201425.78Gb/s64b/66b25100200300
HDR201850Gb/s64b/66b50200400600
NDR, XDR...