HPE Ethernet 10/25Gb 2-port 621SFP28 | 上机与初始化记录

开箱测评 | Reviews & Unboxing 2025年5月14日

1. First | 序

闲逛某鱼发现的型号: HPE Ethernet 10/25Gb 2-port 621SFP28 Adapter

和 QL41232HLCU 同使用 QL41401 FastLinQ Controller

就是 Hewlett Packard Enterprise 10/25GbE 2P QL41222HLCU-HP Adapter

1.1. Features | 特征

Dual 10/25 Gb ports provide up to 100 Gb/s of bi-directional Ethernet bandwidth per adapter
Jumbo Frame
Stand up
HPE Sea of Sensors 3D
Tunnel Offload(NVGRE and VxLAN)
RDMA over Converged Ethernet (RoCE v2, RoCE v1)
Single-root input/output virtualization (SR-IOV)
IPv6 Acceleration
Preboot eXecution Environment (PXE)
Checksum & Segmentation Offload
VMware NetQueue and Microsoft Virtual Machine Queue (VMQ)
Precision Time Protocol (PTP)
Receive-Side Scaling (RSS)
Receive-Side Coalescing (RSC)
Data Plane Development Kit (DPDK)
Active Health Systems support
Authentication of digitally signed firmware
Additional Security features include: UEFI Secure Boot, Sanitization, Audit Logs and Device-level Firewall
Full RDMA –enable the iWARP stacks on adapters in addition to the ROCE capability. (No iWarp and ROCE
on the same port)

👩‍🏫

About Full RDMA & NPAReP

值得注意的是有着完整的 RDMA支持但并不支持 NPAReP

This adapter supports RoCE v1 and v2. RoCE v2, also sometimes called "Routable RoCE" which adds
Concurrent RoCE v1 and v2 support, SR-IOV support, QoS with hierarchical TX scheduling, ECN-based
congestion control for RoCE v2. RoCE is an accelerated I/O delivery mechanism that allows data to be
transferred directly from the user memory of the source server to the user memory of the destination
server bypassing the operating system (OS) kernel. Because the RDMA data transfer is performed by the
DMA engine on the adapter's network processor, the CPU is not used for the data movement, freeing it to
perform other tasks such as hosting more virtual workloads (increased VM density). RDMA also bypasses
the host's TCP/IP stack, in favor of upper layer InfiniBand protocols implemented in the adapter's network
processor. The bypass of the TCP/IP stack and the removal of a data copy step reduce overall latency to
deliver accelerated performance for applications such as Microsoft Hyper-V Live Migration, Microsoft SQL and
Microsoft SharePoint with SMB Direct.

1.2. OS & SW Version | * 环境

OS

已附有操作系统内核中加载的软件驱动程序qed qede
Transceivers

HUAWEI SFP28-25G-1310nm-10km-SM

2. Initialization | 初始化

2.1. R730XD BIOS

首先进 BIOS 看一下可选参数

总览
固件信息
设备级别配置
端口级别配置

2.2. NIC Info | 网卡信息

dmesg | grep "qe"

[   16.185920] qede 84:00.00: Storm FW 8.59.1.0, Management FW 8.65.1.0 [MBI 8.65.1] [eth21]
[   16.554725] qede 84:00.01: Storm FW 8.59.1.0, Management FW 8.65.1.0 [MBI 8.65.1] [eth22]
[   22.497245] qede 0000:84:00.0 p4p1: renamed from eth21
[   24.141331] qede 0000:84:00.1 p4p2: renamed from eth22
[   29.810922] [qede_link_update:2629(p4p1)]Link is up
[   29.880040] [qede_link_update:2629(p4p2)]Link is up

rdma link

link qedr16/1 state ACTIVE physical_state LINK_UP netdev p4p1
link qedr17/1 state ACTIVE physical_state LINK_UP netdev p4p2

ethtool

ethtool -i p4p1

driver: qede
version: [storm 8.59.1.0]
firmware-version: mbi 8.65.1 [mfw 8.65.1.0]
expansion-rom-version:
bus-info: 0000:84:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: yes
supports-priv-flags: yes

ethtool p4p1

Settings for p4p1:
Supported ports: [ FIBRE ]
Supported link modes:   10000baseLR/Full
Supported pause frame use: Symmetric Receive-only
Supports auto-negotiation: Yes
Supported FEC modes: Not reported
Advertised link modes:  10000baseLR/Full
Advertised pause frame use: No
Advertised auto-negotiation: Yes
Advertised FEC modes: Not reported
Link partner advertised link modes:  10000baseLR/Full
Link partner advertised pause frame use: No
Link partner advertised auto-negotiation: No
Link partner advertised FEC modes: Not reported
Speed: 25000Mb/s
Duplex: Full
Auto-negotiation: on
Port: FIBRE
PHYAD: 0
Transceiver: internal
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000000 (0)

Link detected: yes

lspci

84:00.0 Ethernet controller [0200]: QLogic Corp. FastLinQ QL41000 Series 10/25/40/50GbE Controller [1077:8070] (rev 02)
    Subsystem: Hewlett Packard Enterprise 10/25GbE 2P QL41222HLCU-HP Adapter [1590:021d]
    Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0
    Interrupt: pin A routed to IRQ 487
    NUMA node: 1
    Region 0: Memory at c9020000 (64-bit, prefetchable) [size=128K]
    Region 2: Memory at c8800000 (64-bit, prefetchable) [size=8M]
    Region 4: Memory at c9050000 (64-bit, prefetchable) [size=64K]
    Expansion ROM at cb500000 [disabled] [size=512K]
    Capabilities: [40] Power Management version 3
            Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
            Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
    Capabilities: [50] MSI: Enable- Count=1/8 Maskable+ 64bit+
            Address: 0000000000000000  Data: 0000
            Masking: 00000000  Pending: 00000000
    Capabilities: [70] Express (v2) Endpoint, MSI 00
            DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
                    ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 25.000W
            DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                    RlxdOrd- ExtTag+ PhantFunc- AuxPwr- NoSnoop+ FLReset-
                    MaxPayload 256 bytes, MaxReadReq 4096 bytes
            DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
            LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM not supported
                    ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
            LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                    ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
            LnkSta: Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
            DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR+, OBFF Via message/WAKE#
                     AtomicOpsCap: 32bit- 64bit- 128bitCAS-
            DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-, LTR-, OBFF Disabled
                     AtomicOpsCtl: ReqEn+
            LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                     Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                     Compliance De-emphasis: -6dB
            LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
                     EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
    Capabilities: [b0] MSI-X: Enable+ Count=129 Masked-
            Vector table: BAR=4 offset=00000000
            PBA: BAR=4 offset=00001000
    Capabilities: [d0] Vital Product Data
            Product Name: HPE Eth 10/25Gb 2p 621SFP28 Adptr
            Read-only fields:
                    [PN] Part number: 867326-001
                    [EC] Engineering changes: B-5840
                    [MN] Manufacture ID: 1590
                    [V0] Vendor specific: 16.6W PCIeGen3 QL41401
                    [V1] Vendor specific: 4.1.11.2
                    [V2] Vendor specific: 5011
                    [V3] Vendor specific: 8.65.1.0
                    [V5] Vendor specific: 0B
                    [V6] Vendor specific: 0.2.0.19
                    [V7] Vendor specific: 621SFP28
                    [SN] Serial number: MY50110BWH
                    [V4] Vendor specific: 9440C96B24C4
                    [RV] Reserved: checksum good, 2 byte(s) reserved
            End
    Capabilities: [100 v2] Advanced Error Reporting
            UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
            UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
            UESvrt: DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
            CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
            CEMsk:  RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
            AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn+ ECRCChkCap+ ECRCChkEn+
                    MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
            HeaderLog: 00000000 00000000 00000000 00000000
    Capabilities: [148 v1] Virtual Channel
            Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
            Arb:    Fixed- WRR32- WRR64- WRR128-
            Ctrl:   ArbSelect=Fixed
            Status: InProgress-
            VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                    Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                    Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                    Status: NegoPending- InProgress-
    Capabilities: [168 v1] Device Serial Number 00-00-00-00-00-00-00-00
    Capabilities: [178 v1] Power Budgeting <?>
    Capabilities: [188 v1] Alternative Routing-ID Interpretation (ARI)
            ARICap: MFVC- ACS-, Next Function: 1
            ARICtl: MFVC- ACS-, Function Group: 0
    Capabilities: [198 v1] #19
    Capabilities: [1f8 v1] Transaction Processing Hints
            Interrupt vector mode supported
            Device specific mode supported
            Steering table in MSI-X table
    Capabilities: [284 v1] Latency Tolerance Reporting
            Max snoop latency: 0ns
            Max no snoop latency: 0ns
    Capabilities: [28c v1] Vendor Specific Information: ID=0002 Rev=3 Len=100 <?>
    Capabilities: [38c v1] Vendor Specific Information: ID=0001 Rev=1 Len=038 <?>
    Capabilities: [3c4 v1] Precision Time Measurement
            PTMCap: Requester:+ Responder:- Root:-
            PTMClockGranularity: Unimplemented
            PTMControl: Enabled:- RootSelected:-
            PTMEffectiveGranularity: Unknown
    Capabilities: [3d0 v1] Vendor Specific Information: ID=0003 Rev=1 Len=054 <?>
    Capabilities: [424 v1] #15
    Kernel driver in use: qede
    Kernel modules: qede