DELL 万兆 X550T 网卡 debian 连接交换机 10G，但 iperf 最高只能到 1G，信息如下。 哪里出问题了？

[axiauk]

ethtool -i enp2s0f0

driver: ixgbe

version: 5.1.0-k

firmware-version: 0x80000f32, 19.5.12

expansion-rom-version:

bus-info: 0000:02:00.0

supports-statistics: yes

supports-test: yes

supports-eeprom-access: yes

supports-register-dump: yes

supports-priv-flags: yes

ethtool enp2s0f0

Settings for enp2s0f0:

    Supported ports: [ TP ]

    Supported link modes:   100baseT/Full

                            1000baseT/Full

                            10000baseT/Full

    Supported pause frame use: Symmetric

    Supports auto-negotiation: Yes

    Supported FEC modes: Not reported

    Advertised link modes:  100baseT/Full

                            1000baseT/Full

                            10000baseT/Full

    Advertised pause frame use: Symmetric

    Advertised auto-negotiation: Yes

    Advertised FEC modes: Not reported

    Speed: 10000Mb/s

    Duplex: Full

    Port: Twisted Pair

    PHYAD: 0

    Transceiver: internal

    Auto-negotiation: on

    MDI-X: Unknown

    Supports Wake-on: d

    Wake-on: d

    Current message level: 0x00000007 (7)

                           drv probe link

    Link detected: yes

ifconfig

enp2s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500

    inet 192.168.1.7  netmask 255.255.255.0  broadcast 192.168.1.255

    inet6 2408:****:****:9b80:b696:91ff:fe6f:5a78  prefixlen 64  scopeid 0x0<global>

    inet6 fe80::b696:91ff:fe6f:5a78  prefixlen 64  scopeid 0x20<link>

    ether b4:96:91:6f:5a:78  txqueuelen 1000  (Ethernet)

    RX packets 42383  bytes 5799527 (5.5 MiB)

    RX errors 0  dropped 0  overruns 0  frame 0

    TX packets 14906  bytes 7721794 (7.3 MiB)

    TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

dmesg | grep ixgbe

[ 2.028447] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k

[ 2.028447] ixgbe: Copyright (c) 1999-2016 Intel Corporation.

[ 2.729215] ixgbe 0000:02:00.0: Multiqueue Enabled: Rx Queue count = 16, Tx Queue count = 16 XDP Queue count = 0

[ 2.830695] ixgbe 0000:02:00.0: 31.504 Gb/s available PCIe bandwidth (8 GT/s x4 link)

[ 2.943322] ixgbe 0000:02:00.0: MAC: 4, PHY: 0, PBA No: J69754-003

[ 2.943326] ixgbe 0000:02:00.0: b4:96:91:6f:5a:78

[ 3.106565] ixgbe 0000:02:00.0: Intel(R) 10 Gigabit Network Connection

[ 3.106594] libphy: ixgbe-mdio: probed

[ 3.808299] ixgbe 0000:02:00.1: Multiqueue Enabled: Rx Queue count = 16, Tx Queue count = 16 XDP Queue count = 0

[ 3.910503] ixgbe 0000:02:00.1: 31.504 Gb/s available PCIe bandwidth (8 GT/s x4 link)

[ 4.026732] ixgbe 0000:02:00.1: MAC: 4, PHY: 0, PBA No: J69754-003

[ 4.026733] ixgbe 0000:02:00.1: b4:96:91:6f:5a:7a

[ 4.188871] ixgbe 0000:02:00.1: Intel(R) 10 Gigabit Network Connection

[ 4.188899] libphy: ixgbe-mdio: probed

[ 4.189542] ixgbe 0000:02:00.1 enp2s0f1: renamed from eth1

[ 4.214902] ixgbe 0000:02:00.0 enp2s0f0: renamed from eth0

[ 5.897838] ixgbe 0000:02:00.1: registered PHC device on enp2s0f1

[ 6.117558] ixgbe 0000:02:00.0: registered PHC device on enp2s0f0

[ 11.258783] ixgbe 0000:02:00.1 enp2s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX

[ 11.543897] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

[ 11.738770] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Down

[ 12.166518] ixgbe 0000:02:00.1 enp2s0f1: NIC Link is Down

[ 12.454863] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

[ 12.478795] ixgbe 0000:02:00.1 enp2s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX

[12563.001690] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

[ericbize]

我的话会换 iperf3 先看看

[mason961125]

最重要的 iperf3 log 你却不发……

[VYSE]

iperf 是 1GB?
ethtool Speed: 10000Mb/s

[axiauk]

是的，不知为何实际只有标准的千兆网卡速度。 在 NFS 和 SMB 上也是标准的千兆。
# iperf3 -c 192.168.1.3

Connecting to host 192.168.1.3, port 5201

[ 5] local 192.168.1.10 port 43088 connected to 192.168.1.3 port 5201

[ ID] Interval Transfer Bitrate Retr Cwnd

[ 5] 0.00-1.00 sec 113 MBytes 949 Mbits/sec 0 1.45 MBytes

[ 5] 1.00-2.00 sec 110 MBytes 923 Mbits/sec 0 1.45 MBytes

[ 5] 2.00-3.00 sec 110 MBytes 923 Mbits/sec 0 1.45 MBytes

[ 5] 3.00-4.00 sec 110 MBytes 923 Mbits/sec 0 1.46 MBytes

[ 5] 4.00-5.00 sec 110 MBytes 923 Mbits/sec 0 1.46 MBytes

[ 5] 5.00-6.00 sec 110 MBytes 923 Mbits/sec 0 1.96 MBytes

[ 5] 6.00-7.00 sec 110 MBytes 923 Mbits/sec 0 1.96 MBytes

[ 5] 7.00-8.00 sec 109 MBytes 912 Mbits/sec 0 1.96 MBytes

[ 5] 8.00-9.00 sec 111 MBytes 933 Mbits/sec 0 1.96 MBytes

[ 5] 9.00-10.00 sec 110 MBytes 923 Mbits/sec 0 1.96 MBytes

- - - - - - - - - - - - - - - - - - - - - - - - -

[ ID] Interval Transfer Bitrate Retr

[ 5] 0.00-10.00 sec 1.08 GBytes 925 Mbits/sec 0 sender

[ 5] 0.00-10.00 sec 1.07 GBytes 923 Mbits/sec receiver

[axiauk]

折腾两天无果。之前装 windows 10 下 iperf3 都没问题的。难道是姿势不对，默认配置有问题？
下面这条命令不知道是干嘛的
# ethtool -g enp2s0f0

Ring parameters for enp2s0f0:

Pre-set maximums:

RX: 4096

RX Mini: 0

RX Jumbo: 0

TX: 4096

Current hardware settings:

RX: 512

RX Mini: 0

RX Jumbo: 0

TX: 512

[yelocat]

我比较奇怪，网卡插在 pcie2.0 8x 的插槽，每次开机都只能运行在 2x 模式下，显示 10G，实际 3G，重启之后才会运行在 8x 模式。

[axiauk]

已经解决了。但是没搞明白。NUC9 接了一个千兆网卡管理口 连接 AMT （ 192.168.1.10 ）万兆（ 192.168.1.7 ），安装 OMV 配置这两个网卡和 IP，删掉 千兆网卡带宽就正常了。 之前出问题也怪，iperf 无论主 /客 都是到 192.168.1.7 流量只有千兆，难道都通过 192.168.1.10 中转？

[geekvcn]

@axiauk 按你的描述，是非对称路由的关系，每个网卡单独设个路由表就行了