V2EX = way to explore
V2EX 是一个关于分享和探索的地方
现在注册
已注册用户请  登录
axiauk
V2EX  ›  宽带症候群

DELL 万兆 X550T 网卡 debian 连接交换机 10G,但 iperf 最高只能到 1G,信息如下。 哪里出问题了?

  •  
  •   axiauk · 2020-07-13 03:32:52 +08:00 · 2806 次点击
    这是一个创建于 1355 天前的主题,其中的信息可能已经有所发展或是发生改变。

    ethtool -i enp2s0f0

    driver: ixgbe

    version: 5.1.0-k

    firmware-version: 0x80000f32, 19.5.12

    expansion-rom-version:

    bus-info: 0000:02:00.0

    supports-statistics: yes

    supports-test: yes

    supports-eeprom-access: yes

    supports-register-dump: yes

    supports-priv-flags: yes

    ethtool enp2s0f0

    Settings for enp2s0f0:

        Supported ports: [ TP ]
    
        Supported link modes:   100baseT/Full
    
                                1000baseT/Full
    
                                10000baseT/Full
    
        Supported pause frame use: Symmetric
    
        Supports auto-negotiation: Yes
    
        Supported FEC modes: Not reported
    
        Advertised link modes:  100baseT/Full
    
                                1000baseT/Full
    
                                10000baseT/Full
    
        Advertised pause frame use: Symmetric
    
        Advertised auto-negotiation: Yes
    
        Advertised FEC modes: Not reported
    
        Speed: 10000Mb/s
    
        Duplex: Full
    
        Port: Twisted Pair
    
        PHYAD: 0
    
        Transceiver: internal
    
        Auto-negotiation: on
    
        MDI-X: Unknown
    
        Supports Wake-on: d
    
        Wake-on: d
    
        Current message level: 0x00000007 (7)
    
                               drv probe link
    
        Link detected: yes
    

    ifconfig

    enp2s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500

        inet 192.168.1.7  netmask 255.255.255.0  broadcast 192.168.1.255
    
        inet6 2408:****:****:9b80:b696:91ff:fe6f:5a78  prefixlen 64  scopeid 0x0<global>
    
        inet6 fe80::b696:91ff:fe6f:5a78  prefixlen 64  scopeid 0x20<link>
    
        ether b4:96:91:6f:5a:78  txqueuelen 1000  (Ethernet)
    
        RX packets 42383  bytes 5799527 (5.5 MiB)
    
        RX errors 0  dropped 0  overruns 0  frame 0
    
        TX packets 14906  bytes 7721794 (7.3 MiB)
    
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
    

    dmesg | grep ixgbe

    [ 2.028447] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k

    [ 2.028447] ixgbe: Copyright (c) 1999-2016 Intel Corporation.

    [ 2.729215] ixgbe 0000:02:00.0: Multiqueue Enabled: Rx Queue count = 16, Tx Queue count = 16 XDP Queue count = 0

    [ 2.830695] ixgbe 0000:02:00.0: 31.504 Gb/s available PCIe bandwidth (8 GT/s x4 link)

    [ 2.943322] ixgbe 0000:02:00.0: MAC: 4, PHY: 0, PBA No: J69754-003

    [ 2.943326] ixgbe 0000:02:00.0: b4:96:91:6f:5a:78

    [ 3.106565] ixgbe 0000:02:00.0: Intel(R) 10 Gigabit Network Connection

    [ 3.106594] libphy: ixgbe-mdio: probed

    [ 3.808299] ixgbe 0000:02:00.1: Multiqueue Enabled: Rx Queue count = 16, Tx Queue count = 16 XDP Queue count = 0

    [ 3.910503] ixgbe 0000:02:00.1: 31.504 Gb/s available PCIe bandwidth (8 GT/s x4 link)

    [ 4.026732] ixgbe 0000:02:00.1: MAC: 4, PHY: 0, PBA No: J69754-003

    [ 4.026733] ixgbe 0000:02:00.1: b4:96:91:6f:5a:7a

    [ 4.188871] ixgbe 0000:02:00.1: Intel(R) 10 Gigabit Network Connection

    [ 4.188899] libphy: ixgbe-mdio: probed

    [ 4.189542] ixgbe 0000:02:00.1 enp2s0f1: renamed from eth1

    [ 4.214902] ixgbe 0000:02:00.0 enp2s0f0: renamed from eth0

    [ 5.897838] ixgbe 0000:02:00.1: registered PHC device on enp2s0f1

    [ 6.117558] ixgbe 0000:02:00.0: registered PHC device on enp2s0f0

    [ 11.258783] ixgbe 0000:02:00.1 enp2s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX

    [ 11.543897] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

    [ 11.738770] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Down

    [ 12.166518] ixgbe 0000:02:00.1 enp2s0f1: NIC Link is Down

    [ 12.454863] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

    [ 12.478795] ixgbe 0000:02:00.1 enp2s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX

    [12563.001690] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

    8 条回复    2020-07-14 02:12:30 +08:00
    ericbize
        1
    ericbize  
       2020-07-13 07:05:02 +08:00 via iPhone
    我的话会换 iperf3 先看看
    mason961125
        2
    mason961125  
       2020-07-13 07:11:48 +08:00 via iPhone
    最重要的 iperf3 log 你却不发……
    VYSE
        3
    VYSE  
       2020-07-13 09:06:57 +08:00 via Android
    iperf 是 1GB?
    ethtool Speed: 10000Mb/s
    axiauk
        4
    axiauk  
    OP
       2020-07-13 11:55:47 +08:00
    是的,不知为何实际只有标准的千兆网卡速度。 在 NFS 和 SMB 上也是标准的千兆。
    # iperf3 -c 192.168.1.3

    Connecting to host 192.168.1.3, port 5201

    [ 5] local 192.168.1.10 port 43088 connected to 192.168.1.3 port 5201

    [ ID] Interval Transfer Bitrate Retr Cwnd

    [ 5] 0.00-1.00 sec 113 MBytes 949 Mbits/sec 0 1.45 MBytes

    [ 5] 1.00-2.00 sec 110 MBytes 923 Mbits/sec 0 1.45 MBytes

    [ 5] 2.00-3.00 sec 110 MBytes 923 Mbits/sec 0 1.45 MBytes

    [ 5] 3.00-4.00 sec 110 MBytes 923 Mbits/sec 0 1.46 MBytes

    [ 5] 4.00-5.00 sec 110 MBytes 923 Mbits/sec 0 1.46 MBytes

    [ 5] 5.00-6.00 sec 110 MBytes 923 Mbits/sec 0 1.96 MBytes

    [ 5] 6.00-7.00 sec 110 MBytes 923 Mbits/sec 0 1.96 MBytes

    [ 5] 7.00-8.00 sec 109 MBytes 912 Mbits/sec 0 1.96 MBytes

    [ 5] 8.00-9.00 sec 111 MBytes 933 Mbits/sec 0 1.96 MBytes

    [ 5] 9.00-10.00 sec 110 MBytes 923 Mbits/sec 0 1.96 MBytes

    - - - - - - - - - - - - - - - - - - - - - - - - -

    [ ID] Interval Transfer Bitrate Retr

    [ 5] 0.00-10.00 sec 1.08 GBytes 925 Mbits/sec 0 sender

    [ 5] 0.00-10.00 sec 1.07 GBytes 923 Mbits/sec receiver
    axiauk
        5
    axiauk  
    OP
       2020-07-13 12:05:35 +08:00
    折腾两天无果。之前装 windows 10 下 iperf3 都没问题的。难道是姿势不对,默认配置有问题?
    下面这条命令不知道是干嘛的
    # ethtool -g enp2s0f0

    Ring parameters for enp2s0f0:

    Pre-set maximums:

    RX: 4096

    RX Mini: 0

    RX Jumbo: 0

    TX: 4096

    Current hardware settings:

    RX: 512

    RX Mini: 0

    RX Jumbo: 0

    TX: 512
    yelocat
        6
    yelocat  
       2020-07-13 14:40:19 +08:00
    我比较奇怪,网卡插在 pcie2.0 8x 的插槽,每次开机都只能运行在 2x 模式下,显示 10G,实际 3G,重启之后才会运行在 8x 模式。
    axiauk
        7
    axiauk  
    OP
       2020-07-14 01:11:06 +08:00
    已经解决了。但是没搞明白。NUC9 接了一个千兆网卡管理口 连接 AMT ( 192.168.1.10 )万兆( 192.168.1.7 ),安装 OMV 配置这两个网卡和 IP,删掉 千兆网卡带宽就正常了。 之前出问题也怪,iperf 无论主 /客 都是到 192.168.1.7 流量只有千兆,难道都通过 192.168.1.10 中转?
    geekvcn
        8
    geekvcn  
       2020-07-14 02:12:30 +08:00
    @axiauk 按你的描述,是非对称路由的关系,每个网卡单独设个路由表就行了
    关于   ·   帮助文档   ·   博客   ·   API   ·   FAQ   ·   我们的愿景   ·   实用小工具   ·   2861 人在线   最高记录 6543   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 25ms · UTC 12:59 · PVG 20:59 · LAX 05:59 · JFK 08:59
    Developed with CodeLauncher
    ♥ Do have faith in what you're doing.