CDP
vim-cmd hostsvc/net/query_networkhint
esxcfg-info | more +/CDP\ Summary
esxcli iscsi adapter get -A vmhba37 (ESXi5.0)
~ # esxcfg-vswitch -l to find out VLAN id, port groups and Uplinks VMNICs
esxcfg-vswitch -l
Switch Name Num Ports Used Ports Configured Ports MTU Uplinks
vSwitch0 128 7 128 1500 vmnic3.p1
PortGroup Name VLAN ID Used Ports Uplinks
VM Network 0 2 vmnic3.p1
svm-iscsi-pg 1025 1 vmnic3.p1
vmk-iscsi-pg 1025 1 vmnic3.p1
Management Network 0 1 vmnic3.p1
In this example we are using only one uplink at MTU 1500 and vlan id of 1025.
~ # esxcli network neighbor list
Neighbor Mac Address vmknic Expiry(sec) State
10.50.80.14 00:50:56:9d:00:0e vmk0 843
10.50.80.50 9c:8e:99:16:a9:60 vmk0 1169
10.50.80.51 00:25:90:2e:f1:f4 vmk0 249
10.50.80.52 00:25:90:2e:f2:6e vmk0 418
10.50.80.53 00:25:90:2e:f2:3a lo0 4291308798
10.50.80.80 00:0c:29:7e:55:63 vmk0 1162
10.50.80.81 00:50:56:9d:00:00 vmk0 1121
10.50.80.244 00:21:5a:a8:d7:e8 vmk0 1168
10.50.80.253 00:23:47:f6:45:00 vmk0 325
192.168.5.2 00:50:56:9d:00:07 vmk1 1057
~ # esxcli network vswitch standard list
vSwitch0
Name: vSwitch0
Class: etherswitch
Num Ports: 128
Used Ports: 10
Configured Ports: 128
MTU: 1500
CDP Status: listen
Beacon Enabled: false
Beacon Interval: 1
Beacon Threshold: 3
Beacon Required By:
Uplinks: vmnic3.p1
Portgroups: svm-iscsi-pg, VM Network, vmk-nfs-pg, vmk-iscsi-pg, Management Network
vSwitch1
Name: vSwitch1
Class: etherswitch
Num Ports: 128
Used Ports: 3
Configured Ports: 128
MTU: 1500
CDP Status: listen
Beacon Enabled: false
Beacon Interval: 1
Beacon Threshold: 3
Beacon Required By:
Uplinks:
Portgroups: VM Network 2, VMkernel
~ # esxcli network vswitch standard policy failover get -v vSwitch0
Load Balancing: srcport
Network Failure Detection: link
Notify Switches: true
Failback: true
Active Adapters: vmnic3.p1
Standby Adapters:
Unused Adapters:
# esxcli network vswitch standard portgroup policy failover get -p "Management Network"
Load Balancing: srcport
Network Failure Detection: link
Notify Switches: true
Failback: true
Active Adapters: vmnic3.p1
Standby Adapters:
Unused Adapters:
Override Vswitch Load Balancing: true
Override Vswitch Network Failure Detection: true
Override Vswitch Notify Switches: true
Override Vswitch Failback: true
Override Vswitch Uplinks: false
~ # esxcli network vswitch standard portgroup policy failover get -p vmk-iscsi-pg
Load Balancing: srcport
Network Failure Detection: link
Notify Switches: true
Failback: true
Active Adapters: vmnic3.p1
Standby Adapters:
Unused Adapters:
Override Vswitch Load Balancing: false
Override Vswitch Network Failure Detection: false
Override Vswitch Notify Switches: false
Override Vswitch Failback: false
Override Vswitch Uplinks: false
~ # esxcli network vswitch standard portgroup policy failover get -p svm-iscsi-pg
Load Balancing: srcport
Network Failure Detection: link
Notify Switches: true
Failback: true
Active Adapters: vmnic3.p1
Standby Adapters:
Unused Adapters:
Override Vswitch Load Balancing: false
Override Vswitch Network Failure Detection: false
Override Vswitch Notify Switches: false
Override Vswitch Failback: false
Override Vswitch Uplinks: false
~ # esxcli network vswitch standard uplink add -u=vmnic0 -v=vSwitch0
~ # esxcli network vswitch standard uplink add -u=vmnic1 -v=vSwitch0
~ # esxcli network vswitch standard portgroup policy failover get -p svm-iscsi-pg
Load Balancing: srcport
Network Failure Detection: link
Notify Switches: true
Failback: true
Active Adapters: vmnic3.p1
Standby Adapters: vmnic0, vmnic1
Unused Adapters:
Override Vswitch Load Balancing: false
Override Vswitch Network Failure Detection: false
Override Vswitch Notify Switches: false
Override Vswitch Failback: false
Override Vswitch Uplinks: false
/sbin # esxcfg-nics -l : to find what other nics are available.
Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic0 0000:01:00.00 e1000e Up 1000Mbps Full 00:25:90:48:b4:ca 1500 Intel Corporation 82574L Gigabit Network Connection
vmnic1 0000:02:00.00 e1000e Down 0Mbps Half 00:25:90:48:b4:cb 1500 Intel Corporation 82574L Gigabit Network Connection
vmnic3.p1 0000:03:00.00 mlx4_en Up 10000Mbps Full 00:25:90:2e:98:85 1500 Mellanox Technologies MT26418 [ConnectX VPI - 10GigE / IB DDR, PCIe 2.0 5GT/s]
/sbin # esxcfg-vmknic -l - what ip address is used. ( make sure only one IP is configured for iscsi)
Interface Port Group/DVPort IP Family IP Address Netmask Broadcast MAC Address MTU TSO MSS Enabled Type
vmk0 Management Network IPv4 172.16.13.3 255.240.0.0 172.31.255.255 00:25:90:48:b4:ca 1500 65535 true STATIC
vmk1 vmk-iscsi-pg IPv4 192.168.5.1 255.255.255.0 192.168.5.255 00:50:56:7b:a3:50 1500 65535 true STATIC
Driver Version:
/sbin # ethtool -i vmnic3.p1
driver: mlx4_en
version: 1.6.1.2 (Aug-08-2011)
firmware-version: 2.9.1000
bus-info: 0000:03:00.0
/sbin # esxcfg-module -i mlx4_en : driver version and parameters, what type of interrupt and Rings (Qos)
esxcfg-module module information
input file: /usr/lib/vmware/vmkmod/mlx4_en
License: Dual BSD/GPL
Version:
Name-space: com.mellanox.mlx4_en@9.2.0.0
Required name-spaces:
com.vmware.driverAPI@9.2.0.0
com.vmware.vmkapi@v2_0_0_0
Parameters:
heap_initial: int
Initial heap size allocated for the driver.
heap_max: int
Maximum attainable heap size for the driver.
low_mem_config: uint
If set will configure driver to prefer memory utilization over performance. Range 0|1. Default 0
msi_x: uint
Attempt to use MSI-X if nonzero. Range: 0|1. Default 1
net_q: uint
NetQueue support. Enables NetQueue support. Default 1
non_vep_mfunc: uint
Multi functional mode without VEP configuration. Default 0
num_lro: uint
Number of LRO sessions per ring or disabled (0). Default 16
num_lro_aggr: uint
Max number of LRO packets to aggregate. Default 16
port1_default_func: uint
VLAN steering mode only: default function on port1 for untagged traffic. Default 0
port2_default_func: uint
VLAN steering mode only: default function on port2 for untagged traffic. Default 1
rx_bw0: uint
RX BW for function 0 (in multi functional mode). Default 0
rx_bw1: uint
RX BW for function 1 (in multi functional mode). Default 0
rx_bw2: uint
RX BW for function 2 (in multi functional mode). Default 0
rx_bw3: uint
RX BW for function 3 (in multi functional mode). Default 0
rx_bw4: uint
RX BW for function 4 (in multi functional mode). Default 0
rx_bw5: uint
RX BW for function 5 (in multi functional mode). Default 0
rx_bw6: uint
RX BW for function 6 (in multi functional mode). Default 0
rx_bw7: uint
RX BW for function 7 (in multi functional mode). Default 0
rx_ring_num: uint
Number of RX rings. Default: 8, multifunction: 4. Max value is 8, must be power of 2
skb_mpool_initial: int
Driver's minimum private socket buffer memory pool size.
skb_mpool_max: int
Maximum attainable private socket buffer memory pool size for the driver.
tx_bw0: int
TX rate limiting for function0. Default 2500
tx_bw1: int
TX rate limiting for function1. Default 2500
tx_bw2: int
TX rate limiting for function2. Default 2500
tx_bw3: int
TX rate limiting for function3. Default 2500
tx_ring_num: uint
Number of TX rings. Default: 8. Max value is (1 + 8), power of 2
ethtool vmnic3.p1 : to find duplex mode, link detected.
Settings for vmnic3.p1:
Supported ports: [ TP ]
Supported link modes:
Supports auto-negotiation: No
Advertised link modes: Not reported
Advertised auto-negotiation: No
Speed: Unknown! (10000)
Duplex: Full
Port: Twisted Pair
PHYAD: 0
Transceiver: internal
Auto-negotiation: off
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000014 (20)
Link detected: yes
/sbin # ethtool -S vmnic3.p1 ( another nice command watch ethtool -S vmnic.3.p1 | egrep "NIC|errors|drops")
to watch for collissions, packet drops, error statistics)
NIC statistics:
rx_packets: 477499775
tx_packets: 385171583
rx_bytes: 553575646465
tx_bytes: 387922909420
rx_errors: 0
tx_errors: 0
rx_dropped: 0
tx_dropped: 0
multicast: 1864891
collisions: 0
rx_length_errors: 0
rx_over_errors: 0
rx_crc_errors: 0
rx_frame_errors: 0
rx_fifo_errors: 0
rx_missed_errors: 0
tx_aborted_errors: 0
tx_carrier_errors: 0
tx_fifo_errors: 0
tx_heartbeat_errors: 0
tx_window_errors: 0
lro_aggregated: 0
lro_flushed: 0
lro_no_desc: 0
tso_packets: 12413800
queue_stopped: 0
wake_queue: 0
tx_timeout: 0
rx_alloc_failed: 0
rx_csum_good: 473208461
rx_csum_none: 4290768
tx_chksum_offload: 48962974
tx_queue_0_packets: 195868345
tx_queue_0_bytes: 268219905684
tx_queue_1_packets: 0
tx_queue_1_bytes: 0
tx_queue_2_packets: 22660
tx_queue_2_bytes: 2401715
tx_queue_3_packets: 19489818
tx_queue_3_bytes: 28984837136
tx_queue_4_packets: 28289
tx_queue_4_bytes: 3747808
tx_queue_5_packets: 24940
tx_queue_5_bytes: 16991750
tx_queue_6_packets: 197
tx_queue_6_bytes: 11928
tx_queue_7_packets: 63
tx_queue_7_bytes: 72446
tx_queue_8_packets: 157566697
tx_queue_8_bytes: 87314994857
tx_queue_9_packets: 0
tx_queue_9_bytes: 0
tx_queue_10_packets: 12438
tx_queue_10_bytes: 999073
tx_queue_11_packets: 12084208
tx_queue_11_bytes: 3358342992
tx_queue_12_packets: 26856
tx_queue_12_bytes: 2925516
tx_queue_13_packets: 47073
tx_queue_13_bytes: 17678621
tx_queue_14_packets: 0
tx_queue_14_bytes: 0
tx_queue_15_packets: 0
tx_queue_15_bytes: 0
rx_queue_0_packets: 68133576
rx_queue_0_bytes: 45139151905
rx_queue_1_packets: 409366202
rx_queue_1_bytes: 508436494878
rx_queue_2_packets: 0
rx_queue_2_bytes: 0
rx_queue_3_packets: 0
rx_queue_3_bytes: 0
You can set the speed, duplex mode as well
ethtool -s|--change DEVNAME Change generic options
[ speed 10|100|1000 ]
[ duplex half|full ]
[ port tp|aui|bnc|mii|fibre ]
[ autoneg on|off ]
[ phyad %%d ]
[ xcvr internal|external ]
[ wol p|u|m|b|a|g|s|d... ]
[ sopass %%x:%%x:%%x:%%x:%%x:%%x ]
[ msglvl %%d ]
ESXi ISCSI adapter related commands:
# esxcli iscsi adapter list
Adapter Driver State UID Description
------- --------- ------ ------------- ----------------------
vmhba37 iscsi_vmk online iscsi.vmhba37 iSCSI Software Adapter
esxcli iscsi networkportal list --adapter=vmhba37
esxcli iscsi networkportal add --adapter=vmhba37 --nic=vmk1
vmkiscsi-tool -V vmhba37 : look at the high lighted to see if the ESXi is seeing the mac address right.
iSCSI Nic Properties:
- vNic name: vmk1
- pNic name: vmnic3.p1
- ipv4 address: 192.168.5.1
- ipv4 net mask: 255.255.255.0
- ipv6 addresses:
- mac address: 00:25:90:2e:98:e1
- mtu: 1500 (bytes)
- toe: off
- tso: on
- tcp checksum: off
- vlan: on
- vlanId: 1022
- ports revered 63488~65536
- link status: connected
- ethernet speed: 10000 (Mbps)
- packets received: 3745729
- packets sent: 1746541
- NIC driver: mlx4_en
- driver version: 1.6.1.2 (Aug-08-2011)
- firmware version: 2.9.1000
esxcli iscsi adapter get -A vmhba37
vmhba37
Name: iqn.1998-01.com.vmware:proteus-1-6bf60b96
Alias:
Vendor: VMware
Model: iSCSI Software Adapter
Description: iSCSI Software Adapter
Serial Number:
Hardware Version:
Asic Version:
Firmware Version:
Option Rom Version:
Driver Name: iscsi_vmk
Driver Version:
TCP Protocol Supported: false
Bidirectional Transfers Supported: false
Maximum Cdb Length: 64
Can Be NIC: false
Is NIC: false
Is Initiator: true
Is Target: false
Using TCP Offload Engine: false
Using ISCSI Offload Engine: false
esxcli iscsi adapter discovery sendtarget list : if target is configured right ?
Adapter Sendtarget
------- ----------------
vmhba37 192.168.5.2:3261
esxcfg-mpath -L|grep active or dead
vmhba37:C0:T24:L0 state:active t10.NUTANIX_jenkins_var2_f03a81584ad2481e7a32dff1435cd2d6e0ac2be9 vmhba37 0 24 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:jenkins-var2-3b2607f7,t,1
vmhba37:C0:T3:L0 state:active t10.NUTANIX_SPTest_snapshot_dec21ef19174250e0f1274fdc1d24fc9938c7181 vmhba37 0 3 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:sptest.snapshot-bf16abd6,t,1
vmhba37:C0:T8:L0 state:active t10.NUTANIX_shared_datastore1_a118bcd634d6150d5816d20eeeba58b8f7188938 vmhba37 0 8 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:shared_datastore1-08acdfb0,t,1
vmhba37:C0:T13:L0 state:active t10.NUTANIX_NFS_rdm_root_aeaed9fdd5c0a5f0e31b3b27d25597ea2fafff1f vmhba37 0 13 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:nfs-rdm-root-86ef8ab8,t,1
vmhba37:C0:T18:L0 state:active t10.NUTANIX_laura_ubuntu_b567124e6a1c671c951ac540d5b4d066bf02490d vmhba37 0 18 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:laura-ubuntu-2e5c9d9e,t,1
vmhba32:C0:T0:L0 state:active t10.ATA_____ST91000640NS________________________________________9XG066JH vmhba32 0 0 0 NMP active local sata.vmhba32 sata.0:0
vmhba37:C0:T23:L0 state:active t10.NUTANIX_NFS_laura2_19a05f0389ea48c8bf8ab5f2bd09ba64292fdf47 vmhba37 0 23 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:nfs-laura2-501a06ad,t,1
vmhba37:C0:T2:L0 state:active t10.NUTANIX_vdisk_jenkins_var_4adb3cd05414b6867515da94aadd8b60bbd6fa74 vmhba37 0 2 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:vdisk-jenkins-var-ffa83c61,t,1
vmhba35:C0:T0:L0 state:active t10.ATA_____ST91000640NS________________________________________9XG04XGA vmhba35 0 0 0 NMP active local sata.vmhba35 sata.0:0
vmhba37:C0:T7:L0 state:active t10.NUTANIX_shared_datastore3_a761c9791f24e9a3192d13c5429d8bdb8a764a21 vmhba37 0 7 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:shared_datastore3-4b9418d4,t,1
vmhba37:C0:T12:L0 state:active t10.NUTANIX_NFS_rdm_disk_4_8a16d5a2fed9c0cd98f522a5972cca17232b5778 vmhba37 0 12 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:nfs-rdm-disk-4-806fe744,t,1
vmhba37:C0:T17:L0 state:active t10.NUTANIX_VS5TEST_SHARED_DS_02_818ab185dacbba01268ee757057dc3ec3d2efda3 vmhba37 0 17 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:vs5test-shared-ds-02-714ceddd,t,1
vmhba0:C0:T0:L0 state:active t10.ATA_____INTEL_SSDSA2CW300G3_____________________CVPR130205U3300EGN__ vmhba0 0 0 0 NMP active local sata.vmhba0 sata.0:0
vmhba37:C0:T22:L0 state:active t10.NUTANIX_jenkins_home2_f16535bb09f50bd389321753707c4089aca13c00 vmhba37 0 22 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:jenkins-home2-b09052f4,t,1
vmhba37:C0:T1:L0 state:active t10.NUTANIX_vdisk_jenkins_home_ee4dc08f8546629f1b8de8ff9c17d9f0f6b494ae vmhba37 0 1 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:vdisk-jenkins-home-60425f0d,t,1
vmhba37:C0:T6:L0 state:active t10.NUTANIX_shared_datastore2_5056dde856bda2e950dc640701b2d15232696b53 vmhba37 0 6 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:shared_datastore2-368ea95a,t,1
vmhba37:C0:T11:L0 state:active t10.NUTANIX_NFS_rdm_disk_2_ba28e141962617a511a7fc2d7adba28e03c4daf2 vmhba37 0 11 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:nfs-rdm-disk-2-ce363c96,t,1
vmhba37:C0:T16:L0 state:active t10.NUTANIX_VS5TEST_SHARED_DS_03_29186254060a4edc0b07938b2459918024d724dd vmhba37 0 16 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:vs5test-shared-ds-03-fa925a96,t,1
vmhba34:C0:T0:L0 state:active t10.ATA_____ST91000640NS________________________________________9XG06694 vmhba34 0 0 0 NMP active local sata.vmhba34 sata.0:0
vmhba37:C0:T21:L0 state:active t10.NUTANIX_NFS_laura_ad64ca1339b7bbbe97b9f6588c41053b89cea280 vmhba37 0 21 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:nfs-laura-2f3765a2,t,1
vmhba37:C0:T0:L0 state:active t10.NUTANIX_shared_data7_9f17562a583d94c93d8e3e1cf1918142a15d23c2 vmhba37 0 0 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:shared_data7-402424f8,t,1
vmhba37:C0:T5:L0 state:active t10.NUTANIX_shared_datastore0_4ff793687221b5a3d62646b157c50a3fffc61d32 vmhba37 0 5 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:shared_datastore0-aa69a53e,t,1
vmhba37:C0:T10:L0 state:active t10.NUTANIX_NFS_rdm_disk_3_2557408b6a76d3c6604ac4bf33338a22f8aedee4 vmhba37 0 10 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:nfs-rdm-disk-3-e7fbd2a5,t,1
vmhba37:C0:T15:L0 state:active t10.NUTANIX_VS5TEST_SHARED_DS_01_068e745713f034b9fff264fa113427b09788679d vmhba37 0 15 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:vs5test-shared-ds-01-190baf86,t,1
vmhba37:C0:T20:L0 state:active t10.NUTANIX_ubu_stress_test_0_vdisk_4eea1dcd_0_162a26ba3f0c483191756d9fb12db120950498b9 vmhba37 0 20 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:ubu-stress-test-0-vdisk-4eea1dcd-0-8657ebdb,t,1
vmhba37:C0:T4:L0 state:active t10.NUTANIX_jenkins_dogfood_f691c6bdbba98a9ad38ca1f228fb4fd8bd7a7d59 vmhba37 0 4 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:jenkins-dogfood-5eac420e,t,1
vmhba37:C0:T9:L0 state:active t10.NUTANIX_PDS_TEST_e20efc76f560c6a67217815f275d5b39eed87735 vmhba37 0 9 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:pds-test-2b88fcd0,t,1
vmhba33:C0:T0:L0 state:active t10.ATA_____ST91000640NS________________________________________9XG066CE vmhba33 0 0 0 NMP active local sata.vmhba33 sata.0:0
vmhba37:C0:T14:L0 state:active t10.NUTANIX_VS5TEST_SHARED_DS_04_dc7b523a436286d0b0c0f2fa37b507f8868d9761 vmhba37 0 14 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:vs5test-shared-ds-04-fa503db2,t,1
vmhba37:C0:T19:L0 state:active t10.NUTANIX_laura_ubuntu_clone_9d528216d97af798327a7a31123e3b5096515f9d vmhba37 0 19 0 NMP active san iqn.1998-01.com.vmware:proteus-3-5f23b19a 00023d000001,iqn.2010-06.com.nutanix:laura-ubuntu-clone-7da678d7,t,1
vmhba36:C0:T0:L0 state:active t10.ATA_____ST91000640NS________________________________________9XG066SX vmhba36 0 0 0 NMP active local sata.vmhba36 sata.0:0
vmkiscsi-tool -D -l vmhba37 ( if you don't see any iscsi targets from nutanix or only partial list, check ESX firewall rules on all the ESX nodes)
=========Discovery Properties for Adapter vmhba37=========
iSnsDiscoverySettable : 0
iSnsDiscoveryEnabled : 0
iSnsDiscoveryMethod : 0
iSnsHost.ipAddress : ::
staticDiscoverySettable : 0
staticDiscoveryEnabled : 1
sendTargetsDiscoverySettable : 0
sendTargetsDiscoveryEnabled : 1
slpDiscoverySettable : 0
DISCOVERY ADDRESS : 192.168.5.2
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data2-f32ba819
ADDRESS : 192.168.5.2:62002
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data3-14038b98
ADDRESS : 192.168.5.2:62003
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data0-ed7fb8e6
ADDRESS : 192.168.5.2:62000
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data1-665353cd
ADDRESS : 192.168.5.2:62001
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data7-402424f8
ADDRESS : 192.168.5.2:62007
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data5-0ceb3267
ADDRESS : 192.168.5.2:62009
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data4-d6de24ba
ADDRESS : 192.168.5.2:62008
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data6-bfaa6e4d
ADDRESS : 192.168.5.2:62010
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:vdisk-jenkins-home-60425f0d
ADDRESS : 192.168.5.2:3261
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:vdisk-jenkins-var-ffa83c61
ADDRESS : 192.168.5.2:3261
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared-lun10-54a5bcd7
ADDRESS : 192.168.5.2:62011
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:vdisk-test-657ac94b
ADDRESS : 192.168.5.2:3261
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data11_10g-dbd2670f
ADDRESS : 192.168.5.2:62015
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data9_10g-5c4b59f2
ADDRESS : 192.168.5.2:62013
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data8_10g-893d36a6
ADDRESS : 192.168.5.2:62012
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data10_10g-a012f8f6
ADDRESS : 192.168.5.2:62014
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data100_100g-6b99d975
ADDRESS : 192.168.5.2:62004
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data104_100g-818afa13
ADDRESS : 192.168.5.2:62016
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:uvm-vdisk-4ed018a2-1
ADDRESS : 192.168.5.2:3261
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data103_100g-1549ee10
ADDRESS : 192.168.5.2:62006
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:uvm-vdisk-4ed018a2-0
ADDRESS : 192.168.5.2:3261
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:shared_data101_100g-9bcc23b1
ADDRESS : 192.168.5.2:62005
BOOT : No
LAST ERR : LOGIN: No Errors
STATIC DISCOVERY TARGET
NAME : iqn.2010-06.com.nutanix:sptest-798711b3
ADDRESS : 192.168.5.2:3261
BOOT : No
LAST ERR : LOGIN: No Errors
esxcli iscsi networkportal list
vmhba37
Adapter: vmhba37
Vmknic: vmk1
MAC Address: 00:25:90:2e:98:e1
MAC Address Valid: true
IPv4: 192.168.5.1
IPv4 Subnet Mask: 255.255.255.0
IPv6:
MTU: 1500
Vlan Supported: true
Vlan ID: 1022
Reserved Ports: 63488~65536
TOE: false
TSO: true
TCP Checksum: false
Link Up: true
Current Speed: 10000
Rx Packets: 44604
Tx Packets: 48326
NIC Driver: mlx4_en
NIC Driver Version: 1.6.1.2 (Aug-08-2011)
NIC Firmware Version: 2.9.1000
Compliant Status: compliant
NonCompliant Message:
NonCompliant Remedy:
Vswitch: vSwitch0
PortGroup: vmk-iscsi-pg
VswitchUuid:
PortGroupKey:
PortKey:
Duplex:
Path Status: unused
~ # esxcli network firewall ruleset list |grep nfs
nfsClient true
~ # esxcli network firewall ruleset rule list| grep -i nfs
nfsClient Outbound TCP Dst 0 65535
-For 1G Ethernet Module: (most of the above commands can be used)
/sbin # ethtool -i vmnic1
driver: e1000e
version: 1.1.2-NAPI
firmware-version: 1.9-0
bus-info: 0000:02:00.0
esxcfg-module -i e1000e
esxcfg-module module information
input file: /usr/lib/vmware/vmkmod/e1000e
License: GPL
Version:
Name-space:
Required name-spaces:
com.vmware.driverAPI@9.2.0.0
com.vmware.vmkapi@v2_0_0_0
Parameters:
CrcStripping: array of int
Enable CRC Stripping, disable if your BMC needs the CRC
IntMode: array of int
Interrupt Mode
InterruptThrottleRate: array of int
Interrupt Throttling Rate
KumeranLockLoss: array of int
Enable Kumeran lock loss workaround
RxAbsIntDelay: array of int
Receive Absolute Interrupt Delay
RxIntDelay: array of int
Receive Interrupt Delay
SmartPowerDownEnable: array of int
Enable PHY smart power down
TxAbsIntDelay: array of int
Transmit Absolute Interrupt Delay
TxIntDelay: array of int
Transmit Interrupt Delay
WriteProtectNVM: array of int
Write-protect NVM [WARNING: disabling this can lead to corrupted NVM]
copybreak: uint
Maximum size of packet that is copied to a new buffer on receive
heap_initial: int
Initial heap size allocated for the driver.
heap_max: int
Maximum attainable heap size for the driver.
skb_mpool_initial: int
Driver's minimum private socket buffer memory pool size.
skb_mpool_max: int
Maximum attainable private socket buffer memory pool size for the driver.
On CVM:
ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:50:56:9a:c5:bc
inet addr:172.16.13.23 Bcast:172.16.15.255 Mask:255.255.240.0
inet6 addr: fe80::250:56ff:fe9a:c5bc/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:470546787 errors:0 dropped:0 overruns:0 frame:0
TX packets:371359181 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:552056214185 (552.0 GB) TX bytes:369607646409 (369.6 GB)
eth1 Link encap:Ethernet HWaddr 00:50:56:9a:c5:bd
inet addr:192.168.5.2 Bcast:192.168.5.255 Mask:255.255.255.0
inet6 addr: fe80::250:56ff:fe9a:c5bd/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:90194295 errors:0 dropped:0 overruns:0 frame:0
TX packets:60650228 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:104324081442 (104.3 GB) TX bytes:68556431588 (68.5 GB)
# modinfo e1000
filename: /lib/modules/2.6.32-25-server/kernel/drivers/net/e1000/e1000.ko
version: 7.3.21-k5-NAPI
license: GPL
description: Intel(R) PRO/1000 Network Driver
author: Intel Corporation,
srcversion: 3895921F9A653A8C699A770
alias: pci:v00008086d000010B5sv*sd*bc*sc*i*
alias: pci:v00008086d00001099sv*sd*bc*sc*i*
alias: pci:v00008086d0000108Asv*sd*bc*sc*i*
alias: pci:v00008086d0000107Csv*sd*bc*sc*i*
alias: pci:v00008086d0000107Bsv*sd*bc*sc*i*
alias: pci:v00008086d0000107Asv*sd*bc*sc*i*
alias: pci:v00008086d00001079sv*sd*bc*sc*i*
alias: pci:v00008086d00001078sv*sd*bc*sc*i*
alias: pci:v00008086d00001077sv*sd*bc*sc*i*
alias: pci:v00008086d00001076sv*sd*bc*sc*i*
alias: pci:v00008086d00001075sv*sd*bc*sc*i*
alias: pci:v00008086d00001028sv*sd*bc*sc*i*
alias: pci:v00008086d00001027sv*sd*bc*sc*i*
alias: pci:v00008086d00001026sv*sd*bc*sc*i*
alias: pci:v00008086d0000101Esv*sd*bc*sc*i*
alias: pci:v00008086d0000101Dsv*sd*bc*sc*i*
alias: pci:v00008086d0000101Asv*sd*bc*sc*i*
alias: pci:v00008086d00001019sv*sd*bc*sc*i*
alias: pci:v00008086d00001018sv*sd*bc*sc*i*
alias: pci:v00008086d00001017sv*sd*bc*sc*i*
alias: pci:v00008086d00001016sv*sd*bc*sc*i*
alias: pci:v00008086d00001015sv*sd*bc*sc*i*
alias: pci:v00008086d00001014sv*sd*bc*sc*i*
alias: pci:v00008086d00001013sv*sd*bc*sc*i*
alias: pci:v00008086d00001012sv*sd*bc*sc*i*
alias: pci:v00008086d00001011sv*sd*bc*sc*i*
alias: pci:v00008086d00001010sv*sd*bc*sc*i*
alias: pci:v00008086d0000100Fsv*sd*bc*sc*i*
alias: pci:v00008086d0000100Esv*sd*bc*sc*i*
alias: pci:v00008086d0000100Dsv*sd*bc*sc*i*
alias: pci:v00008086d0000100Csv*sd*bc*sc*i*
alias: pci:v00008086d00001009sv*sd*bc*sc*i*
alias: pci:v00008086d00001008sv*sd*bc*sc*i*
alias: pci:v00008086d00001004sv*sd*bc*sc*i*
alias: pci:v00008086d00001001sv*sd*bc*sc*i*
alias: pci:v00008086d00001000sv*sd*bc*sc*i*
depends:
vermagic: 2.6.32-25-server SMP mod_unload modversions
parm: TxDescriptors:Number of transmit descriptors (array of int)
parm: RxDescriptors:Number of receive descriptors (array of int)
parm: Speed:Speed setting (array of int)
parm: Duplex:Duplex setting (array of int)
parm: AutoNeg:Advertised auto-negotiation setting (array of int)
parm: FlowControl:Flow Control setting (array of int)
parm: XsumRX:Disable or enable Receive Checksum offload (array of int)
parm: TxIntDelay:Transmit Interrupt Delay (array of int)
parm: TxAbsIntDelay:Transmit Absolute Interrupt Delay (array of int)
parm: RxIntDelay:Receive Interrupt Delay (array of int)
parm: RxAbsIntDelay:Receive Absolute Interrupt Delay (array of int)
parm: InterruptThrottleRate:Interrupt Throttling Rate (array of int)
parm: SmartPowerDownEnable:Enable PHY smart power down (array of int)
parm: KumeranLockLoss:Enable Kumeran lock loss workaround (array of int)
parm: copybreak:Maximum size of packet that is copied to a new buffer on receive (uint)
parm: debug:Debug level (0=none,...,16=all) (int)
ethtool -i eth0
driver: e1000
version: 7.3.21-k5-NAPI
firmware-version: N/A
bus-info: 0000:02:01.0
watch ethtool -S eth1
NIC statistics:
rx_packets: 470902536
tx_packets: 201854613
rx_bytes: 554346183392
tx_bytes: 358609480869
rx_broadcast: 0
tx_broadcast: 0
rx_multicast: 0
tx_multicast: 0
rx_errors: 0
tx_errors: 0
tx_dropped: 0
multicast: 0
collisions: 0
rx_length_errors: 0
rx_over_errors: 0
rx_crc_errors: 0
rx_frame_errors: 0
root@NTNX-Ctrl-VM-3-proteus# netstat -i
Kernel Interface table
Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
eth0 1500 0 470597929 0 0 0 371404119 0 0 0 BMRU
eth1 1500 0 90195114 0 0 0 60650904 0 0 0 BMRU
lo 16436 0 32978986 0 0 0 32978986 0 0 0 LRU
netstat -s eth1 ( netstat -s eth1 > /tmp/1; sleep 10; netstat -s eth1> /tmp/2; diff 1 2 )
Ip:
590234026 total packets received
8429 with invalid headers
120254162 forwarded
0 incoming packets discarded
469498722 incoming packets delivered
287603881 requests sent out
Icmp:
270 ICMP messages received
0 input ICMP message failed.
ICMP input histogram:
echo requests: 270
421 ICMP messages sent
0 ICMP messages failed
ICMP output histogram:
destination unreachable: 6
time exceeded: 145
echo replies: 270
IcmpMsg:
InType8: 270
OutType0: 270
OutType3: 6
OutType11: 145
Tcp:
50236 active connections openings
64298 passive connection openings
5200 failed connection attempts
9690 connection resets received
345 connections established
469074746 segments received
167035196 segments send out
98317 segments retransmited
0 bad segments received.
50829 resets sent
Udp:
283709 packets received
28 packets to unknown port received.
0 packet receive errors
284394 packets sent
UdpLite:
TcpExt:
19224 invalid SYN cookies received
24 resets received for embryonic SYN_RECV sockets
34387 TCP sockets finished time wait in fast timer
692 time wait sockets recycled by time stamp
3666701 delayed acks sent
1372 delayed acks further delayed because of locked socket
Quick ack mode was activated 10872 times
21709599 packets directly queued to recvmsg prequeue.
3261500288 bytes directly in process context from backlog
1163896018 bytes directly received in process context from prequeue
337684597 packet headers predicted
32888878 packets header predicted and directly queued to user
14751616 acknowledgments not containing data payload received
80604811 predicted acknowledgments
2411 times recovered from packet loss by selective acknowledgements
Detected reordering 62 times using FACK
Detected reordering 789 times using SACK
Detected reordering 63 times using time stamp
49 congestion windows fully recovered without slow start
989 congestion windows partially recovered using Hoe heuristic
265 congestion windows recovered without slow start by DSACK
24 congestion windows recovered without slow start after partial ack
35294 TCP data loss events
TCPLostRetransmit: 682
48 timeouts after SACK recovery
89178 fast retransmits
4722 forward retransmits
3834 retransmits in slow start
239 other TCP timeouts
206 SACK retransmits failed
1 times receiver scheduled too late for direct processing
10879 DSACKs sent for old packets
7812 DSACKs received
20342 connections reset due to unexpected data
4167 connections reset due to early user close
8 connections aborted due to timeout
TCPDSACKIgnoredOld: 5654
TCPDSACKIgnoredNoUndo: 368
TCPSackShifted: 230706
TCPSackMerged: 182577
TCPSackShiftFallback: 19457
IpExt:
InMcastPkts: 12889
InBcastPkts: 195690
InOctets: 1795087596
OutOctets: -358547569
InMcastOctets: 493576
InBcastOctets: 39597687
ISCSI on CVM:
root@NTNX-Ctrl-VM-3-proteus:~/serviceability/config/nagios3# lsmod|grep iscsi
iscsi_tcp 10188 0
libiscsi_tcp 16788 1 iscsi_tcp
libiscsi 44398 3 ib_iser,iscsi_tcp,libiscsi_tcp
scsi_transport_iscsi 38402 4 ib_iser,iscsi_tcp,libiscsi
root@NTNX-Ctrl-VM-3-proteus:~/serviceability/config/nagios3# modinfo libiscsi
filename: /lib/modules/2.6.32-25-server/kernel/drivers/scsi/libiscsi.ko
license: GPL
description: iSCSI library functions
author: Mike Christie
srcversion: 4D6F40D9FEBD420A25F5089
depends: scsi_transport_iscsi
vermagic: 2.6.32-25-server SMP mod_unload modversions
parm: debug_libiscsi_conn:Turn on debugging for connections in libiscsi module. Set to 1 to turn on, and zero to turn off. Default is off. (int)
parm: debug_libiscsi_session:Turn on debugging for sessions in libiscsi module. Set to 1 to turn on, and zero to turn off. Default is off. (int)
parm: debug_libiscsi_eh:Turn on debugging for error handling in libiscsi module. Set to 1 to turn on, and zero to turn off. Default i
iscsiadm -m discovery -t sendtargets -p 127.0.0.1:3261 ( if u don't see the vdisk that was created, then check zeus_config_printer
if the disk is set to delete or there is vzone config).
192.168.5.2:62015,1 iqn.2010-06.com.nutanix:shared_data11_10g-dbd2670f
192.168.5.2:3261,1 iqn.2010-06.com.nutanix:vdisk-jenkins-home-60425f0d
192.168.5.2:3261,1 iqn.2010-06.com.nutanix:vdisk-jenkins-var-ffa83c61
192.168.5.2:62008,1 iqn.2010-06.com.nutanix:shared_data4-d6de24ba
192.168.5.2:62011,1 iqn.2010-06.com.nutanix:shared-lun10-54a5bcd7
192.168.5.2:62012,1 iqn.2010-06.com.nutanix:shared_data8_10g-893d36a6
192.168.5.2:62002,1 iqn.2010-06.com.nutanix:shared_data2-f32ba819
192.168.5.2:62003,1 iqn.2010-06.com.nutanix:shared_data3-14038b98
192.168.5.2:62010,1 iqn.2010-06.com.nutanix:shared_data6-bfaa6e4d
192.168.5.2:62000,1 iqn.2010-06.com.nutanix:shared_data0-ed7fb8e6
192.168.5.2:3261,1 iqn.2010-06.com.nutanix:vdisk-test-657ac94b
192.168.5.2:62014,1 iqn.2010-06.com.nutanix:shared_data10_10g-a012f8f6
192.168.5.2:62001,1 iqn.2010-06.com.nutanix:shared_data1-665353cd
192.168.5.2:62009,1 iqn.2010-06.com.nutanix:shared_data5-0ceb3267
192.168.5.2:62013,1 iqn.2010-06.com.nutanix:shared_data9_10g-5c4b59f2
192.168.5.2:62007,1 iqn.2010-06.com.nutanix:shared_data7-402424f8
root@NTNX-Ctrl-VM-3-proteus# iscsiadm -m node -T iqn.2010-06.com.nutanix:shared_data10_10g-a012f8f6 to find Iscsi parameters.
# BEGIN RECORD 2.0-871
node.name = iqn.2010-06.com.nutanix:shared_data10_10g-a012f8f6
node.tpgt = 1
node.startup = manual
iface.hwaddress =
iface.ipaddress =
iface.iscsi_ifacename = default
iface.net_ifacename =
iface.transport_name = tcp
iface.initiatorname =
node.discovery_address = 127.0.0.1
node.discovery_port = 3261
node.discovery_type = send_targets
node.session.initial_cmdsn = 0
node.session.initial_login_retry_max = 8
node.session.xmit_thread_priority = -20
node.session.cmds_max = 128
node.session.queue_depth = 32
node.session.auth.authmethod = None
node.session.auth.username =
node.session.auth.password =
node.session.auth.username_in =
node.session.auth.password_in =
node.session.timeo.replacement_timeout = 120
node.session.err_timeo.abort_timeout = 15
node.session.err_timeo.lu_reset_timeout = 20
node.session.err_timeo.host_reset_timeout = 60
node.session.iscsi.FastAbort = Yes
node.session.iscsi.InitialR2T = No
node.session.iscsi.ImmediateData = Yes
node.session.iscsi.FirstBurstLength = 262144
node.session.iscsi.MaxBurstLength = 16776192
node.session.iscsi.DefaultTime2Retain = 0
node.session.iscsi.DefaultTime2Wait = 2
node.session.iscsi.MaxConnections = 1
node.session.iscsi.MaxOutstandingR2T = 1
node.session.iscsi.ERL = 0
node.conn[0].address = 192.168.5.2
node.conn[0].port = 62014
node.conn[0].startup = manual
node.conn[0].tcp.window_size = 524288
node.conn[0].tcp.type_of_service = 0
node.conn[0].timeo.logout_timeout = 15
node.conn[0].timeo.login_timeout = 15
node.conn[0].timeo.auth_timeout = 45
node.conn[0].timeo.noop_out_interval = 5
node.conn[0].timeo.noop_out_timeout = 5
node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
node.conn[0].iscsi.HeaderDigest = None
node.conn[0].iscsi.DataDigest = None
node.conn[0].iscsi.IFMarker = No
node.conn[0].iscsi.OFMarker = No
# END RECORD
root@NTNX-Ctrl-VM-3-proteus:~/serviceability/config/nagios3# iscsiadm -m node -T iqn.2010-06.com.nutanix:shared_data10_10g-a012f8f6 --login
Logging in to [iface: default, target: iqn.2010-06.com.nutanix:shared_data10_10g-a012f8f6, portal: 192.168.5.2,62014]
Login to [iface: default, target: iqn.2010-06.com.nutanix:shared_data10_10g-a012f8f6, portal: 192.168.5.2,62014]: successful
root@NTNX-Ctrl-VM-3-proteus:~/serviceability/config/nagios3# sudo iptables -S -t nat |grep 62014
-A PREROUTING -d 192.168.5.2/32 -p tcp -m tcp --dport 62014 -m comment --comment "stargate" -j DNAT --to-destination 172.16.13.24:3261
-A OUTPUT -d 192.168.5.2/32 -p tcp -m tcp --dport 62014 -m comment --comment "stargate" -j DNAT --to-destination 172.16.13.24:3261
Attachments (0)
Attach a file:
Comments
_displayNameOrEmail_ - _time_ - Remove_text_
Jerome Joseph - Dec 4, 2011 2:17 PM - Remove
Increase ISCSI verbosity
http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1013283
---
Dec 4 11:08:02 iscsid: in VmIscsiNetlink_RecvPduData
Dec 4 11:08:02 iscsid: read 48 bytes of PDU header
Dec 4 11:08:02 iscsid: read 48 PDU header bytes, opcode 0x20, dlength 0, data 0x52895424, max 8192
Dec 4 11:08:02 iscsid: in VmIscsiNetlink_RecvPduEnd
Dec 4 11:08:02 iscsid: recv PDU finished for pdu handle 0x0x52815080
Dec 4 11:08:02 iscsid: thread 528978a4 delete: state 2
Dec 4 11:08:02 iscsid: thread 528978cc delete: state 0
Dec 4 11:08:02 iscsid: deleting a scheduled/waiting thread!
Dec 4 11:08:02 iscsid: conn noop out timer 0x528978a4 stopped
Dec 4 11:08:02 iscsid: thread 528978a4 schedule: delay 60 state 2
Dec 4 11:08:02 iscsid: thread removed
Dec 4 11:08:02 iscsid: exec thread 08fa4c3c callback
Dec 4 11:08:02 iscsid: event_type: 1 removing from the head: 0x0x8f45698:0x0x8f456b4:0x0x8f456b4:0x0x8f49698 elem 0x0x8f45698 length 28
Dec 4 11:08:02 iscsid: in VmIscsiNetlink_RecvPduBegin
Dec 4 11:08:02 iscsid: recv PDU began, pdu handle 0x0x523b20a8
Dec 4 11:08:02 iscsid: in VmIscsiNetlink_RecvPduData
Dec 4 11:08:02 iscsid: read 48 bytes of PDU header
Dec 4 11:08:02 iscsid: read 48 PDU header bytes, opcode 0x20, dlength 0, data 0x8f9f86c, max 8192
Dec 4 11:08:02 iscsid: in VmIscsiNetlink_RecvPduEnd
Dec 4 11:08:02 iscsid: recv PDU finished for pdu handle 0x0x523b20a8
Dec 4 11:08:02 iscsid: thread 08fa1cec delete: state 2
Dec 4 11:08:02 iscsid: thread 08fa1d14 delete: state 0
Dec 4 11:08:02 iscsid: deleting a scheduled/waiting thread!
Dec 4 11:08:02 iscsid: conn noop out timer 0x8fa1cec stopped
Dec 4 11:08:02 iscsid: thread 08fa1cec schedule: delay 60 state 2
Dec 4 11:08:02 iscsid: thread removed
Dec 4 11:08:02 iscsid: exec thread 52597bfc callback
Dec 4 11:08:02 iscsid: event_type: 1 removing from the head: 0x0x525dfde0:0x0x525dfdfc:0x0x525dfdfc:0x0x525e3de0 elem 0x0x525dfde0 length 28
Dec 4 11:08:02 iscsid: in VmIscsiNetlink_RecvPduBegin
Dec 4 11:08:02 iscsid: recv PDU began, pdu handle 0x0x5283c108
Dec 4 11:08:02 iscsid: in VmIscsiNetlink_RecvPduData
Dec 4 11:08:02 iscsid: read 48 bytes of PDU header
Dec 4 11:08:02 iscsid: read 48 PDU header bytes, opcode 0x20, dlength 0, data 0x5259282c, max 8192
Dec 4 11:08:02 iscsid: in VmIscsiNetlink_RecvPduEnd
Dec 4 11:08:02 iscsid: recv PDU finished for pdu handle 0x0x5283c108
Dec 4 11:08:02 iscsid: thread 52594cac delete: state 2
Dec 4 11:08:02 iscsid: thread 52594cd4 delete: state 0
Jerome Joseph - Dec 11, 2011 7:23 PM - Remove
Quick Vsphere 5.0 commands
Enable software iSCSI on the ESXi host
~ # esxcli iscsi software set --enabled=true
Add a portgroup to my standard vswitch for iSCSI #1
~ # esxcli network vswitch standard portgroup add -p iSCSI-1 -v vSwitch0
Now add a vmkernel nic (vmk1) to my portgroup
~ # esxcli network ip interface add -i vmk1 -p iSCSI-1
Repeat for iSCSI #2
~ # esxcli network vswitch standard portgroup add -p iSCSI-2 -v vSwitch0
~ # esxcli network ip interface add -i vmk2 -p iSCSI-2
Set the VLAN for both my iSCSI VMkernel port groups - in my case VLAN 140
~ # esxcli network vswitch standard portgroup set -p iSCSI-1 -v 140
~ # esxcli network vswitch standard portgroup set -p iSCSI-2 -v 140
Set the static IP addresses on both VMkernel NICs as part of the iSCSI network
~ # esxcli network ip interface ipv4 set -i vmk1 -I 10.190.201.62 -N 255.255.255.0 -t static
~ # esxcli network ip interface ipv4 set -i vmk2 -I 10.190.201.63 -N 255.255.255.0 -t static
Set manual override fail-over policy so each iSCSI VMkernel portgroup had one active physical vmnic
~ # esxcli network vswitch standard portgroup policy failover set -p iSCSI-1 -a vmnic0
~ # esxcli network vswitch standard portgroup policy failover set -p iSCSI-2 -a vmnic3
Bond each of the VMkernel NICs to the software iSCSI HBA
~ # esxcli iscsi networkportal add -A vmhba33 -n vmk1
~ # esxcli iscsi networkportal add -A vmhba33 -n vmk2
Add the IP address of your iSCSI array or SAN as a dynamic discovery sendtarget
~ # esxcli iscsi adapter discovery sendtarget add -A vmhba33 -a 10.190.201.102
Re-scan your software iSCSI hba to discover volumes and VMFS datastores
~ # esxcli storage core adapter rescan --adapter vmhba33
Jerome Joseph - Dec 14, 2011 5:57 PM - Remove
vsish -e set /config/VMFS3/intOpts/EnableDataMovement 0
vsish -e set /config/DataMover/intOpts/HardwareAcceleratedInit 0
vsish -e set /config/DataMover/intOpts/HardwareAcceleratedMove 0
vsish -e set /config/VMFS3/intOpts/ResvLostRetries 10
vsish -e set /config/Cpu/intOpts/TrackMigrations 0
vsish -e set /config/FSS/intOpts/FSSEnableDataMovement 0
vsish -e set /config/Migrate/intOpts/VMotionStreamHelpers 32
vsish -e set /config/Migrate/intOpts/DiskOpsMaxRetries 50
vsish -e set /config/Migrate/intOpts/NetTimeout 300
vsish -e set /config/Migrate/intOpts/MigrateCpuMinPct1G 30
vsish -e set /config/Migrate/intOpts/MigrateCpuMinPct10G 50
vsish -e set /config/Migrate/intOpts/MigrateCpuSharesRegular 10000
vsish -e set /config/Migrate/intOpts/MigrateCpuSharesHighPriority 20000
vsish -e set /config/Migrate/intOpts/NetResPoolsSched 0
No comments:
Post a Comment