With more than 30,000 customers, vSAN continues to innovate. We’re excited to announce vSAN 7 Update 2, which delivers flexible, resilient, and future ready infrastructure that allows our customers to meet dynamic business and workload demands without compromising on efficiency, performance, or resiliency. We have enhanced the usability of vSAN deployed in various physical topologies, … Continued The post What’s New with vSAN 7 Update 2 appeared first on VMware vSAN Virtual Blocks Blog.
We are excited to share that today VMware is releasing vSphere 7 Update 2. With vSphere 7, released in April 2020, we moved vSphere to a six-month release cycle. We released vSphere 7 Update 1 in October 2020, and vSphere 7 Update 2 today. With this faster pace, you get the benefits of the […]
Tweet Thank you to everyone who applied for vExpert and to the vExpert PROs for managing the voting process, it’s a lot of work! We are pleased to announce the list of 2021 vExperts. You can visit the vExpert Directory to see the list and profiles of each vExpert. All of the new and returning … Continued The post vExpert 2021 Award Announcement appeared first on VMware vExpert Blog.
VMware CEO Pat Gelsinger is stepping down after eight years in the role early in February to take over the company reins of his previous employer, Intel, from its outgoing chief Bob Swan. Before taking over as CEO of VMWare in 2012, and holding the position of president and chief […]
Welcome back VMworld (& VMware) enthusiasts – we hope your year is off to a safe and healthy start. We’re excited to kick off the new year by announcing the official dates for VMworld 2021. We are thrilled to have you all join us online from October 5 – 7, 2021. To ensure the well-being […]
Restart the daemons for the specified solution ID.
daemon control
start
Start the daemons for the specified solution ID.
daemon control
stop
Stop the daemons for the specified DSDK built solution.
daemon info
get
Get running daemon status for the specified solution ID.
daemon info
list
List the installed DSDK built daemons.
hardware pci pcipassthru
list
Display PCI device passthru configuration.
hardware pci pcipassthru
set
Configure PCI device for passthrough.
network nic attachment
add
Attach one uplink as a branch to a trunk uplink with specified VLAN ID.
network nic attachment
list
Show uplink attachment information.
network nic attachment
remove
Detach a branch uplink from its trunk.
network nic dcb status
get
Get the DCB information for a NIC.
network nic hwCap activated
list
List activated hardware capabilities of physical NICs.
network nic hwCap supported
list
List supported hardware capabilities of physical NICs.
nvme adapter
list
List all NVMe adapters.
nvme controller
identify
Get NVMe Identify Controller data.
nvme controller
list
List all NVMe controllers.
nvme fabrics
connect
Connect to an NVMe controller on a specified target through an adapter.
nvme fabrics connection
delete
Delete persistent NVMe over Fabrics connection entries. Reboot required for settings to take effect.
nvme fabrics connection
list
List all persistent NVMe over Fabrics connection entries.
nvme fabrics
disable
Disable NVMe over Fabrics for a transport protocol.
nvme fabrics
disconnect
Disconnect a specified NVMe controller on the specified NVMe adapter.
nvme fabrics
discover
Discover NVMe controllers on the specified target port through the specified NVMe adapter and list all of them.
nvme fabrics
enable
Enable NVMe over Fabrics for a transport protocol.
nvme info
get
Get NVMe host information.
nvme namespace
identify
Get NVMe Identify Namespace data.
nvme namespace
list
List all NVMe namespaces.
rdma iser params
set
Change iSER kernel driver settings.
software addon
get
Display the installed Addon on the host.
software
apply
Applies a complete image with a software spec that specifies base image, addon and components to install on the host.
software baseimage
get
Display the installed baseimage on the host.
software component
apply
Installs Component packages from a depot. Components may be installed, upgraded. WARNING: If your installation requires a reboot, you need to disable HA first.
software component
get
Displays detailed information about one or more installed Components
software component
list
Lists the installed Component packages
software component
remove
Removes components from the host. WARNING: If your installation requires a reboot, you need to disable HA first.
software component signature
verify
Verifies the signatures of installed Components and displays the name, version, vendor, acceptance level and the result of signature verification for each of them.
software component vib
list
List VIBs in an installed Component.
software sources addon
get
Display details about Addons in the depots.
software sources addon
list
List all Addons in the depots.
software sources baseimage
get
Display details about a Base Image from the depot.
software sources baseimage
list
List all the Base Images in a depot.
software sources component
get
Displays detailed information about one or more Components in the depot
software sources component
list
List all the Components from depots.
software sources component vib
list
List VIB packages in the specified Component in a depot.
storage core device smart daemon
start
Enable smartd.
storage core device smart daemon status
get
Get status of smartd.
storage core device smart daemon
stop
Disable smartd.
storage core device smart status
get
Get status of SMART stats on a device.
storage core device smart status
set
Enable or disable SMART stats gathering on a device.
system ntp config
get
Display Network Time Protocol configuration.
system ntp
get
Display Network Time Protocol configuration
system ntp
set
Configures the ESX Network Time Protocol agent.
system ptp
get
Display Precision Time Protocol configuration
system ptp
set
Configures the ESX Precision Time Protocol agent.
system ptp stats
get
Report operational state of Precision Time Protocol Daemon
vm appinfo
get
Get the state of appinfo component on the ESXi host.
vm appinfo
set
Modify the appinfo component on the ESXi host.
vsan network security
get
Get vSAN network security configurations.
vsan network security
set
Configure vSAN network security settings.
The ESXCLI command set allows you to run common system administration commands against vSphere systems from an administration server of your choice. The actual list of commands depends on the system that you are running on. Run esxcli --help for a list of commands on your system.
First, run the command on all Remote Collector nodes (if present) in the cluster, and wait for the task to complete. Continue to step 7.2.
Next, run the command on all Data nodes, the Witness node (if present), and the Primary Replica node (if present) in the cluster; do not wait for each node to complete, just start the command on all nodes. Once Waiting for certificate generation to complete appears on the last node, wait roughly 60 seconds, and continue to step 7.3.
Finally, run the command on the Primary node.
The expected behavior is for the command to finish, then shortly afterwards the pending tasks on the Data nodes and Primary Replica node (if present) will complete. To ensure that the command completes successfully check:
ls -l /var/vmware/_cert_generation_completed
Run the following commands on all nodes in the vRealize Operations cluster:
chown admin:admin -R /storage/vcops/user/conf/ssl/ /storage/vcops/user/conf/ssl_bak/ /storage/db/casa/webapp/hsqldb/
chmod guo+r -R /storage/vcops/user/conf/ssl/
service vmware-casa restart
service vmware-vcops stop
sed -i 's/sliceonline\ \=\ true/sliceonline\ \=\ false/g' /usr/lib/vmware-vcopssuite/utilities/sliceConfiguration/data/roleState.properties
Run the following commands on the Primary node, and Primary Replica node (if present):
service vmware-casa stop
sed -i -e 's/\"onlineState\"\:\"GOING\_OFFLINE\"/\"onlineState\"\:\"OFFLINE\"/g' -e 's/\"online\_state\"\:\"GOING\_OFFLINE\"/\"online\_state\"\:\"OFFLINE\"/g' -e 's/\"onlineState\"\:\"GOING\_ONLINE\"/\"onlineState\"\:\"OFFLINE\"/g' -e 's/\"online\_state\"\:\"GOING\_ONLINE\"/\"online\_state\"\:\"OFFLINE\"/g' -e 's/\"onlineState\"\:\"ONLINE\"/\"onlineState\"\:\"OFFLINE\"/g' -e 's/\"online\_state\"\:\"ONLINE\"/\"online\_state\"\:\"OFFLINE\"/g' -e 's/\"onlineState\"\:\"FAILURE\"/\"onlineState\"\:\"OFFLINE\"/g' -e 's/\"online\_state\"\:\"FAILURE\"/\"online\_state\"\:\"OFFLINE\"/g' /data/db/casa/webapp/hsqldb/casa.db.script
service vmware-casa start
service vmware-vcops-web restart
/etc/init.d/apache2 restart
Log into the vRealize Operations Admin UI as the local admin user.
Click Bring Online under Cluster Status.
Summary:
When I can see message “Data Retriever is not initialized yet. Please wait …” or “Incorrect user name/password”.
Try to check and fix for expired internal certificate in vRealize Operations.
One day I reach vRops admin login message “Incorrect user name/password”. Here is a short info How to reset the admin password in vRealize Operations according KB 2078313. But I was unable to reset. My problem was with expired internal certificate in vRealize Operations.
Reset the OS admin Password
Note: Before resetting the admin password, ensure that the account is not locked out by this command:
pam_tally2 --user admin --reset
Note: If the admin password expires for the local OS, update the local OS version of the password before completing the below steps to reset the password across the Application:
Log into the Master node as root via SSH or Console.
Run the following command to reset the password, and password age of the local admin account:
passwd admin
Repeat steps 1 and 2 on all nodes in the vRealize Operations Manager cluster, including Remote Collectors.
Reset the vRops admin Password
To reset the admin password, follow the steps below:
Log in to the Master node as root via SSH or Console.
I upgraded vCenter to version 7 successfully but failed when it came to updating my hosts from 6.7 to 7.
I got some warning stating PCI devices were incompatible but tried anyways. Turns out that failed, my Mellanox ConnectX 2 wasn’t showing up as an available physical NIC.
At first It was necessary to have VID/DID device code for MT26448 [ConnectX EN 10GigE , PCIe 2.0 5GT/s].
Partner
Product
Driver
VID
DID
Mellanox
MT26448 [ConnectX EN 10GigE , PCIe 2.0 5GT/s]
mlx4_core
15b3
6750
Whole table We could check here or search mlx to see all Mellanox cards list.
Deprecated devices supported by VMKlinux drivers
Devices that were only supported in 6.7 or earlier by a VMKlinux inbox driver. These devices are no longer supported because all support for VMKlinux drivers and their devices have been completely removed in 7.0.
*********************************************************************
/vmfs/volumes/ISO/tmp-network/etc/vmware/default.map.d/nmlx4_core.map
*********************************************************************
regtype=native,bus=pci,id=15b301f6..............,driver=nmlx4_core
regtype=native,bus=pci,id=15b301f8..............,driver=nmlx4_core
regtype=native,bus=pci,id=15b31003..............,driver=nmlx4_core
regtype=native,bus=pci,id=15b31004..............,driver=nmlx4_core
regtype=native,bus=pci,id=15b31007..............,driver=nmlx4_core
regtype=native,bus=pci,id=15b3100715b30003......,driver=nmlx4_core
regtype=native,bus=pci,id=15b3100715b30006......,driver=nmlx4_core
regtype=native,bus=pci,id=15b3100715b30007......,driver=nmlx4_core
regtype=native,bus=pci,id=15b3100715b30008......,driver=nmlx4_core
regtype=native,bus=pci,id=15b3100715b3000c......,driver=nmlx4_core
regtype=native,bus=pci,id=15b3100715b3000d......,driver=nmlx4_core
regtype=native,bus=pci,id=15b36750..............,driver=nmlx4_core
------------------------->Last Line is FIX
And add HW ID support in file nmlx4_core.ids:
**************************************************************************************
/vmfs/volumes/FreeNAS/ISO/tmp-network/usr/share/hwdata/default.pciids.d/nmlx4_core.ids
**************************************************************************************
#
# This file is mechanically generated. Any changes you make
# manually will be lost at the next build.
#
# Please edit <driver>_devices.py file for permanent changes.
#
# Vendors, devices and subsystems.
#
# Syntax (initial indentation must be done with TAB characters):
#
# vendor vendor_name
# device device_name <-- single TAB
# subvendor subdevice subsystem_name <-- two TABs
15b3 Mellanox Technologies
01f6 MT27500 [ConnectX-3 Flash Recovery]
01f8 MT27520 [ConnectX-3 Pro Flash Recovery]
1003 MT27500 Family [ConnectX-3]
1004 MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function]
1007 MT27520 Family [ConnectX-3 Pro]
15b3 0003 ConnectX-3 Pro VPI adapter card; dual-port QSFP; FDR IB (56Gb/s) and 40GigE (MCX354A-FCC)
15b3 0006 ConnectX-3 Pro EN network interface card 40/56GbE dual-port QSFP(MCX314A-BCCT )
15b3 0007 ConnectX-3 Pro EN NIC; 40GigE; dual-port QSFP (MCX314A-BCC)
15b3 0008 ConnectX-3 Pro VPI adapter card; single-port QSFP; FDR IB (56Gb/s) and 40GigE (MCX353A-FCC)
15b3 000c ConnectX-3 Pro EN NIC; 10GigE; dual-port SFP+ (MCX312B-XCC)
15b3 000d ConnectX-3 Pro EN network interface card; 10GigE; single-port SFP+ (MCX311A-XCC)
6750 Mellanox ConnectX-2 Dual Port 10GbE
-------->Last Line is FIX
After reboot I could see support for MT26448 [ConnectX EN 10GigE , PCIe 2.0 5GT/s].
Only ALERT: Failed to verify signatures of the following vib(s): [nmlx4-core].
2020-XX-XXTXX:XX:44.473Z cpu0:2097509)ALERT: Failed to verify signatures of the following vib(s): [nmlx4-core]. All tardisks validated
2020-XX-XXTXX:XX:47.909Z cpu1:2097754)Loading module nmlx4_core ...
2020-XX-XXTXX:XX:47.912Z cpu1:2097754)Elf: 2052: module nmlx4_core has license BSD
2020-XX-XXTXX:XX:47.921Z cpu1:2097754)<NMLX_INF> nmlx4_core: init_module called
2020-XX-XXTXX:XX:47.921Z cpu1:2097754)Device: 194: Registered driver 'nmlx4_core' from 42
2020-XX-XXTXX:XX:47.921Z cpu1:2097754)Mod: 4845: Initialization of nmlx4_core succeeded with module ID 42.
2020-XX-XXTXX:XX:47.921Z cpu1:2097754)nmlx4_core loaded successfully.
2020-XX-XXTXX:XX:47.951Z cpu1:2097754)<NMLX_INF> nmlx4_core: 0000:05:00.0: nmlx4_core_Attach - (nmlx4_core_main.c:2476) running
2020-XX-XXTXX:XX:47.951Z cpu1:2097754)DMA: 688: DMA Engine 'nmlx4_core' created using mapper 'DMANull'.
2020-XX-XXTXX:XX:47.951Z cpu1:2097754)DMA: 688: DMA Engine 'nmlx4_core' created using mapper 'DMANull'.
2020-XX-XXTXX:XX:47.951Z cpu1:2097754)DMA: 688: DMA Engine 'nmlx4_core' created using mapper 'DMANull'.
2020-XX-XXTXX:XX:49.724Z cpu1:2097754)<NMLX_INF> nmlx4_core: 0000:05:00.0: nmlx4_ChooseRoceMode - (nmlx4_core_main.c:382) Requested RoCE mode RoCEv1
2020-XX-XXTXX:XX:49.724Z cpu1:2097754)<NMLX_INF> nmlx4_core: 0000:05:00.0: nmlx4_ChooseRoceMode - (nmlx4_core_main.c:422) Requested RoCE mode is supported - choosing RoCEv1
2020-XX-XXTXX:XX:49.934Z cpu1:2097754)<NMLX_INF> nmlx4_core: 0000:05:00.0: nmlx4_CmdInitHca - (nmlx4_core_fw.c:1408) Initializing device with B0 steering support
2020-XX-XXTXX:XX:50.561Z cpu1:2097754)<NMLX_INF> nmlx4_core: 0000:05:00.0: nmlx4_InterruptsAlloc - (nmlx4_core_main.c:1744) Granted 38 MSIX vectors
2020-XX-XXTXX:XX:50.561Z cpu1:2097754)<NMLX_INF> nmlx4_core: 0000:05:00.0: nmlx4_InterruptsAlloc - (nmlx4_core_main.c:1766) Using MSIX
2020-XX-XXTXX:XX:50.781Z cpu1:2097754)Device: 330: Found driver nmlx4_core for device 0xxxxxxxxxxxxxxxxxxxxxxx
Some 10 Gbps tuning testing looks great, between 2x ESXi 7.0 with 2x MT2644:
Support for RoCEv2 is above card – Mellanox ConnectX-3 Pro
We can see RoCEv2 options in nmlx2_core driver, but when I enabled enable_rocev2 It is NOT working
[root@esxi~] esxcli system module parameters list -m nmlx4_core
Name Type Value Description
---------------------- ---- ----- -----------
enable_64b_cqe_eqe int Enable 64 byte CQEs/EQEs when the the FW supports this
enable_dmfs int Enable Device Managed Flow Steering
enable_qos int Enable Quality of Service support in the HCA
enable_rocev2 int Enable RoCEv2 mode for all devices
enable_vxlan_offloads int Enable VXLAN offloads when supported by NIC
log_mtts_per_seg int Log2 number of MTT entries per segment
log_num_mgm_entry_size int Log2 MGM entry size, that defines the number of QPs per MCG, for example: value 10 results in 248 QP per MGM entry
msi_x int Enable MSI-X
mst_recovery int Enable recovery mode(only NMST module is loaded)
rocev2_udp_port int Destination port for RoCEv2
It is officialy NOT supported. Use it only in your HomeLAB. But We could save some money for new 10Gbps network cards.
