Batching guest discovery and data collection

Download the mcdc CLI

1. Connect to the Linux machine:

   ssh MACHINE_IP

   Replace MACHINE_IP with the IP address of your Linux machine.

2. Download the latest version of the mcdc CLI and make it executable:

    curl -O "https://mcdc-release.storage.googleapis.com/$(curl -s https://mcdc-release.storage.googleapis.com/latest)/mcdc"  chmod +x mcdc

3. Add the mcdc CLI to your shell path:

   PATH=$PATH:`pwd`

Perform a VMware inventory discovery

• Run the inventory discovery:

  ./mcdc discover vsphere -u USERNAME --url https://VSPHERE_URL 

  Replace the following:

  • USERNAME: your vCenter username
  • VSPHERE_URL: the URL for your vCenter Server instance or the vSphere Client

  The output of the discover command looks like the following:

   [+] Found 528 VMs Collecting data... 528 / 528 [---------------------------------------------------] 100.00% 5 p/s [✓] Collection completed. 

Generate a CSV file with all the discovered VMs

To generate a CSV file, use the export script from the Migrate to Containers repository on GitHub.

 vms=$(mcdc report --format csv | tail -n +2 | awk -F ',' '{; print $2";"$3";"$4";;;"}') printf "%s\n" "Name;Platform VM ID;OS Family;IP;USERNAME;PASSWORD" printf "%s\n" "$vms" 

The script uses the report command to generate a CSV file containing all the VMs that were discovered in the previous step.

1. Download the script:

   curl -O https://raw.githubusercontent.com/GoogleCloudPlatform/migrate-to-containers/main/scripts/mcdc/mcdc_discovery_export_guest_tools.sh chmod +x mcdc_discovery_export_guest_tools.sh 

2. Run the script and save the output to a file:

   ./mcdc_discovery_export_guest_tools.sh > VMS_CSV_FILE 

   Replace VMS_CSV_FILE with the name you want for the CSV file.

Split the CSV file into multiple CSV files with a subset of the VMs

To split the large CSV file into smaller CSV files, use the splitter script from the Migrate to Containers repository on GitHub.

tail -n +2 $1 | split -d -l $num_of_lines - $2 for file in $2* do  head -n 1 $1 > tmp_file  cat "$file" >> tmp_file  mv -f tmp_file "$file" done

1. Download the script:

   curl -O https://raw.githubusercontent.com/GoogleCloudPlatform/migrate-to-containers/main/scripts/mcdc/csv_splitter.sh chmod +x csv_splitter.sh 

2. Run the script:

   ./csv_splitter.sh VMS_CSV_FILE CSV_FILES_PREFIX LINES_PER_FILE VMS_CSV_FILE CSV_FILES_PREFIX 

   Replace the following:

   • VMS_CSV_FILE: the input CSV file to split.
   • CSV_FILES_PREFIX: the prefix for the generated CSV files.
   • LINES_PER_FILE: the number of lines per generated CSV file. The default value is 10.

   The script generates various CSV files.

3. View the list of generated CSV files:

   ls -lrt CSV_FILES_PREFIX* 

Run guest discovery on all the VMs in a CSV files

To run the guest discovery for the VMs in a CSV file, use the collection script from the Migrate to Containers GitHub repository.

Repeat this step for each CSV file generated in the previous step.

 url_regex='^https?://[-A-Za-z0-9\+&@#/%?=~_|!:,.;]*[-A-Za-z0-9\+&@#/%=~_|]\.[-A-Za-z0-9\+&@#/%?=~_|!:,.;]*[-A-Za-z0-9\+&@#/%=~_|]$' read -r -p "CSV file name: " CSV_FILE if [[ ! -r "$CSV_FILE" ]]; then  echo "The file $CSV_FILE does not exist or can not be accessed."  exit 1 fi read -r -p "vSphere URL: " VSPHERE_URL if ! [[ $VSPHERE_URL =~ $url_regex ]]; then  echo "vSphere URL $VSPHERE_URL IS not a valid URL"  exit 1 fi read -r -p "vSphere username: " VSPHERE_USER read -r -s -p "vSphere password: " VSPHERE_PASSWORD echo "" read -r -p "Default username: " DEFAULT_USER read -r -s -p "Default password: " DEFAULT_PASSWORD echo "" # CSV fields #NAME;PLATFORM VM ID;OS;IP;USERNAME;PASSWORD while IFS=";" read -r vm_name vm_id os ip username password do  if [ -z "$username" ]  then  username=$DEFAULT_USER  fi  if [ -z "$password" ]  then  password=$DEFAULT_PASSWORD  fi  if [ ! -z "$vm_id" ]  then  # Note that the below only works for VMWare VMs  # vm_id after the last slash if prefixed by vSphere IP  mod_vm_id=$(echo "$vm_id" | sed 's/.*\///')  mcdc discover vsphere guest --url $VSPHERE_URL -u $VSPHERE_USER -p $VSPHERE_PASSWORD --vm-user $username --vm-password $password $mod_vm_id  else  echo "Skipping VM: $vm_name because it has no VM ID"  fi  done < <(tail -n +1 $CSV_FILE) 

The script uses the discover vsphere guest command to upload and execute the guest collection script on the VM.

It's best to execute this script in the background and direct the output to a log file. To do so, you need to create a text file which is passed as input to the script.

1. Create the text file:

   cat <<EOF >> INPUT_FILE CSV_FILES_PREFIXCSV_FILE_SUFFIX VSPHERE_URL VSPHERE_USER VSPHERE_PASSWORD VM_USER VM_PASSWORD EOF 

   Replace the following:

   • INPUT_FILE: input filename
   • CSV_FILES_PREFIX: CSV filename prefix
   • CSV_FILE_SUFFIX: CSV filename suffix
   • VSPHERE_URL: the URL for your vCenter Server instance or the vSphere Client
   • VSPHERE_USER: vCenter username
   • VSPHERE_PASSWORD: vCenter password
   • VM_USER: VM username
   • VM_PASSWORD: VM password

2. Run the guest collection script:

   nohup ./mcdc_collect_vms_guest_tools.sh <INPUT_FILE > /tmp/mcdc.out 2>&1 & 

3. Repeat steps 1 and 2 for each CSV file generated in the previous step.

Generate an offline assessment report

• After all the data is collected, you can produce a detailed HTML report:

  ./mcdc report --format html --full > REPORT_NAME.html