Deployment Steps

This section describes how to deploy, configure, and undeploy PrimaryIO Hybrid Cloud Data Management (HDM) 2.2 for enabling migrations of virtual machines to IBM Cloud for VMware Solutions Dedicated (VCS).

HDM Deployment Steps

HDM deployment involves the following six steps, each of which are discussed in detail in the sections below:

  1. Deploy the HDM Appliance On-Premises
  2. Add an On-Premises vCenter to the Appliance
  3. Register the HDM plugin to the On-Premises vCenter
  4. Add the HDM License
  5. Deploy HDM On-Premises
  6. Deploy HDM in the Cloud

Step 1: Deploy the HDM Appliance On-Premises

The HDM Appliance manages on-premises and cloud HDM operations. This section covers the following topics for deployment and configuration of the HDM Appliance:

  1. Placement of the HDM Appliance on-Premises
  2. System Requirements for the Appliance
  3. Network Requirements
  4. Deployment and Configuration
  5. Network Configuration for the Appliance
  6. Adding vCenter

Placement of HDM Appliance

  1. The HDM Appliance must be deployed on the same on-premises vCenter it will manage.
  2. It should ideally be kept in a separate cluster than the one it will manage.

Deployment and Configuration

The HDM appliance must be installed from the OVF in the HDM package. Be sure to check that the placement and sizing of the deployment conforms to the requirements mentioned above. To deploy the appliance, use the “Deploy OVF Template” option in vCenter (figure 6).

Figure 6: Launching the “Deploy OVF” Template in vCenter

alt_text

Network Configuration

Appliance network configuration requires that the available networks be categorized into four types, described in the Network Requirements and HDM Resource Requirements sections, above. While it is recommended to keep these networks separate, it is possible for each of them to point to a single network. In addition, the decision must be made at this point to deploy using a static IP or DHCP protocol (figure 7).

Figure 7: Configuring the Network

alt_text

IP Address Details

(If DHCP is chosen, this section can be skipped)

For each network type, choose the IP allocation protocol: static or DHCP. The following details are required if static IP is chosen (figure 8):

  • IP range: list of IP addresses that are free to be allocated to various HDM components
  • Subnet mask: subnet of the IP range
  • Gateway: gateway IP of the network
  • Domain: domain name of the network
  • DNS: domain name translation for the IP address
  • NTP: server that will be used for time synchronization

NOTES:

  1. If static IP is chosen, failure to specify an NTP server may cause further HDM operations to fail.
  2. If static IP is chosen, the gateway IP and the specified IP range must be in the same subnet.

Figure 8: Configuring the System for Static IP Protocol

alt_text

Gateway settings

The setting in Default gateway network should be chosen so that traffic for other subnets can be routed through this interface. This would generally be the WAN network but please verify the specifics for your network.

In the field Default Gateway set the default gateway for the network chosen under Default gateway network.

Getting this wrong will cause deployment to fail eventually and you will have to perform an HDM Reset

Figure 8b: Configuring Gateway, NTP and Default Gateway

alt_text

Power on the Appliance

Complete the rest of the wizard and wait for the deployment to complete. Once the deployment has completed, use vCenter to power on the appliance.

Please note that the appliance can take between 5 to 10 minutes to boot depending on the underlying datastore's performance.

Enable VMware HA on the HDM Appliance

(This step should only be performed for Cluster mode deployments of HDM)

VMware HA should be enabled on the cluster where the HDM appliance has been deployed. Follow these procedures to do this:

  1. In the on-premises vCenter, select the cluster where the HDM appliance has been deployed
  2. On the right hand pane, select the Configure tab, then select Services followed by vSphere Availability
  3. If the vSphere HA is turned off, select EDIT and enable vSphere HA

Step 2 : Add On-Premises vCenter to the HDM Appliance

Note: The on-premises vCenter should be added to the same location where the HDM appliance has been deployed.

Steps:

  1. Ensure that the HDM appliance is powered on and you have valid vCenter administrator credentials. To do this, log into the PrimaryIO appliance by accessing https://<appliance ip> in a supported web browser and enter the administrator credentials. The default administrator username and password are ‘administrator’ and ‘2Hdm$aK!N@h!’, respectively. This default password should be changed immediatly following the first login.
  2. Select vCenters from the top pane.
  3. Select Add vCenter from the top right (figure 9). Figure 9: Adding vCenter to the HDM Appliance

alt_text

  1. Specify the IP or FQDN where the on-premises vCenter is configured. Enter the administrator credentials and select Add vCenter.
  2. The on-premises vCenter should now be listed on the PrimaryIO appliance

Figure 10: Viewing the On-Premises vCenter on the HDM Appliance

alt_text

Step 3: Register the HDM Plugin to vCenter

  1. Select Register to register the HDM plugin to the on-premises vCenter.
  2. Logout and login twice (occasionally, more than twice will be required) from vCenter for the plug-in installation to complete. Successful installation will add an HDM icon to the vCenter home page.

Figure 11: HDM Icon on the vCenter Home Page

alt_text

Note: The PrimaryIO vCenter plugin will be automatically registered on all vCenter instances that are configured using enhanced linked mode.

Step 4: Add HDM License

A license key is required to activate the newly-deployed HDM. A trial license will be shared with the product which can be used to activate HDM.

Note: The HDM configuration page may take a few minutes to load, as product settings need to be initialized.

Steps to add a license:

  1. In the on-premises vCenter, access the HDM dashboard by selecting HDM from Shortcuts or the vCenter menu (It may take a few minutes for the dashboard to load).
  2. Select the _Administration_tab.
  3. Select Licensing to add a new license, and to see existing licenses (figure 12).
  4. Select Add License to open a popup where the provided Trial License can be pasted (figure 13).
  5. Copy and paste the shared license key and select OK. The license will now be listed on the license page (figure 14).
  6. The same interface can then be used to add the actual Product License obtained as part of the ordering process.

Figure 12: Add or See HDM Licenses

alt_text

Figure 13: "Add License" Pop-up

alt_text

Figure 14: Verify the Addition of the Trial License

alt_text

Step 5: Deploy HDM On-Premises

This section covers the steps for completing the deployment of HDM on-premises. This section will explain how to:

  1. Select a cluster for HDM deployment
  2. Select HDM deployment mode
  3. Select HDM resource allocation
  4. Configure the network
  5. Complete the deployment

The on-premises deployment may take anywhere between 10 and 20 minutes, depending on the network bandwidth and storage. Any failure-retries performed by HDM during the deployment process are logged into vCenter events. Either the hdm or the com.primaryio keyword can be used in vCenter Event Search to search for events generated by HDM.

Prerequisites:

It is assumed that the HDM appliance deployment and configuration has been executed successfully. Ensure that the plugin has been registered on vCenter, the HDM icon is visible on the vCenter home screen, and a valid HDM license has been added to activate the product.

Steps for deployment:

  1. In the on-premises vCenter, select PrimaryIO from Shortcuts or from Menu to access the PrimaryIO dashboard
  2. Select Administration from the tab
  3. Select Configuration to access the on-premises cluster listing

Figure 15: vCenter On-Premises Cluster Listing

alt_text

  1. Select the cluster where HDM will be installed and select Install. This will open a wizard to select resources for HDM component deployment.
  2. Verify that the Appliance IP is correct.
  3. Select the deployment mode based on the scale and failure tolerance requirements for the on-premises and cloud environments, taking care to ensure there are enough resources available in the on-premises and cloud environments. See the Deployment Requirements section for details on each deployment mode.
  4. Select resource allocation based on size and resource requirements. See the Deployment Requirements section for details on each allocation type. Figure 16: HDM Installation Wizard

alt_text

  1. Select the resource pool and shared datastore where the HDM components will be deployed. Figure 17: Resource Pool and Shared Datastore Selection

alt_text

  1. To specify the internal network configurations, start by choosing the IP allocation protocol: static (figure 18) or DHCP. The following details are required if static IP is chosen:

    • IP range
    • Subnet mask
    • Gateway
    • Domain
    • DNS
    • NTP

    See the Deployment Requirements section for additional details on these requirements. These steps must be repeated for the following components:

    • HDM Internal Network (HDM_Internal_Network)
    • WAN Network (Uplink_WAN_Network)
    • ESXi Network (ESXi_Network)

Note:

  1. If all are mapping to a single network, separate IP ranges will still need to be provided for each network type.
  2. The subnet range 172.17.0.0/16 is not available for the deployment; it is internally used by HDM microservices.

Figure 18: Network Configuration Settings

alt_text

  1. Confirm the selection and submit the installation request by selecting FINISH. Figure 19: HDM Installation Summary

alt_text

  1. This will create a deployment task which can be monitored from vCenter tasks. Also, the deployment progress can be seen in the HDM configuration view: Figure 20: vCenter HDM Configuration View

alt_text

  1. Wait for the deployment task to finish. alt_text

Step 6: Deploy HDM to the Cloud

Depending on the WAN bandwidth and WAN latency, it may take between 10 to 20 minutes to deploy HDM components in the cloud. Any failure-retries during the deployment process will be logged into vCenter Events. To search for events generated by HDM, hdm or com.primaryio keywords can be used in vCenter event search.

Pre-requisites

  1. Ensure that the HDM plug-in has been registered on vCenter and the HDM icon is visible on the home screen.
  2. Ensure that the on-premises deployment has completed successfully.

Steps for deployment

  1. In the on-premises vCenter, select HDM from Shortcuts or Menu to access the HDM dashboard
  2. Select Administration from the tab
  3. Select Clouds to access the cloud listing

Figure 21: vCenter Cloud Listing

alt_text

  1. Select Add Cloud. This will open a wizard where you can select the resources needed to deploy the HDM components.
  2. Select the cloud type, then enter the cloud credentials and the cloud DNS.

Figure 22: HDM Cloud Wizard

alt_text

  1. Select the cluster, resource pool, datastore and VM folder on the cloud where the HDM components will be deployed.

    Note: Select shared datastore in the cloud when deploying HDM components.

Figure 23: Select Cloud Cluster alt_text

  1. Select the network and IP configuration for ON_CLOUD_HDM_NETWORK (HDM Internal Network) that will be used by HDM for VM boot and subsequent IO handling through the HDM components. Choose the IP allocation protocol: static (figure 24) or DHCP . If static IP address allocation is chosen, the unused IP addresses or IP ranges, along with the gateway and subnet mask, would need to be specified.

Figure 24: Network Configuration

alt_text

  1. Select network IP configurations for the WAN. Choose the IP allocation protocol: static or DHCP (figure 25). If static IP address allocation is chosen, the unused IP addresses or IP ranges, along with the gateway and subnet mask, domain search path, and one or more DNS and NTP servers, would need to be specified

Figure 25: WAN Configuration

alt_text

  1. Set WAN route configuration, so data traffic between the cloud and on-premises environments is possible. See the network planning section WAN Routing Configuration.

Figure 26: WAN Route Configuration

alt_text

  1. In the event of a warm migration use case, set routing rules to access the cloud vCenter on port 443 and ESXi on port 443 and 902. Additionally, specify which network will be used for routing from the HDM Internal or WAN Network.

alt_text

  1. Select network mapping to enable the network categorization performed on-premises gets percolated to the cloud

Figure 27: Network Mapping

alt_text

  1. To submit the request and initiate the cloud deployment, select FINISH. This will create deployment tasks for the cloud components, which can be monitored in vCenter Tasks. The progress can also be seen in the HDM Clouds view (figure 29).

Figure 28: Summary and Request Submission

alt_text

  1. This will create deployment tasks for the cloud components. These tasks can be monitored in vCenter Tasks. The progress can also be seen in the HDM configuration view. Figure 29: HDM Clouds View

alt_text

DNS Entry to resolve FQDN

If the cloud vCenter or ESXi has been added using FQDN, the DNS nameserver must be explicitly added in the HDM cloud cache component. The following procedure should be used:

  1. Log into the cloud vCenter
  2. Locate the HDM cloud cache component VMs with the name HDM-Cloud-Cache-*.
  3. ssh into each HDM cloud cache component VM with root credentials and password (admin123)
  4. Set the DNS server in /etc/resolv.conf required for resolving the FQDN
  5. Ensure the FQDN is reachable using the ping command

Deployment Validation

Once the on-premises and cloud deployments are complete, there are multiple ways to view the deployed components and their states:

Appliance View

After successfully installing HDM in the cloud, the appliance control panel will list each component and their health.

Figure 30: HDM Appliance Control Panel

alt_text

In addition to the Appliance Control Panel, this information is also available on vCenter on the HDM plugin by selecting Menu, followed by HDM, Administration, HDM Health, and then Component Health.

Figure 31: vCenter HDM Plug-In

alt_text

On-Premise vCenter

To verify that the on-premises vCenter shows the cloud state as installed, select HDM, then the Administration and _Clouds _tabs.

Figure 32: Verify Installation of the Cloud State

alt_text

Enable IO Monitoring

Notes:

  1. This step is not required for cold migration.
  2. For Lite Standalone and Lite Cluster deployment modes, this step only creates the SPBM policy and attaches to VMs in the cluster; it doesn’t perform any detailed I/O profiling.

HDM requires the on-premises VMs to be monitored for I/O by HDM. Monitoring helps to:

  1. Estimate the cloud cache size requirement for a given VM
  2. Determine whether the VM is a suitable candidate for migration

This is done by creating an HDM SPBM cache type policy and applying that policy to the existing VMs. Detailed steps are provided below.

Prerequisites

  1. Ensure the on-premises installation has successfully completed.
  2. Ensure there are no HDM SPBM policies named ‘HDM Analyzer Profile’ already existing from previous HDM installation attempts. This can be checked using the following steps:
    1. In the on-premises vCenter, select Home, followed by Policies and Profiles, then VM Storage Policies
    2. Delete any instances of ‘HDM Analyzer Profile’

Steps

  1. In the on-premises vCenter, select HDM from Shortcuts or from Menu to access the PrimaryIO dashboard
  2. Select Administration from the tab.
  3. Select Configuration to access the cluster listing.
  4. On the cluster where HDM is installed, select Enable under monitoring. This will open a popup.

alt_text

  1. Select OK to enable monitoring.

This will create an SPBM cache type policy for HDM. The default name for the policy is HDM Analyzer Profile. This profile can be viewed in the on-premises vCenter by selecting Home, followed by Policies and Profiles, then VM Storage Policies.

alt_text

This newly created HDM policy will be applied to all virtual machines under the cluster, and will enable monitoring for I/O activity. A reconfiguration task will be generated for each virtual machine when applying the HDM SPBM policy. If VMs have been successfully reconfigured, VM policies for these virtual machine will have ‘HDM Analyzer Profile’ applied against each of their VMDKs.

Once the policy has been applied, the user can check analyzer summaries by selecting VM->Monitoring->PrimaryIO from Host and Clusters view.

Note:

1.The Enable IO Monitoring step can be executed any number of times to enable monitoring for new VMs since the last execution.

  1. Applying the SPBM policy can fail for some VMs. For example, when the VM already has a snapshot. However, this doesn’t fail the entire operation.

Disabling Monitoring on a VM

Note: This step must not be executed for a VM that will be migrated to the cloud.

Monitoring a VM is a low overhead activity and is done transparently without affecting the ongoing I/Os or operations. However, if you don’t want HDM to monitor certain VMs, take the following steps:

  1. In the on-premises vCenter, right click on the VM you do not want to be monitored.
  2. Select VM Policies, followed by Edit VM Storage Policies.
  3. In the popup, if the VM storage policy is the HDM Analyzer Profile, set the VM storage policy to Datastore Default, then select Apply to all

alt_text

  1. The vCenter task will display the operation progress and status.

Note: HDM cannot migrate a VM that does not have an HDM SPBM policy. However, the SPBM policy can be applied to a VM at any time, thereby making it available for migration.

TroubleShooting

Troubleshooting Common Failure Scenarios

Common failure scenarios and possible reasons are provided below. If the failure is not one of the above reasons and the error message is not clear enough, please contact PrimaryIO Support.

Deployment Failures

Here are some common reasons for deployment failures:

  1. Resources not sufficient: On-premises or cloud resources are insufficient for meeting the deployment mode requirements.
  2. Unresolved input values: Inputs such as vCenter FQDN/IP are not resolvable or are unreachable.
  3. IP range issues: For static IP allocation, the IP range specified is insufficient for assigning to all HDM components.
  4. HDM component failed during or after the deployment: HDM component failed during deployment.

Usually when the deployment UI wizard or vCenter tasks fail, one of the above error messages will appear. After the error has been rectified, a re-deployment can be initiated, or an HDM reset followed by re-deployment can be attempted.

Undeployment Failures

Common reasons for undeployment failures are:

  1. VMs are still migrated to the cloud when undeployment is attempted.
  2. The on-premises cluster host is not able to go to maintenance mode. This can be due to:
    • DRS not enabled on the cluster, causing powered-on VMs to block the maintenance mode
    • In the case where the HDM applicance is part of a single host in the cluster, the maintenance mode will be blocked if the HDM appliance is powered on. In this case, uninstall the HDM filter and immediately power off the appliance.

vCenter tasks will provide the reasons for undeployment failures. If it is one of the above, rectify the problem and retry the operation.

Support and Contact

HDM support can be reached via email: support@primaryio.com

The email should include the following information:

  • Email subject: Clearly specify the issue.
  • Email body: Clearly describe the problem. Include information on the deployment type, the operation being performed, any relevant screenshots, etc.

  • Email attachment : Attach the relevant logs (as described in HDM Support Logs section)

    • HDM logs
    • vm-support logs

    If the attachment size is too large, an alternate shared location may be provided by HDM support to enable the logs to be uploaded.