Academy/VCF 9.0 Support (2V0-15.25)/VCF Operations HCX — Workload Mobility & Migration Troubleshooting
This lab targets VCF 9.0

VCF Operations HCX — Workload Mobility & Migration Troubleshooting

VCF 9.0IntermediateVCP-VCF⏱ 30 min

HCX workload mobility for VCF 9.0 — exam objective 5.11

Objectives

  • Understand HCX architecture and components in VCF 9.0
  • Configure HCX site pairing and network extension
  • Identify common HCX migration types and troubleshooting scenarios
  • Troubleshoot HCX configuration and migration failures

Prerequisites

Active Holodeck VCF 9.0 lab with HCX deployed, or access to VCF/HCX documentation

Prior labs: vcffts9-01, vcffts9-05

Required skills:

  • Basic VMware networking
  • Understanding of VCF architecture

Tasks

Task 1 HCX Architecture & Configuration

HCX is the primary workload mobility tool for VCF — enabling migration from legacy vSphere (6.x/7.x) and cross-cloud mobility. Understanding HCX migration types and when to use each is critical for migration project planning.

Understand HCX components and configuration for VCF workload mobility

Step 1
VCF Operations HCX Components & Deployment

VCF Operations HCX (formerly Hybrid Cloud Extension) enables workload mobility between VCF environments and across sites. Core components: a single streamlined VCF Operations HCX Manager appliance deployed at both the source and the destination site (VCF 9.0 replaces the earlier HCX Connector / HCX Cloud split). Service Mesh: automated deployment of the HCX fleet appliances (Interconnect IX, Network Extension NE, plus Sentinel/OSAM where OS Assisted Migration is used) that form the data plane for migrations. WAN Optimization (HCX-WAN-OPT) is discontinued in VCF Operations HCX 9.0; an upgrade is blocked until WAN-OPT is removed from existing Service Meshes and Compute Profiles. Site Pairing: establishes trust between source and destination HCX Managers — requires network connectivity on port 443, valid certificates, and admin credentials on both sides.

[HOLODECK NOTE] HCX can be deployed in Holodeck for functional testing of site pairing and migration workflows. However, migration throughput is not representative of production — Holodeck's virtual networking has no real WAN latency or bandwidth constraints. For RAV (Replication Assisted vMotion) testing, both source and destination Holodeck environments need sufficient RAM to run the migration appliances.

[SOURCE NOTE] The VCFFTS9 lecture manual covers VCF Operations HCX at overview level only (Module 2: Use Cases). Detailed HCX architecture, Service Mesh, and migration type content in this lab is sourced from HCX documentation and general VMware training materials, not the VCFFTS9 lecture manual. This content addresses exam objective 5.11 which requires HCX troubleshooting knowledge.

Step 2
Network Extension & Migration Types

Network Extension: stretches L2 networks between sites — VMs keep IP addresses during migration. Requires Network Extension appliance pair (source + destination). Mobility Optimized Networking (MON) prevents tromboning by routing a migrated VM's traffic through the destination-site gateway (VCF 9.0.1 docs, Understanding Network Extension with Mobility Optimized Networking; 'Proximity Routing' is the pre-MON term and does not appear in the 9.0 docs). Migration types: (1) Cold Migration — powered-off VMs, uses the VMware NFC protocol (selected automatically when the source VM is powered off, p.5424); (2) vMotion — live migration, zero downtime, one VM at a time, performance dependent on WAN bandwidth; (3) Bulk Migration — scheduled, brief downtime during switchover, many VMs in parallel (HCX scales up to 1000 concurrent VM migrations, VCF 9.0.1 docs p.5324; per Broadcom KB 373010, for HCX 4.10 or later, that is 1000 concurrent Bulk/RAV migrations per HCX Manager only with the Large scale form factor — Default 300, Medium 600 — and HCX vMotion/cold migration concurrency does not change); (4) Replication Assisted vMotion (RAV) — combines replication for bulk data transfer with vMotion for final switchover, best for large VMs over WAN (handles large VMs efficiently via replication-based data transfer); (5) OS Assisted Migration — for non-vSphere sources. For exam: understand which migration type to recommend based on VM size, downtime tolerance, and WAN bandwidth.

Step 3
HCX Troubleshooting Scenarios

Common HCX troubleshooting scenarios for exam: (1) Site pairing failures — check DNS resolution between HCX Managers, port 443 connectivity, certificate trust chain, and admin credentials; (2) Service Mesh deployment failures — verify uplink network profiles (management, vMotion, replication networks), check that required IP pools have available addresses, verify MTU settings (jumbo frames recommended for replication traffic); (3) Migration failures — RAV: check replication network bandwidth and latency, verify source VM has no unsupported devices (raw disk mappings, USB passthrough); vMotion: verify vMotion VMkernel connectivity between sites, check EVC compatibility mode; Bulk: check that replication network IP pool is not exhausted; (4) Network Extension issues — verify L2 extension appliance pair health, check uplink VLAN trunking, verify proximity routing configuration if VMs cannot reach default gateway after migration; (5) HCX activation/licensing failures — verify the vCenter instance that HCX is registered to carries an assigned VCF license in VCF Operations, and check whether the 90-day evaluation period has lapsed.

Validation Gate

Check: When should you use HCX vMotion vs HCX RAV vs HCX Cold Migration?

Expected: HCX vMotion: single critical VM, zero downtime required. HCX RAV: bulk migration with minimal downtime (replication + final vMotion switchover). HCX Cold: VM can be powered off during migration, simplest approach. HCX Bulk: large-scale parallel migrations with scheduled switchover windows.

Common Errors

Using HCX vMotion for bulk migrations of hundreds of VMs
Fix: HCX vMotion migrates one VM at a time with zero downtime — ideal for critical VMs. For bulk migrations (100+ VMs), use HCX RAV (Replication Assisted vMotion) or HCX Bulk Migration which can run multiple concurrent migrations. RAV combines replication (bulk data sync) with a final vMotion switchover (minimal downtime).
Not validating network extension requirements before migration
Fix: HCX Network Extension stretches L2 networks between source and destination. This requires: HCX Network Extension appliance deployed at both sites, sufficient bandwidth for extended traffic, and understanding that extended networks add latency (WAN RTT). Plan network cutover strategy — L2 extension is a migration aid, not a permanent architecture.
Ignoring HCX appliance sizing for migration throughput
Fix: HCX appliances (IX interconnect, NE network extension; WAN optimization no longer exists in HCX 9.0) consume resources at both source and destination. Each IX appliance supports a limited number of concurrent migrations. For large migrations, deploy multiple IX appliance pairs. Plan appliance count based on migration timeline and concurrent migration target.
Not testing HCX migration with a pilot batch before bulk cutover
Fix: Always migrate 5-10 pilot VMs first to validate: network connectivity, application functionality at destination, DNS resolution, storage performance, and migration throughput. Pilot migrations reveal issues (firewall rules, application dependencies, driver compatibility) before they affect hundreds of VMs.

Task 2 HCX in VCF 9.0 Context

HCX troubleshooting requires understanding the migration pipeline: replication sync, switchover, and network cutover. Most migration failures occur during replication (network bandwidth) or switchover (timeout, resource contention).

Understand HCX integration with VCF fleet architecture and upgrade considerations

Step 1
VCF Operations HCX & Fleet Integration

In VCF 9.0, HCX integrates with the fleet architecture: VCF Operations HCX integrates with VCF for licensing, authentication and certificate management, but its updates are applied by the HCX administrator from HCX itself (update the paired HCX Managers, then the Service Mesh appliances under Interconnect → Service Mesh); SDDC Manager lifecycle management does not upgrade HCX. HCX supports migrations between VCF Instances within a fleet, between VCF and standalone vSphere, and between on-premises VCF and VMware Cloud on hyperscalers. HCX licensing in VCF 9.0 is part of the VCF license: assign the VCF license to the vCenter instance in VCF Operations, and the VCF Operations HCX connected to that vCenter is licensed automatically (90-day evaluation until then). For VCF 5.x to 9.0 upgrades: HCX should be upgraded after the core VCF stack (Phase 2 completion) — consult the VCF Transition Sequence Library for exact version compatibility.

Step 2
HCX Migration Planning for VCF

Migration planning considerations specific to VCF: (1) NSX compatibility — ensure NSX security policies and micro-segmentation rules are replicated or mapped at the destination before migration; (2) vSAN storage — migrating VMs between vSAN clusters requires sufficient destination capacity and compatible storage policies; (3) Network pools — destination workload domain must have appropriate network pools configured before receiving migrated VMs; (4) Certificate management — HCX Manager certificates must be valid and trusted by both source and destination vCenter/NSX; (5) Bandwidth planning — RAV migrations consume replication network bandwidth; plan for 70% utilization to avoid impacting production traffic.

[HOLODECK NOTE] HCX migration testing between two Holodeck environments requires two separate Holodeck deployments with routable connectivity between them. This demands substantial physical resources (2x the RAM/CPU/storage of a single deployment). For VCDX study purposes, focus on understanding migration type selection criteria and troubleshooting workflows rather than attempting full cross-site HCX lab scenarios in Holodeck.

Validation Gate

Check: What are the three most common causes of HCX migration failure?

Expected: 1. Replication sync not converging (high change rate + insufficient bandwidth). 2. Network connectivity issues between IX appliances (firewall rules, MTU). 3. Source VM compatibility issues (unsupported virtual hardware version, incompatible guest OS).

Common Errors

Not monitoring replication sync progress before scheduling switchover
Fix: HCX replication continuously syncs changed blocks from source to destination. The initial sync must complete before switchover can begin. If the VM has high change rate and insufficient bandwidth, the initial sync never converges. Monitor sync progress in HCX dashboard — if delta keeps growing, increase bandwidth or schedule migration during low-activity window.
Ignoring HCX compatibility matrix for source vSphere versions
Fix: HCX supports migration from vSphere 6.5+ but with version-specific limitations. Some features (vMotion migration type, network extension) require minimum source versions. Check the HCX compatibility matrix before designing the migration approach. Unsupported combinations cause silent migration failures.

Design Reflection (VCDX)

Migration strategy is a key VCDX topic — panelists test whether you understand migration types, can estimate migration timelines based on VM count and bandwidth, and have a rollback plan for failed migrations. HCX knowledge demonstrates practical migration architecture skills.

Requirements

  • Plan migration strategy using appropriate HCX migration types
  • Size HCX appliances for target migration throughput and concurrency
  • Design network extension and cutover strategy

Constraints

  • HCX vMotion is one-VM-at-a-time — not suitable for bulk
  • Network extension adds WAN latency — not a permanent architecture
  • Source vSphere version must be compatible per HCX matrix

Assumptions

  • Sufficient WAN bandwidth for replication sync to converge
  • HCX licenses are available for source and destination sites

Risks

  • Replication sync never converging due to high change rate
  • Network extension becoming permanent instead of temporary migration aid
  • Application failures at destination due to untested dependencies

⚠ Known Pitfalls

Planning a migration timeline without factoring in replication sync time — a 500GB VM on 100 Mbps WAN takes ~11 hours for initial sync alone.
Leaving HCX network extensions in place permanently after migration — L2 extension adds latency and operational complexity. Plan L3 cutover as part of migration closure.

References

Was this page useful?
Type to search. ↑ ↓ to move, Enter to open, Esc to close.