IO comparison: Proxmox KVM (raw, qcow2, vmdk) and VmWare ESXi 5.1 (LSI SAS, pvSCSI) latest


Comparison of setups:
1) Fujitsu Server + 8Gbps FC + Storage 24 HDD @10k
2) HP Server + 2Gbps FC + Storage RAID10 6 HDD @10k
3) HP Server + 6Gbps local SCSI + RAID10 6 HDD @10k
4) Simple PC + SSD



Result Comparison for 4 setups



Setup nr. 1

HOST Specs:
Fujitsu Blade
CPU: 12x 2.4 GHz Xeon E5-2620 v3
RAM: 96 GB
Storage: 3PAR FC 24x HDD 10k SAS  (via FiberChannel 8Gbps)
Single HOST assigned to this LUN


Soft Used:
Proxmox VE v 4.2-56 (running kernel: 4.4.13-1-pve) + LVM
ESXi 5.1 v 2323236 + VMFS8
CrystalDiskMark v 5.1.2 x64

VM Specs:
for pve: Win7 Ultimate 64b (clean install) + virtio drivers (IO + network)
for vmware: Win7 Ultimate 64b (clean install) + pvSCSI drivers (in case of pvSCSI controller)
CPU: 2x4 vCPUs
RAM: 16 GB
HDD: 50 GB
Single running VM on this HOST

Tests Done:
PVE raw: no-cache/writeback/writethrough/direct-sync
PVE qcow2: no-cache/writeback/writethrough/direct-sync
PVE vmdk: no-cache/writeback/writethrough/direct-sync

ESXi LSI-SAS (Windows 7 - do not req additional drivers for HDD)
ESXi pvSCSI (Paravirtual SCSI controllers, which req drivers for Windows 7)

Info:
VmWare:
 - http://www.vmware.com/files/pdf/1M-iops-perf-vsphere5.pdf
 - Configuring disks to use VMware Paravirtual SCSI (PVSCSI) adapters

PVE KVM:
 - http://events.linuxfoundation.org/sites/events/files/slides/CloudOpen2013_Khoa_Huynh_v3.pdf

Results:

proxmox kvm raw

proxmox kvm qcow2

proxmox kvm vmdk

vmware esxi 5.1



Another setup:

HOST Specs:
HP Server
CPU: 24 @ 2.6 GHz (4 CPU * 6 Sockets) AMD Opteron
RAM: 256 GB
 - Storage1: IBM Storage 6 x HDD 10k SAS  (via FiberChannel 2Gbps)
    Single HOST assigned to this LUN

Storage2: Local HP SCSI Controller RAID10 6xHDD 10k SAS
    Single HOST assigned to this LUN

Soft Used:
Proxmox VE v 4.2-56 (running kernel: 4.4.13-1-pve) + LVM
ESXi 5.1 v 2323236 + VMFS8
CrystalDiskMark v 5.1.2 x64

VM Specs:
for pve: Win7 Ultimate 64b (clean install) + virtio drivers (IO + network)
CPU: 2x4 vCPUs
RAM: 16 GB
HDD: 50 GB
Single running VM on this HOST