Timeout snapshot

[Lauta11]

problem

When creating snapshots of large volumes (approximately larger than 200 GB), the task fails to complete successfully. The snapshot command reaches a timeout of 3600 seconds, which is not enough time to copy the entire disk.

We attempted to modify various timeout-related parameters in CloudStack (including those for snapshot and asynchronous tasks), but none of them appear to extend or affect this timeout limit.

It is unclear whether this is a bug or a missing feature that should allow increasing the timeout duration for snapshot operations.

The corresponding logs are attached for further analysis.

Management:

2025-10-21 02:01:57,863 DEBUG [c.c.s.s.SnapshotSchedulerImpl] (SnapshotPollTask:ctx-93846872) (logid:f246f83a) Snapshot [455b227d-797f-45e6-aa03-1dc7609ac030] for volume [{"name":"ROOT-392","uuid":"8508204f-24ba-454a-8bd1-f56b274088ae"}] can be executed.
2025-10-21 02:01:59,126 DEBUG [c.c.s.s.SnapshotSchedulerImpl] (SnapshotPollTask:ctx-93846872) (logid:f246f83a) Scheduling snapshot [455b227d-797f-45e6-aa03-1dc7609ac030] for volume [{"name":"ROOT-392","uuid":"8508204f-24ba-454a-8bd1-f56b274088ae"}] at [2025-10-21 05:00:00 GMT].
2025-10-21 02:01:59,179 DEBUG [c.c.s.s.SnapshotSchedulerImpl] (SnapshotPollTask:ctx-93846872) (logid:f246f83a) Scheduled snapshot [455b227d-797f-45e6-aa03-1dc7609ac030] for volume [{"name":"ROOT-392","uuid":"8508204f-24ba-454a-8bd1-f56b274088ae"}] as job [d0e089bb-d2cb-4e81-8fb4-5e6a23eee556].
2025-10-21 02:02:01,607 DEBUG [o.a.c.s.s.StorPoolSnapshotStrategy] (Work-Job-Executor-28:ctx-a246b76c job-33232/job-33233 ctx-6f646c29) (logid:d0e089bb) StorpoolSnapshotStrategy.canHandle: snapshot=server18063_ROOT-392_20251021050158, uuid=70decb5c-6f4d-405a-b7e1-f2eb2ace4de0, op=TAKE



2025-10-21 03:02:01,993 DEBUG [o.a.c.s.s.SnapshotServiceImpl] (Work-Job-Executor-28:ctx-a246b76c job-33232/job-33233 ctx-6f646c29) (logid:d0e089bb) create snapshot server18063_ROOT-392_20251021050158 failed: com.cloud.utils.exception.CloudRuntimeException: Failed to send command, due to Agent:59, com.cloud.exception.OperationTimedoutException: Commands 545217029888601412 to Host 59 timed out after 3600


Host:


2025-10-21 03:06:26,176 WARN  [utils.script.Script] (Script-10:null) (logid:) Interrupting script.
2025-10-21 03:06:26,176 WARN  [utils.script.Script] (agentRequest-Handler-2:null) (logid:d0e089bb) Process [3934352] for command [qemu-img convert -O qcow2 -U --imag
e-opts driver=qcow2,file.filename=/mnt/4c524bab-25a3-3db5-a665-d37159b81f11/11806790-0ad0-4a4a-b389-2f7ab41b4e87 /mnt/4c524bab-25a3-3db5-a665-d37159b81f11/snapshots/
3ae09c67-c072-48b4-a8a7-e3f2dbaf2687 ] timed out. Output is [].
2025-10-21 03:06:43,053 ERROR [kvm.storage.KVMStorageProcessor] (agentRequest-Handler-2:null) (logid:d0e089bb) Failed take snapshot for volume [volumeTO[uuid=8508204
f-24ba-454a-8bd1-f56b274088ae|path=11806790-0ad0-4a4a-b389-2f7ab41b4e87|datastore=PrimaryDataStoreTO[uuid=4c524bab-25a3-3db5-a665-d37159b81f11|name=Pool-01|id=18|poo
ltype=NetworkFilesystem]]], in VM [i-52-392-VM], due to [Failed to convert volumeTO[uuid=8508204f-24ba-454a-8bd1-f56b274088ae|path=11806790-0ad0-4a4a-b389-2f7ab41b4e
87|datastore=PrimaryDataStoreTO[uuid=4c524bab-25a3-3db5-a665-d37159b81f11|name=Pool-01|id=18|pooltype=NetworkFilesystem]] snapshot of volume [KVMPhysicalDisk {"dispN
ame":null,"format":"qcow2","name":"11806790-0ad0-4a4a-b389-2f7ab41b4e87","path":"\/mnt\/4c524bab-25a3-3db5-a665-d37159b81f11\/11806790-0ad0-4a4a-b389-2f7ab41b4e87","
pool":{"uuid":"4c524bab-25a3-3db5-a665-d37159b81f11","path":"\/mnt\/4c524bab-25a3-3db5-a665-d37159b81f11"},"size":122363461632,"virtualSize":161061273600,"vmName":nu
ll}] to [/mnt/4c524bab-25a3-3db5-a665-d37159b81f11/snapshots/3ae09c67-c072-48b4-a8a7-e3f2dbaf2687] due to [timeout].].
com.cloud.utils.exception.CloudRuntimeException: Failed to convert volumeTO[uuid=8508204f-24ba-454a-8bd1-f56b274088ae|path=11806790-0ad0-4a4a-b389-2f7ab41b4e87|datas
tore=PrimaryDataStoreTO[uuid=4c524bab-25a3-3db5-a665-d37159b81f11|name=Pool-01|id=18|pooltype=NetworkFilesystem]] snapshot of volume [KVMPhysicalDisk {"dispName":null,"format":"qcow2","name":"11806790-0ad0-4a4a-b389-2f7ab41b4e87","path":"\/mnt\/4c524bab-25a3-3db5-a665-d37159b81f11\/11806790-0ad0-4a4a-b389-2f7ab41b4e87","pool":{"uuid":"4c524bab-25a3-3db5-a665-d37159b81f11","path":"\/mnt\/4c524bab-25a3-3db5-a665-d37159b81f11"},"size":122363461632,"virtualSize":161061273600,"vmName":null}] to [/mnt/4c524bab-25a3-3db5-a665-d37159b81f11/snapshots/3ae09c67-c072-48b4-a8a7-e3f2dbaf2687] due to [timeout].
        at com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.validateConvertResult(KVMStorageProcessor.java:1915)
        at com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.createSnapshot(KVMStorageProcessor.java:1790)
        at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:140)
        at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:66)
        at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStorageSubSystemCommandWrapper.execute(LibvirtStorageSubSystemCommandWrapper.java:36)
        at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStorageSubSystemCommandWrapper.execute(LibvirtStorageSubSystemCommandWrapper.java:30)
        at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
        at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1930)
        at com.cloud.agent.Agent.processRequest(Agent.java:683)
        at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1106)
        at com.cloud.utils.nio.Task.call(Task.java:83)
        at com.cloud.utils.nio.Task.call(Task.java:29)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)

### versions

Cloudstack v4.20 / KVM
S.O ubuntu 24


### The steps to reproduce the bug

1. Start a snapshot task for a volume > 200GB
2. Wait one hour
3. Error


### What to do about it?

Complete configuration to be able to modify this time or fix a bug if necessary.

[boring-cyborg[bot]]

Thanks for opening your first issue here! Be sure to follow the issue template!

[sureshanaparti]

@Lauta11 what is the value set for config 'kvm.incremental.snapshot'? and what is the underlying storage used for the volumes?

[erikbocks]

Hello, @Lauta11

When the CreateObjectCommand is sent to the Agent for the snapshot creation, no value is set for its timeout. When the Agent receives the command, as no timeout was informed, the fallback timeout is defined for it (3600 seconds). I am currently finishing a PR that will add a configurable timeout for volume snapshots, and soon I will open it.

[Lauta11]

@Lauta11 what is the value set for config 'kvm.incremental.snapshot'? and what is the underlying storage used for the volumes?

Hi @sureshanaparti , thanks for you response. The kvm.incremental.snapshot option isn't enabled or listed. We're not using incremental snapshots anyway.
The underlying storage used: 6 disk x 4TB WD-GOLD drives in RAID 10

Hello, @Lauta11

When the CreateObjectCommand is sent to the Agent for the snapshot creation, no value is set for its timeout. When the Agent receives the command, as no timeout was informed, the fallback timeout is defined for it (3600 seconds). I am currently finishing a PR that will add a configurable timeout for volume snapshots, and soon I will open it.

Hi @erikbocks , thanks for you response.
I'll wait for the PR.

[sureshanaparti]

Hi @Lauta11 sorry, 'kvm.incremental.snapshot' config was introduced in 4.21. For your case, I think, you can configure timeout in the global setting 'commands.timeout' (for 3 hrs timeout, set to CreateObjectCommand=10800).

[sureshanaparti]

Hello, @Lauta11

When the CreateObjectCommand is sent to the Agent for the snapshot creation, no value is set for its timeout. When the Agent receives the command, as no timeout was informed, the fallback timeout is defined for it (3600 seconds). I am currently finishing a PR that will add a configurable timeout for volume snapshots, and soon I will open it.

@erikbocks I think, no changes required if the granular commands timeout setting (#9659) addresses the timeout update for the CreateObjectCommand.

[Lauta11]

Hi @Lauta11 sorry, 'kvm.incremental.snapshot' config was introduced in 4.21. For your case, I think, you can configure timeout in the global setting 'commands.timeout' (for 3 hrs timeout, set to CreateObjectCommand=10800).

Hello @sureshanaparti a thousand apologies, I have cloudstack version 4.19.2, I thought I had updated, in this version the global configuration 'commands.timeout' does not appear, is this from 4.20 onwards?

[sureshanaparti]

Hi @Lauta11 sorry, 'kvm.incremental.snapshot' config was introduced in 4.21. For your case, I think, you can configure timeout in the global setting 'commands.timeout' (for 3 hrs timeout, set to CreateObjectCommand=10800).

Hello @sureshanaparti a thousand apologies, I have cloudstack version 4.19.2, I thought I had updated, in this version the global configuration 'commands.timeout' does not appear, is this from 4.20 onwards?

@Lauta11 the config 'commands.timeout' was introduced in 4.20.1.

[Lauta11]

Hi, I updated to Cloudstack 4.20.2 and the "commands.timeout" option appeared. I added CreateObjectCommand=18000 to it, restarted the management system, and now when I try to take a snapshot, it times out after 10 seconds. I removed this option, and it's back to normal.

Is this variable correct? Do I need to add anything else? Thanks. Logs attached.

Logs Management:

2025-11-12 14:59:17,408 ERROR [o.a.c.s.v.VolumeServiceImpl] (Work-Job-Executor-24:[ctx-e02923c9, job-33716/job-33717, ctx-aa135b73]) (logid:e981ed2a) Take snapshot: VolumeObject {"dataStore":"StoragePool {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","volumeVO":"Volume {"id":1449,"instanceId":1117,"name":"ROOT-1117","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","volumeType":"ROOT"}"} failed com.cloud.utils.exception.CloudRuntimeException: Failed take snapshot for volume [volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}], in VM [i-329-1117-VM], due to [Failed to convert volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"} snapshot of volume [KVMPhysicalDisk {"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool {"uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","size":136090554368,"virtualSize":536870912000,"vmName":null}] to [/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/bcbd2cd1-3e47-44f4-bd9d-46c47b966dd5] due to [timeout].]. 2025-11-12 14:59:17,410 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-24:[ctx-e02923c9, job-33716/job-33717, ctx-aa135b73]) (logid:e981ed2a) Invocation exception, caused by: com.cloud.utils.exception.CloudRuntimeException: Failed take snapshot for volume [volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}], in VM [i-329-1117-VM], due to [Failed to convert volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"} snapshot of volume [KVMPhysicalDisk {"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool {"uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","size":136090554368,"virtualSize":536870912000,"vmName":null}] to [/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/bcbd2cd1-3e47-44f4-bd9d-46c47b966dd5] due to [timeout].]. 2025-11-12 14:59:17,410 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-24:[ctx-e02923c9, job-33716/job-33717, ctx-aa135b73]) (logid:e981ed2a) Rethrow exception com.cloud.utils.exception.CloudRuntimeException: Failed take snapshot for volume [volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}], in VM [i-329-1117-VM], due to [Failed to convert volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"} snapshot of volume [KVMPhysicalDisk {"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool {"uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","size":136090554368,"virtualSize":536870912000,"vmName":null}] to [/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/bcbd2cd1-3e47-44f4-bd9d-46c47b966dd5] due to [timeout].]. 2025-11-12 14:59:17,410 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-24:[ctx-e02923c9, job-33716/job-33717]) (logid:e981ed2a) Unable to complete AsyncJob {"accountId":329,"cmd":"com.cloud.vm.VmWorkTakeVolumeSnapshot","cmdInfo":"rO0ABXNyACVjb20uY2xvdWQudm0uVm1Xb3JrVGFrZVZvbHVtZVNuYXBzaG90BL5gG4Li1c8CAAdaAAthc3luY0JhY2t1cFoACXF1aWVzY2VWbUwADGxvY2F0aW9uVHlwZXQAKUxjb20vY2xvdWQvc3RvcmFnZS9TbmFwc2hvdCRMb2NhdGlvblR5cGU7TAAIcG9saWN5SWR0ABBMamF2YS9sYW5nL0xvbmc7TAAKc25hcHNob3RJZHEAfgACTAAIdm9sdW1lSWRxAH4AAkwAB3pvbmVJZHN0ABBMamF2YS91dGlsL0xpc3Q7eHIAE2NvbS5jbG91ZC52bS5WbVdvcmufmbZW8CVnawIABEoACWFjY291bnRJZEoABnVzZXJJZEoABHZtSWRMAAtoYW5kbGVyTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO3hwAAAAAAAAAUkAAAAAAAAAAQAAAAAAAARddAAUVm9sdW1lQXBpU2VydmljZUltcGwAAHBzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAMBzcQB-AAgAAAAAAAAGrXNxAH4ACAAAAAAAAAWpc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4","cmdVersion":0,"completeMsid":null,"created":"Wed Nov 12 14:58:56 ART 2025","id":33717,"initMsid":90520732656511,"instanceId":null,"instanceType":null,"lastPolled":null,"lastUpdated":null,"processStatus":0,"removed":null,"result":null,"resultCode":0,"status":"IN_PROGRESS","userId":1,"uuid":"26728688-30c2-421c-aa66-664248917e26"}, job origin: 33716 com.cloud.utils.exception.CloudRuntimeException: Failed take snapshot for volume [volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}], in VM [i-329-1117-VM], due to [Failed to convert volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"} snapshot of volume [KVMPhysicalDisk {"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool {"uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","size":136090554368,"virtualSize":536870912000,"vmName":null}] to [/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/bcbd2cd1-3e47-44f4-bd9d-46c47b966dd5] due to [timeout].]. Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed take snapshot for volume [volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}], in VM [i-329-1117-VM], due to [Failed to convert volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"} snapshot of volume [KVMPhysicalDisk {"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool {"uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","size":136090554368,"virtualSize":536870912000,"vmName":null}] to [/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/bcbd2cd1-3e47-44f4-bd9d-46c47b966dd5] due to [timeout].].

Logs Host:
2025-11-12 15:15:34,382 WARN [utils.script.Script] (AgentRequest-Handler-2:[]) (logid:) Process [608468] for command [qemu-img convert -O qcow2 -U --image-opts driver=qcow2,file.filename=/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/344e7caa-a74d-4861-81b4-1bb54c4e3cd2 /mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/feade96a-8f4c-41d8-a123-9627d17d4d6d ] timed out. Output is []. 2025-11-12 15:15:34,381 WARN [utils.script.Script] (Script-7:[]) (logid:) Interrupting script. 2025-11-12 15:15:35,107 ERROR [kvm.storage.KVMStorageProcessor] (AgentRequest-Handler-2:[]) (logid:) Failed take snapshot for volume [volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"}], in VM [i-329-1117-VM], due to [Failed to convert volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"} snapshot of volume [KVMPhysicalDisk {"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool {"uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","size":136142057472,"virtualSize":536870912000,"vmName":null}] to [/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/feade96a-8f4c-41d8-a123-9627d17d4d6d] due to [timeout].]. com.cloud.utils.exception.CloudRuntimeException: Failed to convert volumeTO {"dataStore":"PrimaryDataStoreTO {"id":55,"name":"Pool-03","poolType":"NetworkFilesystem","uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","id":1449,"name":"ROOT-1117","path":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","uuid":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2"} snapshot of volume [KVMPhysicalDisk {"dispName":null,"format":"qcow2","name":"344e7caa-a74d-4861-81b4-1bb54c4e3cd2","path":"/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/344e7caa-a74d-4861-81b4-1bb54c4e3cd2","pool":"LibvirtStoragePool {"uuid":"9f38e203-81c7-3eeb-837c-3dbea8d4f256"}","size":136142057472,"virtualSize":536870912000,"vmName":null}] to [/mnt/9f38e203-81c7-3eeb-837c-3dbea8d4f256/snapshots/feade96a-8f4c-41d8-a123-9627d17d4d6d] due to [timeout].

[gabriel2k5]

Hi, I discovered you're using the wrong time measurement. The CreateObjectCommand isn't in seconds, it's in milliseconds. That's why it was canceling as soon as you started if you used 10800 or 14400, since that would be around 10 and 14 seconds, respectively.

But if you use CreateObjectCommand=14400000, it's 4 hours in milliseconds. With this, the snapshots no longer cancel at 3600 seconds.