Checked when both utordas were connected to internet. Docker is running as well.
TASK [Ensure Docker is running] ************************************************************************************************************************************************************************************************
ok: [10.1.19.140]
ok: [10.1.19.131]
TASK [Default scheduler_url from scheduler_host (-e override)] *****************************************************************************************************************************************************************
skipping: [10.1.19.131]
skipping: [10.1.19.140]
TASK [Discover scheduler on control group (try each [control] host in order)] **************************************************************************************************************************************************
included: /home/peercompute/Serverless_Scheduler/ansible_utils/playbooks/tasks/resolve_scheduler.yml for 10.1.19.131, 10.1.19.140
TASK [Probe control nodes for scheduler API (inventory order, first success wins)] *********************************************************************************************************************************************
[ERROR]: Task failed: Module failed: Timeout when waiting for utorda1.dashlab.in:8000
Origin: /home/peercompute/Serverless_Scheduler/ansible_utils/playbooks/tasks/resolve_scheduler.yml:4:3
2 # Sets scheduler_host and scheduler_url from the first [control] host that accepts TCP 8000.
3 # Requires groups['control'] and hostvars[item].ansible_host (or inventory hostname).
4 - name: Probe control nodes for scheduler API (inventory order, first success wins)
^ column 3
failed: [10.1.19.140] (item=utorda1.dashlab.in) => {"ansible_loop_var": "item", "changed": false, "elapsed": 120, "item": "utorda1.dashlab.in", "msg": "Timeout when waiting for utorda1.dashlab.in:8000"}
failed: [10.1.19.131] (item=utorda1.dashlab.in) => {"ansible_loop_var": "item", "changed": false, "elapsed": 120, "item": "utorda1.dashlab.in", "msg": "Timeout when waiting for utorda1.dashlab.in:8000"}
[ERROR]: Task failed: Module failed: Timeout when waiting for utorda2.dashlab.in:8000
Origin: /home/peercompute/Serverless_Scheduler/ansible_utils/playbooks/tasks/resolve_scheduler.yml:4:3
2 # Sets scheduler_host and scheduler_url from the first [control] host that accepts TCP 8000.
3 # Requires groups['control'] and hostvars[item].ansible_host (or inventory hostname).
4 - name: Probe control nodes for scheduler API (inventory order, first success wins)
^ column 3
failed: [10.1.19.140] (item=utorda2.dashlab.in) => {"ansible_loop_var": "item", "changed": false, "elapsed": 120, "item": "utorda2.dashlab.in", "msg": "Timeout when waiting for utorda2.dashlab.in:8000"}
...ignoring
failed: [10.1.19.131] (item=utorda2.dashlab.in) => {"ansible_loop_var": "item", "changed": false, "elapsed": 120, "item": "utorda2.dashlab.in", "msg": "Timeout when waiting for utorda2.dashlab.in:8000"}
...ignoring
TASK [Fail if no control node accepts scheduler connections] *******************************************************************************************************************************************************************
[ERROR]: Task failed: Action failed: No control host in groups['control'] accepted TCP 8000 within 120s per host. Tried: utorda1.dashlab.in, utorda2.dashlab.in
Origin: /home/peercompute/Serverless_Scheduler/ansible_utils/playbooks/tasks/resolve_scheduler.yml:15:3
13 ignore_errors: true
14
15 - name: Fail if no control node accepts scheduler connections
^ column 3
fatal: [10.1.19.131]: FAILED! => {"changed": false, "msg": "No control host in groups['control'] accepted TCP 8000 within 120s per host. Tried: utorda1.dashlab.in, utorda2.dashlab.in"}
fatal: [10.1.19.140]: FAILED! => {"changed": false, "msg": "No control host in groups['control'] accepted TCP 8000 within 120s per host. Tried: utorda1.dashlab.in, utorda2.dashlab.in"}
Checked when both utordas were connected to internet. Docker is running as well.
Text transcript of the attached screenshot: