2026-05-19T11:57:08.331671Z 00O Running with gitlab-runner 18.11.1 (5265d41d)
2026-05-19T11:57:08.331714Z 00O   on ba0d40dbec6d ee6NEhN34, system ID: r_LuGAIt6mmQ0P
2026-05-19T11:57:08.331778Z 00O Resolving secrets
2026-05-19T11:57:08.332292Z 00O section_start:1779191828:prepare_executor
2026-05-19T11:57:08.332297Z 00O+Preparing the "docker" executor
2026-05-19T11:57:08.359629Z 00O Using Docker executor with image docker:cli ...
2026-05-19T11:57:09.380138Z 00O Starting service docker:dind...
2026-05-19T11:57:09.380165Z 00O Using effective pull policy of [always] for container docker:dind
2026-05-19T11:57:09.454709Z 00O Pulling docker image docker:dind ...
2026-05-19T11:57:10.711414Z 00O Using docker image sha256:8e3fae900cbfbdc14e8abca89a9e44363065cb535f34a09283c59cc0dde2de20 for docker:dind with digest docker@sha256:8e3fae900cbfbdc14e8abca89a9e44363065cb535f34a09283c59cc0dde2de20 ...
2026-05-19T11:57:10.959650Z 00O Waiting for services to be up and running (timeout 30 seconds)...
2026-05-19T11:57:42.483670Z 00E 
2026-05-19T11:57:42.483681Z 00E *** WARNING: Service runner-ee6nehn34-project-243-concurrent-0-6b7877bb91f54d87-docker-0 probably didn't start properly.
2026-05-19T11:57:42.483684Z 00E 
2026-05-19T11:57:42.483686Z 00E Health check error:
2026-05-19T11:57:42.483688Z 00E service "runner-ee6nehn34-project-243-concurrent-0-6b7877bb91f54d87-docker-0-wait-for-service" timeout
2026-05-19T11:57:42.483690Z 00E 
2026-05-19T11:57:42.483692Z 00E Health check container logs:
2026-05-19T11:57:42.483693Z 00E 2026-05-19T11:57:11.281151633Z waiting for TCP connection to 45956edeaedf on [2375 2376]...
2026-05-19T11:57:42.483696Z 00E 2026-05-19T11:57:11.281194193Z dialing 45956edeaedf:2376...
2026-05-19T11:57:42.483697Z 00E 2026-05-19T11:57:11.281201606Z dialing 45956edeaedf:2375...
2026-05-19T11:57:42.483699Z 00E 2026-05-19T11:57:12.281969617Z dialing 45956edeaedf:2375...
2026-05-19T11:57:42.483701Z 00E 2026-05-19T11:57:12.282003841Z dialing 45956edeaedf:2376...
2026-05-19T11:57:42.483703Z 00E 2026-05-19T11:57:13.282309460Z dialing 45956edeaedf:2376...
2026-05-19T11:57:42.483704Z 00E 2026-05-19T11:57:13.282356643Z dialing 45956edeaedf:2375...
2026-05-19T11:57:42.483706Z 00E 
2026-05-19T11:57:42.483707Z 00E Service container logs:
2026-05-19T11:57:42.483709Z 00E 2026-05-19T11:57:12.429662022Z Certificate request self-signature ok
2026-05-19T11:57:42.483711Z 00E 2026-05-19T11:57:12.429713058Z subject=CN=docker:dind server
2026-05-19T11:57:42.483713Z 00E 2026-05-19T11:57:12.452207838Z /certs/server/cert.pem: OK
2026-05-19T11:57:42.483714Z 00E 2026-05-19T11:57:12.798385925Z Certificate request self-signature ok
2026-05-19T11:57:42.483716Z 00E 2026-05-19T11:57:12.798419642Z subject=CN=docker:dind client
2026-05-19T11:57:42.483718Z 00E 2026-05-19T11:57:12.818001672Z /certs/client/cert.pem: OK
2026-05-19T11:57:42.483720Z 00E 2026-05-19T11:57:12.823558816Z cat: can't open '/proc/net/ip6_tables_names': No such file or directory
2026-05-19T11:57:42.483722Z 00E 2026-05-19T11:57:12.824465375Z cat: can't open '/proc/net/arp_tables_names': No such file or directory
2026-05-19T11:57:42.483724Z 00E 2026-05-19T11:57:12.827671855Z ip: can't find device 'nf_tables'
2026-05-19T11:57:42.483726Z 00E 2026-05-19T11:57:12.828685354Z nf_tables             376832 4163 nft_chain_nat,nft_compat
2026-05-19T11:57:42.483728Z 00E 2026-05-19T11:57:12.829070546Z nfnetlink              20480  7 nf_conntrack_netlink,ip_set,nft_compat,nf_tables
2026-05-19T11:57:42.483731Z 00E 2026-05-19T11:57:12.829076241Z libcrc32c              12288  5 nf_nat,nf_conntrack,nf_tables,btrfs,raid456
2026-05-19T11:57:42.483733Z 00E 2026-05-19T11:57:12.829689058Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-05-19T11:57:42.483735Z 00E 2026-05-19T11:57:12.832701099Z ip: can't find device 'ip_tables'
2026-05-19T11:57:42.483737Z 00E 2026-05-19T11:57:12.834471321Z ip_tables              32768  0 
2026-05-19T11:57:42.483739Z 00E 2026-05-19T11:57:12.834557657Z x_tables               65536  8 xt_nat,xt_tcpudp,xt_conntrack,xt_MASQUERADE,xt_set,xt_addrtype,nft_compat,ip_tables
2026-05-19T11:57:42.483742Z 00E 2026-05-19T11:57:12.835227734Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-05-19T11:57:42.483744Z 00E 2026-05-19T11:57:12.836922869Z ip: can't find device 'ip6_tables'
2026-05-19T11:57:42.483746Z 00E 2026-05-19T11:57:12.839006134Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-05-19T11:57:42.483748Z 00E 2026-05-19T11:57:12.841363195Z iptables v1.8.11 (nf_tables)
2026-05-19T11:57:42.483750Z 00E 2026-05-19T11:57:12.845093219Z mount: permission denied (are you root?)
2026-05-19T11:57:42.483752Z 00E 2026-05-19T11:57:12.845220270Z Could not mount /sys/kernel/security.
2026-05-19T11:57:42.483754Z 00E 2026-05-19T11:57:12.845230477Z AppArmor detection and --privileged mode might break.
2026-05-19T11:57:42.483756Z 00E 2026-05-19T11:57:12.847074703Z mount: permission denied (are you root?)
2026-05-19T11:57:42.483758Z 00E 
2026-05-19T11:57:42.483759Z 00E *********
2026-05-19T11:57:42.483818Z 00E 
2026-05-19T11:57:42.516801Z 00O Using effective pull policy of [always] for container docker:cli
2026-05-19T11:57:42.579687Z 00O Pulling docker image docker:cli ...
2026-05-19T11:57:43.807966Z 00O Using docker image sha256:864f36643a29d212f6cc88ec3aa1ebd2d939283df933c4c5c1074a982237f9bd for docker:cli with digest docker@sha256:864f36643a29d212f6cc88ec3aa1ebd2d939283df933c4c5c1074a982237f9bd ...
2026-05-19T11:57:43.807993Z 00O section_end:1779191863:prepare_executor
2026-05-19T11:57:43.807997Z 00O+section_start:1779191863:prepare_script
2026-05-19T11:57:43.808250Z 00O+Preparing environment
2026-05-19T11:57:43.836868Z 00O Using effective pull policy of [always] for container sha256:ac0f843d45047cc02cea2f6379f3c6f47aac077acc85bba0527ddc1e0b7773ba
2026-05-19T11:57:44.106793Z 01O Running on runner-ee6nehn34-project-243-concurrent-0 via 0ea095f01732...
2026-05-19T11:57:44.254761Z 00O section_end:1779191864:prepare_script
2026-05-19T11:57:44.254774Z 00O+section_start:1779191864:get_sources
2026-05-19T11:57:44.257401Z 00O+Getting source from Git repository
2026-05-19T11:57:44.607103Z 01O Gitaly correlation ID: 01KS01HK89C1EWE20C83NBKS3B
2026-05-19T11:57:44.617937Z 01O Fetching changes with git depth set to 20...
2026-05-19T11:57:44.622018Z 01O Reinitialized existing Git repository in /builds/kisulkens/platforms/air/services/backend/.git/
2026-05-19T11:57:44.625300Z 01O Created fresh repository.
2026-05-19T11:57:45.384327Z 01O Checking out ffab75dd as detached HEAD (ref is staging)...
2026-05-19T11:57:45.395825Z 01O Removing .env
2026-05-19T11:57:45.451957Z 01O 
2026-05-19T11:57:45.452007Z 01O Skipping Git submodules setup
2026-05-19T11:57:45.647187Z 00O section_end:1779191865:get_sources
2026-05-19T11:57:45.647198Z 00O+section_start:1779191865:step_script
2026-05-19T11:57:45.651768Z 00O+Executing "step_script" stage of the job script
2026-05-19T11:57:45.651806Z 00O Using effective pull policy of [always] for container docker:cli
2026-05-19T11:57:45.701344Z 00O Using docker image sha256:864f36643a29d212f6cc88ec3aa1ebd2d939283df933c4c5c1074a982237f9bd for docker:cli with digest docker@sha256:864f36643a29d212f6cc88ec3aa1ebd2d939283df933c4c5c1074a982237f9bd ...
2026-05-19T11:57:45.960158Z 01O $ mkdir -p $DOCKER_CERT_PATH
2026-05-19T11:57:45.960905Z 01O $ export ENVNAME=$(echo ${ENVIRONMENT} | tr '[:lower:]' '[:upper:]')
2026-05-19T11:57:45.962845Z 01O $ export DOCKER_HOST="tcp://$(printenv "${ENVNAME}_CLUSTER_HOST"):2376"
2026-05-19T11:57:45.963665Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CA)" $DOCKER_CERT_PATH/ca.pem
2026-05-19T11:57:45.966681Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CERT)" $DOCKER_CERT_PATH/cert.pem
2026-05-19T11:57:45.968392Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_KEY)" $DOCKER_CERT_PATH/key.pem
2026-05-19T11:57:45.970273Z 01O $ echo "$CI_REGISTRY_PASSWORD" | docker login -u "$CI_REGISTRY_USER" $CI_REGISTRY --password-stdin
2026-05-19T11:57:48.019150Z 01E 
2026-05-19T11:57:48.019164Z 01E WARNING! Your credentials are stored unencrypted in '/root/.docker/config.json'.
2026-05-19T11:57:48.019169Z 01E Configure a credential helper to remove this warning. See
2026-05-19T11:57:48.019174Z 01E https://docs.docker.com/go/credential-store/
2026-05-19T11:57:48.019177Z 01E 
2026-05-19T11:57:48.019190Z 01O Login Succeeded
2026-05-19T11:57:48.022057Z 01O $ export RELEASE=$(echo -n $(date '+%D %X') | md5sum | awk '{print $1}')
2026-05-19T11:57:48.024692Z 01O $ if [ "$(docker info --format '{{.Swarm.LocalNodeState}}' 2>/dev/null)" = "active" ]; then docker stack deploy --prune --with-registry-auth -c <(docker compose config | grep -v "^name:") $COMPOSE_PROJECT_NAME; else docker compose up -d; fi
2026-05-19T11:57:48.449669Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ffab75dd968e44e326d107109476f7f5b4cc4a56 Pulling 
2026-05-19T11:57:48.449766Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ffab75dd968e44e326d107109476f7f5b4cc4a56 Pulling 
2026-05-19T11:57:48.449772Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ffab75dd968e44e326d107109476f7f5b4cc4a56 Pulling 
2026-05-19T11:57:48.449777Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ffab75dd968e44e326d107109476f7f5b4cc4a56 Pulling 
2026-05-19T11:57:48.990215Z 01E  57fb71246055 Already exists 0B
2026-05-19T11:57:48.998457Z 01E  797809503061 Already exists 0B
2026-05-19T11:57:49.000119Z 01E  759e0c85a86e Already exists 0B
2026-05-19T11:57:49.002771Z 01E  b33ff618953d Already exists 0B
2026-05-19T11:57:49.021081Z 01E  f01fa50b78ea Already exists 0B
2026-05-19T11:57:49.024991Z 01E  1c8830e556e8 Already exists 0B
2026-05-19T11:57:49.027387Z 01E  cf1820a4600c Already exists 0B
2026-05-19T11:57:49.030150Z 01E  e6b5e254ce85 Already exists 0B
2026-05-19T11:57:49.032922Z 01E  e3a538c06379 Pulling fs layer 0B
2026-05-19T11:57:49.170237Z 01E  57fb71246055 Already exists 0B
2026-05-19T11:57:49.172758Z 01E  797809503061 Already exists 0B
2026-05-19T11:57:49.175159Z 01E  759e0c85a86e Already exists 0B
2026-05-19T11:57:49.178309Z 01E  b33ff618953d Already exists 0B
2026-05-19T11:57:49.179922Z 01E  f01fa50b78ea Already exists 0B
2026-05-19T11:57:49.183162Z 01E  1c8830e556e8 Already exists 0B
2026-05-19T11:57:49.185591Z 01E  cf1820a4600c Already exists 0B
2026-05-19T11:57:49.188264Z 01E  e6b5e254ce85 Already exists 0B
2026-05-19T11:57:49.190756Z 01E  e3a538c06379 Pulling fs layer 0B
2026-05-19T11:57:49.205677Z 01E  e3a538c06379 Downloading 31.84kB
2026-05-19T11:57:49.205950Z 01E  e3a538c06379 Downloading 31.84kB
2026-05-19T11:57:49.305981Z 01E  e3a538c06379 Downloading 895.6kB
2026-05-19T11:57:49.305996Z 01E  e3a538c06379 Downloading 895.6kB
2026-05-19T11:57:49.311399Z 01E  57fb71246055 Already exists 0B
2026-05-19T11:57:49.313406Z 01E  797809503061 Already exists 0B
2026-05-19T11:57:49.316001Z 01E  759e0c85a86e Already exists 0B
2026-05-19T11:57:49.318191Z 01E  b33ff618953d Already exists 0B
2026-05-19T11:57:49.320807Z 01E  f01fa50b78ea Already exists 0B
2026-05-19T11:57:49.323047Z 01E  1c8830e556e8 Already exists 0B
2026-05-19T11:57:49.324728Z 01E  cf1820a4600c Already exists 0B
2026-05-19T11:57:49.326859Z 01E  e6b5e254ce85 Already exists 0B
2026-05-19T11:57:49.329098Z 01E  e3a538c06379 Pulling fs layer 0B
2026-05-19T11:57:49.329102Z 01E  e3a538c06379 Downloading 895.6kB
2026-05-19T11:57:49.371492Z 01E  57fb71246055 Already exists 0B
2026-05-19T11:57:49.375548Z 01E  797809503061 Already exists 0B
2026-05-19T11:57:49.377656Z 01E  759e0c85a86e Already exists 0B
2026-05-19T11:57:49.380517Z 01E  b33ff618953d Already exists 0B
2026-05-19T11:57:49.385375Z 01E  f01fa50b78ea Already exists 0B
2026-05-19T11:57:49.387197Z 01E  1c8830e556e8 Already exists 0B
2026-05-19T11:57:49.394921Z 01E  cf1820a4600c Already exists 0B
2026-05-19T11:57:49.400263Z 01E  e6b5e254ce85 Already exists 0B
2026-05-19T11:57:49.402828Z 01E  e3a538c06379 Pulling fs layer 0B
2026-05-19T11:57:49.402944Z 01E  e3a538c06379 Downloading 895.6kB
2026-05-19T11:57:49.416863Z 01E  e3a538c06379 Downloading 2.01MB
2026-05-19T11:57:49.417022Z 01E  e3a538c06379 Downloading 2.01MB
2026-05-19T11:57:49.417026Z 01E  e3a538c06379 Downloading 2.01MB
2026-05-19T11:57:49.417409Z 01E  e3a538c06379 Downloading 2.01MB
2026-05-19T11:57:49.504733Z 01E  e3a538c06379 Verifying Checksum 0B
2026-05-19T11:57:49.504741Z 01E  e3a538c06379 Verifying Checksum 0B
2026-05-19T11:57:49.505144Z 01E  e3a538c06379 Verifying Checksum 0B
2026-05-19T11:57:49.505263Z 01E  e3a538c06379 Download complete 0B
2026-05-19T11:57:49.505404Z 01E  e3a538c06379 Extracting 32.77kB
2026-05-19T11:57:49.505455Z 01E  e3a538c06379 Download complete 0B
2026-05-19T11:57:49.505607Z 01E  e3a538c06379 Extracting 32.77kB
2026-05-19T11:57:49.505742Z 01E  e3a538c06379 Download complete 0B
2026-05-19T11:57:49.505826Z 01E  e3a538c06379 Extracting 32.77kB
2026-05-19T11:57:49.506645Z 01E  e3a538c06379 Verifying Checksum 0B
2026-05-19T11:57:49.506649Z 01E  e3a538c06379 Download complete 0B
2026-05-19T11:57:49.507541Z 01E  e3a538c06379 Extracting 32.77kB
2026-05-19T11:57:49.606796Z 01E  e3a538c06379 Extracting 786.4kB
2026-05-19T11:57:49.606807Z 01E  e3a538c06379 Extracting 786.4kB
2026-05-19T11:57:49.606809Z 01E  e3a538c06379 Extracting 786.4kB
2026-05-19T11:57:49.607094Z 01E  e3a538c06379 Extracting 786.4kB
2026-05-19T11:57:49.715242Z 01E  e3a538c06379 Extracting 2.753MB
2026-05-19T11:57:49.715255Z 01E  e3a538c06379 Extracting 2.753MB
2026-05-19T11:57:49.715257Z 01E  e3a538c06379 Extracting 2.753MB
2026-05-19T11:57:49.715277Z 01E  e3a538c06379 Extracting 2.753MB
2026-05-19T11:57:49.768115Z 01E  e3a538c06379 Extracting 2.881MB
2026-05-19T11:57:49.768126Z 01E  e3a538c06379 Extracting 2.881MB
2026-05-19T11:57:49.768144Z 01E  e3a538c06379 Extracting 2.881MB
2026-05-19T11:57:49.768376Z 01E  e3a538c06379 Extracting 2.881MB
2026-05-19T11:57:49.776049Z 01E  e3a538c06379 Extracting 2.881MB
2026-05-19T11:57:49.776053Z 01E  e3a538c06379 Extracting 2.881MB
2026-05-19T11:57:49.776428Z 01E  e3a538c06379 Extracting 2.881MB
2026-05-19T11:57:49.776436Z 01E  e3a538c06379 Extracting 2.881MB
2026-05-19T11:57:49.826475Z 01E  e3a538c06379 Pull complete 0B
2026-05-19T11:57:49.826482Z 01E  e3a538c06379 Pull complete 0B
2026-05-19T11:57:49.826806Z 01E  e3a538c06379 Pull complete 0B
2026-05-19T11:57:49.826810Z 01E  e3a538c06379 Pull complete 0B
2026-05-19T11:57:49.842985Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ffab75dd968e44e326d107109476f7f5b4cc4a56 Pulled 
2026-05-19T11:57:49.845430Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ffab75dd968e44e326d107109476f7f5b4cc4a56 Pulled 
2026-05-19T11:57:49.845907Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ffab75dd968e44e326d107109476f7f5b4cc4a56 Pulled 
2026-05-19T11:57:49.847264Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ffab75dd968e44e326d107109476f7f5b4cc4a56 Pulled 
2026-05-19T11:57:49.953738Z 01E  Container backend-celery-mdb-1 Running 
2026-05-19T11:57:49.953753Z 01E  Container backend-channels-mdb-1 Running 
2026-05-19T11:57:49.953755Z 01E  Container backend-static-server-1 Running 
2026-05-19T11:57:49.953758Z 01E  Container backend-cache-mdb-1 Running 
2026-05-19T11:57:49.953768Z 01E  Container backend-housekeeper-1 Recreate 
2026-05-19T11:57:49.953784Z 01E  Container backend-celery-beat-1 Recreate 
2026-05-19T11:57:49.954647Z 01E  Container backend-app-1 Recreate 
2026-05-19T11:57:49.954949Z 01E  Container backend-celery-1 Recreate 
2026-05-19T11:57:50.250397Z 01E  Container backend-housekeeper-1 Recreated 
2026-05-19T11:57:51.645843Z 01E  Container backend-celery-beat-1 Recreated 
2026-05-19T11:57:53.325583Z 01E  Container backend-celery-1 Recreated 
2026-05-19T11:58:00.653205Z 01E  Container backend-app-1 Recreated 
2026-05-19T11:58:00.685041Z 01E  Container backend-app-1 Starting 
2026-05-19T11:58:00.685052Z 01E  Container backend-celery-beat-1 Starting 
2026-05-19T11:58:00.685075Z 01E  Container backend-celery-1 Starting 
2026-05-19T11:58:00.685081Z 01E  Container backend-housekeeper-1 Starting 
2026-05-19T11:58:01.117979Z 01E  Container backend-celery-beat-1 Started 
2026-05-19T11:58:01.190908Z 01E  Container backend-app-1 Started 
2026-05-19T11:58:01.243741Z 01E  Container backend-celery-1 Started 
2026-05-19T11:58:01.314006Z 01E  Container backend-housekeeper-1 Started 
2026-05-19T11:58:01.509087Z 00O section_end:1779191881:step_script
2026-05-19T11:58:01.509099Z 00O+section_start:1779191881:cleanup_file_variables
2026-05-19T11:58:01.512545Z 00O+Cleaning up project directory and file based variables
2026-05-19T11:58:01.896026Z 00O section_end:1779191881:cleanup_file_variables
2026-05-19T11:58:01.896034Z 00O+
2026-05-19T11:58:02.081575Z 00O Job succeeded