2026-05-08T08:44:42.024631Z 00O Running with gitlab-runner 18.11.1 (5265d41d)
2026-05-08T08:44:42.024669Z 00O   on ba0d40dbec6d ee6NEhN34, system ID: r_LuGAIt6mmQ0P
2026-05-08T08:44:42.024731Z 00O Resolving secrets
2026-05-08T08:44:42.025147Z 00O section_start:1778229882:prepare_executor
2026-05-08T08:44:42.025151Z 00O+Preparing the "docker" executor
2026-05-08T08:44:42.051167Z 00O Using Docker executor with image docker:cli ...
2026-05-08T08:44:43.074584Z 00O Starting service docker:dind...
2026-05-08T08:44:43.074613Z 00O Using effective pull policy of [always] for container docker:dind
2026-05-08T08:44:43.150456Z 00O Pulling docker image docker:dind ...
2026-05-08T08:44:44.503245Z 00O Using docker image sha256:c77e5d7912f9b137cc67051fdc2991d8f5ae22c55ddf532bb836dcb693a04940 for docker:dind with digest docker@sha256:c77e5d7912f9b137cc67051fdc2991d8f5ae22c55ddf532bb836dcb693a04940 ...
2026-05-08T08:44:44.773217Z 00O Waiting for services to be up and running (timeout 30 seconds)...
2026-05-08T08:45:16.270657Z 00E 
2026-05-08T08:45:16.270665Z 00E *** WARNING: Service runner-ee6nehn34-project-243-concurrent-0-5207ef4c6af9f9fd-docker-0 probably didn't start properly.
2026-05-08T08:45:16.270667Z 00E 
2026-05-08T08:45:16.270668Z 00E Health check error:
2026-05-08T08:45:16.270669Z 00E service "runner-ee6nehn34-project-243-concurrent-0-5207ef4c6af9f9fd-docker-0-wait-for-service" timeout
2026-05-08T08:45:16.270671Z 00E 
2026-05-08T08:45:16.270672Z 00E Health check container logs:
2026-05-08T08:45:16.270673Z 00E 2026-05-08T08:44:45.092140752Z waiting for TCP connection to f02350e8e735 on [2375 2376]...
2026-05-08T08:45:16.270674Z 00E 2026-05-08T08:44:45.092184111Z dialing f02350e8e735:2376...
2026-05-08T08:45:16.270684Z 00E 2026-05-08T08:44:45.092190816Z dialing f02350e8e735:2375...
2026-05-08T08:45:16.270686Z 00E 2026-05-08T08:44:46.092723390Z dialing f02350e8e735:2375...
2026-05-08T08:45:16.270687Z 00E 2026-05-08T08:44:46.092758159Z dialing f02350e8e735:2376...
2026-05-08T08:45:16.270688Z 00E 2026-05-08T08:44:47.093052287Z dialing f02350e8e735:2376...
2026-05-08T08:45:16.270689Z 00E 2026-05-08T08:44:47.093110566Z dialing f02350e8e735:2375...
2026-05-08T08:45:16.270690Z 00E 
2026-05-08T08:45:16.270691Z 00E Service container logs:
2026-05-08T08:45:16.270692Z 00E 2026-05-08T08:44:45.322246985Z Certificate request self-signature ok
2026-05-08T08:45:16.270693Z 00E 2026-05-08T08:44:45.322306604Z subject=CN=docker:dind server
2026-05-08T08:45:16.270694Z 00E 2026-05-08T08:44:45.346446993Z /certs/server/cert.pem: OK
2026-05-08T08:45:16.270695Z 00E 2026-05-08T08:44:46.449757806Z Certificate request self-signature ok
2026-05-08T08:45:16.270696Z 00E 2026-05-08T08:44:46.449790504Z subject=CN=docker:dind client
2026-05-08T08:45:16.270697Z 00E 2026-05-08T08:44:46.472286994Z /certs/client/cert.pem: OK
2026-05-08T08:45:16.270698Z 00E 2026-05-08T08:44:46.476859785Z cat: can't open '/proc/net/ip6_tables_names': No such file or directory
2026-05-08T08:45:16.270700Z 00E 2026-05-08T08:44:46.478057096Z cat: can't open '/proc/net/arp_tables_names': No such file or directory
2026-05-08T08:45:16.270701Z 00E 2026-05-08T08:44:46.482550659Z ip: can't find device 'nf_tables'
2026-05-08T08:45:16.270702Z 00E 2026-05-08T08:44:46.483894383Z nf_tables             376832 4144 nft_chain_nat,nft_compat
2026-05-08T08:45:16.270704Z 00E 2026-05-08T08:44:46.484252548Z nfnetlink              20480  7 nf_conntrack_netlink,ip_set,nft_compat,nf_tables
2026-05-08T08:45:16.270705Z 00E 2026-05-08T08:44:46.484263680Z libcrc32c              12288  5 nf_nat,nf_conntrack,nf_tables,btrfs,raid456
2026-05-08T08:45:16.270706Z 00E 2026-05-08T08:44:46.484807033Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-05-08T08:45:16.270708Z 00E 2026-05-08T08:44:46.487749618Z ip: can't find device 'ip_tables'
2026-05-08T08:45:16.270709Z 00E 2026-05-08T08:44:46.489160121Z ip_tables              32768  0 
2026-05-08T08:45:16.270710Z 00E 2026-05-08T08:44:46.489256203Z x_tables               65536  8 xt_nat,xt_tcpudp,xt_conntrack,xt_MASQUERADE,xt_set,xt_addrtype,nft_compat,ip_tables
2026-05-08T08:45:16.270712Z 00E 2026-05-08T08:44:46.489853979Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-05-08T08:45:16.270713Z 00E 2026-05-08T08:44:46.491625650Z ip: can't find device 'ip6_tables'
2026-05-08T08:45:16.270714Z 00E 2026-05-08T08:44:46.493974752Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-05-08T08:45:16.270715Z 00E 2026-05-08T08:44:46.496341984Z iptables v1.8.11 (nf_tables)
2026-05-08T08:45:16.270717Z 00E 2026-05-08T08:44:46.500406953Z mount: permission denied (are you root?)
2026-05-08T08:45:16.270718Z 00E 2026-05-08T08:44:46.500506473Z Could not mount /sys/kernel/security.
2026-05-08T08:45:16.270719Z 00E 2026-05-08T08:44:46.500515460Z AppArmor detection and --privileged mode might break.
2026-05-08T08:45:16.270720Z 00E 2026-05-08T08:44:46.502170547Z mount: permission denied (are you root?)
2026-05-08T08:45:16.270721Z 00E 
2026-05-08T08:45:16.270722Z 00E *********
2026-05-08T08:45:16.270761Z 00E 
2026-05-08T08:45:16.294572Z 00O Using effective pull policy of [always] for container docker:cli
2026-05-08T08:45:16.347299Z 00O Pulling docker image docker:cli ...
2026-05-08T08:45:17.749345Z 00O Using docker image sha256:17b5c235f40be7432a7c0914c154e9278aed63bad4afe5607e4f91840696a9f8 for docker:cli with digest docker@sha256:17b5c235f40be7432a7c0914c154e9278aed63bad4afe5607e4f91840696a9f8 ...
2026-05-08T08:45:17.749370Z 00O section_end:1778229917:prepare_executor
2026-05-08T08:45:17.749374Z 00O+section_start:1778229917:prepare_script
2026-05-08T08:45:17.749586Z 00O+Preparing environment
2026-05-08T08:45:17.778677Z 00O Using effective pull policy of [always] for container sha256:ac0f843d45047cc02cea2f6379f3c6f47aac077acc85bba0527ddc1e0b7773ba
2026-05-08T08:45:18.045715Z 01O Running on runner-ee6nehn34-project-243-concurrent-0 via 0ea095f01732...
2026-05-08T08:45:18.194029Z 00O section_end:1778229918:prepare_script
2026-05-08T08:45:18.194039Z 00O+section_start:1778229918:get_sources
2026-05-08T08:45:18.196015Z 00O+Getting source from Git repository
2026-05-08T08:45:18.518585Z 01O Gitaly correlation ID: 01KR3C5ACB91HHNEQEP9C1CK9K
2026-05-08T08:45:18.528066Z 01O Fetching changes with git depth set to 20...
2026-05-08T08:45:18.532223Z 01O Reinitialized existing Git repository in /builds/kisulkens/platforms/air/services/backend/.git/
2026-05-08T08:45:18.535412Z 01O Created fresh repository.
2026-05-08T08:45:19.542011Z 01O Checking out c45c6a7b as detached HEAD (ref is staging)...
2026-05-08T08:45:19.557862Z 01O Removing .env
2026-05-08T08:45:19.621234Z 01O 
2026-05-08T08:45:19.621243Z 01O Skipping Git submodules setup
2026-05-08T08:45:19.790185Z 00O section_end:1778229919:get_sources
2026-05-08T08:45:19.790196Z 00O+section_start:1778229919:step_script
2026-05-08T08:45:19.794795Z 00O+Executing "step_script" stage of the job script
2026-05-08T08:45:19.794845Z 00O Using effective pull policy of [always] for container docker:cli
2026-05-08T08:45:19.862050Z 00O Using docker image sha256:17b5c235f40be7432a7c0914c154e9278aed63bad4afe5607e4f91840696a9f8 for docker:cli with digest docker@sha256:17b5c235f40be7432a7c0914c154e9278aed63bad4afe5607e4f91840696a9f8 ...
2026-05-08T08:45:20.157035Z 01O $ mkdir -p $DOCKER_CERT_PATH
2026-05-08T08:45:20.157845Z 01O $ export ENVNAME=$(echo ${ENVIRONMENT} | tr '[:lower:]' '[:upper:]')
2026-05-08T08:45:20.159113Z 01O $ export DOCKER_HOST="tcp://$(printenv "${ENVNAME}_CLUSTER_HOST"):2376"
2026-05-08T08:45:20.159989Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CA)" $DOCKER_CERT_PATH/ca.pem
2026-05-08T08:45:20.162665Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CERT)" $DOCKER_CERT_PATH/cert.pem
2026-05-08T08:45:20.164442Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_KEY)" $DOCKER_CERT_PATH/key.pem
2026-05-08T08:45:20.166279Z 01O $ echo "$CI_REGISTRY_PASSWORD" | docker login -u "$CI_REGISTRY_USER" $CI_REGISTRY --password-stdin
2026-05-08T08:45:20.747497Z 01O Login Succeeded
2026-05-08T08:45:20.747532Z 01E 
2026-05-08T08:45:20.747535Z 01E WARNING! Your credentials are stored unencrypted in '/root/.docker/config.json'.
2026-05-08T08:45:20.747540Z 01E Configure a credential helper to remove this warning. See
2026-05-08T08:45:20.747544Z 01E https://docs.docker.com/go/credential-store/
2026-05-08T08:45:20.747547Z 01E 
2026-05-08T08:45:20.750663Z 01O $ export RELEASE=$(echo -n $(date '+%D %X') | md5sum | awk '{print $1}')
2026-05-08T08:45:20.753749Z 01O $ if [ "$(docker info --format '{{.Swarm.LocalNodeState}}' 2>/dev/null)" = "active" ]; then docker stack deploy --prune --with-registry-auth -c <(docker compose config | grep -v "^name:") $COMPOSE_PROJECT_NAME; else docker compose up -d; fi
2026-05-08T08:45:21.282669Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:c45c6a7ba2d142e55d7f2abaf33178533e589096 Pulling 
2026-05-08T08:45:21.282739Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:c45c6a7ba2d142e55d7f2abaf33178533e589096 Pulling 
2026-05-08T08:45:21.282742Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:c45c6a7ba2d142e55d7f2abaf33178533e589096 Pulling 
2026-05-08T08:45:21.282745Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:c45c6a7ba2d142e55d7f2abaf33178533e589096 Pulling 
2026-05-08T08:45:22.485498Z 01E  3531af2bc2a9 Already exists 0B
2026-05-08T08:45:22.488145Z 01E  cb8c0a9140ac Already exists 0B
2026-05-08T08:45:22.491345Z 01E  4d873bcef452 Already exists 0B
2026-05-08T08:45:22.493568Z 01E  3fc9d9ab5045 Already exists 0B
2026-05-08T08:45:22.496053Z 01E  bec6d5523541 Already exists 0B
2026-05-08T08:45:22.497926Z 01E  57fc793e836b Already exists 0B
2026-05-08T08:45:22.501149Z 01E  bc4f9d5f745b Already exists 0B
2026-05-08T08:45:22.503429Z 01E  f3962f02bbc6 Already exists 0B
2026-05-08T08:45:22.505709Z 01E  b43fa2797c05 Pulling fs layer 0B
2026-05-08T08:45:22.606807Z 01E  3531af2bc2a9 Already exists 0B
2026-05-08T08:45:22.608978Z 01E  cb8c0a9140ac Already exists 0B
2026-05-08T08:45:22.610731Z 01E  4d873bcef452 Already exists 0B
2026-05-08T08:45:22.612527Z 01E  3fc9d9ab5045 Already exists 0B
2026-05-08T08:45:22.614692Z 01E  bec6d5523541 Already exists 0B
2026-05-08T08:45:22.617097Z 01E  57fc793e836b Already exists 0B
2026-05-08T08:45:22.619114Z 01E  bc4f9d5f745b Already exists 0B
2026-05-08T08:45:22.623411Z 01E  f3962f02bbc6 Already exists 0B
2026-05-08T08:45:22.625160Z 01E  b43fa2797c05 Pulling fs layer 0B
2026-05-08T08:45:22.687634Z 01E  b43fa2797c05 Downloading 20.9kB
2026-05-08T08:45:22.687643Z 01E  b43fa2797c05 Downloading 20.9kB
2026-05-08T08:45:22.710418Z 01E  3531af2bc2a9 Already exists 0B
2026-05-08T08:45:22.712951Z 01E  cb8c0a9140ac Already exists 0B
2026-05-08T08:45:22.714902Z 01E  4d873bcef452 Already exists 0B
2026-05-08T08:45:22.716615Z 01E  3fc9d9ab5045 Already exists 0B
2026-05-08T08:45:22.718225Z 01E  bec6d5523541 Already exists 0B
2026-05-08T08:45:22.721350Z 01E  57fc793e836b Already exists 0B
2026-05-08T08:45:22.724207Z 01E  bc4f9d5f745b Already exists 0B
2026-05-08T08:45:22.727517Z 01E  f3962f02bbc6 Already exists 0B
2026-05-08T08:45:22.730349Z 01E  b43fa2797c05 Pulling fs layer 0B
2026-05-08T08:45:22.730442Z 01E  b43fa2797c05 Downloading 20.9kB
2026-05-08T08:45:22.789392Z 01E  b43fa2797c05 Downloading 938kB
2026-05-08T08:45:22.789426Z 01E  b43fa2797c05 Downloading 938kB
2026-05-08T08:45:22.789432Z 01E  b43fa2797c05 Downloading 938kB
2026-05-08T08:45:22.808329Z 01E  3531af2bc2a9 Already exists 0B
2026-05-08T08:45:22.811905Z 01E  cb8c0a9140ac Already exists 0B
2026-05-08T08:45:22.814221Z 01E  4d873bcef452 Already exists 0B
2026-05-08T08:45:22.817016Z 01E  3fc9d9ab5045 Already exists 0B
2026-05-08T08:45:22.820145Z 01E  bec6d5523541 Already exists 0B
2026-05-08T08:45:22.821693Z 01E  57fc793e836b Already exists 0B
2026-05-08T08:45:22.823955Z 01E  bc4f9d5f745b Already exists 0B
2026-05-08T08:45:22.825907Z 01E  f3962f02bbc6 Already exists 0B
2026-05-08T08:45:22.828075Z 01E  b43fa2797c05 Pulling fs layer 0B
2026-05-08T08:45:22.828079Z 01E  b43fa2797c05 Downloading 938kB
2026-05-08T08:45:22.884265Z 01E  b43fa2797c05 Download complete 0B
2026-05-08T08:45:22.884271Z 01E  b43fa2797c05 Verifying Checksum 0B
2026-05-08T08:45:22.884279Z 01E  b43fa2797c05 Download complete 0B
2026-05-08T08:45:22.884311Z 01E  b43fa2797c05 Download complete 0B
2026-05-08T08:45:22.884398Z 01E  b43fa2797c05 Verifying Checksum 0B
2026-05-08T08:45:22.884405Z 01E  b43fa2797c05 Download complete 0B
2026-05-08T08:45:22.884407Z 01E  b43fa2797c05 Extracting 32.77kB
2026-05-08T08:45:22.884533Z 01E  b43fa2797c05 Extracting 32.77kB
2026-05-08T08:45:22.884540Z 01E  b43fa2797c05 Extracting 32.77kB
2026-05-08T08:45:22.884542Z 01E  b43fa2797c05 Extracting 32.77kB
2026-05-08T08:45:22.984556Z 01E  b43fa2797c05 Extracting 1.802MB
2026-05-08T08:45:22.984567Z 01E  b43fa2797c05 Extracting 1.802MB
2026-05-08T08:45:22.984589Z 01E  b43fa2797c05 Extracting 1.802MB
2026-05-08T08:45:22.984642Z 01E  b43fa2797c05 Extracting 1.802MB
2026-05-08T08:45:23.064139Z 01E  b43fa2797c05 Extracting 2.025MB
2026-05-08T08:45:23.064150Z 01E  b43fa2797c05 Extracting 2.025MB
2026-05-08T08:45:23.064152Z 01E  b43fa2797c05 Extracting 2.025MB
2026-05-08T08:45:23.064171Z 01E  b43fa2797c05 Extracting 2.025MB
2026-05-08T08:45:23.069375Z 01E  b43fa2797c05 Extracting 2.025MB
2026-05-08T08:45:23.069501Z 01E  b43fa2797c05 Extracting 2.025MB
2026-05-08T08:45:23.069729Z 01E  b43fa2797c05 Extracting 2.025MB
2026-05-08T08:45:23.069808Z 01E  b43fa2797c05 Extracting 2.025MB
2026-05-08T08:45:23.107744Z 01E  b43fa2797c05 Pull complete 0B
2026-05-08T08:45:23.107748Z 01E  b43fa2797c05 Pull complete 0B
2026-05-08T08:45:23.107750Z 01E  b43fa2797c05 Pull complete 0B
2026-05-08T08:45:23.107752Z 01E  b43fa2797c05 Pull complete 0B
2026-05-08T08:45:23.117713Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:c45c6a7ba2d142e55d7f2abaf33178533e589096 Pulled 
2026-05-08T08:45:23.118131Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:c45c6a7ba2d142e55d7f2abaf33178533e589096 Pulled 
2026-05-08T08:45:23.118757Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:c45c6a7ba2d142e55d7f2abaf33178533e589096 Pulled 
2026-05-08T08:45:23.119086Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:c45c6a7ba2d142e55d7f2abaf33178533e589096 Pulled 
2026-05-08T08:45:23.199979Z 01E  Container backend-celery-mdb-1 Running 
2026-05-08T08:45:23.199990Z 01E  Container backend-channels-mdb-1 Running 
2026-05-08T08:45:23.200556Z 01E  Container backend-housekeeper-1 Recreate 
2026-05-08T08:45:23.200563Z 01E  Container backend-app-1 Recreate 
2026-05-08T08:45:23.200774Z 01E  Container backend-cache-mdb-1 Running 
2026-05-08T08:45:23.200853Z 01E  Container backend-celery-beat-1 Recreate 
2026-05-08T08:45:23.200858Z 01E  Container backend-celery-1 Recreate 
2026-05-08T08:45:23.200919Z 01E  Container backend-static-server-1 Running 
2026-05-08T08:45:23.515806Z 01E  Container backend-housekeeper-1 Recreated 
2026-05-08T08:45:24.658793Z 01E  Container backend-celery-beat-1 Recreated 
2026-05-08T08:45:29.392896Z 01E  Container backend-celery-1 Recreated 
2026-05-08T08:45:33.788026Z 01E  Container backend-app-1 Recreated 
2026-05-08T08:45:33.817220Z 01E  Container backend-housekeeper-1 Starting 
2026-05-08T08:45:33.817230Z 01E  Container backend-celery-1 Starting 
2026-05-08T08:45:33.817233Z 01E  Container backend-celery-beat-1 Starting 
2026-05-08T08:45:33.817244Z 01E  Container backend-app-1 Starting 
2026-05-08T08:45:34.198352Z 01E  Container backend-housekeeper-1 Started 
2026-05-08T08:45:34.202016Z 01E  Container backend-celery-beat-1 Started 
2026-05-08T08:45:34.406190Z 01E  Container backend-celery-1 Started 
2026-05-08T08:45:34.477192Z 01E  Container backend-app-1 Started 
2026-05-08T08:45:34.644447Z 00O section_end:1778229934:step_script
2026-05-08T08:45:34.644458Z 00O+section_start:1778229934:cleanup_file_variables
2026-05-08T08:45:34.648206Z 00O+Cleaning up project directory and file based variables
2026-05-08T08:45:35.057681Z 00O section_end:1778229935:cleanup_file_variables
2026-05-08T08:45:35.057692Z 00O+
2026-05-08T08:45:35.221505Z 00O Job succeeded