2026-05-29T09:17:51.600318Z 00O Running with gitlab-runner 18.11.1 (5265d41d)
2026-05-29T09:17:51.600380Z 00O   on ba0d40dbec6d ee6NEhN34, system ID: r_LuGAIt6mmQ0P
2026-05-29T09:17:51.600500Z 00O Resolving secrets
2026-05-29T09:17:51.600967Z 00O section_start:1780046271:prepare_executor
2026-05-29T09:17:51.600972Z 00O+Preparing the "docker" executor
2026-05-29T09:17:51.625091Z 00O Using Docker executor with image docker:cli ...
2026-05-29T09:17:52.649798Z 00O Starting service docker:dind...
2026-05-29T09:17:52.649830Z 00O Using effective pull policy of [always] for container docker:dind
2026-05-29T09:17:52.726146Z 00O Pulling docker image docker:dind ...
2026-05-29T09:17:54.710017Z 00O Using docker image sha256:6b9cd914eb9c6b342c040a49a27a5eb3804453bae6ecc90f7ff96133595a95e8 for docker:dind with digest docker@sha256:6b9cd914eb9c6b342c040a49a27a5eb3804453bae6ecc90f7ff96133595a95e8 ...
2026-05-29T09:17:54.971753Z 00O Waiting for services to be up and running (timeout 30 seconds)...
2026-05-29T09:18:26.503621Z 00E 
2026-05-29T09:18:26.503628Z 00E *** WARNING: Service runner-ee6nehn34-project-243-concurrent-0-3e5eef5e44d1c8f5-docker-0 probably didn't start properly.
2026-05-29T09:18:26.503630Z 00E 
2026-05-29T09:18:26.503631Z 00E Health check error:
2026-05-29T09:18:26.503632Z 00E service "runner-ee6nehn34-project-243-concurrent-0-3e5eef5e44d1c8f5-docker-0-wait-for-service" timeout
2026-05-29T09:18:26.503634Z 00E 
2026-05-29T09:18:26.503634Z 00E Health check container logs:
2026-05-29T09:18:26.503635Z 00E 2026-05-29T09:17:55.279179153Z waiting for TCP connection to b5bcec153057 on [2375 2376]...
2026-05-29T09:18:26.503636Z 00E 2026-05-29T09:17:55.279216715Z dialing b5bcec153057:2376...
2026-05-29T09:18:26.503637Z 00E 2026-05-29T09:17:55.279221213Z dialing b5bcec153057:2375...
2026-05-29T09:18:26.503638Z 00E 2026-05-29T09:17:56.279807718Z dialing b5bcec153057:2375...
2026-05-29T09:18:26.503639Z 00E 2026-05-29T09:17:56.279862469Z dialing b5bcec153057:2376...
2026-05-29T09:18:26.503640Z 00E 2026-05-29T09:17:57.281128646Z dialing b5bcec153057:2375...
2026-05-29T09:18:26.503641Z 00E 2026-05-29T09:17:57.281153644Z dialing b5bcec153057:2376...
2026-05-29T09:18:26.503642Z 00E 
2026-05-29T09:18:26.503643Z 00E Service container logs:
2026-05-29T09:18:26.503643Z 00E 2026-05-29T09:17:56.255804802Z Certificate request self-signature ok
2026-05-29T09:18:26.503644Z 00E 2026-05-29T09:17:56.255844021Z subject=CN=docker:dind server
2026-05-29T09:18:26.503645Z 00E 2026-05-29T09:17:56.277968992Z /certs/server/cert.pem: OK
2026-05-29T09:18:26.503646Z 00E 2026-05-29T09:17:56.890944003Z Certificate request self-signature ok
2026-05-29T09:18:26.503647Z 00E 2026-05-29T09:17:56.890968268Z subject=CN=docker:dind client
2026-05-29T09:18:26.503648Z 00E 2026-05-29T09:17:56.910367492Z /certs/client/cert.pem: OK
2026-05-29T09:18:26.503649Z 00E 2026-05-29T09:17:56.915341001Z cat: can't open '/proc/net/ip6_tables_names': No such file or directory
2026-05-29T09:18:26.503650Z 00E 2026-05-29T09:17:56.916217864Z cat: can't open '/proc/net/arp_tables_names': No such file or directory
2026-05-29T09:18:26.503651Z 00E 2026-05-29T09:17:56.919772827Z ip: can't find device 'nf_tables'
2026-05-29T09:18:26.503652Z 00E 2026-05-29T09:17:56.920896296Z nf_tables             376832 4318 nft_chain_nat,nft_compat
2026-05-29T09:18:26.503653Z 00E 2026-05-29T09:17:56.921057422Z nfnetlink              20480  7 nf_conntrack_netlink,ip_set,nft_compat,nf_tables
2026-05-29T09:18:26.503654Z 00E 2026-05-29T09:17:56.921067889Z libcrc32c              12288  5 nf_nat,nf_conntrack,nf_tables,btrfs,raid456
2026-05-29T09:18:26.503655Z 00E 2026-05-29T09:17:56.921659752Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-05-29T09:18:26.503657Z 00E 2026-05-29T09:17:56.924351741Z ip: can't find device 'ip_tables'
2026-05-29T09:18:26.503657Z 00E 2026-05-29T09:17:56.925534805Z ip_tables              32768  0 
2026-05-29T09:18:26.503658Z 00E 2026-05-29T09:17:56.925589413Z x_tables               65536  8 xt_nat,xt_tcpudp,xt_conntrack,xt_MASQUERADE,xt_set,xt_addrtype,nft_compat,ip_tables
2026-05-29T09:18:26.503660Z 00E 2026-05-29T09:17:56.926163930Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-05-29T09:18:26.503661Z 00E 2026-05-29T09:17:56.928463314Z ip: can't find device 'ip6_tables'
2026-05-29T09:18:26.503662Z 00E 2026-05-29T09:17:56.930419489Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-05-29T09:18:26.503663Z 00E 2026-05-29T09:17:56.932587917Z iptables v1.8.11 (nf_tables)
2026-05-29T09:18:26.503664Z 00E 2026-05-29T09:17:56.936639022Z mount: permission denied (are you root?)
2026-05-29T09:18:26.503665Z 00E 2026-05-29T09:17:56.936731208Z Could not mount /sys/kernel/security.
2026-05-29T09:18:26.503699Z 00E 2026-05-29T09:17:56.936739310Z AppArmor detection and --privileged mode might break.
2026-05-29T09:18:26.503700Z 00E 2026-05-29T09:17:56.938376303Z mount: permission denied (are you root?)
2026-05-29T09:18:26.503701Z 00E 
2026-05-29T09:18:26.503702Z 00E *********
2026-05-29T09:18:26.503703Z 00E 
2026-05-29T09:18:26.523376Z 00O Using effective pull policy of [always] for container docker:cli
2026-05-29T09:18:26.569412Z 00O Pulling docker image docker:cli ...
2026-05-29T09:18:28.514828Z 00O Using docker image sha256:9ba8e32bfc35a2c7ae2feb1e3241b2778ae21dee80f4dcd31d04e1cfdea86ea2 for docker:cli with digest docker@sha256:9ba8e32bfc35a2c7ae2feb1e3241b2778ae21dee80f4dcd31d04e1cfdea86ea2 ...
2026-05-29T09:18:28.514849Z 00O section_end:1780046308:prepare_executor
2026-05-29T09:18:28.514852Z 00O+section_start:1780046308:prepare_script
2026-05-29T09:18:28.515097Z 00O+Preparing environment
2026-05-29T09:18:28.539574Z 00O Using effective pull policy of [always] for container sha256:ac0f843d45047cc02cea2f6379f3c6f47aac077acc85bba0527ddc1e0b7773ba
2026-05-29T09:18:28.782560Z 01O Running on runner-ee6nehn34-project-243-concurrent-0 via 0ea095f01732...
2026-05-29T09:18:28.926847Z 00O section_end:1780046308:prepare_script
2026-05-29T09:18:28.926855Z 00O+section_start:1780046308:get_sources
2026-05-29T09:18:28.928212Z 00O+Getting source from Git repository
2026-05-29T09:18:29.233931Z 01O Gitaly correlation ID: 01KSSGD4DVMHBPJQ8TEWSS1A65
2026-05-29T09:18:29.242259Z 01O Fetching changes with git depth set to 20...
2026-05-29T09:18:29.245910Z 01O Reinitialized existing Git repository in /builds/kisulkens/platforms/air/services/backend/.git/
2026-05-29T09:18:29.249983Z 01O Created fresh repository.
2026-05-29T09:18:30.020305Z 01O Checking out ebb6bd5e as detached HEAD (ref is staging)...
2026-05-29T09:18:30.040267Z 01O Removing .env
2026-05-29T09:18:30.096979Z 01O 
2026-05-29T09:18:30.097008Z 01O Skipping Git submodules setup
2026-05-29T09:18:30.256368Z 00O section_end:1780046310:get_sources
2026-05-29T09:18:30.256378Z 00O+section_start:1780046310:step_script
2026-05-29T09:18:30.262268Z 00O+Executing "step_script" stage of the job script
2026-05-29T09:18:30.262320Z 00O Using effective pull policy of [always] for container docker:cli
2026-05-29T09:18:30.331960Z 00O Using docker image sha256:9ba8e32bfc35a2c7ae2feb1e3241b2778ae21dee80f4dcd31d04e1cfdea86ea2 for docker:cli with digest docker@sha256:9ba8e32bfc35a2c7ae2feb1e3241b2778ae21dee80f4dcd31d04e1cfdea86ea2 ...
2026-05-29T09:18:30.631242Z 01O $ mkdir -p $DOCKER_CERT_PATH
2026-05-29T09:18:30.632261Z 01O $ export ENVNAME=$(echo ${ENVIRONMENT} | tr '[:lower:]' '[:upper:]')
2026-05-29T09:18:30.633720Z 01O $ export DOCKER_HOST="tcp://$(printenv "${ENVNAME}_CLUSTER_HOST"):2376"
2026-05-29T09:18:30.634509Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CA)" $DOCKER_CERT_PATH/ca.pem
2026-05-29T09:18:30.636934Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CERT)" $DOCKER_CERT_PATH/cert.pem
2026-05-29T09:18:30.638859Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_KEY)" $DOCKER_CERT_PATH/key.pem
2026-05-29T09:18:30.640472Z 01O $ echo "$CI_REGISTRY_PASSWORD" | docker login -u "$CI_REGISTRY_USER" $CI_REGISTRY --password-stdin
2026-05-29T09:18:31.275534Z 01O Login Succeeded
2026-05-29T09:18:31.275566Z 01E 
2026-05-29T09:18:31.275569Z 01E WARNING! Your credentials are stored unencrypted in '/root/.docker/config.json'.
2026-05-29T09:18:31.275573Z 01E Configure a credential helper to remove this warning. See
2026-05-29T09:18:31.275577Z 01E https://docs.docker.com/go/credential-store/
2026-05-29T09:18:31.275580Z 01E 
2026-05-29T09:18:31.278240Z 01O $ export RELEASE=$(echo -n $(date '+%D %X') | md5sum | awk '{print $1}')
2026-05-29T09:18:31.281104Z 01O $ if [ "$(docker info --format '{{.Swarm.LocalNodeState}}' 2>/dev/null)" = "active" ]; then docker stack deploy --prune --with-registry-auth -c <(docker compose config | grep -v "^name:") $COMPOSE_PROJECT_NAME; else docker compose up -d; fi
2026-05-29T09:18:31.811668Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ebb6bd5e3b14c2756e261f3ac9d5515f1117d43d Pulling 
2026-05-29T09:18:31.811680Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ebb6bd5e3b14c2756e261f3ac9d5515f1117d43d Pulling 
2026-05-29T09:18:31.811683Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ebb6bd5e3b14c2756e261f3ac9d5515f1117d43d Pulling 
2026-05-29T09:18:31.811707Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ebb6bd5e3b14c2756e261f3ac9d5515f1117d43d Pulling 
2026-05-29T09:18:32.436003Z 01E  5b4d6ff92fc4 Already exists 0B
2026-05-29T09:18:32.438935Z 01E  4a9dde5cdde1 Already exists 0B
2026-05-29T09:18:32.441846Z 01E  e113665b194b Already exists 0B
2026-05-29T09:18:32.443951Z 01E  07342fe545e6 Already exists 0B
2026-05-29T09:18:32.450984Z 01E  303545c476cc Already exists 0B
2026-05-29T09:18:32.455024Z 01E  64f12c917a33 Already exists 0B
2026-05-29T09:18:32.459386Z 01E  47f07dd99e3d Already exists 0B
2026-05-29T09:18:32.461716Z 01E  a40fd3512261 Already exists 0B
2026-05-29T09:18:32.464164Z 01E  fec7ef7b978c Pulling fs layer 0B
2026-05-29T09:18:32.653999Z 01E  5b4d6ff92fc4 Already exists 0B
2026-05-29T09:18:32.658586Z 01E  4a9dde5cdde1 Already exists 0B
2026-05-29T09:18:32.661363Z 01E  e113665b194b Already exists 0B
2026-05-29T09:18:32.663813Z 01E  07342fe545e6 Already exists 0B
2026-05-29T09:18:32.663938Z 01E  5b4d6ff92fc4 Already exists 0B
2026-05-29T09:18:32.666143Z 01E  fec7ef7b978c Downloading 46.47kB
2026-05-29T09:18:32.668929Z 01E  303545c476cc Already exists 0B
2026-05-29T09:18:32.673223Z 01E  4a9dde5cdde1 Already exists 0B
2026-05-29T09:18:32.677809Z 01E  e113665b194b Already exists 0B
2026-05-29T09:18:32.679142Z 01E  64f12c917a33 Already exists 0B
2026-05-29T09:18:32.683205Z 01E  07342fe545e6 Already exists 0B
2026-05-29T09:18:32.688022Z 01E  303545c476cc Already exists 0B
2026-05-29T09:18:32.688030Z 01E  47f07dd99e3d Already exists 0B
2026-05-29T09:18:32.692071Z 01E  64f12c917a33 Already exists 0B
2026-05-29T09:18:32.693912Z 01E  a40fd3512261 Already exists 0B
2026-05-29T09:18:32.699666Z 01E  fec7ef7b978c Pulling fs layer 0B
2026-05-29T09:18:32.699712Z 01E  fec7ef7b978c Downloading 46.47kB
2026-05-29T09:18:32.700738Z 01E  47f07dd99e3d Already exists 0B
2026-05-29T09:18:32.704146Z 01E  a40fd3512261 Already exists 0B
2026-05-29T09:18:32.706056Z 01E  fec7ef7b978c Pulling fs layer 0B
2026-05-29T09:18:32.706061Z 01E  fec7ef7b978c Downloading 46.47kB
2026-05-29T09:18:32.752220Z 01E  5b4d6ff92fc4 Already exists 0B
2026-05-29T09:18:32.755129Z 01E  4a9dde5cdde1 Already exists 0B
2026-05-29T09:18:32.757967Z 01E  e113665b194b Already exists 0B
2026-05-29T09:18:32.759683Z 01E  07342fe545e6 Already exists 0B
2026-05-29T09:18:32.762513Z 01E  303545c476cc Already exists 0B
2026-05-29T09:18:32.765685Z 01E  64f12c917a33 Already exists 0B
2026-05-29T09:18:32.768025Z 01E  fec7ef7b978c Downloading 973.2kB
2026-05-29T09:18:32.768031Z 01E  fec7ef7b978c Downloading 973.2kB
2026-05-29T09:18:32.768369Z 01E  fec7ef7b978c Downloading 973.2kB
2026-05-29T09:18:32.768996Z 01E  47f07dd99e3d Already exists 0B
2026-05-29T09:18:32.776098Z 01E  a40fd3512261 Already exists 0B
2026-05-29T09:18:32.779337Z 01E  fec7ef7b978c Pulling fs layer 0B
2026-05-29T09:18:32.779400Z 01E  fec7ef7b978c Downloading 973.2kB
2026-05-29T09:18:32.881988Z 01E  fec7ef7b978c Downloading 1.858MB
2026-05-29T09:18:32.882010Z 01E  fec7ef7b978c Downloading 1.858MB
2026-05-29T09:18:32.882012Z 01E  fec7ef7b978c Downloading 1.858MB
2026-05-29T09:18:32.882537Z 01E  fec7ef7b978c Downloading 1.858MB
2026-05-29T09:18:32.984817Z 01E  fec7ef7b978c Downloading 3.48MB
2026-05-29T09:18:32.984825Z 01E  fec7ef7b978c Downloading 3.48MB
2026-05-29T09:18:32.985016Z 01E  fec7ef7b978c Downloading 3.48MB
2026-05-29T09:18:32.985188Z 01E  fec7ef7b978c Downloading 3.48MB
2026-05-29T09:18:33.040489Z 01E  fec7ef7b978c Verifying Checksum 0B
2026-05-29T09:18:33.040496Z 01E  fec7ef7b978c Verifying Checksum 0B
2026-05-29T09:18:33.040499Z 01E  fec7ef7b978c Download complete 0B
2026-05-29T09:18:33.040518Z 01E  fec7ef7b978c Verifying Checksum 0B
2026-05-29T09:18:33.040520Z 01E  fec7ef7b978c Download complete 0B
2026-05-29T09:18:33.040525Z 01E  fec7ef7b978c Download complete 0B
2026-05-29T09:18:33.040677Z 01E  fec7ef7b978c Download complete 0B
2026-05-29T09:18:33.042484Z 01E  fec7ef7b978c Extracting 65.54kB
2026-05-29T09:18:33.042489Z 01E  fec7ef7b978c Extracting 65.54kB
2026-05-29T09:18:33.042500Z 01E  fec7ef7b978c Extracting 65.54kB
2026-05-29T09:18:33.042503Z 01E  fec7ef7b978c Extracting 65.54kB
2026-05-29T09:18:33.145933Z 01E  fec7ef7b978c Extracting 917.5kB
2026-05-29T09:18:33.145942Z 01E  fec7ef7b978c Extracting 917.5kB
2026-05-29T09:18:33.145944Z 01E  fec7ef7b978c Extracting 917.5kB
2026-05-29T09:18:33.145983Z 01E  fec7ef7b978c Extracting 917.5kB
2026-05-29T09:18:33.246859Z 01E  fec7ef7b978c Extracting 2.884MB
2026-05-29T09:18:33.246866Z 01E  fec7ef7b978c Extracting 2.884MB
2026-05-29T09:18:33.246904Z 01E  fec7ef7b978c Extracting 2.884MB
2026-05-29T09:18:33.246919Z 01E  fec7ef7b978c Extracting 2.884MB
2026-05-29T09:18:33.356493Z 01E  fec7ef7b978c Extracting 4.129MB
2026-05-29T09:18:33.356501Z 01E  fec7ef7b978c Extracting 4.129MB
2026-05-29T09:18:33.356503Z 01E  fec7ef7b978c Extracting 4.129MB
2026-05-29T09:18:33.356505Z 01E  fec7ef7b978c Extracting 4.129MB
2026-05-29T09:18:33.368585Z 01E  fec7ef7b978c Extracting 4.134MB
2026-05-29T09:18:33.368590Z 01E  fec7ef7b978c Extracting 4.134MB
2026-05-29T09:18:33.368697Z 01E  fec7ef7b978c Extracting 4.134MB
2026-05-29T09:18:33.368700Z 01E  fec7ef7b978c Extracting 4.134MB
2026-05-29T09:18:33.412037Z 01E  fec7ef7b978c Pull complete 0B
2026-05-29T09:18:33.412043Z 01E  fec7ef7b978c Pull complete 0B
2026-05-29T09:18:33.412045Z 01E  fec7ef7b978c Pull complete 0B
2026-05-29T09:18:33.412046Z 01E  fec7ef7b978c Pull complete 0B
2026-05-29T09:18:33.443013Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ebb6bd5e3b14c2756e261f3ac9d5515f1117d43d Pulled 
2026-05-29T09:18:33.443899Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ebb6bd5e3b14c2756e261f3ac9d5515f1117d43d Pulled 
2026-05-29T09:18:33.444673Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ebb6bd5e3b14c2756e261f3ac9d5515f1117d43d Pulled 
2026-05-29T09:18:33.445393Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:ebb6bd5e3b14c2756e261f3ac9d5515f1117d43d Pulled 
2026-05-29T09:18:33.543830Z 01E  Container backend-channels-mdb-1 Running 
2026-05-29T09:18:33.543844Z 01E  Container backend-cache-mdb-1 Running 
2026-05-29T09:18:33.543859Z 01E  Container backend-celery-1 Recreate 
2026-05-29T09:18:33.543918Z 01E  Container backend-celery-mdb-1 Running 
2026-05-29T09:18:33.543943Z 01E  Container backend-housekeeper-1 Recreate 
2026-05-29T09:18:33.543947Z 01E  Container backend-static-server-1 Running 
2026-05-29T09:18:33.543965Z 01E  Container backend-celery-beat-1 Recreate 
2026-05-29T09:18:33.544051Z 01E  Container backend-app-1 Recreate 
2026-05-29T09:18:33.895862Z 01E  Container backend-housekeeper-1 Recreated 
2026-05-29T09:18:35.360691Z 01E  Container backend-celery-beat-1 Recreated 
2026-05-29T09:18:37.647573Z 01E  Container backend-celery-1 Recreated 
2026-05-29T09:18:44.369343Z 01E  Container backend-app-1 Recreated 
2026-05-29T09:18:44.400830Z 01E  Container backend-app-1 Starting 
2026-05-29T09:18:44.400839Z 01E  Container backend-celery-beat-1 Starting 
2026-05-29T09:18:44.400841Z 01E  Container backend-housekeeper-1 Starting 
2026-05-29T09:18:44.400855Z 01E  Container backend-celery-1 Starting 
2026-05-29T09:18:44.736006Z 01E  Container backend-celery-beat-1 Started 
2026-05-29T09:18:44.958458Z 01E  Container backend-housekeeper-1 Started 
2026-05-29T09:18:45.092340Z 01E  Container backend-app-1 Started 
2026-05-29T09:18:45.109610Z 01E  Container backend-celery-1 Started 
2026-05-29T09:18:45.320522Z 00O section_end:1780046325:step_script
2026-05-29T09:18:45.320535Z 00O+section_start:1780046325:cleanup_file_variables
2026-05-29T09:18:45.324923Z 00O+Cleaning up project directory and file based variables
2026-05-29T09:18:45.720729Z 00O section_end:1780046325:cleanup_file_variables
2026-05-29T09:18:45.720741Z 00O+
2026-05-29T09:18:45.828281Z 00O Job succeeded