2026-04-19T23:11:56.964720Z 00O Running with gitlab-runner 18.9.0 (07e534ba)
2026-04-19T23:11:56.964757Z 00O   on ba0d40dbec6d ee6NEhN34, system ID: r_LuGAIt6mmQ0P
2026-04-19T23:11:56.964816Z 00O Resolving secrets
2026-04-19T23:11:56.965133Z 00O section_start:1776640316:prepare_executor
2026-04-19T23:11:56.965137Z 00O+Preparing the "docker" executor
2026-04-19T23:11:56.992640Z 00O Using Docker executor with image docker:cli ...
2026-04-19T23:11:58.033071Z 00O Starting service docker:dind...
2026-04-19T23:11:58.033097Z 00O Using effective pull policy of [always] for container docker:dind
2026-04-19T23:11:58.111106Z 00O Pulling docker image docker:dind ...
2026-04-19T23:11:59.530949Z 00O Using docker image sha256:a6dd5322747a95cd8e3207bd8d415a8fd20ec34e9c00f06dc019cbd912013489 for docker:dind with digest docker@sha256:a6dd5322747a95cd8e3207bd8d415a8fd20ec34e9c00f06dc019cbd912013489 ...
2026-04-19T23:11:59.777148Z 00O Waiting for services to be up and running (timeout 30 seconds)...
2026-04-19T23:12:31.343442Z 00E 
2026-04-19T23:12:31.343452Z 00E *** WARNING: Service runner-ee6nehn34-project-243-concurrent-0-bbb1144f4a364242-docker-0 probably didn't start properly.
2026-04-19T23:12:31.343455Z 00E 
2026-04-19T23:12:31.343457Z 00E Health check error:
2026-04-19T23:12:31.343459Z 00E service "runner-ee6nehn34-project-243-concurrent-0-bbb1144f4a364242-docker-0-wait-for-service" timeout
2026-04-19T23:12:31.343461Z 00E 
2026-04-19T23:12:31.343462Z 00E Health check container logs:
2026-04-19T23:12:31.343464Z 00E 2026-04-19T23:12:00.155873750Z waiting for TCP connection to d0f01327238d on [2375 2376]...
2026-04-19T23:12:31.343466Z 00E 2026-04-19T23:12:00.155933414Z dialing d0f01327238d:2376...
2026-04-19T23:12:31.343468Z 00E 2026-04-19T23:12:00.155942851Z dialing d0f01327238d:2375...
2026-04-19T23:12:31.343470Z 00E 2026-04-19T23:12:01.156546924Z dialing d0f01327238d:2375...
2026-04-19T23:12:31.343471Z 00E 2026-04-19T23:12:01.156653525Z dialing d0f01327238d:2376...
2026-04-19T23:12:31.343473Z 00E 2026-04-19T23:12:02.157042358Z dialing d0f01327238d:2375...
2026-04-19T23:12:31.343475Z 00E 2026-04-19T23:12:02.157073706Z dialing d0f01327238d:2376...
2026-04-19T23:12:31.343477Z 00E 2026-04-19T23:12:03.157802904Z dialing d0f01327238d:2375...
2026-04-19T23:12:31.343478Z 00E 2026-04-19T23:12:03.157848928Z dialing d0f01327238d:2376...
2026-04-19T23:12:31.343480Z 00E 
2026-04-19T23:12:31.343481Z 00E Service container logs:
2026-04-19T23:12:31.343483Z 00E 2026-04-19T23:12:02.582836813Z Certificate request self-signature ok
2026-04-19T23:12:31.343485Z 00E 2026-04-19T23:12:02.582874551Z subject=CN=docker:dind server
2026-04-19T23:12:31.343487Z 00E 2026-04-19T23:12:02.600792189Z /certs/server/cert.pem: OK
2026-04-19T23:12:31.343489Z 00E 2026-04-19T23:12:02.714196488Z Certificate request self-signature ok
2026-04-19T23:12:31.343490Z 00E 2026-04-19T23:12:02.714228805Z subject=CN=docker:dind client
2026-04-19T23:12:31.343492Z 00E 2026-04-19T23:12:02.734936340Z /certs/client/cert.pem: OK
2026-04-19T23:12:31.343494Z 00E 2026-04-19T23:12:02.740092901Z cat: can't open '/proc/net/ip6_tables_names': No such file or directory
2026-04-19T23:12:31.343496Z 00E 2026-04-19T23:12:02.741188237Z cat: can't open '/proc/net/arp_tables_names': No such file or directory
2026-04-19T23:12:31.343498Z 00E 2026-04-19T23:12:02.745247906Z ip: can't find device 'nf_tables'
2026-04-19T23:12:31.343500Z 00E 2026-04-19T23:12:02.746973104Z nf_tables             376832 4063 nft_chain_nat,nft_compat
2026-04-19T23:12:31.343502Z 00E 2026-04-19T23:12:02.747220445Z nfnetlink              20480  7 nf_conntrack_netlink,ip_set,nft_compat,nf_tables
2026-04-19T23:12:31.343505Z 00E 2026-04-19T23:12:02.747233752Z libcrc32c              12288  5 nf_nat,nf_conntrack,nf_tables,btrfs,raid456
2026-04-19T23:12:31.343507Z 00E 2026-04-19T23:12:02.747893024Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-04-19T23:12:31.343509Z 00E 2026-04-19T23:12:02.751052445Z ip: can't find device 'ip_tables'
2026-04-19T23:12:31.343511Z 00E 2026-04-19T23:12:02.752619042Z ip_tables              32768  0 
2026-04-19T23:12:31.343513Z 00E 2026-04-19T23:12:02.752677797Z x_tables               65536  8 xt_nat,xt_tcpudp,xt_conntrack,xt_MASQUERADE,xt_set,xt_addrtype,nft_compat,ip_tables
2026-04-19T23:12:31.343515Z 00E 2026-04-19T23:12:02.753309382Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-04-19T23:12:31.343518Z 00E 2026-04-19T23:12:02.754896979Z ip: can't find device 'ip6_tables'
2026-04-19T23:12:31.343519Z 00E 2026-04-19T23:12:02.756843009Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-04-19T23:12:31.343522Z 00E 2026-04-19T23:12:02.759110175Z iptables v1.8.11 (nf_tables)
2026-04-19T23:12:31.343524Z 00E 2026-04-19T23:12:02.762670183Z mount: permission denied (are you root?)
2026-04-19T23:12:31.343525Z 00E 2026-04-19T23:12:02.762742758Z Could not mount /sys/kernel/security.
2026-04-19T23:12:31.343527Z 00E 2026-04-19T23:12:02.762751371Z AppArmor detection and --privileged mode might break.
2026-04-19T23:12:31.343620Z 00E 2026-04-19T23:12:02.764340119Z mount: permission denied (are you root?)
2026-04-19T23:12:31.343623Z 00E 
2026-04-19T23:12:31.343625Z 00E *********
2026-04-19T23:12:31.343626Z 00E 
2026-04-19T23:12:31.377912Z 00O Using effective pull policy of [always] for container docker:cli
2026-04-19T23:12:31.443205Z 00O Pulling docker image docker:cli ...
2026-04-19T23:12:32.771481Z 00O Using docker image sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 for docker:cli with digest docker@sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 ...
2026-04-19T23:12:32.771501Z 00O section_end:1776640352:prepare_executor
2026-04-19T23:12:32.771503Z 00O+section_start:1776640352:prepare_script
2026-04-19T23:12:32.771723Z 00O+Preparing environment
2026-04-19T23:12:32.799084Z 00O Using effective pull policy of [always] for container sha256:8759a73e613f7d952d78a5c4cb758a1d0c60dbb2e311c0ce19861809907251a2
2026-04-19T23:12:33.070003Z 01O Running on runner-ee6nehn34-project-243-concurrent-0 via ba0d40dbec6d...
2026-04-19T23:12:33.208623Z 00O section_end:1776640353:prepare_script
2026-04-19T23:12:33.208631Z 00O+section_start:1776640353:get_sources
2026-04-19T23:12:33.210182Z 00O+Getting source from Git repository
2026-04-19T23:12:33.519157Z 01O Gitaly correlation ID: 01KPM07MYBQC54CC6TGE0PCJWV
2026-04-19T23:12:33.529144Z 01O Fetching changes with git depth set to 20...
2026-04-19T23:12:33.532977Z 01O Reinitialized existing Git repository in /builds/kisulkens/platforms/air/services/backend/.git/
2026-04-19T23:12:33.536236Z 01O Created fresh repository.
2026-04-19T23:12:34.326890Z 01O Checking out f7a89280 as detached HEAD (ref is staging)...
2026-04-19T23:12:34.338657Z 01O Removing .env
2026-04-19T23:12:34.397661Z 01O 
2026-04-19T23:12:34.397671Z 01O Skipping Git submodules setup
2026-04-19T23:12:34.565271Z 00O section_end:1776640354:get_sources
2026-04-19T23:12:34.565281Z 00O+section_start:1776640354:step_script
2026-04-19T23:12:34.569673Z 00O+Executing "step_script" stage of the job script
2026-04-19T23:12:34.569723Z 00O Using effective pull policy of [always] for container docker:cli
2026-04-19T23:12:34.642033Z 00O Using docker image sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 for docker:cli with digest docker@sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 ...
2026-04-19T23:12:34.930279Z 01O $ mkdir -p $DOCKER_CERT_PATH
2026-04-19T23:12:34.931057Z 01O $ export ENVNAME=$(echo ${ENVIRONMENT} | tr '[:lower:]' '[:upper:]')
2026-04-19T23:12:34.932324Z 01O $ export DOCKER_HOST="tcp://$(printenv "${ENVNAME}_CLUSTER_HOST"):2376"
2026-04-19T23:12:34.933309Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CA)" $DOCKER_CERT_PATH/ca.pem
2026-04-19T23:12:34.936130Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CERT)" $DOCKER_CERT_PATH/cert.pem
2026-04-19T23:12:34.937946Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_KEY)" $DOCKER_CERT_PATH/key.pem
2026-04-19T23:12:34.939412Z 01O $ echo "$CI_REGISTRY_PASSWORD" | docker login -u "$CI_REGISTRY_USER" $CI_REGISTRY --password-stdin
2026-04-19T23:12:35.455765Z 01O Login Succeeded
2026-04-19T23:12:35.455808Z 01E 
2026-04-19T23:12:35.455811Z 01E WARNING! Your credentials are stored unencrypted in '/root/.docker/config.json'.
2026-04-19T23:12:35.455816Z 01E Configure a credential helper to remove this warning. See
2026-04-19T23:12:35.455820Z 01E https://docs.docker.com/go/credential-store/
2026-04-19T23:12:35.455823Z 01E 
2026-04-19T23:12:35.458867Z 01O $ export RELEASE=$(echo -n $(date '+%D %X') | md5sum | awk '{print $1}')
2026-04-19T23:12:35.461494Z 01O $ if [ "$(docker info --format '{{.Swarm.LocalNodeState}}' 2>/dev/null)" = "active" ]; then docker stack deploy --prune --with-registry-auth -c stack.yml $COMPOSE_PROJECT_NAME; else docker compose up -d; fi
2026-04-19T23:12:35.877920Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:f7a89280434621e1d0ca59962c3cef2f36c0a81d Pulling 
2026-04-19T23:12:35.877934Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:f7a89280434621e1d0ca59962c3cef2f36c0a81d Pulling 
2026-04-19T23:12:35.877937Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:f7a89280434621e1d0ca59962c3cef2f36c0a81d Pulling 
2026-04-19T23:12:35.877939Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:f7a89280434621e1d0ca59962c3cef2f36c0a81d Pulling 
2026-04-19T23:12:36.891232Z 01E  5435b2dcdf5c Already exists 0B
2026-04-19T23:12:36.893961Z 01E  25981ed25cff Already exists 0B
2026-04-19T23:12:36.895980Z 01E  d4c207a1ca27 Already exists 0B
2026-04-19T23:12:36.898297Z 01E  f0bdb572205e Already exists 0B
2026-04-19T23:12:36.901740Z 01E  858f8a9a658f Already exists 0B
2026-04-19T23:12:36.904639Z 01E  d5cc1e7f820a Already exists 0B
2026-04-19T23:12:36.906885Z 01E  a6231aab7c0d Already exists 0B
2026-04-19T23:12:36.909275Z 01E  19b77d7c1eb5 Already exists 0B
2026-04-19T23:12:36.911430Z 01E  e2c9797f7951 Pulling fs layer 0B
2026-04-19T23:12:37.095488Z 01E  e2c9797f7951 Downloading 13.78kB
2026-04-19T23:12:37.124928Z 01E  5435b2dcdf5c Already exists 0B
2026-04-19T23:12:37.128253Z 01E  25981ed25cff Already exists 0B
2026-04-19T23:12:37.131106Z 01E  d4c207a1ca27 Already exists 0B
2026-04-19T23:12:37.137085Z 01E  f0bdb572205e Already exists 0B
2026-04-19T23:12:37.142948Z 01E  5435b2dcdf5c Already exists 0B
2026-04-19T23:12:37.143035Z 01E  858f8a9a658f Already exists 0B
2026-04-19T23:12:37.144394Z 01E  25981ed25cff Already exists 0B
2026-04-19T23:12:37.147310Z 01E  d4c207a1ca27 Already exists 0B
2026-04-19T23:12:37.148145Z 01E  d5cc1e7f820a Already exists 0B
2026-04-19T23:12:37.150365Z 01E  a6231aab7c0d Already exists 0B
2026-04-19T23:12:37.154159Z 01E  19b77d7c1eb5 Already exists 0B
2026-04-19T23:12:37.154165Z 01E  f0bdb572205e Already exists 0B
2026-04-19T23:12:37.155826Z 01E  e2c9797f7951 Pulling fs layer 0B
2026-04-19T23:12:37.155834Z 01E  e2c9797f7951 Downloading 13.78kB
2026-04-19T23:12:37.157248Z 01E  858f8a9a658f Already exists 0B
2026-04-19T23:12:37.159597Z 01E  d5cc1e7f820a Already exists 0B
2026-04-19T23:12:37.161950Z 01E  a6231aab7c0d Already exists 0B
2026-04-19T23:12:37.163661Z 01E  19b77d7c1eb5 Already exists 0B
2026-04-19T23:12:37.165084Z 01E  e2c9797f7951 Pulling fs layer 0B
2026-04-19T23:12:37.165217Z 01E  e2c9797f7951 Downloading 13.78kB
2026-04-19T23:12:37.196201Z 01E  e2c9797f7951 Downloading 855.7kB
2026-04-19T23:12:37.196209Z 01E  e2c9797f7951 Downloading 855.7kB
2026-04-19T23:12:37.196659Z 01E  e2c9797f7951 Downloading 855.7kB
2026-04-19T23:12:37.214897Z 01E  e2c9797f7951 Verifying Checksum 0B
2026-04-19T23:12:37.214905Z 01E  e2c9797f7951 Downloading 1.082MB
2026-04-19T23:12:37.214907Z 01E  e2c9797f7951 Download complete 0B
2026-04-19T23:12:37.214908Z 01E  e2c9797f7951 Verifying Checksum 0B
2026-04-19T23:12:37.214910Z 01E  e2c9797f7951 Download complete 0B
2026-04-19T23:12:37.214912Z 01E  e2c9797f7951 Extracting 32.77kB
2026-04-19T23:12:37.214913Z 01E  e2c9797f7951 Verifying Checksum 0B
2026-04-19T23:12:37.214922Z 01E  e2c9797f7951 Download complete 0B
2026-04-19T23:12:37.214924Z 01E  e2c9797f7951 Extracting 32.77kB
2026-04-19T23:12:37.214925Z 01E  e2c9797f7951 Extracting 32.77kB
2026-04-19T23:12:37.315838Z 01E  e2c9797f7951 Extracting 1.081MB
2026-04-19T23:12:37.315857Z 01E  e2c9797f7951 Extracting 1.081MB
2026-04-19T23:12:37.315873Z 01E  e2c9797f7951 Extracting 1.081MB
2026-04-19T23:12:37.324174Z 01E  e2c9797f7951 Extracting 1.082MB
2026-04-19T23:12:37.324179Z 01E  e2c9797f7951 Extracting 1.082MB
2026-04-19T23:12:37.324180Z 01E  e2c9797f7951 Extracting 1.082MB
2026-04-19T23:12:37.346547Z 01E  5435b2dcdf5c Already exists 0B
2026-04-19T23:12:37.346552Z 01E  25981ed25cff Already exists 0B
2026-04-19T23:12:37.346554Z 01E  d4c207a1ca27 Already exists 0B
2026-04-19T23:12:37.346555Z 01E  f0bdb572205e Already exists 0B
2026-04-19T23:12:37.360950Z 01E  858f8a9a658f Already exists 0B
2026-04-19T23:12:37.360956Z 01E  d5cc1e7f820a Already exists 0B
2026-04-19T23:12:37.360958Z 01E  a6231aab7c0d Already exists 0B
2026-04-19T23:12:37.360959Z 01E  19b77d7c1eb5 Already exists 0B
2026-04-19T23:12:37.360961Z 01E  e2c9797f7951 Pulling fs layer 0B
2026-04-19T23:12:37.360968Z 01E  e2c9797f7951 Extracting 1.082MB
2026-04-19T23:12:37.367138Z 01E  e2c9797f7951 Pull complete 0B
2026-04-19T23:12:37.367142Z 01E  e2c9797f7951 Pull complete 0B
2026-04-19T23:12:37.367144Z 01E  e2c9797f7951 Pull complete 0B
2026-04-19T23:12:37.367150Z 01E  e2c9797f7951 Pull complete 0B
2026-04-19T23:12:37.380851Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:f7a89280434621e1d0ca59962c3cef2f36c0a81d Pulled 
2026-04-19T23:12:37.380859Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:f7a89280434621e1d0ca59962c3cef2f36c0a81d Pulled 
2026-04-19T23:12:37.381060Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:f7a89280434621e1d0ca59962c3cef2f36c0a81d Pulled 
2026-04-19T23:12:37.508481Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:f7a89280434621e1d0ca59962c3cef2f36c0a81d Pulled 
2026-04-19T23:12:37.629623Z 01E  Container backend-celery_beat-1 Stopping 
2026-04-19T23:12:38.847309Z 01E  Container backend-celery_beat-1 Stopped 
2026-04-19T23:12:38.847322Z 01E  Container backend-celery_beat-1 Removing 
2026-04-19T23:12:38.894080Z 01E  Container backend-celery_beat-1 Removed 
2026-04-19T23:12:38.894242Z 01E  Container backend-celery-beat-1 Creating 
2026-04-19T23:12:38.895510Z 01E  Container backend-cache-mdb-1 Running 
2026-04-19T23:12:38.895520Z 01E  Container backend-celery-1 Recreate 
2026-04-19T23:12:38.895524Z 01E  Container backend-static-server-1 Recreate 
2026-04-19T23:12:38.895597Z 01E  Container backend-channels-mdb-1 Running 
2026-04-19T23:12:38.896700Z 01E  Container backend-celery-mdb-1 Running 
2026-04-19T23:12:38.896776Z 01E  Container backend-housekeeper-1 Recreate 
2026-04-19T23:12:38.896849Z 01E  Container backend-app-1 Recreate 
2026-04-19T23:12:39.158328Z 01E  Container backend-celery-1 Recreated 
2026-04-19T23:12:39.167119Z 01E  Container backend-celery-beat-1 Created 
2026-04-19T23:12:39.179788Z 01E  Container backend-housekeeper-1 Recreated 
2026-04-19T23:12:39.383915Z 01E  Container backend-static-server-1 Recreated 
2026-04-19T23:12:49.538637Z 01E  Container backend-app-1 Recreated 
2026-04-19T23:12:49.579887Z 01E  Container backend-static-server-1 Starting 
2026-04-19T23:12:49.579897Z 01E  Container backend-housekeeper-1 Starting 
2026-04-19T23:12:49.579901Z 01E  Container backend-celery-1 Starting 
2026-04-19T23:12:49.579924Z 01E  Container backend-celery-beat-1 Starting 
2026-04-19T23:12:49.580022Z 01E  Container backend-app-1 Starting 
2026-04-19T23:12:49.866301Z 01E  Container backend-housekeeper-1 Started 
2026-04-19T23:12:49.965384Z 01E  Container backend-static-server-1 Started 
2026-04-19T23:12:50.092320Z 01E  Container backend-celery-1 Started 
2026-04-19T23:12:50.147137Z 01E  Container backend-celery-beat-1 Started 
2026-04-19T23:12:50.251125Z 01E  Container backend-app-1 Started 
2026-04-19T23:12:50.434298Z 00O section_end:1776640370:step_script
2026-04-19T23:12:50.434309Z 00O+section_start:1776640370:cleanup_file_variables
2026-04-19T23:12:50.438965Z 00O+Cleaning up project directory and file based variables
2026-04-19T23:12:50.840143Z 00O section_end:1776640370:cleanup_file_variables
2026-04-19T23:12:50.840154Z 00O+
2026-04-19T23:12:50.941416Z 00O Job succeeded