2026-04-19T23:23:30.322930Z 00O Running with gitlab-runner 18.9.0 (07e534ba)
2026-04-19T23:23:30.322967Z 00O   on ba0d40dbec6d ee6NEhN34, system ID: r_LuGAIt6mmQ0P
2026-04-19T23:23:30.323029Z 00O Resolving secrets
2026-04-19T23:23:30.323610Z 00O section_start:1776641010:prepare_executor
2026-04-19T23:23:30.323618Z 00O+Preparing the "docker" executor
2026-04-19T23:23:30.349533Z 00O Using Docker executor with image docker:cli ...
2026-04-19T23:23:31.405130Z 00O Starting service docker:dind...
2026-04-19T23:23:31.405156Z 00O Using effective pull policy of [always] for container docker:dind
2026-04-19T23:23:31.483309Z 00O Pulling docker image docker:dind ...
2026-04-19T23:23:32.880190Z 00O Using docker image sha256:a6dd5322747a95cd8e3207bd8d415a8fd20ec34e9c00f06dc019cbd912013489 for docker:dind with digest docker@sha256:a6dd5322747a95cd8e3207bd8d415a8fd20ec34e9c00f06dc019cbd912013489 ...
2026-04-19T23:23:33.146705Z 00O Waiting for services to be up and running (timeout 30 seconds)...
2026-04-19T23:24:04.706629Z 00E 
2026-04-19T23:24:04.706638Z 00E *** WARNING: Service runner-ee6nehn34-project-243-concurrent-0-ca84f3836d976203-docker-0 probably didn't start properly.
2026-04-19T23:24:04.706641Z 00E 
2026-04-19T23:24:04.706643Z 00E Health check error:
2026-04-19T23:24:04.706645Z 00E service "runner-ee6nehn34-project-243-concurrent-0-ca84f3836d976203-docker-0-wait-for-service" timeout
2026-04-19T23:24:04.706647Z 00E 
2026-04-19T23:24:04.706648Z 00E Health check container logs:
2026-04-19T23:24:04.706650Z 00E 2026-04-19T23:23:33.533692626Z waiting for TCP connection to a838b15eb8c9 on [2375 2376]...
2026-04-19T23:24:04.706652Z 00E 2026-04-19T23:23:33.533750225Z dialing a838b15eb8c9:2376...
2026-04-19T23:24:04.706654Z 00E 2026-04-19T23:23:33.533771472Z dialing a838b15eb8c9:2375...
2026-04-19T23:24:04.706656Z 00E 2026-04-19T23:23:34.534481022Z dialing a838b15eb8c9:2376...
2026-04-19T23:24:04.706657Z 00E 2026-04-19T23:23:34.534520060Z dialing a838b15eb8c9:2375...
2026-04-19T23:24:04.706659Z 00E 2026-04-19T23:23:35.534989116Z dialing a838b15eb8c9:2375...
2026-04-19T23:24:04.706661Z 00E 2026-04-19T23:23:35.535033240Z dialing a838b15eb8c9:2376...
2026-04-19T23:24:04.706663Z 00E 
2026-04-19T23:24:04.706664Z 00E Service container logs:
2026-04-19T23:24:04.706666Z 00E 2026-04-19T23:23:34.200777963Z Certificate request self-signature ok
2026-04-19T23:24:04.706667Z 00E 2026-04-19T23:23:34.200832013Z subject=CN=docker:dind server
2026-04-19T23:24:04.706671Z 00E 2026-04-19T23:23:34.221678517Z /certs/server/cert.pem: OK
2026-04-19T23:24:04.706674Z 00E 2026-04-19T23:23:34.930757635Z Certificate request self-signature ok
2026-04-19T23:24:04.706677Z 00E 2026-04-19T23:23:34.930794007Z subject=CN=docker:dind client
2026-04-19T23:24:04.706681Z 00E 2026-04-19T23:23:34.949339464Z /certs/client/cert.pem: OK
2026-04-19T23:24:04.706684Z 00E 2026-04-19T23:23:34.954328632Z cat: can't open '/proc/net/ip6_tables_names': No such file or directory
2026-04-19T23:24:04.706688Z 00E 2026-04-19T23:23:34.955619784Z cat: can't open '/proc/net/arp_tables_names': No such file or directory
2026-04-19T23:24:04.706692Z 00E 2026-04-19T23:23:34.959081649Z ip: can't find device 'nf_tables'
2026-04-19T23:24:04.706696Z 00E 2026-04-19T23:23:34.960185580Z nf_tables             376832 4063 nft_chain_nat,nft_compat
2026-04-19T23:24:04.706700Z 00E 2026-04-19T23:23:34.960368706Z nfnetlink              20480  7 nf_conntrack_netlink,ip_set,nft_compat,nf_tables
2026-04-19T23:24:04.706705Z 00E 2026-04-19T23:23:34.960382103Z libcrc32c              12288  5 nf_nat,nf_conntrack,nf_tables,btrfs,raid456
2026-04-19T23:24:04.706708Z 00E 2026-04-19T23:23:34.961044413Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-04-19T23:24:04.706711Z 00E 2026-04-19T23:23:34.964456922Z ip: can't find device 'ip_tables'
2026-04-19T23:24:04.706712Z 00E 2026-04-19T23:23:34.965669187Z ip_tables              32768  0 
2026-04-19T23:24:04.706714Z 00E 2026-04-19T23:23:34.965738568Z x_tables               65536  8 xt_nat,xt_tcpudp,xt_conntrack,xt_MASQUERADE,xt_set,xt_addrtype,nft_compat,ip_tables
2026-04-19T23:24:04.706717Z 00E 2026-04-19T23:23:34.966362765Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-04-19T23:24:04.706719Z 00E 2026-04-19T23:23:34.968028396Z ip: can't find device 'ip6_tables'
2026-04-19T23:24:04.706721Z 00E 2026-04-19T23:23:34.970130360Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-04-19T23:24:04.706723Z 00E 2026-04-19T23:23:34.972649196Z iptables v1.8.11 (nf_tables)
2026-04-19T23:24:04.706725Z 00E 2026-04-19T23:23:34.976842707Z mount: permission denied (are you root?)
2026-04-19T23:24:04.706727Z 00E 2026-04-19T23:23:34.976993698Z Could not mount /sys/kernel/security.
2026-04-19T23:24:04.706729Z 00E 2026-04-19T23:23:34.976998704Z AppArmor detection and --privileged mode might break.
2026-04-19T23:24:04.706731Z 00E 2026-04-19T23:23:34.978658656Z mount: permission denied (are you root?)
2026-04-19T23:24:04.706733Z 00E 
2026-04-19T23:24:04.706734Z 00E *********
2026-04-19T23:24:04.706790Z 00E 
2026-04-19T23:24:04.741658Z 00O Using effective pull policy of [always] for container docker:cli
2026-04-19T23:24:04.811624Z 00O Pulling docker image docker:cli ...
2026-04-19T23:24:06.194992Z 00O Using docker image sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 for docker:cli with digest docker@sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 ...
2026-04-19T23:24:06.195015Z 00O section_end:1776641046:prepare_executor
2026-04-19T23:24:06.195018Z 00O+section_start:1776641046:prepare_script
2026-04-19T23:24:06.195236Z 00O+Preparing environment
2026-04-19T23:24:06.219348Z 00O Using effective pull policy of [always] for container sha256:8759a73e613f7d952d78a5c4cb758a1d0c60dbb2e311c0ce19861809907251a2
2026-04-19T23:24:06.467855Z 01O Running on runner-ee6nehn34-project-243-concurrent-0 via ba0d40dbec6d...
2026-04-19T23:24:06.629881Z 00O section_end:1776641046:prepare_script
2026-04-19T23:24:06.629888Z 00O+section_start:1776641046:get_sources
2026-04-19T23:24:06.630913Z 00O+Getting source from Git repository
2026-04-19T23:24:06.920922Z 01O Gitaly correlation ID: 01KPM0WT1W6W2P1RNVAFWAMQ6D
2026-04-19T23:24:06.930393Z 01O Fetching changes with git depth set to 20...
2026-04-19T23:24:06.934133Z 01O Reinitialized existing Git repository in /builds/kisulkens/platforms/air/services/backend/.git/
2026-04-19T23:24:06.937065Z 01O Created fresh repository.
2026-04-19T23:24:07.596183Z 01O Checking out 6929df71 as detached HEAD (ref is staging)...
2026-04-19T23:24:07.607409Z 01O Removing .env
2026-04-19T23:24:07.664903Z 01O 
2026-04-19T23:24:07.664912Z 01O Skipping Git submodules setup
2026-04-19T23:24:07.802965Z 00O section_end:1776641047:get_sources
2026-04-19T23:24:07.802975Z 00O+section_start:1776641047:step_script
2026-04-19T23:24:07.807103Z 00O+Executing "step_script" stage of the job script
2026-04-19T23:24:07.807138Z 00O Using effective pull policy of [always] for container docker:cli
2026-04-19T23:24:07.874391Z 00O Using docker image sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 for docker:cli with digest docker@sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 ...
2026-04-19T23:24:08.150070Z 01O $ mkdir -p $DOCKER_CERT_PATH
2026-04-19T23:24:08.150927Z 01O $ export ENVNAME=$(echo ${ENVIRONMENT} | tr '[:lower:]' '[:upper:]')
2026-04-19T23:24:08.152905Z 01O $ export DOCKER_HOST="tcp://$(printenv "${ENVNAME}_CLUSTER_HOST"):2376"
2026-04-19T23:24:08.154278Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CA)" $DOCKER_CERT_PATH/ca.pem
2026-04-19T23:24:08.159301Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CERT)" $DOCKER_CERT_PATH/cert.pem
2026-04-19T23:24:08.161094Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_KEY)" $DOCKER_CERT_PATH/key.pem
2026-04-19T23:24:08.162950Z 01O $ echo "$CI_REGISTRY_PASSWORD" | docker login -u "$CI_REGISTRY_USER" $CI_REGISTRY --password-stdin
2026-04-19T23:24:08.910870Z 01O Login Succeeded
2026-04-19T23:24:08.910896Z 01E 
2026-04-19T23:24:08.910898Z 01E WARNING! Your credentials are stored unencrypted in '/root/.docker/config.json'.
2026-04-19T23:24:08.910901Z 01E Configure a credential helper to remove this warning. See
2026-04-19T23:24:08.910904Z 01E https://docs.docker.com/go/credential-store/
2026-04-19T23:24:08.910906Z 01E 
2026-04-19T23:24:08.913325Z 01O $ export RELEASE=$(echo -n $(date '+%D %X') | md5sum | awk '{print $1}')
2026-04-19T23:24:08.916514Z 01O $ if [ "$(docker info --format '{{.Swarm.LocalNodeState}}' 2>/dev/null)" = "active" ]; then docker stack deploy --prune --with-registry-auth -c stack.yml $COMPOSE_PROJECT_NAME; else docker compose up -d; fi
2026-04-19T23:24:09.376906Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:6929df71fa832efc86cf9d9d7d703fbeda49f804 Pulling 
2026-04-19T23:24:09.376983Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:6929df71fa832efc86cf9d9d7d703fbeda49f804 Pulling 
2026-04-19T23:24:09.376987Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:6929df71fa832efc86cf9d9d7d703fbeda49f804 Pulling 
2026-04-19T23:24:09.376990Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:6929df71fa832efc86cf9d9d7d703fbeda49f804 Pulling 
2026-04-19T23:24:10.160890Z 01E  5435b2dcdf5c Already exists 0B
2026-04-19T23:24:10.164071Z 01E  25981ed25cff Already exists 0B
2026-04-19T23:24:10.167353Z 01E  d4c207a1ca27 Already exists 0B
2026-04-19T23:24:10.172261Z 01E  f0bdb572205e Already exists 0B
2026-04-19T23:24:10.175249Z 01E  5435b2dcdf5c Already exists 0B
2026-04-19T23:24:10.176447Z 01E  858f8a9a658f Already exists 0B
2026-04-19T23:24:10.178458Z 01E  25981ed25cff Already exists 0B
2026-04-19T23:24:10.181898Z 01E  d4c207a1ca27 Already exists 0B
2026-04-19T23:24:10.182687Z 01E  d5cc1e7f820a Already exists 0B
2026-04-19T23:24:10.186655Z 01E  a6231aab7c0d Already exists 0B
2026-04-19T23:24:10.187342Z 01E  f0bdb572205e Already exists 0B
2026-04-19T23:24:10.189353Z 01E  858f8a9a658f Already exists 0B
2026-04-19T23:24:10.193002Z 01E  19b77d7c1eb5 Already exists 0B
2026-04-19T23:24:10.195004Z 01E  d5cc1e7f820a Already exists 0B
2026-04-19T23:24:10.196560Z 01E  33aaaf9c7772 Pulling fs layer 0B
2026-04-19T23:24:10.197767Z 01E  a6231aab7c0d Already exists 0B
2026-04-19T23:24:10.200151Z 01E  19b77d7c1eb5 Already exists 0B
2026-04-19T23:24:10.202896Z 01E  33aaaf9c7772 Pulling fs layer 0B
2026-04-19T23:24:10.255337Z 01E  5435b2dcdf5c Already exists 0B
2026-04-19T23:24:10.257031Z 01E  5435b2dcdf5c Already exists 0B
2026-04-19T23:24:10.257904Z 01E  25981ed25cff Already exists 0B
2026-04-19T23:24:10.259771Z 01E  d4c207a1ca27 Already exists 0B
2026-04-19T23:24:10.261890Z 01E  25981ed25cff Already exists 0B
2026-04-19T23:24:10.263515Z 01E  f0bdb572205e Already exists 0B
2026-04-19T23:24:10.264724Z 01E  d4c207a1ca27 Already exists 0B
2026-04-19T23:24:10.265765Z 01E  f0bdb572205e Already exists 0B
2026-04-19T23:24:10.268278Z 01E  858f8a9a658f Already exists 0B
2026-04-19T23:24:10.269699Z 01E  858f8a9a658f Already exists 0B
2026-04-19T23:24:10.272662Z 01E  d5cc1e7f820a Already exists 0B
2026-04-19T23:24:10.272666Z 01E  d5cc1e7f820a Already exists 0B
2026-04-19T23:24:10.274199Z 01E  a6231aab7c0d Already exists 0B
2026-04-19T23:24:10.276192Z 01E  a6231aab7c0d Already exists 0B
2026-04-19T23:24:10.277794Z 01E  19b77d7c1eb5 Already exists 0B
2026-04-19T23:24:10.280373Z 01E  19b77d7c1eb5 Already exists 0B
2026-04-19T23:24:10.281980Z 01E  33aaaf9c7772 Pulling fs layer 0B
2026-04-19T23:24:10.283284Z 01E  33aaaf9c7772 Pulling fs layer 0B
2026-04-19T23:24:10.354559Z 01E  33aaaf9c7772 Downloading 13.78kB
2026-04-19T23:24:10.354604Z 01E  33aaaf9c7772 Downloading 13.78kB
2026-04-19T23:24:10.354745Z 01E  33aaaf9c7772 Downloading 13.78kB
2026-04-19T23:24:10.354748Z 01E  33aaaf9c7772 Downloading 13.78kB
2026-04-19T23:24:10.456073Z 01E  33aaaf9c7772 Downloading 891.3kB
2026-04-19T23:24:10.456086Z 01E  33aaaf9c7772 Downloading 891.3kB
2026-04-19T23:24:10.456088Z 01E  33aaaf9c7772 Downloading 891.3kB
2026-04-19T23:24:10.456090Z 01E  33aaaf9c7772 Downloading 891.3kB
2026-04-19T23:24:10.472543Z 01E  33aaaf9c7772 Verifying Checksum 0B
2026-04-19T23:24:10.472549Z 01E  33aaaf9c7772 Verifying Checksum 0B
2026-04-19T23:24:10.472551Z 01E  33aaaf9c7772 Download complete 0B
2026-04-19T23:24:10.472553Z 01E  33aaaf9c7772 Download complete 0B
2026-04-19T23:24:10.472560Z 01E  33aaaf9c7772 Verifying Checksum 0B
2026-04-19T23:24:10.472585Z 01E  33aaaf9c7772 Download complete 0B
2026-04-19T23:24:10.472603Z 01E  33aaaf9c7772 Extracting 32.77kB
2026-04-19T23:24:10.472605Z 01E  33aaaf9c7772 Download complete 0B
2026-04-19T23:24:10.472636Z 01E  33aaaf9c7772 Extracting 32.77kB
2026-04-19T23:24:10.472712Z 01E  33aaaf9c7772 Extracting 32.77kB
2026-04-19T23:24:10.472714Z 01E  33aaaf9c7772 Extracting 32.77kB
2026-04-19T23:24:10.578599Z 01E  33aaaf9c7772 Extracting 1.094MB
2026-04-19T23:24:10.578659Z 01E  33aaaf9c7772 Extracting 1.094MB
2026-04-19T23:24:10.578661Z 01E  33aaaf9c7772 Extracting 1.094MB
2026-04-19T23:24:10.578663Z 01E  33aaaf9c7772 Extracting 1.094MB
2026-04-19T23:24:10.582335Z 01E  33aaaf9c7772 Extracting 1.094MB
2026-04-19T23:24:10.582341Z 01E  33aaaf9c7772 Extracting 1.094MB
2026-04-19T23:24:10.582344Z 01E  33aaaf9c7772 Extracting 1.094MB
2026-04-19T23:24:10.582348Z 01E  33aaaf9c7772 Extracting 1.094MB
2026-04-19T23:24:10.618980Z 01E  33aaaf9c7772 Pull complete 0B
2026-04-19T23:24:10.618987Z 01E  33aaaf9c7772 Pull complete 0B
2026-04-19T23:24:10.618989Z 01E  33aaaf9c7772 Pull complete 0B
2026-04-19T23:24:10.618991Z 01E  33aaaf9c7772 Pull complete 0B
2026-04-19T23:24:10.629220Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:6929df71fa832efc86cf9d9d7d703fbeda49f804 Pulled 
2026-04-19T23:24:10.629791Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:6929df71fa832efc86cf9d9d7d703fbeda49f804 Pulled 
2026-04-19T23:24:10.630655Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:6929df71fa832efc86cf9d9d7d703fbeda49f804 Pulled 
2026-04-19T23:24:10.630733Z 01E  Image registry.kisulkens.ru/kisulkens/platforms/air/services/backend:6929df71fa832efc86cf9d9d7d703fbeda49f804 Pulled 
2026-04-19T23:24:10.722253Z 01E  Container backend-cache-mdb-1 Running 
2026-04-19T23:24:10.722264Z 01E  Container backend-channels-mdb-1 Running 
2026-04-19T23:24:10.722278Z 01E  Container backend-housekeeper-1 Recreate 
2026-04-19T23:24:10.722281Z 01E  Container backend-celery-mdb-1 Running 
2026-04-19T23:24:10.722301Z 01E  Container backend-celery-beat-1 Recreate 
2026-04-19T23:24:10.722305Z 01E  Container backend-static-server-1 Recreate 
2026-04-19T23:24:10.722480Z 01E  Container backend-celery-1 Recreate 
2026-04-19T23:24:10.723445Z 01E  Container backend-app-1 Recreate 
2026-04-19T23:24:11.013576Z 01E  Container backend-housekeeper-1 Recreated 
2026-04-19T23:24:11.178682Z 01E  Container backend-static-server-1 Recreated 
2026-04-19T23:24:12.146782Z 01E  Container backend-celery-beat-1 Recreated 
2026-04-19T23:24:13.832658Z 01E  Container backend-celery-1 Recreated 
2026-04-19T23:24:21.305934Z 01E  Container backend-app-1 Recreated 
2026-04-19T23:24:21.346431Z 01E  Container backend-housekeeper-1 Starting 
2026-04-19T23:24:21.346440Z 01E  Container backend-celery-beat-1 Starting 
2026-04-19T23:24:21.346444Z 01E  Container backend-celery-1 Starting 
2026-04-19T23:24:21.346470Z 01E  Container backend-static-server-1 Starting 
2026-04-19T23:24:21.346627Z 01E  Container backend-app-1 Starting 
2026-04-19T23:24:21.776511Z 01E  Container backend-celery-beat-1 Started 
2026-04-19T23:24:21.832125Z 01E  Container backend-housekeeper-1 Started 
2026-04-19T23:24:21.898751Z 01E  Container backend-static-server-1 Started 
2026-04-19T23:24:21.955381Z 01E  Container backend-app-1 Started 
2026-04-19T23:24:22.039616Z 01E  Container backend-celery-1 Started 
2026-04-19T23:24:22.219145Z 00O section_end:1776641062:step_script
2026-04-19T23:24:22.219155Z 00O+section_start:1776641062:cleanup_file_variables
2026-04-19T23:24:22.222240Z 00O+Cleaning up project directory and file based variables
2026-04-19T23:24:22.611028Z 00O section_end:1776641062:cleanup_file_variables
2026-04-19T23:24:22.611038Z 00O+
2026-04-19T23:24:22.766601Z 00O Job succeeded