2026-04-19T22:40:53.622202Z 00O Running with gitlab-runner 18.9.0 (07e534ba)
2026-04-19T22:40:53.622240Z 00O   on ba0d40dbec6d ee6NEhN34, system ID: r_LuGAIt6mmQ0P
2026-04-19T22:40:53.622304Z 00O Resolving secrets
2026-04-19T22:40:53.622661Z 00O section_start:1776638453:prepare_executor
2026-04-19T22:40:53.622667Z 00O+Preparing the "docker" executor
2026-04-19T22:40:53.648735Z 00O Using Docker executor with image docker:cli ...
2026-04-19T22:40:56.213407Z 00O Starting service docker:dind...
2026-04-19T22:40:56.213432Z 00O Using effective pull policy of [always] for container docker:dind
2026-04-19T22:40:56.296847Z 00O Pulling docker image docker:dind ...
2026-04-19T22:40:58.976724Z 00O Using docker image sha256:a6dd5322747a95cd8e3207bd8d415a8fd20ec34e9c00f06dc019cbd912013489 for docker:dind with digest docker@sha256:a6dd5322747a95cd8e3207bd8d415a8fd20ec34e9c00f06dc019cbd912013489 ...
2026-04-19T22:40:59.857181Z 00O Waiting for services to be up and running (timeout 30 seconds)...
2026-04-19T22:41:32.128684Z 00E 
2026-04-19T22:41:32.128702Z 00E *** WARNING: Service runner-ee6nehn34-project-243-concurrent-0-c7546aee901b4db7-docker-0 probably didn't start properly.
2026-04-19T22:41:32.128707Z 00E 
2026-04-19T22:41:32.128709Z 00E Health check error:
2026-04-19T22:41:32.128711Z 00E service "runner-ee6nehn34-project-243-concurrent-0-c7546aee901b4db7-docker-0-wait-for-service" timeout
2026-04-19T22:41:32.128715Z 00E 
2026-04-19T22:41:32.128717Z 00E Health check container logs:
2026-04-19T22:41:32.128718Z 00E 2026-04-19T22:41:00.623615415Z waiting for TCP connection to 561731bf9ed3 on [2375 2376]...
2026-04-19T22:41:32.128720Z 00E 2026-04-19T22:41:00.623674361Z dialing 561731bf9ed3:2376...
2026-04-19T22:41:32.128721Z 00E 2026-04-19T22:41:00.623680828Z dialing 561731bf9ed3:2375...
2026-04-19T22:41:32.128723Z 00E 2026-04-19T22:41:01.624860650Z dialing 561731bf9ed3:2376...
2026-04-19T22:41:32.128724Z 00E 2026-04-19T22:41:01.624889355Z dialing 561731bf9ed3:2375...
2026-04-19T22:41:32.128725Z 00E 2026-04-19T22:41:02.625743332Z dialing 561731bf9ed3:2375...
2026-04-19T22:41:32.128727Z 00E 2026-04-19T22:41:02.625791147Z dialing 561731bf9ed3:2376...
2026-04-19T22:41:32.128728Z 00E 2026-04-19T22:41:03.626841278Z dialing 561731bf9ed3:2376...
2026-04-19T22:41:32.128729Z 00E 2026-04-19T22:41:03.626883129Z dialing 561731bf9ed3:2375...
2026-04-19T22:41:32.128731Z 00E 
2026-04-19T22:41:32.128732Z 00E Service container logs:
2026-04-19T22:41:32.128733Z 00E 2026-04-19T22:41:01.563673332Z Certificate request self-signature ok
2026-04-19T22:41:32.128734Z 00E 2026-04-19T22:41:01.563725060Z subject=CN=docker:dind server
2026-04-19T22:41:32.128735Z 00E 2026-04-19T22:41:01.584253527Z /certs/server/cert.pem: OK
2026-04-19T22:41:32.128737Z 00E 2026-04-19T22:41:03.383320634Z Certificate request self-signature ok
2026-04-19T22:41:32.128738Z 00E 2026-04-19T22:41:03.383355560Z subject=CN=docker:dind client
2026-04-19T22:41:32.128740Z 00E 2026-04-19T22:41:03.402396756Z /certs/client/cert.pem: OK
2026-04-19T22:41:32.128741Z 00E 2026-04-19T22:41:03.407180080Z cat: can't open '/proc/net/ip6_tables_names': No such file or directory
2026-04-19T22:41:32.128743Z 00E 2026-04-19T22:41:03.408498498Z cat: can't open '/proc/net/arp_tables_names': No such file or directory
2026-04-19T22:41:32.128744Z 00E 2026-04-19T22:41:03.411697060Z ip: can't find device 'nf_tables'
2026-04-19T22:41:32.128746Z 00E 2026-04-19T22:41:03.413627888Z nf_tables             376832 4063 nft_chain_nat,nft_compat
2026-04-19T22:41:32.128747Z 00E 2026-04-19T22:41:03.413960646Z nfnetlink              20480  7 nf_conntrack_netlink,ip_set,nft_compat,nf_tables
2026-04-19T22:41:32.128749Z 00E 2026-04-19T22:41:03.413968912Z libcrc32c              12288  5 nf_nat,nf_conntrack,nf_tables,btrfs,raid456
2026-04-19T22:41:32.128751Z 00E 2026-04-19T22:41:03.414642695Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-04-19T22:41:32.128752Z 00E 2026-04-19T22:41:03.417324968Z ip: can't find device 'ip_tables'
2026-04-19T22:41:32.128754Z 00E 2026-04-19T22:41:03.418534647Z ip_tables              32768  0 
2026-04-19T22:41:32.128755Z 00E 2026-04-19T22:41:03.418726711Z x_tables               65536  8 xt_nat,xt_tcpudp,xt_conntrack,xt_MASQUERADE,xt_set,xt_addrtype,nft_compat,ip_tables
2026-04-19T22:41:32.128757Z 00E 2026-04-19T22:41:03.419326313Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-04-19T22:41:32.128759Z 00E 2026-04-19T22:41:03.421443226Z ip: can't find device 'ip6_tables'
2026-04-19T22:41:32.128760Z 00E 2026-04-19T22:41:03.423629907Z modprobe: can't change directory to '/lib/modules': No such file or directory
2026-04-19T22:41:32.128762Z 00E 2026-04-19T22:41:03.425944355Z iptables v1.8.11 (nf_tables)
2026-04-19T22:41:32.128763Z 00E 2026-04-19T22:41:03.429238129Z mount: permission denied (are you root?)
2026-04-19T22:41:32.128765Z 00E 2026-04-19T22:41:03.429338431Z Could not mount /sys/kernel/security.
2026-04-19T22:41:32.128766Z 00E 2026-04-19T22:41:03.429344946Z AppArmor detection and --privileged mode might break.
2026-04-19T22:41:32.128824Z 00E 2026-04-19T22:41:03.430873936Z mount: permission denied (are you root?)
2026-04-19T22:41:32.128828Z 00E 
2026-04-19T22:41:32.128829Z 00E *********
2026-04-19T22:41:32.128831Z 00E 
2026-04-19T22:41:32.165094Z 00O Using effective pull policy of [always] for container docker:cli
2026-04-19T22:41:32.226222Z 00O Pulling docker image docker:cli ...
2026-04-19T22:41:34.305780Z 00O Using docker image sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 for docker:cli with digest docker@sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 ...
2026-04-19T22:41:34.305805Z 00O section_end:1776638494:prepare_executor
2026-04-19T22:41:34.305809Z 00O+section_start:1776638494:prepare_script
2026-04-19T22:41:34.306030Z 00O+Preparing environment
2026-04-19T22:41:34.335063Z 00O Using effective pull policy of [always] for container sha256:8759a73e613f7d952d78a5c4cb758a1d0c60dbb2e311c0ce19861809907251a2
2026-04-19T22:41:35.129266Z 01O Running on runner-ee6nehn34-project-243-concurrent-0 via ba0d40dbec6d...
2026-04-19T22:41:35.488516Z 00O section_end:1776638495:prepare_script
2026-04-19T22:41:35.488526Z 00O+section_start:1776638495:get_sources
2026-04-19T22:41:35.490968Z 00O+Getting source from Git repository
2026-04-19T22:41:36.038210Z 01O Gitaly correlation ID: 01KPKYERFVJ8DK76NPSWKYDVA7
2026-04-19T22:41:36.050181Z 01O Fetching changes with git depth set to 20...
2026-04-19T22:41:36.062039Z 01O Reinitialized existing Git repository in /builds/kisulkens/platforms/air/services/backend/.git/
2026-04-19T22:41:36.066817Z 01O Created fresh repository.
2026-04-19T22:41:36.781268Z 01O Checking out fdbda4d0 as detached HEAD (ref is staging)...
2026-04-19T22:41:36.853808Z 01O 
2026-04-19T22:41:36.853820Z 01O Skipping Git submodules setup
2026-04-19T22:41:37.163510Z 00O section_end:1776638497:get_sources
2026-04-19T22:41:37.163522Z 00O+section_start:1776638497:step_script
2026-04-19T22:41:37.167892Z 00O+Executing "step_script" stage of the job script
2026-04-19T22:41:37.167930Z 00O Using effective pull policy of [always] for container docker:cli
2026-04-19T22:41:37.243597Z 00O Using docker image sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 for docker:cli with digest docker@sha256:2efe7c8e806b35050def6ba1ba0ddad67b521a0a6d37f4910b3d88f11b495d03 ...
2026-04-19T22:41:38.080811Z 01O $ mkdir -p $DOCKER_CERT_PATH
2026-04-19T22:41:38.081489Z 01O $ export ENVNAME=$(echo ${ENVIRONMENT} | tr '[:lower:]' '[:upper:]')
2026-04-19T22:41:38.083495Z 01O $ export DOCKER_HOST="tcp://$(printenv "${ENVNAME}_CLUSTER_HOST"):2376"
2026-04-19T22:41:38.084508Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CA)" $DOCKER_CERT_PATH/ca.pem
2026-04-19T22:41:38.104745Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_CERT)" $DOCKER_CERT_PATH/cert.pem
2026-04-19T22:41:38.107859Z 01O $ cp "$(printenv ${ENVNAME}_CLUSTER_KEY)" $DOCKER_CERT_PATH/key.pem
2026-04-19T22:41:38.110369Z 01O $ echo "$CI_REGISTRY_PASSWORD" | docker login -u "$CI_REGISTRY_USER" $CI_REGISTRY --password-stdin
2026-04-19T22:41:38.569918Z 01O Login Succeeded
2026-04-19T22:41:38.569942Z 01E 
2026-04-19T22:41:38.569944Z 01E WARNING! Your credentials are stored unencrypted in '/root/.docker/config.json'.
2026-04-19T22:41:38.569946Z 01E Configure a credential helper to remove this warning. See
2026-04-19T22:41:38.569949Z 01E https://docs.docker.com/go/credential-store/
2026-04-19T22:41:38.569951Z 01E 
2026-04-19T22:41:38.572765Z 01O $ export RELEASE=$(echo -n $(date '+%D %X') | md5sum | awk '{print $1}')
2026-04-19T22:41:38.575293Z 01O $ if [ "$(docker info --format '{{.Swarm.LocalNodeState}}' 2>/dev/null)" = "active" ]; then docker stack deploy --prune --with-registry-auth -c stack.yml $COMPOSE_PROJECT_NAME; else docker compose up -d; fi
2026-04-19T22:41:39.069054Z 01E time="2026-04-19T22:41:39Z" level=warning msg="volume \"backend-static\" already exists but was created for project \"air-backend\" (expected \"backend\"). Use `external: true` to use an existing volume"
2026-04-19T22:41:39.111654Z 01E  Container backend-channels-mdb-1 Running 
2026-04-19T22:41:39.111662Z 01E  Container backend-cache-mdb-1 Running 
2026-04-19T22:41:39.111665Z 01E  Container backend-celery-mdb-1 Running 
2026-04-19T22:41:39.111667Z 01E  Container backend-housekeeper-1 Recreate 
2026-04-19T22:41:39.119996Z 01E  Container backend-static-server-1 Recreate 
2026-04-19T22:41:39.120003Z 01E  Container backend-app-1 Recreate 
2026-04-19T22:41:39.120302Z 01E  Container backend-celery-1 Recreate 
2026-04-19T22:41:39.121705Z 01E  Container backend-celery_beat-1 Recreate 
2026-04-19T22:41:39.326431Z 01E  Container backend-celery_beat-1 Recreated 
2026-04-19T22:41:39.338308Z 01E  Container backend-static-server-1 Recreated 
2026-04-19T22:41:39.351981Z 01E  Container backend-celery-1 Recreated 
2026-04-19T22:41:39.370418Z 01E  Container backend-app-1 Recreated 
2026-04-19T22:41:39.378152Z 01E  Container backend-housekeeper-1 Recreated 
2026-04-19T22:41:39.399366Z 01E  Container backend-app-1 Starting 
2026-04-19T22:41:39.399375Z 01E  Container backend-celery-1 Starting 
2026-04-19T22:41:39.399378Z 01E  Container backend-housekeeper-1 Starting 
2026-04-19T22:41:39.399380Z 01E  Container backend-celery_beat-1 Starting 
2026-04-19T22:41:39.399381Z 01E  Container backend-static-server-1 Starting 
2026-04-19T22:41:39.799338Z 01E  Container backend-celery-1 Started 
2026-04-19T22:41:39.931440Z 01E  Container backend-app-1 Started 
2026-04-19T22:41:39.965768Z 01E  Container backend-housekeeper-1 Started 
2026-04-19T22:41:40.091013Z 01E  Container backend-celery_beat-1 Started 
2026-04-19T22:41:40.119595Z 01E  Container backend-static-server-1 Started 
2026-04-19T22:41:40.458249Z 00O section_end:1776638500:step_script
2026-04-19T22:41:40.458260Z 00O+section_start:1776638500:cleanup_file_variables
2026-04-19T22:41:40.461288Z 00O+Cleaning up project directory and file based variables
2026-04-19T22:41:41.262485Z 00O section_end:1776638501:cleanup_file_variables
2026-04-19T22:41:41.262500Z 00O+
2026-04-19T22:41:41.624592Z 00O Job succeeded