All Test Logs

2026-10-31T02:55:04.1244055Z Current runner version: '2.338.2'2026-10-31T02:55:04.1269069Z ##[group]Runner Image Provisioner2026-10-31T02:55:04.1269966Z Hosted Compute Agent2026-10-31T02:55:04.1270593Z Version: 20261021.6182026-10-31T02:55:04.1271341Z Commit: 21505ad2541d5be6135ed84fc33697146cf75b8e2026-10-31T02:55:04.1272107Z Build Date: 2026-10-21T00:45:21Z2026-10-31T02:55:04.1272809Z Worker ID: {afdfca90-880d-451c-a808-0ec449f89e12}2026-10-31T02:55:04.1274022Z Region: northcentralus2026-10-31T02:55:04.1274653Z Cloud: Azure2026-10-31T02:55:04.1275297Z ##[endgroup]2026-10-31T02:55:04.1276813Z ##[group]Operating System2026-10-31T02:55:04.1277479Z Ubuntu2026-10-31T02:55:04.1278136Z 22.04.52026-10-31T02:55:04.1278687Z LTS2026-10-31T02:55:04.1279262Z ##[endgroup]2026-10-31T02:55:04.1279880Z ##[group]Runner Image2026-10-31T02:55:04.1280519Z Image: ubuntu-22.042026-10-31T02:55:04.1281211Z Version: 20261025.340.12026-10-31T02:55:04.1282470Z Included Software: https://github.com/actions/runner-images/blob/ubuntu22/20261025.340/images/ubuntu/Ubuntu2204-Readme.md2026-10-31T02:55:04.1284573Z Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu22%2F20261025.3402026-10-31T02:55:04.1285586Z ##[endgroup]2026-10-31T02:55:04.1289214Z ##[group]GITHUB_TOKEN Permissions2026-10-31T02:55:04.1291646Z Actions: write2026-10-31T02:55:04.1292418Z ArtifactMetadata: write2026-10-31T02:55:04.1293088Z Attestations: write2026-10-31T02:55:04.1294179Z Checks: write2026-10-31T02:55:04.1294792Z CodeQuality: write2026-10-31T02:55:04.1295426Z Contents: write2026-10-31T02:55:04.1296086Z CopilotRequests: write2026-10-31T02:55:04.1296718Z Deployments: write2026-10-31T02:55:04.1297330Z Discussions: write2026-10-31T02:55:04.1297952Z Drives: write2026-10-31T02:55:04.1298506Z Issues: write2026-10-31T02:55:04.1299229Z Metadata: read2026-10-31T02:55:04.1299844Z Models: read2026-10-31T02:55:04.1300491Z Packages: write2026-10-31T02:55:04.1301100Z Pages: write2026-10-31T02:55:04.1301682Z PullRequests: write2026-10-31T02:55:04.1302368Z RepositoryProjects: write2026-10-31T02:55:04.1303005Z SecurityEvents: write2026-10-31T02:55:04.1303943Z Statuses: write2026-10-31T02:55:04.1304671Z VulnerabilityAlerts: read2026-10-31T02:55:04.1305312Z ##[endgroup]2026-10-31T02:55:04.1307457Z Secret source: Actions2026-10-31T02:55:04.1308516Z Cache mode: write2026-10-31T02:55:04.1309657Z Prepare workflow directory2026-10-31T02:55:04.1676651Z Prepare all required actions2026-10-31T02:55:04.1747572Z Getting action download info2026-10-31T02:55:04.4146790Z Download action repository 'actions/checkout@v5' (SHA:fbc6f3992d24b796d5a048ff273f7fcc4a7b6c09)2026-10-31T02:55:04.6039795Z Download action repository 'medyagh/setup-minikube@latest' (SHA:e9e035a86bbc3caea26a450bd4dbf9d0c453682e)2026-10-31T02:55:04.8747623Z Download action repository 'actions/setup-go@v6' (SHA:924ae3a1cded613372ab5595356fb5720e22ba16)2026-10-31T02:55:05.1621273Z Download action repository 'actions/upload-artifact@v4' (SHA:ea165f8d65b6e75b540449e92b4886f43607fa02)2026-10-31T02:55:05.4064919Z Uses: osg-htc/k8s-integration-tests/.github/workflows/test-harness.yaml@refs/heads/main (63ec080e4eea87fb8a9eae678ab9944ec2461251)2026-10-31T02:55:05.4069994Z ##[group] Inputs2026-10-31T02:55:05.4070588Z   testName: TestOSPoolEP2026-10-31T02:55:05.4071527Z   testEnv: OSPOOL_EP_OSPoolEPTag: 25-releaseOSPOOL_EP_CMTag: 25.0-el9OSPOOL_EP_CvmfsType: cvmfsexec2026-10-31T02:55:05.4072520Z   setupScript: 2026-10-31T02:55:05.4072999Z   setupEnv: {}2026-10-31T02:55:05.4073776Z ##[endgroup]2026-10-31T02:55:05.4074528Z Complete job name: ospool-ep / Run OSPool EP test (cvmfsexec, 25-release) / Run Tests2026-10-31T02:55:05.4951658Z ##[group]Run actions/checkout@v52026-10-31T02:55:05.4952606Z with:2026-10-31T02:55:05.4953355Z   repository: osg-htc/k8s-integration-tests2026-10-31T02:55:05.4958095Z   token: ***2026-10-31T02:55:05.4958672Z   ssh-strict: true2026-10-31T02:55:05.4959164Z   ssh-user: git2026-10-31T02:55:05.4959661Z   persist-credentials: true2026-10-31T02:55:05.4960190Z   clean: true2026-10-31T02:55:05.4960957Z   sparse-checkout-cone-mode: true2026-10-31T02:55:05.4961516Z   fetch-depth: 12026-10-31T02:55:05.4961980Z   fetch-tags: false2026-10-31T02:55:05.4962469Z   show-progress: true2026-10-31T02:55:05.4962952Z   lfs: false2026-10-31T02:55:05.4963623Z   submodules: false2026-10-31T02:55:05.4964111Z   set-safe-directory: true2026-10-31T02:55:05.4964657Z   allow-unsafe-pr-checkout: false2026-10-31T02:55:05.4965960Z ##[endgroup]2026-10-31T02:55:05.7044636Z Syncing repository: osg-htc/k8s-integration-tests2026-10-31T02:55:05.7046632Z ##[group]Getting Git version info2026-10-31T02:55:05.7047590Z Working directory is '/home/runner/work/k8s-integration-tests/k8s-integration-tests'2026-10-31T02:55:05.7048834Z [command]/usr/bin/git version2026-10-31T02:55:05.7088652Z git version 2.56.02026-10-31T02:55:05.7110520Z ##[endgroup]2026-10-31T02:55:05.7126092Z Temporarily overriding HOME='/home/runner/work/_temp/c6ff2ffe-29fd-4741-91de-598c8ce3a79b' before making global git config changes2026-10-31T02:55:05.7128673Z Adding repository directory to the temporary git global config as a safe directory2026-10-31T02:55:05.7131927Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/k8s-integration-tests/k8s-integration-tests2026-10-31T02:55:05.7205643Z Deleting the contents of '/home/runner/work/k8s-integration-tests/k8s-integration-tests'2026-10-31T02:55:05.7209837Z ##[group]Initializing the repository2026-10-31T02:55:05.7211029Z [command]/usr/bin/git init /home/runner/work/k8s-integration-tests/k8s-integration-tests2026-10-31T02:55:05.7306192Z hint: Using 'master' as the name for the initial branch. This default branch name2026-10-31T02:55:05.7308248Z hint: will change to "main" in Git 3.0. To configure the initial branch name2026-10-31T02:55:05.7310321Z hint: to use in all of your new repositories, which will suppress this warning,2026-10-31T02:55:05.7311853Z hint: call:2026-10-31T02:55:05.7312925Z hint:2026-10-31T02:55:05.7314341Z hint: 	git config --global init.defaultBranch <name>2026-10-31T02:55:05.7315559Z hint:2026-10-31T02:55:05.7316663Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and2026-10-31T02:55:05.7318404Z hint: 'development'. The just-created branch can be renamed via this command:2026-10-31T02:55:05.7319803Z hint:2026-10-31T02:55:05.7320603Z hint: 	git branch -m <name>2026-10-31T02:55:05.7321460Z hint:2026-10-31T02:55:05.7322530Z hint: Disable this message with "git config set advice.defaultBranchName false"2026-10-31T02:55:05.7324958Z Initialized empty Git repository in /home/runner/work/k8s-integration-tests/k8s-integration-tests/.git/2026-10-31T02:55:05.7328383Z [command]/usr/bin/git remote add origin https://github.com/osg-htc/k8s-integration-tests2026-10-31T02:55:05.7377235Z ##[endgroup]2026-10-31T02:55:05.7378792Z ##[group]Disabling automatic garbage collection2026-10-31T02:55:05.7381662Z [command]/usr/bin/git config --local gc.auto 02026-10-31T02:55:05.7431906Z ##[endgroup]2026-10-31T02:55:05.7434031Z ##[group]Setting up auth2026-10-31T02:55:05.7439755Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand2026-10-31T02:55:05.7478647Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"2026-10-31T02:55:05.7865872Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader2026-10-31T02:55:05.7912528Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"2026-10-31T02:55:05.8191798Z [command]/usr/bin/git config --local --name-only --get-regexp ^includeIf\.gitdir:2026-10-31T02:55:05.8233637Z [command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url2026-10-31T02:55:05.8498175Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***2026-10-31T02:55:05.8544362Z ##[endgroup]2026-10-31T02:55:05.8545159Z ##[group]Fetching the repository2026-10-31T02:55:05.8554007Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --no-recurse-submodules --depth=1 origin +63ec080e4eea87fb8a9eae678ab9944ec2461251:refs/remotes/origin/main2026-10-31T02:55:06.1465962Z From https://github.com/osg-htc/k8s-integration-tests2026-10-31T02:55:06.1467528Z  * [new ref]         63ec080e4eea87fb8a9eae678ab9944ec2461251 -> origin/main2026-10-31T02:55:06.1476337Z ##[endgroup]2026-10-31T02:55:06.1477756Z ##[group]Determining the checkout info2026-10-31T02:55:06.1479329Z ##[endgroup]2026-10-31T02:55:06.1480578Z [command]/usr/bin/git sparse-checkout disable2026-10-31T02:55:06.1532527Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig2026-10-31T02:55:06.1574160Z ##[group]Checking out the ref2026-10-31T02:55:06.1579416Z [command]/usr/bin/git checkout --progress --force -B main refs/remotes/origin/main2026-10-31T02:55:06.1691052Z Switched to a new branch 'main'2026-10-31T02:55:06.1694735Z branch 'main' set up to track 'origin/main'.2026-10-31T02:55:06.1702817Z ##[endgroup]2026-10-31T02:55:06.1758003Z [command]/usr/bin/git log -1 --format=%H2026-10-31T02:55:06.1883486Z 63ec080e4eea87fb8a9eae678ab9944ec24612512026-10-31T02:55:06.2052988Z ##[group]Run echo "TEST_ENV=$(echo "$TEST_ENV_YAML" | yq -o json | tr -d '\n')" >> $GITHUB_OUTPUT2026-10-31T02:55:06.2054469Z echo "TEST_ENV=$(echo "$TEST_ENV_YAML" | yq -o json | tr -d '\n')" >> $GITHUB_OUTPUT2026-10-31T02:55:06.2055542Z echo "SETUP_ENV=$(echo "$SETUP_ENV_YAML" | yq -o json | tr -d '\n')" >> $GITHUB_OUTPUT2026-10-31T02:55:06.2134262Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}2026-10-31T02:55:06.2134944Z env:2026-10-31T02:55:06.2135734Z   TEST_ENV_YAML: OSPOOL_EP_OSPoolEPTag: 25-releaseOSPOOL_EP_CMTag: 25.0-el9OSPOOL_EP_CvmfsType: cvmfsexec2026-10-31T02:55:06.2136687Z   SETUP_ENV_YAML: {}2026-10-31T02:55:06.2137117Z ##[endgroup]2026-10-31T02:55:07.0183972Z ##[group]Run echo "TEST_ENV=$(echo -n "$TEST_ENV" | tr '\n' ' ' | sed 's/\s\+/ /g')" >> $GITHUB_OUTPUT2026-10-31T02:55:07.0187056Z echo "TEST_ENV=$(echo -n "$TEST_ENV" | tr '\n' ' ' | sed 's/\s\+/ /g')" >> $GITHUB_OUTPUT2026-10-31T02:55:07.0256777Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}2026-10-31T02:55:07.0258559Z env:2026-10-31T02:55:07.0260824Z   TEST_ENV: {  "OSPOOL_EP_OSPoolEPTag": "25-release",  "OSPOOL_EP_CMTag": "25.0-el9",  "OSPOOL_EP_CvmfsType": "cvmfsexec"}2026-10-31T02:55:07.0263662Z ##[endgroup]2026-10-31T02:55:07.0485870Z ##[group]Run true2026-10-31T02:55:07.0486887Z true2026-10-31T02:55:07.0553964Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}2026-10-31T02:55:07.0555506Z ##[endgroup]2026-10-31T02:55:07.0884842Z ##[group]Run medyagh/setup-minikube@latest2026-10-31T02:55:07.0886159Z with:2026-10-31T02:55:07.0887042Z   start: true2026-10-31T02:55:07.0887933Z   cache: true2026-10-31T02:55:07.0888874Z   minikube-version: latest2026-10-31T02:55:07.0889948Z   wait: all2026-10-31T02:55:07.0890817Z ##[endgroup]2026-10-31T02:55:07.2231926Z (node:2168) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead.2026-10-31T02:55:07.2236949Z (Use `node --trace-deprecation ...` to show where the warning was created)2026-10-31T02:55:08.1942386Z [command]/usr/bin/chmod +x /home/runner/work/_temp/cfa18d7b-45b0-4ecd-9593-0ead84d20a212026-10-31T02:55:08.3829484Z [command]/home/runner/bin/minikube version --short2026-10-31T02:55:08.4318320Z v1.39.02026-10-31T02:55:08.5483048Z Cache hit for: kic-v1.39.0-x642026-10-31T02:55:08.5491370Z Cache hit for: preloaded-tarball-v1.39.0-x64-stable-docker2026-10-31T02:55:08.5611213Z (node:2168) [DEP0169] DeprecationWarning: `url.parse()` behavior is not standardized and prone to errors that have security implications. Use the WHATWG URL API instead. CVEs are not issued for `url.parse()` vulnerabilities.2026-10-31T02:55:09.6608142Z Received 100663296 of 288577004 (34.9%), 95.1 MBs/sec2026-10-31T02:55:09.6837299Z Received 88080384 of 531630645 (16.6%), 83.0 MBs/sec2026-10-31T02:55:10.6610468Z Received 226492416 of 288577004 (78.5%), 107.5 MBs/sec2026-10-31T02:55:10.6836200Z Received 205520896 of 531630645 (38.7%), 97.4 MBs/sec2026-10-31T02:55:11.3111435Z Received 288577004 of 288577004 (100.0%), 103.5 MBs/sec2026-10-31T02:55:11.3112956Z Cache Size: ~275 MB (288577004 B)2026-10-31T02:55:11.3154906Z [command]/usr/bin/tar -xf /home/runner/work/_temp/b793cdec-c14c-4ac3-83df-1e222605e4e8/cache.tzst -P -C /home/runner/work/k8s-integration-tests/k8s-integration-tests --use-compress-program unzstd2026-10-31T02:55:11.6879932Z Received 310378496 of 531630645 (58.4%), 98.1 MBs/sec2026-10-31T02:55:12.1412692Z Cache restored successfully2026-10-31T02:55:12.6887726Z Received 398458880 of 531630645 (75.0%), 94.6 MBs/sec2026-10-31T02:55:13.6892792Z Received 519047733 of 531630645 (97.6%), 98.6 MBs/sec2026-10-31T02:55:14.0062561Z Received 531630645 of 531630645 (100.0%), 95.0 MBs/sec2026-10-31T02:55:14.0064362Z Cache Size: ~507 MB (531630645 B)2026-10-31T02:55:14.0222726Z [command]/usr/bin/tar -xf /home/runner/work/_temp/a4da9ec0-b827-467a-85d1-bf281c9b4d46/cache.tzst -P -C /home/runner/work/k8s-integration-tests/k8s-integration-tests --use-compress-program unzstd2026-10-31T02:55:15.1014848Z Cache restored successfully2026-10-31T02:55:15.2209680Z [command]/home/runner/bin/minikube start --wait all2026-10-31T02:55:15.2815976Z * minikube v1.39.0 on Ubuntu 22.042026-10-31T02:55:19.5865282Z ! The minimum required version for podman is "4.9.0". your version is "3.4.4". minikube might not work. use at your own risk. To install latest version please see https://podman.io/getting-started/installation.html2026-10-31T02:55:19.5880635Z * Automatically selected the docker driver. Other choices: podman, none, ssh2026-10-31T02:55:19.6817800Z * Using Docker driver with root privileges2026-10-31T02:55:19.6827306Z * Starting "minikube" primary control-plane node in "minikube" cluster2026-10-31T02:55:19.6834473Z * Pulling base image v0.0.51 ...2026-10-31T02:55:41.5249304Z * Preparing Kubernetes v1.37.0 on containerd 2.3.4 ...2026-10-31T02:55:49.0589811Z * Configuring CNI (Container Networking Interface) ...2026-10-31T02:55:54.4823747Z * Verifying Kubernetes components...2026-10-31T02:55:54.5131187Z   - Using image gcr.io/k8s-minikube/storage-provisioner:v52026-10-31T02:55:55.1218513Z * Enabled addons: storage-provisioner, default-storageclass2026-10-31T02:56:14.9667511Z * Done! kubectl is now configured to use "minikube" cluster and "default" namespace by default2026-10-31T02:56:14.9798201Z [command]/home/runner/bin/minikube version --short2026-10-31T02:56:15.0400495Z v1.39.02026-10-31T02:56:15.0779507Z ##[group]Run actions/setup-go@v62026-10-31T02:56:15.0779804Z with:2026-10-31T02:56:15.0780008Z   go-version: 1.262026-10-31T02:56:15.0780229Z   cache: true2026-10-31T02:56:15.0780452Z   cache-dependency-path: go.sum2026-10-31T02:56:15.0780721Z   check-latest: false2026-10-31T02:56:15.0783935Z   token: ***2026-10-31T02:56:15.0784169Z ##[endgroup]2026-10-31T02:56:15.2209470Z Setup go version spec 1.262026-10-31T02:56:15.2267934Z Found in cache @ /opt/hostedtoolcache/go/1.26.10/x642026-10-31T02:56:15.2270458Z Added go to the path2026-10-31T02:56:15.2274674Z Successfully set up Go version 1.262026-10-31T02:56:15.9686533Z [command]/opt/hostedtoolcache/go/1.26.10/x64/bin/go env GOMODCACHE2026-10-31T02:56:15.9729311Z [command]/opt/hostedtoolcache/go/1.26.10/x64/bin/go env GOCACHE2026-10-31T02:56:15.9762662Z /home/runner/go/pkg/mod2026-10-31T02:56:15.9795070Z /home/runner/.cache/go-build2026-10-31T02:56:16.0881854Z Cache is not found2026-10-31T02:56:16.0908662Z go version go1.26.10 linux/amd642026-10-31T02:56:16.0908891Z 2026-10-31T02:56:16.0909189Z ##[group]go env2026-10-31T02:56:16.5732914Z AR='ar'2026-10-31T02:56:16.5733605Z CC='gcc'2026-10-31T02:56:16.5734203Z CGO_CFLAGS='-O2 -g'2026-10-31T02:56:16.5734489Z CGO_CPPFLAGS=''2026-10-31T02:56:16.5734757Z CGO_CXXFLAGS='-O2 -g'2026-10-31T02:56:16.5735037Z CGO_ENABLED='1'2026-10-31T02:56:16.5735295Z CGO_FFLAGS='-O2 -g'2026-10-31T02:56:16.5735563Z CGO_LDFLAGS='-O2 -g'2026-10-31T02:56:16.5735819Z CXX='g++'2026-10-31T02:56:16.5736054Z GCCGO='gccgo'2026-10-31T02:56:16.5736303Z GO111MODULE=''2026-10-31T02:56:16.5736545Z GOAMD64='v1'2026-10-31T02:56:16.5736785Z GOARCH='amd64'2026-10-31T02:56:16.5737030Z GOAUTH='netrc'2026-10-31T02:56:16.5737261Z GOBIN=''2026-10-31T02:56:16.5737532Z GOCACHE='/home/runner/.cache/go-build'2026-10-31T02:56:16.5737870Z GOCACHEPROG=''2026-10-31T02:56:16.5738112Z GODEBUG=''2026-10-31T02:56:16.5738402Z GOENV='/home/runner/.config/go/env'2026-10-31T02:56:16.5738719Z GOEXE=''2026-10-31T02:56:16.5739026Z GOEXPERIMENT=''2026-10-31T02:56:16.5739300Z GOFIPS140='off'2026-10-31T02:56:16.5739543Z GOFLAGS=''2026-10-31T02:56:16.5740393Z GOGCCFLAGS='-fPIC -m64 -pthread -Wl,--no-gc-sections -fmessage-length=0 -ffile-prefix-map=/tmp/go-build2987419659=/tmp/go-build -gno-record-gcc-switches'2026-10-31T02:56:16.5741287Z GOHOSTARCH='amd64'2026-10-31T02:56:16.5741550Z GOHOSTOS='linux'2026-10-31T02:56:16.5741808Z GOINSECURE=''2026-10-31T02:56:16.5742243Z GOMOD='/home/runner/work/k8s-integration-tests/k8s-integration-tests/go.mod'2026-10-31T02:56:16.5742710Z GOMODCACHE='/home/runner/go/pkg/mod'2026-10-31T02:56:16.5743111Z GONOPROXY=''2026-10-31T02:56:16.5743705Z GONOSUMDB=''2026-10-31T02:56:16.5744054Z GOOS='linux'2026-10-31T02:56:16.5744458Z GOPATH='/home/runner/go'2026-10-31T02:56:16.5744882Z GOPRIVATE=''2026-10-31T02:56:16.5745344Z GOPROXY='https://proxy.golang.org,direct'2026-10-31T02:56:16.5745980Z GOROOT='/opt/hostedtoolcache/go/1.26.10/x64'2026-10-31T02:56:16.5746546Z GOSUMDB='sum.golang.org'2026-10-31T02:56:16.5746956Z GOTELEMETRY='local'2026-10-31T02:56:16.5747456Z GOTELEMETRYDIR='/home/runner/.config/go/telemetry'2026-10-31T02:56:16.5747942Z GOTMPDIR=''2026-10-31T02:56:16.5748297Z GOTOOLCHAIN='local'2026-10-31T02:56:16.5748866Z GOTOOLDIR='/opt/hostedtoolcache/go/1.26.10/x64/pkg/tool/linux_amd64'2026-10-31T02:56:16.5749537Z GOVCS=''2026-10-31T02:56:16.5749877Z GOVERSION='go1.26.10'2026-10-31T02:56:16.5750274Z GOWORK=''2026-10-31T02:56:16.5750659Z PKG_CONFIG='pkg-config'2026-10-31T02:56:16.5750929Z 2026-10-31T02:56:16.5751466Z ##[endgroup]2026-10-31T02:56:16.5930314Z ##[group]Run go test ./test -v -count 1 -run TestOSPoolEP -timeout 15m2026-10-31T02:56:16.5930859Z go test ./test -v -count 1 -run TestOSPoolEP -timeout 15m2026-10-31T02:56:16.5996101Z shell: /usr/bin/bash -e {0}2026-10-31T02:56:16.5996387Z env:2026-10-31T02:56:16.5996597Z   GOTOOLCHAIN: local2026-10-31T02:56:16.5996848Z   OSPOOL_EP_OSPoolEPTag: 25-release2026-10-31T02:56:16.5997123Z   OSPOOL_EP_CMTag: 25.0-el92026-10-31T02:56:16.5997394Z   OSPOOL_EP_CvmfsType: cvmfsexec2026-10-31T02:56:16.5997652Z ##[endgroup]2026-10-31T02:56:16.7625347Z go: downloading github.com/gruntwork-io/terratest v0.56.02026-10-31T02:56:16.8081858Z go: downloading github.com/masterminds/sprig v2.22.0+incompatible2026-10-31T02:56:16.8761529Z go: downloading github.com/stretchr/testify v1.11.12026-10-31T02:56:16.9255221Z go: downloading gopkg.in/yaml.v3 v3.0.12026-10-31T02:56:16.9850929Z go: downloading k8s.io/api v0.35.02026-10-31T02:56:17.0689062Z go: downloading k8s.io/apimachinery v0.35.02026-10-31T02:56:18.2357563Z go: downloading github.com/Masterminds/goutils v1.1.12026-10-31T02:56:18.2540315Z go: downloading github.com/Masterminds/semver v1.5.02026-10-31T02:56:18.2720681Z go: downloading github.com/google/uuid v1.6.02026-10-31T02:56:18.2860505Z go: downloading github.com/huandu/xstrings v1.5.02026-10-31T02:56:18.3004777Z go: downloading github.com/imdario/mergo v0.3.162026-10-31T02:56:18.3172058Z go: downloading github.com/mitchellh/copystructure v1.2.02026-10-31T02:56:18.3287364Z go: downloading golang.org/x/crypto v0.52.02026-10-31T02:56:18.5346631Z go: downloading k8s.io/utils v0.0.0-20251002143259-bc988d571ff42026-10-31T02:56:18.5588472Z go: downloading sigs.k8s.io/randfill v1.0.02026-10-31T02:56:18.5713601Z go: downloading k8s.io/klog/v2 v2.130.12026-10-31T02:56:18.5788322Z go: downloading github.com/gruntwork-io/go-commons v0.8.02026-10-31T02:56:18.5907137Z go: downloading github.com/mitchellh/go-homedir v1.1.02026-10-31T02:56:18.5986358Z go: downloading k8s.io/client-go v0.35.02026-10-31T02:56:20.0619433Z go: downloading github.com/davecgh/go-spew v1.1.12026-10-31T02:56:20.0627128Z go: downloading github.com/pmezard/go-difflib v1.0.02026-10-31T02:56:20.0784413Z go: downloading github.com/mitchellh/reflectwalk v1.0.22026-10-31T02:56:20.3120443Z go: downloading gopkg.in/inf.v0 v0.9.12026-10-31T02:56:20.3928463Z go: downloading k8s.io/kube-openapi v0.0.0-20250910181357-589584f1c9122026-10-31T02:56:20.4036237Z go: downloading sigs.k8s.io/structured-merge-diff/v6 v6.3.02026-10-31T02:56:20.4480166Z go: downloading sigs.k8s.io/json v0.0.0-20250730193827-2d320260d7302026-10-31T02:56:20.4747857Z go: downloading github.com/aws/aws-sdk-go-v2 v1.32.52026-10-31T02:56:20.5131436Z go: downloading github.com/aws/aws-sdk-go-v2/config v1.28.52026-10-31T02:56:20.5687775Z go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.17.462026-10-31T02:56:20.5927853Z go: downloading github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.17.412026-10-31T02:56:20.6119034Z go: downloading github.com/aws/aws-sdk-go-v2/service/acm v1.30.62026-10-31T02:56:20.6156441Z go: downloading github.com/aws/aws-sdk-go-v2/service/autoscaling v1.51.02026-10-31T02:56:20.6360141Z go: downloading github.com/aws/aws-sdk-go-v2/service/cloudwatchlogs v1.44.02026-10-31T02:56:20.6434766Z go: downloading github.com/aws/aws-sdk-go-v2/service/dynamodb v1.37.12026-10-31T02:56:20.6902159Z go: downloading github.com/aws/aws-sdk-go-v2/service/ec2 v1.193.02026-10-31T02:56:20.6936386Z go: downloading github.com/aws/aws-sdk-go-v2/service/ecr v1.36.62026-10-31T02:56:20.7265331Z go: downloading github.com/aws/aws-sdk-go-v2/service/ecs v1.52.02026-10-31T02:56:20.7763589Z go: downloading github.com/aws/aws-sdk-go-v2/service/iam v1.38.12026-10-31T02:56:20.8596875Z go: downloading github.com/aws/aws-sdk-go-v2/service/kms v1.37.62026-10-31T02:56:20.9136439Z go: downloading github.com/aws/aws-sdk-go-v2/service/lambda v1.69.02026-10-31T02:56:20.9572944Z go: downloading github.com/aws/aws-sdk-go-v2/service/rds v1.91.02026-10-31T02:56:21.0401424Z go: downloading github.com/aws/aws-sdk-go-v2/service/route53 v1.46.22026-10-31T02:56:21.0637141Z go: downloading github.com/aws/aws-sdk-go-v2/service/s3 v1.69.02026-10-31T02:56:21.0866261Z go: downloading github.com/aws/aws-sdk-go-v2/service/sns v1.33.62026-10-31T02:56:21.0868752Z go: downloading github.com/aws/aws-sdk-go-v2/service/secretsmanager v1.34.62026-10-31T02:56:21.1156626Z go: downloading github.com/aws/aws-sdk-go-v2/service/sqs v1.37.12026-10-31T02:56:21.1408765Z go: downloading github.com/aws/aws-sdk-go-v2/service/ssm v1.56.02026-10-31T02:56:21.1502707Z go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.33.12026-10-31T02:56:21.1504282Z go: downloading github.com/go-sql-driver/mysql v1.8.12026-10-31T02:56:21.1820594Z go: downloading github.com/hashicorp/go-multierror v1.1.12026-10-31T02:56:21.1836615Z go: downloading github.com/jackc/pgx/v5 v5.9.02026-10-31T02:56:21.2052038Z go: downloading github.com/pquerna/otp v1.4.02026-10-31T02:56:21.2175957Z go: downloading github.com/mattn/go-zglob v0.0.2-0.20190814121620-e3c9456763262026-10-31T02:56:21.2309062Z go: downloading github.com/go-errors/errors v1.0.2-0.20180813162953-d98b870cc4e02026-10-31T02:56:21.2310210Z go: downloading github.com/urfave/cli v1.22.162026-10-31T02:56:21.2401965Z go: downloading github.com/go-logr/logr v1.4.32026-10-31T02:56:21.2807997Z go: downloading github.com/spf13/pflag v1.0.92026-10-31T02:56:21.2808656Z go: downloading golang.org/x/term v0.43.02026-10-31T02:56:21.2903584Z go: downloading github.com/gorilla/websocket v1.5.4-0.20250319132907-e064f32e36742026-10-31T02:56:21.2940221Z go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c8222026-10-31T02:56:21.3041747Z go: downloading golang.org/x/net v0.54.02026-10-31T02:56:21.5045395Z go: downloading github.com/fxamacker/cbor/v2 v2.9.02026-10-31T02:56:21.5079874Z go: downloading github.com/json-iterator/go v1.1.122026-10-31T02:56:21.5240561Z go: downloading go.yaml.in/yaml/v2 v2.4.32026-10-31T02:56:21.5364369Z go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.202026-10-31T02:56:21.5437331Z go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.8.12026-10-31T02:56:21.5460981Z go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.24.62026-10-31T02:56:21.5534353Z go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.28.52026-10-31T02:56:21.5576783Z go: downloading github.com/aws/smithy-go v1.22.12026-10-31T02:56:21.6139805Z go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.242026-10-31T02:56:21.6143599Z go: downloading github.com/jmespath/go-jmespath v0.4.02026-10-31T02:56:21.6159968Z go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.12026-10-31T02:56:21.6286441Z go: downloading github.com/aws/aws-sdk-go-v2/service/internal/endpoint-discovery v1.10.52026-10-31T02:56:21.6312349Z go: downloading github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.6.72026-10-31T02:56:21.6788760Z go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.52026-10-31T02:56:21.6833897Z go: downloading github.com/aws/aws-sdk-go-v2/internal/v4a v1.3.242026-10-31T02:56:21.6881575Z go: downloading github.com/aws/aws-sdk-go-v2/service/internal/checksum v1.4.52026-10-31T02:56:21.6958489Z go: downloading github.com/aws/aws-sdk-go-v2/service/internal/s3shared v1.18.52026-10-31T02:56:21.7094888Z go: downloading filippo.io/edwards25519 v1.1.02026-10-31T02:56:21.7095952Z go: downloading github.com/hashicorp/errwrap v1.0.02026-10-31T02:56:21.7198547Z go: downloading github.com/google/gnostic-models v0.7.02026-10-31T02:56:21.7255919Z go: downloading google.golang.org/protobuf v1.36.82026-10-31T02:56:21.7620542Z go: downloading golang.org/x/time v0.9.02026-10-31T02:56:21.7760214Z go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.52026-10-31T02:56:21.7986859Z go: downloading github.com/moby/spdystream v0.5.12026-10-31T02:56:21.8410498Z go: downloading golang.org/x/sys v0.45.02026-10-31T02:56:21.8718284Z go: downloading golang.org/x/oauth2 v0.30.02026-10-31T02:56:21.9290964Z go: downloading github.com/x448/float16 v0.8.42026-10-31T02:56:21.9475567Z go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd2026-10-31T02:56:21.9608721Z go: downloading github.com/modern-go/reflect2 v1.0.3-0.20250322232337-35a7c28c31ee2026-10-31T02:56:21.9775754Z go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.242026-10-31T02:56:21.9892054Z go: downloading github.com/boombuler/barcode v1.0.1-0.20190219062509-6c824513bacc2026-10-31T02:56:22.0160539Z go: downloading github.com/jackc/pgpassfile v1.0.02026-10-31T02:56:22.0161893Z go: downloading github.com/jackc/pgservicefile v0.0.0-20240606120523-5a60cdf6a7612026-10-31T02:56:22.0242522Z go: downloading golang.org/x/text v0.37.02026-10-31T02:56:22.0273442Z go: downloading github.com/jackc/puddle/v2 v2.2.22026-10-31T02:56:22.0434739Z go: downloading go.yaml.in/yaml/v3 v3.0.42026-10-31T02:56:22.0570656Z go: downloading github.com/russross/blackfriday/v2 v2.1.02026-10-31T02:56:22.0687561Z go: downloading sigs.k8s.io/yaml v1.6.02026-10-31T02:56:22.0786749Z go: downloading github.com/mxk/go-flowrate v0.0.0-20140419014527-cca7078d478f2026-10-31T02:56:22.4556027Z go: downloading golang.org/x/sync v0.20.02026-10-31T02:56:22.4560339Z go: downloading github.com/go-openapi/swag v0.23.02026-10-31T02:56:22.4561940Z go: downloading github.com/go-openapi/jsonreference v0.20.22026-10-31T02:56:22.4688346Z go: downloading gopkg.in/evanphx/json-patch.v4 v4.13.02026-10-31T02:56:22.4733957Z go: downloading github.com/emicklei/go-restful/v3 v3.12.22026-10-31T02:56:22.4756482Z go: downloading github.com/go-openapi/jsonpointer v0.21.02026-10-31T02:56:22.4788857Z go: downloading github.com/mailru/easyjson v0.7.72026-10-31T02:56:22.5009053Z go: downloading github.com/josharian/intern v1.0.02026-10-31T02:58:54.9490640Z === RUN   TestOSPoolEP2026-10-31T02:58:54.9491149Z === PAUSE TestOSPoolEP2026-10-31T02:58:54.9491574Z === CONT  TestOSPoolEP2026-10-31T02:58:54.9493900Z TestOSPoolEP 2026-10-31T02:58:54Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:58:54.9612531Z TestOSPoolEP 2026-10-31T02:58:54Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy apply -f /tmp/TestOSPoolEP374188062]2026-10-31T02:58:55.5248704Z TestOSPoolEP 2026-10-31T02:58:55Z logger.go:67: pod/idtoken-generator created2026-10-31T02:58:55.5342226Z TestOSPoolEP 2026-10-31T02:58:55Z logger.go:67: secret/pool-passwd created2026-10-31T02:58:55.5413720Z TestOSPoolEP 2026-10-31T02:58:55Z retry.go:91: Wait for pod idtoken-generator to be provisioned.2026-10-31T02:58:55.5415099Z TestOSPoolEP 2026-10-31T02:58:55Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:58:55.5440649Z TestOSPoolEP 2026-10-31T02:58:55Z retry.go:103: Wait for pod idtoken-generator to be provisioned. returned an error: Pod idtoken-generator is not available, reason: , message: . Sleeping for 10s and will try again.2026-10-31T02:59:05.5447517Z TestOSPoolEP 2026-10-31T02:59:05Z retry.go:91: Wait for pod idtoken-generator to be provisioned.2026-10-31T02:59:05.5449301Z TestOSPoolEP 2026-10-31T02:59:05Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:05.5479548Z TestOSPoolEP 2026-10-31T02:59:05Z logger.go:67: Pod is now available2026-10-31T02:59:05.5481640Z TestOSPoolEP 2026-10-31T02:59:05Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec idtoken-generator -- condor_token_create -authz READ -authz ADVERTISE_STARTD -authz ADVERTISE_MASTER -identity condor@test-cm]2026-10-31T02:59:06.5937816Z TestOSPoolEP 2026-10-31T02:59:06Z logger.go:67: ***2026-10-31T02:59:06.6009220Z TestOSPoolEP 2026-10-31T02:59:06Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy apply -f /tmp/TestOSPoolEP3187108744]2026-10-31T02:59:06.8036750Z TestOSPoolEP 2026-10-31T02:59:06Z logger.go:67: secret/pool-token created2026-10-31T02:59:06.8077183Z TestOSPoolEP 2026-10-31T02:59:06Z retry.go:91: Wait for secret pool-token to be provisioned.2026-10-31T02:59:06.8078728Z TestOSPoolEP 2026-10-31T02:59:06Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:06.8098416Z TestOSPoolEP 2026-10-31T02:59:06Z logger.go:67: Secret is now available2026-10-31T02:59:06.8129743Z TestOSPoolEP 2026-10-31T02:59:06Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy apply -k /tmp/kustomize-template-1759035852]2026-10-31T02:59:07.1436682Z TestOSPoolEP 2026-10-31T02:59:07Z logger.go:67: service/test-cm created2026-10-31T02:59:07.1541548Z TestOSPoolEP 2026-10-31T02:59:07Z logger.go:67: Warning: spec.template.spec.containers[0].env[8]: hides previous definition of "OSG_SQUID_LOCATION", which may be dropped when using apply2026-10-31T02:59:07.1548580Z TestOSPoolEP 2026-10-31T02:59:07Z logger.go:67: deployment.apps/ospool-ep created2026-10-31T02:59:07.1668105Z TestOSPoolEP 2026-10-31T02:59:07Z logger.go:67: deployment.apps/test-cm created2026-10-31T02:59:07.1730706Z === RUN   TestOSPoolEP/Confirm_deployments_become_ready.2026-10-31T02:59:07.1735684Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:07Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:07.1838331Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:07Z retry.go:91: Wait for deployment test-cm to be provisioned.2026-10-31T02:59:07.1846429Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:07Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:07.1848950Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:07Z retry.go:91: Wait for deployment ospool-ep to be provisioned.2026-10-31T02:59:07.1851264Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:07Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:07.1889737Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:07Z retry.go:103: Wait for deployment test-cm to be provisioned. returned an error: Deployment test-cm is not available as 'Progressing' condition indicates that the Deployment is not complete, status: True, reason: NewReplicaSetCreated, message: Created new replica set "test-cm-7f9d786cd6". Sleeping for 10s and will try again.2026-10-31T02:59:07.1897011Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:07Z retry.go:103: Wait for deployment ospool-ep to be provisioned. returned an error: Deployment ospool-ep is not available as 'Progressing' condition indicates that the Deployment is not complete, status: True, reason: NewReplicaSetCreated, message: Created new replica set "ospool-ep-549bffc4dc". Sleeping for 10s and will try again.2026-10-31T02:59:17.1898006Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:17Z retry.go:91: Wait for deployment ospool-ep to be provisioned.2026-10-31T02:59:17.1909141Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:17Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:17.1912126Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:17Z retry.go:91: Wait for deployment test-cm to be provisioned.2026-10-31T02:59:17.1914806Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:17Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:17.1951559Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:17Z retry.go:103: Wait for deployment ospool-ep to be provisioned. returned an error: Deployment ospool-ep is not available as 'Progressing' condition indicates that the Deployment is not complete, status: True, reason: ReplicaSetUpdated, message: ReplicaSet "ospool-ep-549bffc4dc" is progressing.. Sleeping for 10s and will try again.2026-10-31T02:59:17.1955472Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:17Z logger.go:67: Deployment is now available2026-10-31T02:59:27.1966111Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:27Z retry.go:91: Wait for deployment ospool-ep to be provisioned.2026-10-31T02:59:27.1968263Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:27Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:27.1996345Z TestOSPoolEP/Confirm_deployments_become_ready. 2026-10-31T02:59:27Z logger.go:67: Deployment is now available2026-10-31T02:59:27.1997919Z === RUN   TestOSPoolEP/Confirm_condor_status_lists_the_EP2026-10-31T02:59:27.1999781Z TestOSPoolEP/Confirm_condor_status_lists_the_EP 2026-10-31T02:59:27Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:27.2030096Z TestOSPoolEP/Confirm_condor_status_lists_the_EP 2026-10-31T02:59:27Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy cp ../test-configs/ospool-ep/condor_status.sh test-cm-7f9d786cd6-h9wp6:/tmp/condor_status.sh]2026-10-31T02:59:27.5571131Z TestOSPoolEP/Confirm_condor_status_lists_the_EP 2026-10-31T02:59:27Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- chmod +x /tmp/condor_status.sh]2026-10-31T02:59:27.7015113Z TestOSPoolEP/Confirm_condor_status_lists_the_EP 2026-10-31T02:59:27Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/condor_status.sh]2026-10-31T02:59:27.8515440Z TestOSPoolEP/Confirm_condor_status_lists_the_EP 2026-10-31T02:59:27Z logger.go:67: command terminated with exit code 12026-10-31T02:59:27.8552634Z     test_utils.go:102: Exec '[sh -c /tmp/condor_status.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 10s.2026-10-31T02:59:37.8581586Z TestOSPoolEP/Confirm_condor_status_lists_the_EP 2026-10-31T02:59:37Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/condor_status.sh]2026-10-31T02:59:38.0909507Z TestOSPoolEP/Confirm_condor_status_lists_the_EP 2026-10-31T02:59:38Z logger.go:67: command terminated with exit code 12026-10-31T02:59:38.0957909Z     test_utils.go:102: Exec '[sh -c /tmp/condor_status.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 10s.2026-10-31T02:59:48.0989811Z TestOSPoolEP/Confirm_condor_status_lists_the_EP 2026-10-31T02:59:48Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/condor_status.sh]2026-10-31T02:59:48.2557488Z === RUN   TestOSPoolEP/Confirm_EP_container_advertises_singularity2026-10-31T02:59:48.2559317Z TestOSPoolEP/Confirm_EP_container_advertises_singularity 2026-10-31T02:59:48Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:48.2582195Z TestOSPoolEP/Confirm_EP_container_advertises_singularity 2026-10-31T02:59:48Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy cp ../test-configs/ospool-ep/has_singularity.sh test-cm-7f9d786cd6-h9wp6:/tmp/has_singularity.sh]2026-10-31T02:59:48.4474971Z TestOSPoolEP/Confirm_EP_container_advertises_singularity 2026-10-31T02:59:48Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- chmod +x /tmp/has_singularity.sh]2026-10-31T02:59:48.5876029Z TestOSPoolEP/Confirm_EP_container_advertises_singularity 2026-10-31T02:59:48Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_singularity.sh]2026-10-31T02:59:48.7408970Z === RUN   TestOSPoolEP/Confirm_EP_container_advertises_CVMFS2026-10-31T02:59:48.7411051Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T02:59:48Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T02:59:48.7436333Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T02:59:48Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy cp ../test-configs/ospool-ep/has_cvmfs.sh test-cm-7f9d786cd6-h9wp6:/tmp/has_cvmfs.sh]2026-10-31T02:59:48.9250020Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T02:59:48Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- chmod +x /tmp/has_cvmfs.sh]2026-10-31T02:59:49.0647537Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T02:59:49Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_cvmfs.sh]2026-10-31T02:59:49.2246999Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T02:59:49Z logger.go:67: command terminated with exit code 12026-10-31T02:59:49.2286427Z     test_utils.go:102: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 30s.2026-10-31T03:00:19.2289303Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:00:19Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_cvmfs.sh]2026-10-31T03:00:19.3967498Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:00:19Z logger.go:67: command terminated with exit code 12026-10-31T03:00:19.4004610Z     test_utils.go:102: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 30s.2026-10-31T03:00:49.4008811Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:00:49Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_cvmfs.sh]2026-10-31T03:00:49.5559685Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:00:49Z logger.go:67: command terminated with exit code 12026-10-31T03:00:49.5596112Z     test_utils.go:102: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 30s.2026-10-31T03:01:19.5605673Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:01:19Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_cvmfs.sh]2026-10-31T03:01:19.7197809Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:01:19Z logger.go:67: command terminated with exit code 12026-10-31T03:01:19.7232079Z     test_utils.go:102: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 30s.2026-10-31T03:01:49.7236260Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:01:49Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_cvmfs.sh]2026-10-31T03:01:49.8755999Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:01:49Z logger.go:67: command terminated with exit code 12026-10-31T03:01:49.8787223Z     test_utils.go:102: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 30s.2026-10-31T03:02:19.8793381Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:02:19Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_cvmfs.sh]2026-10-31T03:02:20.0311032Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:02:20Z logger.go:67: command terminated with exit code 12026-10-31T03:02:20.0346211Z     test_utils.go:102: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 30s.2026-10-31T03:02:50.0378597Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:02:50Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_cvmfs.sh]2026-10-31T03:02:50.2000201Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:02:50Z logger.go:67: command terminated with exit code 12026-10-31T03:02:50.2035653Z     test_utils.go:102: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 30s.2026-10-31T03:03:20.2087632Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:03:20Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_cvmfs.sh]2026-10-31T03:03:20.3574670Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:03:20Z logger.go:67: command terminated with exit code 12026-10-31T03:03:20.3614979Z     test_utils.go:102: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 30s.2026-10-31T03:03:50.3618833Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:03:50Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_cvmfs.sh]2026-10-31T03:03:50.5265696Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:03:50Z logger.go:67: command terminated with exit code 12026-10-31T03:03:50.5303021Z     test_utils.go:102: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 30s.2026-10-31T03:04:20.5314446Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:04:20Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy exec test-cm-7f9d786cd6-h9wp6 -- sh -c /tmp/has_cvmfs.sh]2026-10-31T03:04:20.6896274Z TestOSPoolEP/Confirm_EP_container_advertises_CVMFS 2026-10-31T03:04:20Z logger.go:67: command terminated with exit code 12026-10-31T03:04:20.6930573Z     test_utils.go:102: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 failed. Retrying in 30s.2026-10-31T03:04:50.6933893Z     test_utils.go:105: Exec '[sh -c /tmp/has_cvmfs.sh]' in pod test-cm-7f9d786cd6-h9wp6 did not succeed within {10 30000000000} retries2026-10-31T03:04:50.6936895Z TestOSPoolEP 2026-10-31T03:04:50Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T03:04:50.7014867Z TestOSPoolEP 2026-10-31T03:04:50Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T03:04:50.9154630Z TestOSPoolEP 2026-10-31T03:04:50Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T03:04:51.0625226Z TestOSPoolEP 2026-10-31T03:04:51Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T03:04:51.1774525Z TestOSPoolEP 2026-10-31T03:04:51Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T03:04:51.1797892Z === NAME  TestOSPoolEP2026-10-31T03:04:51.1798518Z     ospool_ep_test.go:72: ---2026-10-31T03:04:51.1799400Z         Events for pod idtoken-generator:2026-10-31T03:04:51.1802039Z         2026-10-31 02:58:55 +0000 UTC	Normal	Successfully assigned test-ospool-ep-boolvy/idtoken-generator to minikube2026-10-31T03:04:51.1803714Z         2026-10-31 02:58:55 +0000 UTC	Normal	Pulling image "htcondor/base"2026-10-31T03:04:51.1806190Z         2026-10-31 02:59:01 +0000 UTC	Normal	Successfully pulled image "htcondor/base" in 5.458s (5.458s including waiting). Image size: 196303183 bytes.2026-10-31T03:04:51.1807590Z         2026-10-31 02:59:01 +0000 UTC	Normal	Container created2026-10-31T03:04:51.1808540Z         2026-10-31 02:59:01 +0000 UTC	Normal	Container started2026-10-31T03:04:51.1809903Z         2026-10-31T03:04:51.1811008Z         ---2026-10-31T03:04:51.1815527Z TestOSPoolEP 2026-10-31T03:04:51Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T03:04:51.1834298Z     ospool_ep_test.go:72: ---2026-10-31T03:04:51.1835800Z         Events for pod ospool-ep-549bffc4dc-n82gl:2026-10-31T03:04:51.1837941Z         2026-10-31 02:59:07 +0000 UTC	Normal	Successfully assigned test-ospool-ep-boolvy/ospool-ep-549bffc4dc-n82gl to minikube2026-10-31T03:04:51.1838921Z         2026-10-31 02:59:07 +0000 UTC	Normal	Pulling image "hub.opensciencegrid.org/library/alpine:3"2026-10-31T03:04:51.1840156Z         2026-10-31 02:59:09 +0000 UTC	Normal	Successfully pulled image "hub.opensciencegrid.org/library/alpine:3" in 1.422s (1.422s including waiting). Image size: 2893600 bytes.2026-10-31T03:04:51.1841026Z         2026-10-31 02:59:09 +0000 UTC	Normal	Container created2026-10-31T03:04:51.1841540Z         2026-10-31 02:59:09 +0000 UTC	Normal	Container started2026-10-31T03:04:51.1842314Z         2026-10-31 02:59:09 +0000 UTC	Normal	Pulling image "hub.opensciencegrid.org/osg-htc/ospool-ep:25-release"2026-10-31T03:04:51.1844078Z         2026-10-31 02:59:23 +0000 UTC	Normal	Successfully pulled image "hub.opensciencegrid.org/osg-htc/ospool-ep:25-release" in 10.718s (13.825s including waiting). Image size: 571972083 bytes.2026-10-31T03:04:51.1845017Z         2026-10-31 02:59:23 +0000 UTC	Normal	Container created2026-10-31T03:04:51.1845501Z         2026-10-31 02:59:23 +0000 UTC	Normal	Container started2026-10-31T03:04:51.1845827Z         2026-10-31T03:04:51.1846030Z         ---2026-10-31T03:04:51.1846601Z TestOSPoolEP 2026-10-31T03:04:51Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T03:04:51.1866062Z     ospool_ep_test.go:72: ---2026-10-31T03:04:51.1891595Z         Events for pod test-cm-7f9d786cd6-h9wp6:2026-10-31T03:04:51.1904613Z         2026-10-31 02:59:07 +0000 UTC	Normal	Successfully assigned test-ospool-ep-boolvy/test-cm-7f9d786cd6-h9wp6 to minikube2026-10-31T03:04:51.1905984Z         2026-10-31 02:59:07 +0000 UTC	Normal	Pulling image "htcondor/cm:25.0-el9"2026-10-31T03:04:51.1907725Z         2026-10-31 02:59:12 +0000 UTC	Normal	Successfully pulled image "htcondor/cm:25.0-el9" in 3.961s (5.344s including waiting). Image size: 198153089 bytes.2026-10-31T03:04:51.1909029Z         2026-10-31 02:59:12 +0000 UTC	Normal	Container created2026-10-31T03:04:51.1909819Z         2026-10-31 02:59:13 +0000 UTC	Normal	Container started2026-10-31T03:04:51.1910334Z         2026-10-31T03:04:51.1910648Z         ---2026-10-31T03:04:51.1911598Z TestOSPoolEP 2026-10-31T03:04:51Z logger.go:67: Configuring Kubernetes client using config file /home/runner/.kube/config with context 2026-10-31T03:04:51.1927184Z TestOSPoolEP 2026-10-31T03:04:51Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy delete -f /tmp/TestOSPoolEP405684939]2026-10-31T03:04:51.3233380Z TestOSPoolEP 2026-10-31T03:04:51Z logger.go:67: pod "idtoken-generator" deleted from test-ospool-ep-boolvy namespace2026-10-31T03:04:51.3313275Z TestOSPoolEP 2026-10-31T03:04:51Z logger.go:67: secret "pool-passwd" deleted from test-ospool-ep-boolvy namespace2026-10-31T03:04:52.5662146Z TestOSPoolEP 2026-10-31T03:04:52Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy delete -f /tmp/TestOSPoolEP2187780770]2026-10-31T03:04:52.6722622Z TestOSPoolEP 2026-10-31T03:04:52Z logger.go:67: secret "pool-token" deleted from test-ospool-ep-boolvy namespace2026-10-31T03:04:52.6772063Z TestOSPoolEP 2026-10-31T03:04:52Z logger.go:67: Running command kubectl with args [--namespace test-ospool-ep-boolvy delete -k /tmp/kustomize-template-1759035852]2026-10-31T03:04:52.8275157Z TestOSPoolEP 2026-10-31T03:04:52Z logger.go:67: service "test-cm" deleted from test-ospool-ep-boolvy namespace2026-10-31T03:04:52.8337694Z TestOSPoolEP 2026-10-31T03:04:52Z logger.go:67: deployment.apps "ospool-ep" deleted from test-ospool-ep-boolvy namespace2026-10-31T03:04:52.8402685Z TestOSPoolEP 2026-10-31T03:04:52Z logger.go:67: deployment.apps "test-cm" deleted from test-ospool-ep-boolvy namespace2026-10-31T03:04:52.8557444Z --- FAIL: TestOSPoolEP (357.90s)2026-10-31T03:04:52.8574466Z     --- PASS: TestOSPoolEP/Confirm_deployments_become_ready. (20.03s)2026-10-31T03:04:52.8575953Z     --- PASS: TestOSPoolEP/Confirm_condor_status_lists_the_EP (21.06s)2026-10-31T03:04:52.8577528Z     --- PASS: TestOSPoolEP/Confirm_EP_container_advertises_singularity (0.49s)2026-10-31T03:04:52.8578888Z     --- FAIL: TestOSPoolEP/Confirm_EP_container_advertises_CVMFS (301.95s)2026-10-31T03:04:52.8579916Z FAIL2026-10-31T03:04:52.8620706Z FAIL	github.com/osg-htc/k8s-integration-tests/test	357.922s2026-10-31T03:04:52.8762857Z FAIL2026-10-31T03:04:53.5264022Z ##[error]Process completed with exit code 1.2026-10-31T03:04:53.5316618Z ##[group]Run echo "HASH=$(echo -n "$TEST_ENV" | sha256sum | cut -d ' ' -f 1)" >> $GITHUB_OUTPUT2026-10-31T03:04:53.5317293Z echo "HASH=$(echo -n "$TEST_ENV" | sha256sum | cut -d ' ' -f 1)" >> $GITHUB_OUTPUT2026-10-31T03:04:53.5380240Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}2026-10-31T03:04:53.5380613Z env:2026-10-31T03:04:53.5380819Z   GOTOOLCHAIN: local2026-10-31T03:04:53.5381281Z   TEST_ENV: OSPOOL_EP_OSPoolEPTag: 25-releaseOSPOOL_EP_CMTag: 25.0-el9OSPOOL_EP_CvmfsType: cvmfsexec2026-10-31T03:04:53.5381781Z ##[endgroup]2026-10-31T03:04:53.5632141Z ##[group]Run actions/upload-artifact@v42026-10-31T03:04:53.5632671Z with:2026-10-31T03:04:53.5633649Z   name: TestOSPoolEP-4209b6e6ca3892f0c35b39cc3f79d8ed7c833a027d74e27ee4db89bbc1ce72322026-10-31T03:04:53.5634567Z   path: /tmp/k8s-tests2026-10-31T03:04:53.5634857Z   retention-days: 52026-10-31T03:04:53.5635197Z   if-no-files-found: warn2026-10-31T03:04:53.5635539Z   compression-level: 62026-10-31T03:04:53.5635770Z   overwrite: false2026-10-31T03:04:53.5636400Z   include-hidden-files: false2026-10-31T03:04:53.5636760Z env:2026-10-31T03:04:53.5636950Z   GOTOOLCHAIN: local2026-10-31T03:04:53.5637169Z ##[endgroup]2026-10-31T03:04:53.8258879Z (node:23793) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead.2026-10-31T03:04:53.8281991Z (Use `node --trace-deprecation ...` to show where the warning was created)2026-10-31T03:04:53.8386396Z With the provided path, there will be 6 files uploaded2026-10-31T03:04:53.8392281Z Artifact name is valid!2026-10-31T03:04:53.8393596Z Root directory input is valid!2026-10-31T03:04:54.0967710Z Beginning upload of artifact content to blob storage2026-10-31T03:04:54.1291648Z (node:23793) [DEP0169] DeprecationWarning: `url.parse()` behavior is not standardized and prone to errors that have security implications. Use the WHATWG URL API instead. CVEs are not issued for `url.parse()` vulnerabilities.2026-10-31T03:04:54.2475631Z Uploaded bytes 140672026-10-31T03:04:54.2805498Z Finished uploading artifact content to blob storage!2026-10-31T03:04:54.2806716Z SHA256 digest of uploaded artifact zip is 7cfb211d8aace512fd38f936967389a1178fce06e9f4aa6fc202ead9263d1df82026-10-31T03:04:54.2807783Z Finalizing artifact upload2026-10-31T03:04:54.6857104Z Artifact TestOSPoolEP-4209b6e6ca3892f0c35b39cc3f79d8ed7c833a027d74e27ee4db89bbc1ce7232.zip successfully finalized. Artifact ID 130272283102026-10-31T03:04:54.6859087Z Artifact TestOSPoolEP-4209b6e6ca3892f0c35b39cc3f79d8ed7c833a027d74e27ee4db89bbc1ce7232 has been successfully uploaded! Final size is 14067 bytes. Artifact ID is 130272283102026-10-31T03:04:54.6861503Z Artifact download URL: https://github.com/osg-htc/k8s-integration-tests/actions/runs/41162076948/artifacts/130272283102026-10-31T03:04:54.7087011Z Post job cleanup.2026-10-31T03:04:54.8080623Z [command]/usr/bin/git version2026-10-31T03:04:54.8131558Z git version 2.56.02026-10-31T03:04:54.8178600Z Temporarily overriding HOME='/home/runner/work/_temp/2b82f86a-5c20-4665-8534-8ccfa65c8338' before making global git config changes2026-10-31T03:04:54.8179971Z Adding repository directory to the temporary git global config as a safe directory2026-10-31T03:04:54.8185614Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/k8s-integration-tests/k8s-integration-tests2026-10-31T03:04:54.8236512Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand2026-10-31T03:04:54.8287804Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"2026-10-31T03:04:54.8614515Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader2026-10-31T03:04:54.8645238Z http.https://github.com/.extraheader2026-10-31T03:04:54.8669336Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader2026-10-31T03:04:54.8730134Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"2026-10-31T03:04:54.9043730Z [command]/usr/bin/git config --local --name-only --get-regexp ^includeIf\.gitdir:2026-10-31T03:04:54.9093624Z [command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url2026-10-31T03:04:54.9549979Z Cleaning up orphan processes2026-10-31T03:04:55.0331220Z ##[warning]Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/upload-artifact@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/