2023-06-05T14:13:24.3554492Z Requested labels: edge-runner-2 2023-06-05T14:13:24.3554824Z Job defined at: ncrvoyix-swt-retail/edge-infra/.github/workflows/presubmit.yaml@refs/pull/6026/merge 2023-06-05T14:13:24.3554965Z Waiting for a runner to pick up this job... 2023-06-05T14:13:24.5558191Z Job is about to start running on the runner: github-actions-runner-0304-green-golden-TerxpHNAem (organization) 2023-06-05T14:13:29.5422097Z Current runner version: '2.304.0' 2023-06-05T14:13:29.5428556Z Runner name: 'github-actions-runner-0304-green-golden-TerxpHNAem' 2023-06-05T14:13:29.5429044Z Runner group name: 'edge-runner-2' 2023-06-05T14:13:29.5429653Z Machine name: 'github-actions-runner-0304-green' 2023-06-05T14:13:29.5431153Z ##[group]GITHUB_TOKEN Permissions 2023-06-05T14:13:29.5431654Z Actions: write 2023-06-05T14:13:29.5431842Z Checks: write 2023-06-05T14:13:29.5432029Z Contents: write 2023-06-05T14:13:29.5432223Z Deployments: write 2023-06-05T14:13:29.5432405Z Discussions: write 2023-06-05T14:13:29.5432588Z Issues: write 2023-06-05T14:13:29.5432772Z Metadata: read 2023-06-05T14:13:29.5432966Z Packages: write 2023-06-05T14:13:29.5433136Z Pages: write 2023-06-05T14:13:29.5433322Z PullRequests: write 2023-06-05T14:13:29.5433544Z RepositoryProjects: write 2023-06-05T14:13:29.5433757Z SecurityEvents: write 2023-06-05T14:13:29.5433937Z Statuses: write 2023-06-05T14:13:29.5434119Z ##[endgroup] 2023-06-05T14:13:29.5437746Z Secret source: Actions 2023-06-05T14:13:29.5438115Z Prepare workflow directory 2023-06-05T14:13:29.6646416Z Prepare all required actions 2023-06-05T14:13:29.6976688Z Complete job name: ci 2023-06-05T14:13:29.7638641Z ##[group]Checking docker version 2023-06-05T14:13:29.7655320Z ##[command]/usr/bin/docker version --format '{{.Server.APIVersion}}' 2023-06-05T14:13:29.8101398Z '1.41' 2023-06-05T14:13:29.8111972Z Docker daemon API version: '1.41' 2023-06-05T14:13:29.8112425Z ##[command]/usr/bin/docker version --format '{{.Client.APIVersion}}' 2023-06-05T14:13:29.8364309Z '1.41' 2023-06-05T14:13:29.8383649Z Docker client API version: '1.41' 2023-06-05T14:13:29.8390309Z ##[endgroup] 2023-06-05T14:13:29.8393936Z ##[group]Clean up resources from previous jobs 2023-06-05T14:13:29.8399962Z ##[command]/usr/bin/docker ps --all --quiet --no-trunc --filter "label=c3c473" 2023-06-05T14:13:29.8624495Z ##[command]/usr/bin/docker network prune --force --filter "label=c3c473" 2023-06-05T14:13:29.8844180Z ##[endgroup] 2023-06-05T14:13:29.8844534Z ##[group]Create local container network 2023-06-05T14:13:29.8856740Z ##[command]/usr/bin/docker network create --label c3c473 github_network_670a5edc05b6408fbe88397f3db1a871 2023-06-05T14:13:29.9795002Z 7484b873f578b3fb91f45637de5fdd91da97604b1e3ddebd9a2731804b3e4a07 2023-06-05T14:13:29.9818363Z ##[endgroup] 2023-06-05T14:13:29.9903867Z ##[group]Starting job container 2023-06-05T14:13:29.9925501Z ##[command]/usr/bin/docker --config /opt/github/actions-runner/_work/_temp/.docker_e65ced2f-fe1a-40b0-b2da-229108e6ad9d login us-east1-docker.pkg.dev -u _json_key_base64 --password-stdin 2023-06-05T14:13:30.0725675Z ##[command]/usr/bin/docker --config /opt/github/actions-runner/_work/_temp/.docker_e65ced2f-fe1a-40b0-b2da-229108e6ad9d pull us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/build-fractions:dev 2023-06-05T14:13:30.1550064Z dev: Pulling from ret-edge-pltf-infra/workloads/build-fractions 2023-06-05T14:13:30.1568521Z Digest: sha256:faf9aa5b9bd6d4dd759bda6d6a75e5c53646dbd3e6bbfb9045436bc69736a6f4 2023-06-05T14:13:30.1569452Z Status: Image is up to date for us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/build-fractions:dev 2023-06-05T14:13:30.1583185Z us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/build-fractions:dev 2023-06-05T14:13:30.1735122Z ##[command]/usr/bin/docker create --name 882731f15bff46e4aad07a6dd98eaa0d_useast1dockerpkgdevretedgepltfinfraworkloadsbuildfractionsdev_e3bc32 --label c3c473 --workdir /__w/edge-infra/edge-infra --network github_network_670a5edc05b6408fbe88397f3db1a871 -e "HOME=/github/home" -e GITHUB_ACTIONS=true -e CI=true -v "/var/run/docker.sock":"/var/run/docker.sock" -v "/opt/github/actions-runner/_work":"/__w" -v "/opt/github/actions-runner/externals":"/__e":ro -v "/opt/github/actions-runner/_work/_temp":"/__w/_temp" -v "/opt/github/actions-runner/_work/_actions":"/__w/_actions" -v "/opt/github/actions-runner/_work/_tool":"/__w/_tool" -v "/opt/github/actions-runner/_work/_temp/_github_home":"/github/home" -v "/opt/github/actions-runner/_work/_temp/_github_workflow":"/github/workflow" --entrypoint "tail" us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/build-fractions:dev "-f" "/dev/null" 2023-06-05T14:13:30.2554882Z db1823c375d25f16d93ab871d9daa7ffffa6986cefd2877f4c359c10fc159f0f 2023-06-05T14:13:30.2588137Z ##[command]/usr/bin/docker start db1823c375d25f16d93ab871d9daa7ffffa6986cefd2877f4c359c10fc159f0f 2023-06-05T14:13:30.6221882Z db1823c375d25f16d93ab871d9daa7ffffa6986cefd2877f4c359c10fc159f0f 2023-06-05T14:13:30.6245218Z ##[command]/usr/bin/docker ps --all --filter id=db1823c375d25f16d93ab871d9daa7ffffa6986cefd2877f4c359c10fc159f0f --filter status=running --no-trunc --format "{{.ID}} {{.Status}}" 2023-06-05T14:13:30.6649695Z db1823c375d25f16d93ab871d9daa7ffffa6986cefd2877f4c359c10fc159f0f Up Less than a second 2023-06-05T14:13:30.6675374Z ##[command]/usr/bin/docker inspect --format "{{range .Config.Env}}{{println .}}{{end}}" db1823c375d25f16d93ab871d9daa7ffffa6986cefd2877f4c359c10fc159f0f 2023-06-05T14:13:30.6873339Z HOME=/github/home 2023-06-05T14:13:30.6873691Z GITHUB_ACTIONS=true 2023-06-05T14:13:30.6873871Z CI=true 2023-06-05T14:13:30.6874077Z BAZELISK_HOME=/__w/_tool/.cache/bazelisk 2023-06-05T14:13:30.6874684Z DEBIAN_FRONTEND=noninteractive 2023-06-05T14:13:30.6874909Z GOBIN=/usr/local/go/bin 2023-06-05T14:13:30.6875139Z GOLANGCI_LINT_CACHE=/__w/_tool/.cache/golangci-lint 2023-06-05T14:13:30.6875462Z PATH=/usr/local/go/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2023-06-05T14:13:30.6902152Z ##[endgroup] 2023-06-05T14:13:30.6934103Z ##[group]Waiting for all services to be ready 2023-06-05T14:13:30.6935989Z ##[endgroup] 2023-06-05T14:13:30.7368730Z ##[group]Run github-actions-clone-repo.sh 2023-06-05T14:13:30.7369147Z github-actions-clone-repo.sh 2023-06-05T14:13:30.7373232Z shell: sh -e {0} 2023-06-05T14:13:30.7373460Z env: 2023-06-05T14:13:30.7373655Z REPORT_DIR: tmp/junit 2023-06-05T14:13:30.7374252Z GITHUB_TOKEN: *** 2023-06-05T14:13:30.7374437Z ##[endgroup] 2023-06-05T14:13:30.8460392Z Checking if current directory is a Git repo and deleting it if so 2023-06-05T14:13:30.8462140Z Initialized empty Git repository in /__w/edge-infra/edge-infra/.git/ 2023-06-05T14:13:30.8490610Z This is a pull_request event, cloning PR + master. 2023-06-05T14:13:33.5377236Z From https://github.com/ncrvoyix-swt-retail/edge-infra 2023-06-05T14:13:33.5377761Z * [new branch] master -> master 2023-06-05T14:13:33.5378341Z * [new branch] chore/bump-golint -> chore/bump-golint 2023-06-05T14:13:33.5378997Z * [new branch] master -> origin/master 2023-06-05T14:13:33.5379830Z * [new branch] chore/bump-golint -> origin/chore/bump-golint 2023-06-05T14:13:33.5451857Z Checking out chore/bump-golint 2023-06-05T14:13:34.1918194Z Switched to branch 'chore/bump-golint' 2023-06-05T14:13:34.1947224Z Done. 2023-06-05T14:13:34.2156552Z ##[group]Run gcloud auth list 2023-06-05T14:13:34.2156819Z gcloud auth list 2023-06-05T14:13:34.2157155Z gcloud config set account github-actions-runner@ret-edge-pltf-infra.iam.gserviceaccount.com 2023-06-05T14:13:34.2157579Z gcloud auth configure-docker us-east1-docker.pkg.dev --quiet 2023-06-05T14:13:34.2157944Z shell: sh -e {0} 2023-06-05T14:13:34.2158126Z env: 2023-06-05T14:13:34.2158296Z REPORT_DIR: tmp/junit 2023-06-05T14:13:34.2158495Z ##[endgroup] 2023-06-05T14:13:36.7297966Z 2023-06-05T14:13:36.7298674Z To set the active account, run: 2023-06-05T14:13:36.7299122Z $ gcloud config set account `ACCOUNT` 2023-06-05T14:13:36.7299276Z 2023-06-05T14:13:36.7299374Z Credentialed Accounts 2023-06-05T14:13:36.7299606Z ACTIVE ACCOUNT 2023-06-05T14:13:36.7300200Z * github-actions-runner@ret-edge-dev-infra.iam.gserviceaccount.com 2023-06-05T14:13:39.2945995Z Updated property [core/account]. 2023-06-05T14:13:41.8260555Z Adding credentials for: us-east1-docker.pkg.dev 2023-06-05T14:13:41.8629460Z Docker configuration file updated. 2023-06-05T14:13:42.0237265Z ##[group]Run just ci -commit-range=master..chore/bump-golint -run-id=5177987294 2023-06-05T14:13:42.0238157Z just ci -commit-range=master..chore/bump-golint -run-id=5177987294 2023-06-05T14:13:42.0238703Z shell: sh -e {0} 2023-06-05T14:13:42.0238977Z env: 2023-06-05T14:13:42.0239288Z REPORT_DIR: tmp/junit 2023-06-05T14:13:42.0239580Z ##[endgroup] 2023-06-05T14:13:42.1149324Z find -L "$(bazel info bazel-testlogs)" -name 'test.xml' | xargs rm -f {} 2023-06-05T14:13:42.1235354Z Extracting Bazel installation... 2023-06-05T14:13:43.8918037Z Starting local Bazel server and connecting to it... 2023-06-05T14:13:45.6693180Z INFO: Invocation ID: 62553b6c-8b19-47b4-9cde-0dbc9daeba77 2023-06-05T14:13:57.3395372Z find: '/github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs': No such file or directory 2023-06-05T14:13:57.3406333Z bazel run --config=ci hack/build/ci/leaf -- --bazel-configs=ci -commit-range=master..chore/bump-golint -run-id=5177987294 2023-06-05T14:13:57.3824477Z INFO: Invocation ID: e18c7b58-f81c-45e1-ab09-5e507dc0c0dc 2023-06-05T14:13:57.3877937Z INFO: Options provided by the client: 2023-06-05T14:13:57.3878367Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:13:57.3878780Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:13:57.3879323Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:13:57.3881836Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:13:57.3882619Z Inherited 'build' options: --config=cache 2023-06-05T14:13:57.3883336Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:13:57.3884757Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:13:57.3886821Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:13:57.3888444Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:13:57.3889436Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:13:57.3890253Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:14:43.4254072Z INFO: Analyzed target //hack/build/ci/leaf:leaf (245 packages loaded, 14411 targets configured). 2023-06-05T14:14:43.4333171Z INFO: Found 1 target... 2023-06-05T14:14:47.8006531Z Target //hack/build/ci/leaf:leaf up-to-date: 2023-06-05T14:14:47.8007003Z bazel-bin/hack/build/ci/leaf/leaf_/leaf 2023-06-05T14:14:47.8437813Z INFO: Elapsed time: 50.451s, Critical Path: 2.64s 2023-06-05T14:14:47.8438314Z INFO: 191 processes: 56 disk cache hit, 129 remote cache hit, 5 internal, 1 processwrapper-sandbox. 2023-06-05T14:14:47.8478021Z INFO: Running command line: bazel-bin/hack/build/ci/leaf/leaf_/leaf '--bazel-configs=ci' '-commit-range=master..chore/bump-golint' '-run-id=5177987294' 2023-06-05T14:14:47.8787416Z 2023/06/05 14:14:47 Diffing master..chore/bump-golint 2023-06-05T14:14:47.8819567Z 2023/06/05 14:14:47 Querying Bazel for associated labels 2023-06-05T14:14:48.1845544Z 2023/06/05 14:14:48 Found cmd/edge/iam/active-ttl:main.go 2023-06-05T14:14:48.2916347Z 2023/06/05 14:14:48 Found cmd/edge/kpt-fns/addcluster:main.go 2023-06-05T14:14:48.3882803Z 2023/06/05 14:14:48 Found cmd/edge/kpt-fns/addexternalsecret:main.go 2023-06-05T14:14:48.4768982Z 2023/06/05 14:14:48 Found cmd/edge/kpt-fns/addhelmrepository:main.go 2023-06-05T14:14:48.5659243Z 2023/06/05 14:14:48 Found cmd/edge/kpt-fns/addnamespace:main.go 2023-06-05T14:14:48.6575467Z 2023/06/05 14:14:48 Found cmd/edge/kpt-fns/addtenant:main.go 2023-06-05T14:14:48.7447239Z 2023/06/05 14:14:48 Found cmd/edge/kpt-fns/unthossorter:main.go 2023-06-05T14:14:48.8357839Z 2023/06/05 14:14:48 Found cmd/edge/kpt-fns/clustersel:main.go 2023-06-05T14:14:48.9226482Z 2023/06/05 14:14:48 Found cmd/edge/kpt-fns/clusterselgen:main.go 2023-06-05T14:14:49.0076328Z 2023/06/05 14:14:49 Found cmd/edge/kpt-fns/componentlabels:main.go 2023-06-05T14:14:49.0922610Z 2023/06/05 14:14:49 Found cmd/edge/kpt-fns/deleteresource:main.go 2023-06-05T14:14:49.1823002Z 2023/06/05 14:14:49 Found cmd/edge/kpt-fns/duplicatenamespacecheck:main.go 2023-06-05T14:14:49.2746959Z 2023/06/05 14:14:49 Found cmd/edge/kpt-fns/edgerelease:main.go 2023-06-05T14:14:49.3649757Z 2023/06/05 14:14:49 Found cmd/edge/kpt-fns/kubeval:main.go 2023-06-05T14:14:49.4555521Z 2023/06/05 14:14:49 Found cmd/edge/kpt-fns/normalizer:main.go 2023-06-05T14:14:49.5394924Z 2023/06/05 14:14:49 Found cmd/edge/kpt-fns/trimmer:main.go 2023-06-05T14:14:49.6467006Z 2023/06/05 14:14:49 Found cmd/edge/kpt-fns/uniquenesschecker:main.go 2023-06-05T14:14:49.7305479Z 2023/06/05 14:14:49 Found cmd/edge/kpt-fns/validatenamespace:main.go 2023-06-05T14:14:49.8140337Z 2023/06/05 14:14:49 Found cmd/edge/kpt-fns/verifyrolebindings:main.go 2023-06-05T14:14:49.8978176Z 2023/06/05 14:14:49 Found cmd/f8n/monitoring/alertman/cli:create.go 2023-06-05T14:14:49.9778789Z 2023/06/05 14:14:49 Found cmd/f8n/monitoring/alertman/cli:delete.go 2023-06-05T14:14:50.0580141Z 2023/06/05 14:14:50 Found cmd/f8n/monitoring/alertman/cli:get.go 2023-06-05T14:14:50.1415798Z 2023/06/05 14:14:50 Found cmd/f8n/monitoring/alertman/cli:sync.go 2023-06-05T14:14:50.2297630Z 2023/06/05 14:14:50 Found cmd/f8n/monitoring/alertman/cli:update.go 2023-06-05T14:14:50.3161637Z 2023/06/05 14:14:50 Found cmd/f8n/monitoring/dashman/cli:sync.go 2023-06-05T14:14:50.4428948Z 2023/06/05 14:14:50 Found hack/tools:bin.bzl 2023-06-05T14:14:50.5242446Z 2023/06/05 14:14:50 Found hack/tools/eyede/utils:utils.go 2023-06-05T14:14:50.6054608Z 2023/06/05 14:14:50 Found hack/tools/hiss:main.go 2023-06-05T14:14:50.7105253Z 2023/06/05 14:14:50 Found hack/tools/hr/utils:utils.go 2023-06-05T14:14:50.7902739Z 2023/06/05 14:14:50 Found hack/tools/linters:golangcilint.yaml 2023-06-05T14:14:50.8723231Z 2023/06/05 14:14:50 Found hack/tools/lumberjack/utils:utils.go 2023-06-05T14:14:50.9552891Z 2023/06/05 14:14:50 Found pkg/edge/api/apierror:converter.go 2023-06-05T14:14:51.0343333Z 2023/06/05 14:14:51 Found pkg/edge/api/graph/integration:helm_service_test.go 2023-06-05T14:14:51.1126959Z 2023/06/05 14:14:51 Found pkg/edge/api/graph/integration:organization_queries_test.go 2023-06-05T14:14:51.1866942Z 2023/06/05 14:14:51 Found pkg/edge/api/graph/integration:resolver_test.go 2023-06-05T14:14:51.2659456Z 2023/06/05 14:14:51 Found pkg/edge/api/graph/mapper:get_functions.go 2023-06-05T14:14:51.3415872Z 2023/06/05 14:14:51 Found pkg/edge/api/graph/mapper:helm_release_post_renderer.go 2023-06-05T14:14:51.4219530Z 2023/06/05 14:14:51 Found pkg/edge/api/graph/resolver:terminal_orchestration.go 2023-06-05T14:14:51.5009327Z 2023/06/05 14:14:51 Found pkg/edge/api/graph/setup:bff_setup.go 2023-06-05T14:14:51.5777339Z 2023/06/05 14:14:51 Found pkg/edge/api/graph/setup:logger.go 2023-06-05T14:14:51.6582175Z 2023/06/05 14:14:51 Found pkg/edge/api/services:bsl_mock_server.go 2023-06-05T14:14:51.7380459Z 2023/06/05 14:14:51 Found pkg/edge/api/services:bsp_groups.go 2023-06-05T14:14:51.8121002Z 2023/06/05 14:14:51 Found pkg/edge/api/services:capability_service.go 2023-06-05T14:14:51.8871682Z 2023/06/05 14:14:51 Found pkg/edge/api/services:registration_service.go 2023-06-05T14:14:51.9611552Z 2023/06/05 14:14:51 Found pkg/edge/api/services:secret_service.go 2023-06-05T14:14:52.0367701Z 2023/06/05 14:14:52 Found pkg/edge/api/services:services_test.go 2023-06-05T14:14:52.1277063Z 2023/06/05 14:14:52 Found pkg/edge/api/services:store_service.go 2023-06-05T14:14:52.2048104Z 2023/06/05 14:14:52 Found pkg/edge/api/services:user_management_service.go 2023-06-05T14:14:52.2813766Z 2023/06/05 14:14:52 Found pkg/edge/api/utils:mock_server_test.go 2023-06-05T14:14:52.3616310Z 2023/06/05 14:14:52 Found pkg/edge/chariot:metrics.go 2023-06-05T14:14:52.4374213Z 2023/06/05 14:14:52 Found pkg/edge/chariot:metrics_test.go 2023-06-05T14:14:52.5125418Z 2023/06/05 14:14:52 Found pkg/edge/chariot:mockpubsubpull_test.go 2023-06-05T14:14:52.5931718Z 2023/06/05 14:14:52 Found pkg/edge/chariot:response.go 2023-06-05T14:14:52.6686559Z 2023/06/05 14:14:52 Found pkg/edge/chariot:response_test.go 2023-06-05T14:14:52.7470916Z 2023/06/05 14:14:52 Found pkg/edge/cli/commands/updateclustersecret:updateclustersecret.go 2023-06-05T14:14:52.8254645Z 2023/06/05 14:14:52 Found pkg/edge/cli/edgecliutils:flags.go 2023-06-05T14:14:52.9083466Z 2023/06/05 14:14:52 Found pkg/edge/controllers/bannerctl:bannerctl_test.go 2023-06-05T14:14:52.9857764Z 2023/06/05 14:14:52 Found pkg/edge/controllers/clusterctl:gke_cluster_ctl.go 2023-06-05T14:14:53.0654923Z 2023/06/05 14:14:53 Found pkg/edge/controllers/clusterctl/pkg/plugins:flux_setup.go 2023-06-05T14:14:53.1399007Z 2023/06/05 14:14:53 Found pkg/edge/controllers/clusterctl/pkg/plugins:okta_client_registration.go 2023-06-05T14:14:53.2232956Z 2023/06/05 14:14:53 Found pkg/edge/controllers/envctl:persistence_controller.go 2023-06-05T14:14:53.3055447Z 2023/06/05 14:14:53 Found pkg/edge/controllers/syncedobject:controller_test.go 2023-06-05T14:14:53.3860330Z 2023/06/05 14:14:53 Found pkg/edge/datasync/chirp/server/grpc:msg.go 2023-06-05T14:14:53.4624261Z 2023/06/05 14:14:53 Found pkg/edge/datasync/chirp/server/http:liveness.go 2023-06-05T14:14:53.5353925Z 2023/06/05 14:14:53 Found pkg/edge/datasync/chirp/server/http:readiness.go 2023-06-05T14:14:53.6157307Z 2023/06/05 14:14:53 Found pkg/edge/datasync/controllers/couchctl:couchctl_test.go 2023-06-05T14:14:53.7059504Z 2023/06/05 14:14:53 Found pkg/edge/datasync/couchdb:couchdb.go 2023-06-05T14:14:53.7799122Z 2023/06/05 14:14:53 Found pkg/edge/datasync/couchdb:secrets.go 2023-06-05T14:14:53.8559727Z 2023/06/05 14:14:53 Found pkg/edge/datasync/cushion:receiver.go 2023-06-05T14:14:53.9306879Z 2023/06/05 14:14:53 Found pkg/edge/datasync/shoot/http:liveness.go 2023-06-05T14:14:54.0072714Z 2023/06/05 14:14:54 Found pkg/edge/gitops/fn/testutil:testutil.go 2023-06-05T14:14:54.0810685Z 2023/06/05 14:14:54 Found pkg/edge/gitops/fns/edgerelease:edgerelease.go 2023-06-05T14:14:54.1565304Z 2023/06/05 14:14:54 Found pkg/edge/iam/barcode:compose.go 2023-06-05T14:14:54.2481066Z 2023/06/05 14:14:54 Found pkg/edge/iam/barcode:emergency.go 2023-06-05T14:14:54.3229826Z 2023/06/05 14:14:54 Found pkg/edge/iam/barcode:flow.go 2023-06-05T14:14:54.3977581Z 2023/06/05 14:14:54 Found pkg/edge/iam/barcode:flow_code.go 2023-06-05T14:14:54.4728142Z 2023/06/05 14:14:54 Found pkg/edge/iam/barcode:scope.go 2023-06-05T14:14:54.5493221Z 2023/06/05 14:14:54 Found pkg/edge/iam/client:compose.go 2023-06-05T14:14:54.6233575Z 2023/06/05 14:14:54 Found pkg/edge/iam/client:roles.go 2023-06-05T14:14:54.7024250Z 2023/06/05 14:14:54 Found pkg/edge/iam/storage/database:client_storage.go 2023-06-05T14:14:54.7786772Z 2023/06/05 14:14:54 Found pkg/edge/iam/storage/database:redis_session.go 2023-06-05T14:14:54.8561069Z 2023/06/05 14:14:54 Found pkg/edge/iam/storage/database:storage_access_token.go 2023-06-05T14:14:54.9323733Z 2023/06/05 14:14:54 Found pkg/edge/iam/storage/database:storage_authorize_code.go 2023-06-05T14:14:55.0079597Z 2023/06/05 14:14:55 Found pkg/edge/iam/storage/database:storage_barcode.go 2023-06-05T14:14:55.0822846Z 2023/06/05 14:14:55 Found pkg/edge/iam/storage/database:storage_oidc.go 2023-06-05T14:14:55.1559053Z 2023/06/05 14:14:55 Found pkg/edge/iam/storage/database:storage_pkce.go 2023-06-05T14:14:55.2305512Z 2023/06/05 14:14:55 Found pkg/edge/iam/storage/database:storage_refresh_token.go 2023-06-05T14:14:55.3060495Z 2023/06/05 14:14:55 Found pkg/edge/iam/storage/database:storage_revoke_token.go 2023-06-05T14:14:55.3847627Z 2023/06/05 14:14:55 Found pkg/edge/iam/storage/memory:memstore.go 2023-06-05T14:14:55.4751393Z 2023/06/05 14:14:55 Found pkg/edge/iam/storage:request.go 2023-06-05T14:14:55.5512527Z 2023/06/05 14:14:55 Found pkg/edge/linkerd/apis/linkerd/v1alpha1:linkerd_webhook.go 2023-06-05T14:14:55.6271260Z 2023/06/05 14:14:55 Found pkg/edge/linkerd/controllers:linkerd_controller.go 2023-06-05T14:14:55.7007089Z 2023/06/05 14:14:55 Found pkg/edge/linkerd/controllers:linkerd_controller_test.go 2023-06-05T14:14:55.7795891Z 2023/06/05 14:14:55 Found pkg/f8n/devinfra/gcp/job/storage:integration_test.go 2023-06-05T14:14:55.8553816Z 2023/06/05 14:14:55 Found pkg/f8n/devinfra/ghappman:session_test.go 2023-06-05T14:14:55.9305700Z 2023/06/05 14:14:55 Found pkg/f8n/devinfra/jack/guest_services:list.go 2023-06-05T14:14:56.0175786Z 2023/06/05 14:14:56 Found pkg/f8n/devinfra/jack/guest_services:parser.go 2023-06-05T14:14:56.0970096Z 2023/06/05 14:14:56 Found pkg/f8n/devinfra/jack/plugin:interfaces.go 2023-06-05T14:14:56.1753606Z 2023/06/05 14:14:56 Found pkg/f8n/devinfra/jack/plugin/milestones:handler.go 2023-06-05T14:14:56.2512694Z 2023/06/05 14:14:56 Found pkg/f8n/devinfra/jack/plugin:plugins.go 2023-06-05T14:14:56.3274262Z 2023/06/05 14:14:56 Found pkg/f8n/devinfra/jack/plugin/triage_issue:issue.go 2023-06-05T14:14:56.4040729Z 2023/06/05 14:14:56 Found pkg/f8n/devinfra/slacker:subscriber.go 2023-06-05T14:14:56.4830756Z 2023/06/05 14:14:56 Found pkg/f8n/gcp/k8s/controllers/logsink:logsink_controller_test.go 2023-06-05T14:14:56.5591848Z 2023/06/05 14:14:56 Found pkg/f8n/gcp/k8s/controllers/projectinit:project_controller_test.go 2023-06-05T14:14:56.6384833Z 2023/06/05 14:14:56 Found pkg/f8n/kinform/client:publisher.go 2023-06-05T14:14:56.7139210Z 2023/06/05 14:14:56 Found pkg/f8n/kinform/model:model.go 2023-06-05T14:14:56.7883473Z 2023/06/05 14:14:56 Found pkg/f8n/lighthouse:listener.go 2023-06-05T14:14:56.8634526Z 2023/06/05 14:14:56 Found pkg/edge/logging/k8s/controllers/fluentbitctl:fluentbitctl.go 2023-06-05T14:14:56.9365661Z 2023/06/05 14:14:56 Found pkg/edge/logging/k8s/controllers/fluentbitctl:fluentbitctl_test.go 2023-06-05T14:14:57.0109635Z 2023/06/05 14:14:57 Found pkg/f8n/monitoring/am-webhook:am-webhook.go 2023-06-05T14:14:57.0879344Z 2023/06/05 14:14:57 Found pkg/f8n/monitoring/billman/cmd/logs:logs.go 2023-06-05T14:14:57.1631266Z 2023/06/05 14:14:57 Found pkg/f8n/monitoring/billman/cmd/metrics:metrics.go 2023-06-05T14:14:57.2419576Z 2023/06/05 14:14:57 Found pkg/f8n/monitoring/k8s/controllers/prometheusctl:prometheus_stackdriver_controller.go 2023-06-05T14:14:57.3168202Z 2023/06/05 14:14:57 Found pkg/f8n/monitoring/k8s/controllers/prometheusctl:prometheus_stackdriver_controller_test.go 2023-06-05T14:14:57.4079392Z 2023/06/05 14:14:57 Found pkg/f8n/monitoring/plank:plank.go 2023-06-05T14:14:57.4843766Z 2023/06/05 14:14:57 Found pkg/f8n/warehouse/forwarder:subscriber.go 2023-06-05T14:14:57.5609623Z 2023/06/05 14:14:57 Found pkg/f8n/warehouse/forwarder:subscriber_test.go 2023-06-05T14:14:57.6374036Z 2023/06/05 14:14:57 Found pkg/f8n/warehouse/lift/cmd/flatten:flatten.go 2023-06-05T14:14:57.7114940Z 2023/06/05 14:14:57 Found pkg/f8n/warehouse/lift/cmd/internal/command:applier.go 2023-06-05T14:14:57.7921417Z 2023/06/05 14:14:57 Found pkg/f8n/warehouse/lift/cmd/pallet:init.go 2023-06-05T14:14:57.8681091Z 2023/06/05 14:14:57 Found pkg/f8n/warehouse/lift/cmd/pallets:pallets.go 2023-06-05T14:14:57.9455036Z 2023/06/05 14:14:57 Found pkg/f8n/warehouse/lift/cmd/render:render.go 2023-06-05T14:14:58.0221238Z 2023/06/05 14:14:58 Found pkg/f8n/warehouse/oci/layout:layout_test.go 2023-06-05T14:14:58.0971014Z 2023/06/05 14:14:58 Found pkg/f8n/warehouse/pallet:metadata.go 2023-06-05T14:14:58.1787273Z 2023/06/05 14:14:58 Found pkg/k8s/kustomize:fs.go 2023-06-05T14:14:58.2614907Z 2023/06/05 14:14:58 Found pkg/k8s/object/fobject:fake_object.go 2023-06-05T14:14:58.3401227Z 2023/06/05 14:14:58 Found pkg/k8s/runtime/controller/reconcile:result_processor.go 2023-06-05T14:14:58.4190733Z 2023/06/05 14:14:58 Found pkg/lib/fog:flags.go 2023-06-05T14:14:58.4995131Z 2023/06/05 14:14:58 Found pkg/lib/gcp/cloudsql:cloudsql.go 2023-06-05T14:14:58.5767642Z 2023/06/05 14:14:58 Found pkg/lib/gcp/iam:iam_test.go 2023-06-05T14:14:58.6547768Z 2023/06/05 14:14:58 Found pkg/lib/gcp/monitoring/alertmanager:alertmanager.go 2023-06-05T14:14:58.7309028Z 2023/06/05 14:14:58 Found pkg/lib/gcp/monitoring/dashboardmanager:dashboardmanager.go 2023-06-05T14:14:58.8130613Z 2023/06/05 14:14:58 Found pkg/lib/gcp/secretmanager:secretmanager.go 2023-06-05T14:14:58.8887998Z 2023/06/05 14:14:58 Found pkg/lib/runtime/subscriber/metrics:metrics_test.go 2023-06-05T14:14:58.9990779Z 2023/06/05 14:14:58 Found pkg/lib/server/inmemorylistener:inmemorylistener.go 2023-06-05T14:14:59.1233157Z 2023/06/05 14:14:59 Found pkg/lib/text/drawing:drawing_test.go 2023-06-05T14:14:59.2500185Z 2023/06/05 14:14:59 Found pkg/sds/k8s/authserver:auth_server.go 2023-06-05T14:14:59.3413689Z 2023/06/05 14:14:59 Found pkg/sds/k8s/controllers/coredns:manager.go 2023-06-05T14:14:59.4380134Z 2023/06/05 14:14:59 Found pkg/sds/k8s/controllers/coredns/pkg:corednsctl_test.go 2023-06-05T14:14:59.5394031Z 2023/06/05 14:14:59 Found pkg/sds/k8s/controllers/nodeagent/config/fake:config.go 2023-06-05T14:14:59.6172758Z 2023/06/05 14:14:59 Found pkg/sds/k8s/controllers/nodeagent:controller_test.go 2023-06-05T14:14:59.7016779Z 2023/06/05 14:14:59 Found pkg/sds/k8s/controllers/nodeagent/pkg/plugins/applynodelabels:applynodelabels.go 2023-06-05T14:14:59.7831687Z 2023/06/05 14:14:59 Found pkg/sds/k8s/controllers/nodeagent/pkg/plugins/example:example.go 2023-06-05T14:14:59.8960951Z 2023/06/05 14:14:59 Found pkg/sds/k8s/controllers/nodeagent/pkg/plugins/networking:networking.go 2023-06-05T14:14:59.9997409Z 2023/06/05 14:14:59 Found pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration:ntpconfiguration.go 2023-06-05T14:15:00.1002575Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/nodeagent/pkg/plugins/osuserpasswordupdater:osuserpasswordupdater.go 2023-06-05T14:15:00.1827308Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/nodeagent/pkg/plugins/remoteagentconfig:remoteagentconfig.go 2023-06-05T14:15:00.2601465Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/pxe:controller.go 2023-06-05T14:15:00.3359328Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/pxe:controller_test.go 2023-06-05T14:15:00.4105753Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/remoteaccess:client_webhook.go 2023-06-05T14:15:00.4843559Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/remoteaccess:vpnconfig_controller.go 2023-06-05T14:15:00.5623847Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/resiliencemanager:controller.go 2023-06-05T14:15:00.6373566Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/resiliencemanager:node_controller.go 2023-06-05T14:15:00.7119550Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/resiliencemanager/pkg/certs:create_secret.go 2023-06-05T14:15:00.7862978Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/resiliencemanager/pkg/certs:untar_files.go 2023-06-05T14:15:00.8655489Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/resiliencemanager/pkg/safekubeutils:safe_kube_client.go 2023-06-05T14:15:00.9396854Z 2023/06/05 14:15:00 Found pkg/sds/k8s/controllers/resiliencemanager:worker_node_controller.go 2023-06-05T14:15:01.0210108Z 2023/06/05 14:15:01 Found pkg/sds/k8s/controllers/retaildevicemanager/pkg/plugins/plugin:plugin.go 2023-06-05T14:15:01.0972306Z 2023/06/05 14:15:01 Found pkg/sds/k8s/credentials/ien:dsds_secret.go 2023-06-05T14:15:01.1785029Z 2023/06/05 14:15:01 Found pkg/sds/lib/os/file:file_linux.go 2023-06-05T14:15:01.2543138Z 2023/06/05 14:15:01 Found pkg/sds/lib/remotecli/msgsvc:msgsvc_test.go 2023-06-05T14:15:01.3480491Z 2023/06/05 14:15:01 Found pkg/sds/lib/remotecli/remotecli:remotecli.go 2023-06-05T14:15:01.4236642Z 2023/06/05 14:15:01 Found pkg/sds/lib/remotecli/remotecli:remotecli_test.go 2023-06-05T14:15:01.5222348Z 2023/06/05 14:15:01 Found pkg/tools/hack/cmd/owners:create.go 2023-06-05T14:15:01.6139018Z 2023/06/05 14:15:01 Found pkg/tools/hack/cmd/owners:list.go 2023-06-05T14:15:01.6936340Z 2023/06/05 14:15:01 Found pkg/tools/hack/cmd/owners:update.go 2023-06-05T14:15:01.7722574Z 2023/06/05 14:15:01 Found pkg/tools/hack/cmd/owners:verify.go 2023-06-05T14:15:01.8521512Z 2023/06/05 14:15:01 Found test/edge/e2e/framework:context.go 2023-06-05T14:15:01.9289798Z 2023/06/05 14:15:01 Found test/edge/e2e/framework:edge_client.go 2023-06-05T14:15:02.0074547Z 2023/06/05 14:15:02 Found test/f2/x/ktest:options.go 2023-06-05T14:15:02.0889204Z 2023/06/05 14:15:02 Found test/framework/config:config_test.go 2023-06-05T14:15:02.1675697Z 2023/06/05 14:15:02 Found test/framework/k8s:k8s.go 2023-06-05T14:15:02.1675969Z 2023/06/05 14:15:02 Done 2023-06-05T14:15:27.0684659Z 2023/06/05 14:15:02 Querying Bazel for buildables based on changeset 2023-06-05T14:15:27.0721915Z 2023/06/05 14:15:27 Building... [//cmd/edge/api:api_lib //cmd/edge/api:backend //cmd/edge/bannerctl:bannerctl //cmd/edge/bannerctl:bannerctl_lib //cmd/edge/bsl:bsl //cmd/edge/bsl:bsl_lib //cmd/edge/chariot2:chariot2 //cmd/edge/chariot2:chariot2_lib //cmd/edge/clusterctl:clusterctl //cmd/edge/clusterctl:clusterctl_lib //cmd/edge/ctlfish:ctlfish //cmd/edge/ctlfish:ctlfish_lib //cmd/edge/datasync/chirp:chirp //cmd/edge/datasync/chirp:chirp_lib //cmd/edge/datasync/couchctl:couchctl //cmd/edge/datasync/couchctl:couchctl_lib //cmd/edge/datasync/cushion:cushion //cmd/edge/datasync/cushion:cushion_lib //cmd/edge/datasync/datasyncinit:datasyncinit //cmd/edge/datasync/datasyncinit:datasyncinit_lib //cmd/edge/datasync/shoot:shoot //cmd/edge/datasync/shoot:shoot_lib //cmd/edge/edge:edge //cmd/edge/edge:edge_darwin //cmd/edge/edge:edge_lib //cmd/edge/edge:edge_linux //cmd/edge/edge-injector:edge-injector //cmd/edge/edge-injector:edge-injector_lib //cmd/edge/edge-sql:edge-sql //cmd/edge/edge-sql:edge-sql_lib //cmd/edge/iam/active-ttl:active-ttl //cmd/edge/iam/active-ttl:active-ttl_lib //cmd/edge/iam/init:init //cmd/edge/iam/init:init_lib //cmd/edge/iam/operator:operator //cmd/edge/iam/operator:operator_lib //cmd/edge/iam/provider:provider //cmd/edge/iam/provider:provider_lib //cmd/edge/kpt-fns/addcluster:addcluster //cmd/edge/kpt-fns/addcluster:addcluster_lib //cmd/edge/kpt-fns/addexternalsecret:addexternalsecret //cmd/edge/kpt-fns/addexternalsecret:addexternalsecret_lib //cmd/edge/kpt-fns/addhelmrepository:addhelmrepository //cmd/edge/kpt-fns/addhelmrepository:addhelmrepository_lib //cmd/edge/kpt-fns/addnamespace:addnamespace //cmd/edge/kpt-fns/addnamespace:addnamespace_lib //cmd/edge/kpt-fns/addtenant:addtenant //cmd/edge/kpt-fns/addtenant:addtenant_lib //cmd/edge/kpt-fns/unthossorter:unthossorter //cmd/edge/kpt-fns/unthossorter:unthossorter_lib //cmd/edge/kpt-fns/clustersel:clustersel //cmd/edge/kpt-fns/clustersel:clustersel_lib //cmd/edge/kpt-fns/clusterselgen:clusterselgen //cmd/edge/kpt-fns/clusterselgen:clusterselgen_lib //cmd/edge/kpt-fns/componentlabels:componentlabels //cmd/edge/kpt-fns/componentlabels:componentlabels_lib //cmd/edge/kpt-fns/deleteresource:deleteresource //cmd/edge/kpt-fns/deleteresource:deleteresource_lib //cmd/edge/kpt-fns/duplicatenamespacecheck:duplicatenamespacecheck //cmd/edge/kpt-fns/duplicatenamespacecheck:duplicatenamespacecheck_lib //cmd/edge/kpt-fns/edgerelease:edgerelease //cmd/edge/kpt-fns/edgerelease:edgerelease_lib //cmd/edge/kpt-fns/kubeval:kubeval //cmd/edge/kpt-fns/kubeval:kubeval_lib //cmd/edge/kpt-fns/normalizer:normalizer //cmd/edge/kpt-fns/normalizer:normalizer_lib //cmd/edge/kpt-fns/trimmer:trimmer //cmd/edge/kpt-fns/trimmer:trimmer_lib //cmd/edge/kpt-fns/uniquenesschecker:uniquenesschecker //cmd/edge/kpt-fns/uniquenesschecker:uniquenesschecker_lib //cmd/edge/kpt-fns/validatenamespace:validatenamespace //cmd/edge/kpt-fns/validatenamespace:validatenamespace_lib //cmd/edge/kpt-fns/verifyrolebindings:verifyrolebindings //cmd/edge/kpt-fns/verifyrolebindings:verifyrolebindings_lib //cmd/edge/linkerdctl:linkerdctl //cmd/edge/linkerdctl:linkerdctl_lib //cmd/edge/envctl:envctl //cmd/edge/envctl:envctl_lib //cmd/edge/syncedobjectctl:syncedobjectctl //cmd/edge/syncedobjectctl:syncedobjectctl_lib //cmd/f8n/kinform/client:client //cmd/f8n/kinform/client:client_lib //cmd/f8n/kinform/server:server //cmd/f8n/kinform/server:server_lib //cmd/f8n/lighthouse:lighthouse //cmd/f8n/lighthouse:lighthouse_lib //cmd/edge/logging/fluentbitctl:fluentbitctl //cmd/edge/logging/fluentbitctl:fluentbitctl_lib //cmd/f8n/monitoring/alertman:alertman //cmd/f8n/monitoring/alertman:alertman_lib //cmd/f8n/monitoring/alertman/cli:cli //cmd/f8n/monitoring/am-webhook:am-webhook //cmd/f8n/monitoring/am-webhook:am-webhook_lib //cmd/f8n/monitoring/billman:billman //cmd/f8n/monitoring/billman:billman_lib //cmd/f8n/monitoring/dashman:dashman //cmd/f8n/monitoring/dashman:dashman_darwin //cmd/f8n/monitoring/dashman:dashman_lib //cmd/f8n/monitoring/dashman:dashman_linux //cmd/f8n/monitoring/dashman/cli:cli //cmd/f8n/monitoring/plank:plank //cmd/f8n/monitoring/plank:plank_lib //cmd/f8n/monitoring/prometheus:prometheus //cmd/f8n/monitoring/prometheus:prometheus_lib //cmd/f8n/rebar/excursions:excursions //cmd/f8n/rebar/excursions:excursions_lib //cmd/f8n/rebar/gridbug:gridbug //cmd/f8n/rebar/gridbug:gridbug_lib //cmd/f8n/rebar/jack:jack //cmd/f8n/rebar/jack:jack_lib //cmd/f8n/rebar/overlook:overlook //cmd/f8n/rebar/overlook:overlook_lib //cmd/f8n/rebar/slacker:slacker //cmd/f8n/rebar/slacker:slacker_lib //cmd/f8n/warehouse/lift:lift //cmd/f8n/warehouse/lift:lift_lib //cmd/f8n/warehouse/lumperctl:lumperctl //cmd/f8n/warehouse/lumperctl:lumperctl_lib //cmd/f8n/warehouse/promote:promote //cmd/f8n/warehouse/promote:promote_lib //cmd/f8n/warehouse/registryforwarder:registryforwarder //cmd/f8n/warehouse/registryforwarder:registryforwarder_lib //cmd/sds/authserver:authserver //cmd/sds/authserver:authserver_lib //cmd/sds/corednsctl:coredns_lib //cmd/sds/corednsctl:corednsctl //cmd/sds/corednsctl:corednsctl_lib //cmd/sds/nodeagent:nodeagent //cmd/sds/nodeagent:nodeagent_lib //cmd/sds/patchmanager:patchmanager //cmd/sds/patchmanager:patchmanager_lib //cmd/sds/pxe:pxe //cmd/sds/pxe:pxe_lib //cmd/sds/remoteaccess:remoteaccess //cmd/sds/remoteaccess:remoteaccess_lib //cmd/sds/resiliencemanager:resiliencemanager //cmd/sds/resiliencemanager:resiliencemanager_lib //cmd/sds/retaildevicemanager:retaildevicemanager //cmd/sds/retaildevicemanager:retaildevicemanager_lib //cmd/sds/xorg/controller:controller //cmd/sds/xorg/controller:controller_lib //cmd/tools/hack:hack //cmd/tools/hack:hack_lib //cmd/x/gbug:gbug //cmd/x/gbug:gbug_lib //config/unthos:run_krm_fns //config/clusters/ret-edge-pltf-preprod-infra/platform-infra:run_krm_fns //config/pallets:pallets //hack/build/ci/leaf:leaf //hack/build/ci/leaf:leaf_lib //hack/observability/billing:billing //hack/observability/billing:billing_lib //hack/tools/eyede:eyede //hack/tools/eyede:eyede_lib //hack/tools/eyede/use-database:use-database //hack/tools/eyede/use-storage:use-storage //hack/tools/eyede/utils:utils //hack/tools/hiss:hiss //hack/tools/hiss:hiss_lib //hack/tools/hr:eyede //hack/tools/hr:hr_lib //hack/tools/hr/populate:populate //hack/tools/hr/utils:utils //hack/tools/linters:go //hack/tools/lumberjack:lumberjack //hack/tools/lumberjack:lumberjack_lib //hack/tools/lumberjack/utils:utils //pkg/edge/api/apierror:apierror //pkg/edge/api/apierror/testutils:testutils //pkg/edge/api/clients:clients //pkg/edge/api/graph/mapper:mapper //pkg/edge/api/graph/resolver:resolver //pkg/edge/api/graph/setup:setup //pkg/edge/api/graph/test:test //pkg/edge/api/middleware:middleware //pkg/edge/api/middleware/activityhistory:activityhistory //pkg/edge/api/mocks:mocks //pkg/edge/api/services:services //pkg/edge/api/services/gcp:gcp //pkg/edge/api/testutils:testutils //pkg/edge/api/types:types //pkg/edge/bootstrapping:bootstrapping //pkg/edge/bsl:bsl //pkg/edge/bsl-reconciler:bsl-reconciler //pkg/edge/bsl/fake:fake //pkg/edge/chariot:chariot //pkg/edge/chariot/example:example //pkg/edge/chariot/example:example_lib //pkg/edge/cli:cli //pkg/edge/cli/commands/activationcode:activationcode //pkg/edge/cli/commands/activationcode/get:get //pkg/edge/cli/commands/activationcode/list:list //pkg/edge/cli/commands/activationcode/refresh:refresh //pkg/edge/cli/commands/bootstrapcluster:bootstrapcluster //pkg/edge/cli/commands/cfg:cfg //pkg/edge/cli/commands/cfg/updatemanifests:updatemanifests //pkg/edge/cli/commands/clusterconfig:clusterconfig //pkg/edge/cli/commands/clusterconfig/modify:modify //pkg/edge/cli/commands/clusterconfig/register:register //pkg/edge/cli/commands/connectbeta:connectbeta //pkg/edge/cli/commands/networkservice:networkservice //pkg/edge/cli/commands/networkservice/list:list //pkg/edge/cli/commands/networkservice/modify:modify //pkg/edge/cli/commands/networkservice/register:register //pkg/edge/cli/commands/networkservice/remove:remove //pkg/edge/cli/commands/registercluster:registercluster //pkg/edge/cli/commands/terminal:terminal //pkg/edge/cli/commands/terminal/bulkregister:bulkregister //pkg/edge/cli/commands/terminal/modify:modify //pkg/edge/cli/commands/terminal/register:register //pkg/edge/cli/commands/terminal/remove:remove //pkg/edge/cli/commands/updateclustersecret:updateclustersecret //pkg/edge/cli/edgecliutils:edgecliutils //pkg/edge/clientutils:clientutils //pkg/edge/component/build/updatemanifests:updatemanifests //pkg/edge/controllers/bannerctl:bannerctl //pkg/edge/controllers/clusterctl:clusterctl //pkg/edge/controllers/clusterctl/pkg/plugins:plugins //pkg/edge/controllers/clusterctl/pkg/plugins/secretmanagersecrets:secretmanagersecrets //pkg/edge/controllers/envctl:envctl //pkg/edge/controllers/envctl/pkg/nameutils:nameutils //pkg/edge/controllers/syncedobject:syncedobject //pkg/edge/ctlfish/monitor:monitor //pkg/edge/ctlfish/option:option //pkg/edge/datasync/apis/v1alpha1:v1alpha1 //pkg/edge/datasync/chirp:chirp //pkg/edge/datasync/chirp/persister/files:files //pkg/edge/datasync/chirp/server/grpc:grpc //pkg/edge/datasync/chirp/server/http:http //pkg/edge/datasync/controllers/couchctl:couchctl //pkg/edge/datasync/controllers/couchctl/couchdb:couchdb //pkg/edge/datasync/couchdb:couchdb //pkg/edge/datasync/cushion:cushion //pkg/edge/datasync/datasyncinit:datasyncinit //pkg/edge/datasync/internal/configmap:configmap //pkg/edge/datasync/internal/signature:signature //pkg/edge/datasync/shoot:shoot //pkg/edge/datasync/shoot/http:http //pkg/edge/flux:flux //pkg/edge/gitops/chariot/client:client //pkg/edge/gitops/fn/testutil:testutil //pkg/edge/gitops/fns/edgerelease:edgerelease //pkg/edge/iam/barcode:barcode //pkg/edge/iam/client:client //pkg/edge/iam/cloud:cloud //pkg/edge/iam/config:config //pkg/edge/iam/ctl/clientctl:clientctl //pkg/edge/iam/ctl/providerctl:providerctl //pkg/edge/iam/identity:identity //pkg/edge/iam/oauth2:oauth2 //pkg/edge/iam/pin:pin //pkg/edge/iam/profile:profile //pkg/edge/iam/provider:provider //pkg/edge/iam/session:session //pkg/edge/iam/storage:storage //pkg/edge/iam/storage/database:database //pkg/edge/iam/storage/memory:memory //pkg/edge/iam/util:util //pkg/edge/iam/verify:verify //pkg/edge/k8objectsutils:k8objectsutils //pkg/edge/linkerd/apis/linkerd/v1alpha1:v1alpha1 //pkg/edge/linkerd/controllers:controllers //pkg/edge/registration:registration //pkg/edge/shipment/generator:generator //pkg/edge/webhooks/edge-injector:edge-injector //pkg/f8n/devinfra/gridbug:gridbug //pkg/f8n/devinfra/jack:jack //pkg/f8n/devinfra/jack/excursions:excursions //pkg/f8n/devinfra/jack/guest_services:guest_services //pkg/f8n/devinfra/jack/overlook:overlook //pkg/f8n/devinfra/jack/overlook/pluginimports:pluginimports //pkg/f8n/devinfra/jack/plugin:plugin //pkg/f8n/devinfra/jack/plugin/approved_label:approved_label //pkg/f8n/devinfra/jack/plugin/approved_label:bulldoze_sync_label //pkg/f8n/devinfra/jack/plugin/changelog:changelog //pkg/f8n/devinfra/jack/plugin/deleted_issue:deleted_issue //pkg/f8n/devinfra/jack/plugin/enforce_milestone:enforce_milestone //pkg/f8n/devinfra/jack/plugin/epics:epics //pkg/f8n/devinfra/jack/plugin/list:list //pkg/f8n/devinfra/jack/plugin/milestone_report:milestone_report //pkg/f8n/devinfra/jack/plugin/milestones:milestones //pkg/f8n/devinfra/jack/plugin/pr:pr //pkg/f8n/devinfra/jack/plugin/project:project //pkg/f8n/devinfra/jack/plugin/project_pruning:project_pruning //pkg/f8n/devinfra/jack/plugin/size:size //pkg/f8n/devinfra/jack/plugin/task:task //pkg/f8n/devinfra/jack/plugin/triage_issue:triage_issue //pkg/f8n/devinfra/jack/plugin/triage_parent:triage_parent //pkg/f8n/devinfra/jack/plugin/type:type //pkg/f8n/devinfra/jack/plugin/uploadjob:uploadjob //pkg/f8n/devinfra/jack/plugin/webhook_events:webhook_events //pkg/f8n/devinfra/overlook:overlook //pkg/f8n/devinfra/reports:reports //pkg/f8n/devinfra/slacker:slacker //pkg/f8n/kinform/client:client //pkg/f8n/kinform/model:model //pkg/f8n/kinform/server:server //pkg/f8n/kinform/sql:sql //pkg/f8n/lighthouse:lighthouse //pkg/f8n/lighthouse/config:config //pkg/f8n/lighthouse/testutils:testutils //pkg/edge/logging/k8s/controllers/fluentbitctl:fluentbitctl //pkg/f8n/monitoring/am-webhook:am-webhook //pkg/f8n/monitoring/billman/cmd:cmd //pkg/f8n/monitoring/billman/cmd/all:all //pkg/f8n/monitoring/billman/cmd/logs:logs //pkg/f8n/monitoring/billman/cmd/metrics:metrics //pkg/f8n/monitoring/billman/costs:costs //pkg/f8n/monitoring/billman/edgesql:edgesql //pkg/f8n/monitoring/k8s/controllers/prometheusctl:prometheusctl //pkg/f8n/monitoring/plank:plank //pkg/f8n/warehouse/forwarder:forwarder //pkg/f8n/warehouse/k8s/apis/meta:meta //pkg/f8n/warehouse/k8s/apis/v1alpha1:v1alpha1 //pkg/f8n/warehouse/k8s/controllers/lumperctl:lumperctl //pkg/f8n/warehouse/k8s/controllers/lumperctl/internal:internal //pkg/f8n/warehouse/lift/cmd:cmd //pkg/f8n/warehouse/lift/cmd/apply:apply //pkg/f8n/warehouse/lift/cmd/flatten:flatten //pkg/f8n/warehouse/lift/cmd/internal/command:command //pkg/f8n/warehouse/lift/cmd/pack:pack //pkg/f8n/warehouse/lift/cmd/pallet:pallet //pkg/f8n/warehouse/lift/cmd/pallets:pallets //pkg/f8n/warehouse/lift/cmd/render:render //pkg/f8n/warehouse/lift/cmd/setup:setup //pkg/f8n/warehouse/lift/pack:pack //pkg/f8n/warehouse/lift/unpack:unpack //pkg/f8n/warehouse/oci/cache:cache //pkg/f8n/warehouse/oci/remote:remote //pkg/f8n/warehouse/pallet:pallet //pkg/f8n/warehouse/pallet/resolve:resolve //pkg/f8n/warehouse/promote:promote //pkg/k8s/kustomize:kustomize //pkg/k8s/object/fobject:fobject //pkg/k8s/runtime/controller/reconcile:reconcile //pkg/lib/fog:fog //pkg/lib/gcp/cloudsql:cloudsql //pkg/lib/gcp/monitoring/alertmanager:alertmanager //pkg/lib/gcp/monitoring/dashboardmanager:dashboardmanager //pkg/lib/gcp/secretmanager:secretmanager //pkg/lib/gcp/utils:utils //pkg/lib/server/inmemorylistener:inmemorylistener //pkg/sds/k8s/authserver:authserver //pkg/sds/k8s/controllers/coredns:coredns //pkg/sds/k8s/controllers/nodeagent:nodeagent //pkg/sds/k8s/controllers/nodeagent/config/fake:fake //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/applynodelabels:applynodelabels //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/example:example //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/grubstringupdater:grubstringupdater //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/networking:networking //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration:ntpconfiguration //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/chronyd:chronyd //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/timesyncd:timesyncd //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/osuserpasswordupdater:osuserpasswordupdater //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/remoteagentconfig:remoteagentconfig //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient:thinclient //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient/configobject:configobject //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient/selector:selector //pkg/sds/k8s/controllers/patchmanager:patchmanager //pkg/sds/k8s/controllers/patchmanager/pkg/patchmanager:patchmanager //pkg/sds/k8s/controllers/pxe:pxe //pkg/sds/k8s/controllers/pxe/pkg/dnsmasq:dnsmasq //pkg/sds/k8s/controllers/pxe/pkg/pxe:pxe //pkg/sds/k8s/controllers/remoteaccess:remoteaccess //pkg/sds/k8s/controllers/remoteaccess/config:config //pkg/sds/k8s/controllers/remoteaccess/config/fake:fake //pkg/sds/k8s/controllers/remoteaccess/pkg:pkg //pkg/sds/k8s/controllers/remoteaccess/pkg/banner:banner //pkg/sds/k8s/controllers/remoteaccess/pkg/banner/client:client //pkg/sds/k8s/controllers/remoteaccess/pkg/banner/relay:relay //pkg/sds/k8s/controllers/remoteaccess/pkg/banner/store:store //pkg/sds/k8s/controllers/remoteaccess/pkg/clientutils:clientutils //pkg/sds/k8s/controllers/remoteaccess/pkg/gcputils:gcputils //pkg/sds/k8s/controllers/resiliencemanager:resiliencemanager //pkg/sds/k8s/controllers/resiliencemanager/pkg/certs:certs //pkg/sds/k8s/controllers/resiliencemanager/pkg/safekubeutils:safekubeutils //pkg/sds/k8s/controllers/retaildevicemanager:retaildevicemanager //pkg/sds/k8s/controllers/retaildevicemanager/pkg:pkg //pkg/sds/k8s/controllers/retaildevicemanager/pkg/plugins:plugins //pkg/sds/k8s/controllers/retaildevicemanager/pkg/plugins/plugin:plugin //pkg/sds/k8s/controllers/xorgmanager:xorgmanager //pkg/sds/k8s/controllers/xorgmanager/pkg/device/evdev:evdev //pkg/sds/k8s/controllers/xorgmanager/pkg/process/processmanager:processmanager //pkg/sds/k8s/controllers/xorgmanager/pkg/xorgconfig/defaults/manager:manager //pkg/sds/k8s/controllers/xorgmanager/pkg/xorgconfig/defaults/mappingdefaults:mappingdefaults //pkg/sds/k8s/controllers/xorgmanager/pkg/xorgconfig/updater:updater //pkg/sds/k8s/credentials/ien:ien //pkg/sds/k8s/etcd:etcd //pkg/sds/lib/os/file:file //pkg/sds/lib/os/file/fake:fake //pkg/sds/lib/os/grub:grub //pkg/sds/lib/remotecli/remotecli:remotecli //pkg/tools/hack/cmd/owners:owners //pkg/tools/hack/cmd/root:root //test/edge/e2e:e2e //test/edge/e2e/framework:framework //test/edge/e2e/suites/cluster:cluster //test/edge/e2e/suites/tenant:tenant //test/f2/x/ktest:ktest //test/f2/x/ktest/envtest:envtest //test/f2/x/warehouse:warehouse //test/fixtures:fixtures //test/framework/k8s:k8s //test/framework/k8s/envtest:envtest //test/framework/warehouse:warehouse //third_party/k8s/fluxcd:fluxcd] 2023-06-05T14:15:27.1202650Z INFO: Invocation ID: e6545818-41fa-4e44-ba7d-ceb0c83650f3 2023-06-05T14:15:27.1203349Z INFO: Options provided by the client: 2023-06-05T14:15:27.1203886Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:15:27.1210662Z INFO: Reading rc options for 'build' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:15:27.1211732Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:15:27.1212459Z INFO: Reading rc options for 'build' from /etc/bazel.bazelrc: 2023-06-05T14:15:27.1213003Z 'build' options: --config=cache 2023-06-05T14:15:27.1213672Z INFO: Reading rc options for 'build' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:15:27.1214848Z 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:15:27.1215939Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:15:27.1216903Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:15:27.1217724Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:15:27.1220803Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:15:27.5094912Z WARNING: The target pattern '//pkg/f8n/monitoring/billman/cmd/all:all' is ambiguous: ':all' is both a wildcard, and the name of an existing go_library rule; using the latter interpretation 2023-06-05T14:15:30.7281858Z INFO: Analyzed 406 targets (4 packages loaded, 20551 targets configured). 2023-06-05T14:15:30.7297619Z INFO: Found 406 targets... 2023-06-05T14:16:30.9177185Z INFO: Elapsed time: 63.828s, Critical Path: 40.18s 2023-06-05T14:16:30.9179094Z INFO: 4796 processes: 1160 disk cache hit, 3338 remote cache hit, 216 internal, 53 local, 29 processwrapper-sandbox. 2023-06-05T14:16:30.9292084Z 2023/06/05 14:16:30 Querying Bazel for tests based on changeset 2023-06-05T14:16:32.3779162Z 2023/06/05 14:16:32 Running Tests... [//cmd/f8n/monitoring/alertman/cli:cli_test //config/pallets:pallets_test //pkg/edge/api/apierror:apierror_test //pkg/edge/api/clients:clients_test //pkg/edge/api/graph/integration:integration_test //pkg/edge/api/graph/mapper:mapper_test //pkg/edge/api/graph/resolver:resolver_test //pkg/edge/api/middleware:middleware_test //pkg/edge/api/services:services_test //pkg/edge/api/utils:utils_test //pkg/edge/bootstrapping:bootstrapping_test //pkg/edge/bsl:bsl_test //pkg/edge/bsl-reconciler:bsl-reconciler_test //pkg/edge/chariot:chariot_test //pkg/edge/clientutils:clientutils_test //pkg/edge/component/build/updatemanifests:updatemanifests_test //pkg/edge/controllers/bannerctl:bannerctl_test //pkg/edge/controllers/clusterctl:clusterctl_test //pkg/edge/controllers/clusterctl/pkg/iamutils:iamutils_test //pkg/edge/controllers/clusterctl/pkg/plugins:plugins_test //pkg/edge/controllers/envctl:envctl_test //pkg/edge/controllers/envctl/pkg/nameutils:nameutils_test //pkg/edge/controllers/syncedobject:syncedobject_test //pkg/edge/ctlfish/monitor:monitor_test //pkg/edge/ctlfish/option:option_test //pkg/edge/datasync/apis/v1alpha1:v1alpha1_test //pkg/edge/datasync/chirp/persister/files:files_test //pkg/edge/datasync/chirp/provider:provider_test //pkg/edge/datasync/chirp/server/http:http_test //pkg/edge/datasync/controllers/couchctl:couchctl_test //pkg/edge/datasync/controllers/couchctl/couchdb:couchdb_test //pkg/edge/datasync/couchdb:couchdb_test //pkg/edge/datasync/cushion:cushion_test //pkg/edge/datasync/internal/configmap:configmap_test //pkg/edge/datasync/internal/signature:signature_test //pkg/edge/gitops/chariot/client:client_test //pkg/edge/gitops/fns/addcluster:addcluster_test //pkg/edge/gitops/fns/addcontainercluster:addcontainercluster_test //pkg/edge/gitops/fns/addcontainerpool:addcontainerpool_test //pkg/edge/gitops/fns/addexternalsecret:addexternalsecret_test //pkg/edge/gitops/fns/addhelmrepository:addhelmrepository_test //pkg/edge/gitops/fns/addnamespace:addnamespace_test //pkg/edge/gitops/fns/addtenant:addtenant_test //pkg/edge/gitops/fns/clusterselgen:clusterselgen_test //pkg/edge/gitops/fns/deleteresource:deleteresource_test //pkg/edge/gitops/fns/edgerelease:edgerelease_test //pkg/edge/gitops/fns/trimmer:trimmer_test //pkg/edge/iam/util:util_test //pkg/edge/info:info_test //pkg/edge/linkerd/controllers:controllers_test //pkg/edge/registration:registration_test //pkg/edge/shipment/generator:generator_test //pkg/edge/webhooks/edge-injector:edge-injector_test //pkg/f8n/devinfra/gcp/job/storage:storage_test //pkg/f8n/devinfra/ghappman:ghappman_test //pkg/f8n/devinfra/gridbug:gridbug_test //pkg/f8n/devinfra/jack:jack_test //pkg/f8n/devinfra/jack/guest_services:guest_services_test //pkg/f8n/devinfra/jack/plugin/approved_label:approved_label_test //pkg/f8n/devinfra/jack/plugin/approved_label:bulldoze_sync_label_test //pkg/f8n/devinfra/jack/plugin/changelog:changelog_test //pkg/f8n/devinfra/jack/plugin/enforce_milestone:enforce_milestone_test //pkg/f8n/devinfra/jack/plugin/epics:epics_test //pkg/f8n/devinfra/jack/plugin/list:list_test //pkg/f8n/devinfra/jack/plugin/pr:pr_test //pkg/f8n/devinfra/jack/plugin/project:project_test //pkg/f8n/devinfra/jack/plugin/size:size_test //pkg/f8n/devinfra/jack/plugin/triage_issue:triage_issue_test //pkg/f8n/devinfra/jack/plugin/triage_parent:triage_parent_test //pkg/f8n/devinfra/jack/plugin/type:type_test //pkg/f8n/devinfra/jack/plugin/uploadjob:uploadjob_test //pkg/f8n/gcp/k8s/controllers/dennis:dennis_test //pkg/f8n/gcp/k8s/controllers/logsink:logsink_test //pkg/f8n/gcp/k8s/controllers/projectinit:projectinit_test //pkg/f8n/kinform/client:client_test //pkg/f8n/kinform/model:model_test //pkg/f8n/kinform/server:server_test //pkg/f8n/kinform/sql:sql_test //pkg/f8n/lighthouse:lighthouse_test //pkg/f8n/lighthouse/config:config_test //pkg/edge/logging/k8s/controllers/fluentbitctl:fluentbitctl_test //pkg/f8n/monitoring/billman/costs:costs_test //pkg/f8n/monitoring/k8s/controllers/prometheusctl:prometheusctl_test //pkg/f8n/warehouse/forwarder:forwarder_test //pkg/f8n/warehouse/k8s/apis/meta:meta_test //pkg/f8n/warehouse/k8s/apis/v1alpha1:v1alpha1_test //pkg/f8n/warehouse/k8s/controllers/lumperctl:lumperctl_test //pkg/f8n/warehouse/lift/cmd/internal/command:command_test //pkg/f8n/warehouse/lift/cmd/pack:pack_test //pkg/f8n/warehouse/lift/cmd/pallets:pallets_test //pkg/f8n/warehouse/lift/pack:pack_test //pkg/f8n/warehouse/lift/unpack:unpack_test //pkg/f8n/warehouse/oci:oci_test //pkg/f8n/warehouse/oci/cache:cache_test //pkg/f8n/warehouse/oci/cache/providers/disk:disk_test //pkg/f8n/warehouse/oci/cache/providers/memory:memory_test //pkg/f8n/warehouse/oci/layer:layer_test //pkg/f8n/warehouse/oci/layout:layout_test //pkg/f8n/warehouse/oci/mutate:mutate_test //pkg/f8n/warehouse/pallet/resolve:resolve_test //pkg/f8n/warehouse/promote:promote_test //pkg/k8s/certmanager:certmanager_test //pkg/k8s/kustomize:kustomize_test //pkg/k8s/object:object_test //pkg/k8s/runtime/conditions:conditions_test //pkg/k8s/runtime/controller/reconcile:reconcile_test //pkg/k8s/runtime/inventory:inventory_test //pkg/k8s/runtime/objectrestarter:objectrestarter_test //pkg/k8s/runtime/sap:sap_test //pkg/k8s/runtime/sap/install:install_test //pkg/k8s/unstructured:unstructured_test //pkg/lib/fog:fog_test //pkg/lib/gcp/cloudsql:cloudsql_test //pkg/lib/gcp/iam:iam_test //pkg/lib/gcp/secretmanager:secretmanager_test //pkg/lib/runtime/subscriber/metrics:metrics_test //pkg/lib/server:server_test //pkg/lib/server/inmemorylistener:inmemorylistener_test //pkg/lib/text/drawing:drawing_test //pkg/sds/k8s/authserver:authserver_test //pkg/sds/k8s/controllers/coredns/pkg:pkg_test //pkg/sds/k8s/controllers/nodeagent:nodeagent_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/applynodelabels:applynodelabels_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/example:example_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/grubstringupdater:grubstringupdater_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/networking:networking_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration:ntpconfiguration_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/chronyd:chronyd_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/timesyncd:timesyncd_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/osuserpasswordupdater:osuserpasswordupdater_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/remoteagentconfig:remoteagentconfig_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient:thinclient_test //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient/selector:selector_test //pkg/sds/k8s/controllers/pxe:pxe_test //pkg/sds/k8s/controllers/remoteaccess/pkg:pkg_test //pkg/sds/k8s/controllers/resiliencemanager/pkg/certs:certs_test //pkg/sds/lib/os/grub:grub_test //pkg/sds/lib/remotecli/msgsvc:msgsvc_test //pkg/sds/lib/remotecli/remotecli:remotecli_test //pkg/tools/hack/cmd/owners:owners_test //test/f2/x/ktest/kssert:kssert_test //test/fixtures:fixtures_test //test/framework/config:config_test //third_party/k8s/fluxcd:fluxcd_test] 2023-06-05T14:16:32.3987475Z INFO: Invocation ID: 5a1f6b32-93e9-4930-811e-b61fed6b1954 2023-06-05T14:16:32.3988212Z INFO: Options provided by the client: 2023-06-05T14:16:32.3990102Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:16:32.3990963Z INFO: Reading rc options for 'test' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:16:32.3991566Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:16:32.3991961Z INFO: Reading rc options for 'test' from /etc/bazel.bazelrc: 2023-06-05T14:16:32.3992309Z Inherited 'build' options: --config=cache 2023-06-05T14:16:32.3992702Z INFO: Reading rc options for 'test' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:16:32.3993524Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:16:32.3994231Z INFO: Reading rc options for 'test' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:16:32.3994675Z 'test' options: --test_output all --test_arg=-test.v 2023-06-05T14:16:32.3995431Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:16:32.3996385Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:16:32.3997083Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:16:32.3997895Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:16:32.3998724Z INFO: Found applicable config definition test:ci in file /__w/edge-infra/edge-infra/.bazelrc: --flaky_test_attempts=3 --test_keep_going=false --test_timeout=120 --nocache_test_results 2023-06-05T14:16:33.7812007Z INFO: Analyzed 144 targets (0 packages loaded, 2477 targets configured). 2023-06-05T14:16:33.7956729Z INFO: Found 144 test targets... 2023-06-05T14:16:37.3175949Z INFO: From Testing //pkg/f8n/warehouse/lift/pack:pack_test: 2023-06-05T14:16:37.3176572Z ==================== Test output for //pkg/f8n/warehouse/lift/pack:pack_test: 2023-06-05T14:16:37.3177000Z === RUN TestMergeConfig 2023-06-05T14:16:37.3177475Z === RUN TestMergeConfig/destination_is_preserved_if_source_is_empty 2023-06-05T14:16:37.3177977Z === RUN TestMergeConfig/source_overrides_destination 2023-06-05T14:16:37.3179540Z --- PASS: TestMergeConfig (0.00s) 2023-06-05T14:16:37.3180299Z --- PASS: TestMergeConfig/destination_is_preserved_if_source_is_empty (0.00s) 2023-06-05T14:16:37.3181077Z --- PASS: TestMergeConfig/source_overrides_destination (0.00s) 2023-06-05T14:16:37.3181525Z === RUN TestParameters 2023-06-05T14:16:37.3182110Z === RUN TestParameters/with_multiple_$_prefix 2023-06-05T14:16:37.3182618Z === RUN TestParameters/with_multiple_$_prefix#01 2023-06-05T14:16:37.3183042Z === RUN TestParameters/without_parameters 2023-06-05T14:16:37.3183397Z === RUN TestParameters/without_parameters#01 2023-06-05T14:16:37.3183868Z === RUN TestParameters/with_invalid_parameters 2023-06-05T14:16:37.3184307Z === RUN TestParameters/with_invalid_parameters#01 2023-06-05T14:16:37.3184719Z === RUN TestParameters/with_valid_parameters 2023-06-05T14:16:37.3185150Z === RUN TestParameters/with_valid_parameters#01 2023-06-05T14:16:37.3185673Z === RUN TestParameters/with_valid_and_invalid_parameters 2023-06-05T14:16:37.3186236Z === RUN TestParameters/with_valid_and_invalid_parameters#01 2023-06-05T14:16:37.3186780Z --- PASS: TestParameters (0.00s) 2023-06-05T14:16:37.3187486Z --- PASS: TestParameters/with_multiple_$_prefix (0.00s) 2023-06-05T14:16:37.3187861Z --- PASS: TestParameters/with_multiple_$_prefix#01 (0.00s) 2023-06-05T14:16:37.3188437Z --- PASS: TestParameters/without_parameters (0.00s) 2023-06-05T14:16:37.3188808Z --- PASS: TestParameters/without_parameters#01 (0.00s) 2023-06-05T14:16:37.3189201Z --- PASS: TestParameters/with_invalid_parameters (0.00s) 2023-06-05T14:16:37.3189754Z --- PASS: TestParameters/with_invalid_parameters#01 (0.00s) 2023-06-05T14:16:37.3190141Z --- PASS: TestParameters/with_valid_parameters (0.00s) 2023-06-05T14:16:37.3190532Z --- PASS: TestParameters/with_valid_parameters#01 (0.00s) 2023-06-05T14:16:37.3190929Z --- PASS: TestParameters/with_valid_and_invalid_parameters (0.00s) 2023-06-05T14:16:37.3191335Z --- PASS: TestParameters/with_valid_and_invalid_parameters#01 (0.00s) 2023-06-05T14:16:37.3191577Z PASS 2023-06-05T14:16:37.3191883Z ================================================================================ 2023-06-05T14:16:37.7748719Z INFO: From Testing //pkg/edge/gitops/fns/addtenant:addtenant_test: 2023-06-05T14:16:37.7754438Z ==================== Test output for //pkg/edge/gitops/fns/addtenant:addtenant_test: 2023-06-05T14:16:37.7754926Z === RUN TestAddTenant 2023-06-05T14:16:37.7755259Z === RUN TestAddTenant/testdata/basic 2023-06-05T14:16:37.7755918Z --- PASS: TestAddTenant (0.01s) 2023-06-05T14:16:37.7756373Z --- PASS: TestAddTenant/testdata/basic (0.00s) 2023-06-05T14:16:37.7756731Z === RUN TestConfigValidation 2023-06-05T14:16:37.7757421Z --- PASS: TestConfigValidation (0.00s) 2023-06-05T14:16:37.7757815Z PASS 2023-06-05T14:16:37.7758232Z ================================================================================ 2023-06-05T14:16:37.9091852Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/approved_label:bulldoze_sync_label_test: 2023-06-05T14:16:37.9092632Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/approved_label:bulldoze_sync_label_test: 2023-06-05T14:16:37.9093059Z PASS 2023-06-05T14:16:37.9093375Z testing: warning: no tests to run 2023-06-05T14:16:37.9093756Z ================================================================================ 2023-06-05T14:16:40.0495969Z INFO: From Testing //pkg/lib/server:server_test: 2023-06-05T14:16:40.0496520Z ==================== Test output for //pkg/lib/server:server_test: 2023-06-05T14:16:40.0496897Z === RUN TestLiveFuncOption 2023-06-05T14:16:40.0497296Z liveoption_test.go:30: Yay, got status 503 before live function was called 2023-06-05T14:16:40.0498058Z liveoption_test.go:33: Setting live function using code 200 and text 'LIVE' 2023-06-05T14:16:40.0498370Z liveoption_test.go:35: Live function called. 2023-06-05T14:16:40.0498858Z liveoption_test.go:46: Yay, got status 200 after live function was called 2023-06-05T14:16:40.0499454Z liveoption_test.go:49: Setting live function using code 500 2023-06-05T14:16:40.0500082Z liveoption_test.go:51: Live function called. 2023-06-05T14:16:40.0500597Z liveoption_test.go:62: Yay, got status 500 after live function was called 2023-06-05T14:16:40.0501022Z --- PASS: TestLiveFuncOption (0.00s) 2023-06-05T14:16:40.0501467Z === RUN TestMetricsServesScrapeData 2023-06-05T14:16:40.0501863Z metrics_test.go:37: server ready 2023-06-05T14:16:40.0502136Z metrics_test.go:56: Found metric line: "foo_bar_baz_total 1" 2023-06-05T14:16:40.0502500Z --- PASS: TestMetricsServesScrapeData (0.00s) 2023-06-05T14:16:40.0502780Z === RUN TestReadyFuncOption 2023-06-05T14:16:40.0503111Z readyoption_test.go:30: Yay, got status 503 before ready function was called 2023-06-05T14:16:40.0503639Z readyoption_test.go:33: Calling ready function. 2023-06-05T14:16:40.0504100Z readyoption_test.go:35: Ready function called. 2023-06-05T14:16:40.0504713Z readyoption_test.go:46: Yay, got status 200 after ready function was called 2023-06-05T14:16:40.0505081Z --- PASS: TestReadyFuncOption (0.00s) 2023-06-05T14:16:40.0505654Z === RUN TestServerShutdown 2023-06-05T14:16:40.0505915Z shutdown_test.go:41: Got ready status of 200 2023-06-05T14:16:40.0506328Z shutdown_test.go:46: Shutting down server 2023-06-05T14:16:40.0506596Z shutdown_test.go:25: yay server closed correctly. 2023-06-05T14:16:40.0506893Z --- PASS: TestServerShutdown (0.00s) 2023-06-05T14:16:40.0507109Z PASS 2023-06-05T14:16:40.0507319Z ================================================================================ 2023-06-05T14:16:40.1957452Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/enforce_milestone:enforce_milestone_test: 2023-06-05T14:16:40.1958024Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/enforce_milestone:enforce_milestone_test: 2023-06-05T14:16:40.1958324Z === RUN TestLabeling 2023-06-05T14:16:40.1958601Z {"severity":"info","ts":1685974600.1814065,"message":"Check label for milestone"} 2023-06-05T14:16:40.1959057Z removinglabels: []remaining labels: []--- PASS: TestLabeling (0.00s) 2023-06-05T14:16:40.1959366Z === RUN TestUnlabeling 2023-06-05T14:16:40.1959613Z {"severity":"info","ts":1685974600.1814733,"message":"CHECKING REMOVAL"} 2023-06-05T14:16:40.1959937Z --- PASS: TestUnlabeling (0.00s) 2023-06-05T14:16:40.1960166Z === RUN TestAddBack 2023-06-05T14:16:40.1960420Z {"severity":"info","ts":1685974600.1815088,"message":"CHECKING REMOVAL"} 2023-06-05T14:16:40.1960971Z adding&{Labels:[] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:github.Milestone{}}[triage/needs-milestone]--- PASS: TestAddBack (0.00s) 2023-06-05T14:16:40.1961343Z === RUN TestMilestoned 2023-06-05T14:16:40.1961695Z removinglabels: []remaining labels: []--- PASS: TestMilestoned (0.00s) 2023-06-05T14:16:40.1962047Z === RUN TestOpening 2023-06-05T14:16:40.1962559Z adding&{Labels:[] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:github.Milestone{}}[triage/needs-milestone]--- PASS: TestOpening (0.00s) 2023-06-05T14:16:40.1962886Z PASS 2023-06-05T14:16:40.1963109Z ================================================================================ 2023-06-05T14:16:40.5952393Z INFO: From Testing //pkg/edge/gitops/fns/deleteresource:deleteresource_test: 2023-06-05T14:16:40.5959083Z ==================== Test output for //pkg/edge/gitops/fns/deleteresource:deleteresource_test: 2023-06-05T14:16:40.5959615Z === RUN TestConfigValidation 2023-06-05T14:16:40.5960332Z --- PASS: TestConfigValidation (0.00s) 2023-06-05T14:16:40.6005979Z === RUN TestMatches 2023-06-05T14:16:40.6006431Z --- PASS: TestMatches (0.00s) 2023-06-05T14:16:40.6006672Z === RUN TestDeleteResource 2023-06-05T14:16:40.6006978Z === RUN TestDeleteResource/testdata/basic 2023-06-05T14:16:40.6007315Z === RUN TestDeleteResource/testdata/cluster-resources 2023-06-05T14:16:40.6007645Z === RUN TestDeleteResource/testdata/namespace 2023-06-05T14:16:40.6007986Z === RUN TestDeleteResource/testdata/tenant-resources 2023-06-05T14:16:40.6008351Z --- PASS: TestDeleteResource (0.01s) 2023-06-05T14:16:40.6008704Z --- PASS: TestDeleteResource/testdata/basic (0.00s) 2023-06-05T14:16:40.6009076Z --- PASS: TestDeleteResource/testdata/cluster-resources (0.00s) 2023-06-05T14:16:40.6009463Z --- PASS: TestDeleteResource/testdata/namespace (0.00s) 2023-06-05T14:16:40.6009847Z --- PASS: TestDeleteResource/testdata/tenant-resources (0.00s) 2023-06-05T14:16:40.6010396Z PASS 2023-06-05T14:16:40.6010617Z ================================================================================ 2023-06-05T14:16:41.2399854Z INFO: From Testing //pkg/f8n/devinfra/ghappman:ghappman_test: 2023-06-05T14:16:41.2400517Z ==================== Test output for //pkg/f8n/devinfra/ghappman:ghappman_test: 2023-06-05T14:16:41.2400955Z === RUN TestCreateGitHubApp 2023-06-05T14:16:41.2401297Z --- SKIP: TestCreateGitHubApp (0.00s) 2023-06-05T14:16:41.2401548Z === RUN TestFormTemplate 2023-06-05T14:16:41.2401994Z [GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached. 2023-06-05T14:16:41.2402613Z 2023-06-05T14:16:41.2402873Z [GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production. 2023-06-05T14:16:41.2403417Z - using env: export GIN_MODE=release 2023-06-05T14:16:41.2403729Z - using code: gin.SetMode(gin.ReleaseMode) 2023-06-05T14:16:41.2403882Z 2023-06-05T14:16:41.2404195Z [GIN-debug] GET / --> edge-infra.dev/pkg/f8n/devinfra/ghappman.NewServer.func1 (3 handlers) 2023-06-05T14:16:41.2404874Z [GIN-debug] POST /new-app --> edge-infra.dev/pkg/f8n/devinfra/ghappman.NewServer.func2 (3 handlers) 2023-06-05T14:16:41.2405413Z [GIN-debug] GET /new-app --> edge-infra.dev/pkg/f8n/devinfra/ghappman.NewServer.func3 (3 handlers) 2023-06-05T14:16:41.2406024Z [GIN-debug] GET /new-app/:state/callback --> edge-infra.dev/pkg/f8n/devinfra/ghappman.NewServer.func4 (3 handlers) 2023-06-05T14:16:41.2406576Z [GIN-debug] GET /new-app/:state/app --> edge-infra.dev/pkg/f8n/devinfra/ghappman.NewServer.func5 (3 handlers) 2023-06-05T14:16:41.2407130Z [GIN] 2023/06/05 - 14:16:41 | 200 | 224.464µs | | GET "/new-app?install_suffix=foo&state=bar" 2023-06-05T14:16:41.2407465Z --- PASS: TestFormTemplate (0.00s) 2023-06-05T14:16:41.2407705Z === RUN TestGetBeforeSessionTimeout 2023-06-05T14:16:41.2408062Z --- PASS: TestGetBeforeSessionTimeout (0.00s) 2023-06-05T14:16:41.2408367Z === RUN TestGetAfterSessionTimeout 2023-06-05T14:16:41.2408864Z --- PASS: TestGetAfterSessionTimeout (0.00s) 2023-06-05T14:16:41.2409128Z === RUN TestEndBeforeSessionTimeout 2023-06-05T14:16:41.2409458Z --- PASS: TestEndBeforeSessionTimeout (0.00s) 2023-06-05T14:16:41.2409726Z === RUN TestEndAfterSessionTimeout 2023-06-05T14:16:41.2410041Z --- PASS: TestEndAfterSessionTimeout (0.00s) 2023-06-05T14:16:41.2410255Z PASS 2023-06-05T14:16:41.2410461Z ================================================================================ 2023-06-05T14:16:41.2467378Z INFO: From Testing //pkg/f8n/monitoring/billman/costs:costs_test: 2023-06-05T14:16:41.2467964Z ==================== Test output for //pkg/f8n/monitoring/billman/costs:costs_test: 2023-06-05T14:16:41.2468408Z === RUN TestLogCosts 2023-06-05T14:16:41.2468798Z --- PASS: TestLogCosts (0.00s) 2023-06-05T14:16:41.2469170Z === RUN TestMetricCosts 2023-06-05T14:16:41.2469576Z --- PASS: TestMetricCosts (0.00s) 2023-06-05T14:16:41.2469879Z PASS 2023-06-05T14:16:41.2470162Z ================================================================================ 2023-06-05T14:16:41.2897075Z INFO: From Testing //pkg/lib/text/drawing:drawing_test: 2023-06-05T14:16:41.2897741Z ==================== Test output for //pkg/lib/text/drawing:drawing_test: 2023-06-05T14:16:41.2898173Z === RUN TestPrintTree 2023-06-05T14:16:41.2898519Z gma 2023-06-05T14:16:41.2899009Z ├─ uncle 2023-06-05T14:16:41.2899347Z │ ├─ cousin1 2023-06-05T14:16:41.2899567Z │ └─ cousin2 2023-06-05T14:16:41.2899770Z ├─ aunt 2023-06-05T14:16:41.2900002Z │ ├─ cousin_nochild 2023-06-05T14:16:41.2900416Z │ └─ cousin_withchild 2023-06-05T14:16:41.2900790Z │ └─ first_cousin-1 2023-06-05T14:16:41.2901192Z └─ dad 2023-06-05T14:16:41.2901509Z ├─ brother 2023-06-05T14:16:41.2901894Z │ └─ niece 2023-06-05T14:16:41.2902156Z └─ me 2023-06-05T14:16:41.2902366Z ├─ toxic 2023-06-05T14:16:41.2902567Z │ └─ toxic jr 2023-06-05T14:16:41.2902788Z ├─ tupelo 2023-06-05T14:16:41.2903016Z │ └─ tupelo jr 2023-06-05T14:16:41.2903231Z └─ leif 2023-06-05T14:16:41.2903430Z └─ leif jr 2023-06-05T14:16:41.2903667Z └─ leif jr jr 2023-06-05T14:16:41.2903938Z --- PASS: TestPrintTree (0.00s) 2023-06-05T14:16:41.2904164Z === RUN TestPrintDot 2023-06-05T14:16:41.2904385Z subgraph "cluster_some pallet digraph" { 2023-06-05T14:16:41.2904619Z "some pallet digraph" 2023-06-05T14:16:41.2904809Z "dep1" 2023-06-05T14:16:41.2905039Z "some pallet digraph" -> "dep1" 2023-06-05T14:16:41.2905237Z "some pallet digraph" 2023-06-05T14:16:41.2905421Z "dep2" 2023-06-05T14:16:41.2906035Z "some pallet digraph" -> "dep2" 2023-06-05T14:16:41.2906276Z } 2023-06-05T14:16:41.2906539Z --- PASS: TestPrintDot (0.00s) 2023-06-05T14:16:41.2906879Z PASS 2023-06-05T14:16:41.2907139Z ================================================================================ 2023-06-05T14:16:41.7060634Z INFO: From Testing //pkg/f8n/warehouse/k8s/apis/meta:meta_test: 2023-06-05T14:16:41.7061237Z ==================== Test output for //pkg/f8n/warehouse/k8s/apis/meta:meta_test: 2023-06-05T14:16:41.7061651Z === RUN TestIsFromPallet 2023-06-05T14:16:41.7062113Z --- PASS: TestIsFromPallet (0.00s) 2023-06-05T14:16:41.7062424Z PASS 2023-06-05T14:16:41.7062769Z ================================================================================ 2023-06-05T14:16:41.8053099Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/uploadjob:uploadjob_test: 2023-06-05T14:16:41.8053711Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/uploadjob:uploadjob_test: 2023-06-05T14:16:41.8054185Z === RUN Test 2023-06-05T14:16:41.8054583Z --- PASS: Test (0.00s) 2023-06-05T14:16:41.8054911Z PASS 2023-06-05T14:16:41.8055288Z ================================================================================ 2023-06-05T14:16:43.0534401Z INFO: From Testing //pkg/f8n/warehouse/pallet/resolve:resolve_test: 2023-06-05T14:16:43.0534996Z ==================== Test output for //pkg/f8n/warehouse/pallet/resolve:resolve_test: 2023-06-05T14:16:43.0535426Z === RUN TestResolve 2023-06-05T14:16:43.0535751Z === RUN TestResolve/shoot_artifact 2023-06-05T14:16:43.0536336Z === RUN TestResolve/redpanda-system_artifact 2023-06-05T14:16:43.0536896Z --- PASS: TestResolve (0.01s) 2023-06-05T14:16:43.0537363Z --- PASS: TestResolve/shoot_artifact (0.01s) 2023-06-05T14:16:43.0537938Z --- PASS: TestResolve/redpanda-system_artifact (0.00s) 2023-06-05T14:16:43.0538414Z === RUN TestResolveRef 2023-06-05T14:16:43.0538825Z === RUN TestResolveRef/shoot_artifact 2023-06-05T14:16:43.0539181Z resolve_test.go:71: 127.0.0.1:46635/test/shoot:latest 2023-06-05T14:16:43.0539409Z 2023/06/05 14:16:42 GET /v2/ 2023-06-05T14:16:43.0539675Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/latest 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0540093Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:3cd4b55810ae8ccff5bdd29ae639e56714b11be2f3c0f2a731e0d92511d48414 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0540864Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:48d1cb37e16a085c5cb91608bf0e0a0d489287114084b3720d44386a1835f8bd 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0541649Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:7a03cc593c6f5a9d40716baee9fe8add837816c177c022e4909af3d7a28b8f34 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0542436Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:cff8a1cf702db3dc5d93107c5fab83595691c010d3aea0546186228e3a0cf0d2 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0543206Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:04daa12e52015955421daca3cbf6516cb52e949990a78128e60382874557b1d5 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0543843Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:94bfddf8aea8bc19097734a1102333306ffa4580be157b7e294db4c5fc3c980f 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0544608Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:2e5d2c10d4f5374a840c49db31e4e564528377343bb35ec1f285f5ff35b0ebe0 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0545273Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:e736a85dbfe6e0bf961850b039d27db7bf3e970f84cb13d69c41511127bfaf6b 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0546028Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:d12e7f37af41a18228b37def2a8a9d61b1f4b0d33637f6f968815ab2de6837d1 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0546669Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0547814Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:8e3e13915c1f850581774ca9f9534da5ef9acc954266b61b8777ad306320a886 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0548161Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0548680Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:861d3aa54b5392b2532d5d3773e52f256d6709e123f6cd4a0e75ea576f133090 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0549123Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:4bd9f1b9656d6f8146fa4f95f06f447b799c6c721492d378e54941213d739513 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0549462Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0549935Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:7583182abe86d722630e567e32376b3cac125c0419d00de4526e686fa57472d2 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0550661Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:90ee7f5048b0fd2851bf11778a2e8fa04433c0a3b88a07649d5ffd0ef5b9732a 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0551275Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:3870028233bd09b08ab9e41c4341c902d433e0fde89567603477f5c27c065a0f 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0551723Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0552117Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0552525Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/5399431888149524660 2023-06-05T14:16:43.0553049Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:3417750aba6e60c7dda93a35c8941aa85d77f534605910ed68eff91bcf23a731 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0553579Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/7348300629398234806 2023-06-05T14:16:43.0554172Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/5399431888149524660?digest=sha256%3A2e5d2c10d4f5374a840c49db31e4e564528377343bb35ec1f285f5ff35b0ebe0 2023-06-05T14:16:43.0554664Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/2512468171560683386 2023-06-05T14:16:43.0555085Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0555474Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:e0d85b86a8c42b19803a9a87fc0644ae41ce576d9c627bc5643d51a7b0d21289 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0555959Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/2308738848410574745 2023-06-05T14:16:43.0556249Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0556517Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/8872688958423424398 2023-06-05T14:16:43.0556914Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:f6d6769f3effdd2ec6235de76c0afcd5bbd05fb064c4ca21b2d0bba78ece5860 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0557285Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0557638Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:c692d320bb96fb996da8f267750df99df4e238d2ad707bb146d1beda18d1d2a1 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0558306Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:277e49632b62d73da71411c5825eccb01c8b8214abd9b79ef3af66a5f3568dfc 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0559004Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:676039c983ac28389ba2102400548d8e5da9fc05e1d108abf1e02d7e1b8d3e5c 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0559732Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:13de334deeb3505019e46d990c04c2c2bdb670ceb87fd8fdc92b36d9f89ed397 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0560552Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:cf379b0eedeb498e835fea8519f07a0e74e7214d7c6c3f676e4e5d9546305cfe 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0561081Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0561572Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/2512468171560683386?digest=sha256%3A3870028233bd09b08ab9e41c4341c902d433e0fde89567603477f5c27c065a0f 2023-06-05T14:16:43.0562126Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0562595Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/5464790939023260897 2023-06-05T14:16:43.0563112Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0563500Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0563739Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0563983Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0564243Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0564511Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/4802862682969795029 2023-06-05T14:16:43.0564875Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/7348300629398234806?digest=sha256%3A94bfddf8aea8bc19097734a1102333306ffa4580be157b7e294db4c5fc3c980f 2023-06-05T14:16:43.0565332Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/8872688958423424398?digest=sha256%3Ad12e7f37af41a18228b37def2a8a9d61b1f4b0d33637f6f968815ab2de6837d1 2023-06-05T14:16:43.0565775Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/5464790939023260897?digest=sha256%3A8e3e13915c1f850581774ca9f9534da5ef9acc954266b61b8777ad306320a886 2023-06-05T14:16:43.0566208Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:9227359468e0319fb6ff39f9f647c8e664a62a2a7239830cb61ab6fcd94ba85c 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0566548Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0566815Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/1740135535286195681 2023-06-05T14:16:43.0567080Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/8107705286272878975 2023-06-05T14:16:43.0567361Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/3150617657000950785 2023-06-05T14:16:43.0567642Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/7903858258205461757 2023-06-05T14:16:43.0567912Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/4472503829926122965 2023-06-05T14:16:43.0568167Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/2527768530706692586 2023-06-05T14:16:43.0568537Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/4472503829926122965?digest=sha256%3A90ee7f5048b0fd2851bf11778a2e8fa04433c0a3b88a07649d5ffd0ef5b9732a 2023-06-05T14:16:43.0569000Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/2527768530706692586?digest=sha256%3Ac692d320bb96fb996da8f267750df99df4e238d2ad707bb146d1beda18d1d2a1 2023-06-05T14:16:43.0569462Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/2308738848410574745?digest=sha256%3Ae736a85dbfe6e0bf961850b039d27db7bf3e970f84cb13d69c41511127bfaf6b 2023-06-05T14:16:43.0569829Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/8953377151432947314 2023-06-05T14:16:43.0570115Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/9057945200271549032 2023-06-05T14:16:43.0570490Z 2023/06/05 14:16:42 PUT /v2/test/shoot/manifests/sha256:04daa12e52015955421daca3cbf6516cb52e949990a78128e60382874557b1d5 2023-06-05T14:16:43.0570917Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/4802862682969795029?digest=sha256%3Ae0d85b86a8c42b19803a9a87fc0644ae41ce576d9c627bc5643d51a7b0d21289 2023-06-05T14:16:43.0571279Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/5317714134874173595 2023-06-05T14:16:43.0571908Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/1740135535286195681?digest=sha256%3Af6d6769f3effdd2ec6235de76c0afcd5bbd05fb064c4ca21b2d0bba78ece5860 2023-06-05T14:16:43.0572538Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/8107705286272878975?digest=sha256%3A4bd9f1b9656d6f8146fa4f95f06f447b799c6c721492d378e54941213d739513 2023-06-05T14:16:43.0573375Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/3150617657000950785?digest=sha256%3A277e49632b62d73da71411c5825eccb01c8b8214abd9b79ef3af66a5f3568dfc 2023-06-05T14:16:43.0574060Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/7903858258205461757?digest=sha256%3A676039c983ac28389ba2102400548d8e5da9fc05e1d108abf1e02d7e1b8d3e5c 2023-06-05T14:16:43.0574759Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/8953377151432947314?digest=sha256%3Acf379b0eedeb498e835fea8519f07a0e74e7214d7c6c3f676e4e5d9546305cfe 2023-06-05T14:16:43.0575664Z 2023/06/05 14:16:42 PUT /v2/test/shoot/manifests/sha256:48d1cb37e16a085c5cb91608bf0e0a0d489287114084b3720d44386a1835f8bd 2023-06-05T14:16:43.0576408Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/9057945200271549032?digest=sha256%3A13de334deeb3505019e46d990c04c2c2bdb670ceb87fd8fdc92b36d9f89ed397 2023-06-05T14:16:43.0577040Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/5317714134874173595?digest=sha256%3A9227359468e0319fb6ff39f9f647c8e664a62a2a7239830cb61ab6fcd94ba85c 2023-06-05T14:16:43.0577612Z 2023/06/05 14:16:42 PUT /v2/test/shoot/manifests/sha256:861d3aa54b5392b2532d5d3773e52f256d6709e123f6cd4a0e75ea576f133090 2023-06-05T14:16:43.0578163Z 2023/06/05 14:16:42 PUT /v2/test/shoot/manifests/sha256:3417750aba6e60c7dda93a35c8941aa85d77f534605910ed68eff91bcf23a731 2023-06-05T14:16:43.0578712Z 2023/06/05 14:16:42 PUT /v2/test/shoot/manifests/sha256:7583182abe86d722630e567e32376b3cac125c0419d00de4526e686fa57472d2 2023-06-05T14:16:43.0579428Z 2023/06/05 14:16:42 PUT /v2/test/shoot/manifests/sha256:7a03cc593c6f5a9d40716baee9fe8add837816c177c022e4909af3d7a28b8f34 2023-06-05T14:16:43.0579991Z 2023/06/05 14:16:42 PUT /v2/test/shoot/manifests/sha256:cff8a1cf702db3dc5d93107c5fab83595691c010d3aea0546186228e3a0cf0d2 2023-06-05T14:16:43.0580474Z 2023/06/05 14:16:42 PUT /v2/test/shoot/manifests/sha256:3cd4b55810ae8ccff5bdd29ae639e56714b11be2f3c0f2a731e0d92511d48414 2023-06-05T14:16:43.0580928Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:84008b36d1e7f29a23ab1761ef7a435264e6f08174f792c7f32546f2c556f3ca 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:16:43.0581411Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:350da3b321a3daa415d0711c40b8a856c1ef1dcb95bdf017e9f5f1eb2d756382 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:16:43.0581897Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:a97e18e068d1196cc21d2573605dad4e3e028a8a0500c23bf0efb789007f6e8c 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:16:43.0582375Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/manifests/sha256:9b02a7f4f7c47cd9d61f2fdf395d171c751d624c815fd67fb2001d502a999bd3 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:16:43.0582838Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:24e1a96d5c0c7494422c855a13b8ecef40720aca0be08e75ac09380fb6569577 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0583279Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:c801274619a70c952392f99dfe949a8a609a1b4f84a8600f3412efe479d8f6d7 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0583728Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:283ab9fa2da04e41ae7ef673470fbf1c7760f157da9f9a80987fb8654b1e5d22 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0584181Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:36688606c118cd9f9b263e0e314f5185fc5d0227cec318e9d66c6c16289ad1b8 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0584643Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:69801535caf1c54c99d3f44220255e75ed03067bd2d556e0c5a248c63942014e 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0584991Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0585232Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0585496Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0585748Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0586017Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/465153073435142768 2023-06-05T14:16:43.0586285Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0586624Z 2023/06/05 14:16:42 HEAD /v2/test/shoot/blobs/sha256:9074d92b5173a55a62a7b29eb73f9ad9929b0a066e7d1ca87dd9b367fb7bc64e 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0586983Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/3570643311529465394 2023-06-05T14:16:43.0587354Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/465153073435142768?digest=sha256%3A36688606c118cd9f9b263e0e314f5185fc5d0227cec318e9d66c6c16289ad1b8 2023-06-05T14:16:43.0587892Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/134170463300087899 2023-06-05T14:16:43.0588177Z 2023/06/05 14:16:42 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0588541Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/1197058913737149579 2023-06-05T14:16:43.0588827Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/5390199336730816177 2023-06-05T14:16:43.0589203Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/3570643311529465394?digest=sha256%3A24e1a96d5c0c7494422c855a13b8ecef40720aca0be08e75ac09380fb6569577 2023-06-05T14:16:43.0589664Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/134170463300087899?digest=sha256%3A283ab9fa2da04e41ae7ef673470fbf1c7760f157da9f9a80987fb8654b1e5d22 2023-06-05T14:16:43.0590107Z 2023/06/05 14:16:42 PUT /v2/test/shoot/blobs/uploads/5390199336730816177?digest=sha256%3Ac801274619a70c952392f99dfe949a8a609a1b4f84a8600f3412efe479d8f6d7 2023-06-05T14:16:43.0590481Z 2023/06/05 14:16:42 PATCH /v2/test/shoot/blobs/uploads/560556539689716980 2023-06-05T14:16:43.0590827Z 2023/06/05 14:16:42 PUT /v2/test/shoot/manifests/sha256:a97e18e068d1196cc21d2573605dad4e3e028a8a0500c23bf0efb789007f6e8c 2023-06-05T14:16:43.0591251Z 2023/06/05 14:16:43 PUT /v2/test/shoot/blobs/uploads/1197058913737149579?digest=sha256%3A69801535caf1c54c99d3f44220255e75ed03067bd2d556e0c5a248c63942014e 2023-06-05T14:16:43.0591684Z 2023/06/05 14:16:43 PUT /v2/test/shoot/blobs/uploads/560556539689716980?digest=sha256%3A9074d92b5173a55a62a7b29eb73f9ad9929b0a066e7d1ca87dd9b367fb7bc64e 2023-06-05T14:16:43.0592111Z 2023/06/05 14:16:43 PUT /v2/test/shoot/manifests/sha256:9b02a7f4f7c47cd9d61f2fdf395d171c751d624c815fd67fb2001d502a999bd3 2023-06-05T14:16:43.0592529Z 2023/06/05 14:16:43 PUT /v2/test/shoot/manifests/sha256:350da3b321a3daa415d0711c40b8a856c1ef1dcb95bdf017e9f5f1eb2d756382 2023-06-05T14:16:43.0592962Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/manifests/sha256:1dd8325269434ffa687108a888d370e7a4b9e5d47be10de6232ddd033ce08c60 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:16:43.0593444Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/manifests/sha256:ec94acf9e725a48d3ed203974dea88686ed1742d1d9fd2d9b6978e514eb249b8 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:16:43.0593924Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/manifests/sha256:27f78389baeb8613c5053fd50b58e1d58c4a1221297ece6592d4cc6855a35415 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:16:43.0594379Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/blobs/sha256:a73bfc1672e7d311bc78f49b3f6772a30890b8d66e6f76962d83b33925cd62f6 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0594839Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/blobs/sha256:8dcc0abff0c04e8f29440c4086566ae202aa27b017f232823143c7bb5fff875f 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0595316Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/blobs/sha256:a46199c284d35e667323a012798cd0c9938ea9f2ab81e29be5725aee7d4e2158 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0595658Z 2023/06/05 14:16:43 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0596014Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/blobs/sha256:7e02b4aa00b83ba78d58b924005285870f8a463e6f45679c0d74d1c560b10c6c 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0596417Z 2023/06/05 14:16:43 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0596800Z 2023/06/05 14:16:43 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0597209Z 2023/06/05 14:16:43 PATCH /v2/test/shoot/blobs/uploads/5324958390873052502 2023-06-05T14:16:43.0597633Z 2023/06/05 14:16:43 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0598003Z 2023/06/05 14:16:43 PATCH /v2/test/shoot/blobs/uploads/388049914279084504 2023-06-05T14:16:43.0598421Z 2023/06/05 14:16:43 PATCH /v2/test/shoot/blobs/uploads/1561574980058035501 2023-06-05T14:16:43.0598992Z 2023/06/05 14:16:43 PUT /v2/test/shoot/blobs/uploads/5324958390873052502?digest=sha256%3Aa73bfc1672e7d311bc78f49b3f6772a30890b8d66e6f76962d83b33925cd62f6 2023-06-05T14:16:43.0599598Z 2023/06/05 14:16:43 PUT /v2/test/shoot/blobs/uploads/388049914279084504?digest=sha256%3Aa46199c284d35e667323a012798cd0c9938ea9f2ab81e29be5725aee7d4e2158 2023-06-05T14:16:43.0600304Z 2023/06/05 14:16:43 PATCH /v2/test/shoot/blobs/uploads/1305705294027830617 2023-06-05T14:16:43.0600957Z 2023/06/05 14:16:43 PUT /v2/test/shoot/blobs/uploads/1561574980058035501?digest=sha256%3A8dcc0abff0c04e8f29440c4086566ae202aa27b017f232823143c7bb5fff875f 2023-06-05T14:16:43.0601585Z 2023/06/05 14:16:43 PUT /v2/test/shoot/blobs/uploads/1305705294027830617?digest=sha256%3A7e02b4aa00b83ba78d58b924005285870f8a463e6f45679c0d74d1c560b10c6c 2023-06-05T14:16:43.0602241Z 2023/06/05 14:16:43 PUT /v2/test/shoot/manifests/sha256:27f78389baeb8613c5053fd50b58e1d58c4a1221297ece6592d4cc6855a35415 2023-06-05T14:16:43.0602655Z 2023/06/05 14:16:43 PUT /v2/test/shoot/manifests/sha256:ec94acf9e725a48d3ed203974dea88686ed1742d1d9fd2d9b6978e514eb249b8 2023-06-05T14:16:43.0603063Z 2023/06/05 14:16:43 PUT /v2/test/shoot/manifests/sha256:1dd8325269434ffa687108a888d370e7a4b9e5d47be10de6232ddd033ce08c60 2023-06-05T14:16:43.0603510Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/manifests/sha256:1d86382d477e7ab3e2a886fe3293a925593c51ae89a9d8c4b08010d89d1026df 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:16:43.0603978Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/manifests/sha256:e7442b38bfe7897de96e517384b128d03c0db79cda56038029d5049195d17936 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:16:43.0604470Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/blobs/sha256:4efa815dbc544ab8df37f8e4a5e7ebbc9ea296fdaf594daa7a8081b86a4fdd9f 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0604953Z 2023/06/05 14:16:43 HEAD /v2/test/shoot/blobs/sha256:86c55acab272a44706c72eeab6d2abbb92a061821d29f06849ddc76284f473c6 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:16:43.0605294Z 2023/06/05 14:16:43 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0605552Z 2023/06/05 14:16:43 POST /v2/test/shoot/blobs/uploads/ 2023-06-05T14:16:43.0605829Z 2023/06/05 14:16:43 PATCH /v2/test/shoot/blobs/uploads/183711507635972007 2023-06-05T14:16:43.0606114Z 2023/06/05 14:16:43 PATCH /v2/test/shoot/blobs/uploads/1488075285535061473 2023-06-05T14:16:43.0606496Z 2023/06/05 14:16:43 PUT /v2/test/shoot/blobs/uploads/183711507635972007?digest=sha256%3A4efa815dbc544ab8df37f8e4a5e7ebbc9ea296fdaf594daa7a8081b86a4fdd9f 2023-06-05T14:16:43.0606975Z 2023/06/05 14:16:43 PUT /v2/test/shoot/blobs/uploads/1488075285535061473?digest=sha256%3A86c55acab272a44706c72eeab6d2abbb92a061821d29f06849ddc76284f473c6 2023-06-05T14:16:43.0607397Z 2023/06/05 14:16:43 PUT /v2/test/shoot/manifests/sha256:e7442b38bfe7897de96e517384b128d03c0db79cda56038029d5049195d17936 2023-06-05T14:16:43.0607797Z 2023/06/05 14:16:43 PUT /v2/test/shoot/manifests/sha256:1d86382d477e7ab3e2a886fe3293a925593c51ae89a9d8c4b08010d89d1026df 2023-06-05T14:16:43.0608188Z 2023/06/05 14:16:43 PUT /v2/test/shoot/manifests/sha256:84008b36d1e7f29a23ab1761ef7a435264e6f08174f792c7f32546f2c556f3ca 2023-06-05T14:16:43.0608514Z 2023/06/05 14:16:43 PUT /v2/test/shoot/manifests/latest 2023-06-05T14:16:43.0608720Z 2023/06/05 14:16:43 GET /v2/ 2023-06-05T14:16:43.0608949Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/latest 2023-06-05T14:16:43.0609283Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:48d1cb37e16a085c5cb91608bf0e0a0d489287114084b3720d44386a1835f8bd 2023-06-05T14:16:43.0609691Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:7a03cc593c6f5a9d40716baee9fe8add837816c177c022e4909af3d7a28b8f34 2023-06-05T14:16:43.0610114Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:3cd4b55810ae8ccff5bdd29ae639e56714b11be2f3c0f2a731e0d92511d48414 2023-06-05T14:16:43.0610582Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:04daa12e52015955421daca3cbf6516cb52e949990a78128e60382874557b1d5 2023-06-05T14:16:43.0610989Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:cff8a1cf702db3dc5d93107c5fab83595691c010d3aea0546186228e3a0cf0d2 2023-06-05T14:16:43.0611390Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:7583182abe86d722630e567e32376b3cac125c0419d00de4526e686fa57472d2 2023-06-05T14:16:43.0612004Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:3417750aba6e60c7dda93a35c8941aa85d77f534605910ed68eff91bcf23a731 2023-06-05T14:16:43.0612558Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:861d3aa54b5392b2532d5d3773e52f256d6709e123f6cd4a0e75ea576f133090 2023-06-05T14:16:43.0613045Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:84008b36d1e7f29a23ab1761ef7a435264e6f08174f792c7f32546f2c556f3ca 2023-06-05T14:16:43.0613425Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:350da3b321a3daa415d0711c40b8a856c1ef1dcb95bdf017e9f5f1eb2d756382 2023-06-05T14:16:43.0613837Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:9b02a7f4f7c47cd9d61f2fdf395d171c751d624c815fd67fb2001d502a999bd3 2023-06-05T14:16:43.0614235Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:a97e18e068d1196cc21d2573605dad4e3e028a8a0500c23bf0efb789007f6e8c 2023-06-05T14:16:43.0614621Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:1dd8325269434ffa687108a888d370e7a4b9e5d47be10de6232ddd033ce08c60 2023-06-05T14:16:43.0615023Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:ec94acf9e725a48d3ed203974dea88686ed1742d1d9fd2d9b6978e514eb249b8 2023-06-05T14:16:43.0615410Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:27f78389baeb8613c5053fd50b58e1d58c4a1221297ece6592d4cc6855a35415 2023-06-05T14:16:43.0615817Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:350da3b321a3daa415d0711c40b8a856c1ef1dcb95bdf017e9f5f1eb2d756382 2023-06-05T14:16:43.0616227Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:9b02a7f4f7c47cd9d61f2fdf395d171c751d624c815fd67fb2001d502a999bd3 2023-06-05T14:16:43.0616621Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:a97e18e068d1196cc21d2573605dad4e3e028a8a0500c23bf0efb789007f6e8c 2023-06-05T14:16:43.0617006Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:1d86382d477e7ab3e2a886fe3293a925593c51ae89a9d8c4b08010d89d1026df 2023-06-05T14:16:43.0617390Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:e7442b38bfe7897de96e517384b128d03c0db79cda56038029d5049195d17936 2023-06-05T14:16:43.0617762Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:1dd8325269434ffa687108a888d370e7a4b9e5d47be10de6232ddd033ce08c60 2023-06-05T14:16:43.0618159Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:ec94acf9e725a48d3ed203974dea88686ed1742d1d9fd2d9b6978e514eb249b8 2023-06-05T14:16:43.0618558Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:27f78389baeb8613c5053fd50b58e1d58c4a1221297ece6592d4cc6855a35415 2023-06-05T14:16:43.0618956Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:350da3b321a3daa415d0711c40b8a856c1ef1dcb95bdf017e9f5f1eb2d756382 2023-06-05T14:16:43.0619360Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:9b02a7f4f7c47cd9d61f2fdf395d171c751d624c815fd67fb2001d502a999bd3 2023-06-05T14:16:43.0619738Z 2023/06/05 14:16:43 GET /v2/test/shoot/manifests/sha256:a97e18e068d1196cc21d2573605dad4e3e028a8a0500c23bf0efb789007f6e8c 2023-06-05T14:16:43.0620353Z === RUN TestResolveRef/redpanda-system_artifact 2023-06-05T14:16:43.0620792Z resolve_test.go:71: 127.0.0.1:46635/test/redpanda-system:latest 2023-06-05T14:16:43.0621040Z 2023/06/05 14:16:43 GET /v2/ 2023-06-05T14:16:43.0621421Z 2023/06/05 14:16:43 HEAD /v2/test/redpanda-system/manifests/latest 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0621994Z 2023/06/05 14:16:43 HEAD /v2/test/redpanda-system/manifests/sha256:861d3aa54b5392b2532d5d3773e52f256d6709e123f6cd4a0e75ea576f133090 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0622605Z 2023/06/05 14:16:43 HEAD /v2/test/redpanda-system/manifests/sha256:7583182abe86d722630e567e32376b3cac125c0419d00de4526e686fa57472d2 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0623228Z 2023/06/05 14:16:43 HEAD /v2/test/redpanda-system/manifests/sha256:3417750aba6e60c7dda93a35c8941aa85d77f534605910ed68eff91bcf23a731 404 NAME_UNKNOWN Unknown name 2023-06-05T14:16:43.0623841Z 2023/06/05 14:16:43 HEAD /v2/test/redpanda-system/blobs/sha256:f6d6769f3effdd2ec6235de76c0afcd5bbd05fb064c4ca21b2d0bba78ece5860 2023-06-05T14:16:43.0624405Z 2023/06/05 14:16:43 HEAD /v2/test/redpanda-system/blobs/sha256:676039c983ac28389ba2102400548d8e5da9fc05e1d108abf1e02d7e1b8d3e5c 2023-06-05T14:16:43.0625044Z 2023/06/05 14:16:43 HEAD /v2/test/redpanda-system/blobs/sha256:e0d85b86a8c42b19803a9a87fc0644ae41ce576d9c627bc5643d51a7b0d21289 2023-06-05T14:16:43.0625686Z 2023/06/05 14:16:43 HEAD /v2/test/redpanda-system/blobs/sha256:277e49632b62d73da71411c5825eccb01c8b8214abd9b79ef3af66a5f3568dfc 2023-06-05T14:16:43.0626237Z 2023/06/05 14:16:43 HEAD /v2/test/redpanda-system/blobs/sha256:cf379b0eedeb498e835fea8519f07a0e74e7214d7c6c3f676e4e5d9546305cfe 2023-06-05T14:16:43.0626789Z 2023/06/05 14:16:43 HEAD /v2/test/redpanda-system/blobs/sha256:13de334deeb3505019e46d990c04c2c2bdb670ceb87fd8fdc92b36d9f89ed397 2023-06-05T14:16:43.0627351Z 2023/06/05 14:16:43 PUT /v2/test/redpanda-system/manifests/sha256:7583182abe86d722630e567e32376b3cac125c0419d00de4526e686fa57472d2 2023-06-05T14:16:43.0627913Z 2023/06/05 14:16:43 PUT /v2/test/redpanda-system/manifests/sha256:3417750aba6e60c7dda93a35c8941aa85d77f534605910ed68eff91bcf23a731 2023-06-05T14:16:43.0628475Z 2023/06/05 14:16:43 PUT /v2/test/redpanda-system/manifests/sha256:861d3aa54b5392b2532d5d3773e52f256d6709e123f6cd4a0e75ea576f133090 2023-06-05T14:16:43.0628875Z 2023/06/05 14:16:43 PUT /v2/test/redpanda-system/manifests/latest 2023-06-05T14:16:43.0629120Z 2023/06/05 14:16:43 GET /v2/ 2023-06-05T14:16:43.0629429Z 2023/06/05 14:16:43 GET /v2/test/redpanda-system/manifests/latest 2023-06-05T14:16:43.0629906Z 2023/06/05 14:16:43 GET /v2/test/redpanda-system/manifests/sha256:7583182abe86d722630e567e32376b3cac125c0419d00de4526e686fa57472d2 2023-06-05T14:16:43.0630488Z 2023/06/05 14:16:43 GET /v2/test/redpanda-system/manifests/sha256:3417750aba6e60c7dda93a35c8941aa85d77f534605910ed68eff91bcf23a731 2023-06-05T14:16:43.0631028Z 2023/06/05 14:16:43 GET /v2/test/redpanda-system/manifests/sha256:861d3aa54b5392b2532d5d3773e52f256d6709e123f6cd4a0e75ea576f133090 2023-06-05T14:16:43.0631392Z --- PASS: TestResolveRef (0.08s) 2023-06-05T14:16:43.0631708Z --- PASS: TestResolveRef/shoot_artifact (0.07s) 2023-06-05T14:16:43.0632072Z --- PASS: TestResolveRef/redpanda-system_artifact (0.01s) 2023-06-05T14:16:43.0632322Z === RUN TestAcceptFirst 2023-06-05T14:16:43.0632586Z --- PASS: TestAcceptFirst (0.01s) 2023-06-05T14:16:43.0632800Z PASS 2023-06-05T14:16:43.0633006Z ================================================================================ 2023-06-05T14:16:43.4215575Z INFO: From Testing //pkg/f8n/warehouse/lift/cmd/pallets:pallets_test: 2023-06-05T14:16:43.4216350Z stdout (/github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/_tmp/actions/stdout-2079) 1398939 exceeds maximum size of --experimental_ui_max_stdouterr_bytes=1048576 bytes; skipping 2023-06-05T14:16:43.9671666Z INFO: From Testing //pkg/edge/gitops/fns/addcontainerpool:addcontainerpool_test: 2023-06-05T14:16:43.9672470Z ==================== Test output for //pkg/edge/gitops/fns/addcontainerpool:addcontainerpool_test: 2023-06-05T14:16:43.9673040Z === RUN TestAddContainerPool 2023-06-05T14:16:43.9673563Z === RUN TestAddContainerPool/testdata 2023-06-05T14:16:43.9674229Z --- PASS: TestAddContainerPool (0.00s) 2023-06-05T14:16:43.9674872Z --- PASS: TestAddContainerPool/testdata (0.00s) 2023-06-05T14:16:43.9675172Z === RUN TestValidConfigValidation 2023-06-05T14:16:43.9675495Z --- PASS: TestValidConfigValidation (0.00s) 2023-06-05T14:16:43.9675770Z === RUN TestInvalidConfigValidation 2023-06-05T14:16:43.9676372Z === RUN TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_project_id 2023-06-05T14:16:43.9676873Z === PAUSE TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_project_id 2023-06-05T14:16:43.9677383Z === RUN TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_namespace 2023-06-05T14:16:43.9677887Z === PAUSE TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_namespace 2023-06-05T14:16:43.9678381Z === RUN TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_fleet 2023-06-05T14:16:43.9679231Z === PAUSE TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_fleet 2023-06-05T14:16:43.9679930Z === RUN TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Name_in_Spec 2023-06-05T14:16:43.9680448Z === PAUSE TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Name_in_Spec 2023-06-05T14:16:43.9680993Z === RUN TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_InitialNodeCount_in_Payload 2023-06-05T14:16:43.9681712Z === PAUSE TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_InitialNodeCount_in_Payload 2023-06-05T14:16:43.9682300Z === RUN TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Banner_in_Payload 2023-06-05T14:16:43.9682815Z === PAUSE TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Banner_in_Payload 2023-06-05T14:16:43.9683366Z === RUN TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_MinMasterVersion_in_Payload 2023-06-05T14:16:43.9683933Z === PAUSE TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_MinMasterVersion_in_Payload 2023-06-05T14:16:43.9684478Z === RUN TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Location_in_Payload 2023-06-05T14:16:43.9685182Z === PAUSE TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Location_in_Payload 2023-06-05T14:16:43.9685721Z === RUN TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Machine_Type_in_Payload 2023-06-05T14:16:43.9686242Z === PAUSE TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Machine_Type_in_Payload 2023-06-05T14:16:43.9686754Z === RUN TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Cluster_Name_in_Spec 2023-06-05T14:16:43.9687352Z === PAUSE TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Cluster_Name_in_Spec 2023-06-05T14:16:43.9687859Z === CONT TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_project_id 2023-06-05T14:16:43.9688411Z === CONT TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_InitialNodeCount_in_Payload 2023-06-05T14:16:43.9689065Z === CONT TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Banner_in_Payload 2023-06-05T14:16:43.9689632Z === CONT TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Cluster_Name_in_Spec 2023-06-05T14:16:43.9690166Z === CONT TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Name_in_Spec 2023-06-05T14:16:43.9690698Z === CONT TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_fleet 2023-06-05T14:16:43.9691217Z === CONT TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_namespace 2023-06-05T14:16:43.9692080Z === CONT TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Machine_Type_in_Payload 2023-06-05T14:16:43.9692623Z === CONT TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Location_in_Payload 2023-06-05T14:16:43.9693179Z === CONT TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_MinMasterVersion_in_Payload 2023-06-05T14:16:43.9693606Z --- PASS: TestInvalidConfigValidation (0.00s) 2023-06-05T14:16:43.9694079Z --- PASS: TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_project_id (0.00s) 2023-06-05T14:16:43.9694837Z --- PASS: TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_InitialNodeCount_in_Payload (0.00s) 2023-06-05T14:16:43.9695459Z --- PASS: TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Banner_in_Payload (0.00s) 2023-06-05T14:16:43.9696112Z --- PASS: TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Cluster_Name_in_Spec (0.00s) 2023-06-05T14:16:43.9696870Z --- PASS: TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Machine_Type_in_Payload (0.00s) 2023-06-05T14:16:43.9697657Z --- PASS: TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Name_in_Spec (0.00s) 2023-06-05T14:16:43.9698309Z --- PASS: TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_fleet (0.00s) 2023-06-05T14:16:43.9698831Z --- PASS: TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_namespace (0.00s) 2023-06-05T14:16:43.9699389Z --- PASS: TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_Location_in_Payload (0.00s) 2023-06-05T14:16:43.9699997Z --- PASS: TestInvalidConfigValidation/AddContainerPool_-_Simple_invalid_Config_-_Missing_MinMasterVersion_in_Payload (0.00s) 2023-06-05T14:16:43.9700322Z PASS 2023-06-05T14:16:43.9700534Z ================================================================================ 2023-06-05T14:16:46.5123767Z INFO: From Testing //cmd/f8n/monitoring/alertman/cli:cli_test: 2023-06-05T14:16:46.5124322Z ==================== Test output for //cmd/f8n/monitoring/alertman/cli:cli_test: 2023-06-05T14:16:46.5124775Z === RUN TestRunner 2023-06-05T14:16:46.5125180Z --- SKIP: TestRunner (0.00s) 2023-06-05T14:16:46.5125559Z PASS 2023-06-05T14:16:46.5125913Z ================================================================================ 2023-06-05T14:16:46.6617601Z INFO: From Testing //config/pallets:pallets_test: 2023-06-05T14:16:46.6618149Z ==================== Test output for //config/pallets:pallets_test: 2023-06-05T14:16:46.6618635Z === RUN TestEmbeddedAPIPallet 2023-06-05T14:16:46.6619200Z --- PASS: TestEmbeddedAPIPallet (2.21s) 2023-06-05T14:16:46.6619679Z PASS 2023-06-05T14:16:46.6620052Z ================================================================================ 2023-06-05T14:16:47.0163366Z INFO: From Testing //pkg/edge/gitops/fns/addcontainercluster:addcontainercluster_test: 2023-06-05T14:16:47.0164216Z ==================== Test output for //pkg/edge/gitops/fns/addcontainercluster:addcontainercluster_test: 2023-06-05T14:16:47.0164831Z === RUN TestAddContainerCluster 2023-06-05T14:16:47.0165136Z === RUN TestAddContainerCluster/testdata 2023-06-05T14:16:47.0165492Z --- PASS: TestAddContainerCluster (0.00s) 2023-06-05T14:16:47.0166101Z --- PASS: TestAddContainerCluster/testdata (0.00s) 2023-06-05T14:16:47.0166508Z === RUN TestConfigValidation 2023-06-05T14:16:47.0166813Z --- PASS: TestConfigValidation (0.00s) 2023-06-05T14:16:47.0167130Z === RUN TestInvalidConfigValidation 2023-06-05T14:16:47.0167931Z === RUN TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_project_id 2023-06-05T14:16:47.0168793Z === PAUSE TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_project_id 2023-06-05T14:16:47.0169355Z === RUN TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_namespace 2023-06-05T14:16:47.0169891Z === PAUSE TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_namespace 2023-06-05T14:16:47.0170392Z === RUN TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_fleet 2023-06-05T14:16:47.0171034Z === PAUSE TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_fleet 2023-06-05T14:16:47.0171917Z === RUN TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Name_in_Spec 2023-06-05T14:16:47.0172457Z === PAUSE TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Name_in_Spec 2023-06-05T14:16:47.0173021Z === RUN TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_InitialNodeCount_in_Payload 2023-06-05T14:16:47.0173581Z === PAUSE TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_InitialNodeCount_in_Payload 2023-06-05T14:16:47.0174493Z === RUN TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Banner_in_Payload 2023-06-05T14:16:47.0175047Z === PAUSE TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Banner_in_Payload 2023-06-05T14:16:47.0177502Z === RUN TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_MinMasterVersion_in_Payload 2023-06-05T14:16:47.0178264Z === PAUSE TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_MinMasterVersion_in_Payload 2023-06-05T14:16:47.0178825Z === RUN TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Location_in_Payload 2023-06-05T14:16:47.0179350Z === PAUSE TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Location_in_Payload 2023-06-05T14:16:47.0179888Z === RUN TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Cluster_Name_in_Spec 2023-06-05T14:16:47.0180434Z === PAUSE TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Cluster_Name_in_Spec 2023-06-05T14:16:47.0180966Z === CONT TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_project_id 2023-06-05T14:16:47.0181576Z === CONT TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Location_in_Payload 2023-06-05T14:16:47.0182118Z === CONT TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_MinMasterVersion_in_Payload 2023-06-05T14:16:47.0182657Z === CONT TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Name_in_Spec 2023-06-05T14:16:47.0183189Z === CONT TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Cluster_Name_in_Spec 2023-06-05T14:16:47.0183867Z === CONT TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Banner_in_Payload 2023-06-05T14:16:47.0184399Z === CONT TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_fleet 2023-06-05T14:16:47.0184903Z === CONT TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_namespace 2023-06-05T14:16:47.0185471Z === CONT TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_InitialNodeCount_in_Payload 2023-06-05T14:16:47.0185930Z --- PASS: TestInvalidConfigValidation (0.00s) 2023-06-05T14:16:47.0186420Z --- PASS: TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_project_id (0.00s) 2023-06-05T14:16:47.0187216Z --- PASS: TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Location_in_Payload (0.00s) 2023-06-05T14:16:47.0187811Z --- PASS: TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_MinMasterVersion_in_Payload (0.00s) 2023-06-05T14:16:47.0188416Z --- PASS: TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Name_in_Spec (0.00s) 2023-06-05T14:16:47.0188989Z --- PASS: TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Cluster_Name_in_Spec (0.00s) 2023-06-05T14:16:47.0189535Z --- PASS: TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_Banner_in_Payload (0.00s) 2023-06-05T14:16:47.0190096Z --- PASS: TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_fleet (0.00s) 2023-06-05T14:16:47.0190649Z --- PASS: TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_namespace (0.00s) 2023-06-05T14:16:47.0191280Z --- PASS: TestInvalidConfigValidation/AddContainerCluster_-_Simple_invalid_Config_-_Missing_InitialNodeCount_in_Payload (0.00s) 2023-06-05T14:16:47.0191610Z PASS 2023-06-05T14:16:47.0191807Z ================================================================================ 2023-06-05T14:16:47.2565630Z INFO: From Testing //pkg/tools/hack/cmd/owners:owners_test: 2023-06-05T14:16:47.2566296Z ==================== Test output for //pkg/tools/hack/cmd/owners:owners_test: 2023-06-05T14:16:47.2567223Z === RUN TestChangeTitle 2023-06-05T14:16:47.2567558Z / 2023-06-05T14:16:47.2567948Z ├─ . 2023-06-05T14:16:47.2568355Z ├─ owners_test_ 2023-06-05T14:16:47.2568961Z └─ testdata 2023-06-05T14:16:47.2569315Z ├─ dir2 2023-06-05T14:16:47.2569676Z └─ dir4 2023-06-05T14:16:47.2570078Z └─ subdir5 [🚫] 2023-06-05T14:16:47.2570561Z --- PASS: TestChangeTitle (0.00s) 2023-06-05T14:16:47.2570913Z PASS 2023-06-05T14:16:47.2571284Z ================================================================================ 2023-06-05T14:16:47.8314696Z INFO: From Testing //pkg/edge/logging/k8s/controllers/fluentbitctl:fluentbitctl_test: 2023-06-05T14:16:47.8323510Z ==================== Test output for //pkg/edge/logging/k8s/controllers/fluentbitctl:fluentbitctl_test: 2023-06-05T14:16:47.8324147Z === RUN TestController 2023-06-05T14:16:47.8324520Z === RUN TestController/sds 2023-06-05T14:16:47.8325419Z {"severity":"info","ts":1685974606.4328141,"message":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *v1.ConfigMap"} 2023-06-05T14:16:47.8325992Z {"severity":"info","ts":1685974606.43305,"message":"Starting Controller","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} 2023-06-05T14:16:47.8326650Z framework.go:146: created namespace monitoring 2023-06-05T14:16:47.8326936Z === RUN TestController/sds/TestFluentbitPatch 2023-06-05T14:16:47.8327478Z framework.go:146: created fluentbit config monitoring/fluent-bit-config 2023-06-05T14:16:47.8327882Z {"severity":"info","ts":1685974606.5336187,"message":"Starting workers","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","worker count":1} 2023-06-05T14:16:47.8328877Z {"severity":"info","ts":1685974606.5338054,"logger":"fluentbitctl","message":"fetching edge info config map","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"7f7600ba-6920-4a5b-aad4-1d02348fe5c9"} 2023-06-05T14:16:47.8330282Z {"severity":"info","ts":1685974606.5365865,"logger":"fluentbitctl","message":"patching fluentbit config map with output info","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"7f7600ba-6920-4a5b-aad4-1d02348fe5c9"} 2023-06-05T14:16:47.8331007Z === RUN TestController/sds/TestFluentbitRestart 2023-06-05T14:16:47.8332187Z framework.go:146: created fluentbit daemonset monitoring/fluent-bit 2023-06-05T14:16:47.8332541Z framework.go:146: fetching deployment to confirm it was changed 2023-06-05T14:16:47.8333482Z {"severity":"info","ts":1685974606.653818,"logger":"fluentbitctl","message":"fetching edge info config map","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"ed0ef6ef-d120-4da5-8608-fd35c02fb2e5"} 2023-06-05T14:16:47.8334745Z {"severity":"info","ts":1685974606.6562033,"logger":"fluentbitctl","message":"patching fluentbit config map with output info","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"ed0ef6ef-d120-4da5-8608-fd35c02fb2e5"} 2023-06-05T14:16:47.8340126Z {"severity":"error","ts":1685974606.6562417,"logger":"fluentbitctl","message":"failed to patch fluentbit config map with output information","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"ed0ef6ef-d120-4da5-8608-fd35c02fb2e5","error":"ConfigMap \"fluent-bit-config\" not found","stacktrace":"edge-infra.dev/pkg/edge/logging/k8s/controllers/fluentbitctl.(*FluentBitReconciler).Reconcile\n\tpkg/edge/logging/k8s/controllers/fluentbitctl/fluentbitctl.go:109\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:16:47.8344271Z {"severity":"error","ts":1685974606.6563075,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"ed0ef6ef-d120-4da5-8608-fd35c02fb2e5","error":"ConfigMap \"fluent-bit-config\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:16:47.8346183Z {"severity":"info","ts":1685974606.6613958,"logger":"fluentbitctl","message":"fetching edge info config map","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"fbe1ab60-c741-4a93-ae5b-325a13993a7e"} 2023-06-05T14:16:47.8347477Z {"severity":"info","ts":1685974606.6621115,"logger":"fluentbitctl","message":"patching fluentbit config map with output info","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"fbe1ab60-c741-4a93-ae5b-325a13993a7e"} 2023-06-05T14:16:47.8350776Z {"severity":"error","ts":1685974606.662154,"logger":"fluentbitctl","message":"failed to patch fluentbit config map with output information","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"fbe1ab60-c741-4a93-ae5b-325a13993a7e","error":"ConfigMap \"fluent-bit-config\" not found","stacktrace":"edge-infra.dev/pkg/edge/logging/k8s/controllers/fluentbitctl.(*FluentBitReconciler).Reconcile\n\tpkg/edge/logging/k8s/controllers/fluentbitctl/fluentbitctl.go:109\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:16:47.8354322Z {"severity":"error","ts":1685974606.662237,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"fbe1ab60-c741-4a93-ae5b-325a13993a7e","error":"ConfigMap \"fluent-bit-config\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:16:47.8355722Z === RUN TestController/sds/TestSDSFluentbitConfig 2023-06-05T14:16:47.8356927Z {"severity":"info","ts":1685974606.672839,"logger":"fluentbitctl","message":"fetching edge info config map","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"a06957ad-f885-401b-8419-b6c7580db539"} 2023-06-05T14:16:47.8358112Z {"severity":"info","ts":1685974606.6730473,"logger":"fluentbitctl","message":"patching fluentbit config map with output info","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"a06957ad-f885-401b-8419-b6c7580db539"} 2023-06-05T14:16:47.8360971Z {"severity":"error","ts":1685974606.6730645,"logger":"fluentbitctl","message":"failed to patch fluentbit config map with output information","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"a06957ad-f885-401b-8419-b6c7580db539","error":"ConfigMap \"fluent-bit-config\" not found","stacktrace":"edge-infra.dev/pkg/edge/logging/k8s/controllers/fluentbitctl.(*FluentBitReconciler).Reconcile\n\tpkg/edge/logging/k8s/controllers/fluentbitctl/fluentbitctl.go:109\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:16:47.8365837Z {"severity":"error","ts":1685974606.6731157,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"a06957ad-f885-401b-8419-b6c7580db539","error":"ConfigMap \"fluent-bit-config\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:16:47.8368017Z framework.go:146: created sds terminal output config monitoring/fluentbit-stackdriver-output-terminal 2023-06-05T14:16:47.8369247Z {"severity":"info","ts":1685974606.693458,"logger":"fluentbitctl","message":"fetching edge info config map","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"7d69d049-780b-47fc-86c0-8a1f2d1e5984"} 2023-06-05T14:16:47.8370552Z {"severity":"info","ts":1685974606.696455,"logger":"fluentbitctl","message":"patching fluentbit config map with output info","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"7d69d049-780b-47fc-86c0-8a1f2d1e5984"} 2023-06-05T14:16:47.8373789Z {"severity":"error","ts":1685974606.6964846,"logger":"fluentbitctl","message":"failed to patch fluentbit config map with output information","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"7d69d049-780b-47fc-86c0-8a1f2d1e5984","error":"ConfigMap \"fluent-bit-config\" not found","stacktrace":"edge-infra.dev/pkg/edge/logging/k8s/controllers/fluentbitctl.(*FluentBitReconciler).Reconcile\n\tpkg/edge/logging/k8s/controllers/fluentbitctl/fluentbitctl.go:109\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:16:47.8377160Z {"severity":"error","ts":1685974606.6965337,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"fluent-bit-config","namespace":"monitoring"},"namespace":"monitoring","name":"fluent-bit-config","reconcileID":"7d69d049-780b-47fc-86c0-8a1f2d1e5984","error":"ConfigMap \"fluent-bit-config\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:16:47.8378408Z {"severity":"info","ts":1685974606.7076845,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:16:47.8378785Z {"severity":"info","ts":1685974606.707739,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:16:47.8379256Z {"severity":"info","ts":1685974606.7077556,"message":"Shutdown signal received, waiting for all workers to finish","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} 2023-06-05T14:16:47.8379758Z {"severity":"info","ts":1685974606.7077749,"message":"All workers finished","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} 2023-06-05T14:16:47.8380153Z {"severity":"info","ts":1685974606.7077806,"message":"Stopping and waiting for caches"} 2023-06-05T14:16:47.8380460Z {"severity":"info","ts":1685974606.7078826,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:16:47.8380814Z {"severity":"info","ts":1685974606.7079115,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:16:47.8381168Z --- PASS: TestController (7.84s) 2023-06-05T14:16:47.8381466Z --- PASS: TestController/sds (0.30s) 2023-06-05T14:16:47.8381973Z --- PASS: TestController/sds/TestFluentbitPatch (0.10s) 2023-06-05T14:16:47.8382348Z --- PASS: TestController/sds/TestFluentbitRestart (0.12s) 2023-06-05T14:16:47.8382878Z --- PASS: TestController/sds/TestSDSFluentbitConfig (0.04s) 2023-06-05T14:16:47.8383126Z PASS 2023-06-05T14:16:47.8383338Z ================================================================================ 2023-06-05T14:16:53.8767428Z INFO: From Testing //pkg/edge/datasync/chirp/provider:provider_test: 2023-06-05T14:16:53.8768127Z ==================== Test output for //pkg/edge/datasync/chirp/provider:provider_test: 2023-06-05T14:16:53.8768539Z === RUN TestNewFileSystemProvider 2023-06-05T14:16:53.8769062Z --- PASS: TestNewFileSystemProvider (0.00s) 2023-06-05T14:16:53.8769432Z === RUN TestGetMessages 2023-06-05T14:16:53.8769835Z === RUN TestGetMessages/return_nil,_when_there_are_no_messages_in_partition 2023-06-05T14:16:53.8770400Z === RUN TestGetMessages/return_2_messages,_when_there_are_2_messages_in_partition 2023-06-05T14:16:53.8770914Z {"severity":"info","ts":1685974613.8088965,"message":"creating outboxes","outboxes":["tlog","public"]} 2023-06-05T14:16:53.8771583Z {"severity":"info","ts":1685974613.8094869,"message":"created outboxes successfully"} 2023-06-05T14:16:53.8772069Z {"severity":"info","ts":1685974613.8112354,"message":"successfully created message files"} 2023-06-05T14:16:53.8772579Z {"severity":"info","ts":1685974613.812501,"message":"successfully created message files"} 2023-06-05T14:16:53.8773107Z --- PASS: TestGetMessages (0.02s) 2023-06-05T14:16:53.8773679Z --- PASS: TestGetMessages/return_nil,_when_there_are_no_messages_in_partition (0.00s) 2023-06-05T14:16:53.8774362Z --- PASS: TestGetMessages/return_2_messages,_when_there_are_2_messages_in_partition (0.02s) 2023-06-05T14:16:53.8774748Z PASS 2023-06-05T14:16:53.8775028Z ================================================================================ 2023-06-05T14:16:54.2527711Z INFO: From Testing //pkg/edge/datasync/internal/signature:signature_test: 2023-06-05T14:16:54.2593281Z ==================== Test output for //pkg/edge/datasync/internal/signature:signature_test: 2023-06-05T14:16:54.2593747Z === RUN TestSignature 2023-06-05T14:16:54.2594730Z {"severity":"info","ts":1685974614.1454947,"message":"retrieved bsl-info config map values","cfg":{"OrganizationID":"0123456789","OrganizationName":"test-org","SiteID":"id-1","SiteName":"test-site-1"}} 2023-06-05T14:16:54.2595256Z === RUN TestSignature/error_when_missing_ENV_vars 2023-06-05T14:16:54.2595678Z === RUN TestSignature/success_to_sign_compressed_message 2023-06-05T14:16:54.2596174Z === RUN TestSignature/success_to_sign_non-compressed_message 2023-06-05T14:16:54.2596587Z --- PASS: TestSignature (0.00s) 2023-06-05T14:16:54.2597033Z --- PASS: TestSignature/error_when_missing_ENV_vars (0.00s) 2023-06-05T14:16:54.2597572Z --- PASS: TestSignature/success_to_sign_compressed_message (0.00s) 2023-06-05T14:16:54.2598140Z --- PASS: TestSignature/success_to_sign_non-compressed_message (0.00s) 2023-06-05T14:16:54.2598458Z PASS 2023-06-05T14:16:54.2598738Z ================================================================================ 2023-06-05T14:16:55.6340655Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/grubstringupdater:grubstringupdater_test: 2023-06-05T14:16:55.6341425Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/grubstringupdater:grubstringupdater_test: 2023-06-05T14:16:55.6341937Z === RUN TestDoNotReconcileWrongSecret 2023-06-05T14:16:55.6342527Z --- PASS: TestDoNotReconcileWrongSecret (0.00s) 2023-06-05T14:16:55.6342957Z === RUN TestDoNotReconcileWithoutHostIEN 2023-06-05T14:16:55.6343507Z --- PASS: TestDoNotReconcileWithoutHostIEN (0.00s) 2023-06-05T14:16:55.6343952Z === RUN TestUpdateGrubConfigFromGrub2Secret 2023-06-05T14:16:55.6344525Z --- PASS: TestUpdateGrubConfigFromGrub2Secret (0.00s) 2023-06-05T14:16:55.6345063Z === RUN TestInvalidGrub2SecretReturnsError 2023-06-05T14:16:55.6346096Z --- PASS: TestInvalidGrub2SecretReturnsError (0.00s) 2023-06-05T14:16:55.6346541Z === RUN TestUpdateGrubConfigFile 2023-06-05T14:16:55.6347502Z --- PASS: TestUpdateGrubConfigFile (0.00s) 2023-06-05T14:16:55.6347882Z === RUN TestGrubConfigPathEfi 2023-06-05T14:16:55.6348240Z grubstringupdater_test.go:227: PASS: Exists(string) 2023-06-05T14:16:55.6348700Z grubstringupdater_test.go:227: PASS: Read(string) 2023-06-05T14:16:55.6349259Z grubstringupdater_test.go:227: PASS: WriteWithFsReadWrite(string,string,[]uint8,fs.FileMode) 2023-06-05T14:16:55.6349867Z --- PASS: TestGrubConfigPathEfi (0.00s) 2023-06-05T14:16:55.6350259Z === RUN TestGrubConfigPathNotFound 2023-06-05T14:16:55.6350703Z grubstringupdater_test.go:243: PASS: Exists(string) 2023-06-05T14:16:55.6351162Z grubstringupdater_test.go:243: PASS: Exists(string) 2023-06-05T14:16:55.6351695Z --- PASS: TestGrubConfigPathNotFound (0.00s) 2023-06-05T14:16:55.6352173Z === RUN TestFailingToReadGrubConfigFileReturnsError 2023-06-05T14:16:55.6352827Z --- PASS: TestFailingToReadGrubConfigFileReturnsError (0.00s) 2023-06-05T14:16:55.6353353Z === RUN TestUpdateGrubConfigData 2023-06-05T14:16:55.6353825Z --- PASS: TestUpdateGrubConfigData (0.00s) 2023-06-05T14:16:55.6354230Z === RUN TestIsGrubUserConfigLine 2023-06-05T14:16:55.6354698Z --- PASS: TestIsGrubUserConfigLine (0.00s) 2023-06-05T14:16:55.6355153Z === RUN TestIsMenuEntryLine 2023-06-05T14:16:55.6355571Z --- PASS: TestIsMenuEntryLine (0.00s) 2023-06-05T14:16:55.6355908Z === RUN TestGetGrubUserLines 2023-06-05T14:16:55.6356395Z --- PASS: TestGetGrubUserLines (0.00s) 2023-06-05T14:16:55.6356715Z PASS 2023-06-05T14:16:55.6357037Z ================================================================================ 2023-06-05T14:16:56.6805504Z INFO: From Testing //pkg/f8n/warehouse/oci/cache/providers/memory:memory_test: 2023-06-05T14:16:56.6806228Z ==================== Test output for //pkg/f8n/warehouse/oci/cache/providers/memory:memory_test: 2023-06-05T14:16:56.6806651Z === RUN TestNew 2023-06-05T14:16:56.6807056Z --- PASS: TestNew (0.00s) 2023-06-05T14:16:56.6807440Z === RUN TestCache 2023-06-05T14:16:56.6807869Z === PAUSE TestCache 2023-06-05T14:16:56.6808166Z === CONT TestCache 2023-06-05T14:16:56.6808514Z === RUN TestCache/Add 2023-06-05T14:16:56.6808810Z === RUN TestCache/Get 2023-06-05T14:16:56.6809141Z === RUN TestCache/Exists 2023-06-05T14:16:56.6809608Z --- PASS: TestCache (0.00s) 2023-06-05T14:16:56.6810055Z --- PASS: TestCache/Add (0.00s) 2023-06-05T14:16:56.6810541Z --- PASS: TestCache/Get (0.00s) 2023-06-05T14:16:56.6811052Z --- PASS: TestCache/Exists (0.00s) 2023-06-05T14:16:56.6811593Z PASS 2023-06-05T14:16:56.6811958Z ================================================================================ 2023-06-05T14:16:57.4482140Z INFO: From Testing //pkg/lib/gcp/secretmanager:secretmanager_test: 2023-06-05T14:16:57.4482849Z ==================== Test output for //pkg/lib/gcp/secretmanager:secretmanager_test: 2023-06-05T14:16:57.4483473Z === RUN TestSecretManagerClientIntegration 2023-06-05T14:16:57.4484086Z framework.go:161: [integration] skipping: this test can only be ran as an integration test 2023-06-05T14:16:57.4484869Z --- SKIP: TestSecretManagerClientIntegration (0.00s) 2023-06-05T14:16:57.4485390Z PASS 2023-06-05T14:16:57.4485763Z ================================================================================ 2023-06-05T14:16:57.6498994Z INFO: From Testing //pkg/edge/api/middleware:middleware_test: 2023-06-05T14:16:57.6499668Z ==================== Test output for //pkg/edge/api/middleware:middleware_test: 2023-06-05T14:16:57.6500205Z === RUN TestAuthMiddlewareTotpToken 2023-06-05T14:16:57.6500904Z [GIN] 2023/06/05 - 14:16:57 | 200 | 165.662µs | 127.0.0.1 | GET "/" 2023-06-05T14:16:57.6501616Z [GIN] 2023/06/05 - 14:16:57 | 200 | 153.747µs | 127.0.0.1 | GET "/" 2023-06-05T14:16:57.6502207Z --- PASS: TestAuthMiddlewareTotpToken (0.00s) 2023-06-05T14:16:57.6503123Z === RUN TestGetEdgeRole 2023-06-05T14:16:57.6503641Z --- PASS: TestGetEdgeRole (0.00s) 2023-06-05T14:16:57.6504273Z === RUN TestUseMetrics 2023-06-05T14:16:57.6504739Z --- PASS: TestUseMetrics (0.00s) 2023-06-05T14:16:57.6505190Z === RUN TestHandleGraphQlMetrics 2023-06-05T14:16:57.6505903Z [GIN] 2023/06/05 - 14:16:57 | 200 | 144.95µs | 127.0.0.1 | POST "/graphql" 2023-06-05T14:16:57.6506545Z [GIN] 2023/06/05 - 14:16:57 | 200 | 2.533191ms | 127.0.0.1 | GET "/metrics" 2023-06-05T14:16:57.6507103Z --- PASS: TestHandleGraphQlMetrics (0.00s) 2023-06-05T14:16:57.6507595Z === RUN TestCheckVersionNotMatch 2023-06-05T14:16:57.6508220Z [GIN] 2023/06/05 - 14:16:57 | 200 | 40.411µs | 127.0.0.1 | GET "/" 2023-06-05T14:16:57.6508793Z --- PASS: TestCheckVersionNotMatch (0.00s) 2023-06-05T14:16:57.6509261Z === RUN TestCheckVersionMatch 2023-06-05T14:16:57.6509852Z [GIN] 2023/06/05 - 14:16:57 | 200 | 30.32µs | 127.0.0.1 | GET "/" 2023-06-05T14:16:57.6510414Z --- PASS: TestCheckVersionMatch (0.00s) 2023-06-05T14:16:57.6510810Z PASS 2023-06-05T14:16:57.6511243Z ================================================================================ 2023-06-05T14:16:58.5665979Z INFO: From Testing //pkg/sds/k8s/controllers/coredns/pkg:pkg_test: 2023-06-05T14:16:58.5666933Z ==================== Test output for //pkg/sds/k8s/controllers/coredns/pkg:pkg_test: 2023-06-05T14:16:58.5667715Z === RUN TestDeploymentCreatedSuccessfully 2023-06-05T14:16:58.5668653Z --- PASS: TestDeploymentCreatedSuccessfully (0.01s) 2023-06-05T14:16:58.5669023Z === RUN TestDaemonSetCreatedSuccessfully 2023-06-05T14:16:58.5669368Z --- PASS: TestDaemonSetCreatedSuccessfully (0.02s) 2023-06-05T14:16:58.5669687Z === RUN TestDeploymentDeletedSuccessfully 2023-06-05T14:16:58.5670050Z --- PASS: TestDeploymentDeletedSuccessfully (0.00s) 2023-06-05T14:16:58.5670473Z === RUN TestDaemonSetDeletedSuccessfully 2023-06-05T14:16:58.5670818Z --- PASS: TestDaemonSetDeletedSuccessfully (0.00s) 2023-06-05T14:16:58.5671265Z === RUN TestInternalTrafficPolicySetToLocal 2023-06-05T14:16:58.5671643Z --- PASS: TestInternalTrafficPolicySetToLocal (0.00s) 2023-06-05T14:16:58.5672131Z === RUN TestInternalTrafficPolicySetToCluster 2023-06-05T14:16:58.5672521Z --- PASS: TestInternalTrafficPolicySetToCluster (0.00s) 2023-06-05T14:16:58.5672957Z === RUN TestTrafficPolicyPatchWorks 2023-06-05T14:16:58.5673506Z --- PASS: TestTrafficPolicyPatchWorks (0.00s) 2023-06-05T14:16:58.5673941Z === RUN TestDeploymentAffinity 2023-06-05T14:16:58.5674241Z --- PASS: TestDeploymentAffinity (0.00s) 2023-06-05T14:16:58.5674501Z === RUN TestDaemonSetAffinity 2023-06-05T14:16:58.5675146Z --- PASS: TestDaemonSetAffinity (0.00s) 2023-06-05T14:16:58.5675539Z === RUN TestDefaultBehaviourWithNoConfigMapCreatesDeployment 2023-06-05T14:16:58.5676058Z --- PASS: TestDefaultBehaviourWithNoConfigMapCreatesDeployment (0.00s) 2023-06-05T14:16:58.5676522Z === RUN TestDefaultInternalTrafficPolicyWithNoConfigMap 2023-06-05T14:16:58.5676993Z --- PASS: TestDefaultInternalTrafficPolicyWithNoConfigMap (0.00s) 2023-06-05T14:16:58.5677405Z PASS 2023-06-05T14:16:58.5677733Z ================================================================================ 2023-06-05T14:16:58.6838591Z INFO: From Testing //pkg/lib/fog:fog_test: 2023-06-05T14:16:58.6839092Z ==================== Test output for //pkg/lib/fog:fog_test: 2023-06-05T14:16:58.6839498Z === RUN TestWithLabels 2023-06-05T14:16:58.6840901Z {"severity":"dpanic","time":"2023-06-05T14:16:58Z","message":"odd number of arguments passed as key-value pairs for logging labels","ignored":["testBadPair"],"logging.googleapis.com/sourceLocation":{"function":"github.com/stretchr/testify/assert.Panics","file":"external/com_github_stretchr_testify/assert/assertions.go","line":1069}} 2023-06-05T14:16:58.6842085Z --- PASS: TestWithLabels (0.00s) 2023-06-05T14:16:58.6842430Z === RUN TestInfo 2023-06-05T14:16:58.6842819Z --- PASS: TestInfo (0.00s) 2023-06-05T14:16:58.6843109Z PASS 2023-06-05T14:16:58.6843887Z ================================================================================ 2023-06-05T14:16:58.9057403Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/triage_issue:triage_issue_test: 2023-06-05T14:16:58.9058084Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/triage_issue:triage_issue_test: 2023-06-05T14:16:58.9058625Z === RUN TestOnCreation 2023-06-05T14:16:58.9059273Z {"severity":"info","ts":1685974618.6455984,"message":"adding needs-issue label"} 2023-06-05T14:16:58.9060594Z adding&{Labels:[] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[triage/needs-issue]{"severity":"info","ts":1685974618.8121023,"message":"removing needs issue label"} 2023-06-05T14:16:58.9061714Z removinglabels: [triage/needs-issue]remaining labels: []--- PASS: TestOnCreation (0.17s) 2023-06-05T14:16:58.9062156Z === RUN TestEditBody 2023-06-05T14:16:58.9062837Z {"severity":"info","ts":1685974618.8123226,"message":"adding needs-issue label"} 2023-06-05T14:16:58.9063893Z adding&{Labels:[] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[triage/needs-issue]{"severity":"info","ts":1685974618.8490343,"message":"removing needs-issue label"} 2023-06-05T14:16:58.9065023Z removinglabels: [triage/needs-issue]remaining labels: []{"severity":"info","ts":1685974618.8491921,"message":"adding needs-issue label"} 2023-06-05T14:16:58.9066083Z adding&{Labels:[] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[triage/needs-issue]--- PASS: TestEditBody (0.04s) 2023-06-05T14:16:58.9066706Z === RUN TestPRComments 2023-06-05T14:16:58.9067497Z editing{"severity":"info","ts":1685974618.8674788,"message":"attempting to remove triage/needs-issue"} 2023-06-05T14:16:58.9068421Z removinglabels: [triage/needs-issue]remaining labels: []editing{"severity":"info","ts":1685974618.8676398,"message":"attempting to add triage/needs-issue"} 2023-06-05T14:16:58.9069144Z adding&{Labels:[] Assignees:[] Body:## Purpose 2023-06-05T14:16:58.9069726Z 2023-06-05T14:16:58.9070117Z 2023-06-05T14:16:58.9070208Z ## Approach 2023-06-05T14:16:58.9070659Z 2023-06-05T14:16:58.9070889Z 2023-06-05T14:16:58.9071343Z 2023-06-05T14:16:58.9075115Z ==COMMIT_MSG== 2023-06-05T14:16:58.9075343Z 2023-06-05T14:16:58.9075354Z 2023-06-05T14:16:58.9075364Z 2023-06-05T14:16:58.9075529Z ==COMMIT_MSG== 2023-06-05T14:16:58.9075755Z 2023-06-05T14:16:58.9075897Z ## Issue 2023-06-05T14:16:58.9076585Z 2023-06-05T14:16:58.9080290Z 2023-06-05T14:16:58.9081001Z ncr-swt-retail/edge-roadmap#ISSUE_NUMBER_HERE Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[triage/needs-issue]--- PASS: TestPRComments (0.02s) 2023-06-05T14:16:58.9082157Z === RUN TestManualAddRemove 2023-06-05T14:16:58.9082616Z {"severity":"info","ts":1685974618.8681602,"message":"add triage/needs_issue"} 2023-06-05T14:16:58.9083560Z {"severity":"info","ts":1685974618.868204,"message":"adding needs-issue label"} 2023-06-05T14:16:58.9084572Z adding&{Labels:[] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[triage/needs-issue]{"severity":"info","ts":1685974618.8682299,"message":"add triage/needs_issue"} 2023-06-05T14:16:58.9085450Z {"severity":"info","ts":1685974618.868251,"message":"Link exists. Removing label again."} 2023-06-05T14:16:58.9085881Z {"severity":"info","ts":1685974618.8682532,"message":"remove triage/needs_issue"} 2023-06-05T14:16:58.9086624Z {"severity":"info","ts":1685974618.887526,"message":"removing needs-issue label"} 2023-06-05T14:16:58.9087602Z removinglabels: [triage/needs-issue]remaining labels: []{"severity":"info","ts":1685974618.887591,"message":"remove triage/needs_issue"} 2023-06-05T14:16:58.9088321Z {"severity":"info","ts":1685974618.8876607,"message":"Link does not exist. Adding label back"} 2023-06-05T14:16:58.9088922Z {"severity":"info","ts":1685974618.887665,"message":"add triage/needs_issue"} 2023-06-05T14:16:58.9089843Z {"severity":"info","ts":1685974618.8876967,"message":"adding needs-issue label"} 2023-06-05T14:16:58.9090959Z adding&{Labels:[] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[triage/needs-issue]--- PASS: TestManualAddRemove (0.02s) 2023-06-05T14:16:58.9092095Z PASS 2023-06-05T14:16:58.9092515Z ================================================================================ 2023-06-05T14:16:59.1019501Z INFO: From Testing //pkg/edge/gitops/chariot/client:client_test: 2023-06-05T14:16:59.1020176Z ==================== Test output for //pkg/edge/gitops/chariot/client:client_test: 2023-06-05T14:16:59.1020634Z === RUN TestInvokeKptFunction 2023-06-05T14:16:59.1021202Z --- PASS: TestInvokeKptFunction (0.00s) 2023-06-05T14:16:59.1021716Z === RUN TestInvokeKptFunctionEmptyResponse 2023-06-05T14:16:59.1022479Z --- PASS: TestInvokeKptFunctionEmptyResponse (0.00s) 2023-06-05T14:16:59.1023064Z === RUN TestInvokeKptFunctionBadResponse 2023-06-05T14:16:59.1023679Z --- PASS: TestInvokeKptFunctionBadResponse (0.00s) 2023-06-05T14:16:59.1024204Z === RUN TestNewClientOptionalConfig 2023-06-05T14:16:59.1024796Z --- PASS: TestNewClientOptionalConfig (0.00s) 2023-06-05T14:16:59.1025250Z === RUN TestBindFlags 2023-06-05T14:16:59.1025757Z --- PASS: TestBindFlags (0.00s) 2023-06-05T14:16:59.1026173Z === RUN TestNewChariotMessage 2023-06-05T14:16:59.1026698Z --- PASS: TestNewChariotMessage (0.00s) 2023-06-05T14:16:59.1027115Z === RUN TestSetBanner 2023-06-05T14:16:59.1027547Z --- PASS: TestSetBanner (0.00s) 2023-06-05T14:16:59.1027953Z === RUN TestSetCluster 2023-06-05T14:16:59.1028430Z --- PASS: TestSetCluster (0.00s) 2023-06-05T14:16:59.1028831Z === RUN TestSetOperation 2023-06-05T14:16:59.1029273Z --- PASS: TestSetOperation (0.00s) 2023-06-05T14:16:59.1029659Z === RUN TestSetOwner 2023-06-05T14:16:59.1030110Z --- PASS: TestSetOwner (0.00s) 2023-06-05T14:16:59.1030494Z === RUN TestSetObjects 2023-06-05T14:16:59.1030954Z --- PASS: TestSetObjects (0.00s) 2023-06-05T14:16:59.1031351Z === RUN TestAddObject 2023-06-05T14:16:59.1031803Z --- PASS: TestAddObject (0.00s) 2023-06-05T14:16:59.1032189Z === RUN TestSetDir 2023-06-05T14:16:59.1032596Z --- PASS: TestSetDir (0.00s) 2023-06-05T14:16:59.1032971Z === RUN TestSetEmptyDir 2023-06-05T14:16:59.1033461Z --- PASS: TestSetEmptyDir (0.00s) 2023-06-05T14:16:59.1033855Z === RUN TestToByte 2023-06-05T14:16:59.1034251Z --- PASS: TestToByte (0.00s) 2023-06-05T14:16:59.1034594Z PASS 2023-06-05T14:16:59.1034953Z ================================================================================ 2023-06-05T14:16:59.2935899Z INFO: From Testing //pkg/k8s/runtime/conditions:conditions_test: 2023-06-05T14:16:59.2936506Z ==================== Test output for //pkg/k8s/runtime/conditions:conditions_test: 2023-06-05T14:16:59.2937418Z === RUN TestGetAndHas 2023-06-05T14:16:59.2937945Z --- PASS: TestGetAndHas (0.00s) 2023-06-05T14:16:59.2938295Z === RUN TestIsMethods 2023-06-05T14:16:59.2938980Z --- PASS: TestIsMethods (0.00s) 2023-06-05T14:16:59.2939435Z === RUN TestIsReadyStalledReconciling 2023-06-05T14:16:59.2940051Z --- PASS: TestIsReadyStalledReconciling (0.00s) 2023-06-05T14:16:59.2940589Z === RUN TestMirror 2023-06-05T14:16:59.2941052Z === RUN TestMirror/Returns_nil_when_the_ready_condition_does_not_exists 2023-06-05T14:16:59.2941595Z === RUN TestMirror/Returns_ready_condition_from_source 2023-06-05T14:16:59.2942109Z --- PASS: TestMirror (0.00s) 2023-06-05T14:16:59.2942753Z --- PASS: TestMirror/Returns_nil_when_the_ready_condition_does_not_exists (0.00s) 2023-06-05T14:16:59.2943483Z --- PASS: TestMirror/Returns_ready_condition_from_source (0.00s) 2023-06-05T14:16:59.2943931Z === RUN TestSummary 2023-06-05T14:16:59.2944400Z === RUN TestSummary/Returns_nil_when_there_are_no_conditions_to_summarize 2023-06-05T14:16:59.2945110Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(with_default_options) 2023-06-05T14:16:59.2945821Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(using_WithStepCounter_options) 2023-06-05T14:16:59.2946624Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(using_WithStepCounterIf_options) 2023-06-05T14:16:59.2947609Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(using_WithStepCounterIf_options)#01 2023-06-05T14:16:59.2948504Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(using_WithStepCounterIf_and_WithStepCounterIfOnly_options) 2023-06-05T14:16:59.2949392Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(using_WithStepCounterIf_and_WithStepCounterIfOnly_options)#01 2023-06-05T14:16:59.2950333Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_selected_conditions_(using_WithConditions_options) 2023-06-05T14:16:59.2951114Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_selected_conditions_(using_WithConditions_and_WithStepCounter_options) 2023-06-05T14:16:59.2951971Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_selected_conditions_(using_WithConditions_and_WithStepCounterIfOnly_options) 2023-06-05T14:16:59.2953258Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_selected_conditions_(using_WithConditions_and_WithStepCounterIfOnly_options_-_with_inconsistent_order_between_the_two) 2023-06-05T14:16:59.2954265Z === RUN TestSummary/Returns_ready_condition_with_the_summary_of_selected_conditions_(using_WithConditions_and_WithStepCounterIfOnly_options)#01 2023-06-05T14:16:59.2954984Z === RUN TestSummary/Ready_condition_respects_merge_order 2023-06-05T14:16:59.2955559Z === RUN TestSummary/Ignores_existing_Ready_condition_when_computing_the_summary 2023-06-05T14:16:59.2956143Z --- PASS: TestSummary (0.00s) 2023-06-05T14:16:59.2956845Z --- PASS: TestSummary/Returns_nil_when_there_are_no_conditions_to_summarize (0.00s) 2023-06-05T14:16:59.2957752Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(with_default_options) (0.00s) 2023-06-05T14:16:59.2958757Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(using_WithStepCounter_options) (0.00s) 2023-06-05T14:16:59.2959883Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(using_WithStepCounterIf_options) (0.00s) 2023-06-05T14:16:59.2960994Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(using_WithStepCounterIf_options)#01 (0.00s) 2023-06-05T14:16:59.2962163Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(using_WithStepCounterIf_and_WithStepCounterIfOnly_options) (0.00s) 2023-06-05T14:16:59.2963701Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_existing_conditions_(using_WithStepCounterIf_and_WithStepCounterIfOnly_options)#01 (0.00s) 2023-06-05T14:16:59.2964907Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_selected_conditions_(using_WithConditions_options) (0.00s) 2023-06-05T14:16:59.2965993Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_selected_conditions_(using_WithConditions_and_WithStepCounter_options) (0.00s) 2023-06-05T14:16:59.2967175Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_selected_conditions_(using_WithConditions_and_WithStepCounterIfOnly_options) (0.00s) 2023-06-05T14:16:59.2968424Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_selected_conditions_(using_WithConditions_and_WithStepCounterIfOnly_options_-_with_inconsistent_order_between_the_two) (0.00s) 2023-06-05T14:16:59.2969635Z --- PASS: TestSummary/Returns_ready_condition_with_the_summary_of_selected_conditions_(using_WithConditions_and_WithStepCounterIfOnly_options)#01 (0.00s) 2023-06-05T14:16:59.2970772Z --- PASS: TestSummary/Ready_condition_respects_merge_order (0.00s) 2023-06-05T14:16:59.2971751Z --- PASS: TestSummary/Ignores_existing_Ready_condition_when_computing_the_summary (0.00s) 2023-06-05T14:16:59.2972296Z === RUN TestAggregate 2023-06-05T14:16:59.2972776Z === RUN TestAggregate/Returns_nil_when_there_are_no_conditions_to_aggregate 2023-06-05T14:16:59.2973636Z === RUN TestAggregate/Returns_foo_condition_with_an_aggregation_of_the_object's_top_group_conditions 2023-06-05T14:16:59.2974513Z === RUN TestAggregate/Returns_foo_condition_with_the_aggregation_of_object's_subset_conditions 2023-06-05T14:16:59.2975365Z === RUN TestAggregate/Returns_foo_condition_with_the_aggregation_of_object's_subset_priority_conditions 2023-06-05T14:16:59.2976271Z === RUN TestAggregate/Returns_foo_condition_with_the_aggregation_of_object's_subset_priority_conditions_(inverse) 2023-06-05T14:16:59.2976910Z === RUN TestAggregate/Returns_foo_condition_with_source_ref 2023-06-05T14:16:59.2977425Z --- PASS: TestAggregate (0.00s) 2023-06-05T14:16:59.2978066Z --- PASS: TestAggregate/Returns_nil_when_there_are_no_conditions_to_aggregate (0.00s) 2023-06-05T14:16:59.2978986Z --- PASS: TestAggregate/Returns_foo_condition_with_an_aggregation_of_the_object's_top_group_conditions (0.00s) 2023-06-05T14:16:59.2979896Z --- PASS: TestAggregate/Returns_foo_condition_with_the_aggregation_of_object's_subset_conditions (0.00s) 2023-06-05T14:16:59.2980914Z --- PASS: TestAggregate/Returns_foo_condition_with_the_aggregation_of_object's_subset_priority_conditions (0.00s) 2023-06-05T14:16:59.2981920Z --- PASS: TestAggregate/Returns_foo_condition_with_the_aggregation_of_object's_subset_priority_conditions_(inverse) (0.00s) 2023-06-05T14:16:59.2982745Z --- PASS: TestAggregate/Returns_foo_condition_with_source_ref (0.00s) 2023-06-05T14:16:59.2983230Z === RUN TestMatchConditions 2023-06-05T14:16:59.2983700Z === RUN TestMatchConditions/with_an_empty_conditions 2023-06-05T14:16:59.2984224Z === RUN TestMatchConditions/with_matching_conditions 2023-06-05T14:16:59.2984950Z === RUN TestMatchConditions/with_non-matching_conditions 2023-06-05T14:16:59.2985537Z === RUN TestMatchConditions/with_a_different_number_of_conditions 2023-06-05T14:16:59.2986121Z --- PASS: TestMatchConditions (0.00s) 2023-06-05T14:16:59.2986761Z --- PASS: TestMatchConditions/with_an_empty_conditions (0.00s) 2023-06-05T14:16:59.2987489Z --- PASS: TestMatchConditions/with_matching_conditions (0.00s) 2023-06-05T14:16:59.2988231Z --- PASS: TestMatchConditions/with_non-matching_conditions (0.00s) 2023-06-05T14:16:59.2988969Z --- PASS: TestMatchConditions/with_a_different_number_of_conditions (0.00s) 2023-06-05T14:16:59.2989490Z === RUN TestMatchCondition 2023-06-05T14:16:59.2989949Z === RUN TestMatchCondition/with_an_empty_condition 2023-06-05T14:16:59.2990504Z === RUN TestMatchCondition/with_a_matching_condition 2023-06-05T14:16:59.2991009Z === RUN TestMatchCondition/with_a_different_time 2023-06-05T14:16:59.2991800Z === RUN TestMatchCondition/with_a_different_type 2023-06-05T14:16:59.2992309Z === RUN TestMatchCondition/with_a_different_status 2023-06-05T14:16:59.2992939Z === RUN TestMatchCondition/with_a_different_reason 2023-06-05T14:16:59.2993436Z === RUN TestMatchCondition/with_a_different_message 2023-06-05T14:16:59.2993932Z === RUN TestMatchCondition/with_a_subset_message 2023-06-05T14:16:59.2994531Z --- PASS: TestMatchCondition (0.00s) 2023-06-05T14:16:59.2995161Z --- PASS: TestMatchCondition/with_an_empty_condition (0.00s) 2023-06-05T14:16:59.2995805Z --- PASS: TestMatchCondition/with_a_matching_condition (0.00s) 2023-06-05T14:16:59.2996465Z --- PASS: TestMatchCondition/with_a_different_time (0.00s) 2023-06-05T14:16:59.2997133Z --- PASS: TestMatchCondition/with_a_different_type (0.00s) 2023-06-05T14:16:59.2997780Z --- PASS: TestMatchCondition/with_a_different_status (0.00s) 2023-06-05T14:16:59.2998470Z --- PASS: TestMatchCondition/with_a_different_reason (0.00s) 2023-06-05T14:16:59.2999169Z --- PASS: TestMatchCondition/with_a_different_message (0.00s) 2023-06-05T14:16:59.2999819Z --- PASS: TestMatchCondition/with_a_subset_message (0.00s) 2023-06-05T14:16:59.3000365Z === RUN TestNewConditionsGroup 2023-06-05T14:16:59.3000902Z --- PASS: TestNewConditionsGroup (0.00s) 2023-06-05T14:16:59.3001384Z === RUN TestMergeRespectPriority 2023-06-05T14:16:59.3001894Z === RUN TestMergeRespectPriority/aggregate_nil_list_return_nil 2023-06-05T14:16:59.3002487Z === RUN TestMergeRespectPriority/aggregate_empty_list_return_nil 2023-06-05T14:16:59.3003142Z === RUN TestMergeRespectPriority/When_there_is_True/Negative_it_returns_an_inverted_False/Positive 2023-06-05T14:16:59.3003896Z === RUN TestMergeRespectPriority/When_there_is_False/Positive_and_no_True/Negative,_it_returns_False/Positive 2023-06-05T14:16:59.3004711Z === RUN TestMergeRespectPriority/When_there_is_True/Positive_and_no_True/Negative_or_False/Positive,_it_returns_True/Positive 2023-06-05T14:16:59.3005512Z === RUN TestMergeRespectPriority/When_there_is_True/Positive_and_no_False/Positive,_it_returns_True/Positive 2023-06-05T14:16:59.3006306Z === RUN TestMergeRespectPriority/When_there_is_False/Negative_and_no_True/*_or_False/Positive,_it_returns_False/Negative 2023-06-05T14:16:59.3007000Z === RUN TestMergeRespectPriority/When_there_is_Unknown/*_but_no_False/*,_it_returns_Unknown/* 2023-06-05T14:16:59.3007737Z === RUN TestMergeRespectPriority/When_the_target_condition_is_inverted,_it_returns_an_inverted_condition 2023-06-05T14:16:59.3008737Z === RUN TestMergeRespectPriority/When_the_top_and_target_conditions_are_inverted,_it_returns_an_equal_condition 2023-06-05T14:16:59.3009426Z === RUN TestMergeRespectPriority/nil_conditions_are_ignored 2023-06-05T14:16:59.3010110Z --- PASS: TestMergeRespectPriority (0.00s) 2023-06-05T14:16:59.3010888Z --- PASS: TestMergeRespectPriority/aggregate_nil_list_return_nil (0.00s) 2023-06-05T14:16:59.3011819Z --- PASS: TestMergeRespectPriority/aggregate_empty_list_return_nil (0.00s) 2023-06-05T14:16:59.3012759Z --- PASS: TestMergeRespectPriority/When_there_is_True/Negative_it_returns_an_inverted_False/Positive (0.00s) 2023-06-05T14:16:59.3013656Z --- PASS: TestMergeRespectPriority/When_there_is_False/Positive_and_no_True/Negative,_it_returns_False/Positive (0.00s) 2023-06-05T14:16:59.3014689Z --- PASS: TestMergeRespectPriority/When_there_is_True/Positive_and_no_True/Negative_or_False/Positive,_it_returns_True/Positive (0.00s) 2023-06-05T14:16:59.3015740Z --- PASS: TestMergeRespectPriority/When_there_is_True/Positive_and_no_False/Positive,_it_returns_True/Positive (0.00s) 2023-06-05T14:16:59.3016817Z --- PASS: TestMergeRespectPriority/When_there_is_False/Negative_and_no_True/*_or_False/Positive,_it_returns_False/Negative (0.00s) 2023-06-05T14:16:59.3017722Z --- PASS: TestMergeRespectPriority/When_there_is_Unknown/*_but_no_False/*,_it_returns_Unknown/* (0.00s) 2023-06-05T14:16:59.3019010Z --- PASS: TestMergeRespectPriority/When_the_target_condition_is_inverted,_it_returns_an_inverted_condition (0.00s) 2023-06-05T14:16:59.3020008Z --- PASS: TestMergeRespectPriority/When_the_top_and_target_conditions_are_inverted,_it_returns_an_equal_condition (0.00s) 2023-06-05T14:16:59.3021107Z --- PASS: TestMergeRespectPriority/nil_conditions_are_ignored (0.00s) 2023-06-05T14:16:59.3021659Z === RUN TestMergeRespectGeneration 2023-06-05T14:16:59.3022197Z === RUN TestMergeRespectGeneration/without_generation 2023-06-05T14:16:59.3022744Z === RUN TestMergeRespectGeneration/with_generation 2023-06-05T14:16:59.3023352Z --- PASS: TestMergeRespectGeneration (0.00s) 2023-06-05T14:16:59.3024058Z --- PASS: TestMergeRespectGeneration/without_generation (0.00s) 2023-06-05T14:16:59.3024771Z --- PASS: TestMergeRespectGeneration/with_generation (0.00s) 2023-06-05T14:16:59.3025248Z === RUN TestNewPatch 2023-06-05T14:16:59.3025651Z === RUN TestNewPatch/No_changes_return_empty_patch 2023-06-05T14:16:59.3026129Z === RUN TestNewPatch/No_changes_return_empty_patch#01 2023-06-05T14:16:59.3026617Z === RUN TestNewPatch/Detects_AddConditionPatch 2023-06-05T14:16:59.3027136Z === RUN TestNewPatch/Detects_ChangeConditionPatch 2023-06-05T14:16:59.3027637Z === RUN TestNewPatch/Detects_RemoveConditionPatch 2023-06-05T14:16:59.3028168Z --- PASS: TestNewPatch (0.00s) 2023-06-05T14:16:59.3028760Z --- PASS: TestNewPatch/No_changes_return_empty_patch (0.00s) 2023-06-05T14:16:59.3029447Z --- PASS: TestNewPatch/No_changes_return_empty_patch#01 (0.00s) 2023-06-05T14:16:59.3030122Z --- PASS: TestNewPatch/Detects_AddConditionPatch (0.00s) 2023-06-05T14:16:59.3030829Z --- PASS: TestNewPatch/Detects_ChangeConditionPatch (0.00s) 2023-06-05T14:16:59.3031514Z --- PASS: TestNewPatch/Detects_RemoveConditionPatch (0.00s) 2023-06-05T14:16:59.3031966Z === RUN TestApply 2023-06-05T14:16:59.3032361Z === RUN TestApply/No_patch_return_same_list 2023-06-05T14:16:59.3032862Z === RUN TestApply/Add:_When_a_condition_does_not_exists,_it_should_add 2023-06-05T14:16:59.3033475Z === RUN TestApply/Add:_When_a_condition_already_exists_but_without_conflicts,_it_should_add 2023-06-05T14:16:59.3034165Z === RUN TestApply/Add:_When_a_condition_already_exists_but_with_conflicts,_it_should_error 2023-06-05T14:16:59.3034890Z === RUN TestApply/Add:_When_a_condition_already_exists_but_with_conflicts,_it_should_not_error_if_the_condition_is_owned 2023-06-05T14:16:59.3035577Z === RUN TestApply/Remove:_When_a_condition_was_already_deleted,_it_should_pass 2023-06-05T14:16:59.3036227Z === RUN TestApply/Remove:_When_a_condition_already_exists_but_without_conflicts,_it_should_delete 2023-06-05T14:16:59.3036905Z === RUN TestApply/Remove:_When_a_condition_already_exists_but_with_conflicts,_it_should_error 2023-06-05T14:16:59.3037598Z === RUN TestApply/Remove:_When_a_condition_already_exists_but_with_conflicts,_it_should_not_error_if_the_condition_is_owned 2023-06-05T14:16:59.3038301Z === RUN TestApply/Change:_When_a_condition_exists_without_conflicts,_it_should_change 2023-06-05T14:16:59.3039019Z === RUN TestApply/Change:_When_a_condition_exists_with_conflicts_but_there_is_agreement_on_the_final_state,_it_should_change 2023-06-05T14:16:59.3039787Z === RUN TestApply/Change:_When_a_condition_exists_with_conflicts_but_there_is_no_agreement_on_the_final_state,_it_should_error 2023-06-05T14:16:59.3040676Z === RUN TestApply/Change:_When_a_condition_exists_with_conflicts_but_there_is_no_agreement_on_the_final_state,_it_should_not_error_if_the_condition_is_owned 2023-06-05T14:16:59.3041385Z === RUN TestApply/Change:_When_a_condition_was_deleted,_it_should_error 2023-06-05T14:16:59.3042011Z === RUN TestApply/Change:_When_a_condition_was_deleted,_it_should_not_error_if_the_condition_is_owned 2023-06-05T14:16:59.3042657Z --- PASS: TestApply (0.00s) 2023-06-05T14:16:59.3043242Z --- PASS: TestApply/No_patch_return_same_list (0.00s) 2023-06-05T14:16:59.3043961Z --- PASS: TestApply/Add:_When_a_condition_does_not_exists,_it_should_add (0.00s) 2023-06-05T14:16:59.3045071Z --- PASS: TestApply/Add:_When_a_condition_already_exists_but_without_conflicts,_it_should_add (0.00s) 2023-06-05T14:16:59.3046091Z --- PASS: TestApply/Add:_When_a_condition_already_exists_but_with_conflicts,_it_should_error (0.00s) 2023-06-05T14:16:59.3047080Z --- PASS: TestApply/Add:_When_a_condition_already_exists_but_with_conflicts,_it_should_not_error_if_the_condition_is_owned (0.00s) 2023-06-05T14:16:59.3047894Z --- PASS: TestApply/Remove:_When_a_condition_was_already_deleted,_it_should_pass (0.00s) 2023-06-05T14:16:59.3048724Z --- PASS: TestApply/Remove:_When_a_condition_already_exists_but_without_conflicts,_it_should_delete (0.00s) 2023-06-05T14:16:59.3049603Z --- PASS: TestApply/Remove:_When_a_condition_already_exists_but_with_conflicts,_it_should_error (0.00s) 2023-06-05T14:16:59.3050615Z --- PASS: TestApply/Remove:_When_a_condition_already_exists_but_with_conflicts,_it_should_not_error_if_the_condition_is_owned (0.00s) 2023-06-05T14:16:59.3051718Z --- PASS: TestApply/Change:_When_a_condition_exists_without_conflicts,_it_should_change (0.00s) 2023-06-05T14:16:59.3052727Z --- PASS: TestApply/Change:_When_a_condition_exists_with_conflicts_but_there_is_agreement_on_the_final_state,_it_should_change (0.00s) 2023-06-05T14:16:59.3053747Z --- PASS: TestApply/Change:_When_a_condition_exists_with_conflicts_but_there_is_no_agreement_on_the_final_state,_it_should_error (0.00s) 2023-06-05T14:16:59.3054885Z --- PASS: TestApply/Change:_When_a_condition_exists_with_conflicts_but_there_is_no_agreement_on_the_final_state,_it_should_not_error_if_the_condition_is_owned (0.00s) 2023-06-05T14:16:59.3055799Z --- PASS: TestApply/Change:_When_a_condition_was_deleted,_it_should_error (0.00s) 2023-06-05T14:16:59.3056657Z --- PASS: TestApply/Change:_When_a_condition_was_deleted,_it_should_not_error_if_the_condition_is_owned (0.00s) 2023-06-05T14:16:59.3057322Z === RUN TestApplyDoesNotAlterLastTransitionTime 2023-06-05T14:16:59.3058045Z --- PASS: TestApplyDoesNotAlterLastTransitionTime (0.00s) 2023-06-05T14:16:59.3058569Z === RUN TestHasSameState 2023-06-05T14:16:59.3059052Z --- PASS: TestHasSameState (0.00s) 2023-06-05T14:16:59.3059516Z === RUN TestLexicographicLess 2023-06-05T14:16:59.3060044Z --- PASS: TestLexicographicLess (0.00s) 2023-06-05T14:16:59.3060470Z === RUN TestSet 2023-06-05T14:16:59.3060844Z === RUN TestSet/Set_adds_a_condition 2023-06-05T14:16:59.3061278Z === RUN TestSet/Set_adds_more_conditions 2023-06-05T14:16:59.3061780Z === RUN TestSet/Set_does_not_duplicate_existing_conditions 2023-06-05T14:16:59.3062304Z === RUN TestSet/Set_sorts_conditions_in_lexicographic_order 2023-06-05T14:16:59.3062833Z --- PASS: TestSet (0.00s) 2023-06-05T14:16:59.3063404Z --- PASS: TestSet/Set_adds_a_condition (0.00s) 2023-06-05T14:16:59.3063995Z --- PASS: TestSet/Set_adds_more_conditions (0.00s) 2023-06-05T14:16:59.3064662Z --- PASS: TestSet/Set_does_not_duplicate_existing_conditions (0.00s) 2023-06-05T14:16:59.3065395Z --- PASS: TestSet/Set_sorts_conditions_in_lexicographic_order (0.00s) 2023-06-05T14:16:59.3065921Z === RUN TestSetLastTransitionTime 2023-06-05T14:16:59.3066590Z === RUN TestSetLastTransitionTime/Set_a_condition_that_does_not_exists_should_set_the_last_transition_time_if_not_defined 2023-06-05T14:16:59.3067432Z === RUN TestSetLastTransitionTime/Set_a_condition_that_does_not_exists_should_preserve_the_last_transition_time_if_defined 2023-06-05T14:16:59.3068201Z === RUN TestSetLastTransitionTime/Set_a_condition_that_already_exists_with_the_same_state_should_preserves_the_last_transition_time 2023-06-05T14:16:59.3069005Z === RUN TestSetLastTransitionTime/Set_a_condition_that_already_exists_but_with_different_state_should_changes_the_last_transition_time 2023-06-05T14:16:59.3069799Z --- PASS: TestSetLastTransitionTime (0.00s) 2023-06-05T14:16:59.3070766Z --- PASS: TestSetLastTransitionTime/Set_a_condition_that_does_not_exists_should_set_the_last_transition_time_if_not_defined (0.00s) 2023-06-05T14:16:59.3072115Z --- PASS: TestSetLastTransitionTime/Set_a_condition_that_does_not_exists_should_preserve_the_last_transition_time_if_defined (0.00s) 2023-06-05T14:16:59.3073343Z --- PASS: TestSetLastTransitionTime/Set_a_condition_that_already_exists_with_the_same_state_should_preserves_the_last_transition_time (0.00s) 2023-06-05T14:16:59.3074458Z --- PASS: TestSetLastTransitionTime/Set_a_condition_that_already_exists_but_with_different_state_should_changes_the_last_transition_time (0.00s) 2023-06-05T14:16:59.3075142Z === RUN TestSetObservedGeneration 2023-06-05T14:16:59.3075737Z --- PASS: TestSetObservedGeneration (0.00s) 2023-06-05T14:16:59.3076189Z === RUN TestMarkMethods 2023-06-05T14:16:59.3076665Z --- PASS: TestMarkMethods (0.00s) 2023-06-05T14:16:59.3077061Z === RUN TestSetSummary 2023-06-05T14:16:59.3077516Z --- PASS: TestSetSummary (0.00s) 2023-06-05T14:16:59.3077900Z === RUN TestSetMirror 2023-06-05T14:16:59.3078339Z --- PASS: TestSetMirror (0.00s) 2023-06-05T14:16:59.3078735Z === RUN TestSetAggregate 2023-06-05T14:16:59.3079218Z --- PASS: TestSetAggregate (0.00s) 2023-06-05T14:16:59.3079654Z === RUN TestGetStepCounterMessage 2023-06-05T14:16:59.3080229Z --- PASS: TestGetStepCounterMessage (0.00s) 2023-06-05T14:16:59.3080683Z === RUN TestLocalizeReason 2023-06-05T14:16:59.3081160Z --- PASS: TestLocalizeReason (0.00s) 2023-06-05T14:16:59.3081631Z === RUN TestGetFirstReasonAndMessage 2023-06-05T14:16:59.3082234Z --- PASS: TestGetFirstReasonAndMessage (0.00s) 2023-06-05T14:16:59.3082627Z === RUN Fuzz_Getter 2023-06-05T14:16:59.3083070Z --- PASS: Fuzz_Getter (0.00s) 2023-06-05T14:16:59.3083429Z === RUN Fuzz_Match 2023-06-05T14:16:59.3083883Z --- PASS: Fuzz_Match (0.00s) 2023-06-05T14:16:59.3084216Z PASS 2023-06-05T14:16:59.3084584Z ================================================================================ 2023-06-05T14:16:59.4221635Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/project:project_test: 2023-06-05T14:16:59.4222646Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/project:project_test: 2023-06-05T14:16:59.4223268Z === RUN TestAddIssue 2023-06-05T14:16:59.4223562Z {"severity":"info","ts":1685974619.4081147,"message":"Running project plugin"} 2023-06-05T14:16:59.4223889Z {"severity":"info","ts":1685974619.4081538,"message":"attempting to create a new issue for project #1"} 2023-06-05T14:16:59.4224352Z {"severity":"info","ts":1685974619.408162,"message":"Adding a new issue to the default project"} 2023-06-05T14:16:59.4224789Z listing projectsgetting projectslisting project columnscreating project cards{"severity":"info","ts":1685974619.408184,"message":"issue 0 was added to the project"} 2023-06-05T14:16:59.4225615Z --- PASS: TestAddIssue (0.00s) 2023-06-05T14:16:59.4225844Z === RUN TestV4 2023-06-05T14:16:59.4226079Z {"severity":"info","ts":1685974619.408223,"message":"Running project plugin"} 2023-06-05T14:16:59.4226499Z {"severity":"info","ts":1685974619.408227,"message":"attempting to create a new issue for project #150"} 2023-06-05T14:16:59.4226965Z {"severity":"info","ts":1685974619.4082296,"message":"Adding a new issue to the default project"} 2023-06-05T14:16:59.4227355Z listing projects{"severity":"info","ts":1685974619.4082344,"message":"cant find project associated with the given number"} 2023-06-05T14:16:59.4227697Z {"severity":"info","ts":1685974619.408244,"message":"trying the v4 api"} 2023-06-05T14:16:59.4228053Z mock query... 2023-06-05T14:16:59.4228385Z mock mutate... 2023-06-05T14:16:59.4228744Z {"severity":"info","ts":1685974619.4082503,"message":"added via v4 api -- card nodeid "} 2023-06-05T14:16:59.4229140Z --- PASS: TestV4 (0.00s) 2023-06-05T14:16:59.4229325Z PASS 2023-06-05T14:16:59.4229537Z ================================================================================ 2023-06-05T14:16:59.7820041Z INFO: From Testing //pkg/k8s/runtime/controller/reconcile:reconcile_test: 2023-06-05T14:16:59.7820732Z ==================== Test output for //pkg/k8s/runtime/controller/reconcile:reconcile_test: 2023-06-05T14:16:59.7821678Z === RUN TestGetStatusLastHandledReconcileAt 2023-06-05T14:16:59.7822362Z --- PASS: TestGetStatusLastHandledReconcileAt (0.00s) 2023-06-05T14:16:59.7823122Z === RUN TestSetStatusLastHandledReconcileAt 2023-06-05T14:16:59.7823823Z --- PASS: TestSetStatusLastHandledReconcileAt (0.00s) 2023-06-05T14:16:59.7824272Z PASS 2023-06-05T14:16:59.7824621Z ================================================================================ 2023-06-05T14:17:00.2014640Z INFO: From Testing //pkg/f8n/warehouse/oci/mutate:mutate_test: 2023-06-05T14:17:00.2015167Z ==================== Test output for //pkg/f8n/warehouse/oci/mutate:mutate_test: 2023-06-05T14:17:00.2015534Z === RUN TestName 2023-06-05T14:17:00.2015806Z === RUN TestName/Image 2023-06-05T14:17:00.2016103Z === RUN TestName/Image_Index 2023-06-05T14:17:00.2016567Z --- PASS: TestName (0.00s) 2023-06-05T14:17:00.2017051Z --- PASS: TestName/Image (0.00s) 2023-06-05T14:17:00.2017518Z --- PASS: TestName/Image_Index (0.00s) 2023-06-05T14:17:00.2017849Z PASS 2023-06-05T14:17:00.2018155Z ================================================================================ 2023-06-05T14:17:00.5034872Z INFO: From Testing //pkg/f8n/warehouse/lift/cmd/internal/command:command_test: 2023-06-05T14:17:00.5035573Z ==================== Test output for //pkg/f8n/warehouse/lift/cmd/internal/command:command_test: 2023-06-05T14:17:00.5036102Z === RUN TestRegisterCommonFlags 2023-06-05T14:17:00.5036568Z === RUN TestRegisterCommonFlags/Nil_Config 2023-06-05T14:17:00.5037226Z --- PASS: TestRegisterCommonFlags (0.00s) 2023-06-05T14:17:00.5037838Z --- PASS: TestRegisterCommonFlags/Nil_Config (0.00s) 2023-06-05T14:17:00.5038260Z PASS 2023-06-05T14:17:00.5038614Z ================================================================================ 2023-06-05T14:17:00.5664813Z INFO: From Testing //pkg/edge/gitops/fns/trimmer:trimmer_test: 2023-06-05T14:17:00.5665388Z ==================== Test output for //pkg/edge/gitops/fns/trimmer:trimmer_test: 2023-06-05T14:17:00.5665929Z === RUN TestTrimmer 2023-06-05T14:17:00.5666170Z trimmer_test.go:23: Yaml before trimming: 2023-06-05T14:17:00.5666414Z kind: Role 2023-06-05T14:17:00.5666658Z apiVersion: rbac.authorization.k8s.io/v1 2023-06-05T14:17:00.5666878Z metadata: 2023-06-05T14:17:00.5667078Z name: foo 2023-06-05T14:17:00.5667285Z creationTimestamp: null 2023-06-05T14:17:00.5667494Z status: {} 2023-06-05T14:17:00.5667696Z trimmer_test.go:37: Yaml after trimming: 2023-06-05T14:17:00.5667906Z kind: Role 2023-06-05T14:17:00.5668272Z apiVersion: rbac.authorization.k8s.io/v1 2023-06-05T14:17:00.5668602Z metadata: 2023-06-05T14:17:00.5668884Z name: foo 2023-06-05T14:17:00.5669461Z === RUN TestTrimmer/testdata/empty-spec 2023-06-05T14:17:00.5669963Z === RUN TestTrimmer/testdata/non-empty-spec 2023-06-05T14:17:00.5670475Z --- PASS: TestTrimmer (0.00s) 2023-06-05T14:17:00.5670927Z --- PASS: TestTrimmer/testdata/empty-spec (0.00s) 2023-06-05T14:17:00.5671298Z --- PASS: TestTrimmer/testdata/non-empty-spec (0.00s) 2023-06-05T14:17:00.5671557Z PASS 2023-06-05T14:17:00.5671780Z ================================================================================ 2023-06-05T14:17:00.7035923Z INFO: From Testing //pkg/sds/lib/remotecli/remotecli:remotecli_test: 2023-06-05T14:17:00.7036626Z ==================== Test output for //pkg/sds/lib/remotecli/remotecli:remotecli_test: 2023-06-05T14:17:00.7037139Z === RUN TestValidateTarget 2023-06-05T14:17:00.7037626Z --- PASS: TestValidateTarget (0.00s) 2023-06-05T14:17:00.7037871Z === RUN TestNewRemoteCLI 2023-06-05T14:17:00.7038160Z --- PASS: TestNewRemoteCLI (0.00s) 2023-06-05T14:17:00.7038396Z === RUN TestStartSession 2023-06-05T14:17:00.7038673Z --- PASS: TestStartSession (0.00s) 2023-06-05T14:17:00.7038933Z === RUN TestStartSessionInvalidTarget 2023-06-05T14:17:00.7039279Z --- PASS: TestStartSessionInvalidTarget (0.00s) 2023-06-05T14:17:00.7039570Z === RUN TestSend 2023-06-05T14:17:00.7040352Z --- PASS: TestSend (0.00s) 2023-06-05T14:17:00.7040735Z === RUN TestSendNoSessionStarted 2023-06-05T14:17:00.7041479Z --- PASS: TestSendNoSessionStarted (0.00s) 2023-06-05T14:17:00.7041966Z === RUN TestEndSession 2023-06-05T14:17:00.7042392Z --- PASS: TestEndSession (0.00s) 2023-06-05T14:17:00.7042718Z === RUN TestHandler 2023-06-05T14:17:00.7042979Z --- PASS: TestHandler (0.10s) 2023-06-05T14:17:00.7043210Z === RUN TestCreateOptionalConfig 2023-06-05T14:17:00.7043652Z --- PASS: TestCreateOptionalConfig (0.00s) 2023-06-05T14:17:00.7044079Z === RUN TestFillTemplate 2023-06-05T14:17:00.7044547Z --- PASS: TestFillTemplate (0.00s) 2023-06-05T14:17:00.7044878Z PASS 2023-06-05T14:17:00.7045246Z ================================================================================ 2023-06-05T14:17:01.0220980Z INFO: From Testing //pkg/edge/bsl:bsl_test: 2023-06-05T14:17:01.0221542Z ==================== Test output for //pkg/edge/bsl:bsl_test: 2023-06-05T14:17:01.0221956Z === RUN TestBSLClient 2023-06-05T14:17:01.0222476Z --- PASS: TestBSLClient (0.00s) 2023-06-05T14:17:01.0222892Z === RUN TestBSLRequest 2023-06-05T14:17:01.0223423Z --- PASS: TestBSLRequest (0.00s) 2023-06-05T14:17:01.0223720Z === RUN TestSetID 2023-06-05T14:17:01.0224119Z --- PASS: TestSetID (0.00s) 2023-06-05T14:17:01.0224488Z === RUN TestSetSiteName 2023-06-05T14:17:01.0224979Z --- PASS: TestSetSiteName (0.00s) 2023-06-05T14:17:01.0225372Z === RUN TestSetEnterpriseUnitName 2023-06-05T14:17:01.0225954Z --- PASS: TestSetEnterpriseUnitName (0.00s) 2023-06-05T14:17:01.0226213Z === RUN TestSetLatitude 2023-06-05T14:17:01.0226489Z --- PASS: TestSetLatitude (0.00s) 2023-06-05T14:17:01.0226709Z === RUN TestSetLongitude 2023-06-05T14:17:01.0226987Z --- PASS: TestSetLongitude (0.00s) 2023-06-05T14:17:01.0227215Z === RUN TestSetAddress 2023-06-05T14:17:01.0227561Z --- PASS: TestSetAddress (0.00s) 2023-06-05T14:17:01.0227901Z === RUN TestSetContact 2023-06-05T14:17:01.0228482Z --- PASS: TestSetContact (0.00s) 2023-06-05T14:17:01.0228897Z === RUN TestSetCustomAttributes 2023-06-05T14:17:01.0229367Z --- PASS: TestSetCustomAttributes (0.00s) 2023-06-05T14:17:01.0229764Z === RUN TestAddCustomAttributes 2023-06-05T14:17:01.0230236Z --- PASS: TestAddCustomAttributes (0.00s) 2023-06-05T14:17:01.0230712Z === RUN TestAddAttributeToCustomAttributeSet 2023-06-05T14:17:01.0231370Z --- PASS: TestAddAttributeToCustomAttributeSet (0.00s) 2023-06-05T14:17:01.0231838Z === RUN TestSetCurrency 2023-06-05T14:17:01.0232314Z --- PASS: TestSetCurrency (0.00s) 2023-06-05T14:17:01.0232675Z === RUN TestSetCreatedOn 2023-06-05T14:17:01.0233094Z --- PASS: TestSetCreatedOn (0.00s) 2023-06-05T14:17:01.0233431Z === RUN TestSetDescription 2023-06-05T14:17:01.0233866Z --- PASS: TestSetDescription (0.00s) 2023-06-05T14:17:01.0234274Z === RUN TestSetEnterpriseSettings 2023-06-05T14:17:01.0234769Z --- PASS: TestSetEnterpriseSettings (0.00s) 2023-06-05T14:17:01.0235150Z === RUN TestAddEnterpriseSetting 2023-06-05T14:17:01.0235863Z --- PASS: TestAddEnterpriseSetting (0.00s) 2023-06-05T14:17:01.0236275Z === RUN TestAddEnterpriseConfigurationSetting 2023-06-05T14:17:01.0236855Z --- PASS: TestAddEnterpriseConfigurationSetting (0.00s) 2023-06-05T14:17:01.0237264Z === RUN TestSetLastModifiedOn 2023-06-05T14:17:01.0237692Z --- PASS: TestSetLastModifiedOn (0.00s) 2023-06-05T14:17:01.0238002Z === RUN TestSetLocked 2023-06-05T14:17:01.0238377Z --- PASS: TestSetLocked (0.00s) 2023-06-05T14:17:01.0238717Z === RUN TestSetStatus 2023-06-05T14:17:01.0239108Z --- PASS: TestSetStatus (0.00s) 2023-06-05T14:17:01.0239413Z === RUN TestSetDayparts 2023-06-05T14:17:01.0239843Z --- PASS: TestSetDayparts (0.00s) 2023-06-05T14:17:01.0288403Z === RUN TestSetOrganizationName 2023-06-05T14:17:01.0288984Z --- PASS: TestSetOrganizationName (0.00s) 2023-06-05T14:17:01.0289241Z === RUN TestSetParentEnterpriseUnitID 2023-06-05T14:17:01.0289568Z --- PASS: TestSetParentEnterpriseUnitID (0.00s) 2023-06-05T14:17:01.0289820Z === RUN TestSetReferenceID 2023-06-05T14:17:01.0290459Z --- PASS: TestSetReferenceID (0.00s) 2023-06-05T14:17:01.0290685Z === RUN TestSetTimeZone 2023-06-05T14:17:01.0291099Z --- PASS: TestSetTimeZone (0.00s) 2023-06-05T14:17:01.0291565Z === RUN TestLockedToString 2023-06-05T14:17:01.0291968Z --- PASS: TestLockedToString (0.00s) 2023-06-05T14:17:01.0292295Z === RUN TestCoordinateLatitudeToString 2023-06-05T14:17:01.0292808Z --- PASS: TestCoordinateLatitudeToString (0.00s) 2023-06-05T14:17:01.0293232Z === RUN TestCoordinateLongitdeToString 2023-06-05T14:17:01.0293569Z --- PASS: TestCoordinateLongitdeToString (0.00s) 2023-06-05T14:17:01.0293837Z === RUN TestCustomAttributeSetsToString 2023-06-05T14:17:01.0294169Z --- PASS: TestCustomAttributeSetsToString (0.00s) 2023-06-05T14:17:01.0294448Z === RUN TestEnterpriseSettingsToString 2023-06-05T14:17:01.0294765Z --- PASS: TestEnterpriseSettingsToString (0.00s) 2023-06-05T14:17:01.0295015Z === RUN TestNewBSLInfoConfigMap 2023-06-05T14:17:01.0295305Z --- PASS: TestNewBSLInfoConfigMap (0.00s) 2023-06-05T14:17:01.0295599Z === RUN TestAddBSLOrgID 2023-06-05T14:17:01.0295852Z --- PASS: TestAddBSLOrgID (0.00s) 2023-06-05T14:17:01.0296085Z === RUN TestConfigMapToString 2023-06-05T14:17:01.0296354Z --- PASS: TestConfigMapToString (0.00s) 2023-06-05T14:17:01.0296572Z === RUN TestFromClient 2023-06-05T14:17:01.0296816Z --- PASS: TestFromClient (0.00s) 2023-06-05T14:17:01.0297042Z === RUN TestIsBslInfoConfigMap 2023-06-05T14:17:01.0297320Z --- PASS: TestIsBslInfoConfigMap (0.00s) 2023-06-05T14:17:01.0297552Z === RUN TestBuildConfigMap 2023-06-05T14:17:01.0297822Z --- PASS: TestBuildConfigMap (0.00s) 2023-06-05T14:17:01.0298060Z === RUN TestAddOrganizationID 2023-06-05T14:17:01.0298338Z --- PASS: TestAddOrganizationID (0.00s) 2023-06-05T14:17:01.0298596Z === RUN TestSliceToStrings 2023-06-05T14:17:01.0299001Z --- PASS: TestSliceToStrings (0.00s) 2023-06-05T14:17:01.0299235Z === RUN TestGetOrgShortName 2023-06-05T14:17:01.0299497Z --- PASS: TestGetOrgShortName (0.00s) 2023-06-05T14:17:01.0299742Z === RUN TestGetFullAccountName 2023-06-05T14:17:01.0300029Z --- PASS: TestGetFullAccountName (0.00s) 2023-06-05T14:17:01.0300286Z === RUN TestWithOrganizationPrefix 2023-06-05T14:17:01.0300676Z --- PASS: TestWithOrganizationPrefix (0.00s) 2023-06-05T14:17:01.0300960Z === RUN TestWithOrganizationPrefixEmpty 2023-06-05T14:17:01.0301306Z --- PASS: TestWithOrganizationPrefixEmpty (0.00s) 2023-06-05T14:17:01.0301588Z === RUN TestHTTPClient_WithOrg_EmptyRoot 2023-06-05T14:17:01.0301893Z --- PASS: TestHTTPClient_WithOrg_EmptyRoot (0.00s) 2023-06-05T14:17:01.0302145Z === RUN TestHTTPClient_WithOrg 2023-06-05T14:17:01.0302421Z --- PASS: TestHTTPClient_WithOrg (0.00s) 2023-06-05T14:17:01.0302659Z === RUN TestOnConfigMapUpdate 2023-06-05T14:17:01.0302930Z --- PASS: TestOnConfigMapUpdate (0.40s) 2023-06-05T14:17:01.0303186Z === RUN TestOnConfigMapUpdateInvalid 2023-06-05T14:17:01.0304065Z {"severity":"error","ts":1685974619.6002257,"logger":"TestOnConfigMapUpdateInvalid","message":"fail to parse bsl info ConfigMap, will watch for update","error":"strconv.ParseFloat: parsing \"invalid value, number only\": invalid syntax","stacktrace":"edge-infra.dev/pkg/edge/bsl.OnConfigMapUpdate.func1\n\tpkg/edge/bsl/watch.go:36"} 2023-06-05T14:17:01.0305246Z --- PASS: TestOnConfigMapUpdateInvalid (0.40s) 2023-06-05T14:17:01.0305615Z === RUN TestOnConfigMapUpdateFilterMatchAll 2023-06-05T14:17:01.0305996Z --- PASS: TestOnConfigMapUpdateFilterMatchAll (0.40s) 2023-06-05T14:17:01.0306301Z === RUN TestOnConfigMapUpdateFilterMatchOne 2023-06-05T14:17:01.0306667Z --- PASS: TestOnConfigMapUpdateFilterMatchOne (0.40s) 2023-06-05T14:17:01.0306984Z === RUN TestOnConfigMapUpdateFilterMatchNone 2023-06-05T14:17:01.0307357Z --- PASS: TestOnConfigMapUpdateFilterMatchNone (0.40s) 2023-06-05T14:17:01.0307609Z PASS 2023-06-05T14:17:01.0307801Z ================================================================================ 2023-06-05T14:17:01.6299112Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/type:type_test: 2023-06-05T14:17:01.6299998Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/type:type_test: 2023-06-05T14:17:01.6300447Z === RUN TestChangeTitle 2023-06-05T14:17:01.6300759Z --- PASS: TestChangeTitle (0.00s) 2023-06-05T14:17:01.6300988Z === RUN TestCheckTitle 2023-06-05T14:17:01.6301263Z --- PASS: TestCheckTitle (0.00s) 2023-06-05T14:17:01.6301450Z PASS 2023-06-05T14:17:01.6301657Z ================================================================================ 2023-06-05T14:17:01.7798857Z INFO: From Testing //pkg/lib/gcp/iam:iam_test: 2023-06-05T14:17:01.7799479Z ==================== Test output for //pkg/lib/gcp/iam:iam_test: 2023-06-05T14:17:01.7799983Z === RUN TestResolveGoogleAppCreds_Environment 2023-06-05T14:17:01.7800649Z --- PASS: TestResolveGoogleAppCreds_Environment (0.00s) 2023-06-05T14:17:01.7801171Z === RUN TestResolveGoogleAppCreds_Homedir 2023-06-05T14:17:01.7801831Z --- PASS: TestResolveGoogleAppCreds_Homedir (0.00s) 2023-06-05T14:17:01.7802350Z === RUN TestCreateServiceAccount 2023-06-05T14:17:01.7802908Z --- PASS: TestCreateServiceAccount (0.00s) 2023-06-05T14:17:01.7803375Z === RUN TestGetServiceAccount 2023-06-05T14:17:01.7803883Z --- PASS: TestGetServiceAccount (0.00s) 2023-06-05T14:17:01.7804327Z === RUN TestCreateServiceAccountKey 2023-06-05T14:17:01.7804909Z --- PASS: TestCreateServiceAccountKey (0.00s) 2023-06-05T14:17:01.7805465Z === RUN TestCreateIamRole 2023-06-05T14:17:01.7805921Z --- PASS: TestCreateIamRole (0.00s) 2023-06-05T14:17:01.7806232Z === RUN TestGetPolicy 2023-06-05T14:17:01.7806689Z --- PASS: TestGetPolicy (0.00s) 2023-06-05T14:17:01.7807078Z === RUN TestSetPolicy 2023-06-05T14:17:01.7807522Z --- PASS: TestSetPolicy (0.00s) 2023-06-05T14:17:01.7807917Z === RUN TestAccountIDValidation 2023-06-05T14:17:01.7808441Z --- PASS: TestAccountIDValidation (0.00s) 2023-06-05T14:17:01.7808872Z === RUN TestWorkloadIdentity 2023-06-05T14:17:01.7809390Z --- PASS: TestWorkloadIdentity (0.00s) 2023-06-05T14:17:01.7809774Z === RUN TestUserMember 2023-06-05T14:17:01.7810226Z --- PASS: TestUserMember (0.00s) 2023-06-05T14:17:01.7810634Z === RUN TestSvcAccountMember 2023-06-05T14:17:01.7811161Z --- PASS: TestSvcAccountMember (0.00s) 2023-06-05T14:17:01.7811757Z === RUN TestCreatePermission 2023-06-05T14:17:01.7812291Z --- PASS: TestCreatePermission (0.00s) 2023-06-05T14:17:01.7812715Z === RUN TestCreateCondition 2023-06-05T14:17:01.7813223Z --- PASS: TestCreateCondition (0.00s) 2023-06-05T14:17:01.7813641Z === RUN TestCreatePolicyBinding 2023-06-05T14:17:01.7814163Z --- PASS: TestCreatePolicyBinding (0.00s) 2023-06-05T14:17:01.7814594Z === RUN TestCreatePolicy 2023-06-05T14:17:01.7815117Z --- PASS: TestCreatePolicy (0.00s) 2023-06-05T14:17:01.7815498Z === RUN TestCreateRole 2023-06-05T14:17:01.7815965Z --- PASS: TestCreateRole (0.00s) 2023-06-05T14:17:01.7816380Z === RUN TestCreateRoleRequest 2023-06-05T14:17:01.7816904Z --- PASS: TestCreateRoleRequest (0.00s) 2023-06-05T14:17:01.7817319Z === RUN TestNewServiceAccount 2023-06-05T14:17:01.7817850Z --- PASS: TestNewServiceAccount (0.00s) 2023-06-05T14:17:01.7818323Z === RUN TestNewServiceAccountRequest 2023-06-05T14:17:01.7818923Z --- PASS: TestNewServiceAccountRequest (0.00s) 2023-06-05T14:17:01.7819404Z === RUN TestNewServiceAccountKey 2023-06-05T14:17:01.7819928Z --- PASS: TestNewServiceAccountKey (0.00s) 2023-06-05T14:17:01.7820280Z PASS 2023-06-05T14:17:01.7820634Z ================================================================================ 2023-06-05T14:17:02.2564127Z INFO: From Testing //pkg/edge/registration:registration_test: 2023-06-05T14:17:02.2564774Z ==================== Test output for //pkg/edge/registration:registration_test: 2023-06-05T14:17:02.2565233Z === RUN TestRegisterCluster 2023-06-05T14:17:02.2565744Z Fetching cluster registration data... 2023-06-05T14:17:02.2566179Z cluster registration data retrieved 2023-06-05T14:17:02.2566611Z Cluster registered with Edge! 2023-06-05T14:17:02.2567305Z Cluster edge ID: test-registration-id 2023-06-05T14:17:02.2568169Z Fetching cluster bootstrap data... 2023-06-05T14:17:02.2568475Z Cluster bootstrap data retrieved! 2023-06-05T14:17:02.2569179Z creating edge Secrets ... 2023-06-05T14:17:02.2569386Z installing Flux ... 2023-06-05T14:17:02.2569601Z Installing Flux Bucket resource!! 2023-06-05T14:17:02.2569797Z Flux Bucket created 2023-06-05T14:17:02.2570018Z Installing Flux Kustomize resource!! 2023-06-05T14:17:02.2570240Z Flux Kustomize created 2023-06-05T14:17:02.2570474Z Cluster bootstrapping with edge completed! 2023-06-05T14:17:02.2570844Z --- PASS: TestRegisterCluster (1.41s) 2023-06-05T14:17:02.2571100Z === RUN TestCheckIfClusterInCleanState 2023-06-05T14:17:02.2571616Z Fetching cluster registration data... 2023-06-05T14:17:02.2571979Z cluster registration data retrieved 2023-06-05T14:17:02.2572322Z Cluster registered with Edge! 2023-06-05T14:17:02.2572708Z Cluster edge ID: test-registration-id 2023-06-05T14:17:02.2573046Z Fetching cluster bootstrap data... 2023-06-05T14:17:02.2573416Z Cluster bootstrap data retrieved! 2023-06-05T14:17:02.2573743Z creating edge Secrets ... 2023-06-05T14:17:02.2574020Z installing Flux ... 2023-06-05T14:17:02.2574364Z Installing Flux Bucket resource!! 2023-06-05T14:17:02.2574702Z Flux Bucket created 2023-06-05T14:17:02.2575035Z Installing Flux Kustomize resource!! 2023-06-05T14:17:02.2575372Z Flux Kustomize created 2023-06-05T14:17:02.2575804Z Cluster bootstrapping with edge completed! 2023-06-05T14:17:02.2576371Z --- PASS: TestCheckIfClusterInCleanState (0.31s) 2023-06-05T14:17:02.2576845Z === RUN TestRegisterClusterWithTotpToken 2023-06-05T14:17:02.2577247Z Fetching cluster registration data... 2023-06-05T14:17:02.2577633Z cluster registration data retrieved 2023-06-05T14:17:02.2577985Z Cluster registered with Edge! 2023-06-05T14:17:02.2578445Z Cluster edge ID: test-registration-id 2023-06-05T14:17:02.2578805Z Fetching cluster bootstrap data... 2023-06-05T14:17:02.2579175Z Cluster bootstrap data retrieved! 2023-06-05T14:17:02.2579521Z creating edge Secrets ... 2023-06-05T14:17:02.2579854Z installing Flux ... 2023-06-05T14:17:02.2580162Z Installing Flux Bucket resource!! 2023-06-05T14:17:02.2580505Z Flux Bucket created 2023-06-05T14:17:02.2580839Z Installing Flux Kustomize resource!! 2023-06-05T14:17:02.2581181Z Flux Kustomize created 2023-06-05T14:17:02.2581530Z Cluster bootstrapping with edge completed! 2023-06-05T14:17:02.2582084Z --- PASS: TestRegisterClusterWithTotpToken (0.32s) 2023-06-05T14:17:02.2582503Z === RUN TestApplyLumperGKE 2023-06-05T14:17:02.2582949Z --- PASS: TestApplyLumperGKE (1.11s) 2023-06-05T14:17:02.2583272Z PASS 2023-06-05T14:17:02.2583561Z ================================================================================ 2023-06-05T14:17:02.5203895Z INFO: From Testing //pkg/f8n/warehouse/lift/unpack:unpack_test: 2023-06-05T14:17:02.5204524Z ==================== Test output for //pkg/f8n/warehouse/lift/unpack:unpack_test: 2023-06-05T14:17:02.5204967Z === RUN TestLayers 2023-06-05T14:17:02.5205302Z === RUN TestLayers/infrastructure 2023-06-05T14:17:02.5205802Z === RUN TestLayers/infrastructure/WithInfraNamespace 2023-06-05T14:17:02.5206299Z === RUN TestLayers/runtime 2023-06-05T14:17:02.5207017Z layers_test.go:151: layer &{0xc0025dd720 runtime map[com.ncr.warehouse.layer.type:runtime com.ncr.warehouse.pallet.layer.runtime.capability:linkerd]} 2023-06-05T14:17:02.5207739Z layers_test.go:155: expected layer key found linkerd 2023-06-05T14:17:02.5208495Z layers_test.go:151: layer &{0xc0025dd8c0 runtime map[com.ncr.warehouse.layer.type:runtime com.ncr.warehouse.pallet.layer.runtime.capability:prometheus]} 2023-06-05T14:17:02.5209243Z layers_test.go:155: expected layer key found prometheus 2023-06-05T14:17:02.5209834Z layers_test.go:151: layer &{0xc0025dda60 runtime map[com.ncr.warehouse.layer.type:runtime]} 2023-06-05T14:17:02.5210482Z layers_test.go:155: expected layer key found runtime 2023-06-05T14:17:02.5214260Z layers_test.go:151: layer &{0xc002620780 runtime map[com.ncr.warehouse.layer.type:runtime com.ncr.warehouse.pallet.layer.runtime.capability:linkerd]} 2023-06-05T14:17:02.5215233Z layers_test.go:155: expected layer key found linkerd 2023-06-05T14:17:02.5216268Z layers_test.go:151: layer &{0xc002620960 runtime map[com.ncr.warehouse.layer.type:runtime com.ncr.warehouse.pallet.layer.runtime.capability:prometheus]} 2023-06-05T14:17:02.5216988Z layers_test.go:155: expected layer key found prometheus 2023-06-05T14:17:02.5217557Z layers_test.go:151: layer &{0xc002620b00 runtime map[com.ncr.warehouse.layer.type:runtime]} 2023-06-05T14:17:02.5218115Z layers_test.go:155: expected layer key found runtime 2023-06-05T14:17:02.5218555Z === RUN TestLayers/individual_layer_keys 2023-06-05T14:17:02.5218955Z === RUN TestLayers/rendering 2023-06-05T14:17:02.5219413Z === RUN TestLayers/ForProvider_required_for_some_input_types 2023-06-05T14:17:02.5219929Z === RUN TestLayers/All_layers_returned_by_default 2023-06-05T14:17:02.5220489Z layers_test.go:140: expected layer key found infrastructure 2023-06-05T14:17:02.5220971Z layers_test.go:140: expected layer key found linkerd 2023-06-05T14:17:02.5221471Z layers_test.go:140: expected layer key found prometheus 2023-06-05T14:17:02.5221957Z layers_test.go:140: expected layer key found runtime 2023-06-05T14:17:02.5222735Z --- PASS: TestLayers (1.12s) 2023-06-05T14:17:02.5223254Z --- PASS: TestLayers/infrastructure (1.11s) 2023-06-05T14:17:02.5223880Z --- PASS: TestLayers/infrastructure/WithInfraNamespace (0.00s) 2023-06-05T14:17:02.5224486Z --- PASS: TestLayers/runtime (0.00s) 2023-06-05T14:17:02.5225068Z --- PASS: TestLayers/individual_layer_keys (0.00s) 2023-06-05T14:17:02.5225586Z --- PASS: TestLayers/rendering (0.00s) 2023-06-05T14:17:02.5226261Z --- PASS: TestLayers/ForProvider_required_for_some_input_types (0.00s) 2023-06-05T14:17:02.5226956Z --- PASS: TestLayers/All_layers_returned_by_default (0.00s) 2023-06-05T14:17:02.5227405Z === RUN TestOptions 2023-06-05T14:17:02.5227852Z === RUN TestOptions/WithInfraNamespace_and_ForLayerKeys 2023-06-05T14:17:02.5228401Z === RUN TestOptions/WithInfraNamespace_and_ForLayerTypes 2023-06-05T14:17:02.5228977Z === RUN TestOptions/ForLayerKeys_and_ForLayerTypes_are_mutually_exclusive 2023-06-05T14:17:02.5229557Z === RUN TestOptions/WithInfraNamespace_without_infra_layer 2023-06-05T14:17:02.5230110Z --- PASS: TestOptions (0.00s) 2023-06-05T14:17:02.5230823Z --- PASS: TestOptions/WithInfraNamespace_and_ForLayerKeys (0.00s) 2023-06-05T14:17:02.5231535Z --- PASS: TestOptions/WithInfraNamespace_and_ForLayerTypes (0.00s) 2023-06-05T14:17:02.5232327Z --- PASS: TestOptions/ForLayerKeys_and_ForLayerTypes_are_mutually_exclusive (0.00s) 2023-06-05T14:17:02.5233097Z --- PASS: TestOptions/WithInfraNamespace_without_infra_layer (0.00s) 2023-06-05T14:17:02.5233571Z === RUN TestUnpack 2023-06-05T14:17:02.5234035Z unpack_test.go:73: visiting cert-manager 2023-06-05T14:17:02.5234613Z unpack_test.go:73: visiting prometheus-operator 2023-06-05T14:17:02.5235215Z unpack_test.go:73: visiting redpanda-system 2023-06-05T14:17:02.5235776Z unpack_test.go:80: checking dep cert-manager 2023-06-05T14:17:02.5236386Z unpack_test.go:80: checking dep prometheus-operator 2023-06-05T14:17:02.5236962Z unpack_test.go:73: visiting redpanda-cluster 2023-06-05T14:17:02.5237528Z unpack_test.go:80: checking dep redpanda-system 2023-06-05T14:17:02.5238155Z unpack_test.go:73: visiting external-secrets-operator 2023-06-05T14:17:02.5238743Z unpack_test.go:73: visiting secret-store 2023-06-05T14:17:02.5239356Z unpack_test.go:80: checking dep external-secrets-operator 2023-06-05T14:17:02.5239963Z unpack_test.go:73: visiting edge-docker-pull-secret 2023-06-05T14:17:02.5240629Z unpack_test.go:80: checking dep secret-store 2023-06-05T14:17:02.5241084Z unpack_test.go:73: visiting shoot 2023-06-05T14:17:02.5241635Z unpack_test.go:80: checking dep redpanda-cluster 2023-06-05T14:17:02.5242229Z unpack_test.go:80: checking dep external-secrets 2023-06-05T14:17:02.5243069Z === RUN TestUnpack/ForProvider_required_for_some_input_types 2023-06-05T14:17:02.5243619Z === RUN TestUnpack/Layers_Processed_for_all_Input_Types 2023-06-05T14:17:02.5244275Z === RUN TestUnpack/Handle_Unrenderable_Dependency 2023-06-05T14:17:02.5244789Z --- PASS: TestUnpack (0.34s) 2023-06-05T14:17:02.5245430Z --- PASS: TestUnpack/ForProvider_required_for_some_input_types (0.00s) 2023-06-05T14:17:02.5246168Z --- PASS: TestUnpack/Layers_Processed_for_all_Input_Types (0.32s) 2023-06-05T14:17:02.5246864Z --- PASS: TestUnpack/Handle_Unrenderable_Dependency (0.01s) 2023-06-05T14:17:02.5247281Z PASS 2023-06-05T14:17:02.5247652Z ================================================================================ 2023-06-05T14:17:02.6408474Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/approved_label:approved_label_test: 2023-06-05T14:17:02.6409245Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/approved_label:approved_label_test: 2023-06-05T14:17:02.6409533Z PASS 2023-06-05T14:17:02.6409750Z testing: warning: no tests to run 2023-06-05T14:17:02.6409993Z ================================================================================ 2023-06-05T14:17:02.6771966Z INFO: From Testing //pkg/k8s/certmanager:certmanager_test: 2023-06-05T14:17:02.6772637Z ==================== Test output for //pkg/k8s/certmanager:certmanager_test: 2023-06-05T14:17:02.6773088Z === RUN TestInstall 2023-06-05T14:17:02.6773577Z --- PASS: TestInstall (6.40s) 2023-06-05T14:17:02.6774040Z PASS 2023-06-05T14:17:02.6774386Z ================================================================================ 2023-06-05T14:17:02.7864095Z INFO: From Testing //pkg/k8s/kustomize:kustomize_test: 2023-06-05T14:17:02.7864723Z ==================== Test output for //pkg/k8s/kustomize:kustomize_test: 2023-06-05T14:17:02.7865141Z === RUN TestFS 2023-06-05T14:17:02.7865484Z === RUN TestFS/Exists 2023-06-05T14:17:02.7865806Z === RUN TestFS/Exists/0 2023-06-05T14:17:02.7866226Z === RUN TestFS/Exists/1 2023-06-05T14:17:02.7866568Z === RUN TestFS/Exists/2 2023-06-05T14:17:02.7866927Z === RUN TestFS/Exists/3 2023-06-05T14:17:02.7867291Z === RUN TestFS/Exists/4 2023-06-05T14:17:02.7867615Z === RUN TestFS/Exists/5 2023-06-05T14:17:02.7867963Z === RUN TestFS/Exists/6 2023-06-05T14:17:02.7868309Z === RUN TestFS/IsDir 2023-06-05T14:17:02.7868649Z === RUN TestFS/IsDir/0 2023-06-05T14:17:02.7868976Z === RUN TestFS/IsDir/1 2023-06-05T14:17:02.7869326Z === RUN TestFS/IsDir/2 2023-06-05T14:17:02.7869669Z === RUN TestFS/IsDir/3 2023-06-05T14:17:02.7870084Z === RUN TestFS/IsDir/4 2023-06-05T14:17:02.7870382Z === RUN TestFS/IsDir/5 2023-06-05T14:17:02.7870731Z === RUN TestFS/Kustomize_Build 2023-06-05T14:17:02.7871262Z --- PASS: TestFS (0.02s) 2023-06-05T14:17:02.7871717Z --- PASS: TestFS/Exists (0.00s) 2023-06-05T14:17:02.7872196Z --- PASS: TestFS/Exists/0 (0.00s) 2023-06-05T14:17:02.7872661Z --- PASS: TestFS/Exists/1 (0.00s) 2023-06-05T14:17:02.7873172Z --- PASS: TestFS/Exists/2 (0.00s) 2023-06-05T14:17:02.7873655Z --- PASS: TestFS/Exists/3 (0.00s) 2023-06-05T14:17:02.7874289Z --- PASS: TestFS/Exists/4 (0.00s) 2023-06-05T14:17:02.7874786Z --- PASS: TestFS/Exists/5 (0.00s) 2023-06-05T14:17:02.7875264Z --- PASS: TestFS/Exists/6 (0.00s) 2023-06-05T14:17:02.7875751Z --- PASS: TestFS/IsDir (0.00s) 2023-06-05T14:17:02.7876359Z --- PASS: TestFS/IsDir/0 (0.00s) 2023-06-05T14:17:02.7876828Z --- PASS: TestFS/IsDir/1 (0.00s) 2023-06-05T14:17:02.7877304Z --- PASS: TestFS/IsDir/2 (0.00s) 2023-06-05T14:17:02.7877780Z --- PASS: TestFS/IsDir/3 (0.00s) 2023-06-05T14:17:02.7878255Z --- PASS: TestFS/IsDir/4 (0.00s) 2023-06-05T14:17:02.7878717Z --- PASS: TestFS/IsDir/5 (0.00s) 2023-06-05T14:17:02.7879236Z --- PASS: TestFS/Kustomize_Build (0.02s) 2023-06-05T14:17:02.7879611Z PASS 2023-06-05T14:17:02.7880086Z ================================================================================ 2023-06-05T14:17:02.8067997Z INFO: From Testing //pkg/edge/ctlfish/monitor:monitor_test: 2023-06-05T14:17:02.8068978Z ==================== Test output for //pkg/edge/ctlfish/monitor:monitor_test: 2023-06-05T14:17:02.8069514Z === RUN TestAllResourcesExcludeResources 2023-06-05T14:17:02.8070344Z --- PASS: TestAllResourcesExcludeResources (1.00s) 2023-06-05T14:17:02.8070847Z === RUN TestSanitizeResource 2023-06-05T14:17:02.8071260Z === RUN TestSanitizeResource/Test_Case_1_Secret 2023-06-05T14:17:02.8071727Z === PAUSE TestSanitizeResource/Test_Case_1_Secret 2023-06-05T14:17:02.8072197Z === CONT TestSanitizeResource/Test_Case_1_Secret 2023-06-05T14:17:02.8072771Z --- PASS: TestSanitizeResource (0.00s) 2023-06-05T14:17:02.8073364Z --- PASS: TestSanitizeResource/Test_Case_1_Secret (0.00s) 2023-06-05T14:17:02.8073828Z === RUN TestIsFluxResource 2023-06-05T14:17:02.8074324Z --- PASS: TestIsFluxResource (0.00s) 2023-06-05T14:17:02.8074689Z PASS 2023-06-05T14:17:02.8075033Z ================================================================================ 2023-06-05T14:17:03.2636128Z INFO: From Testing //pkg/f8n/warehouse/oci/cache/providers/disk:disk_test: 2023-06-05T14:17:03.2636813Z ==================== Test output for //pkg/f8n/warehouse/oci/cache/providers/disk:disk_test: 2023-06-05T14:17:03.2637260Z === RUN TestNew 2023-06-05T14:17:03.2637709Z --- PASS: TestNew (0.00s) 2023-06-05T14:17:03.2638077Z === RUN TestCache 2023-06-05T14:17:03.2638346Z === PAUSE TestCache 2023-06-05T14:17:03.2638540Z === RUN TestPurge 2023-06-05T14:17:03.2638732Z === PAUSE TestPurge 2023-06-05T14:17:03.2638918Z === CONT TestCache 2023-06-05T14:17:03.2639091Z === CONT TestPurge 2023-06-05T14:17:03.2639286Z === RUN TestCache/Add 2023-06-05T14:17:03.2639483Z === RUN TestCache/Get 2023-06-05T14:17:03.2639683Z === RUN TestCache/Exists 2023-06-05T14:17:03.2639925Z --- PASS: TestCache (0.02s) 2023-06-05T14:17:03.2641206Z --- PASS: TestCache/Add (0.02s) 2023-06-05T14:17:03.2641959Z --- PASS: TestCache/Get (0.00s) 2023-06-05T14:17:03.2642254Z --- PASS: TestCache/Exists (0.00s) 2023-06-05T14:17:03.2642509Z --- PASS: TestPurge (0.05s) 2023-06-05T14:17:03.2642854Z PASS 2023-06-05T14:17:03.2643177Z ================================================================================ 2023-06-05T14:17:03.5793980Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/osuserpasswordupdater:osuserpasswordupdater_test: 2023-06-05T14:17:03.5794764Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/osuserpasswordupdater:osuserpasswordupdater_test: 2023-06-05T14:17:03.5795262Z === RUN TestDoNotReconcileWrongTarget 2023-06-05T14:17:03.5795893Z --- PASS: TestDoNotReconcileWrongTarget (0.00s) 2023-06-05T14:17:03.5796354Z === RUN TestDoNotReconcileWithoutHostIEN 2023-06-05T14:17:03.5796992Z --- PASS: TestDoNotReconcileWithoutHostIEN (0.01s) 2023-06-05T14:17:03.5797315Z === RUN TestReturnErrorOnGetRootPathError 2023-06-05T14:17:03.5797638Z [LaunchDarkly] 2023/06/05 14:17:03 INFO: Starting LaunchDarkly client 6.0.3 2023-06-05T14:17:03.5797993Z [LaunchDarkly] 2023/06/05 14:17:03 INFO: Waiting up to 10000 milliseconds for LaunchDarkly client to start... 2023-06-05T14:17:03.5798350Z [LaunchDarkly] 2023/06/05 14:17:03 INFO: Initialized LaunchDarkly client 2023-06-05T14:17:03.5798726Z --- PASS: TestReturnErrorOnGetRootPathError (0.00s) 2023-06-05T14:17:03.5799032Z === RUN TestUpdateShadowFileFromSecret 2023-06-05T14:17:03.5799490Z --- PASS: TestUpdateShadowFileFromSecret (0.00s) 2023-06-05T14:17:03.5799869Z === RUN TestInvalidSerializationReturnsError 2023-06-05T14:17:03.5800251Z --- PASS: TestInvalidSerializationReturnsError (0.00s) 2023-06-05T14:17:03.5800555Z === RUN TestInvalidSecretsReturnErrors 2023-06-05T14:17:03.5800879Z --- PASS: TestInvalidSecretsReturnErrors (0.00s) 2023-06-05T14:17:03.5801168Z === RUN TestUpdateShadowFile 2023-06-05T14:17:03.5801614Z --- PASS: TestUpdateShadowFile (0.00s) 2023-06-05T14:17:03.5802069Z === RUN TestDoNotUpdateInvalidShadowFile 2023-06-05T14:17:03.5802881Z --- PASS: TestDoNotUpdateInvalidShadowFile (0.00s) 2023-06-05T14:17:03.5803371Z === RUN TestUpdateShadowFileFailedFileHandling 2023-06-05T14:17:03.5803764Z --- PASS: TestUpdateShadowFileFailedFileHandling (0.00s) 2023-06-05T14:17:03.5804096Z === RUN TestFindShadowFileLineIndexToUpdate 2023-06-05T14:17:03.5804466Z --- PASS: TestFindShadowFileLineIndexToUpdate (0.00s) 2023-06-05T14:17:03.5804778Z === RUN TestValidateShadowFileEntryAtLineIndex 2023-06-05T14:17:03.5805163Z --- PASS: TestValidateShadowFileEntryAtLineIndex (0.00s) 2023-06-05T14:17:03.5805487Z === RUN TestUpdateShadowFileEntryAtLineIndex 2023-06-05T14:17:03.5805916Z --- PASS: TestUpdateShadowFileEntryAtLineIndex (0.00s) 2023-06-05T14:17:03.5806183Z === RUN TestToShadowFileLine 2023-06-05T14:17:03.5806464Z --- PASS: TestToShadowFileLine (0.00s) 2023-06-05T14:17:03.5806722Z === RUN TestValidateShadowFileData 2023-06-05T14:17:03.5807038Z --- PASS: TestValidateShadowFileData (0.00s) 2023-06-05T14:17:03.5807261Z PASS 2023-06-05T14:17:03.5807468Z ================================================================================ 2023-06-05T14:17:03.6298686Z INFO: From Testing //pkg/sds/lib/remotecli/msgsvc:msgsvc_test: 2023-06-05T14:17:03.6299384Z ==================== Test output for //pkg/sds/lib/remotecli/msgsvc:msgsvc_test: 2023-06-05T14:17:03.6299903Z === RUN TestSubscriptionFilter 2023-06-05T14:17:03.6300718Z === RUN TestSubscriptionFilter/Elements_don't_match 2023-06-05T14:17:03.6301142Z === RUN TestSubscriptionFilter/Empty_elements 2023-06-05T14:17:03.6301585Z === RUN TestSubscriptionFilter/Key_not_in_attr 2023-06-05T14:17:03.6302065Z === RUN TestSubscriptionFilter/Key_not_in_attr_and_empty 2023-06-05T14:17:03.6302548Z === RUN TestSubscriptionFilter/Empty_attr 2023-06-05T14:17:03.6303028Z === RUN TestSubscriptionFilter/Empty_filter 2023-06-05T14:17:03.6303333Z === RUN TestSubscriptionFilter/Nil_Filter 2023-06-05T14:17:03.6303598Z === RUN TestSubscriptionFilter/Success 2023-06-05T14:17:03.6304002Z --- PASS: TestSubscriptionFilter (0.00s) 2023-06-05T14:17:03.6304357Z --- PASS: TestSubscriptionFilter/Elements_don't_match (0.00s) 2023-06-05T14:17:03.6304753Z --- PASS: TestSubscriptionFilter/Empty_elements (0.00s) 2023-06-05T14:17:03.6305130Z --- PASS: TestSubscriptionFilter/Key_not_in_attr (0.00s) 2023-06-05T14:17:03.6305517Z --- PASS: TestSubscriptionFilter/Key_not_in_attr_and_empty (0.00s) 2023-06-05T14:17:03.6305895Z --- PASS: TestSubscriptionFilter/Empty_attr (0.00s) 2023-06-05T14:17:03.6306237Z --- PASS: TestSubscriptionFilter/Empty_filter (0.00s) 2023-06-05T14:17:03.6306587Z --- PASS: TestSubscriptionFilter/Nil_Filter (0.00s) 2023-06-05T14:17:03.6306940Z --- PASS: TestSubscriptionFilter/Success (0.00s) 2023-06-05T14:17:03.6307184Z === RUN TestPublish 2023-06-05T14:17:03.6307437Z --- PASS: TestPublish (0.00s) 2023-06-05T14:17:03.6307760Z === RUN TestPublishCaching 2023-06-05T14:17:03.6308100Z === RUN TestPublishCaching/Initial_Entry 2023-06-05T14:17:03.6308387Z === RUN TestPublishCaching/Add_Topic_with_new_topic_ID 2023-06-05T14:17:03.6308669Z === RUN TestPublishCaching/Add_Topic_with_new_project_ID 2023-06-05T14:17:03.6308965Z === RUN TestPublishCaching/Reuse_entry_from_cache 2023-06-05T14:17:03.6309286Z --- PASS: TestPublishCaching (0.00s) 2023-06-05T14:17:03.6309614Z --- PASS: TestPublishCaching/Initial_Entry (0.00s) 2023-06-05T14:17:03.6309973Z --- PASS: TestPublishCaching/Add_Topic_with_new_topic_ID (0.00s) 2023-06-05T14:17:03.6310427Z --- PASS: TestPublishCaching/Add_Topic_with_new_project_ID (0.00s) 2023-06-05T14:17:03.6310812Z --- PASS: TestPublishCaching/Reuse_entry_from_cache (0.00s) 2023-06-05T14:17:03.6311211Z === RUN TestStopPublishing 2023-06-05T14:17:03.6311501Z --- PASS: TestStopPublishing (0.00s) 2023-06-05T14:17:03.6311760Z === RUN TestFilterSubscribeSkip 2023-06-05T14:17:03.6312065Z --- PASS: TestFilterSubscribeSkip (0.00s) 2023-06-05T14:17:03.6312312Z === RUN TestFilterSubscribe 2023-06-05T14:17:03.6312946Z --- PASS: TestFilterSubscribe (0.00s) 2023-06-05T14:17:03.6313187Z === RUN TestInvalidMessageNack 2023-06-05T14:17:03.6313635Z --- PASS: TestInvalidMessageNack (0.00s) 2023-06-05T14:17:03.6313892Z PASS 2023-06-05T14:17:03.6314205Z ================================================================================ 2023-06-05T14:17:04.0058391Z INFO: From Testing //pkg/lib/gcp/cloudsql:cloudsql_test: 2023-06-05T14:17:04.0058824Z ==================== Test output for //pkg/lib/gcp/cloudsql:cloudsql_test: 2023-06-05T14:17:04.0059138Z === RUN TestValidationGCP 2023-06-05T14:17:04.0059575Z --- PASS: TestValidationGCP (0.00s) 2023-06-05T14:17:04.0059825Z === RUN TestValidationPostgres 2023-06-05T14:17:04.0060149Z --- PASS: TestValidationPostgres (0.00s) 2023-06-05T14:17:04.0060476Z === RUN TestConfigurationGCP 2023-06-05T14:17:04.0060887Z --- PASS: TestConfigurationGCP (0.26s) 2023-06-05T14:17:04.0061148Z === RUN TestConfigurationPostgres 2023-06-05T14:17:04.0061492Z --- PASS: TestConfigurationPostgres (0.00s) 2023-06-05T14:17:04.0061700Z PASS 2023-06-05T14:17:04.0061937Z ================================================================================ 2023-06-05T14:17:05.3666805Z INFO: From Testing //pkg/f8n/devinfra/jack:jack_test: 2023-06-05T14:17:05.3667459Z ==================== Test output for //pkg/f8n/devinfra/jack:jack_test: 2023-06-05T14:17:05.3667899Z === RUN TestConfig 2023-06-05T14:17:05.3668357Z --- PASS: TestConfig (0.00s) 2023-06-05T14:17:05.3668786Z === RUN TestAllPluginsEnabled 2023-06-05T14:17:05.3669252Z {"severity":"info","ts":1685974625.2535667,"message":"all plugins have been enabled"} 2023-06-05T14:17:05.3673877Z {"severity":"info","ts":1685974625.2543814,"message":"plugins config","plugins":{"ncr-test-retail/edge-testmap":{"jack":{},"epics":{},"issues":{},"pr":{},"project":{"ids":[2,3,4]},"uploadjob":[{"Name":"jack testing","Bucket":"jack-bucket"}],"draftpr":{},"size":{},"enabled":["milestone_report","project_pruning","webhook_events","deleted_issue","list","size","task","triage_parent","epics","project","changelog","enforce_milestone","pr","triage_issue","pr_type","uploadjob","approved_label"],"changelog":{"ChangeChannel":"","CommitChannel":""}},"ncr-test-retail/edge-testmap-dos":{"jack":{},"epics":{},"issues":{},"pr":{},"project":{"ids":[5]},"draftpr":{},"size":{},"enabled":["approved_label","enforce_milestone","pr","triage_issue","pr_type","uploadjob","deleted_issue","milestone_report","project_pruning","webhook_events","epics","list","size","task","triage_parent","changelog","project"],"changelog":{"ChangeChannel":"","CommitChannel":""}},"ncr-test-retail/edge-testmap-tres":{"jack":{},"epics":{},"issues":{},"pr":{},"project":{"ids":[6]},"uploadjob":[{"Name":"testing","Bucket":"jack-testing-bucket-prod"}],"draftpr":{},"size":{},"enabled":["pr","triage_issue","pr_type","uploadjob","approved_label","enforce_milestone","project_pruning","webhook_events","deleted_issue","milestone_report","size","task","triage_parent","epics","list","changelog","project"],"changelog":{"ChangeChannel":"","CommitChannel":""}}}} 2023-06-05T14:17:05.3678272Z --- PASS: TestAllPluginsEnabled (0.00s) 2023-06-05T14:17:05.3678773Z === RUN TestPlugins 2023-06-05T14:17:05.3681523Z {"severity":"info","ts":1685974625.2566261,"message":"plugins config","plugins":{"ncr-test-retail/edge-testmap":{"jack":{},"epics":{},"issues":{},"pr":{},"project":{"ids":[2,3,4]},"uploadjob":[{"Name":"jack testing","Bucket":"jack-bucket"}],"draftpr":{},"size":{},"enabled":["list","size","kind"],"changelog":{"ChangeChannel":"","CommitChannel":""}},"ncr-test-retail/edge-testmap-dos":{"jack":{},"epics":{},"issues":{},"pr":{},"project":{"ids":[5]},"draftpr":{},"size":{},"enabled":["size"],"changelog":{"ChangeChannel":"","CommitChannel":""}},"ncr-test-retail/edge-testmap-tres":{"jack":{},"epics":{},"issues":{},"pr":{},"project":{"ids":[6]},"uploadjob":[{"Name":"testing","Bucket":"jack-testing-bucket-prod"}],"draftpr":{},"size":{},"changelog":{"ChangeChannel":"","CommitChannel":""}}}} 2023-06-05T14:17:05.3683567Z --- PASS: TestPlugins (0.00s) 2023-06-05T14:17:05.3683943Z === RUN TestJack 2023-06-05T14:17:05.3684293Z jack_test.go:23: 2023-06-05T14:17:05.3684935Z --- SKIP: TestJack (0.00s) 2023-06-05T14:17:05.3685255Z PASS 2023-06-05T14:17:05.3685622Z ================================================================================ 2023-06-05T14:17:05.9296798Z INFO: From Testing //pkg/edge/gitops/fns/addcluster:addcluster_test: 2023-06-05T14:17:05.9297508Z ==================== Test output for //pkg/edge/gitops/fns/addcluster:addcluster_test: 2023-06-05T14:17:05.9298053Z === RUN TestAddCluster 2023-06-05T14:17:05.9298645Z === RUN TestAddCluster/testdata/edge-cluster 2023-06-05T14:17:05.9299329Z === RUN TestAddCluster/testdata/tenant-cluster 2023-06-05T14:17:05.9299916Z --- PASS: TestAddCluster (0.01s) 2023-06-05T14:17:05.9300570Z --- PASS: TestAddCluster/testdata/edge-cluster (0.00s) 2023-06-05T14:17:05.9301394Z --- PASS: TestAddCluster/testdata/tenant-cluster (0.00s) 2023-06-05T14:17:05.9301980Z === RUN TestYamlTrimSpec 2023-06-05T14:17:05.9302501Z addcluster_test.go:188: Yaml before spec is trimmed: metadata: 2023-06-05T14:17:05.9303051Z annotations: 2023-06-05T14:17:05.9303651Z internal.config.kubernetes.io/path: manifests/clusterregistry/edge/clusters/Foo.yaml 2023-06-05T14:17:05.9304266Z creationTimestamp: null 2023-06-05T14:17:05.9304660Z labels: 2023-06-05T14:17:05.9305071Z cluster.edge.ncr.com: Foo 2023-06-05T14:17:05.9305546Z cluster.edge.ncr.com/type: gke 2023-06-05T14:17:05.9305982Z fleet.edge.ncr.com: Bar 2023-06-05T14:17:05.9306414Z tenant.edge.ncr.com: "" 2023-06-05T14:17:05.9306837Z name: e1bgfxrry42b 2023-06-05T14:17:05.9307225Z spec: 2023-06-05T14:17:05.9307602Z authInfo: {} 2023-06-05T14:17:05.9308032Z kubernetesApiEndpoints: {} 2023-06-05T14:17:05.9308468Z status: {} 2023-06-05T14:17:05.9308840Z kind: Cluster 2023-06-05T14:17:05.9309339Z apiVersion: clusterregistry.k8s.io/v1alpha1 2023-06-05T14:17:05.9309898Z addcluster_test.go:213: Yaml after spec is trimmed: metadata: 2023-06-05T14:17:05.9310416Z annotations: 2023-06-05T14:17:05.9311075Z internal.config.kubernetes.io/path: manifests/clusterregistry/edge/clusters/Foo.yaml 2023-06-05T14:17:05.9311689Z creationTimestamp: null 2023-06-05T14:17:05.9312098Z labels: 2023-06-05T14:17:05.9312490Z cluster.edge.ncr.com: Foo 2023-06-05T14:17:05.9312974Z cluster.edge.ncr.com/type: gke 2023-06-05T14:17:05.9313443Z fleet.edge.ncr.com: Bar 2023-06-05T14:17:05.9313905Z tenant.edge.ncr.com: "" 2023-06-05T14:17:05.9314315Z name: e1bgfxrry42b 2023-06-05T14:17:05.9314720Z status: {} 2023-06-05T14:17:05.9315090Z kind: Cluster 2023-06-05T14:17:05.9315558Z apiVersion: clusterregistry.k8s.io/v1alpha1 2023-06-05T14:17:05.9316281Z --- PASS: TestYamlTrimSpec (0.00s) 2023-06-05T14:17:05.9316805Z === RUN TestConfigValidation 2023-06-05T14:17:05.9317376Z --- PASS: TestConfigValidation (0.00s) 2023-06-05T14:17:05.9317806Z PASS 2023-06-05T14:17:05.9318200Z ================================================================================ 2023-06-05T14:17:07.5821081Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/networking:networking_test: 2023-06-05T14:17:07.5821780Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/networking:networking_test: 2023-06-05T14:17:07.5822274Z === RUN TestGeneratigNetplanConfig 2023-06-05T14:17:07.5823584Z --- PASS: TestGeneratigNetplanConfig (0.00s) 2023-06-05T14:17:07.5824046Z === RUN TestNetplanNoChange 2023-06-05T14:17:07.5824426Z networking_test.go:148: PASS: Read(string) 2023-06-05T14:17:07.5825110Z --- PASS: TestNetplanNoChange (0.00s) 2023-06-05T14:17:07.5825482Z === RUN TestNetplanChanged 2023-06-05T14:17:07.5826508Z {"severity":"info","ts":1685974627.4868908,"message":"Netplan config applied. Deliberately panicking to trigger nodeagent restart"} 2023-06-05T14:17:07.5827178Z networking_test.go:186: Recovered from panic. Error: Deliberately panicking to trigger nodeagent restart 2023-06-05T14:17:07.5827878Z networking_test.go:190: PASS: Read(string) 2023-06-05T14:17:07.5828289Z networking_test.go:190: PASS: Copy(string,string) 2023-06-05T14:17:07.5828863Z networking_test.go:190: PASS: Write(string,mock.AnythingOfTypeArgument,fs.FileMode) 2023-06-05T14:17:07.5829418Z networking_test.go:190: PASS: Rename(string,string) 2023-06-05T14:17:07.5829856Z networking_test.go:191: PASS: NetplanApply() 2023-06-05T14:17:07.5830423Z --- PASS: TestNetplanChanged (0.03s) 2023-06-05T14:17:07.5830832Z === RUN TestNetplanReversion 2023-06-05T14:17:07.5831325Z {"severity":"info","ts":1685974627.4902909,"message":"Failed to apply new network config, reverting original netplan file"} 2023-06-05T14:17:07.5831828Z networking_test.go:234: PASS: Read(string) 2023-06-05T14:17:07.5832243Z networking_test.go:234: PASS: Copy(string,string) 2023-06-05T14:17:07.5832801Z networking_test.go:234: PASS: Write(string,mock.AnythingOfTypeArgument,fs.FileMode) 2023-06-05T14:17:07.5833321Z networking_test.go:234: PASS: Rename(string,string) 2023-06-05T14:17:07.5833678Z networking_test.go:234: PASS: Rename(string,string) 2023-06-05T14:17:07.5834066Z networking_test.go:235: PASS: NetplanApply() 2023-06-05T14:17:07.5834623Z --- PASS: TestNetplanReversion (0.00s) 2023-06-05T14:17:07.5834934Z PASS 2023-06-05T14:17:07.5835224Z ================================================================================ 2023-06-05T14:17:11.6421004Z INFO: From Testing //pkg/edge/bsl-reconciler:bsl-reconciler_test: 2023-06-05T14:17:11.6421728Z ==================== Test output for //pkg/edge/bsl-reconciler:bsl-reconciler_test: 2023-06-05T14:17:11.6422155Z === RUN TestBSLController 2023-06-05T14:17:11.6424224Z {"severity":"error","ts":1685974623.8302424,"message":"An error occurred getting tenants info","logging bsl operator":"temp","error":"all expectations were already fulfilled, call to Query 'SELECT tenant_edge_id, org_id, org_name FROM tenants' with args [] was not expected","stacktrace":"edge-infra.dev/pkg/edge/bsl-reconciler.(*BSL).Reconcile\n\tpkg/edge/bsl-reconciler/bsl_reconciler.go:152\nedge-infra.dev/pkg/edge/bsl-reconciler.TestBSLController\n\tpkg/edge/bsl-reconciler/bsl_reconciler_test.go:85\ntesting.tRunner\n\tGOROOT/src/testing/testing.go:1446"} 2023-06-05T14:17:11.6426186Z {"severity":"info","ts":1685974623.8314226,"message":"Processing organization for org /test_root_org/test-prefix-test-1","logging bsl operator":"temp"} 2023-06-05T14:17:11.6427130Z {"severity":"info","ts":1685974623.8367696,"message":"Organization is successfully setup for org /test_root_org/test-prefix-test-1","logging bsl operator":"temp"} 2023-06-05T14:17:11.6429008Z {"severity":"error","ts":1685974623.8370626,"message":"failed to get bsl edge org","logging bsl operator":"temp","error":"an error occurred","stacktrace":"edge-infra.dev/pkg/edge/bsl-reconciler.(*BSL).Reconcile\n\tpkg/edge/bsl-reconciler/bsl_reconciler.go:240\nedge-infra.dev/pkg/edge/bsl-reconciler.TestBSLController\n\tpkg/edge/bsl-reconciler/bsl_reconciler_test.go:85\ntesting.tRunner\n\tGOROOT/src/testing/testing.go:1446"} 2023-06-05T14:17:11.6430456Z {"severity":"info","ts":1685974623.8371716,"message":"Processing organization for org /test_root_org/test-prefix-test-2","logging bsl operator":"temp"} 2023-06-05T14:17:11.6431422Z {"severity":"info","ts":1685974623.8422008,"message":"Organization is successfully setup for org /test_root_org/test-prefix-test-2","logging bsl operator":"temp"} 2023-06-05T14:17:11.6433540Z {"severity":"error","ts":1685974623.8424678,"message":"failed to get bsl edge org","logging bsl operator":"temp","error":"an error occurred","stacktrace":"edge-infra.dev/pkg/edge/bsl-reconciler.(*BSL).Reconcile\n\tpkg/edge/bsl-reconciler/bsl_reconciler.go:240\nedge-infra.dev/pkg/edge/bsl-reconciler.TestBSLController\n\tpkg/edge/bsl-reconciler/bsl_reconciler_test.go:85\ntesting.tRunner\n\tGOROOT/src/testing/testing.go:1446"} 2023-06-05T14:17:11.6434799Z --- PASS: TestBSLController (0.01s) 2023-06-05T14:17:11.6435488Z === RUN TestBSLControllerWithSQLConnection 2023-06-05T14:17:11.6435980Z The files belonging to this database system will be owned by user "build". 2023-06-05T14:17:11.6436435Z This user must also own the server process. 2023-06-05T14:17:11.6436833Z 2023-06-05T14:17:11.6437197Z The database cluster will be initialized with locale "C.UTF-8". 2023-06-05T14:17:11.6437680Z The default database encoding has accordingly been set to "UTF8". 2023-06-05T14:17:11.6438152Z The default text search configuration will be set to "english". 2023-06-05T14:17:11.6438412Z 2023-06-05T14:17:11.6438561Z Data page checksums are disabled. 2023-06-05T14:17:11.6438779Z 2023-06-05T14:17:11.6439724Z creating directory /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7106/execroot/edge_infra/_tmp/01edd215de0532de5b04d7de4189cf3a/edge-infra-lighthouse-sql-test-3803699647/runtime/data ... ok 2023-06-05T14:17:11.6440475Z creating subdirectories ... ok 2023-06-05T14:17:11.6440920Z selecting dynamic shared memory implementation ... posix 2023-06-05T14:17:11.6441332Z selecting default max_connections ... 100 2023-06-05T14:17:11.6441706Z selecting default shared_buffers ... 128MB 2023-06-05T14:17:11.6442088Z selecting default time zone ... UTC 2023-06-05T14:17:11.6442448Z creating configuration files ... ok 2023-06-05T14:17:11.6442805Z running bootstrap script ... ok 2023-06-05T14:17:11.6443337Z performing post-bootstrap initialization ... ok 2023-06-05T14:17:11.6443703Z syncing data to disk ... ok 2023-06-05T14:17:11.6443906Z 2023-06-05T14:17:11.6444090Z Success. You can now start the database server using: 2023-06-05T14:17:11.6444348Z 2023-06-05T14:17:11.6445995Z /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7106/execroot/edge_infra/_tmp/01edd215de0532de5b04d7de4189cf3a/edge-infra-lighthouse-sql-test-3803699647/bin/pg_ctl -D /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7106/execroot/edge_infra/_tmp/01edd215de0532de5b04d7de4189cf3a/edge-infra-lighthouse-sql-test-3803699647/runtime/data -l logfile start 2023-06-05T14:17:11.6446963Z 2023-06-05T14:17:11.6447648Z waiting for server to start....2023-06-05 14:17:08.440 UTC [69772] LOG: starting PostgreSQL 14.2 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 4.8.4-2ubuntu1~14.04.4) 4.8.4, 64-bit 2023-06-05T14:17:11.6448402Z 2023-06-05 14:17:08.441 UTC [69772] LOG: listening on IPv4 address "127.0.0.1", port 7568 2023-06-05T14:17:11.6537547Z 2023-06-05 14:17:08.441 UTC [69772] LOG: could not bind IPv6 address "::1": Cannot assign requested address 2023-06-05T14:17:11.6538335Z 2023-06-05 14:17:08.445 UTC [69772] LOG: listening on Unix socket "/tmp/.s.PGSQL.7568" 2023-06-05T14:17:11.6539038Z 2023-06-05 14:17:08.469 UTC [69777] LOG: database system was shut down at 2023-06-05 14:17:08 UTC 2023-06-05T14:17:11.6539655Z 2023-06-05 14:17:08.478 UTC [69772] LOG: database system is ready to accept connections 2023-06-05T14:17:11.6540041Z done 2023-06-05T14:17:11.6540331Z server started 2023-06-05T14:17:11.6540771Z {"severity":"info","ts":1685974631.2239316,"logger":"test","message":"edge env sql migration completed successfully"} 2023-06-05T14:17:11.6541372Z {"severity":"info","ts":1685974631.325304,"logger":"test","message":"edge env sql seeding completed successfully"} 2023-06-05T14:17:11.6542332Z {"severity":"info","ts":1685974631.3267026,"message":"Processing organization for org /test_root_org/test-prefix-test-1","logging bsl operator":"temp"} 2023-06-05T14:17:11.6543258Z {"severity":"info","ts":1685974631.3307776,"message":"Organization is successfully setup for org /test_root_org/test-prefix-test-1","logging bsl operator":"temp"} 2023-06-05T14:17:11.6545736Z {"severity":"error","ts":1685974631.3309667,"message":"failed to get bsl edge org","logging bsl operator":"temp","error":"an error occurred","stacktrace":"edge-infra.dev/pkg/edge/bsl-reconciler.(*BSL).Reconcile\n\tpkg/edge/bsl-reconciler/bsl_reconciler.go:240\nedge-infra.dev/pkg/edge/bsl-reconciler.TestBSLControllerWithSQLConnection\n\tpkg/edge/bsl-reconciler/bsl_reconciler_test.go:125\ntesting.tRunner\n\tGOROOT/src/testing/testing.go:1446"} 2023-06-05T14:17:11.6547811Z {"severity":"info","ts":1685974631.3310351,"message":"Processing organization for org /test_root_org/test-prefix-test-2","logging bsl operator":"temp"} 2023-06-05T14:17:11.6548781Z {"severity":"info","ts":1685974631.3361168,"message":"Organization is successfully setup for org /test_root_org/test-prefix-test-2","logging bsl operator":"temp"} 2023-06-05T14:17:11.6551405Z {"severity":"error","ts":1685974631.3365202,"message":"failed to get bsl edge org","logging bsl operator":"temp","error":"an error occurred","stacktrace":"edge-infra.dev/pkg/edge/bsl-reconciler.(*BSL).Reconcile\n\tpkg/edge/bsl-reconciler/bsl_reconciler.go:240\nedge-infra.dev/pkg/edge/bsl-reconciler.TestBSLControllerWithSQLConnection\n\tpkg/edge/bsl-reconciler/bsl_reconciler_test.go:125\ntesting.tRunner\n\tGOROOT/src/testing/testing.go:1446"} 2023-06-05T14:17:11.6553116Z waiting for server to shut down...2023-06-05 14:17:11.367 UTC [69772] LOG: received fast shutdown request 2023-06-05T14:17:11.6553722Z .2023-06-05 14:17:11.370 UTC [69772] LOG: aborting any active transactions 2023-06-05T14:17:11.6554336Z 2023-06-05 14:17:11.370 UTC [69837] FATAL: terminating connection due to administrator command 2023-06-05T14:17:11.6555042Z 2023-06-05 14:17:11.378 UTC [69772] LOG: background worker "logical replication launcher" (PID 69785) exited with exit code 1 2023-06-05T14:17:11.6555600Z 2023-06-05 14:17:11.384 UTC [69780] LOG: shutting down 2023-06-05T14:17:11.6556118Z 2023-06-05 14:17:11.495 UTC [69772] LOG: database system is shut down 2023-06-05T14:17:11.6556447Z done 2023-06-05T14:17:11.6556713Z server stopped 2023-06-05T14:17:11.6557238Z --- PASS: TestBSLControllerWithSQLConnection (7.73s) 2023-06-05T14:17:11.6557636Z === RUN TestGetEdgeOrgs 2023-06-05T14:17:11.6558046Z --- PASS: TestGetEdgeOrgs (0.00s) 2023-06-05T14:17:11.6558360Z === RUN TestGetEdgeOrg 2023-06-05T14:17:11.6558756Z --- PASS: TestGetEdgeOrg (0.00s) 2023-06-05T14:17:11.6559096Z === RUN TestCreateEdgeOrgGroups 2023-06-05T14:17:11.6559574Z --- PASS: TestCreateEdgeOrgGroups (0.00s) 2023-06-05T14:17:11.6559977Z === RUN TestAssignEdgeOrgAdminRoles 2023-06-05T14:17:11.6560688Z --- PASS: TestAssignEdgeOrgAdminRoles (0.00s) 2023-06-05T14:17:11.6561146Z === RUN TestAssignEdgeBannerAdminRoles 2023-06-05T14:17:11.6561727Z --- PASS: TestAssignEdgeBannerAdminRoles (0.00s) 2023-06-05T14:17:11.6562284Z === RUN TestAssignEdgeBannerViewerRoles 2023-06-05T14:17:11.6562834Z --- PASS: TestAssignEdgeBannerViewerRoles (0.00s) 2023-06-05T14:17:11.6563298Z === RUN TestCreateBSLUser 2023-06-05T14:17:11.6563766Z --- PASS: TestCreateBSLUser (0.00s) 2023-06-05T14:17:11.6564185Z === RUN TestAssignBSLUserToGroup 2023-06-05T14:17:11.6564689Z --- PASS: TestAssignBSLUserToGroup (0.00s) 2023-06-05T14:17:11.6565092Z === RUN TestCreateBSLUserPassword 2023-06-05T14:17:11.6565642Z --- PASS: TestCreateBSLUserPassword (0.00s) 2023-06-05T14:17:11.6566092Z === RUN TestCreateEnterpriseUnitType 2023-06-05T14:17:11.6566668Z --- PASS: TestCreateEnterpriseUnitType (0.00s) 2023-06-05T14:17:11.6567118Z === RUN TestCreateBSLUserAccessKey 2023-06-05T14:17:11.6567620Z --- PASS: TestCreateBSLUserAccessKey (0.00s) 2023-06-05T14:17:11.6568040Z === RUN TestNewBFFUserRequest 2023-06-05T14:17:11.6568515Z --- PASS: TestNewBFFUserRequest (0.00s) 2023-06-05T14:17:11.6568895Z === RUN TestNewEnterpriseTypeRequest 2023-06-05T14:17:11.6569377Z --- PASS: TestNewEnterpriseTypeRequest (0.00s) 2023-06-05T14:17:11.6569753Z === RUN TestNewEdgeOrgGroupMembership 2023-06-05T14:17:11.6570240Z --- PASS: TestNewEdgeOrgGroupMembership (0.00s) 2023-06-05T14:17:11.6570719Z === RUN TestBFFUserPasswordResetRequest 2023-06-05T14:17:11.6571885Z --- PASS: TestBFFUserPasswordResetRequest (0.00s) 2023-06-05T14:17:11.6572396Z === RUN TestGenerateBFFUserPassword 2023-06-05T14:17:11.6573197Z --- PASS: TestGenerateBFFUserPassword (0.00s) 2023-06-05T14:17:11.6573529Z PASS 2023-06-05T14:17:11.6573885Z ================================================================================ 2023-06-05T14:17:11.9433471Z INFO: From Testing //test/framework/config:config_test: 2023-06-05T14:17:11.9434019Z ==================== Test output for //test/framework/config:config_test: 2023-06-05T14:17:11.9434381Z === RUN TestInt 2023-06-05T14:17:11.9434797Z --- PASS: TestInt (0.00s) 2023-06-05T14:17:11.9435135Z === RUN TestLower 2023-06-05T14:17:11.9435478Z --- PASS: TestLower (0.00s) 2023-06-05T14:17:11.9435786Z === RUN TestPrefix 2023-06-05T14:17:11.9436180Z --- PASS: TestPrefix (0.00s) 2023-06-05T14:17:11.9436497Z === RUN TestRecursion 2023-06-05T14:17:11.9436887Z --- PASS: TestRecursion (0.00s) 2023-06-05T14:17:11.9437193Z === RUN TestPanics 2023-06-05T14:17:11.9437617Z --- PASS: TestPanics (0.00s) 2023-06-05T14:17:11.9437991Z === RUN TestTypes 2023-06-05T14:17:11.9438395Z --- PASS: TestTypes (0.00s) 2023-06-05T14:17:11.9438755Z PASS 2023-06-05T14:17:11.9439117Z ================================================================================ 2023-06-05T14:17:12.3341426Z INFO: From Testing //pkg/edge/api/services:services_test: 2023-06-05T14:17:12.3342062Z ==================== Test output for //pkg/edge/api/services:services_test: 2023-06-05T14:17:12.3342520Z === RUN TestGetActions 2023-06-05T14:17:12.3342910Z === RUN TestGetActions/queryByUsername 2023-06-05T14:17:12.3343380Z === RUN TestGetActions/queryByBannerEdgeID 2023-06-05T14:17:12.3343836Z === RUN TestGetActions/queryByClusterEdgeID 2023-06-05T14:17:12.3344253Z === RUN TestGetActions/queryByBatchID 2023-06-05T14:17:12.3344677Z === RUN TestGetActions/queryByDefaultTenantEdgeID 2023-06-05T14:17:12.3345328Z --- PASS: TestGetActions (0.00s) 2023-06-05T14:17:12.3346013Z --- PASS: TestGetActions/queryByUsername (0.00s) 2023-06-05T14:17:12.3346685Z --- PASS: TestGetActions/queryByBannerEdgeID (0.00s) 2023-06-05T14:17:12.3347458Z --- PASS: TestGetActions/queryByClusterEdgeID (0.00s) 2023-06-05T14:17:12.3348003Z --- PASS: TestGetActions/queryByBatchID (0.00s) 2023-06-05T14:17:12.3348585Z --- PASS: TestGetActions/queryByDefaultTenantEdgeID (0.00s) 2023-06-05T14:17:12.3348989Z === RUN TestCreateAction 2023-06-05T14:17:12.3349378Z --- PASS: TestCreateAction (0.00s) 2023-06-05T14:17:12.3349713Z === RUN TestCreateKustomizations 2023-06-05T14:17:12.3350341Z --- PASS: TestCreateKustomizations (0.00s) 2023-06-05T14:17:12.3350767Z === RUN TestCreateKustomizationsEdgeIDSyncing 2023-06-05T14:17:12.3351359Z --- PASS: TestCreateKustomizationsEdgeIDSyncing (0.00s) 2023-06-05T14:17:12.3351803Z === RUN TestGetInstallManifests 2023-06-05T14:17:12.3352270Z --- PASS: TestGetInstallManifests (3.92s) 2023-06-05T14:17:12.3352671Z === RUN TestCreateBSLSite 2023-06-05T14:17:12.3353040Z getMockBspServer url: /site/v1/sites 2023-06-05T14:17:12.3353481Z --- PASS: TestCreateBSLSite (0.00s) 2023-06-05T14:17:12.3353855Z === RUN TestDoesSiteHaveAttachedCluster 2023-06-05T14:17:12.3354440Z --- PASS: TestDoesSiteHaveAttachedCluster (0.00s) 2023-06-05T14:17:12.3354874Z === RUN TestDeleteBSLSite 2023-06-05T14:17:12.3355339Z getMockBspServer url: /site/v1/sites/test-euid 2023-06-05T14:17:12.3355760Z --- PASS: TestDeleteBSLSite (0.00s) 2023-06-05T14:17:12.3356107Z === RUN TestUpdateBSLSite 2023-06-05T14:17:12.3357146Z getMockBspServer url: /site/v1/sites/site-id 2023-06-05T14:17:12.3357814Z getMockBspServer url: /site/v1/sites/site-id 2023-06-05T14:17:12.3359712Z getMockBspServer url: /site/v1/sites/site-id 2023-06-05T14:17:12.3361657Z getMockBspServer url: /site/v1/sites/site-id 2023-06-05T14:17:12.3363853Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.getMockBspServer.func1 (bsp_site_service_test.go:284) 2023-06-05T14:17:12.3367963Z getMockBspServer url: /site/v1/sites/site-id 2023-06-05T14:17:12.3370281Z --- PASS: TestUpdateBSLSite (0.00s) 2023-06-05T14:17:12.3372096Z === RUN TestBSLSiteService_GetOrCreateSite 2023-06-05T14:17:12.3374531Z getMockBspServer url: /site/v1/sites/test-euid-not-exist 2023-06-05T14:17:12.3376377Z getMockBspServer url: /site/v1/sites/test-euid 2023-06-05T14:17:12.3378147Z getMockBspServer url: /site/v1/sites/test-euid 2023-06-05T14:17:12.3379834Z getMockBspServer url: /site/v1/sites 2023-06-05T14:17:12.3381599Z --- PASS: TestBSLSiteService_GetOrCreateSite (0.00s) 2023-06-05T14:17:12.3383304Z === RUN TestCreateClusterConfig 2023-06-05T14:17:12.3385145Z --- PASS: TestCreateClusterConfig (0.00s) 2023-06-05T14:17:12.3386838Z === RUN TestCreateClusterConfigKeyError 2023-06-05T14:17:12.3388673Z --- PASS: TestCreateClusterConfigKeyError (0.00s) 2023-06-05T14:17:12.3390418Z === RUN TestUpdateClusterConfig 2023-06-05T14:17:12.3392173Z --- PASS: TestUpdateClusterConfig (0.00s) 2023-06-05T14:17:12.3393804Z === RUN TestGetClusterConfig 2023-06-05T14:17:12.3395673Z --- PASS: TestGetClusterConfig (0.00s) 2023-06-05T14:17:12.3397305Z === RUN TestGetEmptyClusterConfig 2023-06-05T14:17:12.3399034Z --- PASS: TestGetEmptyClusterConfig (0.00s) 2023-06-05T14:17:12.3400683Z === RUN TestGetSecretName 2023-06-05T14:17:12.3402364Z --- PASS: TestGetSecretName (0.00s) 2023-06-05T14:17:12.3404019Z === RUN TestGCPService_AddSecret 2023-06-05T14:17:12.3405875Z --- PASS: TestGCPService_AddSecret (0.00s) 2023-06-05T14:17:12.3407561Z === RUN TestMapSecretManagerToModelEmptySecret 2023-06-05T14:17:12.3409410Z --- PASS: TestMapSecretManagerToModelEmptySecret (0.00s) 2023-06-05T14:17:12.3411157Z === RUN TestGetClientName 2023-06-05T14:17:12.3413131Z --- PASS: TestGetClientName (0.00s) 2023-06-05T14:17:12.3414965Z === RUN TestGetClientNameEmptyString 2023-06-05T14:17:12.3416949Z --- PASS: TestGetClientNameEmptyString (0.00s) 2023-06-05T14:17:12.3453901Z === RUN TestGetClientNameNil 2023-06-05T14:17:12.3456342Z --- PASS: TestGetClientNameNil (0.00s) 2023-06-05T14:17:12.3458369Z === RUN TestGetConfigForClusterClusterCaCertificateNotReady 2023-06-05T14:17:12.3460622Z --- PASS: TestGetConfigForClusterClusterCaCertificateNotReady (0.00s) 2023-06-05T14:17:12.3462748Z === RUN TestGetConfigForClusterHostNotReady 2023-06-05T14:17:12.3464809Z --- PASS: TestGetConfigForClusterHostNotReady (0.00s) 2023-06-05T14:17:12.3466576Z === RUN TestGetConfigForClusterDecodeError 2023-06-05T14:17:12.3468449Z --- PASS: TestGetConfigForClusterDecodeError (0.00s) 2023-06-05T14:17:12.3470224Z === RUN TestGetConfigForCluster 2023-06-05T14:17:12.3471995Z --- PASS: TestGetConfigForCluster (0.00s) 2023-06-05T14:17:12.3572611Z === RUN TestHelmService_CreateAndDeleteBannerHelmRepo 2023-06-05T14:17:12.3573135Z obj kind not supported 2023-06-05T14:17:12.3573498Z 2023/06/05 14:17:12.059774 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3574069Z obj kind not supported 2023-06-05T14:17:12.3574923Z --- PASS: TestHelmService_CreateAndDeleteBannerHelmRepo (0.04s) 2023-06-05T14:17:12.3575505Z === RUN TestHelmService_GetHelmRepositories 2023-06-05T14:17:12.3575992Z --- PASS: TestHelmService_GetHelmRepositories (0.00s) 2023-06-05T14:17:12.3576375Z === RUN TestHelmService_GetHelmReleases 2023-06-05T14:17:12.3576836Z 2023/06/05 14:17:12.060977 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3577373Z --- PASS: TestHelmService_GetHelmReleases (0.00s) 2023-06-05T14:17:12.3577783Z === RUN TestHelmService_GetHelmReleasesStatus 2023-06-05T14:17:12.3578252Z --- PASS: TestHelmService_GetHelmReleasesStatus (0.00s) 2023-06-05T14:17:12.3578635Z === RUN TestHelmService_UpdateHelmRelease 2023-06-05T14:17:12.3579057Z 2023/06/05 14:17:12.064826 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3579443Z obj kind not supported Namespace 2023-06-05T14:17:12.3579758Z obj kind not supported Namespace 2023-06-05T14:17:12.3580226Z --- PASS: TestHelmService_UpdateHelmRelease (0.05s) 2023-06-05T14:17:12.3581130Z === RUN TestSendExternalSecretToChariot 2023-06-05T14:17:12.3581658Z --- PASS: TestSendExternalSecretToChariot (0.02s) 2023-06-05T14:17:12.3582355Z === RUN TestGenerateHelmReleaseExternalSecretsWithExternalSecrets 2023-06-05T14:17:12.3582794Z [0xc000b24c60 0xc000b24cc0] 2023-06-05T14:17:12.3583082Z [0xc000b24d80 0xc000b24de0] 2023-06-05T14:17:12.3583701Z --- PASS: TestGenerateHelmReleaseExternalSecretsWithExternalSecrets (0.00s) 2023-06-05T14:17:12.3584230Z === RUN TestHelmService_CreateHelmRelease 2023-06-05T14:17:12.3584722Z 2023/06/05 14:17:12.134574 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3585199Z 2023/06/05 14:17:12.157895 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3585588Z obj kind not supported Namespace 2023-06-05T14:17:12.3586078Z --- PASS: TestHelmService_CreateHelmRelease (0.02s) 2023-06-05T14:17:12.3586450Z === RUN TestHelmService_GetHelmCharts 2023-06-05T14:17:12.3586887Z 2023/06/05 14:17:12.160315 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3587397Z --- PASS: TestHelmService_GetHelmCharts (0.00s) 2023-06-05T14:17:12.3587803Z === RUN TestHelmService_GetHelmChartContents 2023-06-05T14:17:12.3588291Z --- PASS: TestHelmService_GetHelmChartContents (0.00s) 2023-06-05T14:17:12.3588681Z === RUN TestHelmService_GetHelmChartVersion 2023-06-05T14:17:12.3589109Z 2023/06/05 14:17:12.162476 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3589640Z --- PASS: TestHelmService_GetHelmChartVersion (0.00s) 2023-06-05T14:17:12.3590037Z === RUN TestHelmService_DeleteHelmRelease 2023-06-05T14:17:12.3590491Z --- PASS: TestHelmService_DeleteHelmRelease (0.00s) 2023-06-05T14:17:12.3590902Z === RUN TestHelmService_GetDefaultConfigSchema 2023-06-05T14:17:12.3591332Z 2023/06/05 14:17:12.165245 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3591803Z 2023/06/05 14:17:12.165827 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3592260Z 2023/06/05 14:17:12.166950 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3592804Z --- PASS: TestHelmService_GetDefaultConfigSchema (0.00s) 2023-06-05T14:17:12.3593230Z === RUN TestHelmService_GetHelmRepositoryInfo 2023-06-05T14:17:12.3593649Z 2023/06/05 14:17:12.168475 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:12.3594181Z --- PASS: TestHelmService_GetHelmRepositoryInfo (0.00s) 2023-06-05T14:17:12.3594626Z === RUN TestHelmService_GetHelmWorkloads 2023-06-05T14:17:12.3595081Z === RUN TestHelmService_GetHelmWorkloads/GetHelmWorkloadsByClusterEdgeID 2023-06-05T14:17:12.3595637Z --- PASS: TestHelmService_GetHelmWorkloads (0.00s) 2023-06-05T14:17:12.3596261Z --- PASS: TestHelmService_GetHelmWorkloads/GetHelmWorkloadsByClusterEdgeID (0.00s) 2023-06-05T14:17:12.3596750Z === RUN TestHelmService_GetAttachedHelmSecrets 2023-06-05T14:17:12.3597247Z --- PASS: TestHelmService_GetAttachedHelmSecrets (0.00s) 2023-06-05T14:17:12.3597677Z === RUN TestHelmService_GetClusterHelmWorkloads 2023-06-05T14:17:12.3598196Z --- PASS: TestHelmService_GetClusterHelmWorkloads (0.00s) 2023-06-05T14:17:12.3598615Z === RUN TestHelmService_checkNamespaceToDelete 2023-06-05T14:17:12.3599040Z === RUN TestHelmService_checkNamespaceToDelete/deleteNamespace 2023-06-05T14:17:12.3599524Z === RUN TestHelmService_checkNamespaceToDelete/notDeleteNamespace 2023-06-05T14:17:12.3600084Z --- PASS: TestHelmService_checkNamespaceToDelete (0.00s) 2023-06-05T14:17:12.3600680Z --- PASS: TestHelmService_checkNamespaceToDelete/deleteNamespace (0.00s) 2023-06-05T14:17:12.3601338Z --- PASS: TestHelmService_checkNamespaceToDelete/notDeleteNamespace (0.00s) 2023-06-05T14:17:12.3601837Z === RUN TestHelmService_addSecretsToDeleteToChariotMessage 2023-06-05T14:17:12.3602335Z === RUN TestHelmService_addSecretsToDeleteToChariotMessage/oneSecret 2023-06-05T14:17:12.3603169Z === RUN TestHelmService_addSecretsToDeleteToChariotMessage/twoSecrets 2023-06-05T14:17:12.3603759Z === RUN TestHelmService_addSecretsToDeleteToChariotMessage/twoSecretsBothUsed 2023-06-05T14:17:12.3604608Z === RUN TestHelmService_addSecretsToDeleteToChariotMessage/twoSecretsBothUsed#01 2023-06-05T14:17:12.3605385Z --- PASS: TestHelmService_addSecretsToDeleteToChariotMessage (0.00s) 2023-06-05T14:17:12.3606085Z --- PASS: TestHelmService_addSecretsToDeleteToChariotMessage/oneSecret (0.00s) 2023-06-05T14:17:12.3606820Z --- PASS: TestHelmService_addSecretsToDeleteToChariotMessage/twoSecrets (0.00s) 2023-06-05T14:17:12.3607591Z --- PASS: TestHelmService_addSecretsToDeleteToChariotMessage/twoSecretsBothUsed (0.00s) 2023-06-05T14:17:12.3608352Z --- PASS: TestHelmService_addSecretsToDeleteToChariotMessage/twoSecretsBothUsed#01 (0.00s) 2023-06-05T14:17:12.3608847Z === RUN TestParseRepoURLYaml 2023-06-05T14:17:12.3609297Z --- PASS: TestParseRepoURLYaml (0.00s) 2023-06-05T14:17:12.3609704Z === RUN TestCheckHelmURLError403Forbidden 2023-06-05T14:17:12.3610258Z --- PASS: TestCheckHelmURLError403Forbidden (0.00s) 2023-06-05T14:17:12.3610651Z === RUN TestCheckHelmURLError 2023-06-05T14:17:12.3611085Z --- PASS: TestCheckHelmURLError (0.00s) 2023-06-05T14:17:12.3614121Z === RUN TestGetHelmSecretData 2023-06-05T14:17:12.3614857Z --- PASS: TestGetHelmSecretData (0.00s) 2023-06-05T14:17:12.3615238Z === RUN TestDeleteHelmReleaseSQLEntry 2023-06-05T14:17:12.3617229Z --- PASS: TestDeleteHelmReleaseSQLEntry (0.00s) 2023-06-05T14:17:12.3617809Z === RUN TestUpdateHelmReleaseSQLEntry 2023-06-05T14:17:12.3618502Z --- PASS: TestUpdateHelmReleaseSQLEntry (0.00s) 2023-06-05T14:17:12.3618927Z === RUN TestCreatedHelmReleaseSQLEntry 2023-06-05T14:17:12.3619445Z --- PASS: TestCreatedHelmReleaseSQLEntry (0.00s) 2023-06-05T14:17:12.3619853Z === RUN TestCreateServiceAccount 2023-06-05T14:17:12.3620324Z --- PASS: TestCreateServiceAccount (0.01s) 2023-06-05T14:17:12.3620689Z === RUN TestDeleteServiceAccount 2023-06-05T14:17:12.3621171Z --- PASS: TestDeleteServiceAccount (0.00s) 2023-06-05T14:17:12.3621567Z === RUN TestCreatePolicyBinding 2023-06-05T14:17:12.3622026Z --- PASS: TestCreatePolicyBinding (0.00s) 2023-06-05T14:17:12.3622421Z === RUN TestDeletePolicyBinding 2023-06-05T14:17:12.3622846Z --- PASS: TestDeletePolicyBinding (0.00s) 2023-06-05T14:17:12.3623212Z === RUN TestCreateIAMRoles 2023-06-05T14:17:12.3623637Z --- PASS: TestCreateIAMRoles (0.00s) 2023-06-05T14:17:12.3623979Z === RUN TestDeleteLabelSQLEntry 2023-06-05T14:17:12.3624415Z --- PASS: TestDeleteLabelSQLEntry (0.00s) 2023-06-05T14:17:12.3624900Z === RUN TestDeleteClusterLabelSQLEntry 2023-06-05T14:17:12.3625404Z --- PASS: TestDeleteClusterLabelSQLEntry (0.00s) 2023-06-05T14:17:12.3625867Z === RUN TestLabelService_CreateClusterLabelSQLEntry 2023-06-05T14:17:12.3626430Z --- PASS: TestLabelService_CreateClusterLabelSQLEntry (0.00s) 2023-06-05T14:17:12.3626913Z === RUN TestLabelService_CreateClusterLabels 2023-06-05T14:17:12.3627648Z {"level":"error","error":"error creating cluster label","time":"2023-06-05T14:17:12Z","message":"error creating cluster label: 123457"} 2023-06-05T14:17:12.3628914Z {"level":"error","error":"call to Rollback transaction, was not expected, next expectation is: ExpectedBegin => expecting database transaction Begin","time":"2023-06-05T14:17:12Z","message":"error rolling back cluster label creation: 123457"} 2023-06-05T14:17:12.3629744Z --- PASS: TestLabelService_CreateClusterLabels (0.00s) 2023-06-05T14:17:12.3630136Z === RUN TestGetClusterLabelSQLEntry 2023-06-05T14:17:12.3630616Z --- PASS: TestGetClusterLabelSQLEntry (0.00s) 2023-06-05T14:17:12.3630988Z === RUN TestCreateLabelSQLEntry 2023-06-05T14:17:12.3631413Z --- PASS: TestCreateLabelSQLEntry (0.00s) 2023-06-05T14:17:12.3631790Z === RUN TestUpdateLabelSQLEntry 2023-06-05T14:17:12.3632237Z --- PASS: TestUpdateLabelSQLEntry (0.00s) 2023-06-05T14:17:12.3632606Z === RUN TestGetLabelSQLEntry 2023-06-05T14:17:12.3633020Z --- PASS: TestGetLabelSQLEntry (0.00s) 2023-06-05T14:17:12.3633704Z === RUN TestGetLabelTypes 2023-06-05T14:17:12.3634115Z --- PASS: TestGetLabelTypes (0.00s) 2023-06-05T14:17:12.3634730Z === RUN TestGetLabelTypesNoBanner 2023-06-05T14:17:12.3635229Z --- PASS: TestGetLabelTypesNoBanner (0.00s) 2023-06-05T14:17:12.3635591Z === RUN TestGetLabel 2023-06-05T14:17:12.3635977Z --- PASS: TestGetLabel (0.00s) 2023-06-05T14:17:12.3636327Z === RUN TestGetLabelTenant 2023-06-05T14:17:12.3636759Z --- PASS: TestGetLabelTenant (0.00s) 2023-06-05T14:17:12.3637121Z === RUN TestBannerSQLEntry 2023-06-05T14:17:12.3637528Z --- PASS: TestBannerSQLEntry (0.00s) 2023-06-05T14:17:12.3637874Z === RUN TestGetPathEntry 2023-06-05T14:17:12.3638312Z --- PASS: TestGetPathEntry (0.00s) 2023-06-05T14:17:12.3638697Z === RUN TestUpdateBannerSQLEntry 2023-06-05T14:17:12.3639130Z --- PASS: TestUpdateBannerSQLEntry (0.00s) 2023-06-05T14:17:12.3639513Z === RUN TestCreateBannerCr 2023-06-05T14:17:12.3639962Z --- PASS: TestCreateBannerCr (0.00s) 2023-06-05T14:17:12.3640345Z === RUN TestBannerProjectID 2023-06-05T14:17:12.3640757Z --- PASS: TestBannerProjectID (0.00s) 2023-06-05T14:17:12.3641135Z === RUN TestBannerFromEdgeID 2023-06-05T14:17:12.3641591Z --- PASS: TestBannerFromEdgeID (0.00s) 2023-06-05T14:17:12.3641969Z === RUN TestGetBannerTypeFromID 2023-06-05T14:17:12.3642422Z --- PASS: TestGetBannerTypeFromID (0.00s) 2023-06-05T14:17:12.3642829Z === RUN TestGetBannerTypeFromUUID 2023-06-05T14:17:12.3643315Z --- PASS: TestGetBannerTypeFromUUID (0.00s) 2023-06-05T14:17:12.3643672Z === RUN TestGetBannerTenantInfo 2023-06-05T14:17:12.3644144Z --- PASS: TestGetBannerTenantInfo (0.00s) 2023-06-05T14:17:12.3644596Z === RUN TestGetBannerInfoNoBanner 2023-06-05T14:17:12.3645086Z --- PASS: TestGetBannerInfoNoBanner (0.00s) 2023-06-05T14:17:12.3645474Z === RUN TestGetClusterInfraInfo 2023-06-05T14:17:12.3645936Z --- PASS: TestGetClusterInfraInfo (0.00s) 2023-06-05T14:17:12.3646351Z === RUN TestDeleteClusterSQLEntryForBanner 2023-06-05T14:17:12.3646949Z --- PASS: TestDeleteClusterSQLEntryForBanner (0.00s) 2023-06-05T14:17:12.3647372Z === RUN TestDeleteOrgBanner 2023-06-05T14:17:12.3647927Z getMockBspServer url: /provisioning/organizations/test-banner/purge 2023-06-05T14:17:12.3648452Z --- PASS: TestDeleteOrgBanner (0.00s) 2023-06-05T14:17:12.3648823Z === RUN TestDeleteEUBanner 2023-06-05T14:17:12.3649318Z getMockBspServer url: /provisioning/enterprise-units 2023-06-05T14:17:12.3649813Z --- PASS: TestDeleteEUBanner (0.00s) 2023-06-05T14:17:12.3650159Z === RUN TestUpdateOrgBanner 2023-06-05T14:17:12.3650691Z getMockBspServer url: /provisioning/organizations/banner-edge-id 2023-06-05T14:17:12.3651219Z --- PASS: TestUpdateOrgBanner (0.00s) 2023-06-05T14:17:12.3651772Z === RUN TestUpdateEUBanner 2023-06-05T14:17:12.3652342Z getMockBspServer url: /provisioning/enterprise-units 2023-06-05T14:17:12.3652899Z --- PASS: TestUpdateEUBanner (0.00s) 2023-06-05T14:17:12.3653254Z === RUN TestGetUserAssignedBanner 2023-06-05T14:17:12.3653739Z getMockBspServer url: /provisioning/users/external/test/accounts?pageNumber=0&pageSize=200 2023-06-05T14:17:12.3654631Z getMockBspServer url: /provisioning/enterprise-unit-grants/unit-grants?username=test&pageNumber=0&pageSize=200 2023-06-05T14:17:12.3655325Z getMockBspServer url: /provisioning/enterprise-units/eu-banner-bsl-id 2023-06-05T14:17:12.3655851Z --- PASS: TestGetUserAssignedBanner (0.00s) 2023-06-05T14:17:12.3656225Z === RUN TestCreateCluster 2023-06-05T14:17:12.3656632Z --- PASS: TestCreateCluster (0.00s) 2023-06-05T14:17:12.3656971Z === RUN TestCreateClusterError 2023-06-05T14:17:12.3657394Z --- PASS: TestCreateClusterError (0.00s) 2023-06-05T14:17:12.3657750Z === RUN TestIsClusterSQLEntryExist 2023-06-05T14:17:12.3658220Z --- PASS: TestIsClusterSQLEntryExist (0.00s) 2023-06-05T14:17:12.3658560Z === RUN TestUpdateCluster 2023-06-05T14:17:12.3658980Z --- PASS: TestUpdateCluster (0.00s) 2023-06-05T14:17:12.3659336Z === RUN TestUpdateClusterError 2023-06-05T14:17:12.3659782Z --- PASS: TestUpdateClusterError (0.00s) 2023-06-05T14:17:12.3660441Z === RUN TestCreateAClusterCR 2023-06-05T14:17:12.3660899Z --- PASS: TestCreateAClusterCR (0.00s) 2023-06-05T14:17:12.3661476Z === RUN TestDeleteClusterResources 2023-06-05T14:17:12.3661970Z --- PASS: TestDeleteClusterResources (0.00s) 2023-06-05T14:17:12.3662342Z === RUN TestIsSystemAdminTrue 2023-06-05T14:17:12.3662768Z --- PASS: TestIsSystemAdminTrue (0.00s) 2023-06-05T14:17:12.3663127Z === RUN TestIsSystemAdminFalse 2023-06-05T14:17:12.3663571Z --- PASS: TestIsSystemAdminFalse (0.00s) 2023-06-05T14:17:12.3663967Z === RUN TestIsOrganizationAdminTrue 2023-06-05T14:17:12.3664421Z --- PASS: TestIsOrganizationAdminTrue (0.00s) 2023-06-05T14:17:12.3664891Z === RUN TestIsOrganizationAdminFalse 2023-06-05T14:17:12.3665384Z --- PASS: TestIsOrganizationAdminFalse (0.00s) 2023-06-05T14:17:12.3665835Z === RUN TestRecoverPassword 2023-06-05T14:17:12.3666573Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:12.3667195Z --- PASS: TestRecoverPassword (0.00s) 2023-06-05T14:17:12.3667553Z === RUN TestDeleteClusterSQLEntry 2023-06-05T14:17:12.3668033Z --- PASS: TestDeleteClusterSQLEntry (0.00s) 2023-06-05T14:17:12.3668405Z === RUN TestGetClusterFromSQL 2023-06-05T14:17:12.3668817Z --- PASS: TestGetClusterFromSQL (0.00s) 2023-06-05T14:17:12.3669221Z === RUN TestGetClustersFromSQL 2023-06-05T14:17:12.3669675Z --- PASS: TestGetClustersFromSQL (0.00s) 2023-06-05T14:17:12.3670074Z === RUN TestGetClustersFromSQLEmptyResponse 2023-06-05T14:17:12.3670636Z --- PASS: TestGetClustersFromSQLEmptyResponse (0.00s) 2023-06-05T14:17:12.3671084Z === RUN TestToBucketStatusInformation 2023-06-05T14:17:12.3671594Z --- PASS: TestToBucketStatusInformation (0.00s) 2023-06-05T14:17:12.3672038Z === RUN TestToKustomizationStatusInformation 2023-06-05T14:17:12.3672567Z --- PASS: TestToKustomizationStatusInformation (0.00s) 2023-06-05T14:17:12.3672987Z === RUN TestGetFluxStatusInfo 2023-06-05T14:17:12.3673439Z --- PASS: TestGetFluxStatusInfo (0.00s) 2023-06-05T14:17:12.3673879Z === RUN TestCreateClusterNetworkServiceSQLEntry 2023-06-05T14:17:12.3674536Z --- PASS: TestCreateClusterNetworkServiceSQLEntry (0.00s) 2023-06-05T14:17:12.3675026Z === RUN TestGetClusterNetworkServiceSQLEntry 2023-06-05T14:17:12.3675591Z --- PASS: TestGetClusterNetworkServiceSQLEntry (0.00s) 2023-06-05T14:17:12.3676061Z === RUN TestDeleteClusterNetworkServiceSQLEntry 2023-06-05T14:17:12.3676621Z --- PASS: TestDeleteClusterNetworkServiceSQLEntry (0.00s) 2023-06-05T14:17:12.3677103Z === RUN TestUpdateClusterNetworkServiceSQLEntry 2023-06-05T14:17:12.3677676Z --- PASS: TestUpdateClusterNetworkServiceSQLEntry (0.00s) 2023-06-05T14:17:12.3678213Z === RUN TestCreateClusterNetworkServiceSQLEntryInvalidNTP 2023-06-05T14:17:12.3678895Z --- PASS: TestCreateClusterNetworkServiceSQLEntryInvalidNTP (0.00s) 2023-06-05T14:17:12.3679488Z === RUN TestUpdateClusterNetworkServiceSQLEntryInvalidNTP 2023-06-05T14:17:12.3680181Z --- PASS: TestUpdateClusterNetworkServiceSQLEntryInvalidNTP (0.00s) 2023-06-05T14:17:12.3680750Z === RUN TestUpdateClusterNetworkServiceSQLEntryValidNTP 2023-06-05T14:17:12.3681455Z --- PASS: TestUpdateClusterNetworkServiceSQLEntryValidNTP (0.00s) 2023-06-05T14:17:12.3682037Z === RUN TestCreateClusterNetworkServiceSQLEntryNoPrioritySet 2023-06-05T14:17:12.3682726Z --- PASS: TestCreateClusterNetworkServiceSQLEntryNoPrioritySet (0.00s) 2023-06-05T14:17:12.3683389Z === RUN TestCreateClusterNetworkServiceSQLEntryPrioritySetToNegativeInt 2023-06-05T14:17:12.3684217Z --- PASS: TestCreateClusterNetworkServiceSQLEntryPrioritySetToNegativeInt (0.00s) 2023-06-05T14:17:12.3684832Z === RUN TestUpdateStoreSiteID 2023-06-05T14:17:12.3685286Z --- PASS: TestUpdateStoreSiteID (0.00s) 2023-06-05T14:17:12.3685664Z === RUN TestTenantService_List 2023-06-05T14:17:12.3686049Z === RUN TestTenantService_List/listTenants 2023-06-05T14:17:12.3686531Z --- PASS: TestTenantService_List (0.00s) 2023-06-05T14:17:12.3687358Z --- PASS: TestTenantService_List/listTenants (0.00s) 2023-06-05T14:17:12.3687776Z === RUN TestTenantService_GetByTenantID 2023-06-05T14:17:12.3688361Z === RUN TestTenantService_GetByTenantID/getTenantByID 2023-06-05T14:17:12.3688929Z --- PASS: TestTenantService_GetByTenantID (0.00s) 2023-06-05T14:17:12.3689521Z --- PASS: TestTenantService_GetByTenantID/getTenantByID (0.00s) 2023-06-05T14:17:12.3690016Z === RUN TestTenantService_GetTenantByBannerIDOrByClusterID 2023-06-05T14:17:12.3690598Z === RUN TestTenantService_GetTenantByBannerIDOrByClusterID/getTenantByBannerID 2023-06-05T14:17:12.3691196Z === RUN TestTenantService_GetTenantByBannerIDOrByClusterID/getTenantByClusterID 2023-06-05T14:17:12.3692138Z --- PASS: TestTenantService_GetTenantByBannerIDOrByClusterID (0.00s) 2023-06-05T14:17:12.3692892Z --- PASS: TestTenantService_GetTenantByBannerIDOrByClusterID/getTenantByBannerID (0.00s) 2023-06-05T14:17:12.3693697Z --- PASS: TestTenantService_GetTenantByBannerIDOrByClusterID/getTenantByClusterID (0.00s) 2023-06-05T14:17:12.3694220Z === RUN TestTenantService_Create 2023-06-05T14:17:12.3694696Z === RUN TestTenantService_Create/createTenant 2023-06-05T14:17:12.3695212Z --- PASS: TestTenantService_Create (0.00s) 2023-06-05T14:17:12.3695712Z --- PASS: TestTenantService_Create/createTenant (0.00s) 2023-06-05T14:17:12.3696108Z === RUN TestCreateTerminal 2023-06-05T14:17:12.3696534Z --- PASS: TestCreateTerminal (0.00s) 2023-06-05T14:17:12.3696970Z === RUN TestCreateTerminalDuplicateLaneNumber 2023-06-05T14:17:12.3697546Z --- PASS: TestCreateTerminalDuplicateLaneNumber (0.00s) 2023-06-05T14:17:12.3698205Z === RUN TestCreateTerminalWithDHCPEmptyAddress 2023-06-05T14:17:12.3698807Z --- PASS: TestCreateTerminalWithDHCPEmptyAddress (0.00s) 2023-06-05T14:17:12.3699272Z === RUN TestCreateTerminalWithDHCP 2023-06-05T14:17:12.3699776Z --- PASS: TestCreateTerminalWithDHCP (0.00s) 2023-06-05T14:17:12.3700211Z === RUN TestCreateTerminalWithDHCPError 2023-06-05T14:17:12.3700720Z --- PASS: TestCreateTerminalWithDHCPError (0.00s) 2023-06-05T14:17:12.3701175Z === RUN TestCreateTerminalInvalidIP 2023-06-05T14:17:12.3701708Z --- PASS: TestCreateTerminalInvalidIP (0.00s) 2023-06-05T14:17:12.3702142Z === RUN TestCreateTerminalInvalidMac 2023-06-05T14:17:12.3702637Z --- PASS: TestCreateTerminalInvalidMac (0.00s) 2023-06-05T14:17:12.3703121Z === RUN TestCreateTerminalValidButUppercaseMac 2023-06-05T14:17:12.3703734Z --- PASS: TestCreateTerminalValidButUppercaseMac (0.00s) 2023-06-05T14:17:12.3704192Z === RUN TestCreateTerminalEmptyClass 2023-06-05T14:17:12.3704820Z --- PASS: TestCreateTerminalEmptyClass (0.00s) 2023-06-05T14:17:12.3705191Z === RUN TestCreateTerminalRollback 2023-06-05T14:17:12.3705696Z --- PASS: TestCreateTerminalRollback (0.00s) 2023-06-05T14:17:12.3706119Z === RUN TestMissingIpv4AddressRollback 2023-06-05T14:17:12.3706660Z --- PASS: TestMissingIpv4AddressRollback (0.00s) 2023-06-05T14:17:12.3707082Z === RUN TestCreateTerminalHostnameExists 2023-06-05T14:17:12.3707644Z --- PASS: TestCreateTerminalHostnameExists (0.00s) 2023-06-05T14:17:12.3708084Z === RUN TestDeleteTerminal 2023-06-05T14:17:12.3708519Z --- PASS: TestDeleteTerminal (0.00s) 2023-06-05T14:17:12.3708874Z === RUN TestUpdateTerminal 2023-06-05T14:17:12.3709319Z --- PASS: TestUpdateTerminal (0.00s) 2023-06-05T14:17:12.3709727Z === RUN TestUpdateTerminalWithEmptyIface 2023-06-05T14:17:12.3710254Z --- PASS: TestUpdateTerminalWithEmptyIface (0.00s) 2023-06-05T14:17:12.3710707Z === RUN TestUpdateTerminalInvalidGateway 2023-06-05T14:17:12.3711274Z --- PASS: TestUpdateTerminalInvalidGateway (0.00s) 2023-06-05T14:17:12.3711734Z === RUN TestUpdateTerminalInvalidCIDR 2023-06-05T14:17:12.3712270Z --- PASS: TestUpdateTerminalInvalidCIDR (0.00s) 2023-06-05T14:17:12.3712667Z === RUN TestUpdateTerminalDHCP 2023-06-05T14:17:12.3713133Z --- PASS: TestUpdateTerminalDHCP (0.00s) 2023-06-05T14:17:12.3713598Z === RUN TestUpdateTerminalIfaceWithUppercaseMac 2023-06-05T14:17:12.3714203Z --- PASS: TestUpdateTerminalIfaceWithUppercaseMac (0.00s) 2023-06-05T14:17:12.3715089Z === RUN TestCreateTerminalInterface 2023-06-05T14:17:12.3715635Z --- PASS: TestCreateTerminalInterface (0.00s) 2023-06-05T14:17:12.3716283Z === RUN TestDeleteTerminalInterface 2023-06-05T14:17:12.3716803Z --- PASS: TestDeleteTerminalInterface (0.00s) 2023-06-05T14:17:12.3717220Z === RUN TestCreateTerminalAddress 2023-06-05T14:17:12.3717682Z --- PASS: TestCreateTerminalAddress (0.00s) 2023-06-05T14:17:12.3718079Z === RUN TestDeleteTerminalAddress 2023-06-05T14:17:12.3718562Z --- PASS: TestDeleteTerminalAddress (0.00s) 2023-06-05T14:17:12.3718975Z === RUN TestDeleteTerminalAddressError 2023-06-05T14:17:12.3719469Z --- PASS: TestDeleteTerminalAddressError (0.00s) 2023-06-05T14:17:12.3719882Z === RUN TestGetTerminalByID 2023-06-05T14:17:12.3720335Z --- PASS: TestGetTerminalByID (0.00s) 2023-06-05T14:17:12.3720737Z === RUN TestGetTerminalByIDWithoutAddress 2023-06-05T14:17:12.3721266Z --- PASS: TestGetTerminalByIDWithoutAddress (0.00s) 2023-06-05T14:17:12.3721744Z === RUN TestGetTerminalsWithClusterEdgeID 2023-06-05T14:17:12.3722294Z --- PASS: TestGetTerminalsWithClusterEdgeID (0.00s) 2023-06-05T14:17:12.3722741Z === RUN TestGetTerminalsWithHostname 2023-06-05T14:17:12.3723250Z --- PASS: TestGetTerminalsWithHostname (0.00s) 2023-06-05T14:17:12.3723705Z === RUN TestGetTerminalsWithClusterEdgeIDAndHostname 2023-06-05T14:17:12.3724395Z --- PASS: TestGetTerminalsWithClusterEdgeIDAndHostname (0.00s) 2023-06-05T14:17:12.3725045Z === RUN TestGetTerminalsWithoutClusterEdgeIDAndHostname 2023-06-05T14:17:12.3725754Z --- PASS: TestGetTerminalsWithoutClusterEdgeIDAndHostname (0.00s) 2023-06-05T14:17:12.3726254Z === RUN TestGetTerminalFromInterface 2023-06-05T14:17:12.3726782Z --- PASS: TestGetTerminalFromInterface (0.00s) 2023-06-05T14:17:12.3727202Z === RUN TestGetTerminalFromAddress 2023-06-05T14:17:12.3727694Z --- PASS: TestGetTerminalFromAddress (0.00s) 2023-06-05T14:17:12.3728081Z === RUN TestGetBannerTerminals 2023-06-05T14:17:12.3728545Z --- PASS: TestGetBannerTerminals (0.00s) 2023-06-05T14:17:12.3728934Z === RUN TestGetEmptyBannerTerminals 2023-06-05T14:17:12.3729441Z --- PASS: TestGetEmptyBannerTerminals (0.00s) 2023-06-05T14:17:12.3729869Z === RUN TestGetTerminalBootstrapConfig 2023-06-05T14:17:12.3730402Z --- PASS: TestGetTerminalBootstrapConfig (0.00s) 2023-06-05T14:17:12.3730819Z === RUN TestUpdatePasswordWToken 2023-06-05T14:17:12.3731774Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:12.3732729Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:12.3733637Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:12.3734277Z --- PASS: TestUpdatePasswordWToken (0.00s) 2023-06-05T14:17:12.3734710Z === RUN TestGetUser 2023-06-05T14:17:12.3735454Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:12.3736029Z --- PASS: TestGetUser (0.04s) 2023-06-05T14:17:12.3736342Z === RUN TestGetUsers 2023-06-05T14:17:12.3736728Z --- PASS: TestGetUsers (0.00s) 2023-06-05T14:17:12.3737081Z === RUN TestUpdateUserProfile 2023-06-05T14:17:12.3737773Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:12.3738692Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:12.3739298Z --- PASS: TestUpdateUserProfile (0.00s) 2023-06-05T14:17:12.3739657Z === RUN TestGetWorkloads 2023-06-05T14:17:12.3740067Z --- PASS: TestGetWorkloads (0.00s) 2023-06-05T14:17:12.3740439Z === RUN TestGetWorkloadsEmptyResponse 2023-06-05T14:17:12.3740965Z --- PASS: TestGetWorkloadsEmptyResponse (0.00s) 2023-06-05T14:17:12.3741684Z === RUN TestGetWorkloadsError 2023-06-05T14:17:12.3742176Z --- PASS: TestGetWorkloadsError (0.00s) 2023-06-05T14:17:12.3742735Z === RUN TestGetWorkload 2023-06-05T14:17:12.3743070Z workload_service_test.go:90: test_workload 2023-06-05T14:17:12.3743509Z --- PASS: TestGetWorkload (0.00s) 2023-06-05T14:17:12.3743856Z === RUN TestGetWorkloadError 2023-06-05T14:17:12.3744303Z --- PASS: TestGetWorkloadError (0.00s) 2023-06-05T14:17:12.3744695Z PASS 2023-06-05T14:17:12.3745014Z ================================================================================ 2023-06-05T14:17:13.3984536Z INFO: From Testing //pkg/edge/datasync/chirp/server/http:http_test: 2023-06-05T14:17:13.3985179Z ==================== Test output for //pkg/edge/datasync/chirp/server/http:http_test: 2023-06-05T14:17:13.3985606Z === RUN TestServerIsNotReady 2023-06-05T14:17:13.3986119Z --- PASS: TestServerIsNotReady (0.00s) 2023-06-05T14:17:13.3988321Z === RUN TestServerIsReady 2023-06-05T14:17:13.3992613Z --- PASS: TestServerIsReady (0.00s) 2023-06-05T14:17:13.3993035Z === RUN TestServerIsNotAlive 2023-06-05T14:17:13.3995258Z {"severity":"error","ts":1685974633.3781006,"message":"Liveness check failed","error":"missing the following environment variables: MESSAGE_ROUTING, PARTITIONS, OUTBOX_PATH, GRPC_PORT, MSG_SERVICE_PORT, LIVENESS_PORT, READINESS_PORT, PROMETHEUS_PORT, TARGET_SETTINGS","stacktrace":"edge-infra.dev/pkg/edge/datasync/chirp/server/http.isServerAlive\n\tpkg/edge/datasync/chirp/server/http/liveness.go:37\nedge-infra.dev/pkg/edge/datasync/chirp/server/http.TestServerIsNotAlive\n\tpkg/edge/datasync/chirp/server/http/http_test.go:23\ntesting.tRunner\n\tGOROOT/src/testing/testing.go:1446"} 2023-06-05T14:17:13.3997076Z --- PASS: TestServerIsNotAlive (0.00s) 2023-06-05T14:17:13.3997427Z === RUN TestServerIsAlive 2023-06-05T14:17:13.3997815Z --- PASS: TestServerIsAlive (0.00s) 2023-06-05T14:17:13.3998146Z PASS 2023-06-05T14:17:13.3998523Z ================================================================================ 2023-06-05T14:17:13.4609170Z INFO: From Testing //pkg/edge/controllers/envctl/pkg/nameutils:nameutils_test: 2023-06-05T14:17:13.4609986Z ==================== Test output for //pkg/edge/controllers/envctl/pkg/nameutils:nameutils_test: 2023-06-05T14:17:13.4611080Z === RUN TestCreateReplicatedStatefulsetName 2023-06-05T14:17:13.4612150Z --- PASS: TestCreateReplicatedStatefulsetName (0.00s) 2023-06-05T14:17:13.4613124Z === RUN TestCreateReplicatedStatefulsetNameNoLaneLabel 2023-06-05T14:17:13.4614072Z --- PASS: TestCreateReplicatedStatefulsetNameNoLaneLabel (0.00s) 2023-06-05T14:17:13.4614745Z === RUN TestStatefulNameConversion 2023-06-05T14:17:13.4615516Z --- PASS: TestStatefulNameConversion (0.00s) 2023-06-05T14:17:13.4616017Z PASS 2023-06-05T14:17:13.4616871Z ================================================================================ 2023-06-05T14:17:14.0852489Z INFO: From Testing //pkg/edge/controllers/clusterctl/pkg/iamutils:iamutils_test: 2023-06-05T14:17:14.0853285Z ==================== Test output for //pkg/edge/controllers/clusterctl/pkg/iamutils:iamutils_test: 2023-06-05T14:17:14.0853836Z === RUN TestBuildIAMResourcesForProject 2023-06-05T14:17:14.0854492Z --- PASS: TestBuildIAMResourcesForProject (0.00s) 2023-06-05T14:17:14.0855030Z === RUN TestBuildIAMResourcesForForemanProject 2023-06-05T14:17:14.0855749Z --- PASS: TestBuildIAMResourcesForForemanProject (0.00s) 2023-06-05T14:17:14.0856182Z PASS 2023-06-05T14:17:14.0856516Z ================================================================================ 2023-06-05T14:17:14.0981419Z INFO: From Testing //pkg/lib/runtime/subscriber/metrics:metrics_test: 2023-06-05T14:17:14.0982116Z ==================== Test output for //pkg/lib/runtime/subscriber/metrics:metrics_test: 2023-06-05T14:17:14.0982532Z PASS 2023-06-05T14:17:14.0982884Z testing: warning: no tests to run 2023-06-05T14:17:14.0983308Z ================================================================================ 2023-06-05T14:17:14.1843118Z INFO: From Testing //pkg/edge/bootstrapping:bootstrapping_test: 2023-06-05T14:17:14.1854134Z ==================== Test output for //pkg/edge/bootstrapping:bootstrapping_test: 2023-06-05T14:17:14.1854788Z === RUN TestCreateRegionConnectionSecretBFF 2023-06-05T14:17:14.1855698Z --- PASS: TestCreateRegionConnectionSecretBFF (0.00s) 2023-06-05T14:17:14.1856336Z === RUN TestCreateRegionConnectionSecretBootstrapping 2023-06-05T14:17:14.1857145Z --- PASS: TestCreateRegionConnectionSecretBootstrapping (0.00s) 2023-06-05T14:17:14.1857772Z === RUN TestCreateDataSyncSecretStringData 2023-06-05T14:17:14.1858429Z --- PASS: TestCreateDataSyncSecretStringData (0.00s) 2023-06-05T14:17:14.1858960Z === RUN TestCreateDataSyncSecretByteData 2023-06-05T14:17:14.1859595Z --- PASS: TestCreateDataSyncSecretByteData (0.00s) 2023-06-05T14:17:14.1860116Z === RUN TestCreateKustomizationNoCleanup 2023-06-05T14:17:14.1860940Z {"severity":"info","ts":1685974634.1405396,"logger":"edge-agent","message":"Installing Flux Kustomize resource!!"} 2023-06-05T14:17:14.1861760Z {"severity":"info","ts":1685974634.140612,"logger":"edge-agent","message":"kustomization applied"} 2023-06-05T14:17:14.1862479Z --- PASS: TestCreateKustomizationNoCleanup (0.00s) 2023-06-05T14:17:14.1863006Z === RUN TestCreateKustomizationCleanup 2023-06-05T14:17:14.1863787Z {"severity":"info","ts":1685974634.1415994,"logger":"edge-agent","message":"Installing Flux Kustomize resource!!"} 2023-06-05T14:17:14.1864611Z {"severity":"info","ts":1685974634.1417813,"logger":"edge-agent","message":"kustomization applied"} 2023-06-05T14:17:14.1865336Z --- PASS: TestCreateKustomizationCleanup (0.00s) 2023-06-05T14:17:14.1865766Z PASS 2023-06-05T14:17:14.1866123Z ================================================================================ 2023-06-05T14:17:14.7133709Z INFO: From Testing //pkg/edge/datasync/cushion:cushion_test: 2023-06-05T14:17:14.7144433Z ==================== Test output for //pkg/edge/datasync/cushion:cushion_test: 2023-06-05T14:17:14.7144897Z === RUN TestCreateReplicationSetDoc 2023-06-05T14:17:14.7145530Z --- PASS: TestCreateReplicationSetDoc (0.00s) 2023-06-05T14:17:14.7145972Z === RUN TestUpdateReplicationSetDocNone 2023-06-05T14:17:14.7146479Z --- PASS: TestUpdateReplicationSetDocNone (0.00s) 2023-06-05T14:17:14.7147068Z === RUN TestUpdateReplicationSetDoc 2023-06-05T14:17:14.7147580Z --- PASS: TestUpdateReplicationSetDoc (0.00s) 2023-06-05T14:17:14.7148026Z === RUN TestUpdateSameReplicationSetDoc 2023-06-05T14:17:14.7148554Z --- PASS: TestUpdateSameReplicationSetDoc (0.00s) 2023-06-05T14:17:14.7148930Z PASS 2023-06-05T14:17:14.7149225Z ================================================================================ 2023-06-05T14:17:15.6705528Z INFO: From Testing //pkg/sds/lib/os/grub:grub_test: 2023-06-05T14:17:15.6706137Z ==================== Test output for //pkg/sds/lib/os/grub:grub_test: 2023-06-05T14:17:15.6706635Z === RUN TestGetGrubConfigPath 2023-06-05T14:17:15.6707249Z --- PASS: TestGetGrubConfigPath (0.00s) 2023-06-05T14:17:15.6707703Z === RUN TestReadWriteGrubCfg 2023-06-05T14:17:15.6708275Z --- PASS: TestReadWriteGrubCfg (0.00s) 2023-06-05T14:17:15.6708793Z === RUN TestWriteGrubCfgReadWrite 2023-06-05T14:17:15.6709395Z --- PASS: TestWriteGrubCfgReadWrite (0.00s) 2023-06-05T14:17:15.6709841Z === RUN TestMenuEntries 2023-06-05T14:17:15.6710220Z insmod all_video 2023-06-05T14:17:15.6710581Z set default="0" 2023-06-05T14:17:15.6710939Z set timeout=5 2023-06-05T14:17:15.6711370Z set root=(lvm/ien-lvboot) 2023-06-05T14:17:15.6711610Z 2023-06-05T14:17:15.6711794Z set superusers="oldGrubUser" 2023-06-05T14:17:15.6712353Z password_pbkdf2 oldGrubUser grub.pbkdf2.sha512.10000.oldSalt.oldHash 2023-06-05T14:17:15.6712872Z export superusers 2023-06-05T14:17:15.6713099Z 2023-06-05T14:17:15.6713380Z menuentry "Run" --unrestricted { 2023-06-05T14:17:15.6714083Z linux /vmlinuz boot=casper persistent zynstra/opmode=operation zynstra/liveboot=false hostname=ien-1 2023-06-05T14:17:15.6715224Z initrd /initrd 2023-06-05T14:17:15.6715567Z } 2023-06-05T14:17:15.6716025Z menuentry "Run" --unrestricted { 2023-06-05T14:17:15.6717039Z linux /vmlinuz boot=casper persistent zynstra/opmode=operation zynstra/liveboot=false hostname=ien-1 2023-06-05T14:17:15.6717587Z initrd /initrd 2023-06-05T14:17:15.6717921Z } 2023-06-05T14:17:15.6718375Z --- PASS: TestMenuEntries (0.00s) 2023-06-05T14:17:15.6718749Z PASS 2023-06-05T14:17:15.6719125Z ================================================================================ 2023-06-05T14:17:15.6729906Z INFO: From Testing //pkg/lib/server/inmemorylistener:inmemorylistener_test: 2023-06-05T14:17:15.6730629Z ==================== Test output for //pkg/lib/server/inmemorylistener:inmemorylistener_test: 2023-06-05T14:17:15.6731196Z === RUN TestInMemoryListener 2023-06-05T14:17:15.6731804Z iml_test.go:32: Successfully got payload "foobarbaz" 2023-06-05T14:17:15.6732428Z --- PASS: TestInMemoryListener (0.00s) 2023-06-05T14:17:15.6732839Z PASS 2023-06-05T14:17:15.6733236Z ================================================================================ 2023-06-05T14:17:16.0505492Z INFO: From Testing //pkg/edge/api/graph/integration:integration_test: 2023-06-05T14:17:16.0524123Z ==================== Test output for //pkg/edge/api/graph/integration:integration_test: 2023-06-05T14:17:16.0524625Z === RUN TestResolversFramework 2023-06-05T14:17:16.0525073Z The files belonging to this database system will be owned by user "build". 2023-06-05T14:17:16.0525532Z This user must also own the server process. 2023-06-05T14:17:16.0525840Z 2023-06-05T14:17:16.0526464Z The database cluster will be initialized with locale "C.UTF-8". 2023-06-05T14:17:16.0527234Z The default database encoding has accordingly been set to "UTF8". 2023-06-05T14:17:16.0527592Z The default text search configuration will be set to "english". 2023-06-05T14:17:16.0527769Z 2023-06-05T14:17:16.0527901Z Data page checksums are disabled. 2023-06-05T14:17:16.0528125Z 2023-06-05T14:17:16.0529164Z creating directory /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7025/execroot/edge_infra/_tmp/c23dbcd6127845420a9094cf4a80c78e/edge-infra-api-test-680601004/runtime/data ... ok 2023-06-05T14:17:16.0530122Z creating subdirectories ... ok 2023-06-05T14:17:16.0530576Z selecting dynamic shared memory implementation ... posix 2023-06-05T14:17:16.0531095Z selecting default max_connections ... 100 2023-06-05T14:17:16.0531724Z selecting default shared_buffers ... 128MB 2023-06-05T14:17:16.0532109Z selecting default time zone ... UTC 2023-06-05T14:17:16.0532465Z creating configuration files ... ok 2023-06-05T14:17:16.0532817Z running bootstrap script ... ok 2023-06-05T14:17:16.0533318Z performing post-bootstrap initialization ... ok 2023-06-05T14:17:16.0533726Z syncing data to disk ... ok 2023-06-05T14:17:16.0533955Z 2023-06-05T14:17:16.0534149Z Success. You can now start the database server using: 2023-06-05T14:17:16.0534381Z 2023-06-05T14:17:16.0535870Z /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7025/execroot/edge_infra/_tmp/c23dbcd6127845420a9094cf4a80c78e/edge-infra-api-test-680601004/bin/pg_ctl -D /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7025/execroot/edge_infra/_tmp/c23dbcd6127845420a9094cf4a80c78e/edge-infra-api-test-680601004/runtime/data -l logfile start 2023-06-05T14:17:16.0536678Z 2023-06-05T14:17:16.0537323Z waiting for server to start....2023-06-05 14:17:05.543 UTC [69509] LOG: starting PostgreSQL 14.2 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 4.8.4-2ubuntu1~14.04.4) 4.8.4, 64-bit 2023-06-05T14:17:16.0538046Z 2023-06-05 14:17:05.544 UTC [69509] LOG: listening on IPv4 address "127.0.0.1", port 5434 2023-06-05T14:17:16.0539367Z 2023-06-05 14:17:05.544 UTC [69509] LOG: could not bind IPv6 address "::1": Cannot assign requested address 2023-06-05T14:17:16.0540188Z 2023-06-05 14:17:05.549 UTC [69509] LOG: listening on Unix socket "/tmp/.s.PGSQL.5434" 2023-06-05T14:17:16.0540693Z 2023-06-05 14:17:05.559 UTC [69510] LOG: database system was shut down at 2023-06-05 14:17:05 UTC 2023-06-05T14:17:16.0541609Z 2023-06-05 14:17:05.567 UTC [69509] LOG: database system is ready to accept connections 2023-06-05T14:17:16.0541850Z done 2023-06-05T14:17:16.0542010Z server started 2023-06-05T14:17:16.0542308Z {"severity":"info","ts":1685974627.0836802,"logger":"test","message":"edge env sql migration completed successfully"} 2023-06-05T14:17:16.0542689Z {"severity":"info","ts":1685974627.1457455,"logger":"test","message":"edge env sql seeding completed successfully"} 2023-06-05T14:17:16.0543184Z === RUN TestResolversFramework/TestAddClusterLabels 2023-06-05T14:17:16.0543488Z === RUN TestResolversFramework/TestAddClusterLabelsError 2023-06-05T14:17:16.0544119Z {"level":"error","error":"ERROR: invalid input syntax for type uuid: \"label-not-exist\" (SQLSTATE 22P02)","time":"2023-06-05T14:17:11Z","message":"error creating cluster label: label-not-exist"} 2023-06-05T14:17:16.0544922Z {"level":"error","error":"ERROR: duplicate key value violates unique constraint \"cluster_labels_pkey\" (SQLSTATE 23505)","time":"2023-06-05T14:17:11Z","message":"error creating cluster label: ca18bfab-091b-4a7f-9db6-011d2603b949"} 2023-06-05T14:17:16.0545398Z === RUN TestResolversFramework/TestAssignRoleToUser 2023-06-05T14:17:16.0545777Z === RUN TestResolversFramework/TestAssignUserToEUAndOrgBanner 2023-06-05T14:17:16.0546320Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0547287Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0548431Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0549408Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0550363Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0551087Z === RUN TestResolversFramework/TestAssignUserToEUBanner 2023-06-05T14:17:16.0551595Z === RUN TestResolversFramework/TestAssignUserToOrgBanner 2023-06-05T14:17:16.0552433Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0553310Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0554136Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0554954Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0555673Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0556533Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0557376Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0557991Z === RUN TestResolversFramework/TestBanner 2023-06-05T14:17:16.0558786Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0559445Z === RUN TestResolversFramework/TestBannerStatusActive 2023-06-05T14:17:16.0560565Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0561383Z === RUN TestResolversFramework/TestBannerStatusAllStatus 2023-06-05T14:17:16.0561969Z Cluster Scope edge.ncr.com/v1alpha1, Kind=Banner /3396a52c-6a22-4049-9593-5a63b596a100 delete 2023-06-05T14:17:16.0562323Z Cluster Scope edge.ncr.com/v1alpha1, Kind=Cluster /j9bvzmydckxf delete 2023-06-05T14:17:16.0562874Z Cluster Scope edge.ncr.com/v1alpha1, Kind=GKECluster /j9bvzmydckxf delete 2023-06-05T14:17:16.0563423Z === RUN TestResolversFramework/TestBannerValidation 2023-06-05T14:17:16.0564274Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0565206Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0566238Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0567252Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0567892Z === RUN TestResolversFramework/TestBanner_Mismatches 2023-06-05T14:17:16.0568302Z === RUN TestResolversFramework/TestBanners 2023-06-05T14:17:16.0569294Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0570391Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0571129Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0572033Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0572611Z === RUN TestResolversFramework/TestBanners_Mismatches 2023-06-05T14:17:16.0573687Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0574614Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0575543Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0576586Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0577221Z === RUN TestResolversFramework/TestBootstrapActiveCluster 2023-06-05T14:17:16.0577760Z [LaunchDarkly] 2023/06/05 14:17:11 INFO: Starting LaunchDarkly client 6.0.3 2023-06-05T14:17:16.0578357Z [LaunchDarkly] 2023/06/05 14:17:11 INFO: Waiting up to 10000 milliseconds for LaunchDarkly client to start... 2023-06-05T14:17:16.0579018Z [LaunchDarkly] 2023/06/05 14:17:11 INFO: Initialized LaunchDarkly client 2023-06-05T14:17:16.0579577Z === RUN TestResolversFramework/TestBootstrapActiveClusterNoLumper 2023-06-05T14:17:16.0580193Z === RUN TestResolversFramework/TestBootstrapClusterCaHash 2023-06-05T14:17:16.0580792Z === RUN TestResolversFramework/TestBootstrapClusterEdgeIDSyncing 2023-06-05T14:17:16.0581436Z === RUN TestResolversFramework/TestBootstrapClusterUsingClusterID 2023-06-05T14:17:16.0582062Z === RUN TestResolversFramework/TestBootstrapInactiveCluster 2023-06-05T14:17:16.0582763Z === RUN TestResolversFramework/TestCanAssignRoleValidation 2023-06-05T14:17:16.0583305Z === RUN TestResolversFramework/TestClusterConfigMap 2023-06-05T14:17:16.0584181Z Cluster Scope /v1, Kind=ConfigMap kube-public/edge-info delete 2023-06-05T14:17:16.0585049Z === RUN TestResolversFramework/TestClusterLabels 2023-06-05T14:17:16.0585555Z === RUN TestResolversFramework/TestClusterNameTaken 2023-06-05T14:17:16.0589294Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0590726Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0591287Z === RUN TestResolversFramework/TestClusterValidation 2023-06-05T14:17:16.0591875Z === RUN TestResolversFramework/TestCreateBanner 2023-06-05T14:17:16.0592729Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0593788Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0594724Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0595861Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0596757Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0597329Z === RUN TestResolversFramework/TestCreateBannerError 2023-06-05T14:17:16.0598131Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0599020Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:arghlequbhr7 Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0599846Z PublishMessage Banner banners 4b94d214-d2f1-47a3-b35e-fa42de3e2715 map[] 1 2023-06-05T14:17:16.0600761Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0601624Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:arghlequbhr7 Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0602379Z PublishMessage Banner banners d090e7a1-e3e5-4fe2-8baf-098cb1c89423 map[] 1 2023-06-05T14:17:16.0602977Z === RUN TestResolversFramework/TestCreateBannerWithDeletedEu 2023-06-05T14:17:16.0603691Z [{"message":"enterprise unit test-bsl-id-for-deleted-eu is deleted","path":["createBanner"]}] 2023-06-05T14:17:16.0604463Z === RUN TestResolversFramework/TestCreateBannerWithDeletedOrg 2023-06-05T14:17:16.0605348Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0606122Z === RUN TestResolversFramework/TestCreateBannerWithExisitingEu 2023-06-05T14:17:16.0607066Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0608057Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0609036Z Chariot Message: {ChariotMessage - Banner:top-level-project Cluster:arghlequbhr7 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0609593Z PublishMessage map[] 2023-06-05T14:17:16.0610162Z Object 'Kind' is missing in 'unstructured object has no kind' 2023-06-05T14:17:16.0610651Z === RUN TestResolversFramework/TestCreateBannerWithExisitingOrg 2023-06-05T14:17:16.0611625Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:arghlequbhr7 Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0612504Z PublishMessage Banner banners 67647fbc-29ea-41a5-a24c-e928c2b5e769 map[] 1 2023-06-05T14:17:16.0613554Z 2023/06/05 14:17:11 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0614660Z === RUN TestResolversFramework/TestCreateClusterNetworkService 2023-06-05T14:17:16.0615549Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:arghlequbhr7 Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0616576Z PublishMessage Banner banners 6f30542a-7448-4e0a-ac73-477ac9f7b069 map[] 1 2023-06-05T14:17:16.0617360Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0618255Z PublishMessage IENode ien-00005e0053af map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c101] 1 2023-06-05T14:17:16.0619066Z === RUN TestResolversFramework/TestCreateClusterNetworkServiceInvalidIP 2023-06-05T14:17:16.0619810Z === RUN TestResolversFramework/TestCreateClusterNetworkServiceInvalidServiceType 2023-06-05T14:17:16.0620529Z === RUN TestResolversFramework/TestCreateExternalSecretHelmRelease 2023-06-05T14:17:16.0621412Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0622317Z PublishMessage IENode ien-00005e0035fa map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c201] 1 2023-06-05T14:17:16.0623252Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0624042Z PublishMessage ClusterExternalSecret test-secret-2 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0624796Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0625676Z PublishMessage ClusterExternalSecret bitnami map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0626558Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:3396a52c-6a22-4049-9593-5a63b596a205 Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0627462Z PublishMessage ExternalSecret secret-ns-1685974631650925218 test-secret-1 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0628310Z PublishMessage ExternalSecret secret-ns-1685974631650925218 test-secret-2 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0629231Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:3396a52c-6a22-4049-9593-5a63b596a205 Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0630280Z PublishMessage HelmRelease flux-system external-secret-helmrelease-1685974631650926306 map[parent-cluster:region-infra secret-mamager.edge.ncr.com:bitnami] 1 2023-06-05T14:17:16.0631455Z PublishMessage Namespace secret-ns-1685974631650925218 map[workload.edge.ncr.com:tenant] 1 2023-06-05T14:17:16.0632022Z === RUN TestResolversFramework/TestCreateHelmRelease 2023-06-05T14:17:16.0632830Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0633614Z PublishMessage ClusterExternalSecret bitnami map[tenant.edge.ncr.com:test-org] 2023-06-05T14:17:16.0634333Z clusterexternalsecrets.external-secrets.io "bitnami" already exists 2023-06-05T14:17:16.0634915Z === RUN TestResolversFramework/TestCreateInvalidHelmRelease 2023-06-05T14:17:16.0635391Z === RUN TestResolversFramework/TestCreateLabel 2023-06-05T14:17:16.0636008Z === RUN TestResolversFramework/TestCreateOrUpdateBannerHelmRepository 2023-06-05T14:17:16.0636830Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0637831Z PublishMessage HelmRelease flux-system create-helmrelease-1685974631278584365 map[parent-cluster:region-infra secret-mamager.edge.ncr.com:bitnami] 1 2023-06-05T14:17:16.0638728Z PublishMessage Namespace helmrelease-1685974631278584365 map[workload.edge.ncr.com:tenant] 1 2023-06-05T14:17:16.0639502Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0640569Z PublishMessage HelmRepository flux-system create-helmrepo-1685974631278584365 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0641266Z === RUN TestResolversFramework/TestCreateOrUpdateInvalidBannerHelmRepository 2023-06-05T14:17:16.0642246Z === RUN TestResolversFramework/TestCreateOrUpdateSecretManagerSecret 2023-06-05T14:17:16.0642930Z === RUN TestResolversFramework/TestCreateSecret 2023-06-05T14:17:16.0643628Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0644515Z PublishMessage HelmRepository flux-system create-helmrepo-1685974631278584365 map[tenant.edge.ncr.com:test-org] 2023-06-05T14:17:16.0645345Z helmrepositories.source.toolkit.fluxcd.io "create-helmrepo-1685974631278584365" already exists 2023-06-05T14:17:16.0645969Z === RUN TestResolversFramework/TestCreateTerminal 2023-06-05T14:17:16.0646684Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0647485Z PublishMessage Secret secret-ns-1685974631278584365 test-get-secret-store-1685974631278584365 map[] 1 2023-06-05T14:17:16.0648343Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwc Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0649260Z PublishMessage ExternalSecret pxe activation-code-60ace0ec-bbae-49c6-85f2-f366396e9fd6 map[tenant.edge.ncr.com:test-org] 2023-06-05T14:17:16.0650232Z externalsecrets.external-secrets.io "activation-code-60ace0ec-bbae-49c6-85f2-f366396e9fd6" not found 2023-06-05T14:17:16.0651136Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwc Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0652411Z PublishMessage IENode ien-00005e0053bb map[node.ncr.com/terminal-id:60ace0ec-bbae-49c6-85f2-f366396e9fd6] 1 2023-06-05T14:17:16.0653010Z === RUN TestResolversFramework/TestCreateTerminalAddress 2023-06-05T14:17:16.0653787Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0654586Z PublishMessage IENode ien-00005e0053af map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c101] 2023-06-05T14:17:16.0655259Z ienodes.dsds.edge.ncr.com "ien-00005e0053af" already exists 2023-06-05T14:17:16.0655839Z === RUN TestResolversFramework/TestCreateTerminalDHCPNotSet 2023-06-05T14:17:16.0656813Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwc Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0657799Z PublishMessage ExternalSecret pxe activation-code-1626cac5-c813-44d5-ae97-a589ef51e61a map[tenant.edge.ncr.com:test-org] 2023-06-05T14:17:16.0658900Z externalsecrets.external-secrets.io "activation-code-1626cac5-c813-44d5-ae97-a589ef51e61a" not found 2023-06-05T14:17:16.0659615Z === RUN TestResolversFramework/TestCreateTerminalError 2023-06-05T14:17:16.0660357Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwc Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0661187Z PublishMessage IENode ien-00005e0053bb map[node.ncr.com/terminal-id:1626cac5-c813-44d5-ae97-a589ef51e61a] 2023-06-05T14:17:16.0661897Z ienodes.dsds.edge.ncr.com "ien-00005e0053bb" already exists 2023-06-05T14:17:16.0662441Z === RUN TestResolversFramework/TestCreateTerminalInterface 2023-06-05T14:17:16.0663025Z === RUN TestResolversFramework/TestCreateTerminalInterfaceError 2023-06-05T14:17:16.0663715Z === RUN TestResolversFramework/TestCreateTerminalInvalidCIDR 2023-06-05T14:17:16.0664323Z === RUN TestResolversFramework/TestCreateTerminalInvalidIP 2023-06-05T14:17:16.0665194Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0666247Z PublishMessage IENode ien-00005e0053af map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c101] 2023-06-05T14:17:16.0667029Z ienodes.dsds.edge.ncr.com "ien-00005e0053af" already exists 2023-06-05T14:17:16.0667597Z === RUN TestResolversFramework/TestCreateTerminalInvalidMac 2023-06-05T14:17:16.0668205Z === RUN TestResolversFramework/TestCreateUpdateDeleteGetClusterConfig 2023-06-05T14:17:16.0669485Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0670184Z PublishMessage ConfigMap pxe boot-options map[] 1 2023-06-05T14:17:16.0671193Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0672127Z PublishMessage ConfigMap kube-public topology-info map[] 1 2023-06-05T14:17:16.0672972Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0673695Z PublishMessage VPNConfig vpn 3396a52c-6a22-4049-9593-5a63b596a201 map[] 1 2023-06-05T14:17:16.0674534Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0675319Z PublishMessage ConfigMap pxe boot-options map[] 2023-06-05T14:17:16.0676026Z configmaps "boot-options" already exists 2023-06-05T14:17:16.0676955Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0677763Z PublishMessage VPNConfig vpn 3396a52c-6a22-4049-9593-5a63b596a201 map[] 2023-06-05T14:17:16.0678574Z vpnconfigs.remoteaccess.edge.ncr.com "3396a52c-6a22-4049-9593-5a63b596a201" already exists 2023-06-05T14:17:16.0679182Z === RUN TestResolversFramework/TestDefaultSchemaConfig 2023-06-05T14:17:16.0679981Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0680684Z PublishMessage ConfigMap kube-public topology-info map[] 2023-06-05T14:17:16.0681251Z configmaps "topology-info" already exists 2023-06-05T14:17:16.0681778Z 2023/06/05 14:17:12.043912 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:16.0682342Z 2023/06/05 14:17:12.044429 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:16.0682867Z === RUN TestResolversFramework/TestDeleteBanner 2023-06-05T14:17:16.0683652Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0684764Z PublishMessage ClusterExternalSecret config-chart-secret-1685974631278584365 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0685949Z Special Chariot Message: {ChariotMessage - Banner:test-org Cluster:arghlequbhr7 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0687076Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:arghlequbhr7 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0687928Z PublishMessage Banner banners 3396a52c-6a22-4049-9593-5a63b596a103 map[] 2023-06-05T14:17:16.0688566Z banners.edge.ncr.com "3396a52c-6a22-4049-9593-5a63b596a103" not found 2023-06-05T14:17:16.0689341Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:arghlequbhr7 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0690102Z PublishMessage Cluster 3396a52c-6a22-4049-9593-5a63b596a203 map[] 2023-06-05T14:17:16.0690732Z clusters.edge.ncr.com "3396a52c-6a22-4049-9593-5a63b596a203" not found 2023-06-05T14:17:16.0691719Z Special Chariot Message: {ChariotMessage - Banner:test-org Cluster:arghlequbhr7 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0692430Z === RUN TestResolversFramework/TestDeleteBannerHelmRepository 2023-06-05T14:17:16.0692893Z === RUN TestResolversFramework/TestDeleteBanner_NotExists 2023-06-05T14:17:16.0693363Z === RUN TestResolversFramework/TestDeleteCluster 2023-06-05T14:17:16.0694128Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0695059Z PublishMessage HelmRepository flux-system delete-helmrepo-1685974631278584365 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0696131Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0696884Z PublishMessage Cluster 3d589401-8e64-4845-ad7b-0466e8e65f13 map[] 2023-06-05T14:17:16.0697464Z clusters.edge.ncr.com "3d589401-8e64-4845-ad7b-0466e8e65f13" not found 2023-06-05T14:17:16.0698361Z === RUN TestResolversFramework/TestDeleteClusterAndBslSite 2023-06-05T14:17:16.0699339Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0700214Z PublishMessage VPNConfig vpn 3d589401-8e64-4845-ad7b-0466e8e65f13 map[] 2023-06-05T14:17:16.0701212Z vpnconfigs.remoteaccess.edge.ncr.com "3d589401-8e64-4845-ad7b-0466e8e65f13" not found 2023-06-05T14:17:16.0702012Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0702718Z PublishMessage Cluster 25980ab2-cb78-46ab-bf8f-9a7b78239b7f map[] 2023-06-05T14:17:16.0703356Z clusters.edge.ncr.com "25980ab2-cb78-46ab-bf8f-9a7b78239b7f" not found 2023-06-05T14:17:16.0704146Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0705406Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0706135Z === RUN TestResolversFramework/TestDeleteClusterNetworkService 2023-06-05T14:17:16.0707008Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0707774Z PublishMessage VPNConfig vpn 25980ab2-cb78-46ab-bf8f-9a7b78239b7f map[] 2023-06-05T14:17:16.0708527Z vpnconfigs.remoteaccess.edge.ncr.com "25980ab2-cb78-46ab-bf8f-9a7b78239b7f" not found 2023-06-05T14:17:16.0709332Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0710333Z PublishMessage IENode ien-00005e0053af map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c101] 2023-06-05T14:17:16.0711040Z ienodes.dsds.edge.ncr.com "ien-00005e0053af" already exists 2023-06-05T14:17:16.0711588Z === RUN TestResolversFramework/TestDeleteClusters1 2023-06-05T14:17:16.0712283Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0713141Z PublishMessage IENode ien-00005e0035fa map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c201] 2023-06-05T14:17:16.0713795Z ienodes.dsds.edge.ncr.com "ien-00005e0035fa" already exists 2023-06-05T14:17:16.0714592Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0715351Z PublishMessage Cluster 2a589401-8e64-4845-ad7b-0466e8e65f13 map[] 2023-06-05T14:17:16.0716081Z clusters.edge.ncr.com "2a589401-8e64-4845-ad7b-0466e8e65f13" not found 2023-06-05T14:17:16.0716846Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0717634Z PublishMessage VPNConfig vpn 2a589401-8e64-4845-ad7b-0466e8e65f13 map[] 2023-06-05T14:17:16.0718403Z vpnconfigs.remoteaccess.edge.ncr.com "2a589401-8e64-4845-ad7b-0466e8e65f13" not found 2023-06-05T14:17:16.0718968Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0719425Z PublishMessage Cluster 2b589401-8e64-4845-ad7b-0466e8e65f13 map[] 2023-06-05T14:17:16.0719788Z clusters.edge.ncr.com "2b589401-8e64-4845-ad7b-0466e8e65f13" not found 2023-06-05T14:17:16.0720303Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0720762Z PublishMessage VPNConfig vpn 2b589401-8e64-4845-ad7b-0466e8e65f13 map[] 2023-06-05T14:17:16.0721201Z vpnconfigs.remoteaccess.edge.ncr.com "2b589401-8e64-4845-ad7b-0466e8e65f13" not found 2023-06-05T14:17:16.0722336Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0722944Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0723679Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0724138Z PublishMessage Cluster 2c589401-8e64-4845-ad7b-0466e8e65f13 map[] 2023-06-05T14:17:16.0724520Z clusters.edge.ncr.com "2c589401-8e64-4845-ad7b-0466e8e65f13" not found 2023-06-05T14:17:16.0725031Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0725482Z PublishMessage VPNConfig vpn 2c589401-8e64-4845-ad7b-0466e8e65f13 map[] 2023-06-05T14:17:16.0725984Z vpnconfigs.remoteaccess.edge.ncr.com "2c589401-8e64-4845-ad7b-0466e8e65f13" not found 2023-06-05T14:17:16.0726614Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0727097Z PublishMessage Cluster 2d589401-8e64-4845-ad7b-0466e8e65f13 map[] 2023-06-05T14:17:16.0727500Z clusters.edge.ncr.com "2d589401-8e64-4845-ad7b-0466e8e65f13" not found 2023-06-05T14:17:16.0727997Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0728720Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0729103Z === RUN TestResolversFramework/TestDeleteHelmRelease 2023-06-05T14:17:16.0729619Z Chariot Message: {ChariotMessage - Banner:status_banner Cluster:3396a52c-6a22-4049-9593-5a63b596a204 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0730268Z PublishMessage VPNConfig vpn 2d589401-8e64-4845-ad7b-0466e8e65f13 map[] 2023-06-05T14:17:16.0730718Z vpnconfigs.remoteaccess.edge.ncr.com "2d589401-8e64-4845-ad7b-0466e8e65f13" not found 2023-06-05T14:17:16.0731068Z === RUN TestResolversFramework/TestDeleteHelmRepoMutation 2023-06-05T14:17:16.0732003Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0732645Z PublishMessage HelmRelease flux-system delete-helmrelease-1685974632312780837 map[parent-cluster:region-infra secret-mamager.edge.ncr.com:] 2023-06-05T14:17:16.0733212Z helmreleases.helm.toolkit.fluxcd.io "delete-helmrelease-1685974632312780837" not found 2023-06-05T14:17:16.0733800Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0734362Z PublishMessage HelmRepository flux-system delete-helmrepo-1685974631278584365 map[tenant.edge.ncr.com:test-org] 2023-06-05T14:17:16.0735087Z helmrepositories.source.toolkit.fluxcd.io "delete-helmrepo-1685974631278584365" already exists 2023-06-05T14:17:16.0735528Z === RUN TestResolversFramework/TestDeleteSecret 2023-06-05T14:17:16.0736316Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0736881Z PublishMessage HelmRepository flux-system delete-helmrepo-1685974631278584365 map[] 2023-06-05T14:17:16.0737374Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0738045Z PublishMessage Secret secret-ns-1685974632356191028 test-get-secret-store-1685974632356189392 map[] 1 2023-06-05T14:17:16.0738485Z === RUN TestResolversFramework/TestDeleteSecretManagerSecretDocker 2023-06-05T14:17:16.0738993Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0739565Z PublishMessage Secret secret-ns-1685974632356191028 test-get-secret-store-1685974632356189392 map[] 2023-06-05T14:17:16.0740171Z === RUN TestResolversFramework/TestDeleteSecretManagerSecretHelm 2023-06-05T14:17:16.0740651Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0741349Z PublishMessage ClusterExternalSecret test-create-secret-manager-1685974632379754143 map[tenant.edge.ncr.com:test-org] 2023-06-05T14:17:16.0741978Z clusterexternalsecrets.external-secrets.io "test-create-secret-manager-1685974632379754143" not found 2023-06-05T14:17:16.0742515Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0743147Z PublishMessage ClusterExternalSecret test-create-secret-manager-1685974632392925966 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0743553Z === RUN TestResolversFramework/TestDeleteTerminal 2023-06-05T14:17:16.0743986Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0744545Z PublishMessage ClusterExternalSecret test-create-secret-manager-1685974632392925966 map[tenant.edge.ncr.com:test-org] 2023-06-05T14:17:16.0744964Z === RUN TestResolversFramework/TestDeleteTerminalAddress 2023-06-05T14:17:16.0745425Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0746102Z PublishMessage IENode ien-00005e0035fa map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c201] 2023-06-05T14:17:16.0746468Z === RUN TestResolversFramework/TestDeleteTerminalError 2023-06-05T14:17:16.0746792Z === RUN TestResolversFramework/TestDeleteTerminalInterface 2023-06-05T14:17:16.0747418Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0747916Z PublishMessage IENode ien-00005e0053af map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c101] 2023-06-05T14:17:16.0748441Z ienodes.dsds.edge.ncr.com "ien-00005e0053af" already exists 2023-06-05T14:17:16.0748947Z === RUN TestResolversFramework/TestDeleteTerminalInterfaceError 2023-06-05T14:17:16.0749513Z === RUN TestResolversFramework/TestEdgeInfoConfigMap 2023-06-05T14:17:16.0749965Z === RUN TestResolversFramework/TestForgotPassword 2023-06-05T14:17:16.0750377Z === RUN TestResolversFramework/TestGKEZonesFail 2023-06-05T14:17:16.0750819Z === RUN TestResolversFramework/TestGKEZonesValid 2023-06-05T14:17:16.0751644Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0752043Z === RUN TestResolversFramework/TestGetBannerTerminals 2023-06-05T14:17:16.0752831Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0753379Z PublishMessage IENode ien-00005e0053af map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c101] 2023-06-05T14:17:16.0754120Z ienodes.dsds.edge.ncr.com "ien-00005e0053af" already exists 2023-06-05T14:17:16.0754616Z === RUN TestResolversFramework/TestGetBannerTerminalsError 2023-06-05T14:17:16.0755171Z === RUN TestResolversFramework/TestGetClusterNetworkService 2023-06-05T14:17:16.0755801Z === RUN TestResolversFramework/TestGetHelmWorkloads 2023-06-05T14:17:16.0756424Z 2023/06/05 14:17:12.499469 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:16.0756933Z 2023/06/05 14:17:12.500647 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:16.0757442Z === RUN TestResolversFramework/TestGetSecretManagerSecret 2023-06-05T14:17:16.0758223Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0758937Z PublishMessage ClusterExternalSecret test-helm-workload map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0759292Z === RUN TestResolversFramework/TestGetTerminal 2023-06-05T14:17:16.0759692Z === RUN TestResolversFramework/TestGetTerminalError 2023-06-05T14:17:16.0759987Z === RUN TestResolversFramework/TestGetTerminals 2023-06-05T14:17:16.0760528Z === RUN TestResolversFramework/TestGetTerminalsError 2023-06-05T14:17:16.0760928Z === RUN TestResolversFramework/TestGetUser 2023-06-05T14:17:16.0761441Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0761816Z === RUN TestResolversFramework/TestGetUserData 2023-06-05T14:17:16.0762316Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0762916Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0763511Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0764225Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0764803Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0765181Z === RUN TestResolversFramework/TestGetUserData_Empty 2023-06-05T14:17:16.0765949Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0766570Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0767151Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0767706Z === RUN TestResolversFramework/TestGetUserData_Multiple 2023-06-05T14:17:16.0768383Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0768958Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0769664Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0770214Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0770793Z 2023/06/05 14:17:12 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0772934Z === RUN TestResolversFramework/TestHelmChartVersion 2023-06-05T14:17:16.0773397Z 2023/06/05 14:17:12.534613 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:16.0773706Z === RUN TestResolversFramework/TestHelmCharts 2023-06-05T14:17:16.0774188Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0774752Z PublishMessage ClusterExternalSecret version-chart-secret-1685974631278584365 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0775164Z 2023/06/05 14:17:12.548990 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:16.0775469Z === RUN TestResolversFramework/TestHelmRelease 2023-06-05T14:17:16.0775957Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0776475Z PublishMessage ClusterExternalSecret helm-chart-secret-1685974631278584365 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0776984Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0777531Z PublishMessage ClusterExternalSecret bitnami map[tenant.edge.ncr.com:test-org] 2023-06-05T14:17:16.0778218Z clusterexternalsecrets.external-secrets.io "bitnami" already exists 2023-06-05T14:17:16.0778708Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0779278Z PublishMessage HelmRepository flux-system bitnami map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0779700Z === RUN TestResolversFramework/TestHelmReleasesStatus 2023-06-05T14:17:16.0780170Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0780776Z PublishMessage HelmRelease flux-system helmreleases-1685974631278584365 map[parent-cluster:region-infra secret-mamager.edge.ncr.com:bitnami] 1 2023-06-05T14:17:16.0781318Z PublishMessage Namespace helmrelease-1685974631278584365 map[workload.edge.ncr.com:tenant] 2023-06-05T14:17:16.0781709Z namespaces "helmrelease-1685974631278584365" already exists 2023-06-05T14:17:16.0782142Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0782658Z PublishMessage ClusterExternalSecret chart-secret-1685974631278584365 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0783033Z === RUN TestResolversFramework/TestHelmRepositories 2023-06-05T14:17:16.0783339Z === RUN TestResolversFramework/TestHelmRepositoryInfo 2023-06-05T14:17:16.0783764Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0784543Z PublishMessage HelmRepository flux-system helmrepos-1685974631278584365 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0785185Z 2023/06/05 14:17:14.825700 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:16.0785736Z === RUN TestResolversFramework/TestLabelValidation 2023-06-05T14:17:16.0786563Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0787486Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0788245Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0788802Z PublishMessage ClusterExternalSecret helmrepo-info-secret-1685974631278584365 map[tenant.edge.ncr.com:test-org] 1 2023-06-05T14:17:16.0789410Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0789995Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0790553Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0791307Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0791692Z === RUN TestResolversFramework/TestLabelsValidation 2023-06-05T14:17:16.0792198Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0792775Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0793339Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0793891Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0794513Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0795322Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0796193Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0796766Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0797329Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0797875Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0798259Z 2023/06/05 14:17:14.847497 WARN RESTY Using Basic Auth in HTTP mode is not secure, use HTTPS 2023-06-05T14:17:16.0798776Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0799406Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0799979Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0800328Z === RUN TestResolversFramework/TestLogin 2023-06-05T14:17:16.0800601Z === RUN TestResolversFramework/TestLoginBadPassword 2023-06-05T14:17:16.0800909Z === RUN TestResolversFramework/TestMachineTypeFail 2023-06-05T14:17:16.0801363Z === RUN TestResolversFramework/TestMachineTypeValid 2023-06-05T14:17:16.0801677Z === RUN TestResolversFramework/TestMachineTypesFail 2023-06-05T14:17:16.0802106Z === RUN TestResolversFramework/TestMachineTypesValid 2023-06-05T14:17:16.0802515Z === RUN TestResolversFramework/TestRegisterCluster 2023-06-05T14:17:16.0803202Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0803815Z Chariot Message: {ChariotMessage - Banner:test_project_id Cluster:2786eb9b-4205-4bb8-aaf7-b0f23e1085aa Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0804270Z PublishMessage ConfigMap kube-public bsl-info map[] 1 2023-06-05T14:17:16.0804604Z PublishMessage ConfigMap kube-public edge-info map[] 2023-06-05T14:17:16.0804918Z configmaps "edge-info" already exists 2023-06-05T14:17:16.0805252Z === RUN TestResolversFramework/TestRegisterClusterAddClusterResourcesError 2023-06-05T14:17:16.0805826Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0806281Z PublishMessage Cluster 2786eb9b-4205-4bb8-aaf7-b0f23e1085aa map[] 1 2023-06-05T14:17:16.0806803Z Chariot Message: {ChariotMessage - Banner:test_project_id Cluster:2430dddd-8b7a-46d6-b0b0-bedd842761f9 Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0807250Z PublishMessage ConfigMap kube-public bsl-info map[] 2023-06-05T14:17:16.0807562Z configmaps "bsl-info" already exists 2023-06-05T14:17:16.0807887Z PublishMessage ConfigMap kube-public edge-info map[] 2023-06-05T14:17:16.0808181Z configmaps "edge-info" already exists 2023-06-05T14:17:16.0808626Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0809221Z PublishMessage Cluster 2430dddd-8b7a-46d6-b0b0-bedd842761f9 map[] 1 2023-06-05T14:17:16.0809901Z Chariot Message: {ChariotMessage - Banner:test_project_id Cluster:2430dddd-8b7a-46d6-b0b0-bedd842761f9 Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0810437Z PublishMessage ConfigMap kube-public bsl-info map[] 2023-06-05T14:17:16.0810989Z PublishMessage ConfigMap kube-public edge-info map[] 2023-06-05T14:17:16.0811346Z === RUN TestResolversFramework/TestRegisterClusterByBannerEdgeID 2023-06-05T14:17:16.0812990Z 2023/06/05 14:17:14 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0813657Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:DELETE Owner:api-server Dir:} 2023-06-05T14:17:16.0814115Z PublishMessage Cluster 2430dddd-8b7a-46d6-b0b0-bedd842761f9 map[] 2023-06-05T14:17:16.0814642Z Chariot Message: {ChariotMessage - Banner:test_project_id Cluster:253c376a-6cb3-4cb3-a47a-a533bcca9577 Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0815230Z PublishMessage ConfigMap kube-public bsl-info map[] 1 2023-06-05T14:17:16.0815647Z PublishMessage ConfigMap kube-public edge-info map[] 1 2023-06-05T14:17:16.0815977Z === RUN TestResolversFramework/TestRegisterClusterCreateBanner 2023-06-05T14:17:16.0816469Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0816898Z PublishMessage Cluster 253c376a-6cb3-4cb3-a47a-a533bcca9577 map[] 1 2023-06-05T14:17:16.0817667Z Chariot Message: {ChariotMessage - Banner:test_project_id Cluster:9f3d6867-83fd-402f-b234-c395b2dfda6f Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0818187Z PublishMessage ConfigMap kube-public edge-info map[] 2023-06-05T14:17:16.0818616Z configmaps "edge-info" already exists 2023-06-05T14:17:16.0819078Z === RUN TestResolversFramework/TestRegisterClusterCreateSQLEntryError 2023-06-05T14:17:16.0820066Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0820659Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:arghlequbhr7 Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0821247Z PublishMessage Cluster 9f3d6867-83fd-402f-b234-c395b2dfda6f map[] 1 2023-06-05T14:17:16.0822097Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0823164Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0824249Z Chariot Message: {ChariotMessage - Banner:test_project_id Cluster:591fc2f0-bf08-4db5-b211-0d26f42efc76 Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0825043Z PublishMessage ConfigMap kube-public bsl-info map[] 2023-06-05T14:17:16.0825558Z configmaps "bsl-info" already exists 2023-06-05T14:17:16.0826061Z PublishMessage ConfigMap kube-public edge-info map[] 2023-06-05T14:17:16.0826499Z configmaps "edge-info" already exists 2023-06-05T14:17:16.0826858Z === RUN TestResolversFramework/TestRegisterClusterFlow 2023-06-05T14:17:16.0827873Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0828429Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0828953Z PublishMessage Cluster 591fc2f0-bf08-4db5-b211-0d26f42efc76 map[] 1 2023-06-05T14:17:16.0829482Z Chariot Message: {ChariotMessage - Banner:test_project_id Cluster:729901b3-5ec0-4be5-9a32-e656741376db Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0829906Z PublishMessage ConfigMap kube-public bsl-info map[] 2023-06-05T14:17:16.0830212Z configmaps "bsl-info" already exists 2023-06-05T14:17:16.0830534Z PublishMessage ConfigMap kube-public edge-info map[] 2023-06-05T14:17:16.0830841Z configmaps "edge-info" already exists 2023-06-05T14:17:16.0831116Z === RUN TestResolversFramework/TestRegisterExistingCluster 2023-06-05T14:17:16.0831593Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0832027Z PublishMessage Cluster 729901b3-5ec0-4be5-9a32-e656741376db map[] 1 2023-06-05T14:17:16.0832330Z === RUN TestResolversFramework/TestRoleValidation 2023-06-05T14:17:16.0832988Z === RUN TestResolversFramework/TestSecretManagerSecrets 2023-06-05T14:17:16.0833269Z === RUN TestResolversFramework/TestSiteEU 2023-06-05T14:17:16.0833895Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0834258Z === RUN TestResolversFramework/TestSiteORG 2023-06-05T14:17:16.0834794Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0835174Z === RUN TestResolversFramework/TestSiteWithMismatches 2023-06-05T14:17:16.0835716Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0836095Z === RUN TestResolversFramework/TestStoreStatusActive 2023-06-05T14:17:16.0836405Z === RUN TestResolversFramework/TestStoreStatusNotActive 2023-06-05T14:17:16.0836695Z === RUN TestResolversFramework/TestTenant 2023-06-05T14:17:16.0836967Z === RUN TestResolversFramework/TestTenants 2023-06-05T14:17:16.0837256Z === RUN TestResolversFramework/TestTokenExchange 2023-06-05T14:17:16.0837744Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0838110Z === RUN TestResolversFramework/TestUpdateBanner 2023-06-05T14:17:16.0838400Z === RUN TestResolversFramework/TestUpdateClusterName 2023-06-05T14:17:16.0838720Z === RUN TestResolversFramework/TestUpdateClusterNetworkService 2023-06-05T14:17:16.0839041Z === RUN TestResolversFramework/TestUpdateHelmRelease 2023-06-05T14:17:16.0839492Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0840016Z PublishMessage IENode ien-00005e0053af map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c101] 2023-06-05T14:17:16.0840498Z ienodes.dsds.edge.ncr.com "ien-00005e0053af" already exists 2023-06-05T14:17:16.0841013Z Chariot Message: {ChariotMessage - Banner:test-org Cluster: Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0841750Z PublishMessage ClusterExternalSecret chart-secret-1685974631278584365 map[tenant.edge.ncr.com:test-org] 2023-06-05T14:17:16.0842264Z clusterexternalsecrets.external-secrets.io "chart-secret-1685974631278584365" already exists 2023-06-05T14:17:16.0842867Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0843441Z PublishMessage HelmRelease flux-system test-helm-release map[parent-cluster:region-infra secret-mamager.edge.ncr.com:bitnami] 2023-06-05T14:17:16.0843943Z helmreleases.helm.toolkit.fluxcd.io "test-helm-release" already exists 2023-06-05T14:17:16.0844410Z PublishMessage Namespace helmrelease-1685974631278584365 map[workload.edge.ncr.com:tenant] 2023-06-05T14:17:16.0844801Z namespaces "helmrelease-1685974631278584365" already exists 2023-06-05T14:17:16.0845260Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0845834Z PublishMessage HelmRelease flux-system test-helm-release map[] 2023-06-05T14:17:16.0846244Z helmreleases.helm.toolkit.fluxcd.io "test-helm-release" already exists 2023-06-05T14:17:16.0846664Z PublishMessage Namespace flux-system map[workload.edge.ncr.com:tenant] 2023-06-05T14:17:16.0846993Z namespaces "flux-system" already exists 2023-06-05T14:17:16.0847313Z === RUN TestResolversFramework/TestUpdateInvalidHelmRelease 2023-06-05T14:17:16.0847706Z === RUN TestResolversFramework/TestUpdateSite 2023-06-05T14:17:16.0848209Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0848779Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0849312Z === RUN TestResolversFramework/TestUpdateTerminal 2023-06-05T14:17:16.0849878Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:j9bvzmydckxf Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0850422Z PublishMessage ConfigMap kube-public bsl-info map[] 2023-06-05T14:17:16.0850764Z configmaps "bsl-info" already exists 2023-06-05T14:17:16.0851188Z Chariot Message: {ChariotMessage - Banner:test-org Cluster:zao28owd8rwx Operation:CREATE Owner:api-server Dir:} 2023-06-05T14:17:16.0852132Z PublishMessage IENode ien-00005e0053af map[node.ncr.com/terminal-id:c4aa6450-3b2a-11ed-a261-0242ac12c101] 2023-06-05T14:17:16.0852554Z ienodes.dsds.edge.ncr.com "ien-00005e0053af" already exists 2023-06-05T14:17:16.0852863Z === RUN TestResolversFramework/TestUpdateTerminalError 2023-06-05T14:17:16.0853189Z === RUN TestResolversFramework/TestUpdateTerminalInvalidIP 2023-06-05T14:17:16.0853503Z === RUN TestResolversFramework/TestUpdateTerminalInvalidMac 2023-06-05T14:17:16.0853823Z === RUN TestResolversFramework/TestUpdateUserPassword 2023-06-05T14:17:16.0854159Z === RUN TestResolversFramework/TestUpdateUserPasswordWithToken 2023-06-05T14:17:16.0854486Z === RUN TestResolversFramework/TestUpdateUserProfile 2023-06-05T14:17:16.0854751Z === RUN TestResolversFramework/TestUsers 2023-06-05T14:17:16.0855021Z === RUN TestResolversFramework/TestUsersEUBanner 2023-06-05T14:17:16.0855307Z === RUN TestResolversFramework/TestUsersOrgBanner 2023-06-05T14:17:16.0855786Z === RUN TestResolversFramework/TestWhoAmINoAuth 2023-06-05T14:17:16.0856186Z === RUN TestResolversFramework/TestZones 2023-06-05T14:17:16.0856724Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0857315Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0857894Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0858460Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0859027Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0859590Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0860223Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0860794Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0861501Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0862083Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0862723Z 2023/06/05 14:17:15 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/services.notFound (bsl_mock_server.go:558) 2023-06-05T14:17:16.0863202Z 2023-06-05 14:17:11.301 UTC [69529] ERROR: invalid input syntax for type uuid: "label-not-exist" 2023-06-05T14:17:16.0863588Z 2023-06-05 14:17:11.301 UTC [69529] CONTEXT: unnamed portal parameter $2 = '...' 2023-06-05T14:17:16.0864034Z 2023-06-05 14:17:11.301 UTC [69529] STATEMENT: INSERT INTO cluster_labels(cluster_edge_id, label_edge_id) VALUES($1, $2) 2023-06-05T14:17:16.0864567Z 2023-06-05 14:17:11.303 UTC [69529] ERROR: duplicate key value violates unique constraint "cluster_labels_pkey" 2023-06-05T14:17:16.0865370Z 2023-06-05 14:17:11.303 UTC [69529] DETAIL: Key (cluster_edge_id, label_edge_id)=(3396a52c-6a22-4049-9593-5a63b596a200, ca18bfab-091b-4a7f-9db6-011d2603b949) already exists. 2023-06-05T14:17:16.0866134Z 2023-06-05 14:17:11.303 UTC [69529] STATEMENT: INSERT INTO cluster_labels(cluster_edge_id, label_edge_id) VALUES($1, $2) 2023-06-05T14:17:16.0866597Z 2023-06-05 14:17:11.572 UTC [69529] ERROR: duplicate key value violates unique constraint "banners_banner_name_key" 2023-06-05T14:17:16.0867069Z 2023-06-05 14:17:11.572 UTC [69529] DETAIL: Key (banner_name)=(test-create-org-with-error) already exists. 2023-06-05T14:17:16.0867759Z 2023-06-05 14:17:11.572 UTC [69529] STATEMENT: INSERT INTO banners(banner_bsl_id, banner_name, banner_type, project_id, tenant_edge_id, banner_edge_id, description) VALUES($1, $2, $3, $4, $5, $6, $7) 2023-06-05T14:17:16.0868372Z 2023-06-05 14:17:11.650 UTC [69529] ERROR: invalid input value for enum network_service_type: "domainnameserver" 2023-06-05T14:17:16.0868792Z 2023-06-05 14:17:11.650 UTC [69529] CONTEXT: unnamed portal parameter $4 = '...' 2023-06-05T14:17:16.0869430Z 2023-06-05 14:17:11.650 UTC [69529] STATEMENT: INSERT INTO cluster_network_services(cluster_edge_id, ip, family, service_type, priority) VALUES ($1, $2, $3, $4, $5) RETURNING network_service_id, ip, family, service_type, priority 2023-06-05T14:17:16.0869997Z 2023-06-05 14:17:12.102 UTC [69972] ERROR: invalid input syntax for type uuid: "test-org-not-exist-id" 2023-06-05T14:17:16.0870401Z 2023-06-05 14:17:12.102 UTC [69972] CONTEXT: unnamed portal parameter $1 = '...' 2023-06-05T14:17:16.0871063Z 2023-06-05 14:17:12.102 UTC [69972] STATEMENT: SELECT banner_edge_id, banner_bsl_id, banner_name, banner_type, description, project_id, tenant_edge_id FROM banners WHERE banner_edge_id = $1 LIMIT 1 2023-06-05T14:17:16.0871555Z 2023-06-05 14:17:12.457 UTC [69972] ERROR: invalid input syntax for type uuid: "" 2023-06-05T14:17:16.0872132Z 2023-06-05 14:17:12.457 UTC [69972] CONTEXT: unnamed portal parameter $1 = '' 2023-06-05T14:17:16.0872459Z 2023-06-05 14:17:12.457 UTC [69972] STATEMENT: 2023-06-05T14:17:16.0872853Z SELECT terminals.terminal_id, terminals.lane, terminals.terminal_role, terminals.cluster_edge_id, cluster.cluster_name, terminals.class, terminals.hostname 2023-06-05T14:17:16.0873326Z FROM (terminals INNER JOIN clusters AS cluster ON terminals.cluster_edge_id=cluster.cluster_edge_id) 2023-06-05T14:17:16.0873638Z WHERE terminals.terminal_id = $1; 2023-06-05T14:17:16.0873844Z 2023-06-05T14:17:16.0874168Z 2023-06-05 14:17:12.507 UTC [69972] ERROR: invalid input syntax for type uuid: "does-not-exist" 2023-06-05T14:17:16.0874562Z 2023-06-05 14:17:12.507 UTC [69972] CONTEXT: unnamed portal parameter $1 = '...' 2023-06-05T14:17:16.0874876Z 2023-06-05 14:17:12.507 UTC [69972] STATEMENT: 2023-06-05T14:17:16.0875271Z SELECT terminals.terminal_id, terminals.lane, terminals.terminal_role, terminals.cluster_edge_id, cluster.cluster_name, terminals.class, terminals.hostname 2023-06-05T14:17:16.0875787Z FROM (terminals INNER JOIN clusters AS cluster ON terminals.cluster_edge_id=cluster.cluster_edge_id) 2023-06-05T14:17:16.0876083Z WHERE terminals.terminal_id = $1; 2023-06-05T14:17:16.0876286Z 2023-06-05T14:17:16.0876683Z 2023-06-05 14:17:12.511 UTC [69972] ERROR: invalid input syntax for type uuid: "does-not-exist" 2023-06-05T14:17:16.0877280Z 2023-06-05 14:17:12.511 UTC [69972] CONTEXT: unnamed portal parameter $1 = '...' 2023-06-05T14:17:16.0877763Z 2023-06-05 14:17:12.511 UTC [69972] STATEMENT: 2023-06-05T14:17:16.0878154Z SELECT terminals.terminal_id, terminals.lane, terminals.terminal_role, terminals.cluster_edge_id, cluster.cluster_name, terminals.class, terminals.hostname 2023-06-05T14:17:16.0878717Z FROM (terminals INNER JOIN clusters AS cluster ON terminals.cluster_edge_id=cluster.cluster_edge_id) 2023-06-05T14:17:16.0879024Z WHERE cluster.cluster_edge_id = $1; 2023-06-05T14:17:16.0879229Z 2023-06-05T14:17:16.0879588Z waiting for server to shut down....2023-06-05 14:17:15.318 UTC [69509] LOG: received fast shutdown request 2023-06-05T14:17:16.0880178Z 2023-06-05 14:17:15.353 UTC [69509] LOG: aborting any active transactions 2023-06-05T14:17:16.0880591Z 2023-06-05 14:17:15.363 UTC [69972] FATAL: terminating connection due to administrator command 2023-06-05T14:17:16.0881113Z 2023-06-05 14:17:15.363 UTC [70440] FATAL: terminating connection due to administrator command 2023-06-05T14:17:16.0881527Z 2023-06-05 14:17:15.363 UTC [69529] FATAL: terminating connection due to administrator command 2023-06-05T14:17:16.0881922Z 2023-06-05 14:17:15.364 UTC [70474] FATAL: terminating connection due to administrator command 2023-06-05T14:17:16.0882396Z 2023-06-05 14:17:15.364 UTC [69509] LOG: background worker "logical replication launcher" (PID 69516) exited with exit code 1 2023-06-05T14:17:16.0882831Z 2023-06-05 14:17:15.364 UTC [70452] FATAL: terminating connection due to administrator command 2023-06-05T14:17:16.0883239Z 2023-06-05 14:17:15.366 UTC [69523] FATAL: terminating connection due to administrator command 2023-06-05T14:17:16.0883582Z 2023-06-05 14:17:15.371 UTC [69511] LOG: shutting down 2023-06-05T14:17:16.0883909Z 2023-06-05 14:17:15.973 UTC [69509] LOG: database system is shut down 2023-06-05T14:17:16.0884116Z done 2023-06-05T14:17:16.0884285Z server stopped 2023-06-05T14:17:16.0884591Z --- PASS: TestResolversFramework (14.00s) 2023-06-05T14:17:16.0885167Z --- PASS: TestResolversFramework/TestAddClusterLabels (0.02s) 2023-06-05T14:17:16.0885891Z --- PASS: TestResolversFramework/TestAddClusterLabelsError (0.00s) 2023-06-05T14:17:16.0886464Z --- PASS: TestResolversFramework/TestAssignRoleToUser (0.00s) 2023-06-05T14:17:16.0886886Z --- PASS: TestResolversFramework/TestAssignUserToEUAndOrgBanner (0.02s) 2023-06-05T14:17:16.0887427Z --- PASS: TestResolversFramework/TestAssignUserToEUBanner (0.01s) 2023-06-05T14:17:16.0887834Z --- PASS: TestResolversFramework/TestAssignUserToOrgBanner (0.00s) 2023-06-05T14:17:16.0888212Z --- PASS: TestResolversFramework/TestBanner (0.00s) 2023-06-05T14:17:16.0888603Z --- PASS: TestResolversFramework/TestBannerStatusActive (0.00s) 2023-06-05T14:17:16.0889016Z --- PASS: TestResolversFramework/TestBannerStatusAllStatus (0.00s) 2023-06-05T14:17:16.0889423Z --- PASS: TestResolversFramework/TestBannerValidation (0.01s) 2023-06-05T14:17:16.0889796Z --- PASS: TestResolversFramework/TestBanner_Mismatches (0.00s) 2023-06-05T14:17:16.0890162Z --- PASS: TestResolversFramework/TestBanners (0.00s) 2023-06-05T14:17:16.0890541Z --- PASS: TestResolversFramework/TestBanners_Mismatches (0.02s) 2023-06-05T14:17:16.0890947Z --- PASS: TestResolversFramework/TestBootstrapActiveCluster (0.06s) 2023-06-05T14:17:16.0891581Z --- PASS: TestResolversFramework/TestBootstrapActiveClusterNoLumper (0.01s) 2023-06-05T14:17:16.0892350Z --- PASS: TestResolversFramework/TestBootstrapClusterCaHash (0.01s) 2023-06-05T14:17:16.0893159Z --- PASS: TestResolversFramework/TestBootstrapClusterEdgeIDSyncing (0.02s) 2023-06-05T14:17:16.0893802Z --- PASS: TestResolversFramework/TestBootstrapClusterUsingClusterID (0.02s) 2023-06-05T14:17:16.0894262Z --- PASS: TestResolversFramework/TestBootstrapInactiveCluster (0.02s) 2023-06-05T14:17:16.0894689Z --- PASS: TestResolversFramework/TestCanAssignRoleValidation (0.00s) 2023-06-05T14:17:16.0895102Z --- PASS: TestResolversFramework/TestClusterConfigMap (0.00s) 2023-06-05T14:17:16.0895495Z --- PASS: TestResolversFramework/TestClusterLabels (0.00s) 2023-06-05T14:17:16.0895932Z --- PASS: TestResolversFramework/TestClusterNameTaken (0.00s) 2023-06-05T14:17:16.0896322Z --- PASS: TestResolversFramework/TestClusterValidation (0.00s) 2023-06-05T14:17:16.0896694Z --- PASS: TestResolversFramework/TestCreateBanner (0.03s) 2023-06-05T14:17:16.0897219Z --- PASS: TestResolversFramework/TestCreateBannerError (0.03s) 2023-06-05T14:17:16.0897783Z --- PASS: TestResolversFramework/TestCreateBannerWithDeletedEu (0.00s) 2023-06-05T14:17:16.0898341Z --- PASS: TestResolversFramework/TestCreateBannerWithDeletedOrg (0.00s) 2023-06-05T14:17:16.0899012Z --- PASS: TestResolversFramework/TestCreateBannerWithExisitingEu (0.02s) 2023-06-05T14:17:16.0899801Z --- PASS: TestResolversFramework/TestCreateBannerWithExisitingOrg (0.01s) 2023-06-05T14:17:16.0900721Z --- PASS: TestResolversFramework/TestCreateClusterNetworkService (0.03s) 2023-06-05T14:17:16.0901346Z --- PASS: TestResolversFramework/TestCreateClusterNetworkServiceInvalidIP (0.00s) 2023-06-05T14:17:16.0902210Z --- PASS: TestResolversFramework/TestCreateClusterNetworkServiceInvalidServiceType (0.00s) 2023-06-05T14:17:16.0903096Z --- PASS: TestResolversFramework/TestCreateExternalSecretHelmRelease (0.06s) 2023-06-05T14:17:16.0903825Z --- PASS: TestResolversFramework/TestCreateHelmRelease (0.03s) 2023-06-05T14:17:16.0904540Z --- PASS: TestResolversFramework/TestCreateInvalidHelmRelease (0.00s) 2023-06-05T14:17:16.0905111Z --- PASS: TestResolversFramework/TestCreateLabel (0.00s) 2023-06-05T14:17:16.0905554Z --- PASS: TestResolversFramework/TestCreateOrUpdateBannerHelmRepository (0.03s) 2023-06-05T14:17:16.0906131Z --- PASS: TestResolversFramework/TestCreateOrUpdateInvalidBannerHelmRepository (0.00s) 2023-06-05T14:17:16.0906882Z --- PASS: TestResolversFramework/TestCreateOrUpdateSecretManagerSecret (0.00s) 2023-06-05T14:17:16.0907329Z --- PASS: TestResolversFramework/TestCreateSecret (0.01s) 2023-06-05T14:17:16.0907710Z --- PASS: TestResolversFramework/TestCreateTerminal (0.07s) 2023-06-05T14:17:16.0908116Z --- PASS: TestResolversFramework/TestCreateTerminalAddress (0.02s) 2023-06-05T14:17:16.0908531Z --- PASS: TestResolversFramework/TestCreateTerminalDHCPNotSet (0.03s) 2023-06-05T14:17:16.0908957Z --- PASS: TestResolversFramework/TestCreateTerminalError (0.00s) 2023-06-05T14:17:16.0909385Z --- PASS: TestResolversFramework/TestCreateTerminalInterface (0.02s) 2023-06-05T14:17:16.0909828Z --- PASS: TestResolversFramework/TestCreateTerminalInterfaceError (0.00s) 2023-06-05T14:17:16.0910404Z --- PASS: TestResolversFramework/TestCreateTerminalInvalidCIDR (0.00s) 2023-06-05T14:17:16.0911496Z --- PASS: TestResolversFramework/TestCreateTerminalInvalidIP (0.00s) 2023-06-05T14:17:16.0912047Z --- PASS: TestResolversFramework/TestCreateTerminalInvalidMac (0.00s) 2023-06-05T14:17:16.0912723Z --- PASS: TestResolversFramework/TestCreateUpdateDeleteGetClusterConfig (0.09s) 2023-06-05T14:17:16.0913382Z --- PASS: TestResolversFramework/TestDefaultSchemaConfig (0.03s) 2023-06-05T14:17:16.0913906Z --- PASS: TestResolversFramework/TestDeleteBanner (0.04s) 2023-06-05T14:17:16.0914491Z --- PASS: TestResolversFramework/TestDeleteBannerHelmRepository (0.01s) 2023-06-05T14:17:16.0914929Z --- PASS: TestResolversFramework/TestDeleteBanner_NotExists (0.00s) 2023-06-05T14:17:16.0915321Z --- PASS: TestResolversFramework/TestDeleteCluster (0.03s) 2023-06-05T14:17:16.0915801Z --- PASS: TestResolversFramework/TestDeleteClusterAndBslSite (0.04s) 2023-06-05T14:17:16.0916374Z --- PASS: TestResolversFramework/TestDeleteClusterNetworkService (0.03s) 2023-06-05T14:17:16.0916810Z --- PASS: TestResolversFramework/TestDeleteClusters1 (0.11s) 2023-06-05T14:17:16.0917524Z --- PASS: TestResolversFramework/TestDeleteHelmRelease (0.02s) 2023-06-05T14:17:16.0918433Z --- PASS: TestResolversFramework/TestDeleteHelmRepoMutation (0.03s) 2023-06-05T14:17:16.0919109Z --- PASS: TestResolversFramework/TestDeleteSecret (0.02s) 2023-06-05T14:17:16.0919786Z --- PASS: TestResolversFramework/TestDeleteSecretManagerSecretDocker (0.01s) 2023-06-05T14:17:16.0920515Z --- PASS: TestResolversFramework/TestDeleteSecretManagerSecretHelm (0.03s) 2023-06-05T14:17:16.0921151Z --- PASS: TestResolversFramework/TestDeleteTerminal (0.02s) 2023-06-05T14:17:16.0921699Z --- PASS: TestResolversFramework/TestDeleteTerminalAddress (0.02s) 2023-06-05T14:17:16.0922336Z --- PASS: TestResolversFramework/TestDeleteTerminalError (0.00s) 2023-06-05T14:17:16.0922781Z --- PASS: TestResolversFramework/TestDeleteTerminalInterface (0.02s) 2023-06-05T14:17:16.0923793Z --- PASS: TestResolversFramework/TestDeleteTerminalInterfaceError (0.00s) 2023-06-05T14:17:16.0924613Z --- PASS: TestResolversFramework/TestEdgeInfoConfigMap (0.00s) 2023-06-05T14:17:16.0925494Z --- PASS: TestResolversFramework/TestForgotPassword (0.00s) 2023-06-05T14:17:16.0926216Z --- PASS: TestResolversFramework/TestGKEZonesFail (0.00s) 2023-06-05T14:17:16.0926853Z --- PASS: TestResolversFramework/TestGKEZonesValid (0.00s) 2023-06-05T14:17:16.0927566Z --- PASS: TestResolversFramework/TestGetBannerTerminals (0.00s) 2023-06-05T14:17:16.0928434Z --- PASS: TestResolversFramework/TestGetBannerTerminalsError (0.00s) 2023-06-05T14:17:16.0929176Z --- PASS: TestResolversFramework/TestGetClusterNetworkService (0.00s) 2023-06-05T14:17:16.0929913Z --- PASS: TestResolversFramework/TestGetHelmWorkloads (0.02s) 2023-06-05T14:17:16.0930677Z --- PASS: TestResolversFramework/TestGetSecretManagerSecret (0.00s) 2023-06-05T14:17:16.0931372Z --- PASS: TestResolversFramework/TestGetTerminal (0.00s) 2023-06-05T14:17:16.0932456Z --- PASS: TestResolversFramework/TestGetTerminalError (0.00s) 2023-06-05T14:17:16.0933158Z --- PASS: TestResolversFramework/TestGetTerminals (0.00s) 2023-06-05T14:17:16.0933936Z --- PASS: TestResolversFramework/TestGetTerminalsError (0.00s) 2023-06-05T14:17:16.0934533Z --- PASS: TestResolversFramework/TestGetUser (0.00s) 2023-06-05T14:17:16.0935121Z --- PASS: TestResolversFramework/TestGetUserData (0.00s) 2023-06-05T14:17:16.0935725Z --- PASS: TestResolversFramework/TestGetUserData_Empty (0.00s) 2023-06-05T14:17:16.0936697Z --- PASS: TestResolversFramework/TestGetUserData_Multiple (0.00s) 2023-06-05T14:17:16.0937410Z --- PASS: TestResolversFramework/TestHelmChartVersion (0.01s) 2023-06-05T14:17:16.0937907Z --- PASS: TestResolversFramework/TestHelmCharts (0.01s) 2023-06-05T14:17:16.0938274Z --- PASS: TestResolversFramework/TestHelmRelease (2.23s) 2023-06-05T14:17:16.0938663Z --- PASS: TestResolversFramework/TestHelmReleasesStatus (0.02s) 2023-06-05T14:17:16.0939065Z --- PASS: TestResolversFramework/TestHelmRepositories (0.01s) 2023-06-05T14:17:16.0939467Z --- PASS: TestResolversFramework/TestHelmRepositoryInfo (0.01s) 2023-06-05T14:17:16.0940051Z --- PASS: TestResolversFramework/TestLabelValidation (0.01s) 2023-06-05T14:17:16.0940458Z --- PASS: TestResolversFramework/TestLabelsValidation (0.01s) 2023-06-05T14:17:16.0940824Z --- PASS: TestResolversFramework/TestLogin (0.00s) 2023-06-05T14:17:16.0941203Z --- PASS: TestResolversFramework/TestLoginBadPassword (0.00s) 2023-06-05T14:17:16.0941591Z --- PASS: TestResolversFramework/TestMachineTypeFail (0.00s) 2023-06-05T14:17:16.0941982Z --- PASS: TestResolversFramework/TestMachineTypeValid (0.00s) 2023-06-05T14:17:16.0942357Z --- PASS: TestResolversFramework/TestMachineTypesFail (0.00s) 2023-06-05T14:17:16.0942754Z --- PASS: TestResolversFramework/TestMachineTypesValid (0.00s) 2023-06-05T14:17:16.0943262Z --- PASS: TestResolversFramework/TestRegisterCluster (0.03s) 2023-06-05T14:17:16.0943741Z --- PASS: TestResolversFramework/TestRegisterClusterAddClusterResourcesError (0.05s) 2023-06-05T14:17:16.0944240Z --- PASS: TestResolversFramework/TestRegisterClusterByBannerEdgeID (0.04s) 2023-06-05T14:17:16.0944687Z --- PASS: TestResolversFramework/TestRegisterClusterCreateBanner (0.03s) 2023-06-05T14:17:16.0945174Z --- PASS: TestResolversFramework/TestRegisterClusterCreateSQLEntryError (0.03s) 2023-06-05T14:17:16.0945825Z --- PASS: TestResolversFramework/TestRegisterClusterFlow (0.04s) 2023-06-05T14:17:16.0946258Z --- PASS: TestResolversFramework/TestRegisterExistingCluster (0.00s) 2023-06-05T14:17:16.0946652Z --- PASS: TestResolversFramework/TestRoleValidation (0.00s) 2023-06-05T14:17:16.0947353Z --- PASS: TestResolversFramework/TestSecretManagerSecrets (0.01s) 2023-06-05T14:17:16.0947770Z --- PASS: TestResolversFramework/TestSiteEU (0.00s) 2023-06-05T14:17:16.0948128Z --- PASS: TestResolversFramework/TestSiteORG (0.00s) 2023-06-05T14:17:16.0948767Z --- PASS: TestResolversFramework/TestSiteWithMismatches (0.00s) 2023-06-05T14:17:16.0949301Z --- PASS: TestResolversFramework/TestStoreStatusActive (0.00s) 2023-06-05T14:17:16.0949708Z --- PASS: TestResolversFramework/TestStoreStatusNotActive (0.00s) 2023-06-05T14:17:16.0950084Z --- PASS: TestResolversFramework/TestTenant (0.00s) 2023-06-05T14:17:16.0950440Z --- PASS: TestResolversFramework/TestTenants (0.00s) 2023-06-05T14:17:16.0950796Z --- PASS: TestResolversFramework/TestTokenExchange (0.00s) 2023-06-05T14:17:16.0951175Z --- PASS: TestResolversFramework/TestUpdateBanner (0.00s) 2023-06-05T14:17:16.0951566Z --- PASS: TestResolversFramework/TestUpdateClusterName (0.00s) 2023-06-05T14:17:16.0951997Z --- PASS: TestResolversFramework/TestUpdateClusterNetworkService (0.01s) 2023-06-05T14:17:16.0952418Z --- PASS: TestResolversFramework/TestUpdateHelmRelease (0.07s) 2023-06-05T14:17:16.0952827Z --- PASS: TestResolversFramework/TestUpdateInvalidHelmRelease (0.00s) 2023-06-05T14:17:16.0953225Z --- PASS: TestResolversFramework/TestUpdateSite (0.02s) 2023-06-05T14:17:16.0953604Z --- PASS: TestResolversFramework/TestUpdateTerminal (0.06s) 2023-06-05T14:17:16.0954001Z --- PASS: TestResolversFramework/TestUpdateTerminalError (0.00s) 2023-06-05T14:17:16.0954423Z --- PASS: TestResolversFramework/TestUpdateTerminalInvalidIP (0.04s) 2023-06-05T14:17:16.0954843Z --- PASS: TestResolversFramework/TestUpdateTerminalInvalidMac (0.01s) 2023-06-05T14:17:16.0955257Z --- PASS: TestResolversFramework/TestUpdateUserPassword (0.00s) 2023-06-05T14:17:16.0955739Z --- PASS: TestResolversFramework/TestUpdateUserPasswordWithToken (0.00s) 2023-06-05T14:17:16.0956165Z --- PASS: TestResolversFramework/TestUpdateUserProfile (0.00s) 2023-06-05T14:17:16.0956521Z --- PASS: TestResolversFramework/TestUsers (0.00s) 2023-06-05T14:17:16.0956885Z --- PASS: TestResolversFramework/TestUsersEUBanner (0.00s) 2023-06-05T14:17:16.0957281Z --- PASS: TestResolversFramework/TestUsersOrgBanner (0.00s) 2023-06-05T14:17:16.0957658Z --- PASS: TestResolversFramework/TestWhoAmINoAuth (0.00s) 2023-06-05T14:17:16.0958023Z --- PASS: TestResolversFramework/TestZones (0.00s) 2023-06-05T14:17:16.0958240Z PASS 2023-06-05T14:17:16.0958439Z ================================================================================ 2023-06-05T14:17:16.1866043Z INFO: From Testing //test/f2/x/ktest/kssert:kssert_test: 2023-06-05T14:17:16.1866661Z ==================== Test output for //test/f2/x/ktest/kssert:kssert_test: 2023-06-05T14:17:16.1867098Z === RUN TestHasConditions 2023-06-05T14:17:16.1867501Z === RUN TestHasConditions/empty 2023-06-05T14:17:16.1867937Z === RUN TestHasConditions/passing_check 2023-06-05T14:17:16.1868442Z === RUN TestHasConditions/extra_conditions 2023-06-05T14:17:16.1868898Z === RUN TestHasConditions/partial_match 2023-06-05T14:17:16.1869311Z === RUN TestHasConditions/no_match 2023-06-05T14:17:16.1869856Z --- PASS: TestHasConditions (0.00s) 2023-06-05T14:17:16.1870402Z --- PASS: TestHasConditions/empty (0.00s) 2023-06-05T14:17:16.1871016Z --- PASS: TestHasConditions/passing_check (0.00s) 2023-06-05T14:17:16.1871631Z --- PASS: TestHasConditions/extra_conditions (0.00s) 2023-06-05T14:17:16.1872249Z --- PASS: TestHasConditions/partial_match (0.00s) 2023-06-05T14:17:16.1872831Z --- PASS: TestHasConditions/no_match (0.00s) 2023-06-05T14:17:16.1873268Z === RUN TestOnlyHasConditions 2023-06-05T14:17:16.1873708Z === RUN TestOnlyHasConditions/passing_check 2023-06-05T14:17:16.1874182Z === RUN TestOnlyHasConditions/extra_conditions 2023-06-05T14:17:16.1874650Z === RUN TestOnlyHasConditions/no_match 2023-06-05T14:17:16.1875097Z === RUN TestOnlyHasConditions/empty 2023-06-05T14:17:16.1875755Z --- PASS: TestOnlyHasConditions (0.00s) 2023-06-05T14:17:16.1876345Z --- PASS: TestOnlyHasConditions/passing_check (0.00s) 2023-06-05T14:17:16.1877001Z --- PASS: TestOnlyHasConditions/extra_conditions (0.00s) 2023-06-05T14:17:16.1878069Z --- PASS: TestOnlyHasConditions/no_match (0.00s) 2023-06-05T14:17:16.1878698Z --- PASS: TestOnlyHasConditions/empty (0.00s) 2023-06-05T14:17:16.1879330Z === RUN TestHasTrueConditions 2023-06-05T14:17:16.1879743Z === RUN TestHasTrueConditions/empty 2023-06-05T14:17:16.1880206Z === RUN TestHasTrueConditions/passing_check 2023-06-05T14:17:16.1880679Z === RUN TestHasTrueConditions/extra_conditions 2023-06-05T14:17:16.1881154Z === RUN TestHasTrueConditions/mixed_true/false 2023-06-05T14:17:16.1881631Z === RUN TestHasTrueConditions/not_true 2023-06-05T14:17:16.1882190Z --- PASS: TestHasTrueConditions (0.00s) 2023-06-05T14:17:16.1882751Z --- PASS: TestHasTrueConditions/empty (0.00s) 2023-06-05T14:17:16.1883365Z --- PASS: TestHasTrueConditions/passing_check (0.00s) 2023-06-05T14:17:16.1883988Z --- PASS: TestHasTrueConditions/extra_conditions (0.00s) 2023-06-05T14:17:16.1884644Z --- PASS: TestHasTrueConditions/mixed_true/false (0.00s) 2023-06-05T14:17:16.1885347Z --- PASS: TestHasTrueConditions/not_true (0.00s) 2023-06-05T14:17:16.1885811Z === RUN TestHasSameConditions 2023-06-05T14:17:16.1886263Z === RUN TestHasSameConditions/extra_conditions 2023-06-05T14:17:16.1886737Z === RUN TestHasSameConditions/not_true 2023-06-05T14:17:16.1887191Z === RUN TestHasSameConditions/empty 2023-06-05T14:17:16.1887673Z === RUN TestHasSameConditions/passing_check 2023-06-05T14:17:16.1888236Z --- PASS: TestHasSameConditions (0.00s) 2023-06-05T14:17:16.1888861Z --- PASS: TestHasSameConditions/extra_conditions (0.00s) 2023-06-05T14:17:16.1889463Z --- PASS: TestHasSameConditions/not_true (0.00s) 2023-06-05T14:17:16.1890056Z --- PASS: TestHasSameConditions/empty (0.00s) 2023-06-05T14:17:16.1890665Z --- PASS: TestHasSameConditions/passing_check (0.00s) 2023-06-05T14:17:16.1891074Z PASS 2023-06-05T14:17:16.1891590Z ================================================================================ 2023-06-05T14:17:16.2958887Z INFO: From Testing //pkg/edge/chariot:chariot_test: 2023-06-05T14:17:16.2959493Z ==================== Test output for //pkg/edge/chariot:chariot_test: 2023-06-05T14:17:16.2960079Z === RUN TestFakeGcsServerSetsMD5InObjectAttrs 2023-06-05T14:17:16.2960644Z fakegcsserver_test.go:63: Want MD5 hash: "9e38f88d728ac72dbcd875d2536b2af3" 2023-06-05T14:17:16.2961349Z fakegcsserver_test.go:88: Got MD5 hash "9e38f88d728ac72dbcd875d2536b2af3" for Object().Attrs() function 2023-06-05T14:17:16.2961930Z fakegcsserver_test.go:113: Got MD5 hash "9e38f88d728ac72dbcd875d2536b2af3" for Objects().Next() function 2023-06-05T14:17:16.2962753Z fakegcsserver_test.go:117: Got correct MD5 hash values from fake-gcs-server 2023-06-05T14:17:16.2963496Z --- PASS: TestFakeGcsServerSetsMD5InObjectAttrs (0.01s) 2023-06-05T14:17:16.2964088Z === RUN TestStartFakeGcsServerWithFakeStorageObjects 2023-06-05T14:17:16.2964582Z fakegcsserver_test.go:155: Success, bytes downloaded equal bytes input. 2023-06-05T14:17:16.2965330Z --- PASS: TestStartFakeGcsServerWithFakeStorageObjects (0.00s) 2023-06-05T14:17:16.2965760Z === RUN TestFakeGcsServerWriterOverwritingFilesWorks 2023-06-05T14:17:16.2966091Z fakegcsserver_test.go:220: Successfully overwrote file 2023-06-05T14:17:16.2966480Z --- PASS: TestFakeGcsServerWriterOverwritingFilesWorks (0.02s) 2023-06-05T14:17:16.2966814Z === RUN TestFakeGcsServerDeleteFilesWorks 2023-06-05T14:17:16.2967266Z fakegcsserver_test.go:272: Successfully deleted file. NewReader gave error: "storage: object doesn't exist" 2023-06-05T14:17:16.2967674Z --- PASS: TestFakeGcsServerDeleteFilesWorks (0.01s) 2023-06-05T14:17:16.2967995Z === RUN TestFakeGcsServerWriterWritingFilesWorks 2023-06-05T14:17:16.2968420Z fakegcsserver_test.go:338: Successfully created new file object 2023-06-05T14:17:16.2968811Z --- PASS: TestFakeGcsServerWriterWritingFilesWorks (0.01s) 2023-06-05T14:17:16.2969116Z === RUN TestIncGoogleAPIErrorsTotal 2023-06-05T14:17:16.2969811Z assert.go:252: assertion passed. folded metric value 1.000000 equals expected total 1.000000 2023-06-05T14:17:16.2970251Z assert.go:252: assertion passed. folded metric value 2.000000 equals expected total 2.000000 2023-06-05T14:17:16.2970993Z assert.go:252: assertion passed. folded metric value 3.000000 equals expected total 3.000000 2023-06-05T14:17:16.2971341Z assert.go:252: assertion passed. folded metric value 6.000000 equals expected total 6.000000 2023-06-05T14:17:16.2972080Z assert.go:252: assertion passed. folded metric value 7.000000 equals expected total 7.000000 2023-06-05T14:17:16.2972395Z assert.go:208: assertion passed. the metric exists 2023-06-05T14:17:16.2972701Z assert.go:252: assertion passed. folded metric value 7.000000 equals expected total 7.000000 2023-06-05T14:17:16.2973051Z assert.go:252: assertion passed. folded metric value 1.000000 equals expected total 1.000000 2023-06-05T14:17:16.2973390Z assert.go:252: assertion passed. folded metric value 1.000000 equals expected total 1.000000 2023-06-05T14:17:16.2973743Z assert.go:252: assertion passed. folded metric value 2.000000 equals expected total 2.000000 2023-06-05T14:17:16.2974087Z assert.go:252: assertion passed. folded metric value 3.000000 equals expected total 3.000000 2023-06-05T14:17:16.2974414Z assert.go:252: assertion passed. folded metric value 3.000000 equals expected total 3.000000 2023-06-05T14:17:16.2974749Z assert.go:252: assertion passed. folded metric value 1.000000 equals expected total 1.000000 2023-06-05T14:17:16.2975199Z --- PASS: TestIncGoogleAPIErrorsTotal (0.01s) 2023-06-05T14:17:16.2975524Z === RUN TestRequestsTotalMetrics 2023-06-05T14:17:16.2975795Z metrics_test.go:139: Got "chariot2_requests_total" value 0.000000 2023-06-05T14:17:16.2976075Z metrics_test.go:141: Got "chariot2_errors_total" value 0.000000 2023-06-05T14:17:16.2977161Z {"severity":"info","message":"Storage Info","request_pubsub_id":"1","storage_info":{"objects_put":[{"location":"gs://testbucket/cluster2/chariot/06b8cc20d72df2ff21a38478d6fea74d.yaml"},{"location":"gs://testbucket/cluster2/chariot/72db55ae200cfa320a36f3c398edb9ef.yaml"},{"location":"gs://testbucket/cluster2/chariot/fa16a704f7adaf5d10aee97234ac18ff.yaml"},{"location":"gs://testbucket/cluster2/chariot/42d717375fe9169bbf1bb168a1268d72.yaml"},{"location":"gs://testbucket/cluster2/chariot/f46fe21549b6ac2878d9aac8a375fa5c.yaml"}]}} 2023-06-05T14:17:16.2977915Z metrics_test.go:174: Got ack from message 1 2023-06-05T14:17:16.2978224Z assert.go:252: assertion passed. folded metric value 1.000000 equals expected total 1.000000 2023-06-05T14:17:16.2978573Z metrics_test.go:182: Yay, the requests total metric value increased by 1 as expected 2023-06-05T14:17:16.2978949Z --- PASS: TestRequestsTotalMetrics (0.03s) 2023-06-05T14:17:16.2979199Z === RUN TestRequestsTotalSadPath 2023-06-05T14:17:16.2979460Z metrics_test.go:228: Got requests total value 0.000000 2023-06-05T14:17:16.2979727Z metrics_test.go:231: Got errors total value 0.000000 2023-06-05T14:17:16.3207786Z {"message":"Error parsing request JSON","severity":"error","error":"Request validation error: Unsupported Operation \"DANCE\"","pubsub_data":"eyJvcGVyYXRpb24iOiJEQU5DRSIsIm9iamVjdHMiOlsiWVhCcFZtVnljMmx2YmpvZ1kyeDFjM1JsY25KbFoybHpkSEo1TG1zNGN5NXBieTkyTVdGc2NHaGhNUXByYVc1a09pQlVaVzVoYm5RS2JXVjBZV1JoZEdFNkNpQWdibUZ0WlRvZ056ZzJaamxtTkdKbFl6UXdaamcwWXpnNU1tSTVZbVptWkRRek5qSTVZakFLSUNCdVlXMWxjM0JoWTJVNklDSWlDaUFnYkdGaVpXeHpPZ29nSUNBZ1kyeDFjM1JsY2k1bFpHZGxMbTVqY2k1amIyMDZJQ0l5TWpBME1ETTNOQ0lLSUNBZ0lHTnNkWE4wWlhJdVpXUm5aUzV1WTNJdVkyOXRMM1I1Y0dVNklHWTJPVEkwWWprNENpQWdJQ0JtYkdWbGRDNWxaR2RsTG01amNpNWpiMjA2SUdOaVpqZzNNVE5tQ2c9PSIsIllYQnBWbVZ5YzJsdmJqb2dZMngxYzNSbGNuSmxaMmx6ZEhKNUxtczRjeTVwYnk5Mk1XRnNjR2hoTVFwcmFXNWtPaUJPWVcxbGMzQmhZMlVLYldWMFlXUmhkR0U2Q2lBZ2JtRnRaVG9nT0dRNU5qSmtNalJsTW1OaFptTmpZV1V6WVRZeFptSTFPRFppTVRRek1qTUtJQ0J1WVcxbGMzQmhZMlU2SUdkdlpHOWpDaUFnYkdGaVpXeHpPaUI3ZlFvPSIsIllYQnBWbVZ5YzJsdmJqb2dZMngxYzNSbGNuSmxaMmx6ZEhKNUxtczRjeTVwYnk5Mk1XRnNjR2hoTVFwcmFXNWtPaUJPWVcxbGMzQmhZMlVLYldWMFlXUmhkR0U2Q2lBZ2JtRnRaVG9nWVRZd05qZGtPRGxpWXpkbU1ERm1NV1kxTnpNNU9ERTJOVGxoTkRSbVpqRUtJQ0J1WVcxbGMzQmhZMlU2SUNJaUNpQWdiR0ZpWld4ek9pQjdmUW89IiwiWVhCcFZtVnljMmx2YmpvZ1kyeDFjM1JsY25KbFoybHpkSEo1TG1zNGN5NXBieTkyTVdGc2NHaGhNUXByYVc1a09pQk9ZVzFsYzNCaFkyVUtiV1YwWVdSaGRHRTZDaUFnYm1GdFpUb2dOMkUwWXpjeU1UVmhNMkkxT0RFNU9UaGxZbVZoT0Rsak1HSTBZak0zTXprS0lDQnVZVzFsYzNCaFkyVTZJQ0lpQ2lBZ2JHRmlaV3h6T2lCN2ZRbz0iLCJZWEJwVm1WeWMybHZiam9nWTJ4MWMzUmxjbkpsWjJsemRISjVMbXM0Y3k1cGJ5OTJNV0ZzY0doaE1RcHJhVzVrT2lCRGJIVnpkR1Z5Q20xbGRHRmtZWFJoT2dvZ0lHNWhiV1U2SURjd01URTFaVGd5TXpaalpEUm1NalJoWW1ZM1pHWTROalppWVdFMU5qQXpDaUFnYm1GdFpYTndZV05sT2lBaUlnb2dJR3hoWW1Wc2N6b0tJQ0FnSUdOc2RYTjBaWEl1WldSblpTNXVZM0l1WTI5dE9pQTRNelkzTTJFd1lRb2dJQ0FnWTJ4MWMzUmxjaTVsWkdkbExtNWpjaTVqYjIwdmRIbHdaVG9nWkRoaVpUbGpNemtLSUNBZ0lHWnNaV1YwTG1Wa1oyVXVibU55TG1OdmJUb2dOemhpTURRNE9ETUsiXSwiYmFubmVyIjoidGVzdGJ1Y2tldCIsImNsdXN0ZXIiOiJjbHVzdGVyMiIsIm93bmVyIjoidGVzdCJ9","pubsub_request_id":"1"} 2023-06-05T14:17:16.3416263Z metrics_test.go:266: Got ack from message 1 2023-06-05T14:17:16.3416864Z assert.go:252: assertion passed. folded metric value 1.000000 equals expected total 1.000000 2023-06-05T14:17:16.3417480Z assert.go:252: assertion passed. folded metric value 1.000000 equals expected total 1.000000 2023-06-05T14:17:16.3418414Z --- PASS: TestRequestsTotalSadPath (0.01s) 2023-06-05T14:17:16.3418910Z === RUN TestDeadlineExceededTotalMetrics 2023-06-05T14:17:16.3419382Z metrics_test.go:322: Got deadline exceeded total value 0.000000 2023-06-05T14:17:16.3419849Z metrics_test.go:325: Got errors total value 1.000000 2023-06-05T14:17:16.3426691Z {"severity":"error","message":"Storage Info","request_pubsub_id":"1","storage_info":{"errors":[{"object":{"location":"gs://testbucket/cluster2/chariot/f4bd5f273e886d9b6f8bc7f596573d69.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Namespace\nmetadata:\n name: e56a156a9dec6a40e9a1d007f033c282\n namespace: \"\"\n labels:\n cluster.edge.ncr.com: \"30612968\"\n cluster.edge.ncr.com/type: 8b734b8e\n fleet.edge.ncr.com: a0f3ca99\n"},"error":"context deadline exceeded"},{"object":{"location":"gs://testbucket/cluster2/chariot/83c6b80595b92adbe0c215c89e82ed23.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Cluster\nmetadata:\n name: 36e8461fa665f606f6a63b7f3dfd2567\n namespace: \"\"\n labels: {}\n"},"error":"context deadline exceeded"},{"object":{"location":"gs://testbucket/cluster2/chariot/79142b0bec8b9fbe22617c275d0fdfec.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Tenant\nmetadata:\n name: c1894b39f32b7c7822ba64f84ab43ca0\n namespace: ci\n labels:\n cluster.edge.ncr.com: 2d184fc3\n cluster.edge.ncr.com/type: 9d1734ff\n fleet.edge.ncr.com: \"57164289\"\n"},"error":"context deadline exceeded"},{"object":{"location":"gs://testbucket/cluster2/chariot/b9c774992d5ac3f857793e6ea704d48d.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Tenant\nmetadata:\n name: 53bb17c9028be9914eb7649c6c934780\n namespace: \"\"\n labels: {}\n"},"error":"context deadline exceeded"},{"object":{"location":"gs://testbucket/cluster2/chariot/e4b0b169bc8bc5861ea60f64e5889659.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Tenant\nmetadata:\n name: 6987c77f5818526f1814be823350eab1\n namespace: policy-bot\n labels:\n cluster.edge.ncr.com: 3935f31d\n cluster.edge.ncr.com/type: 840c30ec\n fleet.edge.ncr.com: 29a37039\n"},"error":"context deadline exceeded"}]}} 2023-06-05T14:17:16.3430705Z {"message":"Retry chariot request","severity":"info","pubsub_request_id":"1","retry_reason":"Storage operation failed: Got errors putting objects: count=5"} 2023-06-05T14:17:16.3431498Z {"message":"Ack deadline expired","severity":"error","pubsub_request_id":"1","timeout_duration":"0s","why":"Ack deadline reached while performing storage operation"} 2023-06-05T14:17:16.3432026Z metrics_test.go:360: Got nack from message 2023-06-05T14:17:16.3432536Z assert.go:252: assertion passed. folded metric value 1.000000 equals expected total 1.000000 2023-06-05T14:17:16.3433542Z assert.go:252: assertion passed. folded metric value 2.000000 equals expected total 2.000000 2023-06-05T14:17:16.3434563Z --- PASS: TestDeadlineExceededTotalMetrics (0.01s) 2023-06-05T14:17:16.3435015Z === RUN TestDaemonCreatesObjects 2023-06-05T14:17:16.3435526Z mockpubsubpull_test.go:163: Sending 4 create requests to the Daemon 2023-06-05T14:17:16.3436725Z {"severity":"info","message":"Storage Info","request_pubsub_id":"0","storage_info":{"objects_put":[{"location":"gs://testbucket/chariot/d835ed00c33bb14d7079283c66c4f8ee.yaml"},{"location":"gs://testbucket/chariot/802cd9ab8760258d79f9df0e8a3ebe8a.yaml"},{"location":"gs://testbucket/chariot/6329be9dfe2dba744d0a8666c5c240bf.yaml"},{"location":"gs://testbucket/chariot/f66619ce214a8ca85538f848e3125302.yaml"},{"location":"gs://testbucket/chariot/9da3509dcb334366c271931e53ad9882.yaml"}]}} 2023-06-05T14:17:16.3437730Z mockpubsubpull_test.go:182: Got ack from message 1 2023-06-05T14:17:16.3438907Z {"severity":"info","message":"Storage Info","request_pubsub_id":"1","storage_info":{"objects_put":[{"location":"gs://testbucket/cluster1/chariot/7177418031afb9e95d7d392cc193e6ee.yaml"},{"location":"gs://testbucket/cluster1/chariot/bdd71731ec022f62bd6c06c997d0cb3e.yaml"},{"location":"gs://testbucket/cluster1/chariot/f87ef060119a64960e4c83e0e52d01d5.yaml"},{"location":"gs://testbucket/cluster1/chariot/3365b7f8425abc17c112bafc040e2c3b.yaml"},{"location":"gs://testbucket/cluster1/chariot/188b497bd14014502666af77c393fe67.yaml"}]}} 2023-06-05T14:17:16.3440073Z mockpubsubpull_test.go:182: Got ack from message 2 2023-06-05T14:17:16.3441156Z {"severity":"info","message":"Storage Info","request_pubsub_id":"2","storage_info":{"objects_put":[{"location":"gs://testbucket/chariot/032c652d62837536c9d8125d3d27294f.yaml"},{"location":"gs://testbucket/chariot/174bc9d408cf288a010ef3b53448aba6.yaml"},{"location":"gs://testbucket/chariot/a3fa5072d4566c032c182d8c5c89a518.yaml"},{"location":"gs://testbucket/chariot/9f8e3ef137266f0c4d70a3e79c8acc78.yaml"},{"location":"gs://testbucket/chariot/4c16a3655f4f070672032e11173ac16c.yaml"}]}} 2023-06-05T14:17:16.3442208Z mockpubsubpull_test.go:182: Got ack from message 3 2023-06-05T14:17:16.3443347Z {"severity":"info","message":"Storage Info","request_pubsub_id":"3","storage_info":{"objects_put":[{"location":"gs://testbucket/cluster2/chariot/bdb32c3a109948ae13802668191c8025.yaml"},{"location":"gs://testbucket/cluster2/chariot/7374fd70b14b8e26c65adc3903d7a9c3.yaml"},{"location":"gs://testbucket/cluster2/chariot/23a303569011158922a0afdc2142cc34.yaml"},{"location":"gs://testbucket/cluster2/chariot/64bff861de1e8bac6bbbb289b43fdfb0.yaml"},{"location":"gs://testbucket/cluster2/chariot/ab1166eff4d839f6e985cc1395ee389b.yaml"}]}} 2023-06-05T14:17:16.3444484Z mockpubsubpull_test.go:182: Got ack from message 4 2023-06-05T14:17:16.3444943Z mockpubsubpull_test.go:189: Got acks from all 4 requests 2023-06-05T14:17:16.3445481Z mockpubsubpull_test.go:197: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3445982Z mockpubsubpull_test.go:197: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3446448Z mockpubsubpull_test.go:197: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3446928Z mockpubsubpull_test.go:197: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3447417Z mockpubsubpull_test.go:203: Successfully created all objects in GCS storage 2023-06-05T14:17:16.3448083Z --- PASS: TestDaemonCreatesObjects (0.09s) 2023-06-05T14:17:16.3448478Z === RUN TestDaemonDeletesObjects 2023-06-05T14:17:16.3448924Z mockpubsubpull_test.go:297: Sending 4 create requests to the Daemon 2023-06-05T14:17:16.3450475Z {"severity":"info","message":"Storage Info","request_pubsub_id":"0","storage_info":{"objects_put":[{"location":"gs://testbucket/chariot/da8151874abfa705c45b23d4d699d3d2.yaml"},{"location":"gs://testbucket/chariot/df4112d1b44818808817adb321d7674e.yaml"},{"location":"gs://testbucket/chariot/fc88a08eed0bf3426e1fd982b8981434.yaml"},{"location":"gs://testbucket/chariot/6f6f48cd332b1cbbd4e914f109f35f1a.yaml"},{"location":"gs://testbucket/chariot/69114fb1b6233f5d87425256f3f7948f.yaml"}]}} 2023-06-05T14:17:16.3451794Z mockpubsubpull_test.go:316: Got ack from message 1 2023-06-05T14:17:16.3453304Z {"severity":"info","message":"Storage Info","request_pubsub_id":"1","storage_info":{"objects_put":[{"location":"gs://testbucket/cluster1/chariot/1cc8a4880ebb774dd17551f5c7c9826c.yaml"},{"location":"gs://testbucket/cluster1/chariot/843764c1f8a6329d51ab5353ac896807.yaml"},{"location":"gs://testbucket/cluster1/chariot/6b9482163b07736db808ecb466f2cc2d.yaml"},{"location":"gs://testbucket/cluster1/chariot/bf80e343ed3695780fb74e6673b86347.yaml"},{"location":"gs://testbucket/cluster1/chariot/7b666423bd58dd973ebfb158ca3c46b9.yaml"}]}} 2023-06-05T14:17:16.3454420Z mockpubsubpull_test.go:316: Got ack from message 2 2023-06-05T14:17:16.3455716Z {"severity":"info","message":"Storage Info","request_pubsub_id":"2","storage_info":{"objects_put":[{"location":"gs://testbucket/chariot/b647c41e37ed1fd3f6153457b8cef78a.yaml"},{"location":"gs://testbucket/chariot/464e254c655d75010a0985e3a2ed85cd.yaml"},{"location":"gs://testbucket/chariot/064fbfa29cfc54c6dd2cac305222e4bf.yaml"},{"location":"gs://testbucket/chariot/eb45bbdce045c7f9adb3ddcc0bb48544.yaml"},{"location":"gs://testbucket/chariot/33b7ef7dd4e98607ed055bdb15aad79c.yaml"}]}} 2023-06-05T14:17:16.3456891Z mockpubsubpull_test.go:316: Got ack from message 3 2023-06-05T14:17:16.3458163Z {"severity":"info","message":"Storage Info","request_pubsub_id":"3","storage_info":{"objects_put":[{"location":"gs://testbucket/cluster2/chariot/403224fed80d719d10f2f90080bf0173.yaml"},{"location":"gs://testbucket/cluster2/chariot/2bb0fc9004368b7bd72f032b223545fd.yaml"},{"location":"gs://testbucket/cluster2/chariot/3960a151d3200688a2c8b90e797b3259.yaml"},{"location":"gs://testbucket/cluster2/chariot/02be0e7559be19a7c5e2f2639b6b3d76.yaml"},{"location":"gs://testbucket/cluster2/chariot/79f3b25a2bf0c0291c6db9a3fd8f264c.yaml"}]}} 2023-06-05T14:17:16.3459330Z mockpubsubpull_test.go:316: Got ack from message 4 2023-06-05T14:17:16.3459834Z mockpubsubpull_test.go:323: Got acks from all 4 requests 2023-06-05T14:17:16.3460303Z mockpubsubpull_test.go:331: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3460826Z mockpubsubpull_test.go:331: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3461350Z mockpubsubpull_test.go:331: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3461849Z mockpubsubpull_test.go:331: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3462307Z mockpubsubpull_test.go:337: Created all objects in GCS storage 2023-06-05T14:17:16.3462803Z mockpubsubpull_test.go:339: Now testing the deletion of the created objects in GCS 2023-06-05T14:17:16.3463578Z {"severity":"info","message":"Storage Info","request_pubsub_id":"0","storage_info":{"objects_deleted":[{"location":"gs://testbucket/chariot/df4112d1b44818808817adb321d7674e.yaml"},{"location":"gs://testbucket/chariot/6f6f48cd332b1cbbd4e914f109f35f1a.yaml"}]}} 2023-06-05T14:17:16.3464397Z mockpubsubpull_test.go:373: Got ack from message 1 2023-06-05T14:17:16.3464863Z mockpubsubpull_test.go:384: Checking 2 objects do not exist in bucket 2023-06-05T14:17:16.3465450Z mockpubsubpull_test.go:397: Checking 3 objects exist in bucket 2023-06-05T14:17:16.3466298Z {"severity":"info","message":"Storage Info","request_pubsub_id":"1","storage_info":{"objects_deleted":[{"location":"gs://testbucket/cluster1/chariot/843764c1f8a6329d51ab5353ac896807.yaml"},{"location":"gs://testbucket/cluster1/chariot/bf80e343ed3695780fb74e6673b86347.yaml"}]}} 2023-06-05T14:17:16.3467113Z mockpubsubpull_test.go:373: Got ack from message 2 2023-06-05T14:17:16.3467633Z mockpubsubpull_test.go:384: Checking 2 objects do not exist in bucket 2023-06-05T14:17:16.3468108Z mockpubsubpull_test.go:397: Checking 3 objects exist in bucket 2023-06-05T14:17:16.3469328Z {"severity":"info","message":"Storage Info","request_pubsub_id":"2","storage_info":{"objects_deleted":[{"location":"gs://testbucket/chariot/464e254c655d75010a0985e3a2ed85cd.yaml"},{"location":"gs://testbucket/chariot/eb45bbdce045c7f9adb3ddcc0bb48544.yaml"}]}} 2023-06-05T14:17:16.3470201Z mockpubsubpull_test.go:373: Got ack from message 3 2023-06-05T14:17:16.3470855Z mockpubsubpull_test.go:384: Checking 2 objects do not exist in bucket 2023-06-05T14:17:16.3471377Z mockpubsubpull_test.go:397: Checking 3 objects exist in bucket 2023-06-05T14:17:16.3472413Z {"severity":"info","message":"Storage Info","request_pubsub_id":"3","storage_info":{"objects_deleted":[{"location":"gs://testbucket/cluster2/chariot/2bb0fc9004368b7bd72f032b223545fd.yaml"},{"location":"gs://testbucket/cluster2/chariot/02be0e7559be19a7c5e2f2639b6b3d76.yaml"}]}} 2023-06-05T14:17:16.3473208Z mockpubsubpull_test.go:373: Got ack from message 4 2023-06-05T14:17:16.3473701Z mockpubsubpull_test.go:384: Checking 2 objects do not exist in bucket 2023-06-05T14:17:16.3474229Z mockpubsubpull_test.go:397: Checking 3 objects exist in bucket 2023-06-05T14:17:16.3474711Z mockpubsubpull_test.go:403: Verified the correct objects were deleted and not deleted 2023-06-05T14:17:16.3475508Z --- PASS: TestDaemonDeletesObjects (0.10s) 2023-06-05T14:17:16.3475937Z === RUN TestDaemonDeletesObjectsThatDoNotExist 2023-06-05T14:17:16.3476384Z mockpubsubpull_test.go:497: Sending 4 create requests to the Daemon 2023-06-05T14:17:16.3477532Z {"severity":"info","message":"Storage Info","request_pubsub_id":"0","storage_info":{"objects_put":[{"location":"gs://testbucket/chariot/5c1dcc07a3e172ee2de76019c0d635cb.yaml"},{"location":"gs://testbucket/chariot/f764ad22b9f9756dce084dd47941792f.yaml"},{"location":"gs://testbucket/chariot/6ca4e8dba11b5da85cdb87f85dc7bb73.yaml"},{"location":"gs://testbucket/chariot/25dd7179d6fdd535e7ac49412e1a79d3.yaml"},{"location":"gs://testbucket/chariot/09f395603c41cdb906c1c4fcdbf3f42b.yaml"}]}} 2023-06-05T14:17:16.3478634Z mockpubsubpull_test.go:516: Got ack from message 1 2023-06-05T14:17:16.3479829Z {"severity":"info","message":"Storage Info","request_pubsub_id":"1","storage_info":{"objects_put":[{"location":"gs://testbucket/cluster1/chariot/3ae09008c029a8041fe07094205ce59e.yaml"},{"location":"gs://testbucket/cluster1/chariot/bfaabedddafc51dbc87513402204dc4e.yaml"},{"location":"gs://testbucket/cluster1/chariot/dfee4dfd21e1341109f665da2370f915.yaml"},{"location":"gs://testbucket/cluster1/chariot/9d96b73becc00bc4121b44240a1c0f9b.yaml"},{"location":"gs://testbucket/cluster1/chariot/a8a4997857e7f9d5772bfc0333f426f1.yaml"}]}} 2023-06-05T14:17:16.3481031Z mockpubsubpull_test.go:516: Got ack from message 2 2023-06-05T14:17:16.3482158Z {"severity":"info","message":"Storage Info","request_pubsub_id":"2","storage_info":{"objects_put":[{"location":"gs://testbucket/chariot/4fca96295d9188c1ca17db31b7bd4585.yaml"},{"location":"gs://testbucket/chariot/cc5a31198aa16698d095305550a71720.yaml"},{"location":"gs://testbucket/chariot/6e0247d5dc03c32379768c075e9dfcbb.yaml"},{"location":"gs://testbucket/chariot/e53f76bbb87720a9f139a6945c3f691e.yaml"},{"location":"gs://testbucket/chariot/14e1f77f545eeeafe768c88e8af3a136.yaml"}]}} 2023-06-05T14:17:16.3483272Z mockpubsubpull_test.go:516: Got ack from message 3 2023-06-05T14:17:16.3484480Z {"severity":"info","message":"Storage Info","request_pubsub_id":"3","storage_info":{"objects_put":[{"location":"gs://testbucket/cluster2/chariot/eca2fba466bf1c6458768c93334b8596.yaml"},{"location":"gs://testbucket/cluster2/chariot/667e4742fbf4359228c603dba9386d8d.yaml"},{"location":"gs://testbucket/cluster2/chariot/08f8dcb39cd46cb9798ba78a0c8084e4.yaml"},{"location":"gs://testbucket/cluster2/chariot/b7b2903f897621a8b5aca839548fb38d.yaml"},{"location":"gs://testbucket/cluster2/chariot/71bfc2621443d12afb89cec76b223823.yaml"}]}} 2023-06-05T14:17:16.3485681Z mockpubsubpull_test.go:516: Got ack from message 4 2023-06-05T14:17:16.3486119Z mockpubsubpull_test.go:523: Got acks from all 4 requests 2023-06-05T14:17:16.3486559Z mockpubsubpull_test.go:531: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3487043Z mockpubsubpull_test.go:531: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3487869Z mockpubsubpull_test.go:531: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3488569Z mockpubsubpull_test.go:531: Checking 5 objects exist in bucket 2023-06-05T14:17:16.3489012Z mockpubsubpull_test.go:537: Created all objects in GCS storage 2023-06-05T14:17:16.3489498Z mockpubsubpull_test.go:539: Now testing the deletion of the created objects in GCS 2023-06-05T14:17:16.3490310Z {"severity":"info","message":"Storage Info","request_pubsub_id":"0","storage_info":{"objects_deleted":[{"location":"gs://testbucket/chariot/f764ad22b9f9756dce084dd47941792f.yaml"},{"location":"gs://testbucket/chariot/25dd7179d6fdd535e7ac49412e1a79d3.yaml"}]}} 2023-06-05T14:17:16.3491026Z mockpubsubpull_test.go:573: Got ack from message 1 2023-06-05T14:17:16.3491657Z mockpubsubpull_test.go:584: Checking 2 objects do not exist in bucket 2023-06-05T14:17:16.3492161Z mockpubsubpull_test.go:590: Attempting to delete objects again 2023-06-05T14:17:16.3493718Z {"severity":"warning","message":"Storage Info","request_pubsub_id":"0","storage_info":{"objects_do_not_exist":[{"location":"gs://testbucket/chariot/f764ad22b9f9756dce084dd47941792f.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Cluster\nmetadata:\n name: f6eaee4182d17caaba160cd640ff7349\n namespace: ci\n labels: {}\n"},{"location":"gs://testbucket/chariot/25dd7179d6fdd535e7ac49412e1a79d3.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Tenant\nmetadata:\n name: e140232a4a87383a21d1845c408ad757\n namespace: \"\"\n labels:\n cluster.edge.ncr.com: \"04381303\"\n cluster.edge.ncr.com/type: 2a279a96\n fleet.edge.ncr.com: 879a4f36\n"}]}} 2023-06-05T14:17:16.3495112Z mockpubsubpull_test.go:602: Got ack from message 1 2023-06-05T14:17:16.3495642Z mockpubsubpull_test.go:616: Checking 3 objects exist in bucket 2023-06-05T14:17:16.3496495Z {"severity":"info","message":"Storage Info","request_pubsub_id":"1","storage_info":{"objects_deleted":[{"location":"gs://testbucket/cluster1/chariot/bfaabedddafc51dbc87513402204dc4e.yaml"},{"location":"gs://testbucket/cluster1/chariot/9d96b73becc00bc4121b44240a1c0f9b.yaml"}]}} 2023-06-05T14:17:16.3497307Z mockpubsubpull_test.go:573: Got ack from message 2 2023-06-05T14:17:16.3497792Z mockpubsubpull_test.go:584: Checking 2 objects do not exist in bucket 2023-06-05T14:17:16.3498279Z mockpubsubpull_test.go:590: Attempting to delete objects again 2023-06-05T14:17:16.3499918Z {"severity":"warning","message":"Storage Info","request_pubsub_id":"1","storage_info":{"objects_do_not_exist":[{"location":"gs://testbucket/cluster1/chariot/bfaabedddafc51dbc87513402204dc4e.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Namespace\nmetadata:\n name: 6e9c63415b0af9ce8c208bc20ee52674\n namespace: \"\"\n labels:\n cluster.edge.ncr.com: 15e0b430\n cluster.edge.ncr.com/type: f9bcb049\n fleet.edge.ncr.com: a3d38540\n"},{"location":"gs://testbucket/cluster1/chariot/9d96b73becc00bc4121b44240a1c0f9b.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Namespace\nmetadata:\n name: 287935e281ebfc4b8b652b69ccb092e5\n namespace: godoc\n labels: {}\n"}]}} 2023-06-05T14:17:16.3501525Z mockpubsubpull_test.go:602: Got ack from message 2 2023-06-05T14:17:16.3501971Z mockpubsubpull_test.go:616: Checking 3 objects exist in bucket 2023-06-05T14:17:16.3502747Z {"severity":"info","message":"Storage Info","request_pubsub_id":"2","storage_info":{"objects_deleted":[{"location":"gs://testbucket/chariot/cc5a31198aa16698d095305550a71720.yaml"},{"location":"gs://testbucket/chariot/e53f76bbb87720a9f139a6945c3f691e.yaml"}]}} 2023-06-05T14:17:16.3503505Z mockpubsubpull_test.go:573: Got ack from message 3 2023-06-05T14:17:16.3504024Z mockpubsubpull_test.go:584: Checking 2 objects do not exist in bucket 2023-06-05T14:17:16.3504497Z mockpubsubpull_test.go:590: Attempting to delete objects again 2023-06-05T14:17:16.3507565Z {"severity":"warning","message":"Storage Info","request_pubsub_id":"2","storage_info":{"objects_do_not_exist":[{"location":"gs://testbucket/chariot/cc5a31198aa16698d095305550a71720.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Tenant\nmetadata:\n name: c7bbda1c5be68ef4eebe8cb8fa7dc548\n namespace: \"\"\n labels: {}\n"},{"location":"gs://testbucket/chariot/e53f76bbb87720a9f139a6945c3f691e.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Cluster\nmetadata:\n name: 3eb52094f2dd5c08731f52315d828846\n namespace: policy-bot\n labels:\n cluster.edge.ncr.com: e37df68f\n cluster.edge.ncr.com/type: d176fd8a\n fleet.edge.ncr.com: 56da8bb0\n"}]}} 2023-06-05T14:17:16.3509303Z mockpubsubpull_test.go:602: Got ack from message 3 2023-06-05T14:17:16.3509721Z mockpubsubpull_test.go:616: Checking 3 objects exist in bucket 2023-06-05T14:17:16.3510598Z {"severity":"info","message":"Storage Info","request_pubsub_id":"3","storage_info":{"objects_deleted":[{"location":"gs://testbucket/cluster2/chariot/667e4742fbf4359228c603dba9386d8d.yaml"},{"location":"gs://testbucket/cluster2/chariot/b7b2903f897621a8b5aca839548fb38d.yaml"}]}} 2023-06-05T14:17:16.3511395Z mockpubsubpull_test.go:573: Got ack from message 4 2023-06-05T14:17:16.3511900Z mockpubsubpull_test.go:584: Checking 2 objects do not exist in bucket 2023-06-05T14:17:16.3512407Z mockpubsubpull_test.go:590: Attempting to delete objects again 2023-06-05T14:17:16.3513882Z {"severity":"warning","message":"Storage Info","request_pubsub_id":"3","storage_info":{"objects_do_not_exist":[{"location":"gs://testbucket/cluster2/chariot/667e4742fbf4359228c603dba9386d8d.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Cluster\nmetadata:\n name: 2c41770c01746de44f3db6e3402e7873\n namespace: \"\"\n labels: {}\n"},{"location":"gs://testbucket/cluster2/chariot/b7b2903f897621a8b5aca839548fb38d.yaml","content":"apiVersion: clusterregistry.k8s.io/v1alpha1\nkind: Tenant\nmetadata:\n name: a6472a41f2cf84765f4e5d3ceefc1c02\n namespace: \"\"\n labels: {}\n"}]}} 2023-06-05T14:17:16.3515257Z mockpubsubpull_test.go:602: Got ack from message 4 2023-06-05T14:17:16.3515848Z mockpubsubpull_test.go:616: Checking 3 objects exist in bucket 2023-06-05T14:17:16.3516379Z mockpubsubpull_test.go:622: Verified the correct objects were deleted and not deleted 2023-06-05T14:17:16.3517209Z --- PASS: TestDaemonDeletesObjectsThatDoNotExist (0.10s) 2023-06-05T14:17:16.3517748Z === RUN TestRequestDirOption 2023-06-05T14:17:16.3518270Z request_test.go:123: Successfully validated the Request.Dir optional field validation 2023-06-05T14:17:16.3518894Z --- PASS: TestRequestDirOption (0.00s) 2023-06-05T14:17:16.3519327Z === RUN TestRequestStorageObjectsFunction 2023-06-05T14:17:16.3520065Z request_test.go:158: Checking that banner-wide and cluster-wide objects are idempotent 2023-06-05T14:17:16.3520887Z request_test.go:175: Successfully checked that banner-wide and cluster-wide objects are idempotent 2023-06-05T14:17:16.3521776Z request_test.go:178: Checking that banner-wide and cluster-wide objects are hashed properly 2023-06-05T14:17:16.3522370Z request_test.go:196: Checking hash "a1bd5220fb7d3f199fc5de7e6c5e4e12" 2023-06-05T14:17:16.3522873Z request_test.go:196: Checking hash "615b31708ee10fd9f620364f202eb24f" 2023-06-05T14:17:16.3523387Z request_test.go:196: Checking hash "e2476b7a568ec55399eb1ec545aa645a" 2023-06-05T14:17:16.3523897Z request_test.go:196: Checking hash "4e92e7d50074ff0af4c595044158542c" 2023-06-05T14:17:16.3524383Z request_test.go:196: Checking hash "9e341344a124d4081864f803430d8314" 2023-06-05T14:17:16.3524849Z request_test.go:196: Checking hash "e06dd5be49f9cbab63f86031331df6ca" 2023-06-05T14:17:16.3525332Z request_test.go:196: Checking hash "e889d7250b5448ec45eab10a7e710f8b" 2023-06-05T14:17:16.3525891Z request_test.go:196: Checking hash "bfcb962a51aa64bd33cac02c6579fc90" 2023-06-05T14:17:16.3526706Z request_test.go:205: Successfully checked that banner-wide and cluster-wide objects are hashed properly 2023-06-05T14:17:16.3527842Z request_test.go:208: Checking that banner-wide and cluster-wide object locations are set properly 2023-06-05T14:17:16.3528675Z request_test.go:211: Checking banner-wide regex: "^gs://%s/%s/[a-f0-9]{32}[.]yaml$" 2023-06-05T14:17:16.3529594Z request_test.go:212: Checking cluster-wide regex: "^gs://%s/%s/%s/[a-f0-9]{32}[.]yaml$" 2023-06-05T14:17:16.3530442Z request_test.go:218: Banner-wide location: "gs://my-banner/chariot/a1bd5220fb7d3f199fc5de7e6c5e4e12.yaml" 2023-06-05T14:17:16.3531302Z request_test.go:222: Cluster-wide location: "gs://my-banner/test/chariot/a1bd5220fb7d3f199fc5de7e6c5e4e12.yaml" 2023-06-05T14:17:16.3532377Z request_test.go:218: Banner-wide location: "gs://my-banner/chariot/615b31708ee10fd9f620364f202eb24f.yaml" 2023-06-05T14:17:16.3533203Z request_test.go:222: Cluster-wide location: "gs://my-banner/test/chariot/615b31708ee10fd9f620364f202eb24f.yaml" 2023-06-05T14:17:16.3534065Z request_test.go:218: Banner-wide location: "gs://my-banner/chariot/e2476b7a568ec55399eb1ec545aa645a.yaml" 2023-06-05T14:17:16.3534948Z request_test.go:222: Cluster-wide location: "gs://my-banner/test/chariot/e2476b7a568ec55399eb1ec545aa645a.yaml" 2023-06-05T14:17:16.3535856Z request_test.go:218: Banner-wide location: "gs://my-banner/chariot/4e92e7d50074ff0af4c595044158542c.yaml" 2023-06-05T14:17:16.3536660Z request_test.go:222: Cluster-wide location: "gs://my-banner/test/chariot/4e92e7d50074ff0af4c595044158542c.yaml" 2023-06-05T14:17:16.3537445Z request_test.go:218: Banner-wide location: "gs://my-banner/chariot/9e341344a124d4081864f803430d8314.yaml" 2023-06-05T14:17:16.3538160Z request_test.go:222: Cluster-wide location: "gs://my-banner/test/chariot/9e341344a124d4081864f803430d8314.yaml" 2023-06-05T14:17:16.3538940Z request_test.go:218: Banner-wide location: "gs://my-banner/chariot/e06dd5be49f9cbab63f86031331df6ca.yaml" 2023-06-05T14:17:16.3539743Z request_test.go:222: Cluster-wide location: "gs://my-banner/test/chariot/e06dd5be49f9cbab63f86031331df6ca.yaml" 2023-06-05T14:17:16.3540548Z request_test.go:218: Banner-wide location: "gs://my-banner/chariot/e889d7250b5448ec45eab10a7e710f8b.yaml" 2023-06-05T14:17:16.3541360Z request_test.go:222: Cluster-wide location: "gs://my-banner/test/chariot/e889d7250b5448ec45eab10a7e710f8b.yaml" 2023-06-05T14:17:16.3542113Z request_test.go:218: Banner-wide location: "gs://my-banner/chariot/bfcb962a51aa64bd33cac02c6579fc90.yaml" 2023-06-05T14:17:16.3542930Z request_test.go:222: Cluster-wide location: "gs://my-banner/test/chariot/bfcb962a51aa64bd33cac02c6579fc90.yaml" 2023-06-05T14:17:16.3543780Z request_test.go:227: Successfully checked that banner-wide and cluster-wide objects have valid locations 2023-06-05T14:17:16.3544436Z --- PASS: TestRequestStorageObjectsFunction (0.00s) 2023-06-05T14:17:16.3545037Z === RUN TestStorageObjectGetGcsBucketAndPathParsingWorks 2023-06-05T14:17:16.3546022Z request_test.go:350: Successfully verified 1536 combinations of StorageObject.Location for their 'bucket' and 'path' parsing 2023-06-05T14:17:16.3547077Z --- PASS: TestStorageObjectGetGcsBucketAndPathParsingWorks (0.01s) 2023-06-05T14:17:16.3547614Z === RUN TestChariotSuccessfulResponse 2023-06-05T14:17:16.3548085Z response_test.go:100: Sending 2 create requests to the Daemon 2023-06-05T14:17:16.3549226Z {"severity":"info","message":"Storage Info","request_pubsub_id":"0","storage_info":{"objects_put":[{"location":"gs://testbucket/chariot/2b1b8a6584907d07e1cc0b2a749e809c.yaml"},{"location":"gs://testbucket/chariot/d3c3724025e4f32f1d44da8916741177.yaml"},{"location":"gs://testbucket/chariot/093a8660cae95d4de839b8dd4e034ea0.yaml"},{"location":"gs://testbucket/chariot/1ad695c8a18934e91aff6b8f7b03172f.yaml"},{"location":"gs://testbucket/chariot/6314940a43c1349ed2ecf75678936ab0.yaml"}]}} 2023-06-05T14:17:16.3550304Z response_test.go:119: Got ack from message 1 2023-06-05T14:17:16.3550834Z response_test.go:130: Got response data: {"pubsub_request_id":"0","ok":true,"operation":"CREATE"} 2023-06-05T14:17:16.3551733Z response_test.go:131: Got response attributes: map[owner:test] 2023-06-05T14:17:16.3553091Z {"severity":"info","message":"Storage Info","request_pubsub_id":"1","storage_info":{"objects_put":[{"location":"gs://testbucket/cluster1/chariot/bf0c10a76346711ecb97ddf40cfbdfcc.yaml"},{"location":"gs://testbucket/cluster1/chariot/a4f2d62303da0008885f760953c9e616.yaml"},{"location":"gs://testbucket/cluster1/chariot/52fc4f9bce62948a43c9948de432caed.yaml"},{"location":"gs://testbucket/cluster1/chariot/b4fbc1328d035c057c3f376ba28c5799.yaml"},{"location":"gs://testbucket/cluster1/chariot/0dfb2a9cc900f7d6286cbacb14920c8d.yaml"}]}} 2023-06-05T14:17:16.3554467Z response_test.go:119: Got ack from message 2 2023-06-05T14:17:16.3555033Z response_test.go:130: Got response data: {"pubsub_request_id":"1","ok":true,"operation":"CREATE"} 2023-06-05T14:17:16.3555719Z response_test.go:131: Got response attributes: map[owner:test] 2023-06-05T14:17:16.3556193Z response_test.go:169: Got acks from all 2 requests 2023-06-05T14:17:16.3556843Z --- PASS: TestChariotSuccessfulResponse (0.05s) 2023-06-05T14:17:16.3557243Z === RUN TestChariotErrorResponse 2023-06-05T14:17:16.3557706Z response_test.go:253: Sending 3 create requests to the Daemon 2023-06-05T14:17:16.3611627Z {"message":"Error parsing request JSON","severity":"error","error":"Request validation error: Banner must not be empty","pubsub_data":"eyJvcGVyYXRpb24iOiJDUkVBVEUiLCJvYmplY3RzIjpbIllYQnBWbVZ5YzJsdmJqb2dZMngxYzNSbGNuSmxaMmx6ZEhKNUxtczRjeTVwYnk5Mk1XRnNjR2hoTVFwcmFXNWtPaUJVWlc1aGJuUUtiV1YwWVdSaGRHRTZDaUFnYm1GdFpUb2dOR05rTjJVMU0yWmxOalJqTkRjeE1ETXlOalV5T0dZeU5HSXdPVGxrTUdJS0lDQnVZVzFsYzNCaFkyVTZJR0oxYkd4a2IzcGxjZ29nSUd4aFltVnNjem9nZTMwSyIsIllYQnBWbVZ5YzJsdmJqb2dZMngxYzNSbGNuSmxaMmx6ZEhKNUxtczRjeTVwYnk5Mk1XRnNjR2hoTVFwcmFXNWtPaUJEYkhWemRHVnlDbTFsZEdGa1lYUmhPZ29nSUc1aGJXVTZJRFkzTkdJMFl6RmtNamRsTlRCaE1URXhObVF5WTJVeE5tTTRaalZsWWpJeENpQWdibUZ0WlhOd1lXTmxPaUJpZFd4c1pHOTZaWElLSUNCc1lXSmxiSE02SUh0OUNnPT0iLCJZWEJwVm1WeWMybHZiam9nWTJ4MWMzUmxjbkpsWjJsemRISjVMbXM0Y3k1cGJ5OTJNV0ZzY0doaE1RcHJhVzVrT2lCVVpXNWhiblFLYldWMFlXUmhkR0U2Q2lBZ2JtRnRaVG9nWVRFMU9HSmhaRGMyTWpBeU1UZGhOREJsTXpSaU9XSmlPRFJrTVRnNVpXWUtJQ0J1WVcxbGMzQmhZMlU2SUNJaUNpQWdiR0ZpWld4ek9pQjdmUW89IiwiWVhCcFZtVnljMmx2YmpvZ1kyeDFjM1JsY25KbFoybHpkSEo1TG1zNGN5NXBieTkyTVdGc2NHaGhNUXByYVc1a09pQkRiSFZ6ZEdWeUNtMWxkR0ZrWVhSaE9nb2dJRzVoYldVNklHWXpNbUl5TUdWbU0yWm1Nek0yT1RGbU5XUmlNbVJsWVRReFpURmxOakE0Q2lBZ2JtRnRaWE53WVdObE9pQWlJZ29nSUd4aFltVnNjem9LSUNBZ0lHTnNkWE4wWlhJdVpXUm5aUzV1WTNJdVkyOXRPaUJoWmpObVpqTXdaUW9nSUNBZ1kyeDFjM1JsY2k1bFpHZGxMbTVqY2k1amIyMHZkSGx3WlRvZ1lUZzJOR0k0TkRNS0lDQWdJR1pzWldWMExtVmtaMlV1Ym1OeUxtTnZiVG9nT1dKak9XVmhNVEFLIiwiWVhCcFZtVnljMmx2YmpvZ1kyeDFjM1JsY25KbFoybHpkSEo1TG1zNGN5NXBieTkyTVdGc2NHaGhNUXByYVc1a09pQkRiSFZ6ZEdWeUNtMWxkR0ZrWVhSaE9nb2dJRzVoYldVNklHUmlOR1F5WWpBNFl6YzBOR1k0TURZeFpEUTJNbVV5T0dZeE56UTBPRGxsQ2lBZ2JtRnRaWE53WVdObE9pQmphUW9nSUd4aFltVnNjem9nZTMwSyJdLCJiYW5uZXIiOiIiLCJvd25lciI6InRlc3QifQ==","pubsub_request_id":"0"} 2023-06-05T14:17:16.3658734Z response_test.go:272: Got ack from message 1 2023-06-05T14:17:16.3659132Z response_test.go:283: Got response data: {"pubsub_request_id":"0","ok":false,"error":"Request validation error: Banner must not be empty","operation":"CREATE"} 2023-06-05T14:17:16.3659529Z response_test.go:284: Got response attributes: map[owner:test] 2023-06-05T14:17:16.3732089Z {"message":"Error parsing request JSON","severity":"error","error":"Request validation error: Unsupported Operation \"DANCE\"","pubsub_data":"eyJvcGVyYXRpb24iOiJEQU5DRSIsIm9iamVjdHMiOlsiWVhCcFZtVnljMmx2YmpvZ1kyeDFjM1JsY25KbFoybHpkSEo1TG1zNGN5NXBieTkyTVdGc2NHaGhNUXByYVc1a09pQlVaVzVoYm5RS2JXVjBZV1JoZEdFNkNpQWdibUZ0WlRvZ056VXhOREJtTXpBd05ETTBNR0prWm1VMk1EQTJNbVl4TjJNMU0yWXpZemtLSUNCdVlXMWxjM0JoWTJVNklDSWlDaUFnYkdGaVpXeHpPaUI3ZlFvPSIsIllYQnBWbVZ5YzJsdmJqb2dZMngxYzNSbGNuSmxaMmx6ZEhKNUxtczRjeTVwYnk5Mk1XRnNjR2hoTVFwcmFXNWtPaUJVWlc1aGJuUUtiV1YwWVdSaGRHRTZDaUFnYm1GdFpUb2dNREJoTkdJME0ySTJZV00wTTJFMU1UTXdZVGN6WVRsaU0yTXlZMkpqT1RNS0lDQnVZVzFsYzNCaFkyVTZJQ0lpQ2lBZ2JHRmlaV3h6T2dvZ0lDQWdZMngxYzNSbGNpNWxaR2RsTG01amNpNWpiMjA2SUdKa01qazJZMlExQ2lBZ0lDQmpiSFZ6ZEdWeUxtVmtaMlV1Ym1OeUxtTnZiUzkwZVhCbE9pQm1ORGhqWlRNeE13b2dJQ0FnWm14bFpYUXVaV1JuWlM1dVkzSXVZMjl0T2lBeU9HRmhNekpsWkFvPSIsIllYQnBWbVZ5YzJsdmJqb2dZMngxYzNSbGNuSmxaMmx6ZEhKNUxtczRjeTVwYnk5Mk1XRnNjR2hoTVFwcmFXNWtPaUJVWlc1aGJuUUtiV1YwWVdSaGRHRTZDaUFnYm1GdFpUb2dZekV3WldVNFl6ZzNNR05rTWpneFpEWXhOR1UyWW1NeVl6QmhOV05oTXpBS0lDQnVZVzFsYzNCaFkyVTZJQ0lpQ2lBZ2JHRmlaV3h6T2dvZ0lDQWdZMngxYzNSbGNpNWxaR2RsTG01amNpNWpiMjA2SUROaVl6UTROamsyQ2lBZ0lDQmpiSFZ6ZEdWeUxtVmtaMlV1Ym1OeUxtTnZiUzkwZVhCbE9pQmhNMkprTlRkaVpnb2dJQ0FnWm14bFpYUXVaV1JuWlM1dVkzSXVZMjl0T2lCbVptTm1aVGMwTWdvPSIsIllYQnBWbVZ5YzJsdmJqb2dZMngxYzNSbGNuSmxaMmx6ZEhKNUxtczRjeTVwYnk5Mk1XRnNjR2hoTVFwcmFXNWtPaUJVWlc1aGJuUUtiV1YwWVdSaGRHRTZDaUFnYm1GdFpUb2dPR0kxWWpObU5XUmxOelE0T1RFNE5UVXpaR1kxTkRVellqTmpOakF3TVRZS0lDQnVZVzFsYzNCaFkyVTZJR2R2Wkc5akNpQWdiR0ZpWld4ek9pQjdmUW89IiwiWVhCcFZtVnljMmx2YmpvZ1kyeDFjM1JsY25KbFoybHpkSEo1TG1zNGN5NXBieTkyTVdGc2NHaGhNUXByYVc1a09pQkRiSFZ6ZEdWeUNtMWxkR0ZrWVhSaE9nb2dJRzVoYldVNklEazJaak5rWlRBeE16ZGxOREUwTmpreVltWTBZbVJsTWpCbFpEZzVPV1U1Q2lBZ2JtRnRaWE53WVdObE9pQWlJZ29nSUd4aFltVnNjem9LSUNBZ0lHTnNkWE4wWlhJdVpXUm5aUzV1WTNJdVkyOXRPaUEzTnpJM1lqZGxZUW9nSUNBZ1kyeDFjM1JsY2k1bFpHZGxMbTVqY2k1amIyMHZkSGx3WlRvZ05HVmtOakUyT0dRS0lDQWdJR1pzWldWMExtVmtaMlV1Ym1OeUxtTnZiVG9nTnpkak5EZ3paR1FLIl0sImJhbm5lciI6InRlc3RidWNrZXQiLCJjbHVzdGVyIjoiY2x1c3RlcjEiLCJvd25lciI6InRlc3QifQ==","pubsub_request_id":"1"} 2023-06-05T14:17:16.3805038Z response_test.go:272: Got ack from message 2 2023-06-05T14:17:16.3805482Z response_test.go:283: Got response data: {"pubsub_request_id":"1","ok":false,"error":"Request validation error: Unsupported Operation \"DANCE\"","operation":"DANCE"} 2023-06-05T14:17:16.3805884Z response_test.go:284: Got response attributes: map[owner:test] 2023-06-05T14:17:16.3857016Z {"message":"Error parsing request JSON","severity":"error","error":"Request validation error: yaml: unmarshal errors:\n line 1: cannot unmarshal !!str `AN INVA...` into chariot.YamlGVKNN","pubsub_data":"eyJvcGVyYXRpb24iOiJDUkVBVEUiLCJvYmplY3RzIjpbIllYQnBWbVZ5YzJsdmJqb2dZMngxYzNSbGNuSmxaMmx6ZEhKNUxtczRjeTVwYnk5Mk1XRnNjR2hoTVFwcmFXNWtPaUJEYkhWemRHVnlDbTFsZEdGa1lYUmhPZ29nSUc1aGJXVTZJRFZqWlRCa01qTTBNRFE1TUdRM1lXUXpNak5qTlRCaE5XSXhNVGN3TXpNM0NpQWdibUZ0WlhOd1lXTmxPaUJuYjJSdll3b2dJR3hoWW1Wc2N6b0tJQ0FnSUdOc2RYTjBaWEl1WldSblpTNXVZM0l1WTI5dE9pQTBNVGMwWVRrNU53b2dJQ0FnWTJ4MWMzUmxjaTVsWkdkbExtNWpjaTVqYjIwdmRIbHdaVG9nWm1RelpHSTFNRFlLSUNBZ0lHWnNaV1YwTG1Wa1oyVXVibU55TG1OdmJUb2daVEk0WkRJMFpqWUsiLCJZWEJwVm1WeWMybHZiam9nWTJ4MWMzUmxjbkpsWjJsemRISjVMbXM0Y3k1cGJ5OTJNV0ZzY0doaE1RcHJhVzVrT2lCT1lXMWxjM0JoWTJVS2JXVjBZV1JoZEdFNkNpQWdibUZ0WlRvZ1l6VTFOVFEwWTJJek9UZ3daV0poWkRjNFpERTJNekEyTVRoa01URXpabUVLSUNCdVlXMWxjM0JoWTJVNklDSWlDaUFnYkdGaVpXeHpPaUI3ZlFvPSIsIllYQnBWbVZ5YzJsdmJqb2dZMngxYzNSbGNuSmxaMmx6ZEhKNUxtczRjeTVwYnk5Mk1XRnNjR2hoTVFwcmFXNWtPaUJPWVcxbGMzQmhZMlVLYldWMFlXUmhkR0U2Q2lBZ2JtRnRaVG9nTkRRMVpqZzJNalZtWTJWak56RTNZamczWVRZMVptRXdNakl4WVROaFlUZ0tJQ0J1WVcxbGMzQmhZMlU2SUdkdlpHOWpDaUFnYkdGaVpXeHpPaUI3ZlFvPSIsIllYQnBWbVZ5YzJsdmJqb2dZMngxYzNSbGNuSmxaMmx6ZEhKNUxtczRjeTVwYnk5Mk1XRnNjR2hoTVFwcmFXNWtPaUJPWVcxbGMzQmhZMlVLYldWMFlXUmhkR0U2Q2lBZ2JtRnRaVG9nTVRRek1EUmtNRGN5TmpOa1l6TmtPVEUxT0dWak1qUXlNREE0TWpJMlpERUtJQ0J1WVcxbGMzQmhZMlU2SUdKMWJHeGtiM3BsY2dvZ0lHeGhZbVZzY3pvZ2UzMEsiLCJRVTRnU1U1V1FVeEpSQ0JTUlZGVlJWTlUiLCJZWEJwVm1WeWMybHZiam9nWTJ4MWMzUmxjbkpsWjJsemRISjVMbXM0Y3k1cGJ5OTJNV0ZzY0doaE1RcHJhVzVrT2lCRGJIVnpkR1Z5Q20xbGRHRmtZWFJoT2dvZ0lHNWhiV1U2SUdaaFlXUTBZV1l6WkRRMFpEWmtPRFkxTkRSaFpHVXpOR001TXpVeE9ESTRDaUFnYm1GdFpYTndZV05sT2lCbmIyUnZZd29nSUd4aFltVnNjem9nZTMwSyJdLCJiYW5uZXIiOiJ0ZXN0YnVja2V0Iiwib3duZXIiOiJ0ZXN0In0=","pubsub_request_id":"2"} 2023-06-05T14:17:16.3909512Z response_test.go:272: Got ack from message 3 2023-06-05T14:17:16.3910003Z response_test.go:283: Got response data: {"pubsub_request_id":"2","ok":false,"error":"Request validation error: yaml: unmarshal errors:\n line 1: cannot unmarshal !!str `AN INVA...` into chariot.YamlGVKNN","operation":"CREATE"} 2023-06-05T14:17:16.3910463Z response_test.go:284: Got response attributes: map[owner:test] 2023-06-05T14:17:16.3911079Z response_test.go:322: Got acks from all 3 requests 2023-06-05T14:17:16.3911636Z --- PASS: TestChariotErrorResponse (0.01s) 2023-06-05T14:17:16.3912007Z PASS 2023-06-05T14:17:16.3912213Z ================================================================================ 2023-06-05T14:17:16.5223542Z INFO: From Testing //pkg/edge/gitops/fns/clusterselgen:clusterselgen_test: 2023-06-05T14:17:16.5224289Z ==================== Test output for //pkg/edge/gitops/fns/clusterselgen:clusterselgen_test: 2023-06-05T14:17:16.5224822Z === RUN TestCluterSelectorGen 2023-06-05T14:17:16.5225297Z === RUN TestCluterSelectorGen/testdata/basic 2023-06-05T14:17:16.5225924Z --- PASS: TestCluterSelectorGen (0.01s) 2023-06-05T14:17:16.5226589Z --- PASS: TestCluterSelectorGen/testdata/basic (0.01s) 2023-06-05T14:17:16.5227016Z PASS 2023-06-05T14:17:16.5227380Z ================================================================================ 2023-06-05T14:17:16.8467448Z INFO: From Testing //third_party/k8s/fluxcd:fluxcd_test: 2023-06-05T14:17:16.8468091Z ==================== Test output for //third_party/k8s/fluxcd:fluxcd_test: 2023-06-05T14:17:16.8468545Z === RUN TestLoadManifests 2023-06-05T14:17:16.8469080Z --- PASS: TestLoadManifests (1.27s) 2023-06-05T14:17:16.8469465Z PASS 2023-06-05T14:17:16.8469813Z ================================================================================ 2023-06-05T14:17:16.8980222Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/timesyncd:timesyncd_test: 2023-06-05T14:17:16.8981206Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/timesyncd:timesyncd_test: 2023-06-05T14:17:16.8981830Z === RUN TestNTPAddressesCanBeUpdatedInData 2023-06-05T14:17:16.8982286Z timesyncd_test.go:55: PASS: Read(string) 2023-06-05T14:17:16.8982758Z timesyncd_test.go:55: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:16.8983213Z timesyncd_test.go:55: PASS: Read(string) 2023-06-05T14:17:16.8983727Z timesyncd_test.go:55: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:16.8984520Z --- PASS: TestNTPAddressesCanBeUpdatedInData (0.00s) 2023-06-05T14:17:16.8985245Z === RUN TestTimeSectionAndNTPAddressCanBeAddedToTimesyncdData 2023-06-05T14:17:16.8985841Z timesyncd_test.go:67: PASS: Read(string) 2023-06-05T14:17:16.8986659Z timesyncd_test.go:67: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:16.8987594Z --- PASS: TestTimeSectionAndNTPAddressCanBeAddedToTimesyncdData (0.00s) 2023-06-05T14:17:16.8988297Z === RUN TestUpToDateTimesyncdDataIsNotChanged 2023-06-05T14:17:16.8988833Z timesyncd_test.go:78: PASS: Read(string) 2023-06-05T14:17:16.8989467Z --- PASS: TestUpToDateTimesyncdDataIsNotChanged (0.00s) 2023-06-05T14:17:16.8990115Z === RUN TestNTPAddressesCanBeRemovedFromTimesyncdData 2023-06-05T14:17:16.8990665Z timesyncd_test.go:90: PASS: Read(string) 2023-06-05T14:17:16.8991157Z timesyncd_test.go:90: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:16.8991923Z --- PASS: TestNTPAddressesCanBeRemovedFromTimesyncdData (0.00s) 2023-06-05T14:17:16.8992546Z === RUN TestInvalidTimesyncdDataIsNotUpdated 2023-06-05T14:17:16.8993058Z timesyncd_test.go:101: PASS: Read(string) 2023-06-05T14:17:16.8993701Z --- PASS: TestInvalidTimesyncdDataIsNotUpdated (0.00s) 2023-06-05T14:17:16.8994307Z === RUN TestReadWriteErrorsAreHandledAsExpected 2023-06-05T14:17:16.8994809Z timesyncd_test.go:123: PASS: Read(string) 2023-06-05T14:17:16.8995252Z timesyncd_test.go:123: PASS: Read(string) 2023-06-05T14:17:16.8995756Z timesyncd_test.go:123: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:16.8996541Z --- PASS: TestReadWriteErrorsAreHandledAsExpected (0.00s) 2023-06-05T14:17:16.8997262Z === RUN TestServiceRestartingErrorsAreHandledAsExpected 2023-06-05T14:17:16.8997936Z timesyncd_test.go:147: PASS: Read(string) 2023-06-05T14:17:16.8998444Z timesyncd_test.go:147: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:16.8999434Z timesyncd_test.go:147: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:16.8999905Z timesyncd_test.go:147: PASS: Read(string) 2023-06-05T14:17:16.9000539Z timesyncd_test.go:147: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:16.9001040Z timesyncd_test.go:147: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:16.9001828Z --- PASS: TestServiceRestartingErrorsAreHandledAsExpected (0.00s) 2023-06-05T14:17:16.9002384Z === RUN TestUpdateNTPAddressInData 2023-06-05T14:17:16.9002966Z --- PASS: TestUpdateNTPAddressInData (0.00s) 2023-06-05T14:17:16.9003543Z === RUN TestUpdatingInvalidTimesyncdDataReturnsErrors 2023-06-05T14:17:16.9004348Z --- PASS: TestUpdatingInvalidTimesyncdDataReturnsErrors (0.00s) 2023-06-05T14:17:16.9004857Z PASS 2023-06-05T14:17:16.9005228Z ================================================================================ 2023-06-05T14:17:17.0229175Z INFO: From Testing //pkg/edge/component/build/updatemanifests:updatemanifests_test: 2023-06-05T14:17:17.0230016Z ==================== Test output for //pkg/edge/component/build/updatemanifests:updatemanifests_test: 2023-06-05T14:17:17.0230583Z === RUN TestUpdateManifests 2023-06-05T14:17:17.0231126Z --- PASS: TestUpdateManifests (0.02s) 2023-06-05T14:17:17.0231471Z PASS 2023-06-05T14:17:17.0231808Z ================================================================================ 2023-06-05T14:17:17.8649625Z INFO: From Testing //pkg/k8s/runtime/sap:sap_test: 2023-06-05T14:17:17.8650228Z ==================== Test output for //pkg/k8s/runtime/sap:sap_test: 2023-06-05T14:17:17.8651011Z === RUN TestManager 2023-06-05T14:17:17.8652191Z === RUN TestManager/TestApply 2023-06-05T14:17:17.8652729Z === RUN TestManager/TestApply/creates_objs_in_order 2023-06-05T14:17:17.8653369Z === RUN TestManager/TestApply/does_not_apply_unchanged_objs 2023-06-05T14:17:17.8654034Z === RUN TestManager/TestApply/applies_only_changed_objs 2023-06-05T14:17:17.8654626Z === RUN TestManager/TestApplyCleanup 2023-06-05T14:17:17.8655345Z === RUN TestManager/TestApplyCleanup/creates_objs_as_kubectl 2023-06-05T14:17:17.8656376Z === RUN TestManager/TestApplyCleanup/removes_kubectl_client-side-apply_s.resourceMgr_and_annotation 2023-06-05T14:17:17.8657439Z === RUN TestManager/TestApplyCleanup/replaces_kubectl_server-side-apply_s.resourceMgr 2023-06-05T14:17:17.8657963Z === RUN TestManager/TestApplyCleanupExclusions 2023-06-05T14:17:17.8658573Z === RUN TestManager/TestApplyCleanupExclusions/creates_objs_as_kubectl 2023-06-05T14:17:17.8659278Z === RUN TestManager/TestApplyCleanupExclusions/does_not_not_remove_kubectl_s.resourceMgr 2023-06-05T14:17:17.8660286Z === RUN TestManager/TestApplyCleanupRemovals 2023-06-05T14:17:17.8660725Z === RUN TestManager/TestApplyCleanupRemovals/creates_objs_using_s.resourceMgr_apply 2023-06-05T14:17:17.8661365Z === RUN TestManager/TestApplyCleanupRemovals/applies_edited_objs_as_kubectl 2023-06-05T14:17:17.8661908Z === RUN TestManager/TestApplyCleanupRemovals/applies_edited_object_using_s.resourceMgr_apply 2023-06-05T14:17:17.8662391Z === RUN TestManager/TestApplyExclusions 2023-06-05T14:17:17.8662897Z === RUN TestManager/TestApplyExclusions/creates_objs 2023-06-05T14:17:17.8663419Z === RUN TestManager/TestApplyExclusions/skips_apply 2023-06-05T14:17:17.8663876Z === RUN TestManager/TestApplyExclusions/applies_changes 2023-06-05T14:17:17.8664355Z === RUN TestManager/TestApplyForce 2023-06-05T14:17:17.8664821Z === RUN TestManager/TestApplyForce/fails_to_apply_immutable_secret 2023-06-05T14:17:17.8665435Z === RUN TestManager/TestApplyForce/force_applies_immutable_secret 2023-06-05T14:17:17.8665915Z === RUN TestManager/TestApplyForce/recreates_immutable_RBAC 2023-06-05T14:17:17.8666436Z === RUN TestManager/TestApplyForce/recreates_immutable_StorageClass 2023-06-05T14:17:17.8666902Z === RUN TestManager/TestApplyNoOp 2023-06-05T14:17:17.8667383Z === RUN TestManager/TestApplyNoOp/creates_objs 2023-06-05T14:17:17.8667940Z === RUN TestManager/TestApplyNoOp/skips_apply 2023-06-05T14:17:17.8668897Z === RUN TestManager/TestDelete 2023-06-05T14:17:17.8669537Z [0xc000790918 0xc000790948 0xc000790960 0xc000790978 0xc000790990 0xc0007909c8 0xc0007909e8]=== RUN TestManager/TestDelete/deletes_objs_in_order 2023-06-05T14:17:17.8684306Z === RUN TestManager/TestDelete_Exclusions 2023-06-05T14:17:17.8684882Z === RUN TestManager/TestDelete_Exclusions/creates_objs 2023-06-05T14:17:17.8685444Z === RUN TestManager/TestDelete_Exclusions/skips_delete 2023-06-05T14:17:17.8685867Z === RUN TestManager/TestDiff 2023-06-05T14:17:17.8686758Z framework.go:146: objs ServiceAccount/sap-0ca7867c/sap-0ca7867c 2023-06-05T14:17:17.8687285Z Secret/sap-0ca7867c/sap-0ca7867c 2023-06-05T14:17:17.8687777Z ConfigMap/sap-0ca7867c/sap-0ca7867c 2023-06-05T14:17:17.8688238Z Namespace/sap-0ca7867c 2023-06-05T14:17:17.8688652Z ClusterRole/sap-0ca7867c 2023-06-05T14:17:17.8689104Z ClusterRoleBinding/sap-0ca7867c 2023-06-05T14:17:17.8689581Z StorageClass/sap-0ca7867c 2023-06-05T14:17:17.8690091Z === RUN TestManager/TestDiff/generates_empty_diff_for_unchanged_object 2023-06-05T14:17:17.8690774Z framework.go:146: changesetentry ConfigMap/sap-0ca7867c/sap-0ca7867c unchanged 2023-06-05T14:17:17.8691311Z === RUN TestManager/TestDiff/generates_diff_for_changed_object 2023-06-05T14:17:17.8692019Z === RUN TestManager/TestDiff/generates_diff_for_replaced_key_in_stringData_secret 2023-06-05T14:17:17.8692538Z === RUN TestManager/TestDiff/masks_secret_values 2023-06-05T14:17:17.8692956Z === RUN TestManager/TestOwnerLabels 2023-06-05T14:17:17.8693392Z === RUN TestManager/TestOwnerLabels/Test_Owner_Labels 2023-06-05T14:17:17.8693865Z === RUN TestManager/TestOwnerLabels/Test_Empty_Namespace 2023-06-05T14:17:17.8694300Z === RUN TestManager/TestWaitForSet 2023-06-05T14:17:17.8694736Z === RUN TestManager/TestWaitForSet/waits_for_CRD_and_CR 2023-06-05T14:17:17.8695338Z --- PASS: TestManager (15.30s) 2023-06-05T14:17:17.8695857Z --- PASS: TestManager/TestApply (0.19s) 2023-06-05T14:17:17.8696484Z --- PASS: TestManager/TestApply/creates_objs_in_order (0.06s) 2023-06-05T14:17:17.8697176Z --- PASS: TestManager/TestApply/does_not_apply_unchanged_objs (0.03s) 2023-06-05T14:17:17.8697854Z --- PASS: TestManager/TestApply/applies_only_changed_objs (0.06s) 2023-06-05T14:17:17.8698405Z --- PASS: TestManager/TestApplyCleanup (0.17s) 2023-06-05T14:17:17.8699036Z --- PASS: TestManager/TestApplyCleanup/creates_objs_as_kubectl (0.02s) 2023-06-05T14:17:17.8699902Z --- PASS: TestManager/TestApplyCleanup/removes_kubectl_client-side-apply_s.resourceMgr_and_annotation (0.05s) 2023-06-05T14:17:17.8700799Z --- PASS: TestManager/TestApplyCleanup/replaces_kubectl_server-side-apply_s.resourceMgr (0.06s) 2023-06-05T14:17:17.8701502Z --- PASS: TestManager/TestApplyCleanupExclusions (0.07s) 2023-06-05T14:17:17.8702240Z --- PASS: TestManager/TestApplyCleanupExclusions/creates_objs_as_kubectl (0.02s) 2023-06-05T14:17:17.8703107Z --- PASS: TestManager/TestApplyCleanupExclusions/does_not_not_remove_kubectl_s.resourceMgr (0.03s) 2023-06-05T14:17:17.8703852Z --- PASS: TestManager/TestApplyCleanupRemovals (0.11s) 2023-06-05T14:17:17.8704638Z --- PASS: TestManager/TestApplyCleanupRemovals/creates_objs_using_s.resourceMgr_apply (0.02s) 2023-06-05T14:17:17.8705509Z --- PASS: TestManager/TestApplyCleanupRemovals/applies_edited_objs_as_kubectl (0.01s) 2023-06-05T14:17:17.8706319Z --- PASS: TestManager/TestApplyCleanupRemovals/applies_edited_object_using_s.resourceMgr_apply (0.04s) 2023-06-05T14:17:17.8707056Z --- PASS: TestManager/TestApplyExclusions (0.17s) 2023-06-05T14:17:17.8707725Z --- PASS: TestManager/TestApplyExclusions/creates_objs (0.05s) 2023-06-05T14:17:17.8708407Z --- PASS: TestManager/TestApplyExclusions/skips_apply (0.05s) 2023-06-05T14:17:17.8709086Z --- PASS: TestManager/TestApplyExclusions/applies_changes (0.04s) 2023-06-05T14:17:17.8710075Z --- PASS: TestManager/TestApplyForce (0.38s) 2023-06-05T14:17:17.8710782Z --- PASS: TestManager/TestApplyForce/fails_to_apply_immutable_secret (0.04s) 2023-06-05T14:17:17.8711726Z --- PASS: TestManager/TestApplyForce/force_applies_immutable_secret (0.08s) 2023-06-05T14:17:17.8712446Z --- PASS: TestManager/TestApplyForce/recreates_immutable_RBAC (0.08s) 2023-06-05T14:17:17.8713188Z --- PASS: TestManager/TestApplyForce/recreates_immutable_StorageClass (0.06s) 2023-06-05T14:17:17.8713812Z --- PASS: TestManager/TestApplyNoOp (0.09s) 2023-06-05T14:17:17.8714430Z --- PASS: TestManager/TestApplyNoOp/creates_objs (0.04s) 2023-06-05T14:17:17.8715083Z --- PASS: TestManager/TestApplyNoOp/skips_apply (0.02s) 2023-06-05T14:17:17.8715722Z --- PASS: TestManager/TestDelete (0.17s) 2023-06-05T14:17:17.8716300Z --- PASS: TestManager/TestDelete/deletes_objs_in_order (0.03s) 2023-06-05T14:17:17.8716940Z --- PASS: TestManager/TestDelete_Exclusions (0.15s) 2023-06-05T14:17:17.8717569Z --- PASS: TestManager/TestDelete_Exclusions/creates_objs (0.06s) 2023-06-05T14:17:17.8718261Z --- PASS: TestManager/TestDelete_Exclusions/skips_delete (0.06s) 2023-06-05T14:17:17.8718811Z --- PASS: TestManager/TestDiff (0.09s) 2023-06-05T14:17:17.8719472Z --- PASS: TestManager/TestDiff/generates_empty_diff_for_unchanged_object (0.00s) 2023-06-05T14:17:17.8720188Z --- PASS: TestManager/TestDiff/generates_diff_for_changed_object (0.00s) 2023-06-05T14:17:17.8720998Z --- PASS: TestManager/TestDiff/generates_diff_for_replaced_key_in_stringData_secret (0.01s) 2023-06-05T14:17:17.8721673Z --- PASS: TestManager/TestDiff/masks_secret_values (0.00s) 2023-06-05T14:17:17.8722220Z --- PASS: TestManager/TestOwnerLabels (0.04s) 2023-06-05T14:17:17.8722830Z --- PASS: TestManager/TestOwnerLabels/Test_Owner_Labels (0.00s) 2023-06-05T14:17:17.8723508Z --- PASS: TestManager/TestOwnerLabels/Test_Empty_Namespace (0.00s) 2023-06-05T14:17:17.8724126Z --- PASS: TestManager/TestWaitForSet (1.77s) 2023-06-05T14:17:17.8724758Z --- PASS: TestManager/TestWaitForSet/waits_for_CRD_and_CR (1.75s) 2023-06-05T14:17:17.8725162Z PASS 2023-06-05T14:17:17.8725570Z ================================================================================ 2023-06-05T14:17:18.2017156Z INFO: From Testing //pkg/f8n/gcp/k8s/controllers/logsink:logsink_test: 2023-06-05T14:17:18.2017829Z ==================== Test output for //pkg/f8n/gcp/k8s/controllers/logsink:logsink_test: 2023-06-05T14:17:18.2018330Z === RUN TestLogSinkController 2023-06-05T14:17:18.2019181Z {"severity":"info","ts":1685974632.8385522,"message":"Starting EventSource","controller":"logginglogsink","controllerGroup":"logging.cnrm.cloud.google.com","controllerKind":"LoggingLogSink","source":"kind source: *v1beta1.LoggingLogSink"} 2023-06-05T14:17:18.2020652Z {"severity":"info","ts":1685974632.8386283,"message":"Starting EventSource","controller":"logginglogsink","controllerGroup":"logging.cnrm.cloud.google.com","controllerKind":"LoggingLogSink","source":"kind source: *v1beta1.IAMPolicyMember"} 2023-06-05T14:17:18.2021583Z {"severity":"info","ts":1685974632.8386352,"message":"Starting Controller","controller":"logginglogsink","controllerGroup":"logging.cnrm.cloud.google.com","controllerKind":"LoggingLogSink"} 2023-06-05T14:17:18.2022356Z === RUN TestLogSinkController/TestBigQueryDestination 2023-06-05T14:17:18.2023177Z {"severity":"info","ts":1685974632.939663,"message":"Starting workers","controller":"logginglogsink","controllerGroup":"logging.cnrm.cloud.google.com","controllerKind":"LoggingLogSink","worker count":1} 2023-06-05T14:17:18.2024771Z {"severity":"info","ts":1685974633.1549873,"logger":"controller","message":"resolved project id","name":"same-namespace","namespace":"logsinkctl-549809f5","destination":{"name":"same-namespace"},"project-id":"foreman-dev"} 2023-06-05T14:17:18.2026672Z {"severity":"info","ts":1685974633.1628098,"logger":"controller","message":"IAMPolicyMember successfully created","name":"same-namespace","namespace":"logsinkctl-549809f5","destination":{"name":"same-namespace"},"iampolicymember":"logsinkctl-549809f5/same-namespace-bigquery-data-editor"} 2023-06-05T14:17:18.2028479Z {"severity":"info","ts":1685974633.1630976,"logger":"controller","message":"resolved project id","name":"same-namespace","namespace":"logsinkctl-549809f5","destination":{"name":"same-namespace"},"project-id":"foreman-dev"} 2023-06-05T14:17:18.2030273Z {"severity":"info","ts":1685974633.1631348,"logger":"controller","message":"IAMPolicyMember already exists, will not re-create","name":"same-namespace","namespace":"logsinkctl-549809f5","destination":{"name":"same-namespace"},"iampolicymember":"logsinkctl-549809f5/same-namespace-bigquery-data-editor"} 2023-06-05T14:17:18.2033797Z logsink_controller_test.go:100: iampolicymember &{{ } {same-namespace-bigquery-data-editor logsinkctl-549809f5 64fdff21-d15a-476e-903b-9428cd8fd3c1 635 1 2023-06-05 14:17:13 +0000 UTC map[] map[] [{logging.cnrm.cloud.google.com/v1beta1 LoggingLogSink same-namespace b94d7472-cd18-43eb-a5e6-df19d2fad652 0xc002da9f6f 0xc002da9f6e}] [] [{logsink_test Update iam.cnrm.cloud.google.com/v1beta1 2023-06-05 14:17:13 +0000 UTC FieldsV1 {"f:metadata":{"f:ownerReferences":{".":{},"k:{\"uid\":\"b94d7472-cd18-43eb-a5e6-df19d2fad652\"}":{}}},"f:spec":{".":{},"f:member":{},"f:resourceRef":{".":{},"f:apiVersion":{},"f:external":{},"f:kind":{}},"f:role":{}},"f:status":{}} }]} { 0xc000ee0470 {Project resourcemanager.cnrm.cloud.google.com/v1beta1 projects/foreman-dev} roles/bigquery.dataEditor} {[] 0}} 2023-06-05T14:17:18.2036224Z {"severity":"info","ts":1685974633.9683714,"logger":"controller","message":"resolved project id","name":"same-namespace","namespace":"logsinkctl-549809f5","destination":{"name":"same-namespace"},"project-id":"foreman-dev"} 2023-06-05T14:17:18.2037762Z {"severity":"info","ts":1685974633.9755092,"logger":"controller","message":"IAMPolicyMember successfully created","name":"same-namespace","namespace":"logsinkctl-549809f5","destination":{"name":"same-namespace"},"iampolicymember":"logsinkctl-549809f5/same-namespace-bigquery-data-editor"} 2023-06-05T14:17:18.2039342Z {"severity":"info","ts":1685974633.9757476,"logger":"controller","message":"resolved project id","name":"same-namespace","namespace":"logsinkctl-549809f5","destination":{"name":"same-namespace"},"project-id":"foreman-dev"} 2023-06-05T14:17:18.2041129Z {"severity":"info","ts":1685974633.975802,"logger":"controller","message":"IAMPolicyMember already exists, will not re-create","name":"same-namespace","namespace":"logsinkctl-549809f5","destination":{"name":"same-namespace"},"iampolicymember":"logsinkctl-549809f5/same-namespace-bigquery-data-editor"} 2023-06-05T14:17:18.2042097Z === RUN TestLogSinkController/TestIAMPolicyUpdate 2023-06-05T14:17:18.2043321Z {"severity":"info","ts":1685974634.9787781,"logger":"controller","message":"resolved project id","name":"updated-project-ref","namespace":"logsinkctl-549809f5","destination":{"name":"updated-project-ref"},"project-id":"foreman-dev"} 2023-06-05T14:17:18.2045152Z {"severity":"info","ts":1685974634.9834108,"logger":"controller","message":"IAMPolicyMember successfully created","name":"updated-project-ref","namespace":"logsinkctl-549809f5","destination":{"name":"updated-project-ref"},"iampolicymember":"logsinkctl-549809f5/updated-project-ref-bigquery-data-editor"} 2023-06-05T14:17:18.2046755Z {"severity":"info","ts":1685974634.9835658,"logger":"controller","message":"resolved project id","name":"updated-project-ref","namespace":"logsinkctl-549809f5","destination":{"name":"updated-project-ref"},"project-id":"foreman-dev"} 2023-06-05T14:17:18.2048361Z {"severity":"info","ts":1685974634.98359,"logger":"controller","message":"IAMPolicyMember already exists, will not re-create","name":"updated-project-ref","namespace":"logsinkctl-549809f5","destination":{"name":"updated-project-ref"},"iampolicymember":"logsinkctl-549809f5/updated-project-ref-bigquery-data-editor"} 2023-06-05T14:17:18.2050511Z {"severity":"info","ts":1685974635.9948025,"logger":"controller","message":"resolved project id","name":"updated-project-ref","namespace":"logsinkctl-549809f5","destination":{"name":"updated-project-ref"},"project-id":"ret-edge-foo-fighters"} 2023-06-05T14:17:18.2052572Z {"severity":"info","ts":1685974636.002237,"logger":"controller","message":"IAMPolicyMember successfully created","name":"updated-project-ref","namespace":"logsinkctl-549809f5","destination":{"name":"updated-project-ref"},"iampolicymember":"logsinkctl-549809f5/updated-project-ref-bigquery-data-editor"} 2023-06-05T14:17:18.2054269Z {"severity":"info","ts":1685974636.0023708,"logger":"controller","message":"resolved project id","name":"updated-project-ref","namespace":"logsinkctl-549809f5","destination":{"name":"updated-project-ref"},"project-id":"ret-edge-foo-fighters"} 2023-06-05T14:17:18.2056143Z {"severity":"info","ts":1685974636.0023985,"logger":"controller","message":"IAMPolicyMember already exists, will not re-create","name":"updated-project-ref","namespace":"logsinkctl-549809f5","destination":{"name":"updated-project-ref"},"iampolicymember":"logsinkctl-549809f5/updated-project-ref-bigquery-data-editor"} 2023-06-05T14:17:18.2057276Z {"severity":"info","ts":1685974636.9993963,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:17:18.2057927Z {"severity":"info","ts":1685974636.9994285,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:17:18.2058763Z {"severity":"info","ts":1685974636.9994476,"message":"Shutdown signal received, waiting for all workers to finish","controller":"logginglogsink","controllerGroup":"logging.cnrm.cloud.google.com","controllerKind":"LoggingLogSink"} 2023-06-05T14:17:18.2059791Z {"severity":"info","ts":1685974636.9994724,"message":"All workers finished","controller":"logginglogsink","controllerGroup":"logging.cnrm.cloud.google.com","controllerKind":"LoggingLogSink"} 2023-06-05T14:17:18.2060644Z {"severity":"info","ts":1685974636.9994876,"message":"Stopping and waiting for caches"} 2023-06-05T14:17:18.2061225Z {"severity":"info","ts":1685974636.9997249,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:17:18.2061857Z {"severity":"info","ts":1685974636.9997408,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:17:18.2062528Z --- PASS: TestLogSinkController (16.64s) 2023-06-05T14:17:18.2063209Z --- PASS: TestLogSinkController/TestBigQueryDestination (2.04s) 2023-06-05T14:17:18.2063930Z --- PASS: TestLogSinkController/TestIAMPolicyUpdate (2.03s) 2023-06-05T14:17:18.2064362Z PASS 2023-06-05T14:17:18.2064708Z ================================================================================ 2023-06-05T14:17:18.2268769Z INFO: From Testing //pkg/k8s/runtime/sap/install:install_test: 2023-06-05T14:17:18.2269495Z ==================== Test output for //pkg/k8s/runtime/sap/install:install_test: 2023-06-05T14:17:18.2270106Z === RUN TestOptions_Defaults 2023-06-05T14:17:18.2270698Z --- PASS: TestOptions_Defaults (0.00s) 2023-06-05T14:17:18.2271209Z === RUN TestOptions_WithForce 2023-06-05T14:17:18.2271789Z --- PASS: TestOptions_WithForce (0.00s) 2023-06-05T14:17:18.2272294Z === RUN TestOptions_WithTimeout 2023-06-05T14:17:18.2272843Z --- PASS: TestOptions_WithTimeout (0.00s) 2023-06-05T14:17:18.2273228Z === RUN TestOptions_WithoutWait 2023-06-05T14:17:18.2273682Z --- PASS: TestOptions_WithoutWait (0.00s) 2023-06-05T14:17:18.2274068Z PASS 2023-06-05T14:17:18.2274428Z ================================================================================ 2023-06-05T14:17:18.2689414Z INFO: From Testing //pkg/edge/datasync/controllers/couchctl/couchdb:couchdb_test: 2023-06-05T14:17:18.2690206Z ==================== Test output for //pkg/edge/datasync/controllers/couchctl/couchdb:couchdb_test: 2023-06-05T14:17:18.2690703Z === RUN TestManifests 2023-06-05T14:17:18.2691194Z --- PASS: TestManifests (1.31s) 2023-06-05T14:17:18.2691741Z === RUN TestOldCouchDBManifests 2023-06-05T14:17:18.2692257Z --- PASS: TestOldCouchDBManifests (0.01s) 2023-06-05T14:17:18.2693198Z === RUN TestNilFieldCouchDBManifests 2023-06-05T14:17:18.2693789Z --- PASS: TestNilFieldCouchDBManifests (0.00s) 2023-06-05T14:17:18.2694418Z PASS 2023-06-05T14:17:18.2694778Z ================================================================================ 2023-06-05T14:17:18.6665056Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient/selector:selector_test: 2023-06-05T14:17:18.6665922Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient/selector:selector_test: 2023-06-05T14:17:18.6666510Z === RUN TestGetTargetObjectsForSelector 2023-06-05T14:17:18.6667186Z --- PASS: TestGetTargetObjectsForSelector (0.02s) 2023-06-05T14:17:18.6667822Z === RUN TestErrorHandlingWhenGettingTargetObjectsForInvalidSelectors 2023-06-05T14:17:18.6668729Z --- PASS: TestErrorHandlingWhenGettingTargetObjectsForInvalidSelectors (0.01s) 2023-06-05T14:17:18.6669410Z === RUN TestFindTargetSelectorForConfigObject 2023-06-05T14:17:18.6670116Z --- PASS: TestFindTargetSelectorForConfigObject (0.00s) 2023-06-05T14:17:18.6670745Z === RUN TestErrorHandlingWhenFindingTargetSelectorForConfigObject 2023-06-05T14:17:18.6671579Z --- PASS: TestErrorHandlingWhenFindingTargetSelectorForConfigObject (0.00s) 2023-06-05T14:17:18.6672049Z PASS 2023-06-05T14:17:18.6672425Z ================================================================================ 2023-06-05T14:17:19.5347379Z INFO: From Testing //pkg/f8n/devinfra/gridbug:gridbug_test: 2023-06-05T14:17:19.5347984Z ==================== Test output for //pkg/f8n/devinfra/gridbug:gridbug_test: 2023-06-05T14:17:19.5348385Z === RUN TestGetName 2023-06-05T14:17:19.5348831Z --- PASS: TestGetName (0.00s) 2023-06-05T14:17:19.5349175Z PASS 2023-06-05T14:17:19.5349505Z ================================================================================ 2023-06-05T14:17:19.8897333Z INFO: From Testing //pkg/k8s/unstructured:unstructured_test: 2023-06-05T14:17:19.8897936Z ==================== Test output for //pkg/k8s/unstructured:unstructured_test: 2023-06-05T14:17:19.8898368Z === RUN TestToUnstructured 2023-06-05T14:17:19.8898947Z --- PASS: TestToUnstructured (0.00s) 2023-06-05T14:17:19.8899349Z === RUN TestToUnstructuredList 2023-06-05T14:17:19.8899926Z --- PASS: TestToUnstructuredList (0.00s) 2023-06-05T14:17:19.8900476Z === RUN TestUnmarshalField 2023-06-05T14:17:19.8900939Z --- PASS: TestUnmarshalField (0.00s) 2023-06-05T14:17:19.8901316Z === RUN TestToClientObjArray 2023-06-05T14:17:19.8901768Z --- PASS: TestToClientObjArray (0.00s) 2023-06-05T14:17:19.8902157Z PASS 2023-06-05T14:17:19.8902495Z ================================================================================ 2023-06-05T14:17:20.2513945Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/example:example_test: 2023-06-05T14:17:20.2514648Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/example:example_test: 2023-06-05T14:17:20.2515166Z === RUN TestCreatePlugin 2023-06-05T14:17:20.2515516Z --- PASS: TestCreatePlugin (0.00s) 2023-06-05T14:17:20.2516037Z === RUN TestSecretExampleOnlyReconcilesWhenHostIENExists 2023-06-05T14:17:20.2516963Z --- PASS: TestSecretExampleOnlyReconcilesWhenHostIENExists (0.01s) 2023-06-05T14:17:20.2517483Z PASS 2023-06-05T14:17:20.2517818Z ================================================================================ 2023-06-05T14:17:21.1083144Z INFO: From Testing //pkg/f8n/devinfra/gcp/job/storage:storage_test: 2023-06-05T14:17:21.1083846Z ==================== Test output for //pkg/f8n/devinfra/gcp/job/storage:storage_test: 2023-06-05T14:17:21.1084345Z === RUN TestJobStorageClient 2023-06-05T14:17:21.1084937Z framework.go:161: [integration] skipping: this test can only be ran as an integration test 2023-06-05T14:17:21.1085572Z --- SKIP: TestJobStorageClient (0.00s) 2023-06-05T14:17:21.1085954Z === RUN TestOptions 2023-06-05T14:17:21.1086397Z --- PASS: TestOptions (0.00s) 2023-06-05T14:17:21.1087004Z === RUN TestActionsPath 2023-06-05T14:17:21.1087919Z --- PASS: TestActionsPath (0.00s) 2023-06-05T14:17:21.1088262Z PASS 2023-06-05T14:17:21.1088620Z ================================================================================ 2023-06-05T14:17:21.8017797Z INFO: From Testing //pkg/f8n/warehouse/oci/layer:layer_test: 2023-06-05T14:17:21.8018422Z ==================== Test output for //pkg/f8n/warehouse/oci/layer:layer_test: 2023-06-05T14:17:21.8018856Z === RUN TestLayer_Descriptor 2023-06-05T14:17:21.8019474Z --- PASS: TestLayer_Descriptor (0.00s) 2023-06-05T14:17:21.8019816Z === RUN TestType 2023-06-05T14:17:21.8020299Z --- PASS: TestType (0.00s) 2023-06-05T14:17:21.8020618Z === RUN TestForCapability 2023-06-05T14:17:21.8021048Z --- PASS: TestForCapability (0.00s) 2023-06-05T14:17:21.8021379Z === RUN TestKey 2023-06-05T14:17:21.8021668Z === RUN TestKey/base_runtime_layer 2023-06-05T14:17:21.8021990Z === RUN TestKey/infra_layer 2023-06-05T14:17:21.8022336Z === RUN TestKey/config_layer 2023-06-05T14:17:21.8022710Z === RUN TestKey/runtime_capability_layer 2023-06-05T14:17:21.8023178Z --- PASS: TestKey (0.00s) 2023-06-05T14:17:21.8023750Z --- PASS: TestKey/base_runtime_layer (0.00s) 2023-06-05T14:17:21.8024350Z --- PASS: TestKey/infra_layer (0.00s) 2023-06-05T14:17:21.8024804Z --- PASS: TestKey/config_layer (0.00s) 2023-06-05T14:17:21.8025285Z --- PASS: TestKey/runtime_capability_layer (0.00s) 2023-06-05T14:17:21.8025717Z === RUN TestSort 2023-06-05T14:17:21.8026155Z --- PASS: TestSort (0.00s) 2023-06-05T14:17:21.8026535Z === RUN TestFromImage 2023-06-05T14:17:21.8027047Z === RUN TestFromImage/drops_non-warehouse_layers 2023-06-05T14:17:21.8027596Z --- PASS: TestFromImage (0.00s) 2023-06-05T14:17:21.8028229Z --- PASS: TestFromImage/drops_non-warehouse_layers (0.00s) 2023-06-05T14:17:21.8028817Z PASS 2023-06-05T14:17:21.8029197Z ================================================================================ 2023-06-05T14:17:21.8584252Z INFO: From Testing //pkg/sds/k8s/controllers/remoteaccess/pkg:pkg_test: 2023-06-05T14:17:21.8584915Z ==================== Test output for //pkg/sds/k8s/controllers/remoteaccess/pkg:pkg_test: 2023-06-05T14:17:21.8585499Z === RUN TestVPNConfigMapNotExistingReturnsError 2023-06-05T14:17:21.8586211Z --- PASS: TestVPNConfigMapNotExistingReturnsError (0.01s) 2023-06-05T14:17:21.8586840Z === RUN TestVPNConfigHasIPAddressSet 2023-06-05T14:17:21.8587396Z --- PASS: TestVPNConfigHasIPAddressSet (0.02s) 2023-06-05T14:17:21.8587891Z === RUN TestVPNConfigHasIPAddressReassigned 2023-06-05T14:17:21.8588532Z --- PASS: TestVPNConfigHasIPAddressReassigned (0.01s) 2023-06-05T14:17:21.8589048Z === RUN TestValidVPNConfigIsNotAltered 2023-06-05T14:17:21.8589600Z --- PASS: TestValidVPNConfigIsNotAltered (0.01s) 2023-06-05T14:17:21.8590117Z === RUN TestAssignedIPAddressesAreUnique 2023-06-05T14:17:21.8590724Z --- PASS: TestAssignedIPAddressesAreUnique (0.08s) 2023-06-05T14:17:21.8591373Z === RUN TestIPAddressesAreNotAssignedWhenPoolIsFull 2023-06-05T14:17:21.8592120Z --- PASS: TestIPAddressesAreNotAssignedWhenPoolIsFull (0.11s) 2023-06-05T14:17:21.8592828Z === RUN TestVPNConfigWithRelayIPAddressHasNewAddressAssigned 2023-06-05T14:17:21.8593685Z --- PASS: TestVPNConfigWithRelayIPAddressHasNewAddressAssigned (0.00s) 2023-06-05T14:17:21.8594323Z === RUN TestWireguardRelayDeploymentIsCreated 2023-06-05T14:17:21.8594958Z --- PASS: TestWireguardRelayDeploymentIsCreated (0.00s) 2023-06-05T14:17:21.8595491Z === RUN TestRelaySecretContainsExpectedData 2023-06-05T14:17:21.8596129Z --- PASS: TestRelaySecretContainsExpectedData (0.00s) 2023-06-05T14:17:21.8596696Z === RUN TestClientSecretContainsExpectedData 2023-06-05T14:17:21.8597346Z --- PASS: TestClientSecretContainsExpectedData (0.00s) 2023-06-05T14:17:21.8597907Z === RUN TestMultipleStoresAreAddedToRelaySecret 2023-06-05T14:17:21.8598631Z --- PASS: TestMultipleStoresAreAddedToRelaySecret (0.01s) 2023-06-05T14:17:21.8599203Z === RUN TestMultipleStoresAreAddedToClientSecret 2023-06-05T14:17:21.8600338Z --- PASS: TestMultipleStoresAreAddedToClientSecret (0.01s) 2023-06-05T14:17:21.8601007Z === RUN TestStoreCanBeRemovedFromRelaySecret 2023-06-05T14:17:21.8601946Z --- PASS: TestStoreCanBeRemovedFromRelaySecret (0.02s) 2023-06-05T14:17:21.8602469Z === RUN TestStoreCanBeRemovedFromClientSecret 2023-06-05T14:17:21.8603118Z --- PASS: TestStoreCanBeRemovedFromClientSecret (0.02s) 2023-06-05T14:17:21.8603673Z === RUN TestStoreDeploymentSyncedObjectIsCreated 2023-06-05T14:17:21.8604368Z --- PASS: TestStoreDeploymentSyncedObjectIsCreated (0.01s) 2023-06-05T14:17:21.8604976Z === RUN TestStoreExternalSecretSyncedObjectIsCreated 2023-06-05T14:17:21.8605712Z --- PASS: TestStoreExternalSecretSyncedObjectIsCreated (0.00s) 2023-06-05T14:17:21.8606273Z === RUN TestMultipleStoresAreConfigured 2023-06-05T14:17:21.8606866Z --- PASS: TestMultipleStoresAreConfigured (0.01s) 2023-06-05T14:17:21.8607294Z === RUN TestStoreCanBeRemoved 2023-06-05T14:17:21.8607800Z --- PASS: TestStoreCanBeRemoved (0.01s) 2023-06-05T14:17:21.8608274Z === RUN TestEmissaryMappingIsCreated 2023-06-05T14:17:21.8608845Z --- PASS: TestEmissaryMappingIsCreated (0.00s) 2023-06-05T14:17:21.8609308Z === RUN TestEmissaryMappingIsDeleted 2023-06-05T14:17:21.8609887Z --- PASS: TestEmissaryMappingIsDeleted (0.01s) 2023-06-05T14:17:21.8610368Z === RUN TestEmissaryMappingIsUpdated 2023-06-05T14:17:21.8611012Z --- PASS: TestEmissaryMappingIsUpdated (0.01s) 2023-06-05T14:17:21.8611753Z === RUN TestEmissaryDeploymentWithoutWireguardIsRestarted 2023-06-05T14:17:21.8612594Z --- PASS: TestEmissaryDeploymentWithoutWireguardIsRestarted (0.00s) 2023-06-05T14:17:21.8613239Z === RUN TestEmissaryDeploymentWithoutWireguardIsNotRestarted 2023-06-05T14:17:21.8614054Z --- PASS: TestEmissaryDeploymentWithoutWireguardIsNotRestarted (0.00s) 2023-06-05T14:17:21.8614646Z === RUN TestStoresCanBeDisabled 2023-06-05T14:17:21.8615137Z --- PASS: TestStoresCanBeDisabled (0.01s) 2023-06-05T14:17:21.8615519Z PASS 2023-06-05T14:17:21.8615887Z ================================================================================ 2023-06-05T14:17:22.0010978Z INFO: From Testing //pkg/edge/linkerd/controllers:controllers_test: 2023-06-05T14:17:22.0011807Z ==================== Test output for //pkg/edge/linkerd/controllers:controllers_test: 2023-06-05T14:17:22.0012267Z === RUN TestLinkerdController 2023-06-05T14:17:22.0012961Z {"severity":"info","ts":1685974615.9606292,"message":"Starting EventSource","controller":"linkerd","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"Linkerd","source":"kind source: *v1alpha1.Linkerd"} 2023-06-05T14:17:22.0013942Z {"severity":"info","ts":1685974615.962416,"message":"Starting EventSource","controller":"linkerdworkloadinjection","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"LinkerdWorkloadInjection","source":"kind source: *v1alpha1.LinkerdWorkloadInjection"} 2023-06-05T14:17:22.0015144Z {"severity":"info","ts":1685974615.9624789,"message":"Starting Controller","controller":"linkerdworkloadinjection","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"LinkerdWorkloadInjection"} 2023-06-05T14:17:22.0016064Z {"severity":"info","ts":1685974615.9624703,"message":"Starting EventSource","controller":"linkerd","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"Linkerd","source":"kind source: *v1.Certificate"} 2023-06-05T14:17:22.0016928Z {"severity":"info","ts":1685974615.9625022,"message":"Starting EventSource","controller":"linkerd","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"Linkerd","source":"kind source: *v1.Issuer"} 2023-06-05T14:17:22.0017791Z {"severity":"info","ts":1685974615.9625108,"message":"Starting EventSource","controller":"linkerd","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"Linkerd","source":"kind source: *v1.Node"} 2023-06-05T14:17:22.0018649Z {"severity":"info","ts":1685974615.9625475,"message":"Starting EventSource","controller":"linkerd","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"Linkerd","source":"kind source: *v1.ConfigMap"} 2023-06-05T14:17:22.0019985Z {"severity":"info","ts":1685974615.9625528,"message":"Starting Controller","controller":"linkerd","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"Linkerd"} 2023-06-05T14:17:22.0020855Z === RUN TestLinkerdController/TestLinkerdInstall 2023-06-05T14:17:22.0021592Z {"severity":"info","ts":1685974616.3637786,"message":"Starting workers","controller":"linkerdworkloadinjection","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"LinkerdWorkloadInjection","worker count":1} 2023-06-05T14:17:22.0022495Z {"severity":"info","ts":1685974616.364209,"message":"Starting workers","controller":"linkerd","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"Linkerd","worker count":1} 2023-06-05T14:17:22.0049640Z {"severity":"info","ts":1685974620.2746637,"logger":"controller.install","message":"applied linkerd install manifests","resources":[{"ObjMetadata":{"Namespace":"","Name":"authorizationpolicies.policy.linkerd.io","GroupKind":{"Group":"apiextensions.k8s.io","Kind":"CustomResourceDefinition"}},"GroupVersion":"v1","Subject":"CustomResourceDefinition/authorizationpolicies.policy.linkerd.io","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"httproutes.policy.linkerd.io","GroupKind":{"Group":"apiextensions.k8s.io","Kind":"CustomResourceDefinition"}},"GroupVersion":"v1","Subject":"CustomResourceDefinition/httproutes.policy.linkerd.io","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"meshtlsauthentications.policy.linkerd.io","GroupKind":{"Group":"apiextensions.k8s.io","Kind":"CustomResourceDefinition"}},"GroupVersion":"v1","Subject":"CustomResourceDefinition/meshtlsauthentications.policy.linkerd.io","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"networkauthentications.policy.linkerd.io","GroupKind":{"Group":"apiextensions.k8s.io","Kind":"CustomResourceDefinition"}},"GroupVersion":"v1","Subject":"CustomResourceDefinition/networkauthentications.policy.linkerd.io","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"serverauthorizations.policy.linkerd.io","GroupKind":{"Group":"apiextensions.k8s.io","Kind":"CustomResourceDefinition"}},"GroupVersion":"v1","Subject":"CustomResourceDefinition/serverauthorizations.policy.linkerd.io","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"servers.policy.linkerd.io","GroupKind":{"Group":"apiextensions.k8s.io","Kind":"CustomResourceDefinition"}},"GroupVersion":"v1","Subject":"CustomResourceDefinition/servers.policy.linkerd.io","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"serviceprofiles.linkerd.io","GroupKind":{"Group":"apiextensions.k8s.io","Kind":"CustomResourceDefinition"}},"GroupVersion":"v1","Subject":"CustomResourceDefinition/serviceprofiles.linkerd.io","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-destination","GroupKind":{"Group":"","Kind":"ServiceAccount"}},"GroupVersion":"v1","Subject":"ServiceAccount/linkerd/linkerd-destination","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-identity","GroupKind":{"Group":"","Kind":"ServiceAccount"}},"GroupVersion":"v1","Subject":"ServiceAccount/linkerd/linkerd-identity","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-proxy-injector","GroupKind":{"Group":"","Kind":"ServiceAccount"}},"GroupVersion":"v1","Subject":"ServiceAccount/linkerd/linkerd-proxy-injector","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-linkerd-destination","GroupKind":{"Group":"rbac.authorization.k8s.io","Kind":"ClusterRole"}},"GroupVersion":"v1","Subject":"ClusterRole/linkerd-linkerd-destination","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-linkerd-identity","GroupKind":{"Group":"rbac.authorization.k8s.io","Kind":"ClusterRole"}},"GroupVersion":"v1","Subject":"ClusterRole/linkerd-linkerd-identity","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-linkerd-proxy-injector","GroupKind":{"Group":"rbac.authorization.k8s.io","Kind":"ClusterRole"}},"GroupVersion":"v1","Subject":"ClusterRole/linkerd-linkerd-proxy-injector","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-policy","GroupKind":{"Group":"rbac.authorization.k8s.io","Kind":"ClusterRole"}},"GroupVersion":"v1","Subject":"ClusterRole/linkerd-policy","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-destination-policy","GroupKind":{"Group":"rbac.authorization.k8s.io","Kind":"ClusterRoleBinding"}},"GroupVersion":"v1","Subject":"ClusterRoleBinding/linkerd-destination-policy","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-linkerd-destination","GroupKind":{"Group":"rbac.authorization.k8s.io","Kind":"ClusterRoleBinding"}},"GroupVersion":"v1","Subject":"ClusterRoleBinding/linkerd-linkerd-destination","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-linkerd-identity","GroupKind":{"Group":"rbac.authorization.k8s.io","Kind":"ClusterRoleBinding"}},"GroupVersion":"v1","Subject":"ClusterRoleBinding/linkerd-linkerd-identity","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-linkerd-proxy-injector","GroupKind":{"Group":"rbac.authorization.k8s.io","Kind":"ClusterRoleBinding"}},"GroupVersion":"v1","Subject":"ClusterRoleBinding/linkerd-linkerd-proxy-injector","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-config","GroupKind":{"Group":"","Kind":"ConfigMap"}},"GroupVersion":"v1","Subject":"ConfigMap/linkerd/linkerd-config","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-identity-trust-roots","GroupKind":{"Group":"","Kind":"ConfigMap"}},"GroupVersion":"v1","Subject":"ConfigMap/linkerd/linkerd-identity-trust-roots","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-policy-validator-k8s-tls","GroupKind":{"Group":"","Kind":"Secret"}},"GroupVersion":"v1","Subject":"Secret/linkerd/linkerd-policy-validator-k8s-tls","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-proxy-injector-k8s-tls","GroupKind":{"Group":"","Kind":"Secret"}},"GroupVersion":"v1","Subject":"Secret/linkerd/linkerd-proxy-injector-k8s-tls","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-sp-validator-k8s-tls","GroupKind":{"Group":"","Kind":"Secret"}},"GroupVersion":"v1","Subject":"Secret/linkerd/linkerd-sp-validator-k8s-tls","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-dst","GroupKind":{"Group":"","Kind":"Service"}},"GroupVersion":"v1","Subject":"Service/linkerd/linkerd-dst","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-dst-headless","GroupKind":{"Group":"","Kind":"Service"}},"GroupVersion":"v1","Subject":"Service/linkerd/linkerd-dst-headless","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-identity","GroupKind":{"Group":"","Kind":"Service"}},"GroupVersion":"v1","Subject":"Service/linkerd/linkerd-identity","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-identity-headless","GroupKind":{"Group":"","Kind":"Service"}},"GroupVersion":"v1","Subject":"Service/linkerd/linkerd-identity-headless","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-policy","GroupKind":{"Group":"","Kind":"Service"}},"GroupVersion":"v1","Subject":"Service/linkerd/linkerd-policy","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-policy-validator","GroupKind":{"Group":"","Kind":"Service"}},"GroupVersion":"v1","Subject":"Service/linkerd/linkerd-policy-validator","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-proxy-injector","GroupKind":{"Group":"","Kind":"Service"}},"GroupVersion":"v1","Subject":"Service/linkerd/linkerd-proxy-injector","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-sp-validator","GroupKind":{"Group":"","Kind":"Service"}},"GroupVersion":"v1","Subject":"Service/linkerd/linkerd-sp-validator","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-destination","GroupKind":{"Group":"apps","Kind":"Deployment"}},"GroupVersion":"v1","Subject":"Deployment/linkerd/linkerd-destination","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-identity","GroupKind":{"Group":"apps","Kind":"Deployment"}},"GroupVersion":"v1","Subject":"Deployment/linkerd/linkerd-identity","Action":"created"},{"ObjMetadata":{"Namespace":"linkerd","Name":"linkerd-proxy-injector","GroupKind":{"Group":"apps","Kind":"Deployment"}},"GroupVersion":"v1","Subject":"Deployment/linkerd/linkerd-proxy-injector","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-proxy-injector-webhook-config","GroupKind":{"Group":"admissionregistration.k8s.io","Kind":"MutatingWebhookConfiguration"}},"GroupVersion":"v1","Subject":"MutatingWebhookConfiguration/linkerd-proxy-injector-webhook-config","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-policy-validator-webhook-config","GroupKind":{"Group":"admissionregistration.k8s.io","Kind":"ValidatingWebhookConfiguration"}},"GroupVersion":"v1","Subject":"ValidatingWebhookConfiguration/linkerd-policy-validator-webhook-config","Action":"created"},{"ObjMetadata":{"Namespace":"","Name":"linkerd-sp-validator-webhook-config","GroupKind":{"Group":"admissionregistration.k8s.io","Kind":"ValidatingWebhookConfiguration"}},"GroupVersion":"v1","Subject":"ValidatingWebhookConfiguration/linkerd-sp-validator-webhook-config","Action":"created"}]} 2023-06-05T14:17:22.0067649Z {"severity":"info","ts":1685974621.4107733,"logger":"workloadinjection-controller","message":"starting linkerd workload injection job..."} 2023-06-05T14:17:22.0068733Z {"severity":"info","ts":1685974621.5161667,"logger":"workloadinjection-controller","message":"successfully reinjected workloads"} 2023-06-05T14:17:22.0069271Z {"severity":"info","ts":1685974622.4139962,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:17:22.0069958Z {"severity":"info","ts":1685974622.414051,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:17:22.0070761Z {"severity":"info","ts":1685974622.414091,"message":"Shutdown signal received, waiting for all workers to finish","controller":"linkerd","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"Linkerd"} 2023-06-05T14:17:22.0071882Z {"severity":"info","ts":1685974622.4140813,"message":"Shutdown signal received, waiting for all workers to finish","controller":"linkerdworkloadinjection","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"LinkerdWorkloadInjection"} 2023-06-05T14:17:22.0072989Z {"severity":"info","ts":1685974622.4141083,"message":"All workers finished","controller":"linkerdworkloadinjection","controllerGroup":"linkerd.edge.ncr.com","controllerKind":"LinkerdWorkloadInjection"} 2023-06-05T14:17:22.0073739Z --- PASS: TestLinkerdController (36.07s) 2023-06-05T14:17:22.0074323Z --- PASS: TestLinkerdController/TestLinkerdInstall (6.45s) 2023-06-05T14:17:22.0074726Z PASS 2023-06-05T14:17:22.0075035Z ================================================================================ 2023-06-05T14:17:22.9613740Z INFO: From Testing //pkg/edge/clientutils:clientutils_test: 2023-06-05T14:17:22.9614311Z ==================== Test output for //pkg/edge/clientutils:clientutils_test: 2023-06-05T14:17:22.9614796Z === RUN TestCreateOrUpdateConfigmap 2023-06-05T14:17:22.9615291Z --- PASS: TestCreateOrUpdateConfigmap (0.00s) 2023-06-05T14:17:22.9615635Z PASS 2023-06-05T14:17:22.9615926Z ================================================================================ 2023-06-05T14:17:24.7850037Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/list:list_test: 2023-06-05T14:17:24.7850687Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/list:list_test: 2023-06-05T14:17:24.7851693Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/changelog:changelog_test: 2023-06-05T14:17:24.7852650Z === RUN TestHandleNewIssue 2023-06-05T14:17:24.7853749Z {"severity":"info","ts":1685974644.6952894,"message":"------- got a new issue event"} 2023-06-05T14:17:24.7854402Z {"severity":"info","ts":1685974644.6954372,"message":"Handling a new issue"} 2023-06-05T14:17:24.7855038Z {"severity":"info","ts":1685974644.6955082,"message":""} 2023-06-05T14:17:24.7856027Z {"severity":"info","ts":1685974644.695568,"message":"0"} 2023-06-05T14:17:24.7859151Z {"severity":"info","ts":1685974644.6956098,"message":"body is empty exiting"} 2023-06-05T14:17:24.7860496Z {"severity":"info","ts":1685974644.6956887,"message":"------- got a new issue event"} 2023-06-05T14:17:24.7861015Z {"severity":"info","ts":1685974644.6957412,"message":"Handling a new issue"} 2023-06-05T14:17:24.7861507Z {"severity":"info","ts":1685974644.6957781,"message":"Nothing to see here"} 2023-06-05T14:17:24.7862003Z {"severity":"info","ts":1685974644.695824,"message":"19"} 2023-06-05T14:17:24.7862605Z {"severity":"info","ts":1685974644.696009,"message":"{Parents:{Added:[] Removed:[] Count:0} Children:{Added:[] Removed:[] Count:0}}"} 2023-06-05T14:17:24.7866026Z {"severity":"info","ts":1685974644.6960788,"message":"No commands found"} 2023-06-05T14:17:24.7867033Z {"severity":"info","ts":1685974644.696152,"message":"------- got a new issue event"} 2023-06-05T14:17:24.7867728Z {"severity":"info","ts":1685974644.6961982,"message":"Handling a new issue"} 2023-06-05T14:17:24.7868763Z {"severity":"info","ts":1685974644.6962314,"message":"/child #1 /parent #1"} 2023-06-05T14:17:24.7871856Z {"severity":"info","ts":1685974644.6962752,"message":"20"} 2023-06-05T14:17:24.7872714Z {"severity":"info","ts":1685974644.6964123,"message":"{Parents:{Added:[1] Removed:[] Count:1} Children:{Added:[1] Removed:[] Count:1}}"} 2023-06-05T14:17:24.7873722Z {"severity":"info","ts":1685974644.6964755,"message":"Cannot mix /child and /parent commands"} 2023-06-05T14:17:24.7874814Z creating comment{"severity":"info","ts":1685974644.6965652,"message":"------- got a new issue event"} 2023-06-05T14:17:24.7875319Z {"severity":"info","ts":1685974644.696611,"message":"Handling a new issue"} 2023-06-05T14:17:24.7875758Z {"severity":"info","ts":1685974644.6966462,"message":"/child #2"} 2023-06-05T14:17:24.7876155Z {"severity":"info","ts":1685974644.6966932,"message":"9"} 2023-06-05T14:17:24.7876661Z {"severity":"info","ts":1685974644.6967924,"message":"{Parents:{Added:[] Removed:[] Count:0} Children:{Added:[2] Removed:[] Count:1}}"} 2023-06-05T14:17:24.7877179Z {"severity":"info","ts":1685974644.6968417,"message":"its a parent"} 2023-06-05T14:17:24.7877708Z {"severity":"info","ts":1685974644.6969123,"message":"not mixed commands"} 2023-06-05T14:17:24.7878300Z {"severity":"info","ts":1685974644.6969662,"message":"adding child to parent"} 2023-06-05T14:17:24.7878794Z {"severity":"info","ts":1685974644.6970072,"message":"Adding a list of issues"} 2023-06-05T14:17:24.7879213Z {"severity":"info","ts":1685974644.6970692,"message":"[2]"} 2023-06-05T14:17:24.7879615Z {"severity":"info","ts":1685974644.6971045,"message":"kind/feature"} 2023-06-05T14:17:24.7880074Z {"severity":"info","ts":1685974644.6971803,"message":"Issue already has a parent label"} 2023-06-05T14:17:24.7882178Z {"severity":"info","ts":1685974644.6972222,"message":"/child #2\n\n\n___\n\n\n### parents\n\n*No Issues added yet*\n\n### children\n\n*No Issues added yet*\n\n\n To add to this list use the commands: \n`/child #{child_number}` to add a child or `/parent #{parent_number}` to add a parent.\n[Click here to find outmore about jackbot](https://docs.edge-infra.dev/foundation/dev-infra/bots/jackbot/)\n___\n\n"} 2023-06-05T14:17:24.7883479Z {"severity":"info","ts":1685974644.697287,"message":"2"} 2023-06-05T14:17:24.7883916Z getting{"severity":"info","ts":1685974644.6973617,"message":"Adding epic 1 to issue 999"} 2023-06-05T14:17:24.7884389Z editing{"severity":"info","ts":1685974644.6974387,"message":"Added issue 999 to epic 1"} 2023-06-05T14:17:24.7884822Z editing{"severity":"info","ts":1685974644.6975346,"message":"after add calls"} 2023-06-05T14:17:24.7885401Z {"severity":"info","ts":1685974644.6976023,"message":"------- got a new issue event"} 2023-06-05T14:17:24.7885832Z {"severity":"info","ts":1685974644.697649,"message":"Handling a new issue"} 2023-06-05T14:17:24.7886608Z {"severity":"info","ts":1685974644.6976821,"message":"/parent #2"} 2023-06-05T14:17:24.7887003Z {"severity":"info","ts":1685974644.697726,"message":"10"} 2023-06-05T14:17:24.7887677Z {"severity":"info","ts":1685974644.6978447,"message":"{Parents:{Added:[2] Removed:[] Count:1} Children:{Added:[] Removed:[] Count:0}}"} 2023-06-05T14:17:24.7888160Z {"severity":"info","ts":1685974644.6979134,"message":"not mixed commands"} 2023-06-05T14:17:24.7888583Z {"severity":"info","ts":1685974644.6979487,"message":"adding parent to child"} 2023-06-05T14:17:24.7889024Z {"severity":"info","ts":1685974644.697999,"message":"Adding a list of issues"} 2023-06-05T14:17:24.7889406Z {"severity":"info","ts":1685974644.6980352,"message":"[2]"} 2023-06-05T14:17:24.7891191Z {"severity":"info","ts":1685974644.6981053,"message":"/parent #2\n\n\n___\n\n\n### parents\n\n*No Issues added yet*\n\n\n\n\n\n To add to this list use the commands: \n`/child #{child_number}` to add a child or `/parent #{parent_number}` to add a parent.\n[Click here to find outmore about jackbot](https://docs.edge-infra.dev/foundation/dev-infra/bots/jackbot/)\n___\n\n"} 2023-06-05T14:17:24.7892568Z {"severity":"info","ts":1685974644.698227,"message":"2"} 2023-06-05T14:17:24.7892993Z getting{"severity":"info","ts":1685974644.6983085,"message":"Adding epic 1 to issue 999"} 2023-06-05T14:17:24.7893467Z editing{"severity":"info","ts":1685974644.6983876,"message":"Added issue 999 to epic 1"} 2023-06-05T14:17:24.7893919Z editing{"severity":"info","ts":1685974644.6984618,"message":"after add calls"} 2023-06-05T14:17:24.7894526Z {"severity":"info","ts":1685974644.6985152,"message":"------- got a new issue event"} 2023-06-05T14:17:24.7894948Z {"severity":"info","ts":1685974644.6985517,"message":"Handling a new issue"} 2023-06-05T14:17:24.7895361Z {"severity":"info","ts":1685974644.6985977,"message":"/parent #2"} 2023-06-05T14:17:24.7895773Z {"severity":"info","ts":1685974644.6986303,"message":"10"} 2023-06-05T14:17:24.7896268Z {"severity":"info","ts":1685974644.6987157,"message":"{Parents:{Added:[2] Removed:[] Count:1} Children:{Added:[] Removed:[] Count:0}}"} 2023-06-05T14:17:24.7896777Z {"severity":"info","ts":1685974644.6987648,"message":"not mixed commands"} 2023-06-05T14:17:24.7897191Z {"severity":"info","ts":1685974644.6987987,"message":"adding parent to child"} 2023-06-05T14:17:24.7897606Z {"severity":"info","ts":1685974644.698841,"message":"Adding a list of issues"} 2023-06-05T14:17:24.7898009Z {"severity":"info","ts":1685974644.698885,"message":"[2]"} 2023-06-05T14:17:24.7898397Z {"severity":"info","ts":1685974644.69892,"message":"kind/epic"} 2023-06-05T14:17:24.7898855Z {"severity":"info","ts":1685974644.6989653,"message":"Issue already has a parent label"} 2023-06-05T14:17:24.7899293Z {"severity":"info","ts":1685974644.6990058,"message":"Epics cant have parents silly goose"} 2023-06-05T14:17:24.7899778Z creating comment{"severity":"info","ts":1685974644.699082,"message":"after add calls"} 2023-06-05T14:17:24.7900413Z {"severity":"info","ts":1685974644.6991496,"message":"------- got a new issue event"} 2023-06-05T14:17:24.7900884Z {"severity":"info","ts":1685974644.6991951,"message":"Handling a new issue"} 2023-06-05T14:17:24.7901307Z {"severity":"info","ts":1685974644.699229,"message":"/child #12"} 2023-06-05T14:17:24.7901744Z {"severity":"info","ts":1685974644.6992729,"message":"10"} 2023-06-05T14:17:24.7902226Z {"severity":"info","ts":1685974644.69935,"message":"{Parents:{Added:[] Removed:[] Count:0} Children:{Added:[12] Removed:[] Count:1}}"} 2023-06-05T14:17:24.7902708Z {"severity":"info","ts":1685974644.6994042,"message":"its a parent"} 2023-06-05T14:17:24.7903117Z {"severity":"info","ts":1685974644.699444,"message":"not mixed commands"} 2023-06-05T14:17:24.7903682Z {"severity":"info","ts":1685974644.69949,"message":"adding child to parent"} 2023-06-05T14:17:24.7904096Z {"severity":"info","ts":1685974644.6995258,"message":"Adding a list of issues"} 2023-06-05T14:17:24.7904818Z {"severity":"info","ts":1685974644.6995745,"message":"[12]"} 2023-06-05T14:17:24.7906874Z {"severity":"info","ts":1685974644.6996207,"message":"/child #12\n\n\n___\n\n\n### parents\n\n*No Issues added yet*\n\n### children\n\n*No Issues added yet*\n\n\n To add to this list use the commands: \n`/child #{child_number}` to add a child or `/parent #{parent_number}` to add a parent.\n[Click here to find outmore about jackbot](https://docs.edge-infra.dev/foundation/dev-infra/bots/jackbot/)\n___\n\n"} 2023-06-05T14:17:24.7908286Z {"severity":"info","ts":1685974644.6996756,"message":"12"} 2023-06-05T14:17:24.7908715Z getting{"severity":"info","ts":1685974644.699755,"message":"Adding epic 1 to issue 0"} 2023-06-05T14:17:24.7909279Z editing{"severity":"info","ts":1685974644.6998334,"message":"Added issue 0 to epic 1"} 2023-06-05T14:17:24.7909750Z {"severity":"info","ts":1685974644.6998796,"message":"adding epic label to new parent"} 2023-06-05T14:17:24.7910227Z editing{"severity":"info","ts":1685974644.6999753,"message":"after add calls"} 2023-06-05T14:17:24.7910767Z --- PASS: TestHandleNewIssue (0.00s) 2023-06-05T14:17:24.7911150Z === RUN TestHandleIssueComment 2023-06-05T14:17:24.7911634Z {"severity":"info","ts":1685974644.7002726,"message":"list plugin running"} 2023-06-05T14:17:24.7912064Z {"severity":"info","ts":1685974644.7003453,"message":"no command found in comment exiting"} 2023-06-05T14:17:24.7912522Z {"severity":"info","ts":1685974644.7004004,"message":"list plugin running"} 2023-06-05T14:17:24.7912948Z {"severity":"info","ts":1685974644.7004795,"message":"its a child"} 2023-06-05T14:17:24.7913383Z {"severity":"info","ts":1685974644.7005289,"message":"children cant have children >:|"} 2023-06-05T14:17:24.7913888Z creating comment{"severity":"info","ts":1685974644.700625,"message":"list plugin running"} 2023-06-05T14:17:24.7914337Z {"severity":"info","ts":1685974644.700698,"message":"removing an issue"} 2023-06-05T14:17:24.7914767Z {"severity":"info","ts":1685974644.7007468,"message":"Removing a list of issues"} 2023-06-05T14:17:24.7915243Z getting{"severity":"info","ts":1685974644.7008212,"message":"Removing an epic from an issues list"} 2023-06-05T14:17:24.7915736Z {"severity":"info","ts":1685974644.7008677,"message":"Removing epic 1 from issue 999"} 2023-06-05T14:17:24.7916228Z editing{"severity":"info","ts":1685974644.7010329,"message":"Removed issue 999 from epic 1"} 2023-06-05T14:17:24.7916695Z editing{"severity":"info","ts":1685974644.7011378,"message":"list plugin running"} 2023-06-05T14:17:24.7917151Z {"severity":"info","ts":1685974644.7012396,"message":"removing an issue"} 2023-06-05T14:17:24.7917572Z {"severity":"info","ts":1685974644.7012951,"message":"Removing a list of issues"} 2023-06-05T14:17:24.7918048Z getting{"severity":"info","ts":1685974644.7013657,"message":"Removing an epic from an issues list"} 2023-06-05T14:17:24.7918542Z {"severity":"info","ts":1685974644.7014132,"message":"Removing epic 1 from issue 999"} 2023-06-05T14:17:24.7919008Z editing{"severity":"info","ts":1685974644.701495,"message":"Removed issue 999 from epic 1"} 2023-06-05T14:17:24.7919513Z editing{"severity":"info","ts":1685974644.7016158,"message":"list plugin running"} 2023-06-05T14:17:24.7919941Z {"severity":"info","ts":1685974644.7016914,"message":"adding an issue"} 2023-06-05T14:17:24.7920359Z {"severity":"info","ts":1685974644.70174,"message":"Adding a list of issues"} 2023-06-05T14:17:24.7920739Z {"severity":"info","ts":1685974644.701778,"message":"[2]"} 2023-06-05T14:17:24.7921124Z {"severity":"info","ts":1685974644.701824,"message":"kind/feature"} 2023-06-05T14:17:24.7921651Z {"severity":"info","ts":1685974644.7018578,"message":"Issue already has a parent label"} 2023-06-05T14:17:24.7924004Z {"severity":"info","ts":1685974644.7019036,"message":"Nothing to see here\n\n\n___\n\n\n### parents\n\n*No Issues added yet*\n\n### children\n\n*No Issues added yet*\n\n\n To add to this list use the commands: \n`/child #{child_number}` to add a child or `/parent #{parent_number}` to add a parent.\n[Click here to find outmore about jackbot](https://docs.edge-infra.dev/foundation/dev-infra/bots/jackbot/)\n___\n\n"} 2023-06-05T14:17:24.7925351Z {"severity":"info","ts":1685974644.701952,"message":"2"} 2023-06-05T14:17:24.7925789Z getting{"severity":"info","ts":1685974644.702031,"message":"Adding epic 1 to issue 999"} 2023-06-05T14:17:24.7926271Z editing{"severity":"info","ts":1685974644.7021074,"message":"Added issue 999 to epic 1"} 2023-06-05T14:17:24.7926734Z editing{"severity":"info","ts":1685974644.702198,"message":"list plugin running"} 2023-06-05T14:17:24.7927450Z {"severity":"info","ts":1685974644.70227,"message":"adding an issue"} 2023-06-05T14:17:24.7927897Z {"severity":"info","ts":1685974644.7023165,"message":"Adding a list of issues"} 2023-06-05T14:17:24.7928316Z {"severity":"info","ts":1685974644.7023532,"message":"[2]"} 2023-06-05T14:17:24.7928708Z {"severity":"info","ts":1685974644.7023983,"message":"kind/feature"} 2023-06-05T14:17:24.7929140Z {"severity":"info","ts":1685974644.7024324,"message":"Issue already has a parent label"} 2023-06-05T14:17:24.7931115Z {"severity":"info","ts":1685974644.7024782,"message":"Nothing to see here\n\n\n___\n\n\n### parents\n\n*No Issues added yet*\n\n### children\n\n*No Issues added yet*\n\n\n To add to this list use the commands: \n`/child #{child_number}` to add a child or `/parent #{parent_number}` to add a parent.\n[Click here to find outmore about jackbot](https://docs.edge-infra.dev/foundation/dev-infra/bots/jackbot/)\n___\n\n"} 2023-06-05T14:17:24.7932569Z {"severity":"info","ts":1685974644.702531,"message":"2"} 2023-06-05T14:17:24.7933009Z getting{"severity":"info","ts":1685974644.7026036,"message":"Adding epic 1 to issue 999"} 2023-06-05T14:17:24.7933493Z editing{"severity":"info","ts":1685974644.702677,"message":"Added issue 999 to epic 1"} 2023-06-05T14:17:24.7933964Z editing{"severity":"info","ts":1685974644.702798,"message":"list plugin running"} 2023-06-05T14:17:24.7934400Z {"severity":"info","ts":1685974644.7028677,"message":"adding an issue"} 2023-06-05T14:17:24.7934844Z {"severity":"info","ts":1685974644.7029157,"message":"Adding a list of issues"} 2023-06-05T14:17:24.7935247Z {"severity":"info","ts":1685974644.702961,"message":"[1]"} 2023-06-05T14:17:24.7935729Z {"severity":"info","ts":1685974644.7030017,"message":"kind/feature"} 2023-06-05T14:17:24.7936155Z {"severity":"info","ts":1685974644.7030528,"message":"Issue already has a parent label"} 2023-06-05T14:17:24.7938201Z {"severity":"info","ts":1685974644.7030904,"message":"Nothing to see here\n\n\n___\n\n\n### parents\n\n*No Issues added yet*\n\n### children\n\n*No Issues added yet*\n\n\n To add to this list use the commands: \n`/child #{child_number}` to add a child or `/parent #{parent_number}` to add a parent.\n[Click here to find outmore about jackbot](https://docs.edge-infra.dev/foundation/dev-infra/bots/jackbot/)\n___\n\n"} 2023-06-05T14:17:24.7939421Z {"severity":"info","ts":1685974644.703168,"message":"1"} 2023-06-05T14:17:24.7939988Z {"severity":"info","ts":1685974644.7032151,"message":"#1 - cannot add an issue to itself"} 2023-06-05T14:17:24.7940519Z editing{"severity":"info","ts":1685974644.7033198,"message":"Commenting on epic that some issues were not added"} 2023-06-05T14:17:24.7941273Z {"severity":"info","ts":1685974644.7033617,"message":"Some issues could not be added:\n#1 - cannot add an issue to itself"} 2023-06-05T14:17:24.7941890Z creating comment{"severity":"info","ts":1685974644.7034376,"message":"list plugin running"} 2023-06-05T14:17:24.7942801Z {"severity":"info","ts":1685974644.7035043,"message":"adding an issue"} 2023-06-05T14:17:24.7943625Z {"severity":"info","ts":1685974644.7035558,"message":"Adding a list of issues"} 2023-06-05T14:17:24.7944067Z {"severity":"info","ts":1685974644.7035892,"message":"[999]"} 2023-06-05T14:17:24.7944460Z {"severity":"info","ts":1685974644.7036448,"message":"kind/feature"} 2023-06-05T14:17:24.7944963Z {"severity":"info","ts":1685974644.7036743,"message":"Issue already has a parent label"} 2023-06-05T14:17:24.7947077Z {"severity":"info","ts":1685974644.7037299,"message":"Nothing to see here\n\n\n___\n\n\n### parents\n\n- #999\n\n### children\n\n*No Issues added yet*\n\n\n To add to this list use the commands: \n`/child #{child_number}` to add a child or `/parent #{parent_number}` to add a parent.\n[Click here to find outmore about jackbot](https://docs.edge-infra.dev/foundation/dev-infra/bots/jackbot/)\n___\n\n"} 2023-06-05T14:17:24.7948381Z {"severity":"info","ts":1685974644.7037776,"message":"999"} 2023-06-05T14:17:24.7948797Z getting{"severity":"info","ts":1685974644.70381,"message":"Adding epic 1 to issue 999"} 2023-06-05T14:17:24.7949282Z {"severity":"info","ts":1685974644.703857,"message":"This issue was already added to the parent list #1"} 2023-06-05T14:17:24.7949782Z {"severity":"info","ts":1685974644.703892,"message":"attempting to swap child to parent 999"} 2023-06-05T14:17:24.7950317Z {"severity":"info","ts":1685974644.7039788,"message":"failed to swap #1 from child to parent on downstream list"} 2023-06-05T14:17:24.7950819Z editing{"severity":"info","ts":1685974644.704057,"message":"Added issue 999 to epic 1"} 2023-06-05T14:17:24.7951268Z editing{"severity":"info","ts":1685974644.704138,"message":"list plugin running"} 2023-06-05T14:17:24.7951745Z {"severity":"info","ts":1685974644.7042124,"message":"adding an issue"} 2023-06-05T14:17:24.7952176Z {"severity":"info","ts":1685974644.7042658,"message":"Adding a list of issues"} 2023-06-05T14:17:24.7952601Z {"severity":"info","ts":1685974644.70431,"message":"[999]"} 2023-06-05T14:17:24.7952973Z {"severity":"info","ts":1685974644.704351,"message":"kind/feature"} 2023-06-05T14:17:24.7953424Z {"severity":"info","ts":1685974644.7043967,"message":"Issue already has a parent label"} 2023-06-05T14:17:24.7955402Z {"severity":"info","ts":1685974644.704452,"message":"Nothing to see here\n\n\n___\n\n\n### parents\n\n*No Issues added yet*\n\n### children\n\n- #999\n\n\n To add to this list use the commands: \n`/child #{child_number}` to add a child or `/parent #{parent_number}` to add a parent.\n[Click here to find outmore about jackbot](https://docs.edge-infra.dev/foundation/dev-infra/bots/jackbot/)\n___\n\n"} 2023-06-05T14:17:24.7956605Z {"severity":"info","ts":1685974644.7045207,"message":"999"} 2023-06-05T14:17:24.7957032Z getting{"severity":"info","ts":1685974644.7045944,"message":"Adding epic 1 to issue 999"} 2023-06-05T14:17:24.7957551Z {"severity":"info","ts":1685974644.704638,"message":"This issue was already added to the child list on #1"} 2023-06-05T14:17:24.7958107Z {"severity":"info","ts":1685974644.7046733,"message":"attempting to swap child to parent 999"} 2023-06-05T14:17:24.7958620Z {"severity":"info","ts":1685974644.7047198,"message":"attempting to swap parent to child 999 1"} 2023-06-05T14:17:24.7959165Z {"severity":"info","ts":1685974644.7047558,"message":"failed to swap #1 from parent to child on downstream list"} 2023-06-05T14:17:24.7959667Z editing{"severity":"info","ts":1685974644.704846,"message":"Added issue 999 to epic 1"} 2023-06-05T14:17:24.7960200Z editing--- PASS: TestHandleIssueComment (0.00s) 2023-06-05T14:17:24.7960536Z PASS 2023-06-05T14:17:24.7961121Z ================================================================================ 2023-06-05T14:17:24.7961652Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/changelog:changelog_test: 2023-06-05T14:17:24.7962199Z === RUN TestExtraction 2023-06-05T14:17:24.7962586Z --- PASS: TestExtraction (0.00s) 2023-06-05T14:17:24.7963059Z === RUN TestGenerateChange 2023-06-05T14:17:24.7963473Z --- PASS: TestGenerateChange (0.02s) 2023-06-05T14:17:24.7963809Z === RUN TestSend 2023-06-05T14:17:24.7966562Z {"severity":"info","ts":1685974644.4025433,"message":"attempting to send a change","change":{"id":"00000000-0000-0000-0000-000000000000","created":"2022-09-22T22:02:35Z","commitMessage":"test","pullRequest":{"id":"00000000-0000-0000-0000-000000000000","change":"00000000-0000-0000-0000-000000000000","author":"le250055","title":"fix: edge config validation for banner and top-level clusters","number":3350,"org":"ncrvoyix-swt-retail","repo":"edge-infra","labels":[{"pull_request":"00000000-0000-0000-0000-000000000000","prefix":"team","text":"platform"},{"pull_request":"00000000-0000-0000-0000-000000000000","prefix":"bulldozer","text":"ok-to-sync"}],"milestone":{"pull_request":"00000000-0000-0000-0000-000000000000","name":"","number":0,"repo":"","org":""},"issues":[{"pull_request":"00000000-0000-0000-0000-000000000000","number":3851,"org":"ncrvoyix-swt-retail","repo":"edge-roadmap","closed":true}]},"commitID":"2eb04c1","version":"","actionRequired":false,"type":"fix"},"changeChannel":"C04901N9SH4","commitChannel":"C04901N9SH4"} 2023-06-05T14:17:24.7970799Z {"severity":"info","ts":1685974644.4030252,"message":"slack commit message","commit":{"ChannelID":"C04901N9SH4","Message":{"replace_original":false,"delete_original":false,"metadata":{"event_type":"","event_payload":null},"blocks":[{"type":"section","text":{"type":"mrkdwn","text":"*fix: edge config validation for banner and top-level clusters*"}},{"type":"context","elements":[{"type":"mrkdwn","text":"\u003chttps://github.com/ncrvoyix-swt-retail/edge-infra/commit/2eb04c1|`2eb04c1`\u003e via \u003chttps://github.com/ncrvoyix-swt-retail/edge-infra/pull/3350|ncrvoyix-swt-retail/edge-infra#3350\u003e"}]},{"type":"context","elements":[{"type":"mrkdwn","text":"closes \u003chttps://github.com/ncr-swt-retail/edge-roadmap/pull/3851|ncr-swt-retail/edge-roadmap#3851\u003e"}]},{"type":"section","text":{"type":"mrkdwn","text":"\u003etest"}},{"type":"context","elements":[{"type":"image","image_url":"https://github.com/le250055.png","alt_text":"@le250055"},{"type":"mrkdwn","text":"\u003chttps://github.com/le250055|@le250055\u003e"}]}]}}} 2023-06-05T14:17:24.7972923Z {"severity":"info","ts":1685974644.7411597,"logger":"pubsub","message":"Failed to publish","err":"rpc error: code = PermissionDenied desc = User not authorized to perform this action."} 2023-06-05T14:17:24.7973572Z --- PASS: TestSend (0.34s) 2023-06-05T14:17:24.7973871Z PASS 2023-06-05T14:17:24.7974187Z ================================================================================ 2023-06-05T14:17:26.0861167Z INFO: From Testing //pkg/f8n/kinform/model:model_test: 2023-06-05T14:17:26.0861918Z ==================== Test output for //pkg/f8n/kinform/model:model_test: 2023-06-05T14:17:26.0862458Z === RUN TestUnmarshalPubSub_ClusterHeartbeat 2023-06-05T14:17:26.0863204Z --- PASS: TestUnmarshalPubSub_ClusterHeartbeat (0.00s) 2023-06-05T14:17:26.0863766Z === RUN TestMarshalUnmarsalPubSub_ClusterHeatbeat 2023-06-05T14:17:26.0864424Z --- PASS: TestMarshalUnmarsalPubSub_ClusterHeatbeat (0.00s) 2023-06-05T14:17:26.0865007Z === RUN TestMarshalUnmarsalPubSub_WatchedResource 2023-06-05T14:17:26.0865553Z --- PASS: TestMarshalUnmarsalPubSub_WatchedResource (0.00s) 2023-06-05T14:17:26.0866099Z PASS 2023-06-05T14:17:26.0866492Z ================================================================================ 2023-06-05T14:17:26.6673092Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient:thinclient_test: 2023-06-05T14:17:26.6673858Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient:thinclient_test: 2023-06-05T14:17:26.6675096Z === RUN TestNonConfigurationConfigMapReturnsNil 2023-06-05T14:17:26.6675834Z --- PASS: TestNonConfigurationConfigMapReturnsNil (0.08s) 2023-06-05T14:17:26.6676589Z === RUN TestConfigPluginErrorHandling 2023-06-05T14:17:26.6677092Z --- PASS: TestConfigPluginErrorHandling (0.01s) 2023-06-05T14:17:26.6677484Z === RUN TestUpdateTargetObjects 2023-06-05T14:17:26.6677875Z thinclient_test.go:224: PASS: Exists(string) 2023-06-05T14:17:26.6678248Z thinclient_test.go:224: PASS: Read(string) 2023-06-05T14:17:26.6678639Z thinclient_test.go:224: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:26.6679060Z thinclient_test.go:224: PASS: Exists(string) 2023-06-05T14:17:26.6679835Z thinclient_test.go:224: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:26.6680244Z thinclient_test.go:224: PASS: Exists(string) 2023-06-05T14:17:26.6680660Z thinclient_test.go:224: PASS: Read(string) 2023-06-05T14:17:26.6681072Z thinclient_test.go:224: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:26.6682159Z thinclient_test.go:224: PASS: Exists(string) 2023-06-05T14:17:26.6682572Z thinclient_test.go:224: PASS: Read(string) 2023-06-05T14:17:26.6683018Z thinclient_test.go:224: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:26.6683486Z thinclient_test.go:224: PASS: Exists(string) 2023-06-05T14:17:26.6683885Z thinclient_test.go:224: PASS: Read(string) 2023-06-05T14:17:26.6684319Z thinclient_test.go:224: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:26.6684929Z thinclient_test.go:224: PASS: Exists(string) 2023-06-05T14:17:26.6685333Z thinclient_test.go:224: PASS: Read(string) 2023-06-05T14:17:26.6685822Z thinclient_test.go:224: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:26.6686273Z thinclient_test.go:224: PASS: Exists(string) 2023-06-05T14:17:26.6686703Z thinclient_test.go:224: PASS: Read(string) 2023-06-05T14:17:26.6687146Z thinclient_test.go:224: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:26.6687572Z thinclient_test.go:224: PASS: Exists(string) 2023-06-05T14:17:26.6687925Z thinclient_test.go:224: PASS: Read(string) 2023-06-05T14:17:26.6688515Z thinclient_test.go:224: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:26.6688948Z thinclient_test.go:224: PASS: Exists(string) 2023-06-05T14:17:26.6689342Z thinclient_test.go:224: PASS: Read(string) 2023-06-05T14:17:26.6690032Z --- PASS: TestUpdateTargetObjects (0.02s) 2023-06-05T14:17:26.6690635Z === RUN TestFailingToReadFromFileReturnsExpectedError 2023-06-05T14:17:26.6691640Z --- PASS: TestFailingToReadFromFileReturnsExpectedError (0.00s) 2023-06-05T14:17:26.6692358Z === RUN TestFailingToWriteToFileReturnsExpectedError 2023-06-05T14:17:26.6693163Z --- PASS: TestFailingToWriteToFileReturnsExpectedError (0.02s) 2023-06-05T14:17:26.6693864Z === RUN TestFailingToRestartServiceReturnsExpectedError 2023-06-05T14:17:26.6694772Z --- PASS: TestFailingToRestartServiceReturnsExpectedError (0.01s) 2023-06-05T14:17:26.6695512Z === RUN TestErrorHandlingWhenUpdatingTargetObjects 2023-06-05T14:17:26.6696293Z --- PASS: TestErrorHandlingWhenUpdatingTargetObjects (0.00s) 2023-06-05T14:17:26.6696801Z === RUN TestConfigMapWatcherPluginErrorHandling 2023-06-05T14:17:26.6697426Z --- PASS: TestConfigMapWatcherPluginErrorHandling (0.00s) 2023-06-05T14:17:26.6697958Z === RUN TestSecretWatcherPluginErrorHandling 2023-06-05T14:17:26.6698533Z --- PASS: TestSecretWatcherPluginErrorHandling (0.01s) 2023-06-05T14:17:26.6699074Z === RUN TestNoMatchingSelectorsForWatcherPluginsReturnsNil 2023-06-05T14:17:26.6699859Z --- PASS: TestNoMatchingSelectorsForWatcherPluginsReturnsNil (0.00s) 2023-06-05T14:17:26.6700427Z === RUN TestGetSelectorForConfigObject 2023-06-05T14:17:26.6701004Z --- PASS: TestGetSelectorForConfigObject (0.01s) 2023-06-05T14:17:26.6701526Z === RUN TestErrorHandlingWhenGettingSelectorForConfigObject 2023-06-05T14:17:26.6702227Z --- PASS: TestErrorHandlingWhenGettingSelectorForConfigObject (0.02s) 2023-06-05T14:17:26.6702665Z PASS 2023-06-05T14:17:26.6703399Z ================================================================================ 2023-06-05T14:17:27.6660858Z INFO: From Testing //pkg/sds/k8s/authserver:authserver_test: 2023-06-05T14:17:27.6661462Z ==================== Test output for //pkg/sds/k8s/authserver:authserver_test: 2023-06-05T14:17:27.6661929Z === RUN TestAuthServerDenied 2023-06-05T14:17:27.6663557Z {"severity":"INFO","time":"2023-06-05T14:17:27Z","message":"Request denied","remote-addr":"10.0.0.1","reason":"Get \"https://dev0.test/validate_token\": access denied","requestId":"c2ffa341-544d-414b-8f05-1c8137b75c96","logging.googleapis.com/sourceLocation":{"function":"edge-infra.dev/pkg/sds/k8s/authserver.(*AuthServer).infoLog","file":"pkg/sds/k8s/authserver/auth_server.go","line":173}} 2023-06-05T14:17:27.6664623Z --- PASS: TestAuthServerDenied (0.00s) 2023-06-05T14:17:27.6665115Z === RUN TestAuthServerAccepted 2023-06-05T14:17:27.6666498Z {"severity":"INFO","time":"2023-06-05T14:17:27Z","message":"Request was validated","remote-addr":"10.0.0.1","requestId":"5eef0002-dd6c-4fe4-b98a-f3c6ebf33f35","logging.googleapis.com/sourceLocation":{"function":"edge-infra.dev/pkg/sds/k8s/authserver.(*AuthServer).infoLog","file":"pkg/sds/k8s/authserver/auth_server.go","line":176}} 2023-06-05T14:17:27.6668503Z {"severity":"INFO","time":"2023-06-05T14:17:27Z","message":"redirecting to https://dev0.test//remoteaccesstest?test-param=test-value","remote-addr":"10.0.0.1","requestId":"5eef0002-dd6c-4fe4-b98a-f3c6ebf33f35","logging.googleapis.com/sourceLocation":{"function":"edge-infra.dev/pkg/sds/k8s/authserver.(*AuthServer).infoLog","file":"pkg/sds/k8s/authserver/auth_server.go","line":176}} 2023-06-05T14:17:27.6672616Z &{302 Found 302 HTTP/1.1 1 1 map[Content-Type:[text/html; charset=utf-8] Location:[https://dev0.test//remoteaccesstest?test-param=test-value] Set-Cookie:[__Host-SID=MTY4NTk3NDY0N3xzR21vbUhReXhQeFQ4TWxUbEZ6dWE5aU55c21OUUQ2Si1ENXdBdG5kQUkwUm5zVl9pRkpMNmRlRkR3YkUxNlVybVQ4SzZvRDYxaGlzajhtTk9JUVpCZjdDTFJKNG9CS2J8m6oRyQ42JJijKbTP9QCcF1jcUKOaCISkYcxf6GxZJe0=; Path=/; Expires=Mon, 05 Jun 2023 14:32:27 GMT; Max-Age=900; HttpOnly; Secure; SameSite=Strict] X-Request-Id:[5eef0002-dd6c-4fe4-b98a-f3c6ebf33f35]] {0xc00040f650} -1 [] false false map[] } 2023-06-05T14:17:27.6675326Z --- PASS: TestAuthServerAccepted (0.01s) 2023-06-05T14:17:27.6675738Z PASS 2023-06-05T14:17:27.6676102Z ================================================================================ 2023-06-05T14:17:27.9396734Z INFO: From Testing //pkg/sds/k8s/controllers/pxe:pxe_test: 2023-06-05T14:17:27.9397460Z ==================== Test output for //pkg/sds/k8s/controllers/pxe:pxe_test: 2023-06-05T14:17:27.9397891Z === RUN TestControllerWithDefaults 2023-06-05T14:17:27.9398689Z {"severity":"info","ts":1685974646.3006856,"logger":"controller-runtime.metrics","message":"Metrics server is starting to listen","addr":":9000"} 2023-06-05T14:17:27.9399441Z {"severity":"info","ts":1685974646.3297591,"message":"Starting server","path":"/metrics","kind":"metrics","addr":"[::]:9000"} 2023-06-05T14:17:27.9399992Z {"severity":"info","ts":1685974646.3330877,"message":"Starting server","kind":"health probe","addr":"[::]:9001"} 2023-06-05T14:17:27.9400699Z {"severity":"info","ts":1685974646.3332918,"message":"Starting EventSource","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode","source":"kind source: *v1.IENode"} 2023-06-05T14:17:27.9401539Z {"severity":"info","ts":1685974646.3351986,"message":"Starting EventSource","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode","source":"kind source: *v1.ConfigMap"} 2023-06-05T14:17:27.9402384Z {"severity":"info","ts":1685974646.335219,"message":"Starting EventSource","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode","source":"kind source: *v1.Secret"} 2023-06-05T14:17:27.9403596Z {"severity":"info","ts":1685974646.3352234,"message":"Starting Controller","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode"} 2023-06-05T14:17:27.9404206Z === RUN TestControllerWithDefaults/TestIENodeCreate 2023-06-05T14:17:27.9404924Z {"severity":"info","ts":1685974646.4303157,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:17:27.9405446Z {"severity":"info","ts":1685974646.430368,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:17:27.9408591Z {"severity":"error","ts":1685974646.4304752,"logger":"controller-runtime.source","message":"failed to get informer from cache","error":"Timeout: failed waiting for *v1.Secret Informer to sync","stacktrace":"sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1.1\n\texternal/io_k8s_sigs_controller_runtime/pkg/source/source.go:144\nk8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext\n\texternal/io_k8s_apimachinery/pkg/util/wait/wait.go:235\nk8s.io/apimachinery/pkg/util/wait.poll\n\texternal/io_k8s_apimachinery/pkg/util/wait/wait.go:582\nk8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext\n\texternal/io_k8s_apimachinery/pkg/util/wait/wait.go:547\nsigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1\n\texternal/io_k8s_sigs_controller_runtime/pkg/source/source.go:132"} 2023-06-05T14:17:27.9414420Z {"severity":"error","ts":1685974646.4305563,"message":"Could not wait for Cache to sync","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode","error":"failed to wait for ienode caches to sync: failed to get informer from cache: Timeout: failed waiting for *v1.Secret Informer to sync","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:210\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:215\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:241\nsigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1\n\texternal/io_k8s_sigs_controller_runtime/pkg/manager/runnable_group.go:219"} 2023-06-05T14:17:27.9416790Z {"severity":"info","ts":1685974646.4306014,"message":"Stopping and waiting for caches"} 2023-06-05T14:17:27.9420084Z {"severity":"error","ts":1685974646.430628,"logger":"controller-runtime.source","message":"failed to get informer from cache","error":"Timeout: failed waiting for *v1.IENode Informer to sync","stacktrace":"sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1.1\n\texternal/io_k8s_sigs_controller_runtime/pkg/source/source.go:144\nk8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext\n\texternal/io_k8s_apimachinery/pkg/util/wait/wait.go:235\nk8s.io/apimachinery/pkg/util/wait.poll\n\texternal/io_k8s_apimachinery/pkg/util/wait/wait.go:582\nk8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext\n\texternal/io_k8s_apimachinery/pkg/util/wait/wait.go:547\nsigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1\n\texternal/io_k8s_sigs_controller_runtime/pkg/source/source.go:132"} 2023-06-05T14:17:27.9424362Z {"severity":"error","ts":1685974646.4306533,"logger":"controller-runtime.source","message":"failed to get informer from cache","error":"Timeout: failed waiting for *v1.ConfigMap Informer to sync","stacktrace":"sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1.1\n\texternal/io_k8s_sigs_controller_runtime/pkg/source/source.go:144\nk8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext\n\texternal/io_k8s_apimachinery/pkg/util/wait/wait.go:235\nk8s.io/apimachinery/pkg/util/wait.poll\n\texternal/io_k8s_apimachinery/pkg/util/wait/wait.go:582\nk8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext\n\texternal/io_k8s_apimachinery/pkg/util/wait/wait.go:547\nsigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1\n\texternal/io_k8s_sigs_controller_runtime/pkg/source/source.go:132"} 2023-06-05T14:17:27.9427657Z {"severity":"error","ts":1685974646.430707,"message":"error received after stop sequence was engaged","error":"failed to wait for ienode caches to sync: failed to get informer from cache: Timeout: failed waiting for *v1.Secret Informer to sync","stacktrace":"sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1\n\texternal/io_k8s_sigs_controller_runtime/pkg/manager/internal.go:541"} 2023-06-05T14:17:27.9428791Z {"severity":"info","ts":1685974646.4309046,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:17:27.9429298Z {"severity":"info","ts":1685974646.4309247,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:17:27.9429847Z --- PASS: TestControllerWithDefaults (13.53s) 2023-06-05T14:17:27.9430374Z --- PASS: TestControllerWithDefaults/TestIENodeCreate (0.07s) 2023-06-05T14:17:27.9430730Z PASS 2023-06-05T14:17:27.9431017Z ================================================================================ 2023-06-05T14:17:28.5781419Z INFO: From Testing //pkg/edge/api/utils:utils_test: 2023-06-05T14:17:28.5781985Z ==================== Test output for //pkg/edge/api/utils:utils_test: 2023-06-05T14:17:28.5782555Z === RUN TestGetBannerTypeOrg 2023-06-05T14:17:28.5783015Z --- PASS: TestGetBannerTypeOrg (0.00s) 2023-06-05T14:17:28.5783360Z === RUN TestGetBannerTypeEU 2023-06-05T14:17:28.5783778Z --- PASS: TestGetBannerTypeEU (0.00s) 2023-06-05T14:17:28.5784165Z === RUN TestNewRollbackError 2023-06-05T14:17:28.5784590Z --- PASS: TestNewRollbackError (0.00s) 2023-06-05T14:17:28.5784903Z === RUN TestAddError 2023-06-05T14:17:28.5785279Z --- PASS: TestAddError (0.00s) 2023-06-05T14:17:28.5785597Z === RUN TestIsNotNil 2023-06-05T14:17:28.5785976Z --- PASS: TestIsNotNil (0.00s) 2023-06-05T14:17:28.5786321Z === RUN TestGetErrors 2023-06-05T14:17:28.5786854Z --- PASS: TestGetErrors (0.00s) 2023-06-05T14:17:28.5787187Z === RUN TestLen 2023-06-05T14:17:28.5787521Z --- PASS: TestLen (0.00s) 2023-06-05T14:17:28.5787855Z === RUN TestNewMockHTTPTestServer 2023-06-05T14:17:28.5788316Z --- PASS: TestNewMockHTTPTestServer (0.00s) 2023-06-05T14:17:28.5788695Z === RUN TestAddTestServer 2023-06-05T14:17:28.5789107Z --- PASS: TestAddTestServer (0.00s) 2023-06-05T14:17:28.5789483Z === RUN TestNotAllowedContentType 2023-06-05T14:17:28.5790004Z --- PASS: TestNotAllowedContentType (0.00s) 2023-06-05T14:17:28.5790343Z === RUN TestAddRoute 2023-06-05T14:17:28.5791042Z 2023/06/05 14:17:28 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/utils.NewTestServer.func1 (mock_server.go:77) 2023-06-05T14:17:28.5791605Z --- PASS: TestAddRoute (0.00s) 2023-06-05T14:17:28.5791954Z === RUN TestPost 2023-06-05T14:17:28.5792630Z 2023/06/05 14:17:28 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/utils.notFound (mock_server_test.go:281) 2023-06-05T14:17:28.5793176Z --- PASS: TestPost (0.00s) 2023-06-05T14:17:28.5793473Z === RUN TestGet 2023-06-05T14:17:28.5794139Z 2023/06/05 14:17:28 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/utils.notFound (mock_server_test.go:281) 2023-06-05T14:17:28.5794667Z --- PASS: TestGet (0.00s) 2023-06-05T14:17:28.5794958Z === RUN TestPut 2023-06-05T14:17:28.5795627Z 2023/06/05 14:17:28 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/utils.notFound (mock_server_test.go:281) 2023-06-05T14:17:28.5796141Z --- PASS: TestPut (0.01s) 2023-06-05T14:17:28.5796435Z === RUN TestPatch 2023-06-05T14:17:28.5797100Z 2023/06/05 14:17:28 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/utils.notFound (mock_server_test.go:281) 2023-06-05T14:17:28.5797650Z --- PASS: TestPatch (0.00s) 2023-06-05T14:17:28.5797950Z === RUN TestAny 2023-06-05T14:17:28.5798634Z 2023/06/05 14:17:28 http: superfluous response.WriteHeader call from edge-infra.dev/pkg/edge/api/utils.notFound (mock_server_test.go:281) 2023-06-05T14:17:28.5799150Z --- PASS: TestAny (0.00s) 2023-06-05T14:17:28.5800015Z === RUN TestValidateTerminal 2023-06-05T14:17:28.5800500Z --- PASS: TestValidateTerminal (0.00s) 2023-06-05T14:17:28.5801158Z === RUN TestValidateTerminalIfaceMacAddressError 2023-06-05T14:17:28.5801755Z --- PASS: TestValidateTerminalIfaceMacAddressError (0.00s) 2023-06-05T14:17:28.5802221Z === RUN TestValidateTerminalIfaceDhcp4True 2023-06-05T14:17:28.5802756Z --- PASS: TestValidateTerminalIfaceDhcp4True (0.00s) 2023-06-05T14:17:28.5803233Z === RUN TestValidateTerminalIfaceDhcp4False 2023-06-05T14:17:28.5803811Z --- PASS: TestValidateTerminalIfaceDhcp4False (0.00s) 2023-06-05T14:17:28.5804260Z === RUN TestValidateTerminalIfaceDhcp4FalseError 2023-06-05T14:17:28.5804842Z --- PASS: TestValidateTerminalIfaceDhcp4FalseError (0.00s) 2023-06-05T14:17:28.5805324Z === RUN TestValidateTerminalIfaceDhcp6True 2023-06-05T14:17:28.5805875Z --- PASS: TestValidateTerminalIfaceDhcp6True (0.00s) 2023-06-05T14:17:28.5806324Z === RUN TestValidateTerminalIfaceDhcp6False 2023-06-05T14:17:28.5806874Z --- PASS: TestValidateTerminalIfaceDhcp6False (0.00s) 2023-06-05T14:17:28.5807301Z === RUN TestValidateTerminalAddress 2023-06-05T14:17:28.5807796Z --- PASS: TestValidateTerminalAddress (0.00s) 2023-06-05T14:17:28.5808241Z === RUN TestValidateTerminalAddressIpError 2023-06-05T14:17:28.5808756Z --- PASS: TestValidateTerminalAddressIpError (0.00s) 2023-06-05T14:17:28.5809216Z === RUN TestValidateTerminalAddressCidrError 2023-06-05T14:17:28.5809844Z --- PASS: TestValidateTerminalAddressCidrError (0.00s) 2023-06-05T14:17:28.5810280Z === RUN TestMatchMacAddresses 2023-06-05T14:17:28.5810687Z --- PASS: TestMatchMacAddresses (0.00s) 2023-06-05T14:17:28.5811044Z === RUN TestConvertMacAddresses 2023-06-05T14:17:28.5811831Z --- PASS: TestConvertMacAddresses (0.00s) 2023-06-05T14:17:28.5812214Z === RUN TestConvertMacAddressesError 2023-06-05T14:17:28.5812700Z --- PASS: TestConvertMacAddressesError (0.00s) 2023-06-05T14:17:28.5813039Z PASS 2023-06-05T14:17:28.5813348Z ================================================================================ 2023-06-05T14:17:28.6398871Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/chronyd:chronyd_test: 2023-06-05T14:17:28.6433891Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/chronyd:chronyd_test: 2023-06-05T14:17:28.6434448Z === RUN TestChronydSourcesCanBeUpdated 2023-06-05T14:17:28.6434859Z chronyd_test.go:35: PASS: Exists(string) 2023-06-05T14:17:28.6435252Z chronyd_test.go:35: PASS: Read(string) 2023-06-05T14:17:28.6435691Z chronyd_test.go:35: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:28.6436716Z --- PASS: TestChronydSourcesCanBeUpdated (0.00s) 2023-06-05T14:17:28.6437360Z === RUN TestChronydSourcesFileIsAddedIfNotPresent 2023-06-05T14:17:28.6437798Z chronyd_test.go:45: PASS: Exists(string) 2023-06-05T14:17:28.6438222Z chronyd_test.go:45: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:28.6438866Z --- PASS: TestChronydSourcesFileIsAddedIfNotPresent (0.00s) 2023-06-05T14:17:28.6439404Z === RUN TestChronydSourcesAreAddedIfNotPresent 2023-06-05T14:17:28.6439881Z chronyd_test.go:56: PASS: Exists(string) 2023-06-05T14:17:28.6440325Z chronyd_test.go:56: PASS: Read(string) 2023-06-05T14:17:28.6447392Z chronyd_test.go:56: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:28.6448290Z --- PASS: TestChronydSourcesAreAddedIfNotPresent (0.00s) 2023-06-05T14:17:28.6448735Z === RUN TestChronydSourcesAreRemoved 2023-06-05T14:17:28.6449099Z chronyd_test.go:67: PASS: Exists(string) 2023-06-05T14:17:28.6449430Z chronyd_test.go:67: PASS: Read(string) 2023-06-05T14:17:28.6449820Z chronyd_test.go:67: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:28.6450364Z --- PASS: TestChronydSourcesAreRemoved (0.00s) 2023-06-05T14:17:28.6450844Z === RUN TestChronydSourcesNotUpdatedIfUpAlreadyToDate 2023-06-05T14:17:28.6451346Z chronyd_test.go:78: PASS: Exists(string) 2023-06-05T14:17:28.6451858Z chronyd_test.go:78: PASS: Read(string) 2023-06-05T14:17:28.6452911Z --- PASS: TestChronydSourcesNotUpdatedIfUpAlreadyToDate (0.00s) 2023-06-05T14:17:28.6455123Z === RUN TestFailureToReadChronydSourcesReturnsError 2023-06-05T14:17:28.6455642Z chronyd_test.go:89: PASS: Exists(string) 2023-06-05T14:17:28.6455971Z chronyd_test.go:89: PASS: Read(string) 2023-06-05T14:17:28.6456628Z --- PASS: TestFailureToReadChronydSourcesReturnsError (0.00s) 2023-06-05T14:17:28.6457190Z === RUN TestFailureToUpdateNTPServersSourcesFileReturnsError 2023-06-05T14:17:28.6457640Z chronyd_test.go:100: PASS: Exists(string) 2023-06-05T14:17:28.6458009Z chronyd_test.go:100: PASS: Read(string) 2023-06-05T14:17:28.6458412Z chronyd_test.go:100: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:28.6459074Z --- PASS: TestFailureToUpdateNTPServersSourcesFileReturnsError (0.00s) 2023-06-05T14:17:28.6459664Z === RUN TestChronySourcesReloadingErrorsAreHandledAsExpected 2023-06-05T14:17:28.6460144Z chronyd_test.go:125: PASS: Exists(string) 2023-06-05T14:17:28.6460504Z chronyd_test.go:125: PASS: Read(string) 2023-06-05T14:17:28.6460939Z chronyd_test.go:125: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:28.6461438Z chronyd_test.go:125: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:28.6461835Z chronyd_test.go:125: PASS: Exists(string) 2023-06-05T14:17:28.6462182Z chronyd_test.go:125: PASS: Read(string) 2023-06-05T14:17:28.6462548Z chronyd_test.go:125: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:28.6463023Z chronyd_test.go:125: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:28.6463777Z --- PASS: TestChronySourcesReloadingErrorsAreHandledAsExpected (0.00s) 2023-06-05T14:17:28.6464241Z PASS 2023-06-05T14:17:28.6464507Z ================================================================================ 2023-06-05T14:17:29.3592795Z INFO: From Testing //pkg/f8n/kinform/sql:sql_test: 2023-06-05T14:17:29.3593317Z ==================== Test output for //pkg/f8n/kinform/sql:sql_test: 2023-06-05T14:17:29.3593919Z The files belonging to this database system will be owned by user "build". 2023-06-05T14:17:29.3594378Z This user must also own the server process. 2023-06-05T14:17:29.3594598Z 2023-06-05T14:17:29.3594952Z The database cluster will be initialized with locale "C.UTF-8". 2023-06-05T14:17:29.3595390Z The default database encoding has accordingly been set to "UTF8". 2023-06-05T14:17:29.3595971Z The default text search configuration will be set to "english". 2023-06-05T14:17:29.3596223Z 2023-06-05T14:17:29.3596377Z Data page checksums are disabled. 2023-06-05T14:17:29.3596578Z 2023-06-05T14:17:29.3597465Z creating directory /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7262/execroot/edge_infra/_tmp/72d8e91e00875679fb88ec5f49a33af9/edge-infra-kinform-sql-test-3126073977/runtime/data ... ok 2023-06-05T14:17:29.3598192Z creating subdirectories ... ok 2023-06-05T14:17:29.3598575Z selecting dynamic shared memory implementation ... posix 2023-06-05T14:17:29.3599037Z selecting default max_connections ... 100 2023-06-05T14:17:29.3599407Z selecting default shared_buffers ... 128MB 2023-06-05T14:17:29.3599810Z selecting default time zone ... UTC 2023-06-05T14:17:29.3600164Z creating configuration files ... ok 2023-06-05T14:17:29.3600529Z running bootstrap script ... ok 2023-06-05T14:17:29.3601082Z performing post-bootstrap initialization ... ok 2023-06-05T14:17:29.3601499Z syncing data to disk ... ok 2023-06-05T14:17:29.3601711Z 2023-06-05T14:17:29.3601916Z Success. You can now start the database server using: 2023-06-05T14:17:29.3602176Z 2023-06-05T14:17:29.3604225Z /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7262/execroot/edge_infra/_tmp/72d8e91e00875679fb88ec5f49a33af9/edge-infra-kinform-sql-test-3126073977/bin/pg_ctl -D /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7262/execroot/edge_infra/_tmp/72d8e91e00875679fb88ec5f49a33af9/edge-infra-kinform-sql-test-3126073977/runtime/data -l logfile start 2023-06-05T14:17:29.3605190Z 2023-06-05T14:17:29.3606196Z waiting for server to start....2023-06-05 14:17:26.646 UTC [72041] LOG: starting PostgreSQL 14.2 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 4.8.4-2ubuntu1~14.04.4) 4.8.4, 64-bit 2023-06-05T14:17:29.3606951Z 2023-06-05 14:17:26.657 UTC [72041] LOG: listening on IPv4 address "127.0.0.1", port 37477 2023-06-05T14:17:29.3607820Z 2023-06-05 14:17:26.657 UTC [72041] LOG: could not bind IPv6 address "::1": Cannot assign requested address 2023-06-05T14:17:29.3608463Z 2023-06-05 14:17:26.664 UTC [72041] LOG: listening on Unix socket "/tmp/.s.PGSQL.37477" 2023-06-05T14:17:29.3609075Z 2023-06-05 14:17:26.672 UTC [72050] LOG: database system was shut down at 2023-06-05 14:17:25 UTC 2023-06-05T14:17:29.3609679Z 2023-06-05 14:17:26.684 UTC [72041] LOG: database system is ready to accept connections 2023-06-05T14:17:29.3610021Z done 2023-06-05T14:17:29.3610276Z server started 2023-06-05T14:17:29.3610587Z === RUN TestIntegration 2023-06-05T14:17:29.3610998Z --- SKIP: TestIntegration (0.00s) 2023-06-05T14:17:29.3611583Z === RUN TestLabelMatching 2023-06-05T14:17:29.3612627Z sql_test.go:104: using dsn host=127.0.0.1 port=37477 user=postgres *** dbname=postgres 2023-06-05T14:17:29.3613338Z sql_test.go:127: inserted new cluster. id: 5ea59f85-b5fa-4283-bc74-68cb0e962462 2023-06-05T14:17:29.3613737Z Query complete in 3 ms 2023-06-05T14:17:29.3614050Z Query complete in 0 ms 2023-06-05T14:17:29.3614615Z sql_test.go:169: found 1 clusters with labels matching artifact with id 57178420-3ec5-4cfe-9c85-05ef5684f0a1 2023-06-05T14:17:29.3615162Z --- PASS: TestLabelMatching (0.45s) 2023-06-05T14:17:29.3615542Z === RUN TestConnectCluster 2023-06-05T14:17:29.3616240Z sql_test.go:181: using dsn host=127.0.0.1 port=37477 user=postgres *** dbname=postgres 2023-06-05T14:17:29.3616765Z --- PASS: TestConnectCluster (1.13s) 2023-06-05T14:17:29.3617062Z PASS 2023-06-05T14:17:29.3617607Z waiting for server to shut down....2023-06-05 14:17:28.411 UTC [72041] LOG: received fast shutdown request 2023-06-05T14:17:29.3618316Z 2023-06-05 14:17:28.482 UTC [72041] LOG: aborting any active transactions 2023-06-05T14:17:29.3619019Z 2023-06-05 14:17:28.488 UTC [72148] FATAL: terminating connection due to administrator command 2023-06-05T14:17:29.3619784Z 2023-06-05 14:17:28.489 UTC [72103] FATAL: terminating connection due to administrator command 2023-06-05T14:17:29.3620578Z 2023-06-05 14:17:28.490 UTC [72041] LOG: background worker "logical replication launcher" (PID 72064) exited with exit code 1 2023-06-05T14:17:29.3621343Z 2023-06-05 14:17:28.490 UTC [72066] FATAL: terminating connection due to administrator command 2023-06-05T14:17:29.3622031Z 2023-06-05 14:17:28.503 UTC [72059] LOG: shutting down 2023-06-05T14:17:29.3622594Z 2023-06-05 14:17:29.238 UTC [72041] LOG: database system is shut down 2023-06-05T14:17:29.3694565Z done 2023-06-05T14:17:29.3695487Z server stopped 2023-06-05T14:17:29.3696105Z ================================================================================ 2023-06-05T14:17:31.4644429Z INFO: From Testing //pkg/edge/gitops/fns/addexternalsecret:addexternalsecret_test: 2023-06-05T14:17:31.4645913Z ==================== Test output for //pkg/edge/gitops/fns/addexternalsecret:addexternalsecret_test: 2023-06-05T14:17:31.4646374Z === RUN TestAddExternalSecret 2023-06-05T14:17:31.4647057Z --- PASS: TestAddExternalSecret (0.00s) 2023-06-05T14:17:31.4649376Z === RUN TestAddExternalSecretDocker 2023-06-05T14:17:31.4655533Z === RUN TestAddExternalSecretDocker/testdata/docker-secret 2023-06-05T14:17:31.4656471Z === RUN TestAddExternalSecretDocker/testdata/helm-secret 2023-06-05T14:17:31.4657261Z --- PASS: TestAddExternalSecretDocker (0.01s) 2023-06-05T14:17:31.4658118Z --- PASS: TestAddExternalSecretDocker/testdata/docker-secret (0.00s) 2023-06-05T14:17:31.4659016Z --- PASS: TestAddExternalSecretDocker/testdata/helm-secret (0.00s) 2023-06-05T14:17:31.4660210Z === RUN TestConfigValidation 2023-06-05T14:17:31.4660941Z --- PASS: TestConfigValidation (0.00s) 2023-06-05T14:17:31.4661734Z PASS 2023-06-05T14:17:31.4662680Z ================================================================================ 2023-06-05T14:17:31.7604556Z INFO: From Testing //test/fixtures:fixtures_test: 2023-06-05T14:17:31.7615859Z ==================== Test output for //test/fixtures:fixtures_test: 2023-06-05T14:17:31.7616258Z === RUN TestCRDLoading 2023-06-05T14:17:31.7616835Z --- PASS: TestCRDLoading (0.94s) 2023-06-05T14:17:31.7617186Z === RUN TestCRDLoading_Only 2023-06-05T14:17:31.7617597Z --- PASS: TestCRDLoading_Only (0.25s) 2023-06-05T14:17:31.7617895Z PASS 2023-06-05T14:17:31.7618206Z ================================================================================ 2023-06-05T14:17:33.5025515Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration:ntpconfiguration_test: 2023-06-05T14:17:33.5026348Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration:ntpconfiguration_test: 2023-06-05T14:17:33.5027129Z === RUN TestGetRootPathErrorsAreHandledAsExpected 2023-06-05T14:17:33.5027904Z --- PASS: TestGetRootPathErrorsAreHandledAsExpected (0.00s) 2023-06-05T14:17:33.5028615Z === RUN TestTimesyncdNTPConfigurationIsUpdated 2023-06-05T14:17:33.5029126Z ntpconfiguration_test.go:58: PASS: Read(string) 2023-06-05T14:17:33.5029662Z ntpconfiguration_test.go:58: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:33.5030466Z --- PASS: TestTimesyncdNTPConfigurationIsUpdated (0.00s) 2023-06-05T14:17:33.5031050Z === RUN TestChronydNTPConfigurationIsUpdated 2023-06-05T14:17:33.5031569Z ntpconfiguration_test.go:71: PASS: Exists(string) 2023-06-05T14:17:33.5032086Z ntpconfiguration_test.go:71: PASS: Read(string) 2023-06-05T14:17:33.5032624Z ntpconfiguration_test.go:71: PASS: Write(string,[]uint8,fs.FileMode) 2023-06-05T14:17:33.5033311Z --- PASS: TestChronydNTPConfigurationIsUpdated (0.00s) 2023-06-05T14:17:33.5033924Z === RUN TestNTPConfigurationIsNotUpdatedWhenNTPServiceIsNotEnabled 2023-06-05T14:17:33.5034937Z --- PASS: TestNTPConfigurationIsNotUpdatedWhenNTPServiceIsNotEnabled (0.00s) 2023-06-05T14:17:33.5035506Z PASS 2023-06-05T14:17:33.5035839Z ================================================================================ 2023-06-05T14:17:33.6122865Z INFO: From Testing //pkg/edge/gitops/fns/edgerelease:edgerelease_test: 2023-06-05T14:17:33.6130489Z ==================== Test output for //pkg/edge/gitops/fns/edgerelease:edgerelease_test: 2023-06-05T14:17:33.6131035Z === RUN TestConfigValidation 2023-06-05T14:17:33.6132032Z --- PASS: TestConfigValidation (0.00s) 2023-06-05T14:17:33.6132436Z === RUN TestInitFns 2023-06-05T14:17:33.6132887Z --- PASS: TestInitFns (0.00s) 2023-06-05T14:17:33.6133255Z === RUN TestComponent 2023-06-05T14:17:33.6133669Z === RUN TestComponent/testdata/deployment 2023-06-05T14:17:33.6134234Z === RUN TestComponent/testdata/multi-container 2023-06-05T14:17:33.6134919Z === RUN TestComponent/testdata/multi-container-single-image 2023-06-05T14:17:33.6135483Z --- PASS: TestComponent (0.04s) 2023-06-05T14:17:33.6136044Z --- PASS: TestComponent/testdata/deployment (0.00s) 2023-06-05T14:17:33.6136680Z --- PASS: TestComponent/testdata/multi-container (0.00s) 2023-06-05T14:17:33.6137430Z --- PASS: TestComponent/testdata/multi-container-single-image (0.01s) 2023-06-05T14:17:33.6137932Z === RUN TestKptFn 2023-06-05T14:17:33.6138350Z --- PASS: TestKptFn (0.00s) 2023-06-05T14:17:33.6138699Z PASS 2023-06-05T14:17:33.6139058Z ================================================================================ 2023-06-05T14:17:35.0504034Z INFO: From Testing //pkg/f8n/warehouse/oci:oci_test: 2023-06-05T14:17:35.0504557Z ==================== Test output for //pkg/f8n/warehouse/oci:oci_test: 2023-06-05T14:17:35.0504931Z === RUN TestIsPackage 2023-06-05T14:17:35.0505372Z === RUN TestIsPackage/image_is_not_a_package 2023-06-05T14:17:35.0506259Z === RUN TestIsPackage/image_is_a_package 2023-06-05T14:17:35.0506662Z === RUN TestIsPackage/handles_nil_parents 2023-06-05T14:17:35.0507469Z --- PASS: TestIsPackage (0.00s) 2023-06-05T14:17:35.0507992Z --- PASS: TestIsPackage/image_is_not_a_package (0.00s) 2023-06-05T14:17:35.0508516Z --- PASS: TestIsPackage/image_is_a_package (0.00s) 2023-06-05T14:17:35.0509007Z --- PASS: TestIsPackage/handles_nil_parents (0.00s) 2023-06-05T14:17:35.0509381Z === RUN TestContains 2023-06-05T14:17:35.0509722Z === RUN TestContains/index_contains_image 2023-06-05T14:17:35.0512120Z === RUN TestContains/index_contains_image_with_wrong_digest 2023-06-05T14:17:35.0512610Z === RUN TestContains/index_doesnt_contain_image 2023-06-05T14:17:35.0513224Z --- PASS: TestContains (0.00s) 2023-06-05T14:17:35.0513708Z --- PASS: TestContains/index_contains_image (0.00s) 2023-06-05T14:17:35.0514291Z --- PASS: TestContains/index_contains_image_with_wrong_digest (0.00s) 2023-06-05T14:17:35.0514992Z --- PASS: TestContains/index_doesnt_contain_image (0.00s) 2023-06-05T14:17:35.0515565Z === RUN TestIsComposite 2023-06-05T14:17:35.0515944Z === RUN TestIsComposite/is_not_composite 2023-06-05T14:17:35.0516322Z === RUN TestIsComposite/is_composite 2023-06-05T14:17:35.0516778Z --- PASS: TestIsComposite (0.01s) 2023-06-05T14:17:35.0517304Z --- PASS: TestIsComposite/is_not_composite (0.00s) 2023-06-05T14:17:35.0517958Z --- PASS: TestIsComposite/is_composite (0.00s) 2023-06-05T14:17:35.0518298Z PASS 2023-06-05T14:17:35.0518644Z ================================================================================ 2023-06-05T14:17:35.0892193Z INFO: From Testing //pkg/f8n/lighthouse:lighthouse_test: 2023-06-05T14:17:35.0892753Z ==================== Test output for //pkg/f8n/lighthouse:lighthouse_test: 2023-06-05T14:17:35.0894111Z === RUN TestLighthouse 2023-06-05T14:17:35.0899039Z The files belonging to this database system will be owned by user "build". 2023-06-05T14:17:35.0899631Z This user must also own the server process. 2023-06-05T14:17:35.0899889Z 2023-06-05T14:17:35.0900641Z The database cluster will be initialized with locale "C.UTF-8". 2023-06-05T14:17:35.0901179Z The default database encoding has accordingly been set to "UTF8". 2023-06-05T14:17:35.0901660Z The default text search configuration will be set to "english". 2023-06-05T14:17:35.0901905Z 2023-06-05T14:17:35.0902055Z Data page checksums are disabled. 2023-06-05T14:17:35.0902255Z 2023-06-05T14:17:35.0903206Z creating directory /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7260/execroot/edge_infra/_tmp/e40696d9898a2d257c43ad3b1c659fd1/edge-infra-lighthouse-sql-test-3794861459/runtime/data ... ok 2023-06-05T14:17:35.0904037Z creating subdirectories ... ok 2023-06-05T14:17:35.0904424Z selecting dynamic shared memory implementation ... posix 2023-06-05T14:17:35.0904828Z selecting default max_connections ... 100 2023-06-05T14:17:35.0905278Z selecting default shared_buffers ... 128MB 2023-06-05T14:17:35.0905729Z selecting default time zone ... UTC 2023-06-05T14:17:35.0906088Z creating configuration files ... ok 2023-06-05T14:17:35.0906486Z running bootstrap script ... ok 2023-06-05T14:17:35.0907040Z performing post-bootstrap initialization ... ok 2023-06-05T14:17:35.0907432Z syncing data to disk ... ok 2023-06-05T14:17:35.0907631Z 2023-06-05T14:17:35.0907817Z Success. You can now start the database server using: 2023-06-05T14:17:35.0908082Z 2023-06-05T14:17:35.0909770Z /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7260/execroot/edge_infra/_tmp/e40696d9898a2d257c43ad3b1c659fd1/edge-infra-lighthouse-sql-test-3794861459/bin/pg_ctl -D /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7260/execroot/edge_infra/_tmp/e40696d9898a2d257c43ad3b1c659fd1/edge-infra-lighthouse-sql-test-3794861459/runtime/data -l logfile start 2023-06-05T14:17:35.0910864Z 2023-06-05T14:17:35.0912035Z waiting for server to start....2023-06-05 14:17:24.044 UTC [71814] LOG: starting PostgreSQL 14.2 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 4.8.4-2ubuntu1~14.04.4) 4.8.4, 64-bit 2023-06-05T14:17:35.0913117Z 2023-06-05 14:17:24.045 UTC [71814] LOG: listening on IPv4 address "127.0.0.1", port 5336 2023-06-05T14:17:35.0914038Z 2023-06-05 14:17:24.045 UTC [71814] LOG: could not bind IPv6 address "::1": Cannot assign requested address 2023-06-05T14:17:35.0914734Z 2023-06-05 14:17:24.058 UTC [71814] LOG: listening on Unix socket "/tmp/.s.PGSQL.5336" 2023-06-05T14:17:35.0915447Z 2023-06-05 14:17:24.072 UTC [71818] LOG: database system was shut down at 2023-06-05 14:17:23 UTC 2023-06-05T14:17:35.0916134Z 2023-06-05 14:17:24.081 UTC [71814] LOG: database system is ready to accept connections 2023-06-05T14:17:35.0916556Z done 2023-06-05T14:17:35.0916796Z server started 2023-06-05T14:17:35.0917218Z {"severity":"info","ts":1685974646.6532073,"logger":"test","message":"edge env sql migration completed successfully"} 2023-06-05T14:17:35.0917810Z {"severity":"info","ts":1685974646.7414067,"logger":"test","message":"edge env sql seeding completed successfully"} 2023-06-05T14:17:35.0918392Z === RUN TestLighthouse/TestIncrementRetryCount 2023-06-05T14:17:35.0918809Z === RUN TestLighthouse/TestNewWatchTower 2023-06-05T14:17:35.0919247Z === RUN TestLighthouse/TestRegisterChannel 2023-06-05T14:17:35.0919635Z === RUN TestLighthouse/TestRetry 2023-06-05T14:17:35.0920610Z {"severity":"info","ts":1685974647.8718526,"message":"Successfully resent Event ID: 98b2267b-af07-4081-a619-1005ed1950a9","test":"lighthouse"} 2023-06-05T14:17:35.0921540Z {"severity":"info","ts":1685974647.8958037,"message":"Successfully resent Event ID: f75467bc-ba8b-4c4b-967a-67a105de00d7","test":"lighthouse"} 2023-06-05T14:17:35.0922513Z {"severity":"info","ts":1685974647.9209766,"message":"Successfully resent Event ID: 3acacff6-5755-47c5-9f80-f3afa8f655c7","test":"lighthouse"} 2023-06-05T14:17:35.0923504Z {"severity":"info","ts":1685974647.9451978,"message":"Successfully resent Event ID: 43a58f5a-fa85-494d-a676-38c1c54aed67","test":"lighthouse"} 2023-06-05T14:17:35.0924478Z {"severity":"info","ts":1685974647.9724321,"message":"Successfully resent Event ID: dacfe907-c8be-4067-bf4c-74c4fc0f4b16","test":"lighthouse"} 2023-06-05T14:17:35.0925523Z {"severity":"info","ts":1685974648.0184793,"message":"Successfully resent Event ID: aa5a117a-5577-4db2-855c-e3b4ae520aed","test":"lighthouse"} 2023-06-05T14:17:35.0926466Z {"severity":"info","ts":1685974648.0407531,"message":"Successfully resent Event ID: c27e8c3f-8203-43b4-ba9a-b80212747588","test":"lighthouse"} 2023-06-05T14:17:35.0927360Z {"severity":"info","ts":1685974648.0650258,"message":"Successfully resent Event ID: 70b7bf8e-f632-4c1a-aafb-e6ca8ee2dac9","test":"lighthouse"} 2023-06-05T14:17:35.0928305Z {"severity":"info","ts":1685974648.0887504,"message":"Successfully resent Event ID: 356d05e5-c85d-45aa-8775-31f5e967078f","test":"lighthouse"} 2023-06-05T14:17:35.0929277Z {"severity":"info","ts":1685974648.1139417,"message":"Successfully resent Event ID: a6a6969f-4238-45ad-812c-99e5462688a1","test":"lighthouse"} 2023-06-05T14:17:35.0930253Z {"severity":"info","ts":1685974648.1369736,"message":"Successfully resent Event ID: f59e0e7c-ad7f-4648-8582-44e16cc3e8ef","test":"lighthouse"} 2023-06-05T14:17:35.0931301Z {"severity":"info","ts":1685974648.1606176,"message":"Successfully resent Event ID: b538aad6-cff3-4b97-93cf-7445cbba3ac1","test":"lighthouse"} 2023-06-05T14:17:35.0932631Z {"severity":"info","ts":1685974648.1850605,"message":"Successfully resent Event ID: 1dcf0cb3-4d9f-47dc-90e7-587c514a1cbf","test":"lighthouse"} 2023-06-05T14:17:35.0933554Z {"severity":"info","ts":1685974648.207247,"message":"Successfully resent Event ID: 2eeba155-1263-49c6-8cc0-ff3a97a86a35","test":"lighthouse"} 2023-06-05T14:17:35.0934516Z {"severity":"info","ts":1685974648.2595794,"message":"Successfully resent Event ID: 11a761c1-3d12-44b8-bbe9-7590ab23cec8","test":"lighthouse"} 2023-06-05T14:17:35.0935858Z {"severity":"info","ts":1685974648.3287811,"message":"Successfully resent Event ID: a449290f-c2bb-45cd-a00d-35eca61fcc78","test":"lighthouse"} 2023-06-05T14:17:35.0937051Z {"severity":"info","ts":1685974648.3510442,"message":"Successfully resent Event ID: 269ced91-5b51-4e04-bf12-99db59fd2369","test":"lighthouse"} 2023-06-05T14:17:35.0938023Z {"severity":"info","ts":1685974648.3748114,"message":"Successfully resent Event ID: 14c990cf-4416-4231-b072-5144ffd83799","test":"lighthouse"} 2023-06-05T14:17:35.0938978Z {"severity":"info","ts":1685974648.3986983,"message":"Successfully resent Event ID: d6e5bc2f-0ab6-4de2-a9c4-689aba9a0166","test":"lighthouse"} 2023-06-05T14:17:35.0939976Z {"severity":"info","ts":1685974648.4485064,"message":"Successfully resent Event ID: 60743375-f624-4fc0-9f2b-1a11c6f88dc6","test":"lighthouse"} 2023-06-05T14:17:35.0940948Z {"severity":"info","ts":1685974648.483489,"message":"Successfully resent Event ID: aed943b9-1460-4e9d-98de-c8f64c899a86","test":"lighthouse"} 2023-06-05T14:17:35.0941556Z === RUN TestLighthouse/TestSetLivelinessProbe 2023-06-05T14:17:35.0942041Z === RUN TestLighthouse/TestSetMaxConcurrent 2023-06-05T14:17:35.0942486Z === RUN TestLighthouse/TestSetProjectID 2023-06-05T14:17:35.0942910Z === RUN TestLighthouse/TestSetTicker 2023-06-05T14:17:35.0943345Z === RUN TestLighthouse/TestSetTickerEmpty 2023-06-05T14:17:35.0943783Z === RUN TestLighthouse/TestSetTopicID 2023-06-05T14:17:35.0944197Z === RUN TestLighthouse/TestStream 2023-06-05T14:17:35.0944660Z === RUN TestLighthouse/TestUnregisterAllChannels 2023-06-05T14:17:35.0947965Z {"severity":"error","ts":1685974648.9530668,"message":"An error occurred and panicked","error":"stream method panicked and recovered","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).Stream.func1.1\n\tpkg/f8n/lighthouse/listener.go:302\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:884\nruntime.panicmem\n\tGOROOT/src/runtime/panic.go:260\nruntime.sigpanic\n\tGOROOT/src/runtime/signal_unix.go:835\ndatabase/sql.(*DB).conn\n\tGOROOT/src/database/sql/sql.go:1288\ndatabase/sql.(*DB).exec\n\tGOROOT/src/database/sql/sql.go:1655\ndatabase/sql.(*DB).ExecContext\n\tGOROOT/src/database/sql/sql.go:1633\ndatabase/sql.(*DB).Exec\n\tGOROOT/src/database/sql/sql.go:1651\nedge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).Stream.func1\n\tpkg/f8n/lighthouse/listener.go:320"} 2023-06-05T14:17:35.0949832Z === RUN TestLighthouse/TestUnregisterChannel 2023-06-05T14:17:35.0950288Z === RUN TestLighthouse/TestWatchCfg 2023-06-05T14:17:35.0951232Z {"severity":"info","ts":1685974649.86964,"message":"Successfully resent Event ID: 07ce65ba-3b7f-4e93-9c2f-d1d147e82333","test":"lighthouse"} 2023-06-05T14:17:35.0953722Z {"severity":"error","ts":1685974654.0171673,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: terminating connection due to administrator command","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:849\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0956907Z {"severity":"error","ts":1685974654.017317,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: terminating connection due to administrator command","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:849\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0960323Z {"severity":"error","ts":1685974654.0174778,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: terminating connection due to administrator command","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:849\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0963980Z {"severity":"error","ts":1685974654.017549,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: terminating connection due to administrator command","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:849\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0967210Z {"severity":"error","ts":1685974654.0176382,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: terminating connection due to administrator command","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:849\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0970506Z {"severity":"error","ts":1685974654.0186028,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: terminating connection due to administrator command","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:849\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0973632Z {"severity":"error","ts":1685974654.0228558,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: terminating connection due to administrator command","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:849\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0976608Z {"severity":"error","ts":1685974654.0361037,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: the database system is shutting down","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:817\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0979423Z {"severity":"error","ts":1685974654.04168,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: the database system is shutting down","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:817\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0982600Z {"severity":"error","ts":1685974654.0439312,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: the database system is shutting down","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:817\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0985634Z {"severity":"error","ts":1685974654.0493567,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: the database system is shutting down","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:817\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0988457Z {"severity":"error","ts":1685974654.050073,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: the database system is shutting down","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:817\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0991396Z {"severity":"error","ts":1685974654.0667305,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: the database system is shutting down","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:817\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0994109Z {"severity":"error","ts":1685974654.0689628,"message":"An error occurred creating new dialer listener","test":"lighthouse","error":"pq: the database system is shutting down","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).AddListener.func1\n\tpkg/f8n/lighthouse/listener.go:157\ngithub.com/lib/pq.(*Listener).emitEvent\n\texternal/com_github_lib_pq/notify.go:797\ngithub.com/lib/pq.(*Listener).listenerConnLoop\n\texternal/com_github_lib_pq/notify.go:817\ngithub.com/lib/pq.(*Listener).listenerMain\n\texternal/com_github_lib_pq/notify.go:856"} 2023-06-05T14:17:35.0996245Z {"severity":"error","ts":1685974654.837519,"message":"An error occurred getting notification events","test":"lighthouse","error":"FATAL: terminating connection due to administrator command (SQLSTATE 57P01)","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).Retry.func1\n\tpkg/f8n/lighthouse/listener.go:227"} 2023-06-05T14:17:35.0998806Z {"severity":"error","ts":1685974654.837607,"message":"An error occurred and panicked","test":"lighthouse","error":"retry method panicked and recovered","stacktrace":"edge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).Retry.func1.1\n\tpkg/f8n/lighthouse/listener.go:222\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:890\nruntime.panicmem\n\tGOROOT/src/runtime/panic.go:260\nruntime.sigpanic\n\tGOROOT/src/runtime/signal_unix.go:835\ndatabase/sql.(*Rows).Next\n\tGOROOT/src/database/sql/sql.go:2985\nedge-infra.dev/pkg/f8n/lighthouse.(*WatchTower).Retry.func1\n\tpkg/f8n/lighthouse/listener.go:230"} 2023-06-05T14:17:35.1000231Z 2023-06-05 14:17:33.990 UTC [71814] LOG: received fast shutdown request 2023-06-05T14:17:35.1000996Z waiting for server to shut down....2023-06-05 14:17:34.015 UTC [71814] LOG: aborting any active transactions 2023-06-05T14:17:35.1002051Z 2023-06-05 14:17:34.015 UTC [72312] FATAL: terminating connection due to administrator command 2023-06-05T14:17:35.1002763Z 2023-06-05 14:17:34.015 UTC [71938] FATAL: terminating connection due to administrator command 2023-06-05T14:17:35.1003563Z 2023-06-05 14:17:34.015 UTC [72316] FATAL: terminating connection due to administrator command 2023-06-05T14:17:35.1004225Z 2023-06-05 14:17:34.016 UTC [72315] FATAL: terminating connection due to administrator command 2023-06-05T14:17:35.1004805Z 2023-06-05 14:17:34.016 UTC [72302] FATAL: terminating connection due to administrator command 2023-06-05T14:17:35.1005461Z 2023-06-05 14:17:34.016 UTC [72097] FATAL: terminating connection due to administrator command 2023-06-05T14:17:35.1006145Z 2023-06-05 14:17:34.017 UTC [72077] FATAL: terminating connection due to administrator command 2023-06-05T14:17:35.1006802Z 2023-06-05 14:17:34.017 UTC [72072] FATAL: terminating connection due to administrator command 2023-06-05T14:17:35.1007488Z 2023-06-05 14:17:34.018 UTC [72045] FATAL: terminating connection due to administrator command 2023-06-05T14:17:35.1008190Z 2023-06-05 14:17:34.025 UTC [71814] LOG: background worker "logical replication launcher" (PID 71825) exited with exit code 1 2023-06-05T14:17:35.1008773Z 2023-06-05 14:17:34.035 UTC [71820] LOG: shutting down 2023-06-05T14:17:35.1009346Z 2023-06-05 14:17:34.035 UTC [72569] FATAL: the database system is shutting down 2023-06-05T14:17:35.1009930Z 2023-06-05 14:17:34.041 UTC [72568] FATAL: the database system is shutting down 2023-06-05T14:17:35.1010629Z 2023-06-05 14:17:34.043 UTC [72570] FATAL: the database system is shutting down 2023-06-05T14:17:35.1011234Z 2023-06-05 14:17:34.049 UTC [72573] FATAL: the database system is shutting down 2023-06-05T14:17:35.1012308Z 2023-06-05 14:17:34.049 UTC [72571] FATAL: the database system is shutting down 2023-06-05T14:17:35.1012887Z 2023-06-05 14:17:34.056 UTC [72572] FATAL: the database system is shutting down 2023-06-05T14:17:35.1013469Z 2023-06-05 14:17:34.068 UTC [72574] FATAL: the database system is shutting down 2023-06-05T14:17:35.1014053Z 2023-06-05 14:17:34.935 UTC [71814] LOG: database system is shut down 2023-06-05T14:17:35.1014399Z done 2023-06-05T14:17:35.1014697Z server stopped 2023-06-05T14:17:35.1015130Z --- PASS: TestLighthouse (15.80s) 2023-06-05T14:17:35.1015716Z --- PASS: TestLighthouse/TestIncrementRetryCount (0.06s) 2023-06-05T14:17:35.1016237Z --- PASS: TestLighthouse/TestNewWatchTower (0.00s) 2023-06-05T14:17:35.1016779Z --- PASS: TestLighthouse/TestRegisterChannel (0.03s) 2023-06-05T14:17:35.1017320Z --- PASS: TestLighthouse/TestRetry (2.04s) 2023-06-05T14:17:35.1017827Z --- PASS: TestLighthouse/TestSetLivelinessProbe (0.00s) 2023-06-05T14:17:35.1018309Z --- PASS: TestLighthouse/TestSetMaxConcurrent (0.00s) 2023-06-05T14:17:35.1018806Z --- PASS: TestLighthouse/TestSetProjectID (0.00s) 2023-06-05T14:17:35.1019340Z --- PASS: TestLighthouse/TestSetTicker (0.00s) 2023-06-05T14:17:35.1019842Z --- PASS: TestLighthouse/TestSetTickerEmpty (0.00s) 2023-06-05T14:17:35.1020480Z --- PASS: TestLighthouse/TestSetTopicID (0.00s) 2023-06-05T14:17:35.1020946Z --- PASS: TestLighthouse/TestStream (0.07s) 2023-06-05T14:17:35.1021462Z --- PASS: TestLighthouse/TestUnregisterAllChannels (0.02s) 2023-06-05T14:17:35.1021939Z --- PASS: TestLighthouse/TestUnregisterChannel (0.02s) 2023-06-05T14:17:35.1022488Z --- PASS: TestLighthouse/TestWatchCfg (5.00s) 2023-06-05T14:17:35.1022804Z PASS 2023-06-05T14:17:35.1023114Z ================================================================================ 2023-06-05T14:17:35.4213509Z INFO: From Testing //pkg/edge/api/apierror:apierror_test: 2023-06-05T14:17:35.4214142Z ==================== Test output for //pkg/edge/api/apierror:apierror_test: 2023-06-05T14:17:35.4214588Z === RUN TestIsAPIError 2023-06-05T14:17:35.4215063Z --- PASS: TestIsAPIError (0.00s) 2023-06-05T14:17:35.4215470Z === RUN TestIsNotFoundError 2023-06-05T14:17:35.4215968Z --- PASS: TestIsNotFoundError (0.00s) 2023-06-05T14:17:35.4216804Z === RUN TestIsForbiddenError 2023-06-05T14:17:35.4217356Z --- PASS: TestIsForbiddenError (0.00s) 2023-06-05T14:17:35.4218088Z === RUN TestAddAPIErrorToResponse 2023-06-05T14:17:35.4218685Z --- PASS: TestAddAPIErrorToResponse (0.00s) 2023-06-05T14:17:35.4219245Z === RUN TestAddEmptyAPIErrorToResponse 2023-06-05T14:17:35.4219866Z --- PASS: TestAddEmptyAPIErrorToResponse (0.00s) 2023-06-05T14:17:35.4220292Z === RUN TestNew 2023-06-05T14:17:35.4220729Z --- PASS: TestNew (0.00s) 2023-06-05T14:17:35.4221120Z === RUN TestNewFromError 2023-06-05T14:17:35.4221585Z --- PASS: TestNewFromError (0.00s) 2023-06-05T14:17:35.4221963Z === RUN TestSetPath 2023-06-05T14:17:35.4222398Z --- PASS: TestSetPath (0.00s) 2023-06-05T14:17:35.4222765Z === RUN TestSetMessage 2023-06-05T14:17:35.4223253Z --- PASS: TestSetMessage (0.00s) 2023-06-05T14:17:35.4223652Z === RUN TestSetOperationID 2023-06-05T14:17:35.4224134Z --- PASS: TestSetOperationID (0.00s) 2023-06-05T14:17:35.4224480Z === RUN TestSetSetVersion 2023-06-05T14:17:35.4224918Z --- PASS: TestSetSetVersion (0.00s) 2023-06-05T14:17:35.4225362Z === RUN TestSetGenericErrorExtension 2023-06-05T14:17:35.4225950Z --- PASS: TestSetGenericErrorExtension (0.00s) 2023-06-05T14:17:35.4226440Z === RUN TestAddGenericErrorExtension 2023-06-05T14:17:35.4227002Z --- PASS: TestAddGenericErrorExtension (0.00s) 2023-06-05T14:17:35.4227489Z === RUN TestMapGenericExtensions 2023-06-05T14:17:35.4228046Z --- PASS: TestMapGenericExtensions (0.00s) 2023-06-05T14:17:35.4228450Z === RUN TestError 2023-06-05T14:17:35.4228880Z --- PASS: TestError (0.00s) 2023-06-05T14:17:35.4229226Z PASS 2023-06-05T14:17:35.4229592Z ================================================================================ 2023-06-05T14:17:35.5694128Z INFO: From Testing //pkg/f8n/devinfra/jack/guest_services:guest_services_test: 2023-06-05T14:17:35.5694690Z ==================== Test output for //pkg/f8n/devinfra/jack/guest_services:guest_services_test: 2023-06-05T14:17:35.5695133Z === RUN TestCommands 2023-06-05T14:17:35.5695574Z --- PASS: TestCommands (0.00s) 2023-06-05T14:17:35.5695915Z === RUN TestSpecificCommands 2023-06-05T14:17:35.5696516Z --- PASS: TestSpecificCommands (0.00s) 2023-06-05T14:17:35.5696825Z === RUN TestIsKindLabel 2023-06-05T14:17:35.5697217Z --- PASS: TestIsKindLabel (0.00s) 2023-06-05T14:17:35.5697513Z === RUN TestLabel 2023-06-05T14:17:35.5697864Z --- PASS: TestLabel (0.00s) 2023-06-05T14:17:35.5698185Z === RUN TestEpics 2023-06-05T14:17:35.5698595Z --- PASS: TestEpics (0.00s) 2023-06-05T14:17:35.5698920Z === RUN TestFindMethods 2023-06-05T14:17:35.5703366Z --- PASS: TestFindMethods (0.00s) 2023-06-05T14:17:35.5703915Z === RUN TestIsParentLabel 2023-06-05T14:17:35.5704476Z --- PASS: TestIsParentLabel (0.00s) 2023-06-05T14:17:35.5705059Z === RUN TestCheckTitle 2023-06-05T14:17:35.5706387Z --- PASS: TestCheckTitle (0.00s) 2023-06-05T14:17:35.5706886Z PASS 2023-06-05T14:17:35.5707361Z ================================================================================ 2023-06-05T14:17:35.8021592Z INFO: From Testing //pkg/edge/shipment/generator:generator_test: 2023-06-05T14:17:35.8121019Z ==================== Test output for //pkg/edge/shipment/generator:generator_test: 2023-06-05T14:17:35.8121629Z === RUN TestGenerateRepo 2023-06-05T14:17:35.8122337Z --- PASS: TestGenerateRepo (0.00s) 2023-06-05T14:17:35.8122697Z === RUN TestSplitShipments 2023-06-05T14:17:35.8123124Z --- PASS: TestSplitShipments (0.00s) 2023-06-05T14:17:35.8123459Z PASS 2023-06-05T14:17:35.8123780Z ================================================================================ 2023-06-05T14:17:35.8274481Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/epics:epics_test: 2023-06-05T14:17:35.8275070Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/epics:epics_test: 2023-06-05T14:17:35.8276050Z === RUN TestLabeled 2023-06-05T14:17:35.8276806Z {"severity":"info","ts":1685974655.7478888,"message":"Running epics plugin"} 2023-06-05T14:17:35.8278507Z {"severity":"info","ts":1685974655.7479265,"message":"[]"} 2023-06-05T14:17:35.8279025Z {"severity":"info","ts":1685974655.7479372,"message":"Epic 0 initializing"} 2023-06-05T14:17:35.8280296Z {"severity":"info","ts":1685974655.747957,"message":"Epic 0 initialized with the jackbot epic template"} 2023-06-05T14:17:35.8281223Z editing--- PASS: TestLabeled (0.00s) 2023-06-05T14:17:35.8281880Z === RUN TestSwap 2023-06-05T14:17:35.8282578Z {"severity":"info","ts":1685974655.7480214,"message":"Running epics plugin"} 2023-06-05T14:17:35.8283073Z {"severity":"info","ts":1685974655.7480276,"message":"[kind/feature]"} 2023-06-05T14:17:35.8283585Z editing--- PASS: TestSwap (0.00s) 2023-06-05T14:17:35.8283948Z === RUN TestRemoved 2023-06-05T14:17:35.8284588Z --- PASS: TestRemoved (0.00s) 2023-06-05T14:17:35.8284960Z === RUN TestEpicLabelRemoval 2023-06-05T14:17:35.8285598Z {"severity":"info","ts":1685974655.7481177,"message":"Removing the jackbot epic template from issue"} 2023-06-05T14:17:35.8286184Z {"severity":"info","ts":1685974655.7481277,"message":"Parent 0 had its children removed"} 2023-06-05T14:17:35.8286894Z editingcreating commentediting--- PASS: TestEpicLabelRemoval (0.00s) 2023-06-05T14:17:35.8287344Z === RUN TestEdited 2023-06-05T14:17:35.8287730Z {"severity":"info","ts":1685974655.7481577,"message":"Checking edits made to an issue"} 2023-06-05T14:17:35.8288251Z --- PASS: TestEdited (0.00s) 2023-06-05T14:17:35.8288617Z === RUN TestParseJackBlock 2023-06-05T14:17:35.8289050Z {"severity":"info","ts":1685974655.7482316,"message":"Checking edits made to an issue"} 2023-06-05T14:17:35.8289541Z {"severity":"info","ts":1685974655.7482505,"message":"Checking edits made to an issue"} 2023-06-05T14:17:35.8290052Z {"severity":"info","ts":1685974655.7482603,"message":"No changed body. Ignoring."} 2023-06-05T14:17:35.8290539Z {"severity":"info","ts":1685974655.748514,"message":"Issue Body is empty."} 2023-06-05T14:17:35.8291060Z editingcreating comment{"severity":"info","ts":1685974655.7485409,"message":"Checking edits made to an issue"} 2023-06-05T14:17:35.8291895Z editingcreating comment{"severity":"info","ts":1685974655.748566,"message":"Checking edits made to an issue"} 2023-06-05T14:17:35.8292532Z --- PASS: TestParseJackBlock (0.00s) 2023-06-05T14:17:35.8292890Z PASS 2023-06-05T14:17:35.8293456Z ================================================================================ 2023-06-05T14:17:35.9698065Z INFO: From Testing //pkg/f8n/monitoring/k8s/controllers/prometheusctl:prometheusctl_test: 2023-06-05T14:17:35.9698806Z ==================== Test output for //pkg/f8n/monitoring/k8s/controllers/prometheusctl:prometheusctl_test: 2023-06-05T14:17:35.9699248Z === RUN TestController 2023-06-05T14:17:35.9699571Z === RUN TestController/gke 2023-06-05T14:17:35.9700216Z {"severity":"info","ts":1685974652.8397884,"message":"Starting EventSource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","source":"kind source: *v1.Prometheus"} 2023-06-05T14:17:35.9701250Z {"severity":"info","ts":1685974652.8398733,"message":"Starting EventSource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","source":"kind source: *v1.ServiceMonitor"} 2023-06-05T14:17:35.9702109Z {"severity":"info","ts":1685974652.8398817,"message":"Starting EventSource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","source":"kind source: *v1.PodMonitor"} 2023-06-05T14:17:35.9702895Z {"severity":"info","ts":1685974652.839887,"message":"Starting Controller","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus"} 2023-06-05T14:17:35.9703798Z framework.go:146: created namespace prometheus-gke 2023-06-05T14:17:35.9704432Z framework.go:146: created monitor kube-state-metrics prometheus-gke 2023-06-05T14:17:35.9705075Z framework.go:146: created monitor flux-system-monitoring prometheus-gke 2023-06-05T14:17:35.9705551Z === RUN TestController/gke/TestLegacy 2023-06-05T14:17:35.9706693Z framework.go:146: created prometheus prometheus-gke/prometheus-gke 2023-06-05T14:17:35.9707677Z {"severity":"info","ts":1685974653.5414844,"message":"Starting workers","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","worker count":1} 2023-06-05T14:17:35.9709524Z {"severity":"info","ts":1685974653.541817,"message":"falling back to legacy patching using edge-info","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"flux-system-monitoring","reconcileID":"6b7eba76-f5ed-4e29-8b7e-09d36b437e5a"} 2023-06-05T14:17:35.9712098Z {"severity":"info","ts":1685974653.658754,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"flux-system-monitoring","reconcileID":"6b7eba76-f5ed-4e29-8b7e-09d36b437e5a","prometheus":"prometheus-gke/prometheus-gke"} 2023-06-05T14:17:35.9714423Z {"severity":"info","ts":1685974653.6589794,"message":"falling back to legacy patching using edge-info","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"kube-state-metrics","reconcileID":"36abd980-ea9f-4599-805f-1e2a90039f93"} 2023-06-05T14:17:35.9732962Z {"severity":"info","ts":1685974653.6663237,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"kube-state-metrics","reconcileID":"36abd980-ea9f-4599-805f-1e2a90039f93","prometheus":"prometheus-gke/prometheus-gke"} 2023-06-05T14:17:35.9737991Z {"severity":"error","ts":1685974653.6911116,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"c7ddb211-18aa-448e-a310-ed1e0a51fc3d","prometheus":"prometheus-gke/prometheus-gke","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9744180Z {"severity":"error","ts":1685974653.6911976,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"c7ddb211-18aa-448e-a310-ed1e0a51fc3d","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9750484Z {"severity":"error","ts":1685974653.6965902,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"f223de3b-f4c2-4608-8cea-c72fb0db5045","prometheus":"prometheus-gke/prometheus-gke","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9756378Z {"severity":"error","ts":1685974653.6966672,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"f223de3b-f4c2-4608-8cea-c72fb0db5045","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9759234Z {"severity":"info","ts":1685974653.70771,"message":"falling back to legacy patching using edge-info","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"bd9380a0-2ff9-41c3-821f-3d12bf067e4f"} 2023-06-05T14:17:35.9761322Z {"severity":"info","ts":1685974653.7248635,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"bd9380a0-2ff9-41c3-821f-3d12bf067e4f","prometheus":"prometheus-gke/prometheus-gke"} 2023-06-05T14:17:35.9766412Z {"severity":"error","ts":1685974653.7487442,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"14f1a623-4705-4371-9476-a66c39301327","prometheus":"prometheus-gke/prometheus-gke","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9772224Z {"severity":"error","ts":1685974653.7488208,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"14f1a623-4705-4371-9476-a66c39301327","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9774132Z === RUN TestController/gke/TestPrometheusPatch 2023-06-05T14:17:35.9778518Z {"severity":"error","ts":1685974653.7549314,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"6e7c5c43-0b88-4176-84ba-65a6c0229cee","prometheus":"prometheus-gke/prometheus-gke","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9784426Z {"severity":"error","ts":1685974653.7550113,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"6e7c5c43-0b88-4176-84ba-65a6c0229cee","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9786907Z framework.go:146: created prometheus prometheus-gke/prometheus-gke 2023-06-05T14:17:35.9788523Z {"severity":"info","ts":1685974653.766227,"message":"reconciling prometheus owned by lumperctl","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"126f9735-255a-45d9-8709-2fd043edd2ba"} 2023-06-05T14:17:35.9790492Z {"severity":"info","ts":1685974653.7740657,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"126f9735-255a-45d9-8709-2fd043edd2ba","prometheus":"prometheus-gke/prometheus-gke"} 2023-06-05T14:17:35.9795691Z {"severity":"error","ts":1685974653.7808998,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"6f89c6c7-c526-4661-bcad-f4b8cea44c9f","prometheus":"prometheus-gke/prometheus-gke","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9801898Z {"severity":"error","ts":1685974653.780978,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"6f89c6c7-c526-4661-bcad-f4b8cea44c9f","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9804898Z {"severity":"info","ts":1685974653.7863212,"message":"reconciling prometheus owned by lumperctl","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"46021d1b-1018-443d-8858-7e583c7dd3a6"} 2023-06-05T14:17:35.9807431Z {"severity":"info","ts":1685974653.8297815,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"46021d1b-1018-443d-8858-7e583c7dd3a6","prometheus":"prometheus-gke/prometheus-gke"} 2023-06-05T14:17:35.9824240Z {"severity":"error","ts":1685974653.8413124,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"a916db8b-939d-4c64-9953-1c6a1601a1e7","prometheus":"prometheus-gke/prometheus-gke","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9830110Z {"severity":"error","ts":1685974653.8414001,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-gke","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"prometheus-gke","reconcileID":"a916db8b-939d-4c64-9953-1c6a1601a1e7","error":"failed to get object prometheus-gke/prometheus-gke: Prometheus.monitoring.coreos.com \"prometheus-gke\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9832023Z {"severity":"info","ts":1685974653.841773,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:17:35.9832546Z {"severity":"info","ts":1685974653.841807,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:17:35.9833235Z {"severity":"info","ts":1685974653.8418224,"message":"Shutdown signal received, waiting for all workers to finish","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus"} 2023-06-05T14:17:35.9834300Z {"severity":"info","ts":1685974653.8418407,"message":"All workers finished","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus"} 2023-06-05T14:17:35.9834884Z {"severity":"info","ts":1685974653.8418467,"message":"Stopping and waiting for caches"} 2023-06-05T14:17:35.9835514Z {"severity":"info","ts":1685974653.8420527,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:17:35.9836008Z {"severity":"info","ts":1685974653.8420758,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:17:35.9836419Z === RUN TestController/generic 2023-06-05T14:17:35.9837047Z {"severity":"info","ts":1685974653.9732761,"message":"Starting EventSource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","source":"kind source: *v1.Prometheus"} 2023-06-05T14:17:35.9837858Z {"severity":"info","ts":1685974653.9733467,"message":"Starting EventSource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","source":"kind source: *v1.ServiceMonitor"} 2023-06-05T14:17:35.9838720Z {"severity":"info","ts":1685974653.9733546,"message":"Starting EventSource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","source":"kind source: *v1.PodMonitor"} 2023-06-05T14:17:35.9839517Z {"severity":"info","ts":1685974653.9733593,"message":"Starting Controller","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus"} 2023-06-05T14:17:35.9840239Z framework.go:146: created namespace prometheus-generic 2023-06-05T14:17:35.9840900Z {"severity":"info","ts":1685974654.076099,"message":"Starting workers","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","worker count":1} 2023-06-05T14:17:35.9845459Z {"severity":"error","ts":1685974654.0763667,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"flux-system-monitoring","reconcileID":"aa76f345-b445-4656-ba83-0a8b59779130","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9851742Z {"severity":"error","ts":1685974654.0764523,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"flux-system-monitoring","reconcileID":"aa76f345-b445-4656-ba83-0a8b59779130","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9857778Z {"severity":"error","ts":1685974654.076632,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"kube-state-metrics","reconcileID":"489e6ffb-9e82-43bb-9dcd-43438e60dc7e","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9863294Z {"severity":"error","ts":1685974654.0766706,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"kube-state-metrics","reconcileID":"489e6ffb-9e82-43bb-9dcd-43438e60dc7e","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9869301Z {"severity":"error","ts":1685974654.0820882,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"flux-system-monitoring","reconcileID":"919b8369-805d-4782-a93d-3385b98b8b95","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9874960Z {"severity":"error","ts":1685974654.0821872,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"flux-system-monitoring","reconcileID":"919b8369-805d-4782-a93d-3385b98b8b95","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9880999Z {"severity":"error","ts":1685974654.0822964,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"kube-state-metrics","reconcileID":"3b3d1bb1-eb60-4800-be4d-515ae0de8f98","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9886951Z {"severity":"error","ts":1685974654.0823214,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"kube-state-metrics","reconcileID":"3b3d1bb1-eb60-4800-be4d-515ae0de8f98","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9893497Z {"severity":"error","ts":1685974654.0927572,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"flux-system-monitoring","reconcileID":"e6d6b601-88aa-49fd-8ab4-343990f33263","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9899622Z {"severity":"error","ts":1685974654.092841,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"flux-system-monitoring","reconcileID":"e6d6b601-88aa-49fd-8ab4-343990f33263","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9905971Z {"severity":"error","ts":1685974654.0929313,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"kube-state-metrics","reconcileID":"225b9415-4fa7-4031-9a33-eac64ce79e10","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9912421Z {"severity":"error","ts":1685974654.0929549,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"kube-state-metrics","reconcileID":"225b9415-4fa7-4031-9a33-eac64ce79e10","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9919373Z {"severity":"error","ts":1685974654.0976894,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"kube-state-metrics","reconcileID":"ee21ee60-cee1-451d-8dda-24123ff3b7f6","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9925724Z {"severity":"error","ts":1685974654.0977705,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"kube-state-metrics","reconcileID":"ee21ee60-cee1-451d-8dda-24123ff3b7f6","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9928304Z framework.go:146: created monitor kube-state-metrics prometheus-generic 2023-06-05T14:17:35.9933660Z {"severity":"error","ts":1685974654.1049452,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"flux-system-monitoring","reconcileID":"e23f543e-4873-483f-83b0-a762da7934a3","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9940071Z {"severity":"error","ts":1685974654.1050231,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"flux-system-monitoring","reconcileID":"e23f543e-4873-483f-83b0-a762da7934a3","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9947138Z {"severity":"error","ts":1685974654.1051595,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"kube-state-metrics","reconcileID":"856365b8-18a7-416f-b844-455f28c59836","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9953906Z {"severity":"error","ts":1685974654.1052,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"kube-state-metrics","reconcileID":"856365b8-18a7-416f-b844-455f28c59836","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9956511Z framework.go:146: created monitor flux-system-monitoring prometheus-generic 2023-06-05T14:17:35.9956983Z === RUN TestController/generic/TestLegacy 2023-06-05T14:17:35.9962074Z {"severity":"error","ts":1685974654.1106484,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"flux-system-monitoring","reconcileID":"4b5f58ae-5064-488d-9ea9-ccbc09e2e077","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9968492Z {"severity":"error","ts":1685974654.1107166,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"flux-system-monitoring","reconcileID":"4b5f58ae-5064-488d-9ea9-ccbc09e2e077","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9971173Z framework.go:146: created prometheus prometheus-generic/prometheus-generic 2023-06-05T14:17:35.9972922Z {"severity":"info","ts":1685974654.1163533,"message":"falling back to legacy patching using edge-info","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"flux-system-monitoring","reconcileID":"a1c565ff-b8b6-444f-977e-f16ff225cfca"} 2023-06-05T14:17:35.9975361Z {"severity":"info","ts":1685974654.2978354,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"flux-system-monitoring","reconcileID":"a1c565ff-b8b6-444f-977e-f16ff225cfca","prometheus":"prometheus-generic/prometheus-generic"} 2023-06-05T14:17:35.9977815Z {"severity":"info","ts":1685974654.2981522,"message":"falling back to legacy patching using edge-info","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"kube-state-metrics","reconcileID":"abac08f5-a528-46c4-ade9-994cc9adb957"} 2023-06-05T14:17:35.9980097Z {"severity":"info","ts":1685974654.3382525,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-gke"},"namespace":"prometheus-gke","name":"kube-state-metrics","reconcileID":"abac08f5-a528-46c4-ade9-994cc9adb957","prometheus":"prometheus-generic/prometheus-generic"} 2023-06-05T14:17:35.9982337Z {"severity":"info","ts":1685974654.3385072,"message":"falling back to legacy patching using edge-info","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"kube-state-metrics","reconcileID":"ce29c007-299d-4c0e-8a06-59cc21e04dc7"} 2023-06-05T14:17:35.9987665Z {"severity":"error","ts":1685974654.361898,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"kube-state-metrics","reconcileID":"ce29c007-299d-4c0e-8a06-59cc21e04dc7","prometheus":"prometheus-generic/prometheus-generic","error":"prometheuses.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9993778Z {"severity":"error","ts":1685974654.3619912,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"kube-state-metrics","reconcileID":"ce29c007-299d-4c0e-8a06-59cc21e04dc7","error":"prometheuses.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:35.9996826Z {"severity":"info","ts":1685974654.362282,"message":"falling back to legacy patching using edge-info","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"flux-system-monitoring","reconcileID":"9f6c89d3-77a1-4514-bca7-94e0d1f0b964"} 2023-06-05T14:17:36.0002099Z {"severity":"error","ts":1685974654.3652444,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"flux-system-monitoring","reconcileID":"9f6c89d3-77a1-4514-bca7-94e0d1f0b964","prometheus":"prometheus-generic/prometheus-generic","error":"prometheuses.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0008375Z {"severity":"error","ts":1685974654.3653336,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"flux-system-monitoring","reconcileID":"9f6c89d3-77a1-4514-bca7-94e0d1f0b964","error":"prometheuses.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0014996Z {"severity":"error","ts":1685974654.367248,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"eaffab00-e5eb-48ce-90ff-1df679118cc7","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0021724Z {"severity":"error","ts":1685974654.3673432,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"eaffab00-e5eb-48ce-90ff-1df679118cc7","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0025555Z {"severity":"info","ts":1685974654.3729913,"message":"falling back to legacy patching using edge-info","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"39898030-94f0-4038-97e7-f160f31882a1"} 2023-06-05T14:17:36.0027664Z {"severity":"info","ts":1685974654.409992,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"39898030-94f0-4038-97e7-f160f31882a1","prometheus":"prometheus-generic/prometheus-generic"} 2023-06-05T14:17:36.0029605Z {"severity":"info","ts":1685974654.4102807,"message":"falling back to legacy patching using edge-info","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"kube-state-metrics","reconcileID":"465a2e39-5610-4ed8-9161-1f1f42e72f26"} 2023-06-05T14:17:36.0031979Z {"severity":"info","ts":1685974654.4208066,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"kube-state-metrics","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"kube-state-metrics","reconcileID":"465a2e39-5610-4ed8-9161-1f1f42e72f26","prometheus":"prometheus-generic/prometheus-generic"} 2023-06-05T14:17:36.0034193Z {"severity":"info","ts":1685974654.4213305,"message":"falling back to legacy patching using edge-info","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"flux-system-monitoring","reconcileID":"f7d8858b-c106-450e-b1b1-d800cfeeb364"} 2023-06-05T14:17:36.0036534Z {"severity":"info","ts":1685974654.4310305,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"flux-system-monitoring","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"flux-system-monitoring","reconcileID":"f7d8858b-c106-450e-b1b1-d800cfeeb364","prometheus":"prometheus-generic/prometheus-generic"} 2023-06-05T14:17:36.0042614Z {"severity":"error","ts":1685974654.4377913,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"fdcffae1-234b-42f5-89aa-e62a347c837b","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0048850Z {"severity":"error","ts":1685974654.4378695,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"fdcffae1-234b-42f5-89aa-e62a347c837b","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0051304Z === RUN TestController/generic/TestPrometheusPatch 2023-06-05T14:17:36.0056139Z {"severity":"error","ts":1685974654.4434502,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"aafe5cee-a005-41e8-8b80-7fbabd32a5b8","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0062416Z {"severity":"error","ts":1685974654.4435139,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"aafe5cee-a005-41e8-8b80-7fbabd32a5b8","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0069351Z {"severity":"error","ts":1685974654.4539864,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"68596cb5-b2a1-468e-8084-6d152aea06a3","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0075327Z {"severity":"error","ts":1685974654.4540699,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"68596cb5-b2a1-468e-8084-6d152aea06a3","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0077745Z framework.go:146: created prometheus prometheus-generic/prometheus-generic 2023-06-05T14:17:36.0079179Z {"severity":"info","ts":1685974654.4774811,"message":"reconciling prometheus owned by lumperctl","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"3d659780-81d4-4862-8bbf-3483c45fb0e8"} 2023-06-05T14:17:36.0081489Z {"severity":"info","ts":1685974654.4775062,"message":"adding gcp api key configuration for non-GKE cluster","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"3d659780-81d4-4862-8bbf-3483c45fb0e8","cluster-type":"generic"} 2023-06-05T14:17:36.0083681Z {"severity":"info","ts":1685974654.5017486,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"3d659780-81d4-4862-8bbf-3483c45fb0e8","prometheus":"prometheus-generic/prometheus-generic"} 2023-06-05T14:17:36.0089053Z {"severity":"error","ts":1685974654.5394344,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"68295bfb-f9a6-412b-8045-5dfaff22b17b","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0094958Z {"severity":"error","ts":1685974654.5395138,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"68295bfb-f9a6-412b-8045-5dfaff22b17b","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0097871Z {"severity":"info","ts":1685974654.5458124,"message":"reconciling prometheus owned by lumperctl","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"ea6fa030-5a0b-464b-9a30-022531795d3c"} 2023-06-05T14:17:36.0100063Z {"severity":"info","ts":1685974654.5458405,"message":"adding gcp api key configuration for non-GKE cluster","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"ea6fa030-5a0b-464b-9a30-022531795d3c","cluster-type":"generic"} 2023-06-05T14:17:36.0102821Z {"severity":"info","ts":1685974654.557961,"message":"reconciler has patched prometheus based on changes to prometheus CRD","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"ea6fa030-5a0b-464b-9a30-022531795d3c","prometheus":"prometheus-generic/prometheus-generic"} 2023-06-05T14:17:36.0108047Z {"severity":"error","ts":1685974654.5981781,"message":"failed to patch prometheus resource","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"dc1951c3-acf1-4e23-8545-c5aae9e4853b","prometheus":"prometheus-generic/prometheus-generic","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"edge-infra.dev/pkg/f8n/monitoring/k8s/controllers/prometheusctl.(*PrometheusStackdriverReconciler).Reconcile\n\tpkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheus_stackdriver_controller.go:93\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0113824Z {"severity":"error","ts":1685974654.5982766,"message":"Reconciler error","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus","Prometheus":{"name":"prometheus-generic","namespace":"prometheus-generic"},"namespace":"prometheus-generic","name":"prometheus-generic","reconcileID":"dc1951c3-acf1-4e23-8545-c5aae9e4853b","error":"failed to get object prometheus-generic/prometheus-generic: Prometheus.monitoring.coreos.com \"prometheus-generic\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:36.0116186Z {"severity":"info","ts":1685974654.598637,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:17:36.0116720Z {"severity":"info","ts":1685974654.5986583,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:17:36.0117400Z {"severity":"info","ts":1685974654.5986722,"message":"Shutdown signal received, waiting for all workers to finish","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus"} 2023-06-05T14:17:36.0118177Z {"severity":"info","ts":1685974654.5986924,"message":"All workers finished","controller":"prometheus","controllerGroup":"monitoring.coreos.com","controllerKind":"Prometheus"} 2023-06-05T14:17:36.0118766Z {"severity":"info","ts":1685974654.5986981,"message":"Stopping and waiting for caches"} 2023-06-05T14:17:36.0119234Z {"severity":"info","ts":1685974654.598895,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:17:36.0119743Z {"severity":"info","ts":1685974654.5989044,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:17:36.0120341Z --- PASS: TestController (18.16s) 2023-06-05T14:17:36.0121142Z --- PASS: TestController/gke (1.14s) 2023-06-05T14:17:36.0121629Z --- PASS: TestController/gke/TestLegacy (0.27s) 2023-06-05T14:17:36.0122321Z --- PASS: TestController/gke/TestPrometheusPatch (0.09s) 2023-06-05T14:17:36.0122826Z --- PASS: TestController/generic (0.76s) 2023-06-05T14:17:36.0123338Z --- PASS: TestController/generic/TestLegacy (0.33s) 2023-06-05T14:17:36.0123921Z --- PASS: TestController/generic/TestPrometheusPatch (0.16s) 2023-06-05T14:17:36.0124395Z === RUN TestParseMetricsAnnotations 2023-06-05T14:17:36.0124847Z === RUN TestParseMetricsAnnotations/empty_annotation 2023-06-05T14:17:36.0125307Z === RUN TestParseMetricsAnnotations/no_annotation 2023-06-05T14:17:36.0125765Z === RUN TestParseMetricsAnnotations/simple 2023-06-05T14:17:36.0126248Z --- PASS: TestParseMetricsAnnotations (0.00s) 2023-06-05T14:17:36.0126820Z --- PASS: TestParseMetricsAnnotations/empty_annotation (0.00s) 2023-06-05T14:17:36.0127480Z --- PASS: TestParseMetricsAnnotations/no_annotation (0.00s) 2023-06-05T14:17:36.0128123Z --- PASS: TestParseMetricsAnnotations/simple (0.00s) 2023-06-05T14:17:36.0128515Z PASS 2023-06-05T14:17:36.0128848Z ================================================================================ 2023-06-05T14:17:36.7643841Z INFO: From Testing //pkg/k8s/runtime/inventory:inventory_test: 2023-06-05T14:17:36.7644387Z ==================== Test output for //pkg/k8s/runtime/inventory:inventory_test: 2023-06-05T14:17:36.7644866Z === RUN TestInventory 2023-06-05T14:17:36.7645184Z === RUN TestInventory/AddObjects 2023-06-05T14:17:36.7645506Z === RUN TestInventory/ListObjects 2023-06-05T14:17:36.7645841Z === RUN TestInventory/ListMeta 2023-06-05T14:17:36.7646156Z === RUN TestInventory/Diff 2023-06-05T14:17:36.7646595Z --- PASS: TestInventory (0.00s) 2023-06-05T14:17:36.7649768Z --- PASS: TestInventory/AddObjects (0.00s) 2023-06-05T14:17:36.7650530Z --- PASS: TestInventory/ListObjects (0.00s) 2023-06-05T14:17:36.7651654Z --- PASS: TestInventory/ListMeta (0.00s) 2023-06-05T14:17:36.7655085Z --- PASS: TestInventory/Diff (0.00s) 2023-06-05T14:17:36.7656621Z === RUN TestGetUnstructuredInventory 2023-06-05T14:17:36.7657368Z --- PASS: TestGetUnstructuredInventory (0.00s) 2023-06-05T14:17:36.7657958Z === RUN TestOptions 2023-06-05T14:17:36.7658565Z === RUN TestOptions/From_Unstructured 2023-06-05T14:17:36.7659271Z === RUN TestOptions/From_ChangeSet 2023-06-05T14:17:36.7660073Z === RUN TestOptions/Consistent_Inventories 2023-06-05T14:17:36.7660612Z --- PASS: TestOptions (0.00s) 2023-06-05T14:17:36.7661052Z --- PASS: TestOptions/From_Unstructured (0.00s) 2023-06-05T14:17:36.7661517Z --- PASS: TestOptions/From_ChangeSet (0.00s) 2023-06-05T14:17:36.7661980Z --- PASS: TestOptions/Consistent_Inventories (0.00s) 2023-06-05T14:17:36.7662326Z === RUN TestStorage 2023-06-05T14:17:36.7662631Z === RUN TestStorage/Creates_ConfigMap 2023-06-05T14:17:36.7663025Z === RUN TestStorage/Loads_From_ConfigMap 2023-06-05T14:17:36.7663365Z === RUN TestStorage/Set 2023-06-05T14:17:36.7663737Z --- PASS: TestStorage (15.68s) 2023-06-05T14:17:36.7664215Z --- PASS: TestStorage/Creates_ConfigMap (0.03s) 2023-06-05T14:17:36.7664715Z --- PASS: TestStorage/Loads_From_ConfigMap (0.02s) 2023-06-05T14:17:36.7665310Z --- PASS: TestStorage/Set (0.05s) 2023-06-05T14:17:36.7665637Z PASS 2023-06-05T14:17:36.7665997Z ================================================================================ 2023-06-05T14:17:37.0351319Z INFO: From Testing //pkg/f8n/warehouse/oci/layout:layout_test: 2023-06-05T14:17:37.0351972Z ==================== Test output for //pkg/f8n/warehouse/oci/layout:layout_test: 2023-06-05T14:17:37.0352424Z === RUN TestNew 2023-06-05T14:17:37.0352859Z --- PASS: TestNew (0.00s) 2023-06-05T14:17:37.0353300Z === RUN TestAppendTag 2023-06-05T14:17:37.0353754Z --- PASS: TestAppendTag (0.00s) 2023-06-05T14:17:37.0354160Z === RUN TestAppendDigest 2023-06-05T14:17:37.0355084Z --- PASS: TestAppendDigest (0.00s) 2023-06-05T14:17:37.0355481Z === RUN TestGetTag 2023-06-05T14:17:37.0355914Z --- PASS: TestGetTag (0.00s) 2023-06-05T14:17:37.0356598Z === RUN TestAppendTagMultipleTimes 2023-06-05T14:17:37.0357200Z --- PASS: TestAppendTagMultipleTimes (0.01s) 2023-06-05T14:17:37.0357696Z === RUN TestAppendDigestMultipleTimes 2023-06-05T14:17:37.0358378Z --- PASS: TestAppendDigestMultipleTimes (0.02s) 2023-06-05T14:17:37.0358870Z === RUN TestGetTagMultipleTimes 2023-06-05T14:17:37.0359418Z --- PASS: TestGetTagMultipleTimes (0.01s) 2023-06-05T14:17:37.0359817Z PASS 2023-06-05T14:17:37.0360172Z ================================================================================ 2023-06-05T14:17:37.3963513Z INFO: From Testing //pkg/f8n/warehouse/lift/cmd/pack:pack_test: 2023-06-05T14:17:37.3964104Z ==================== Test output for //pkg/f8n/warehouse/lift/cmd/pack:pack_test: 2023-06-05T14:17:37.3965228Z === RUN TestContextFS 2023-06-05T14:17:37.3965869Z === RUN TestContextFS/single_valid_path 2023-06-05T14:17:37.3966805Z === RUN TestContextFS/recursive_valid_path 2023-06-05T14:17:37.3968309Z === RUN TestContextFS/recursive_invalid_path 2023-06-05T14:17:37.3968863Z === RUN TestContextFS/single_valid_path#01 2023-06-05T14:17:37.3969266Z === RUN TestContextFS/recursive_valid_path#01 2023-06-05T14:17:37.3969767Z === RUN TestContextFS/recursive_invalid_path#01 2023-06-05T14:17:37.3970571Z --- PASS: TestContextFS (0.00s) 2023-06-05T14:17:37.3971076Z --- PASS: TestContextFS/single_valid_path (0.00s) 2023-06-05T14:17:37.3972094Z --- PASS: TestContextFS/recursive_valid_path (0.00s) 2023-06-05T14:17:37.3972676Z --- PASS: TestContextFS/recursive_invalid_path (0.00s) 2023-06-05T14:17:37.3973314Z --- PASS: TestContextFS/single_valid_path#01 (0.00s) 2023-06-05T14:17:37.3973967Z --- PASS: TestContextFS/recursive_valid_path#01 (0.00s) 2023-06-05T14:17:37.3974921Z --- PASS: TestContextFS/recursive_invalid_path#01 (0.00s) 2023-06-05T14:17:37.3975317Z === RUN TestFS 2023-06-05T14:17:37.3975699Z --- PASS: TestFS (0.00s) 2023-06-05T14:17:37.3976099Z PASS 2023-06-05T14:17:37.3976442Z ================================================================================ 2023-06-05T14:17:38.2177163Z INFO: From Testing //pkg/edge/iam/util:util_test: 2023-06-05T14:17:38.2177673Z ==================== Test output for //pkg/edge/iam/util:util_test: 2023-06-05T14:17:38.2178051Z === RUN TestRolesSerialize 2023-06-05T14:17:38.2178547Z --- PASS: TestRolesSerialize (0.00s) 2023-06-05T14:17:38.2178908Z PASS 2023-06-05T14:17:38.2179919Z ================================================================================ 2023-06-05T14:17:38.4542839Z INFO: From Testing //pkg/f8n/kinform/server:server_test: 2023-06-05T14:17:38.4543553Z ==================== Test output for //pkg/f8n/kinform/server:server_test: 2023-06-05T14:17:38.4544047Z PASS 2023-06-05T14:17:38.4544476Z testing: warning: no tests to run 2023-06-05T14:17:38.4544959Z ================================================================================ 2023-06-05T14:17:38.7857589Z INFO: From Testing //pkg/edge/datasync/internal/configmap:configmap_test: 2023-06-05T14:17:38.7858301Z ==================== Test output for //pkg/edge/datasync/internal/configmap:configmap_test: 2023-06-05T14:17:38.7858818Z === RUN TestLoadConfiguration 2023-06-05T14:17:38.7859883Z {"severity":"info","ts":1685974658.7433574,"message":"retrieved bsl-info config map values","cfg":{"OrganizationID":"0123456789","OrganizationName":"test-org","SiteID":"id-1","SiteName":"test-site-1"}} 2023-06-05T14:17:38.7860688Z --- PASS: TestLoadConfiguration (0.00s) 2023-06-05T14:17:38.7861038Z PASS 2023-06-05T14:17:38.7861369Z ================================================================================ 2023-06-05T14:17:39.1537198Z INFO: From Testing //pkg/edge/datasync/apis/v1alpha1:v1alpha1_test: 2023-06-05T14:17:39.1537864Z ==================== Test output for //pkg/edge/datasync/apis/v1alpha1:v1alpha1_test: 2023-06-05T14:17:39.1539557Z === RUN TestSecretNamespacedName 2023-06-05T14:17:39.1540806Z --- PASS: TestSecretNamespacedName (0.00s) 2023-06-05T14:17:39.1543987Z === RUN TestToINIFile 2023-06-05T14:17:39.1544400Z [couchdb] 2023-06-05T14:17:39.1544904Z default_security = admin_only 2023-06-05T14:17:39.1546681Z single_node = true 2023-06-05T14:17:39.1547353Z max_dbs_open = 1000 2023-06-05T14:17:39.1548060Z uuid = 41e359fa-bd7e-45d3-87ba-75b2bfe7a73b 2023-06-05T14:17:39.1548821Z file_compression = deflate_3 2023-06-05T14:17:39.1551422Z 2023-06-05T14:17:39.1551642Z [chttpd] 2023-06-05T14:17:39.1552304Z bind_address = :: 2023-06-05T14:17:39.1553509Z changes_timeout = 180000 2023-06-05T14:17:39.1554023Z require_valid_user_except_for_up = true 2023-06-05T14:17:39.1554267Z 2023-06-05T14:17:39.1554389Z [cluster] 2023-06-05T14:17:39.1554660Z q = 5 2023-06-05T14:17:39.1554945Z n = 3 2023-06-05T14:17:39.1555281Z seedlist = node1,node2,node3 2023-06-05T14:17:39.1555497Z 2023-06-05T14:17:39.1555652Z [replicator] 2023-06-05T14:17:39.1555971Z max_jobs = 50 2023-06-05T14:17:39.1562114Z interval = 60000 2023-06-05T14:17:39.1562733Z max_churn = 10 2023-06-05T14:17:39.1563223Z max_history = 8 2023-06-05T14:17:39.1563714Z connection_timeout = 90000 2023-06-05T14:17:39.1564212Z checkpoint_interval = 300000 2023-06-05T14:17:39.1564740Z use_checkpoints = true 2023-06-05T14:17:39.1565387Z use_bulk_get = true 2023-06-05T14:17:39.1567951Z 2023-06-05T14:17:39.1568193Z [replicator.shares] 2023-06-05T14:17:39.1568661Z _replicator = 50 2023-06-05T14:17:39.1569121Z bar/_replicator = 25 2023-06-05T14:17:39.1571839Z foo/_replicator = 25 2023-06-05T14:17:39.1572237Z 2023-06-05T14:17:39.1572530Z [smoosh] 2023-06-05T14:17:39.1573196Z db_channels = upgrade_dbs,ratio_dbs,slack_dbs 2023-06-05T14:17:39.1573909Z view_channels = upgrade_views,ratio_views,slack_views 2023-06-05T14:17:39.1574795Z cleanup_channels = index_cleanup 2023-06-05T14:17:39.1575452Z compaction_log_level = debug 2023-06-05T14:17:39.1575806Z 2023-06-05T14:17:39.1576118Z [smoosh.ratio_dbs] 2023-06-05T14:17:39.1576629Z concurrency = 5 2023-06-05T14:17:39.1577072Z min_priority = 1.3 2023-06-05T14:17:39.1577504Z min_size = 10000 2023-06-05T14:17:39.1578023Z priority = ratio 2023-06-05T14:17:39.1578553Z 2023-06-05T14:17:39.1581193Z [smoosh.ratio_views] 2023-06-05T14:17:39.1581638Z concurrency = 5 2023-06-05T14:17:39.1582199Z min_priority = 1.3 2023-06-05T14:17:39.1582826Z min_size = 10000 2023-06-05T14:17:39.1583420Z priority = ratio 2023-06-05T14:17:39.1583995Z 2023-06-05T14:17:39.1584568Z [smoosh.slack_dbs] 2023-06-05T14:17:39.1585438Z concurrency = 5 2023-06-05T14:17:39.1586068Z min_priority = 20000000 2023-06-05T14:17:39.1586720Z min_size = 10000 2023-06-05T14:17:39.1587302Z priority = slack 2023-06-05T14:17:39.1587720Z 2023-06-05T14:17:39.1588092Z [smoosh.slack_views] 2023-06-05T14:17:39.1588689Z concurrency = 5 2023-06-05T14:17:39.1589189Z min_priority = 20000000 2023-06-05T14:17:39.1589694Z min_size = 10000 2023-06-05T14:17:39.1590129Z priority = slack 2023-06-05T14:17:39.1590447Z 2023-06-05T14:17:39.1590749Z [ioq.bypass] 2023-06-05T14:17:39.1591351Z os_process = true 2023-06-05T14:17:39.1595187Z read = true 2023-06-05T14:17:39.1595854Z write = true 2023-06-05T14:17:39.1596465Z view_update = true 2023-06-05T14:17:39.1597230Z shard_sync = false 2023-06-05T14:17:39.1598101Z compaction = false 2023-06-05T14:17:39.1598927Z reshard = false 2023-06-05T14:17:39.1599763Z 2023-06-05T14:17:39.1600562Z [prometheus] 2023-06-05T14:17:39.1601610Z additional_port = true 2023-06-05T14:17:39.1602415Z bind_address = 127.0.0.1 2023-06-05T14:17:39.1603131Z port = 17986 2023-06-05T14:17:39.1603665Z 2023-06-05T14:17:39.1604432Z --- PASS: TestToINIFile (0.00s) 2023-06-05T14:17:39.1605157Z PASS 2023-06-05T14:17:39.1605773Z ================================================================================ 2023-06-05T14:17:39.2465977Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/triage_parent:triage_parent_test: 2023-06-05T14:17:39.2466769Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/triage_parent:triage_parent_test: 2023-06-05T14:17:39.2467187Z === RUN TestCheckForParent 2023-06-05T14:17:39.2468071Z adding&{Labels:[kind/feature] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[kind/feature triage/needs-parent]--- PASS: TestCheckForParent (0.00s) 2023-06-05T14:17:39.2468588Z === RUN TestAdded 2023-06-05T14:17:39.2468964Z {"severity":"info","ts":1685974659.1926131,"message":"its a label we care about: kind/epic"} 2023-06-05T14:17:39.2469385Z {"severity":"info","ts":1685974659.1926522,"message":"triage labeled event"} 2023-06-05T14:17:39.2469821Z {"severity":"info","ts":1685974659.1931121,"message":"its a label we care about: kind/epic"} 2023-06-05T14:17:39.2470261Z {"severity":"info","ts":1685974659.1931188,"message":"triage labeled event"} 2023-06-05T14:17:39.2470707Z {"severity":"info","ts":1685974659.193122,"message":"removing needs parent label"} 2023-06-05T14:17:39.2471428Z removinglabels: [triage/needs-parent kind/epic]remaining labels: [kind/epic]--- PASS: TestAdded (0.00s) 2023-06-05T14:17:39.2471868Z === RUN TestRemoved 2023-06-05T14:17:39.2472235Z {"severity":"info","ts":1685974659.1932566,"message":"its a label we care about: kind/epic"} 2023-06-05T14:17:39.2472895Z {"severity":"info","ts":1685974659.193263,"message":"triage unlabeled event"} 2023-06-05T14:17:39.2473358Z {"severity":"info","ts":1685974659.1932738,"message":"adding needs parent label"} 2023-06-05T14:17:39.2474390Z adding&{Labels:[] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[triage/needs-parent]{"severity":"info","ts":1685974659.1933446,"message":"its a label we care about: triage/needs-parent"} 2023-06-05T14:17:39.2475125Z {"severity":"info","ts":1685974659.1933587,"message":"triage unlabeled event"} 2023-06-05T14:17:39.2475610Z --- PASS: TestRemoved (0.00s) 2023-06-05T14:17:39.2475941Z === RUN TestIssueComments 2023-06-05T14:17:39.2476353Z {"severity":"info","ts":1685974659.1934004,"message":"Running triage_parent plugin"} 2023-06-05T14:17:39.2477149Z {"severity":"info","ts":1685974659.1953292,"message":"parents exist and no parents being removed. \nattempting to remove triage/needs-parent"} 2023-06-05T14:17:39.2478128Z removinglabels: [kind/feature triage/needs-parent]remaining labels: [kind/feature]{"severity":"info","ts":1685974659.1953928,"message":"Running triage_parent plugin"} 2023-06-05T14:17:39.2479005Z {"severity":"info","ts":1685974659.195484,"message":"all parents are being removed. \nattempting to add triage/needs-parent"} 2023-06-05T14:17:39.2479659Z adding&{Labels:[kind/feature] Assignees:[] Body: 2023-06-05T14:17:39.2480014Z ___ 2023-06-05T14:17:39.2480168Z 2023-06-05T14:17:39.2480305Z 2023-06-05T14:17:39.2480577Z ### parents 2023-06-05T14:17:39.2480946Z 2023-06-05T14:17:39.2481475Z - #12 2023-06-05T14:17:39.2481851Z 2023-06-05T14:17:39.2482173Z ### children 2023-06-05T14:17:39.2482519Z 2023-06-05T14:17:39.2482829Z *No Issues added yet* 2023-06-05T14:17:39.2483163Z 2023-06-05T14:17:39.2483509Z 2023-06-05T14:17:39.2483774Z ___ 2023-06-05T14:17:39.2484075Z 2023-06-05T14:17:39.2484913Z Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[kind/feature triage/needs-parent]{"severity":"info","ts":1685974659.195532,"message":"Running triage_parent plugin"} 2023-06-05T14:17:39.2485871Z {"severity":"info","ts":1685974659.1955516,"message":"no parents being added \nattempting to add triage/needs-parent"} 2023-06-05T14:17:39.2486899Z adding&{Labels:[] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[triage/needs-parent]{"severity":"info","ts":1685974659.1955926,"message":"Running triage_parent plugin"} 2023-06-05T14:17:39.2488170Z {"severity":"info","ts":1685974659.19562,"message":"parents exist \nattempting to remove triage/needs-parent"} 2023-06-05T14:17:39.2492337Z removinglabels: [kind/feature triage/needs-parent]remaining labels: [kind/feature]--- PASS: TestIssueComments (0.00s) 2023-06-05T14:17:39.2492805Z PASS 2023-06-05T14:17:39.2493091Z ================================================================================ 2023-06-05T14:17:39.2758018Z INFO: From Testing //pkg/edge/controllers/clusterctl:clusterctl_test: 2023-06-05T14:17:39.2758674Z ==================== Test output for //pkg/edge/controllers/clusterctl:clusterctl_test: 2023-06-05T14:17:39.2759164Z === RUN TestClusterController 2023-06-05T14:17:39.2759912Z {"severity":"info","ts":1685974647.849288,"message":"Starting EventSource","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","source":"kind source: *v1alpha1.Cluster"} 2023-06-05T14:17:39.2760829Z {"severity":"info","ts":1685974647.8497672,"message":"Starting Controller","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster"} 2023-06-05T14:17:39.2761868Z {"severity":"info","ts":1685974647.8502119,"message":"Starting EventSource","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","source":"kind source: *v1alpha1.GKECluster"} 2023-06-05T14:17:39.2762853Z {"severity":"info","ts":1685974647.8504233,"message":"Starting Controller","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster"} 2023-06-05T14:17:39.2765679Z === RUN TestClusterController/TestClusterControllerGKE 2023-06-05T14:17:39.2767013Z {"severity":"info","ts":1685974648.0511816,"message":"Starting workers","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","worker count":1} 2023-06-05T14:17:39.2768345Z {"severity":"info","ts":1685974648.0512486,"message":"Starting workers","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","worker count":1} 2023-06-05T14:17:39.2770659Z {"severity":"info","ts":1685974648.051481,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"2ce0245d-ccfb-4881-8fa9-bfc29ea8d508"} 2023-06-05T14:17:39.2775538Z {"severity":"error","ts":1685974648.076162,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"2ce0245d-ccfb-4881-8fa9-bfc29ea8d508","error":"failed to apply resources: /c28e7c0c-0c80-42f6-b89c-817a47d6df4a dry-run failed, error: Object 'Kind' is missing in 'unstructured object has no kind'","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2779256Z {"severity":"info","ts":1685974648.0816839,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"339f6818-b0cd-4c4a-a089-130a377fa7c7"} 2023-06-05T14:17:39.2785612Z {"severity":"error","ts":1685974648.3214357,"message":"unable to get ld flag for prunning, defaulting to prune enabled","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"339f6818-b0cd-4c4a-a089-130a377fa7c7","error":"unknown feature key: clusterctl-inventory-pruning. Verify that this feature key exists. Returning default value","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:254\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2789911Z [LaunchDarkly] 2023/06/05 14:17:28 INFO: Starting LaunchDarkly client 6.0.3 2023-06-05T14:17:39.2790674Z [LaunchDarkly] 2023/06/05 14:17:28 INFO: Waiting up to 10000 milliseconds for LaunchDarkly client to start... 2023-06-05T14:17:39.2791374Z [LaunchDarkly] 2023/06/05 14:17:28 INFO: Initialized LaunchDarkly client 2023-06-05T14:17:39.2793341Z {"severity":"info","ts":1685974648.330159,"message":"reconciling finished","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"339f6818-b0cd-4c4a-a089-130a377fa7c7"} 2023-06-05T14:17:39.2795584Z {"severity":"info","ts":1685974649.5100198,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"a2c685a4-d97d-429a-9e0f-64f45c2b51e0"} 2023-06-05T14:17:39.2797962Z {"severity":"info","ts":1685974649.5307117,"message":"finalizer: no secrets for secret manager found in status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"a2c685a4-d97d-429a-9e0f-64f45c2b51e0"} 2023-06-05T14:17:39.2800209Z {"severity":"info","ts":1685974649.6326172,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"f0f53f70-21d7-491a-9a6d-fc5075c35ad1"} 2023-06-05T14:17:39.2806097Z {"severity":"error","ts":1685974649.6351607,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"f0f53f70-21d7-491a-9a6d-fc5075c35ad1","error":"clusters.edge.ncr.com \"c28e7c0c-0c80-42f6-b89c-817a47d6df4a\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2812369Z {"severity":"error","ts":1685974649.6352515,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"f0f53f70-21d7-491a-9a6d-fc5075c35ad1","error":"clusters.edge.ncr.com \"c28e7c0c-0c80-42f6-b89c-817a47d6df4a\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2815901Z {"severity":"info","ts":1685974649.6406195,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"a9395c1c-d7c4-4f27-bafd-05e85233c42a"} 2023-06-05T14:17:39.2820809Z {"severity":"error","ts":1685974649.640675,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"a9395c1c-d7c4-4f27-bafd-05e85233c42a","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2826915Z {"severity":"error","ts":1685974649.640747,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"a9395c1c-d7c4-4f27-bafd-05e85233c42a","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2830081Z {"severity":"info","ts":1685974649.6534126,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"afb93f19-914d-4766-9ba6-43c70f0a089c"} 2023-06-05T14:17:39.2835058Z {"severity":"error","ts":1685974649.6534846,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"afb93f19-914d-4766-9ba6-43c70f0a089c","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2841279Z {"severity":"error","ts":1685974649.6535478,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"afb93f19-914d-4766-9ba6-43c70f0a089c","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2844741Z {"severity":"info","ts":1685974649.6739075,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"58775c96-eff4-44b5-a6a4-1383a9f56418"} 2023-06-05T14:17:39.2849573Z {"severity":"error","ts":1685974649.673959,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"58775c96-eff4-44b5-a6a4-1383a9f56418","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2855809Z {"severity":"error","ts":1685974649.6740248,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"58775c96-eff4-44b5-a6a4-1383a9f56418","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2859106Z {"severity":"info","ts":1685974649.7150345,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"3935354e-1a6b-4b67-806a-c91e2147746d"} 2023-06-05T14:17:39.2863713Z {"severity":"error","ts":1685974649.7150857,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"3935354e-1a6b-4b67-806a-c91e2147746d","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2869215Z {"severity":"error","ts":1685974649.7151496,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"3935354e-1a6b-4b67-806a-c91e2147746d","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2872315Z {"severity":"info","ts":1685974649.7953625,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"6440ae55-334e-43c7-9a2a-de35868f177e"} 2023-06-05T14:17:39.2878424Z {"severity":"error","ts":1685974649.7954195,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"6440ae55-334e-43c7-9a2a-de35868f177e","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2884669Z {"severity":"error","ts":1685974649.7954922,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"6440ae55-334e-43c7-9a2a-de35868f177e","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2886811Z === RUN TestClusterController/TestClusterControllerGKENonStore 2023-06-05T14:17:39.2888398Z {"severity":"info","ts":1685974649.8121107,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"0926b155-fa3c-436c-b869-3e0977132964"} 2023-06-05T14:17:39.2891267Z {"severity":"info","ts":1685974649.8284006,"message":"GKECluster created","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"0926b155-fa3c-436c-b869-3e0977132964","gkeclusters":{"projectId":"ret-edge-test","banner":"cypress-test-org","organization":"edge-dev0-test","name":"df3dc1ab-92d7-4104-ba84-dca039cdd602","cluster_id":"xrvbzv1btihi","edge_id_syncing":true,"fleet":"cluster-infra","location":"us-east-1c","node_version":"1.21.9-gke.300","num_node":3,"machine_type":"e2-highmem-2"}} 2023-06-05T14:17:39.2893352Z {"severity":"info","ts":1685974649.859869,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.2898751Z {"severity":"error","ts":1685974649.9455729,"message":"unable to get ld flag for prunning, defaulting to prune enabled","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"0926b155-fa3c-436c-b869-3e0977132964","error":"unknown feature key: clusterctl-inventory-pruning. Verify that this feature key exists. Returning default value","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:254\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2903027Z {"severity":"info","ts":1685974649.9904158,"message":"reconciling finished","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"0926b155-fa3c-436c-b869-3e0977132964"} 2023-06-05T14:17:39.2904972Z {"severity":"info","ts":1685974649.9905715,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"b4ece172-b213-4179-bbd6-814c1a9ec25e"} 2023-06-05T14:17:39.2909876Z {"severity":"error","ts":1685974649.990601,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"b4ece172-b213-4179-bbd6-814c1a9ec25e","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2915704Z {"severity":"error","ts":1685974649.9906678,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"b4ece172-b213-4179-bbd6-814c1a9ec25e","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2918260Z {"severity":"info","ts":1685974650.2511125,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.2919947Z {"severity":"info","ts":1685974650.3118646,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"67dde758-d0e2-494b-93db-da0d43204e22"} 2023-06-05T14:17:39.2925064Z {"severity":"error","ts":1685974650.3119404,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"67dde758-d0e2-494b-93db-da0d43204e22","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2930969Z {"severity":"error","ts":1685974650.3120184,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"67dde758-d0e2-494b-93db-da0d43204e22","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2933626Z {"severity":"info","ts":1685974650.344725,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.2934413Z === RUN TestClusterController/TestClusterControllerSDSDistributed 2023-06-05T14:17:39.2936014Z {"severity":"info","ts":1685974650.3939989,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"da1bcfc5-8511-48b9-bfab-9c3459efcb19"} 2023-06-05T14:17:39.2938026Z {"severity":"info","ts":1685974650.4109788,"message":"finalizer: no secrets for secret manager found in status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"da1bcfc5-8511-48b9-bfab-9c3459efcb19"} 2023-06-05T14:17:39.2939457Z {"severity":"info","ts":1685974650.418939,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.2940608Z {"severity":"info","ts":1685974650.4869418,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.2945149Z {"severity":"error","ts":1685974650.4870152,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2951140Z {"severity":"error","ts":1685974650.487118,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"bee10f91-6402-4e4a-8e45-203e9abd6050","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2953706Z {"severity":"info","ts":1685974650.4923697,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.2958211Z {"severity":"error","ts":1685974650.4927664,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2963865Z {"severity":"error","ts":1685974650.4931118,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"894b4419-9be3-4fda-97bd-5a5745a94537","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.2966979Z {"severity":"info","ts":1685974650.5012069,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"ed362afa-b06b-4586-9fbf-df0bcc855261"} 2023-06-05T14:17:39.2968596Z {"severity":"info","ts":1685974650.5032978,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.2992337Z {"severity":"error","ts":1685974650.5034785,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3002888Z {"severity":"error","ts":1685974650.503667,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"d1ba80f2-bea7-43f1-9e14-137372f1b69f","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3008215Z {"severity":"error","ts":1685974650.5227914,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"ed362afa-b06b-4586-9fbf-df0bcc855261","error":"failed to apply resources: /397000da-cff6-4114-8a7c-c3ede276ed93 dry-run failed, error: Object 'Kind' is missing in 'unstructured object has no kind'","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3013876Z {"severity":"info","ts":1685974650.5229714,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"0f35ee95-b4a1-47d7-8a8f-9372532dd41b"} 2023-06-05T14:17:39.3030774Z {"severity":"error","ts":1685974650.5230107,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"0f35ee95-b4a1-47d7-8a8f-9372532dd41b","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3036890Z {"severity":"error","ts":1685974650.5230699,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"0f35ee95-b4a1-47d7-8a8f-9372532dd41b","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3039405Z {"severity":"info","ts":1685974650.524774,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.3043759Z {"severity":"error","ts":1685974650.5248394,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3049501Z {"severity":"error","ts":1685974650.524973,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"3e1badf6-4545-494f-bd0b-f9ec171baaf4","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3052946Z {"severity":"info","ts":1685974650.5280883,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"153c8ac6-9d7c-4085-973e-537454289885"} 2023-06-05T14:17:39.3054516Z {"severity":"info","ts":1685974650.5650964,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.3058867Z {"severity":"error","ts":1685974650.5652068,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3064497Z {"severity":"error","ts":1685974650.5652978,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"5d8d5c00-46f6-486f-be38-7bcbe1037c93","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3067038Z {"severity":"info","ts":1685974650.6482122,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.3071339Z {"severity":"error","ts":1685974650.6482837,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3079077Z {"severity":"error","ts":1685974650.64836,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"f62ae84e-1693-4863-8f90-52c34a813287","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3081912Z {"severity":"info","ts":1685974650.8088648,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.3086305Z {"severity":"error","ts":1685974650.8089526,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3092483Z {"severity":"error","ts":1685974650.809054,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"d1e13777-7b54-4086-984b-33e9d6cfb808","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3095129Z {"severity":"info","ts":1685974651.1296482,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.3099714Z {"severity":"error","ts":1685974651.1297252,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3105555Z {"severity":"error","ts":1685974651.1298406,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"f442bca2-82af-42e6-b42c-319a537adf30","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3108745Z {"severity":"info","ts":1685974651.1373768,"logger":"store-credentials-plugin","message":"generated secret","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"153c8ac6-9d7c-4085-973e-537454289885","secret_name":"grub2"} 2023-06-05T14:17:39.3110899Z {"severity":"info","ts":1685974651.149238,"logger":"store-credentials-plugin","message":"generated secret","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"153c8ac6-9d7c-4085-973e-537454289885","secret_name":"breakglass"} 2023-06-05T14:17:39.3116255Z {"severity":"error","ts":1685974651.2467716,"message":"unable to get ld flag for prunning, defaulting to prune enabled","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"153c8ac6-9d7c-4085-973e-537454289885","error":"unknown feature key: clusterctl-inventory-pruning. Verify that this feature key exists. Returning default value","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:254\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3122690Z {"severity":"error","ts":1685974651.252516,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"153c8ac6-9d7c-4085-973e-537454289885","error":"Cluster.edge.ncr.com \"397000da-cff6-4114-8a7c-c3ede276ed93\" is invalid: status.external_inventory.secret_manager_secrets: Required value","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3126103Z {"severity":"info","ts":1685974651.2526784,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"ed1c3ded-9dc8-4ded-838e-0e97f74f2353"} 2023-06-05T14:17:39.3130977Z {"severity":"error","ts":1685974651.2527063,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"ed1c3ded-9dc8-4ded-838e-0e97f74f2353","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3137360Z {"severity":"error","ts":1685974651.2527413,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"ed1c3ded-9dc8-4ded-838e-0e97f74f2353","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3139880Z INFO: From Testing //pkg/edge/api/graph/resolver:resolver_test: 2023-06-05T14:17:39.3141438Z {"severity":"info","ts":1685974651.2527812,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"fb7d6995-8f5f-449d-89dc-d6e94726b641"} 2023-06-05T14:17:39.3146578Z {"severity":"error","ts":1685974651.2527955,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"fb7d6995-8f5f-449d-89dc-d6e94726b641","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3152621Z {"severity":"error","ts":1685974651.252819,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"fb7d6995-8f5f-449d-89dc-d6e94726b641","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3155722Z {"severity":"info","ts":1685974651.2634113,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"e8815705-a9b0-4ab3-b669-07ad33b37990"} 2023-06-05T14:17:39.3157142Z {"severity":"info","ts":1685974651.77032,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.3161443Z {"severity":"error","ts":1685974651.7704103,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3167343Z {"severity":"error","ts":1685974651.7705002,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"94de9ed8-f46b-46b0-b472-45d658317f8a","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3170646Z {"severity":"info","ts":1685974652.0523996,"logger":"store-credentials-plugin","message":"generated secret","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"e8815705-a9b0-4ab3-b669-07ad33b37990","secret_name":"grub2"} 2023-06-05T14:17:39.3172940Z {"severity":"info","ts":1685974652.09918,"logger":"store-credentials-plugin","message":"generated secret","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"e8815705-a9b0-4ab3-b669-07ad33b37990","secret_name":"breakglass"} 2023-06-05T14:17:39.3178351Z {"severity":"error","ts":1685974652.256463,"message":"unable to get ld flag for prunning, defaulting to prune enabled","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"e8815705-a9b0-4ab3-b669-07ad33b37990","error":"unknown feature key: clusterctl-inventory-pruning. Verify that this feature key exists. Returning default value","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:254\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3181465Z === RUN TestClusterController/TestClusterControllerSds 2023-06-05T14:17:39.3182954Z {"severity":"info","ts":1685974652.2730277,"message":"reconciling finished","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"e8815705-a9b0-4ab3-b669-07ad33b37990"} 2023-06-05T14:17:39.3184857Z {"severity":"info","ts":1685974652.2731922,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"3e48b3e1-1373-4348-accd-5baacb468a14"} 2023-06-05T14:17:39.3190020Z {"severity":"error","ts":1685974652.2732298,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"3e48b3e1-1373-4348-accd-5baacb468a14","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3195888Z {"severity":"error","ts":1685974652.2733,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"3e48b3e1-1373-4348-accd-5baacb468a14","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3198910Z {"severity":"info","ts":1685974652.2734063,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"172abdd0-3eb0-4947-bb30-0eb64195195f"} 2023-06-05T14:17:39.3200891Z {"severity":"info","ts":1685974652.2963161,"message":"finalizer: secret manager service created","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"172abdd0-3eb0-4947-bb30-0eb64195195f"} 2023-06-05T14:17:39.3202849Z {"severity":"info","ts":1685974652.3165963,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"d1fe3a2d-c064-4d9f-a712-243588eea824"} 2023-06-05T14:17:39.3207028Z {"severity":"error","ts":1685974652.3642652,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"d1fe3a2d-c064-4d9f-a712-243588eea824","error":"failed to apply resources: /4fb64e1f-1b03-4d8e-a582-c804aa13767d dry-run failed, error: Object 'Kind' is missing in 'unstructured object has no kind'","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3210212Z {"severity":"info","ts":1685974652.364449,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"55e59eac-7698-42dc-aeb0-e191cb53cca0"} 2023-06-05T14:17:39.3215461Z {"severity":"error","ts":1685974652.3644824,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"55e59eac-7698-42dc-aeb0-e191cb53cca0","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3221314Z {"severity":"error","ts":1685974652.3645365,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"55e59eac-7698-42dc-aeb0-e191cb53cca0","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3224372Z {"severity":"info","ts":1685974652.3645818,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"725b3b20-01f3-4aae-a27d-7532f142ffc7"} 2023-06-05T14:17:39.3229239Z {"severity":"error","ts":1685974652.3645973,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"725b3b20-01f3-4aae-a27d-7532f142ffc7","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3235230Z {"severity":"error","ts":1685974652.3646176,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"725b3b20-01f3-4aae-a27d-7532f142ffc7","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3238383Z {"severity":"info","ts":1685974652.3701565,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"c6bf9c5f-817e-464d-b253-cbbba1f73148"} 2023-06-05T14:17:39.3243629Z {"severity":"error","ts":1685974652.588018,"message":"unable to get ld flag for prunning, defaulting to prune enabled","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"c6bf9c5f-817e-464d-b253-cbbba1f73148","error":"unknown feature key: clusterctl-inventory-pruning. Verify that this feature key exists. Returning default value","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:254\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3247783Z {"severity":"info","ts":1685974652.6015553,"message":"reconciling finished","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"c6bf9c5f-817e-464d-b253-cbbba1f73148"} 2023-06-05T14:17:39.3249705Z {"severity":"info","ts":1685974652.6017063,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"7af4bf41-e9ea-4828-9187-f095cd628bcc"} 2023-06-05T14:17:39.3255020Z {"severity":"error","ts":1685974652.6017318,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"7af4bf41-e9ea-4828-9187-f095cd628bcc","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3260914Z {"severity":"error","ts":1685974652.6017942,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"7af4bf41-e9ea-4828-9187-f095cd628bcc","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3263931Z {"severity":"info","ts":1685974652.6018417,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"822f4722-c18b-43f9-836c-85afb0d663a5"} 2023-06-05T14:17:39.3268784Z {"severity":"error","ts":1685974652.6018562,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"822f4722-c18b-43f9-836c-85afb0d663a5","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3274437Z {"severity":"error","ts":1685974652.6018882,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"822f4722-c18b-43f9-836c-85afb0d663a5","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3277484Z {"severity":"info","ts":1685974652.601928,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"86a5a01e-3fbd-4210-ba8f-b5bee91d433e"} 2023-06-05T14:17:39.3282534Z {"severity":"error","ts":1685974652.6019392,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"86a5a01e-3fbd-4210-ba8f-b5bee91d433e","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3288478Z {"severity":"error","ts":1685974652.6019638,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"86a5a01e-3fbd-4210-ba8f-b5bee91d433e","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3291648Z {"severity":"info","ts":1685974652.612861,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"792d9a64-ebb0-481f-9640-61d201e1daff"} 2023-06-05T14:17:39.3296536Z {"severity":"error","ts":1685974652.61291,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"792d9a64-ebb0-481f-9640-61d201e1daff","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3302402Z {"severity":"error","ts":1685974652.6129768,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"792d9a64-ebb0-481f-9640-61d201e1daff","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3305594Z {"severity":"info","ts":1685974652.633369,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"b57fe04c-0031-43e8-9393-69d83904647c"} 2023-06-05T14:17:39.3310410Z {"severity":"error","ts":1685974652.6334255,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"b57fe04c-0031-43e8-9393-69d83904647c","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3316206Z {"severity":"error","ts":1685974652.6334925,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"b57fe04c-0031-43e8-9393-69d83904647c","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3319220Z {"severity":"info","ts":1685974652.673885,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"6c3746c0-f840-48db-b4d4-facd6f8ffdaa"} 2023-06-05T14:17:39.3324272Z {"severity":"error","ts":1685974652.6739454,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"6c3746c0-f840-48db-b4d4-facd6f8ffdaa","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3330192Z {"severity":"error","ts":1685974652.6740098,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"6c3746c0-f840-48db-b4d4-facd6f8ffdaa","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3333371Z {"severity":"info","ts":1685974652.683845,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"794f27d6-9cc6-4eb4-89e1-544aebe00f6e"} 2023-06-05T14:17:39.3338275Z {"severity":"error","ts":1685974652.683895,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"794f27d6-9cc6-4eb4-89e1-544aebe00f6e","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3344174Z {"severity":"error","ts":1685974652.6839585,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"794f27d6-9cc6-4eb4-89e1-544aebe00f6e","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3347430Z {"severity":"info","ts":1685974652.7549257,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"1b60d544-c85f-4000-8d5c-526ad1984904"} 2023-06-05T14:17:39.3352492Z {"severity":"error","ts":1685974652.7549772,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"1b60d544-c85f-4000-8d5c-526ad1984904","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3358253Z {"severity":"error","ts":1685974652.7550483,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"1b60d544-c85f-4000-8d5c-526ad1984904","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3361223Z {"severity":"info","ts":1685974652.8454902,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"e9bf6311-e9af-46e1-ba10-a1c8a04494ed"} 2023-06-05T14:17:39.3366267Z {"severity":"error","ts":1685974652.8455403,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"e9bf6311-e9af-46e1-ba10-a1c8a04494ed","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3372372Z {"severity":"error","ts":1685974652.8456013,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"e9bf6311-e9af-46e1-ba10-a1c8a04494ed","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3375418Z {"severity":"info","ts":1685974652.916076,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"835a7c5a-2fc9-4644-8b0c-78d9403d6eb2"} 2023-06-05T14:17:39.3380263Z {"severity":"error","ts":1685974652.9161353,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"835a7c5a-2fc9-4644-8b0c-78d9403d6eb2","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3386023Z {"severity":"error","ts":1685974652.9162037,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"835a7c5a-2fc9-4644-8b0c-78d9403d6eb2","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3388543Z {"severity":"info","ts":1685974653.051288,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.3393107Z {"severity":"error","ts":1685974653.0513685,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3398850Z {"severity":"error","ts":1685974653.0514638,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"05fa263a-082a-48c2-8e59-8206ffbe215c","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3401867Z {"severity":"info","ts":1685974653.1775165,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"76a3eb1f-d5dc-4ddc-81c7-d308c5bcd528"} 2023-06-05T14:17:39.3406777Z {"severity":"error","ts":1685974653.1775758,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"76a3eb1f-d5dc-4ddc-81c7-d308c5bcd528","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3412858Z {"severity":"error","ts":1685974653.1776483,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"76a3eb1f-d5dc-4ddc-81c7-d308c5bcd528","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3416091Z {"severity":"info","ts":1685974653.2370603,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"7b463511-0975-420f-9d29-8d3d44e8fdb5"} 2023-06-05T14:17:39.3420967Z {"severity":"error","ts":1685974653.2371151,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"7b463511-0975-420f-9d29-8d3d44e8fdb5","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3426717Z {"severity":"error","ts":1685974653.237203,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"7b463511-0975-420f-9d29-8d3d44e8fdb5","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3429721Z {"severity":"info","ts":1685974653.61173,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"87d85b4b-9350-48e4-9a49-86c56329acb0"} 2023-06-05T14:17:39.3430709Z === RUN TestClusterController/TestGKEClusterImmutableFields 2023-06-05T14:17:39.3432336Z {"severity":"info","ts":1685974653.6264277,"message":"finalizer: no secrets for secret manager found in status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"87d85b4b-9350-48e4-9a49-86c56329acb0"} 2023-06-05T14:17:39.3434309Z {"severity":"info","ts":1685974653.6857958,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"4dca94f3-fa20-4807-8197-b0760866ce36"} 2023-06-05T14:17:39.3439376Z {"severity":"error","ts":1685974653.6858513,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"4dca94f3-fa20-4807-8197-b0760866ce36","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3445287Z {"severity":"error","ts":1685974653.685923,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"4dca94f3-fa20-4807-8197-b0760866ce36","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3448330Z {"severity":"info","ts":1685974653.6911228,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"da2185d8-eb34-4bf4-b58c-8e2fae2301ea"} 2023-06-05T14:17:39.3453359Z {"severity":"error","ts":1685974653.6911755,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"da2185d8-eb34-4bf4-b58c-8e2fae2301ea","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3459386Z {"severity":"error","ts":1685974653.6912484,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"da2185d8-eb34-4bf4-b58c-8e2fae2301ea","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3462032Z {"severity":"info","ts":1685974653.693671,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3463717Z {"severity":"info","ts":1685974653.7024457,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"2242468d-d456-46a0-a8b0-1c888a9643e8"} 2023-06-05T14:17:39.3468592Z {"severity":"error","ts":1685974653.7025132,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"2242468d-d456-46a0-a8b0-1c888a9643e8","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3474331Z {"severity":"error","ts":1685974653.7026536,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"2242468d-d456-46a0-a8b0-1c888a9643e8","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3477395Z {"severity":"info","ts":1685974653.7228549,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"aaaa93ed-1c71-42ac-b4dc-c4d3d760b07c"} 2023-06-05T14:17:39.3482545Z {"severity":"error","ts":1685974653.7230308,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"aaaa93ed-1c71-42ac-b4dc-c4d3d760b07c","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3488462Z {"severity":"error","ts":1685974653.723216,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"aaaa93ed-1c71-42ac-b4dc-c4d3d760b07c","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3491004Z {"severity":"info","ts":1685974653.7613077,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3492823Z {"severity":"info","ts":1685974653.7641897,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"dc33abe3-022a-409f-a9ad-827747ba2623"} 2023-06-05T14:17:39.3497796Z {"severity":"error","ts":1685974653.7642343,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"dc33abe3-022a-409f-a9ad-827747ba2623","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3503819Z {"severity":"error","ts":1685974653.7642977,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"dc33abe3-022a-409f-a9ad-827747ba2623","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3506091Z === RUN TestClusterController/TestGKEClusterReconciler 2023-06-05T14:17:39.3507104Z {"severity":"info","ts":1685974653.8105159,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3508772Z {"severity":"info","ts":1685974653.8180084,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"f564e4b8-0284-4f3b-9f0c-ca2f3886c9e1"} 2023-06-05T14:17:39.3513586Z {"severity":"error","ts":1685974653.818058,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"f564e4b8-0284-4f3b-9f0c-ca2f3886c9e1","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3519302Z {"severity":"error","ts":1685974653.8181202,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"f564e4b8-0284-4f3b-9f0c-ca2f3886c9e1","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3522375Z {"severity":"info","ts":1685974653.8445659,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"acff661c-792a-4350-b6f6-8dd5d674e781"} 2023-06-05T14:17:39.3527507Z {"severity":"error","ts":1685974653.844639,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"acff661c-792a-4350-b6f6-8dd5d674e781","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3533514Z {"severity":"error","ts":1685974653.8447099,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"acff661c-792a-4350-b6f6-8dd5d674e781","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3536084Z {"severity":"info","ts":1685974653.8515236,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/dac58942-a67e-43c0-a1cc-05e2343f79a1"} 2023-06-05T14:17:39.3537769Z {"severity":"info","ts":1685974653.877438,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"fd9b14d6-7c02-40e4-9fd6-5b018349a904"} 2023-06-05T14:17:39.3542634Z {"severity":"error","ts":1685974653.8776526,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"fd9b14d6-7c02-40e4-9fd6-5b018349a904","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3548775Z {"severity":"error","ts":1685974653.8778257,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"fd9b14d6-7c02-40e4-9fd6-5b018349a904","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3551409Z {"severity":"info","ts":1685974653.914655,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3552572Z {"severity":"info","ts":1685974653.9956648,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/dac58942-a67e-43c0-a1cc-05e2343f79a1"} 2023-06-05T14:17:39.3554262Z {"severity":"info","ts":1685974654.00501,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"d7bb66a7-7d06-40d8-807f-01382615a7ff"} 2023-06-05T14:17:39.3559168Z {"severity":"error","ts":1685974654.0050623,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"d7bb66a7-7d06-40d8-807f-01382615a7ff","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3564939Z {"severity":"error","ts":1685974654.0051131,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"d7bb66a7-7d06-40d8-807f-01382615a7ff","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3566910Z Fetching cluster bootstrap data... 2023-06-05T14:17:39.3567322Z Cluster bootstrap data retrieved! 2023-06-05T14:17:39.3567739Z creating edge Secrets ... 2023-06-05T14:17:39.3568100Z installing Flux ... 2023-06-05T14:17:39.3569710Z {"severity":"info","ts":1685974654.3260915,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"64a169dd-7e50-4a81-b02a-cd1e68ed2d7e"} 2023-06-05T14:17:39.3574789Z {"severity":"error","ts":1685974654.3261645,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"64a169dd-7e50-4a81-b02a-cd1e68ed2d7e","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3580783Z {"severity":"error","ts":1685974654.3263023,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"64a169dd-7e50-4a81-b02a-cd1e68ed2d7e","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3583829Z {"severity":"info","ts":1685974654.9675298,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"02238cc8-7b6d-407c-aa21-621850e5d8aa"} 2023-06-05T14:17:39.3588718Z {"severity":"error","ts":1685974654.9675994,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"02238cc8-7b6d-407c-aa21-621850e5d8aa","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3594635Z {"severity":"error","ts":1685974654.9676657,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"02238cc8-7b6d-407c-aa21-621850e5d8aa","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3597822Z {"severity":"info","ts":1685974655.0985548,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"18702d12-3e73-47fb-a10d-52ae37429427"} 2023-06-05T14:17:39.3602633Z {"severity":"error","ts":1685974655.0986116,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"18702d12-3e73-47fb-a10d-52ae37429427","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3608373Z {"severity":"error","ts":1685974655.0986798,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"18702d12-3e73-47fb-a10d-52ae37429427","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3611366Z {"severity":"info","ts":1685974655.158487,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"a5e04beb-4a20-4f6c-bf3d-fef812f692bc"} 2023-06-05T14:17:39.3616696Z {"severity":"error","ts":1685974655.1585548,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"a5e04beb-4a20-4f6c-bf3d-fef812f692bc","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3622668Z {"severity":"error","ts":1685974655.1586413,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"a5e04beb-4a20-4f6c-bf3d-fef812f692bc","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3625787Z {"severity":"info","ts":1685974655.1630828,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"c8e8904f-4d98-4ad4-9d53-3021d3db16d1"} 2023-06-05T14:17:39.3630644Z {"severity":"error","ts":1685974655.163158,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"c8e8904f-4d98-4ad4-9d53-3021d3db16d1","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3636545Z {"severity":"error","ts":1685974655.1632433,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a"},"namespace":"","name":"c28e7c0c-0c80-42f6-b89c-817a47d6df4a","reconcileID":"c8e8904f-4d98-4ad4-9d53-3021d3db16d1","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3639667Z {"severity":"info","ts":1685974656.2488012,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"1b20e27e-f784-4875-82b5-182c7497df04"} 2023-06-05T14:17:39.3644528Z {"severity":"error","ts":1685974656.2488968,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"1b20e27e-f784-4875-82b5-182c7497df04","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3650295Z {"severity":"error","ts":1685974656.2489839,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d"},"namespace":"","name":"4fb64e1f-1b03-4d8e-a582-c804aa13767d","reconcileID":"1b20e27e-f784-4875-82b5-182c7497df04","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3652430Z Installing Flux Bucket resource!! 2023-06-05T14:17:39.3652807Z Flux Bucket created 2023-06-05T14:17:39.3653186Z Installing Flux Kustomize resource!! 2023-06-05T14:17:39.3653574Z Flux Kustomize created 2023-06-05T14:17:39.3653966Z Cluster bootstrapping with edge completed! 2023-06-05T14:17:39.3656177Z {"severity":"info","ts":1685974656.693927,"logger":"gkecluster-reconciler","message":"Installing Flux Kustomize resource!!","gkeclusters":"/dac58942-a67e-43c0-a1cc-05e2343f79a1","name":"dac58942-a67e-43c0-a1cc-05e2343f79a1","spec":{"projectId":"ret-edge-test","banner":"cypress-test-org","organization":"edge-dev0-test","name":"dac58942-a67e-43c0-a1cc-05e2343f79a1","cluster_id":"rzm5qgl4zqci","edge_id_syncing":true,"fleet":"store","location":"us-east-1c","node_version":"1.21.9-gke.300","num_node":3,"machine_type":"e2-highmem-2"}} 2023-06-05T14:17:39.3659254Z {"severity":"info","ts":1685974656.6940262,"logger":"gkecluster-reconciler","message":"kustomization applied","gkeclusters":"/dac58942-a67e-43c0-a1cc-05e2343f79a1","name":"dac58942-a67e-43c0-a1cc-05e2343f79a1","spec":{"projectId":"ret-edge-test","banner":"cypress-test-org","organization":"edge-dev0-test","name":"dac58942-a67e-43c0-a1cc-05e2343f79a1","cluster_id":"rzm5qgl4zqci","edge_id_syncing":true,"fleet":"store","location":"us-east-1c","node_version":"1.21.9-gke.300","num_node":3,"machine_type":"e2-highmem-2"}} 2023-06-05T14:17:39.3662237Z {"severity":"info","ts":1685974656.7024145,"logger":"gkecluster-reconciler","message":"container cluster creation and bootstrapping successful, reconciling finished.","gkeclusters":"/dac58942-a67e-43c0-a1cc-05e2343f79a1","name":"dac58942-a67e-43c0-a1cc-05e2343f79a1","spec":{"projectId":"ret-edge-test","banner":"cypress-test-org","organization":"edge-dev0-test","name":"dac58942-a67e-43c0-a1cc-05e2343f79a1","cluster_id":"rzm5qgl4zqci","edge_id_syncing":true,"fleet":"store","location":"us-east-1c","node_version":"1.21.9-gke.300","num_node":3,"machine_type":"e2-highmem-2"}} 2023-06-05T14:17:39.3664213Z {"severity":"info","ts":1685974656.7025282,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3665026Z === RUN TestClusterController/TestGKEClusterReconciler_FleetClusterInfra 2023-06-05T14:17:39.3666087Z {"severity":"info","ts":1685974656.7502425,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a"} 2023-06-05T14:17:39.3670377Z {"severity":"error","ts":1685974656.7503073,"logger":"gkecluster-reconciler","message":"invalid GKECluster spec","gkeclusters":"/609d14df-1a7c-4839-a532-253220b9366a","name":"","spec":{"projectId":"","banner":"","organization":"","name":"","fleet":""},"error":"project id is not provided in cluster spec","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*GKEClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/gke_cluster_ctl.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3676050Z {"severity":"error","ts":1685974656.750385,"message":"Reconciler error","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster","GKECluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"59eebdf2-6427-4daf-bac3-e0f4e15e0b3f","error":"GKECluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3678586Z {"severity":"info","ts":1685974656.7504218,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/dc36b70c-00b4-4a78-86e0-8c7ab5825262"} 2023-06-05T14:17:39.3679739Z {"severity":"info","ts":1685974656.7936323,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3680905Z {"severity":"info","ts":1685974656.831791,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/dc36b70c-00b4-4a78-86e0-8c7ab5825262"} 2023-06-05T14:17:39.3682070Z {"severity":"info","ts":1685974656.8672013,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3683368Z {"severity":"info","ts":1685974656.905262,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/dc36b70c-00b4-4a78-86e0-8c7ab5825262"} 2023-06-05T14:17:39.3684159Z Fetching cluster bootstrap data... 2023-06-05T14:17:39.3684567Z Cluster bootstrap data retrieved! 2023-06-05T14:17:39.3684985Z creating edge Secrets ... 2023-06-05T14:17:39.3685342Z installing Flux ... 2023-06-05T14:17:39.3685715Z Installing Flux Bucket resource!! 2023-06-05T14:17:39.3686085Z Flux Bucket created 2023-06-05T14:17:39.3686444Z Installing Flux Kustomize resource!! 2023-06-05T14:17:39.3686829Z Flux Kustomize created 2023-06-05T14:17:39.3687237Z Cluster bootstrapping with edge completed! 2023-06-05T14:17:39.3689355Z {"severity":"info","ts":1685974657.2208729,"logger":"gkecluster-reconciler","message":"Installing Flux Kustomize resource!!","gkeclusters":"/dc36b70c-00b4-4a78-86e0-8c7ab5825262","name":"dc36b70c-00b4-4a78-86e0-8c7ab5825262","spec":{"projectId":"ret-edge-test","banner":"cypress-test-org","organization":"edge-dev0-test","name":"dc36b70c-00b4-4a78-86e0-8c7ab5825262","cluster_id":"rwpiuidvclcu","edge_id_syncing":true,"fleet":"cluster-infra","location":"us-east-1c","node_version":"1.21.9-gke.300","num_node":3,"machine_type":"e2-highmem-2"}} 2023-06-05T14:17:39.3692331Z {"severity":"info","ts":1685974657.2211177,"logger":"gkecluster-reconciler","message":"kustomization applied","gkeclusters":"/dc36b70c-00b4-4a78-86e0-8c7ab5825262","name":"dc36b70c-00b4-4a78-86e0-8c7ab5825262","spec":{"projectId":"ret-edge-test","banner":"cypress-test-org","organization":"edge-dev0-test","name":"dc36b70c-00b4-4a78-86e0-8c7ab5825262","cluster_id":"rwpiuidvclcu","edge_id_syncing":true,"fleet":"cluster-infra","location":"us-east-1c","node_version":"1.21.9-gke.300","num_node":3,"machine_type":"e2-highmem-2"}} 2023-06-05T14:17:39.3695382Z {"severity":"info","ts":1685974657.2354746,"logger":"gkecluster-reconciler","message":"container cluster creation and bootstrapping successful, reconciling finished.","gkeclusters":"/dc36b70c-00b4-4a78-86e0-8c7ab5825262","name":"dc36b70c-00b4-4a78-86e0-8c7ab5825262","spec":{"projectId":"ret-edge-test","banner":"cypress-test-org","organization":"edge-dev0-test","name":"dc36b70c-00b4-4a78-86e0-8c7ab5825262","cluster_id":"rwpiuidvclcu","edge_id_syncing":true,"fleet":"cluster-infra","location":"us-east-1c","node_version":"1.21.9-gke.300","num_node":3,"machine_type":"e2-highmem-2"}} 2023-06-05T14:17:39.3697233Z {"severity":"info","ts":1685974657.2356098,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3698003Z === RUN TestClusterController/TestGKEClusterReconciler_TenantClusterInfra 2023-06-05T14:17:39.3699056Z {"severity":"info","ts":1685974657.3141043,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3700202Z {"severity":"info","ts":1685974657.3546293,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/dad34701-8781-4064-a36d-c99c77883713"} 2023-06-05T14:17:39.3701347Z {"severity":"info","ts":1685974657.4106746,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3702479Z {"severity":"info","ts":1685974657.4530253,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/dad34701-8781-4064-a36d-c99c77883713"} 2023-06-05T14:17:39.3703617Z {"severity":"info","ts":1685974657.4949188,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3704773Z {"severity":"info","ts":1685974657.5441997,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/dad34701-8781-4064-a36d-c99c77883713"} 2023-06-05T14:17:39.3705440Z Fetching cluster bootstrap data... 2023-06-05T14:17:39.3706071Z Cluster bootstrap data retrieved! 2023-06-05T14:17:39.3706453Z creating edge Secrets ... 2023-06-05T14:17:39.3706945Z installing Flux ... 2023-06-05T14:17:39.3708361Z {"severity":"info","ts":1685974657.6596487,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"5baba900-cb22-4c77-a89c-5024c86df8d4"} 2023-06-05T14:17:39.3713206Z {"severity":"error","ts":1685974657.6597276,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"5baba900-cb22-4c77-a89c-5024c86df8d4","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3718977Z {"severity":"error","ts":1685974657.6598136,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"609d14df-1a7c-4839-a532-253220b9366a"},"namespace":"","name":"609d14df-1a7c-4839-a532-253220b9366a","reconcileID":"5baba900-cb22-4c77-a89c-5024c86df8d4","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3721979Z {"severity":"info","ts":1685974657.7198796,"message":"reconciling started for cluster","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"52333c1f-6fee-4f54-a721-0fc9b94f34b5"} 2023-06-05T14:17:39.3727035Z {"severity":"error","ts":1685974657.7199423,"message":"unable to update Cluster status","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"52333c1f-6fee-4f54-a721-0fc9b94f34b5","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/clusterctl.(*ClusterReconciler).Reconcile\n\tpkg/edge/controllers/clusterctl/cluster_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3733016Z {"severity":"error","ts":1685974657.7200108,"message":"Reconciler error","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster","Cluster":{"name":"397000da-cff6-4114-8a7c-c3ede276ed93"},"namespace":"","name":"397000da-cff6-4114-8a7c-c3ede276ed93","reconcileID":"52333c1f-6fee-4f54-a721-0fc9b94f34b5","error":"Cluster.edge.ncr.com \"\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:39.3735074Z Installing Flux Bucket resource!! 2023-06-05T14:17:39.3735431Z Flux Bucket created 2023-06-05T14:17:39.3735804Z Installing Flux Kustomize resource!! 2023-06-05T14:17:39.3736188Z Flux Kustomize created 2023-06-05T14:17:39.3736591Z Cluster bootstrapping with edge completed! 2023-06-05T14:17:39.3738693Z {"severity":"info","ts":1685974657.9599729,"logger":"gkecluster-reconciler","message":"Installing Flux Kustomize resource!!","gkeclusters":"/dad34701-8781-4064-a36d-c99c77883713","name":"dad34701-8781-4064-a36d-c99c77883713","spec":{"projectId":"tenant-project","banner":"cypress-test-org","organization":"edge-dev0-test","name":"dad34701-8781-4064-a36d-c99c77883713","cluster_id":"jh2o8soo1pmu","edge_id_syncing":true,"fleet":"cluster-infra","location":"us-east-1c","node_version":"1.21.9-gke.300","num_node":3,"machine_type":"e2-highmem-2"}} 2023-06-05T14:17:39.3741475Z {"severity":"info","ts":1685974657.960156,"logger":"gkecluster-reconciler","message":"kustomization applied","gkeclusters":"/dad34701-8781-4064-a36d-c99c77883713","name":"dad34701-8781-4064-a36d-c99c77883713","spec":{"projectId":"tenant-project","banner":"cypress-test-org","organization":"edge-dev0-test","name":"dad34701-8781-4064-a36d-c99c77883713","cluster_id":"jh2o8soo1pmu","edge_id_syncing":true,"fleet":"cluster-infra","location":"us-east-1c","node_version":"1.21.9-gke.300","num_node":3,"machine_type":"e2-highmem-2"}} 2023-06-05T14:17:39.3744458Z {"severity":"info","ts":1685974657.9673252,"logger":"gkecluster-reconciler","message":"container cluster creation and bootstrapping successful, reconciling finished.","gkeclusters":"/dad34701-8781-4064-a36d-c99c77883713","name":"dad34701-8781-4064-a36d-c99c77883713","spec":{"projectId":"tenant-project","banner":"cypress-test-org","organization":"edge-dev0-test","name":"dad34701-8781-4064-a36d-c99c77883713","cluster_id":"jh2o8soo1pmu","edge_id_syncing":true,"fleet":"cluster-infra","location":"us-east-1c","node_version":"1.21.9-gke.300","num_node":3,"machine_type":"e2-highmem-2"}} 2023-06-05T14:17:39.3746334Z {"severity":"info","ts":1685974657.9676006,"logger":"gkecluster-reconciler","message":"reconciling started for GKECluster","gkeclusters":"/30f39111-8a54-4ab7-8bee-705b978d8be7"} 2023-06-05T14:17:39.3747268Z {"severity":"info","ts":1685974658.0256598,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:17:39.3747895Z {"severity":"info","ts":1685974658.0257082,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:17:39.3748713Z {"severity":"info","ts":1685974658.0257244,"message":"Shutdown signal received, waiting for all workers to finish","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster"} 2023-06-05T14:17:39.3749910Z {"severity":"info","ts":1685974658.0257316,"message":"Shutdown signal received, waiting for all workers to finish","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster"} 2023-06-05T14:17:39.3750967Z {"severity":"info","ts":1685974658.0257597,"message":"All workers finished","controller":"gkecluster","controllerGroup":"edge.ncr.com","controllerKind":"GKECluster"} 2023-06-05T14:17:39.3751807Z {"severity":"info","ts":1685974658.0257657,"message":"All workers finished","controller":"cluster","controllerGroup":"edge.ncr.com","controllerKind":"Cluster"} 2023-06-05T14:17:39.3752492Z {"severity":"info","ts":1685974658.0257707,"message":"Stopping and waiting for caches"} 2023-06-05T14:17:39.3753048Z {"severity":"info","ts":1685974658.0259893,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:17:39.3753637Z {"severity":"info","ts":1685974658.0259984,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:17:39.3754286Z --- PASS: TestClusterController (24.48s) 2023-06-05T14:17:39.3755005Z --- PASS: TestClusterController/TestClusterControllerGKE (1.93s) 2023-06-05T14:17:39.3755810Z --- PASS: TestClusterController/TestClusterControllerGKENonStore (0.59s) 2023-06-05T14:17:39.3756645Z --- PASS: TestClusterController/TestClusterControllerSDSDistributed (1.87s) 2023-06-05T14:17:39.3757426Z --- PASS: TestClusterController/TestClusterControllerSds (1.34s) 2023-06-05T14:17:39.3758182Z --- PASS: TestClusterController/TestGKEClusterImmutableFields (0.19s) 2023-06-05T14:17:39.3758932Z --- PASS: TestClusterController/TestGKEClusterReconciler (2.92s) 2023-06-05T14:17:39.3759736Z --- PASS: TestClusterController/TestGKEClusterReconciler_FleetClusterInfra (0.58s) 2023-06-05T14:17:39.3760572Z --- PASS: TestClusterController/TestGKEClusterReconciler_TenantClusterInfra (0.72s) 2023-06-05T14:17:39.3761065Z PASS 2023-06-05T14:17:39.3761411Z ================================================================================ 2023-06-05T14:17:39.3761887Z ==================== Test output for //pkg/edge/api/graph/resolver:resolver_test: 2023-06-05T14:17:39.3762339Z === RUN TestGetActions 2023-06-05T14:17:39.3762778Z --- PASS: TestGetActions (0.00s) 2023-06-05T14:17:39.3763145Z === RUN TestLogin 2023-06-05T14:17:39.3763547Z --- PASS: TestLogin (0.00s) 2023-06-05T14:17:39.3763918Z === RUN TestRegistration 2023-06-05T14:17:39.3764363Z --- PASS: TestRegistration (0.00s) 2023-06-05T14:17:39.3764773Z === RUN TestGetBootrapperRoles 2023-06-05T14:17:39.3765329Z --- PASS: TestGetBootrapperRoles (0.00s) 2023-06-05T14:17:39.3765770Z === RUN TestGetDockerPullSecret 2023-06-05T14:17:39.3766277Z --- PASS: TestGetDockerPullSecret (0.00s) 2023-06-05T14:17:39.3766731Z === RUN TestBeginTerminalBootstrap 2023-06-05T14:17:39.3767288Z --- PASS: TestBeginTerminalBootstrap (0.00s) 2023-06-05T14:17:39.3767720Z === RUN TestAddSiteToStore 2023-06-05T14:17:39.3768183Z --- PASS: TestAddSiteToStore (0.00s) 2023-06-05T14:17:39.3768603Z === RUN TestAddSiteToStoreWithEU 2023-06-05T14:17:39.3769132Z --- PASS: TestAddSiteToStoreWithEU (0.00s) 2023-06-05T14:17:39.3769549Z === RUN TestAPIVersion 2023-06-05T14:17:39.3769976Z --- PASS: TestAPIVersion (0.00s) 2023-06-05T14:17:39.3770317Z PASS 2023-06-05T14:17:39.3770670Z ================================================================================ 2023-06-05T14:17:39.7899389Z INFO: From Testing //pkg/f8n/kinform/client:client_test: 2023-06-05T14:17:39.7900140Z ==================== Test output for //pkg/f8n/kinform/client:client_test: 2023-06-05T14:17:39.7900642Z === RUN TestConfigFromFile 2023-06-05T14:17:39.7901161Z --- PASS: TestConfigFromFile (0.00s) 2023-06-05T14:17:39.7901568Z === RUN TestConfigFromFileNotFound 2023-06-05T14:17:39.7902037Z --- PASS: TestConfigFromFileNotFound (0.00s) 2023-06-05T14:17:39.7902698Z === RUN TestGVRToString 2023-06-05T14:17:39.7903087Z --- PASS: TestGVRToString (0.00s) 2023-06-05T14:17:39.7903403Z === RUN TestRegexMatch 2023-06-05T14:17:39.7903855Z --- PASS: TestRegexMatch (0.00s) 2023-06-05T14:17:39.7904183Z === RUN TestRegexMatchesAny 2023-06-05T14:17:39.7905050Z --- PASS: TestRegexMatchesAny (0.00s) 2023-06-05T14:17:39.7905510Z PASS 2023-06-05T14:17:39.7905794Z ================================================================================ 2023-06-05T14:17:40.2460672Z INFO: From Testing //pkg/edge/ctlfish/option:option_test: 2023-06-05T14:17:40.2576394Z ==================== Test output for //pkg/edge/ctlfish/option:option_test: 2023-06-05T14:17:40.2576874Z === RUN TestGetConfigAllTrue 2023-06-05T14:17:40.2577888Z --- PASS: TestGetConfigAllTrue (0.00s) 2023-06-05T14:17:40.2578293Z === RUN TestGetConfigNotFound 2023-06-05T14:17:40.2581557Z {"severity":"error","ts":1685974660.141283,"message":"Config file not found at , using default values","error":"Config File \"NO_FILE\" Not Found in \"[/github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7428/execroot/edge_infra/bazel-out/k8-fastbuild/bin/pkg/edge/ctlfish/option/option_test_/option_test.runfiles/edge_infra/pkg/edge/ctlfish/option /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7428/execroot/edge_infra/bazel-out/k8-fastbuild/bin/pkg/edge/ctlfish/option/option_test_/option_test.runfiles/edge_infra/pkg/edge/ctlfish/option/testdata /opt]\"","stacktrace":"edge-infra.dev/pkg/edge/ctlfish/option.GetConfig\n\tpkg/edge/ctlfish/option/config.go:68\nedge-infra.dev/pkg/edge/ctlfish/option.TestGetConfigNotFound\n\tpkg/edge/ctlfish/option/config_test.go:68\ntesting.tRunner\n\tGOROOT/src/testing/testing.go:1446"} 2023-06-05T14:17:40.2583755Z --- PASS: TestGetConfigNotFound (0.00s) 2023-06-05T14:17:40.2584159Z === RUN TestGetConfigAllFalse 2023-06-05T14:17:40.2584622Z --- PASS: TestGetConfigAllFalse (0.00s) 2023-06-05T14:17:40.2584979Z === RUN TestIntervalSet 2023-06-05T14:17:40.2585392Z --- PASS: TestIntervalSet (0.00s) 2023-06-05T14:17:40.2585767Z === RUN TestIntervalDefault 2023-06-05T14:17:40.2586215Z --- PASS: TestIntervalDefault (0.00s) 2023-06-05T14:17:40.2586608Z === RUN TestMetricConfig_IsExcluded 2023-06-05T14:17:40.2587112Z --- PASS: TestMetricConfig_IsExcluded (0.00s) 2023-06-05T14:17:40.2587529Z === RUN TestMetricConfig_IsIncluded 2023-06-05T14:17:40.2588044Z --- PASS: TestMetricConfig_IsIncluded (0.02s) 2023-06-05T14:17:40.2588406Z === RUN TestGVRToString 2023-06-05T14:17:40.2588824Z --- PASS: TestGVRToString (0.00s) 2023-06-05T14:17:40.2589145Z PASS 2023-06-05T14:17:40.2589549Z ================================================================================ 2023-06-05T14:17:40.4967296Z INFO: From Testing //pkg/f8n/warehouse/promote:promote_test: 2023-06-05T14:17:40.4967933Z ==================== Test output for //pkg/f8n/warehouse/promote:promote_test: 2023-06-05T14:17:40.4968428Z === RUN TestNewConfigForPackagePromotion 2023-06-05T14:17:40.4969026Z --- PASS: TestNewConfigForPackagePromotion (0.00s) 2023-06-05T14:17:40.4969539Z === RUN TestNewConfigForAllPackagesPromotion 2023-06-05T14:17:40.4970356Z --- PASS: TestNewConfigForAllPackagesPromotion (0.00s) 2023-06-05T14:17:40.4970844Z === RUN TestNewConfigWithDefaults 2023-06-05T14:17:40.4971621Z --- PASS: TestNewConfigWithDefaults (0.00s) 2023-06-05T14:17:40.4972206Z === RUN TestNewConfigWithAllPackagesAndNameReturnsError 2023-06-05T14:17:40.4972995Z --- PASS: TestNewConfigWithAllPackagesAndNameReturnsError (0.00s) 2023-06-05T14:17:40.4973651Z === RUN TestNewConfigWithoutAllPackagesOrNameReturnsError 2023-06-05T14:17:40.4974431Z --- PASS: TestNewConfigWithoutAllPackagesOrNameReturnsError (0.00s) 2023-06-05T14:17:40.4975046Z === RUN TestNewConfigMissingRequiredFlagsReturnsError 2023-06-05T14:17:40.4975746Z --- PASS: TestNewConfigMissingRequiredFlagsReturnsError (0.00s) 2023-06-05T14:17:40.4976319Z === RUN TestNewConfigMissingAllFlagsReturnsError 2023-06-05T14:17:40.4976984Z --- PASS: TestNewConfigMissingAllFlagsReturnsError (0.00s) 2023-06-05T14:17:40.4977551Z === RUN TestNewConfigWithUnknownFlagReturnsError 2023-06-05T14:17:40.4978108Z flag provided but not defined: -invalid-flag 2023-06-05T14:17:40.4978457Z Usage of promote: 2023-06-05T14:17:40.4979274Z -all-pkgs 2023-06-05T14:17:40.4980119Z promote all packages from the source repository - version will always be "latest", cannot be set when pkg-name is specified 2023-06-05T14:17:40.4980928Z -dest-project string 2023-06-05T14:17:40.4981559Z GCP project ID that contains the destination repository (e.g. "ret-edge-stage2-foreman") 2023-06-05T14:17:40.4982054Z -dest-repo string 2023-06-05T14:17:40.4982447Z destination GAR repository instance to promote to (default "warehouse") 2023-06-05T14:17:40.4982937Z -fwder-project string 2023-06-05T14:17:40.4983528Z GCP project ID that contains the registry forwarder (default "ret-edge-pltf-infra") 2023-06-05T14:17:40.4984053Z -gcp-location string 2023-06-05T14:17:40.4985927Z GCP location / region (default "us-east1") 2023-06-05T14:17:40.4987251Z -pkg-name string 2023-06-05T14:17:40.4988247Z the name of the package to be promoted (e.g. "lumper-controller") 2023-06-05T14:17:40.4988765Z -pkg-version string 2023-06-05T14:17:40.4989249Z the package version to be promoted (e.g. "latest" or "sha256@a9f10383...") (default "latest") 2023-06-05T14:17:40.4991287Z -src-project string 2023-06-05T14:17:40.4992221Z GCP project ID that contains the source repository (e.g. "ret-edge-stage1-foreman") 2023-06-05T14:17:40.4995255Z -src-repo string 2023-06-05T14:17:40.4996007Z source GAR repository instance to promote from (default "warehouse") 2023-06-05T14:17:40.4999425Z --- PASS: TestNewConfigWithUnknownFlagReturnsError (0.00s) 2023-06-05T14:17:40.5001255Z === RUN TestPromotion 2023-06-05T14:17:40.5002698Z === RUN TestPromotion/Package_promotion 2023-06-05T14:17:40.5004090Z 2023/06/05 14:17:40 GET /v2/ 2023-06-05T14:17:40.5006005Z 2023/06/05 14:17:40 HEAD /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/manifests/latest 404 NAME_UNKNOWN Unknown name 2023-06-05T14:17:40.5008424Z 2023/06/05 14:17:40 HEAD /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/sha256:e0f3c1395ad359b76e16906cf4e94a5f9262b5a6873429d1c6aafac8463bf40d 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:40.5011043Z 2023/06/05 14:17:40 HEAD /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/sha256:8fdfe2dbd5e942701a4569cdde51994c910b9bd6b56580f1467b46e964bc031e 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:40.5015029Z 2023/06/05 14:17:40 POST /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/ 2023-06-05T14:17:40.5017418Z 2023/06/05 14:17:40 POST /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/ 2023-06-05T14:17:40.5019602Z 2023/06/05 14:17:40 PATCH /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/2395374180576118454 2023-06-05T14:17:40.5021762Z 2023/06/05 14:17:40 PATCH /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/997909269553289412 2023-06-05T14:17:40.5024105Z 2023/06/05 14:17:40 PUT /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/997909269553289412?digest=sha256%3Ae0f3c1395ad359b76e16906cf4e94a5f9262b5a6873429d1c6aafac8463bf40d 2023-06-05T14:17:40.5026679Z 2023/06/05 14:17:40 PUT /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/2395374180576118454?digest=sha256%3A8fdfe2dbd5e942701a4569cdde51994c910b9bd6b56580f1467b46e964bc031e 2023-06-05T14:17:40.5028809Z 2023/06/05 14:17:40 PUT /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/manifests/latest 2023-06-05T14:17:40.5030335Z 2023/06/05 14:17:40 GET /v2/ 2023-06-05T14:17:40.5032448Z 2023/06/05 14:17:40 HEAD /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/manifests/old 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:17:40.5034965Z 2023/06/05 14:17:40 HEAD /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/sha256:2c4e4b5117fcbfcfa23ef0ee7de514c530e4b01a625a35660b58fa5e5444b923 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:40.5038600Z 2023/06/05 14:17:40 HEAD /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/sha256:7a307a8a5bc9d4297bbb1784eaea28f96a4a62a6b0b80f92ce8c18663ae128d6 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:40.5041456Z 2023/06/05 14:17:40 POST /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/ 2023-06-05T14:17:40.5043774Z 2023/06/05 14:17:40 POST /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/ 2023-06-05T14:17:40.5045619Z 2023/06/05 14:17:40 PATCH /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/3392199674623705456 2023-06-05T14:17:40.5047702Z 2023/06/05 14:17:40 PATCH /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/2522934754633249055 2023-06-05T14:17:40.5050199Z 2023/06/05 14:17:40 PUT /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/3392199674623705456?digest=sha256%3A2c4e4b5117fcbfcfa23ef0ee7de514c530e4b01a625a35660b58fa5e5444b923 2023-06-05T14:17:40.5053285Z 2023/06/05 14:17:40 PUT /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/blobs/uploads/2522934754633249055?digest=sha256%3A7a307a8a5bc9d4297bbb1784eaea28f96a4a62a6b0b80f92ce8c18663ae128d6 2023-06-05T14:17:40.5056020Z 2023/06/05 14:17:40 PUT /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/manifests/old 2023-06-05T14:17:40.5057622Z 2023/06/05 14:17:40 GET /v2/ 2023-06-05T14:17:40.5059469Z 2023/06/05 14:17:40 HEAD /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/manifests/latest 404 NAME_UNKNOWN Unknown name 2023-06-05T14:17:40.5061907Z 2023/06/05 14:17:40 HEAD /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/blobs/sha256:a189386b5f641591218efe6d3eec2b2e6bd90998b174cee74097a90b496b6fd8 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:40.5064476Z 2023/06/05 14:17:40 HEAD /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/blobs/sha256:ff11bcd0c2f92139ac29a72c57654704bfc87c782a9f8e4c683ba0107077f5d1 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:40.5066657Z 2023/06/05 14:17:40 POST /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/blobs/uploads/ 2023-06-05T14:17:40.5068422Z 2023/06/05 14:17:40 POST /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/blobs/uploads/ 2023-06-05T14:17:40.5070581Z 2023/06/05 14:17:40 PATCH /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/blobs/uploads/290267735222040835 2023-06-05T14:17:40.5072977Z 2023/06/05 14:17:40 PATCH /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/blobs/uploads/7706559633350675399 2023-06-05T14:17:40.5075547Z 2023/06/05 14:17:40 PUT /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/blobs/uploads/290267735222040835?digest=sha256%3Aa189386b5f641591218efe6d3eec2b2e6bd90998b174cee74097a90b496b6fd8 2023-06-05T14:17:40.5087171Z 2023/06/05 14:17:40 PUT /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/blobs/uploads/7706559633350675399?digest=sha256%3Aff11bcd0c2f92139ac29a72c57654704bfc87c782a9f8e4c683ba0107077f5d1 2023-06-05T14:17:40.5088282Z 2023/06/05 14:17:40 PUT /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/manifests/latest 2023-06-05T14:17:40.5088944Z === RUN TestPromotion/Package_promotion/Latest_package_version_is_promoted 2023-06-05T14:17:40.5089374Z 2023/06/05 14:17:40 GET /v2/ 2023-06-05T14:17:40.5090120Z 2023/06/05 14:17:40 GET /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/manifests/latest 2023-06-05T14:17:40.5090712Z === RUN TestPromotion/Package_promotion/Specified_package_version_is_promoted 2023-06-05T14:17:40.5091289Z === RUN TestPromotion/Package_promotion/All_repository_latest_packages_are_promoted 2023-06-05T14:17:40.5091929Z 2023/06/05 14:17:40 GET /v2/ 2023-06-05T14:17:40.5092260Z 2023/06/05 14:17:40 GET /v2/_catalog?n=1000 2023-06-05T14:17:40.5092603Z 2023/06/05 14:17:40 GET /v2/ 2023-06-05T14:17:40.5093280Z 2023/06/05 14:17:40 GET /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/manifests/latest 2023-06-05T14:17:40.5095127Z 2023/06/05 14:17:40 GET /v2/ 2023-06-05T14:17:40.5096343Z 2023/06/05 14:17:40 GET /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/registryforwarder/manifests/latest 2023-06-05T14:17:40.5097229Z === RUN TestPromotion/Package_promotion/Non-existent_package_is_not_promoted 2023-06-05T14:17:40.5097976Z 2023/06/05 14:17:40 GET /v2/ 2023-06-05T14:17:40.5098817Z 2023/06/05 14:17:40 GET /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/does-not-exist/manifests/latest 404 NAME_UNKNOWN Unknown name 2023-06-05T14:17:40.5099416Z === RUN TestPromotion/Package_promotion/Invalid_package_reference_returns_error 2023-06-05T14:17:40.5099945Z === RUN TestPromotion/Package_promotion/Failure_to_send_promotion_message_returns_error 2023-06-05T14:17:40.5100411Z 2023/06/05 14:17:40 GET /v2/ 2023-06-05T14:17:40.5100784Z 2023/06/05 14:17:40 GET /v2/_catalog?n=1000 2023-06-05T14:17:40.5101134Z 2023/06/05 14:17:40 GET /v2/ 2023-06-05T14:17:40.5101895Z 2023/06/05 14:17:40 GET /v2/16dd90f0/ret-edge-stage1-foreman/warehouse/lumper-controller/manifests/latest 2023-06-05T14:17:40.5102505Z --- PASS: TestPromotion (0.03s) 2023-06-05T14:17:40.5103078Z --- PASS: TestPromotion/Package_promotion (0.03s) 2023-06-05T14:17:40.5103724Z --- PASS: TestPromotion/Package_promotion/Latest_package_version_is_promoted (0.00s) 2023-06-05T14:17:40.5104525Z --- PASS: TestPromotion/Package_promotion/Specified_package_version_is_promoted (0.00s) 2023-06-05T14:17:40.5105416Z --- PASS: TestPromotion/Package_promotion/All_repository_latest_packages_are_promoted (0.00s) 2023-06-05T14:17:40.5106225Z --- PASS: TestPromotion/Package_promotion/Non-existent_package_is_not_promoted (0.00s) 2023-06-05T14:17:40.5106954Z --- PASS: TestPromotion/Package_promotion/Invalid_package_reference_returns_error (0.00s) 2023-06-05T14:17:40.5107665Z --- PASS: TestPromotion/Package_promotion/Failure_to_send_promotion_message_returns_error (0.00s) 2023-06-05T14:17:40.5108098Z PASS 2023-06-05T14:17:40.5108426Z ================================================================================ 2023-06-05T14:17:40.5467575Z INFO: From Testing //pkg/edge/gitops/fns/addnamespace:addnamespace_test: 2023-06-05T14:17:40.5468111Z ==================== Test output for //pkg/edge/gitops/fns/addnamespace:addnamespace_test: 2023-06-05T14:17:40.5468471Z === RUN TestAddNamespace 2023-06-05T14:17:40.5470405Z === RUN TestAddNamespace/testdata/existing-namespace 2023-06-05T14:17:40.5471107Z === RUN TestAddNamespace/testdata/new-namespace 2023-06-05T14:17:40.5471564Z --- PASS: TestAddNamespace (0.00s) 2023-06-05T14:17:40.5472106Z --- PASS: TestAddNamespace/testdata/existing-namespace (0.00s) 2023-06-05T14:17:40.5472739Z --- PASS: TestAddNamespace/testdata/new-namespace (0.00s) 2023-06-05T14:17:40.5473154Z === RUN TestUpdateNamespace 2023-06-05T14:17:40.5473692Z --- PASS: TestUpdateNamespace (0.00s) 2023-06-05T14:17:40.5474062Z === RUN TestConfigValidation 2023-06-05T14:17:40.5474471Z === RUN TestConfigValidation/Simple_valid_Config_Type:platform 2023-06-05T14:17:40.5475049Z === RUN TestConfigValidation/Simple_valid_Config_Type:ncr 2023-06-05T14:17:40.5475526Z === RUN TestConfigValidation/Simple_valid_Config_Type:tenant 2023-06-05T14:17:40.5475983Z === RUN TestConfigValidation/Invalid_Name_Config 2023-06-05T14:17:40.5476431Z === RUN TestConfigValidation/Invalid_Type_Config 2023-06-05T14:17:40.5476866Z === RUN TestConfigValidation/Invalid_Tenant_Config 2023-06-05T14:17:40.5477315Z === RUN TestConfigValidation/Invalid_Cluster_Config 2023-06-05T14:17:40.5477900Z --- PASS: TestConfigValidation (0.00s) 2023-06-05T14:17:40.5478506Z --- PASS: TestConfigValidation/Simple_valid_Config_Type:platform (0.00s) 2023-06-05T14:17:40.5479154Z --- PASS: TestConfigValidation/Simple_valid_Config_Type:ncr (0.00s) 2023-06-05T14:17:40.5479791Z --- PASS: TestConfigValidation/Simple_valid_Config_Type:tenant (0.00s) 2023-06-05T14:17:40.5480400Z --- PASS: TestConfigValidation/Invalid_Name_Config (0.00s) 2023-06-05T14:17:40.5480965Z --- PASS: TestConfigValidation/Invalid_Type_Config (0.00s) 2023-06-05T14:17:40.5481965Z --- PASS: TestConfigValidation/Invalid_Tenant_Config (0.00s) 2023-06-05T14:17:40.5482619Z --- PASS: TestConfigValidation/Invalid_Cluster_Config (0.00s) 2023-06-05T14:17:40.5483178Z PASS 2023-06-05T14:17:40.5483502Z ================================================================================ 2023-06-05T14:17:40.7219264Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/size:size_test: 2023-06-05T14:17:40.7219996Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/size:size_test: 2023-06-05T14:17:40.7220461Z === RUN TestAddSizeToNewIssue 2023-06-05T14:17:40.7220959Z {"severity":"info","ts":1685974660.6475396,"message":"cant add size to epic exiting addSizeToNewIssue"} 2023-06-05T14:17:40.7221537Z {"severity":"info","ts":1685974660.6477582,"message":"a size label already exists exiting"} 2023-06-05T14:17:40.7222770Z adding&{Labels:[kind/task] Assignees:[] Body:No relevant command here Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[kind/task triage/needs-size]{"severity":"info","ts":1685974660.6531925,"message":"command is not a valid size"} 2023-06-05T14:17:40.7224202Z adding&{Labels:[kind/task] Assignees:[] Body:This issue is of size extra medismell Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[kind/task triage/needs-size]{"severity":"info","ts":1685974660.6532793,"message":"command is not a valid size"} 2023-06-05T14:17:40.7226567Z adding&{Labels:[kind/task] Assignees:[] Body:This issue is of size medismell Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[kind/task triage/needs-size]adding&{Labels:[kind/task] Assignees:[] Body:This issue is of size extra large Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[kind/task size/xl]adding&{Labels:[kind/task] Assignees:[] Body:This issue is of size large Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}[kind/task size/l]--- PASS: TestAddSizeToNewIssue (0.01s) 2023-06-05T14:17:40.7227735Z === RUN TestAddLabel 2023-06-05T14:17:40.7228228Z editing{"severity":"info","ts":1685974660.6534612,"message":"not a valid size label exiting removelabel"} 2023-06-05T14:17:40.7228816Z editing{"severity":"info","ts":1685974660.6535072,"message":"size/s is a valid size command"} 2023-06-05T14:17:40.7229333Z {"severity":"info","ts":1685974660.653518,"message":"adding kind/task"} 2023-06-05T14:17:40.7229881Z editing--- PASS: TestAddLabel (0.00s) 2023-06-05T14:17:40.7230273Z === RUN TestRemoveLabel 2023-06-05T14:17:40.7230689Z {"severity":"info","ts":1685974660.653602,"message":"size/m"} 2023-06-05T14:17:40.7231151Z {"severity":"info","ts":1685974660.6536207,"message":"kind/feature"} 2023-06-05T14:17:40.7231627Z editing{"severity":"info","ts":1685974660.6536286,"message":"kind/task"} 2023-06-05T14:17:40.7232202Z {"severity":"info","ts":1685974660.6536317,"message":"not a valid size label exiting removelabel"} 2023-06-05T14:17:40.7232710Z {"severity":"info","ts":1685974660.6536372,"message":"size/m"} 2023-06-05T14:17:40.7233169Z {"severity":"info","ts":1685974660.6536398,"message":"Removed size label"} 2023-06-05T14:17:40.7233721Z editing--- PASS: TestRemoveLabel (0.00s) 2023-06-05T14:17:40.7234106Z === RUN TestCommentEvents 2023-06-05T14:17:40.7234565Z {"severity":"info","ts":1685974660.6537561,"message":"Running size plugin"} 2023-06-05T14:17:40.7235191Z {"severity":"info","ts":1685974660.6537657,"message":"handling a new size command from a comment: [small]"} 2023-06-05T14:17:40.7235798Z {"severity":"info","ts":1685974660.6537778,"message":"its an epic dont add a size label"} 2023-06-05T14:17:40.7236358Z creating comment{"severity":"info","ts":1685974660.6538105,"message":"Running size plugin"} 2023-06-05T14:17:40.7237008Z {"severity":"info","ts":1685974660.6538146,"message":"handling a new size command from a comment: [extra medismell]"} 2023-06-05T14:17:40.7237625Z {"severity":"info","ts":1685974660.653818,"message":"command is not a valid size"} 2023-06-05T14:17:40.7238131Z {"severity":"info","ts":1685974660.6538317,"message":"Running size plugin"} 2023-06-05T14:17:40.7239171Z {"severity":"info","ts":1685974660.653835,"message":"handling a new size command from a comment: [extra small]"} 2023-06-05T14:17:40.7239948Z {"severity":"info","ts":1685974660.6538393,"message":"size/xs label already exists. Exiting."} 2023-06-05T14:17:40.7240474Z {"severity":"info","ts":1685974660.6538765,"message":"Running size plugin"} 2023-06-05T14:17:40.7241036Z {"severity":"info","ts":1685974660.6538818,"message":"handling a new size command from a comment: [small]"} 2023-06-05T14:17:40.7241691Z editing--- PASS: TestCommentEvents (0.00s) 2023-06-05T14:17:40.7242048Z PASS 2023-06-05T14:17:40.7242373Z ================================================================================ 2023-06-05T14:17:40.8524763Z INFO: From Testing //pkg/f8n/devinfra/jack/plugin/pr:pr_test: 2023-06-05T14:17:40.8525437Z ==================== Test output for //pkg/f8n/devinfra/jack/plugin/pr:pr_test: 2023-06-05T14:17:40.8525836Z === RUN TestDraftPR 2023-06-05T14:17:40.8526261Z {"severity":"info","ts":1685974660.831304,"message":"Running PR plugin"} 2023-06-05T14:17:40.8526779Z {"severity":"info","ts":1685974660.8313506,"message":"PR is draft, not assigning users"} 2023-06-05T14:17:40.8527370Z --- PASS: TestDraftPR (0.00s) 2023-06-05T14:17:40.8530485Z === RUN TestReviewerAuthor 2023-06-05T14:17:40.8533646Z {"severity":"info","ts":1685974660.8314579,"message":"Running PR plugin"} 2023-06-05T14:17:40.8536746Z {"severity":"info","ts":1685974660.8314626,"message":"reviewer is author"} 2023-06-05T14:17:40.8539884Z --- PASS: TestReviewerAuthor (0.00s) 2023-06-05T14:17:40.8542734Z === RUN TestRequestedReviewers 2023-06-05T14:17:40.8546638Z {"severity":"info","ts":1685974660.8315308,"message":"Running PR plugin"} 2023-06-05T14:17:40.8549007Z {"severity":"info","ts":1685974660.8315341,"message":"Reviewer is not in requested review list"} 2023-06-05T14:17:40.8550646Z --- PASS: TestRequestedReviewers (0.00s) 2023-06-05T14:17:40.8551117Z === RUN TestAuthorAssoc 2023-06-05T14:17:40.8551594Z {"severity":"info","ts":1685974660.8317518,"message":"Running PR plugin"} 2023-06-05T14:17:40.8552261Z {"severity":"info","ts":1685974660.8317657,"message":"Ignoring review from non contributor, non owner, or non collaborator"} 2023-06-05T14:17:40.8552747Z --- PASS: TestAuthorAssoc (0.00s) 2023-06-05T14:17:40.8552978Z === RUN TestAddAssignees 2023-06-05T14:17:40.8553228Z {"severity":"info","ts":1685974660.8318057,"message":"Running PR plugin"} 2023-06-05T14:17:40.8565659Z adding assignee&{Labels:[] Assignees:[] Body: Comments:0 ID:0 RelatedIssue:github.Issue{} Milestone:}{"severity":"info","ts":1685974660.8327298,"message":"Added assignment from review"} 2023-06-05T14:17:40.8566200Z --- PASS: TestAddAssignees (0.00s) 2023-06-05T14:17:40.8566430Z PASS 2023-06-05T14:17:40.8566626Z ================================================================================ 2023-06-05T14:17:40.9409204Z INFO: From Testing //pkg/edge/api/graph/mapper:mapper_test: 2023-06-05T14:17:40.9409724Z ==================== Test output for //pkg/edge/api/graph/mapper:mapper_test: 2023-06-05T14:17:40.9410177Z === RUN TestToHelmRepositoriesModel 2023-06-05T14:17:40.9412447Z --- PASS: TestToHelmRepositoriesModel (0.00s) 2023-06-05T14:17:40.9413008Z === RUN TestToHelmReleasesModels 2023-06-05T14:17:40.9413592Z --- PASS: TestToHelmReleasesModels (0.00s) 2023-06-05T14:17:40.9414090Z === RUN TestToHelmReleasesStatusModels 2023-06-05T14:17:40.9414688Z --- PASS: TestToHelmReleasesStatusModels (0.00s) 2023-06-05T14:17:40.9415237Z === RUN TestToHelmStatusTrue 2023-06-05T14:17:40.9415701Z --- PASS: TestToHelmStatusTrue (0.00s) 2023-06-05T14:17:40.9416094Z === RUN TestToHelmStatusFail 2023-06-05T14:17:40.9417023Z --- PASS: TestToHelmStatusFail (0.00s) 2023-06-05T14:17:40.9417530Z === RUN TestToCreateHelmReleaseNil 2023-06-05T14:17:40.9418070Z --- PASS: TestToCreateHelmReleaseNil (0.00s) 2023-06-05T14:17:40.9418371Z === RUN TestToCreateHelmReleaseNamespace 2023-06-05T14:17:40.9418849Z --- PASS: TestToCreateHelmReleaseNamespace (0.00s) 2023-06-05T14:17:40.9419794Z === RUN TestToCreateHelmReleaseNamespaceConvertConfigMap 2023-06-05T14:17:40.9420686Z --- PASS: TestToCreateHelmReleaseNamespaceConvertConfigMap (0.00s) 2023-06-05T14:17:40.9421507Z === RUN TestToHelmChartResponse 2023-06-05T14:17:40.9422067Z --- PASS: TestToHelmChartResponse (0.00s) 2023-06-05T14:17:40.9422515Z === RUN TestConvertToConfigMap 2023-06-05T14:17:40.9423435Z --- PASS: TestConvertToConfigMap (0.00s) 2023-06-05T14:17:40.9424055Z === RUN TestUpdateHelmWorkload 2023-06-05T14:17:40.9424985Z --- PASS: TestUpdateHelmWorkload (0.00s) 2023-06-05T14:17:40.9425709Z === RUN TestToCreateHelmReleasePostRendererPatchStrings 2023-06-05T14:17:40.9426595Z === RUN TestToCreateHelmReleasePostRendererPatchStrings/installationTypeServerPreferred 2023-06-05T14:17:40.9427456Z === RUN TestToCreateHelmReleasePostRendererPatchStrings/installationTypeAny 2023-06-05T14:17:40.9428253Z === RUN TestToCreateHelmReleasePostRendererPatchStrings/installationTypeTouchPoint 2023-06-05T14:17:40.9429007Z === RUN TestToCreateHelmReleasePostRendererPatchStrings/installationTypeServer 2023-06-05T14:17:40.9430361Z === RUN TestToCreateHelmReleasePostRendererPatchStrings/installationTypeNoMod 2023-06-05T14:17:40.9432390Z --- PASS: TestToCreateHelmReleasePostRendererPatchStrings (0.00s) 2023-06-05T14:17:40.9434315Z --- PASS: TestToCreateHelmReleasePostRendererPatchStrings/installationTypeServerPreferred (0.00s) 2023-06-05T14:17:40.9436326Z --- PASS: TestToCreateHelmReleasePostRendererPatchStrings/installationTypeAny (0.00s) 2023-06-05T14:17:40.9438144Z --- PASS: TestToCreateHelmReleasePostRendererPatchStrings/installationTypeTouchPoint (0.00s) 2023-06-05T14:17:40.9440013Z --- PASS: TestToCreateHelmReleasePostRendererPatchStrings/installationTypeServer (0.00s) 2023-06-05T14:17:40.9441855Z --- PASS: TestToCreateHelmReleasePostRendererPatchStrings/installationTypeNoMod (0.00s) 2023-06-05T14:17:40.9443422Z === RUN TestToCreateHelmReleasePostRendererPatchTargets 2023-06-05T14:17:40.9445076Z === RUN TestToCreateHelmReleasePostRendererPatchTargets/installationTypeServerPreferred 2023-06-05T14:17:40.9446821Z === RUN TestToCreateHelmReleasePostRendererPatchTargets/installationTypeAny 2023-06-05T14:17:40.9448459Z === RUN TestToCreateHelmReleasePostRendererPatchTargets/installationTypeTouchPoint 2023-06-05T14:17:40.9450872Z === RUN TestToCreateHelmReleasePostRendererPatchTargets/installationTypeServer 2023-06-05T14:17:40.9452721Z === RUN TestToCreateHelmReleasePostRendererPatchTargets/installationTypeNoMod 2023-06-05T14:17:40.9454533Z --- PASS: TestToCreateHelmReleasePostRendererPatchTargets (0.00s) 2023-06-05T14:17:40.9456511Z --- PASS: TestToCreateHelmReleasePostRendererPatchTargets/installationTypeServerPreferred (0.00s) 2023-06-05T14:17:40.9458398Z --- PASS: TestToCreateHelmReleasePostRendererPatchTargets/installationTypeAny (0.00s) 2023-06-05T14:17:40.9460270Z --- PASS: TestToCreateHelmReleasePostRendererPatchTargets/installationTypeTouchPoint (0.00s) 2023-06-05T14:17:40.9462185Z --- PASS: TestToCreateHelmReleasePostRendererPatchTargets/installationTypeServer (0.00s) 2023-06-05T14:17:40.9464089Z --- PASS: TestToCreateHelmReleasePostRendererPatchTargets/installationTypeNoMod (0.00s) 2023-06-05T14:17:40.9465651Z === RUN TestToBSLSiteNoContactPhoneNumberFields 2023-06-05T14:17:40.9467267Z --- PASS: TestToBSLSiteNoContactPhoneNumberFields (0.00s) 2023-06-05T14:17:40.9468767Z === RUN TestToBSLSiteNoContactPersonFields 2023-06-05T14:17:40.9486393Z --- PASS: TestToBSLSiteNoContactPersonFields (0.00s) 2023-06-05T14:17:40.9486898Z === RUN TestToBSLSiteFullFields 2023-06-05T14:17:40.9487408Z --- PASS: TestToBSLSiteFullFields (0.00s) 2023-06-05T14:17:40.9487842Z === RUN TestToBSLSite2MissingFields 2023-06-05T14:17:40.9488387Z --- PASS: TestToBSLSite2MissingFields (0.00s) 2023-06-05T14:17:40.9488840Z === RUN TestToServiceAccountNotEmpty 2023-06-05T14:17:40.9489420Z --- PASS: TestToServiceAccountNotEmpty (0.00s) 2023-06-05T14:17:40.9489894Z === RUN TestToServiceAccountIsIncorrect 2023-06-05T14:17:40.9490905Z --- PASS: TestToServiceAccountIsIncorrect (0.00s) 2023-06-05T14:17:40.9491344Z === RUN TestToZones 2023-06-05T14:17:40.9492198Z --- PASS: TestToZones (0.00s) 2023-06-05T14:17:40.9492546Z === RUN TestToMachineTypes 2023-06-05T14:17:40.9492990Z --- PASS: TestToMachineTypes (0.00s) 2023-06-05T14:17:40.9493369Z === RUN TestToGkeVersions 2023-06-05T14:17:40.9493837Z --- PASS: TestToGkeVersions (0.00s) 2023-06-05T14:17:40.9494248Z === RUN TestToDeleteBannerRequest 2023-06-05T14:17:40.9494751Z --- PASS: TestToDeleteBannerRequest (0.00s) 2023-06-05T14:17:40.9495190Z === RUN TestToDeleteClusterRequest 2023-06-05T14:17:40.9495811Z --- PASS: TestToDeleteClusterRequest (0.00s) 2023-06-05T14:17:40.9496271Z === RUN TestToClusterAndFleetType 2023-06-05T14:17:40.9496812Z --- PASS: TestToClusterAndFleetType (0.00s) 2023-06-05T14:17:40.9497235Z === RUN TestToCreateNamespace 2023-06-05T14:17:40.9497733Z --- PASS: TestToCreateNamespace (0.00s) 2023-06-05T14:17:40.9498166Z === RUN TestToListOptions 2023-06-05T14:17:40.9498619Z --- PASS: TestToListOptions (0.00s) 2023-06-05T14:17:40.9499031Z === RUN TestToEnterpriseUnitData 2023-06-05T14:17:40.9499570Z --- PASS: TestToEnterpriseUnitData (0.00s) 2023-06-05T14:17:40.9500010Z === RUN TestToEdgeResponsePayload 2023-06-05T14:17:40.9500517Z --- PASS: TestToEdgeResponsePayload (0.00s) 2023-06-05T14:17:40.9500931Z === RUN TestEUsToOrganizations 2023-06-05T14:17:40.9501458Z --- PASS: TestEUsToOrganizations (0.00s) 2023-06-05T14:17:40.9501929Z === RUN TestSubOrgsToOrganizations 2023-06-05T14:17:40.9502515Z --- PASS: TestSubOrgsToOrganizations (0.00s) 2023-06-05T14:17:40.9502921Z === RUN TestSubOrgToBanner 2023-06-05T14:17:40.9503435Z --- PASS: TestSubOrgToBanner (0.00s) 2023-06-05T14:17:40.9503797Z === RUN TestEUToBanner 2023-06-05T14:17:40.9504224Z --- PASS: TestEUToBanner (0.00s) 2023-06-05T14:17:40.9504623Z === RUN TestUserAssignedOrgsToBanners 2023-06-05T14:17:40.9505171Z --- PASS: TestUserAssignedOrgsToBanners (0.00s) 2023-06-05T14:17:40.9505639Z === RUN TestUserAssignedOrgToBanner 2023-06-05T14:17:40.9506225Z --- PASS: TestUserAssignedOrgToBanner (0.00s) 2023-06-05T14:17:40.9506672Z === RUN TestToRoleData 2023-06-05T14:17:40.9507101Z --- PASS: TestToRoleData (0.00s) 2023-06-05T14:17:40.9507459Z === RUN TestToSecrets 2023-06-05T14:17:40.9507886Z --- PASS: TestToSecrets (0.00s) 2023-06-05T14:17:40.9508281Z === RUN TestToCreateSecretObject 2023-06-05T14:17:40.9508769Z --- PASS: TestToCreateSecretObject (0.00s) 2023-06-05T14:17:40.9509248Z === RUN TestToConvertSecretToUnstructured 2023-06-05T14:17:40.9509845Z --- PASS: TestToConvertSecretToUnstructured (0.00s) 2023-06-05T14:17:40.9510365Z === RUN TestToConvertUnstructuredToSecret 2023-06-05T14:17:40.9510938Z --- PASS: TestToConvertUnstructuredToSecret (0.00s) 2023-06-05T14:17:40.9511452Z === RUN TestToBuildSecretRedactedTrue 2023-06-05T14:17:40.9512034Z --- PASS: TestToBuildSecretRedactedTrue (0.00s) 2023-06-05T14:17:40.9512534Z === RUN TestToBuildSecretRedactedFalse 2023-06-05T14:17:40.9513126Z --- PASS: TestToBuildSecretRedactedFalse (0.00s) 2023-06-05T14:17:40.9513663Z === RUN TestToConvertUnstructuredToNode 2023-06-05T14:17:40.9514248Z --- PASS: TestToConvertUnstructuredToNode (0.00s) 2023-06-05T14:17:40.9514726Z === RUN TestToStoreClusterStatus 2023-06-05T14:17:40.9515248Z --- PASS: TestToStoreClusterStatus (0.00s) 2023-06-05T14:17:40.9515689Z === RUN TestFirstNodeBootstrapConfig 2023-06-05T14:17:40.9516323Z --- PASS: TestFirstNodeBootstrapConfig (0.00s) 2023-06-05T14:17:40.9516826Z === RUN TestSecondNodeBootstrapConfig 2023-06-05T14:17:40.9517419Z --- PASS: TestSecondNodeBootstrapConfig (0.00s) 2023-06-05T14:17:40.9517908Z === RUN TestTerminalToIENodeWithoutDHCP 2023-06-05T14:17:40.9518472Z --- PASS: TestTerminalToIENodeWithoutDHCP (0.00s) 2023-06-05T14:17:40.9518945Z === RUN TestTerminalToIENodeWithDHCP 2023-06-05T14:17:40.9519517Z --- PASS: TestTerminalToIENodeWithDHCP (0.00s) 2023-06-05T14:17:40.9520000Z === RUN TestTerminalToIENodeWithoutAddress 2023-06-05T14:17:40.9521022Z --- PASS: TestTerminalToIENodeWithoutAddress (0.00s) 2023-06-05T14:17:40.9521480Z === RUN TestToCreateUserRequest 2023-06-05T14:17:40.9522229Z --- PASS: TestToCreateUserRequest (0.00s) 2023-06-05T14:17:40.9522705Z === RUN TestDeploymentToLivenessReadinessResponse 2023-06-05T14:17:40.9523413Z --- PASS: TestDeploymentToLivenessReadinessResponse (0.00s) 2023-06-05T14:17:40.9523992Z === RUN TestStatefulSetToLivenessReadinessResponse 2023-06-05T14:17:40.9524636Z --- PASS: TestStatefulSetToLivenessReadinessResponse (0.00s) 2023-06-05T14:17:40.9525279Z === RUN TestDeploymentToLivenessReadinessResponseDaemonSet 2023-06-05T14:17:40.9526124Z --- PASS: TestDeploymentToLivenessReadinessResponseDaemonSet (0.00s) 2023-06-05T14:17:40.9526671Z === RUN TestUnstructuredToPodsList 2023-06-05T14:17:40.9527204Z --- PASS: TestUnstructuredToPodsList (0.00s) 2023-06-05T14:17:40.9527671Z === RUN TestUnstructuredToDeploymentList 2023-06-05T14:17:40.9528252Z --- PASS: TestUnstructuredToDeploymentList (0.00s) 2023-06-05T14:17:40.9528800Z === RUN TestUnstructuredToStatefulSetList 2023-06-05T14:17:40.9529377Z --- PASS: TestUnstructuredToStatefulSetList (0.00s) 2023-06-05T14:17:40.9529911Z === RUN TestUnstructuredToDaemonSetList 2023-06-05T14:17:40.9530507Z --- PASS: TestUnstructuredToDaemonSetList (0.00s) 2023-06-05T14:17:40.9530993Z === RUN TestUnstructuredToObjectDeployment 2023-06-05T14:17:40.9531801Z --- PASS: TestUnstructuredToObjectDeployment (0.00s) 2023-06-05T14:17:40.9532355Z === RUN TestUnstructuredToObjectStatefulSet 2023-06-05T14:17:40.9533029Z --- PASS: TestUnstructuredToObjectStatefulSet (0.00s) 2023-06-05T14:17:40.9533544Z === RUN TestUnstructuredToObjectDaemonSet 2023-06-05T14:17:40.9534168Z --- PASS: TestUnstructuredToObjectDaemonSet (0.00s) 2023-06-05T14:17:40.9534592Z PASS 2023-06-05T14:17:40.9534925Z ================================================================================ 2023-06-05T14:17:41.2552719Z INFO: From Testing //pkg/k8s/object:object_test: 2023-06-05T14:17:41.2553345Z ==================== Test output for //pkg/k8s/object:object_test: 2023-06-05T14:17:41.2553815Z === RUN TestCmpMaskData 2023-06-05T14:17:41.2554158Z === PAUSE TestCmpMaskData 2023-06-05T14:17:41.2554497Z === RUN TestReadObjects_DropsInvalid 2023-06-05T14:17:41.2554898Z === PAUSE TestReadObjects_DropsInvalid 2023-06-05T14:17:41.2555244Z === RUN TestIsDeleted 2023-06-05T14:17:41.2555595Z === PAUSE TestIsDeleted 2023-06-05T14:17:41.2555908Z === RUN TestFmtObject 2023-06-05T14:17:41.2556227Z === PAUSE TestFmtObject 2023-06-05T14:17:41.2556609Z === RUN TestGetStatusObservedGeneration 2023-06-05T14:17:41.2557310Z --- PASS: TestGetStatusObservedGeneration (0.00s) 2023-06-05T14:17:41.2557787Z === RUN TestGetRequeueInterval 2023-06-05T14:17:41.2558310Z --- PASS: TestGetRequeueInterval (0.00s) 2023-06-05T14:17:41.2558701Z === CONT TestCmpMaskData 2023-06-05T14:17:41.2559064Z === RUN TestCmpMaskData/empty 2023-06-05T14:17:41.2559456Z === PAUSE TestCmpMaskData/empty 2023-06-05T14:17:41.2559844Z === RUN TestCmpMaskData/no_change 2023-06-05T14:17:41.2560197Z === PAUSE TestCmpMaskData/no_change 2023-06-05T14:17:41.2560550Z === RUN TestCmpMaskData/simple_value_changed 2023-06-05T14:17:41.2560958Z === PAUSE TestCmpMaskData/simple_value_changed 2023-06-05T14:17:41.2561412Z === RUN TestCmpMaskData/simple_value_changed_with_different_casing 2023-06-05T14:17:41.2561971Z === PAUSE TestCmpMaskData/simple_value_changed_with_different_casing 2023-06-05T14:17:41.2562473Z === RUN TestCmpMaskData/value_changed_with_different_casing_and_different_values 2023-06-05T14:17:41.2563022Z === PAUSE TestCmpMaskData/value_changed_with_different_casing_and_different_values 2023-06-05T14:17:41.2563462Z === CONT TestCmpMaskData/empty 2023-06-05T14:17:41.2563818Z === CONT TestFmtObject 2023-06-05T14:17:41.2564112Z === RUN TestFmtObject/Namespaced 2023-06-05T14:17:41.2564447Z === PAUSE TestFmtObject/Namespaced 2023-06-05T14:17:41.2564808Z === RUN TestFmtObject/Cluster 2023-06-05T14:17:41.2565148Z === PAUSE TestFmtObject/Cluster 2023-06-05T14:17:41.2566003Z === CONT TestFmtObject/Namespaced 2023-06-05T14:17:41.2566396Z === CONT TestIsDeleted 2023-06-05T14:17:41.2567012Z === RUN TestIsDeleted/Marked_for_deletion_no_error 2023-06-05T14:17:41.2567469Z === PAUSE TestIsDeleted/Marked_for_deletion_no_error 2023-06-05T14:17:41.2567854Z === RUN TestIsDeleted/Marked_for_deletion_error_IsGone 2023-06-05T14:17:41.2568264Z === PAUSE TestIsDeleted/Marked_for_deletion_error_IsGone 2023-06-05T14:17:41.2568701Z === RUN TestIsDeleted/Marked_for_deletion_error_IsNotFound 2023-06-05T14:17:41.2569130Z === PAUSE TestIsDeleted/Marked_for_deletion_error_IsNotFound 2023-06-05T14:17:41.2569557Z === RUN TestIsDeleted/Error_IsGone 2023-06-05T14:17:41.2569960Z === PAUSE TestIsDeleted/Error_IsGone 2023-06-05T14:17:41.2570403Z === RUN TestIsDeleted/Error_IsNotFound 2023-06-05T14:17:41.2570828Z === PAUSE TestIsDeleted/Error_IsNotFound 2023-06-05T14:17:41.2571235Z === RUN TestIsDeleted/Not_deleted 2023-06-05T14:17:41.2571815Z === PAUSE TestIsDeleted/Not_deleted 2023-06-05T14:17:41.2572290Z === CONT TestIsDeleted/Marked_for_deletion_no_error 2023-06-05T14:17:41.2572748Z === CONT TestReadObjects_DropsInvalid 2023-06-05T14:17:41.2573187Z === RUN TestReadObjects_DropsInvalid/valid_resources 2023-06-05T14:17:41.2573674Z === PAUSE TestReadObjects_DropsInvalid/valid_resources 2023-06-05T14:17:41.2574156Z === RUN TestReadObjects_DropsInvalid/some_invalid_resources 2023-06-05T14:17:41.2574635Z === PAUSE TestReadObjects_DropsInvalid/some_invalid_resources 2023-06-05T14:17:41.2575078Z === CONT TestReadObjects_DropsInvalid/valid_resources 2023-06-05T14:17:41.2575574Z === CONT TestCmpMaskData/value_changed_with_different_casing_and_different_values 2023-06-05T14:17:41.2576116Z === CONT TestCmpMaskData/simple_value_changed_with_different_casing 2023-06-05T14:17:41.2576552Z === CONT TestCmpMaskData/simple_value_changed 2023-06-05T14:17:41.2576963Z === CONT TestCmpMaskData/no_change 2023-06-05T14:17:41.2577632Z --- PASS: TestCmpMaskData (0.00s) 2023-06-05T14:17:41.2578112Z --- PASS: TestCmpMaskData/empty (0.00s) 2023-06-05T14:17:41.2578726Z --- PASS: TestCmpMaskData/value_changed_with_different_casing_and_different_values (0.00s) 2023-06-05T14:17:41.2579413Z --- PASS: TestCmpMaskData/simple_value_changed_with_different_casing (0.00s) 2023-06-05T14:17:41.2580051Z --- PASS: TestCmpMaskData/simple_value_changed (0.00s) 2023-06-05T14:17:41.2580508Z --- PASS: TestCmpMaskData/no_change (0.00s) 2023-06-05T14:17:41.2580905Z === CONT TestFmtObject/Cluster 2023-06-05T14:17:41.2581371Z --- PASS: TestFmtObject (0.00s) 2023-06-05T14:17:41.2581946Z --- PASS: TestFmtObject/Namespaced (0.00s) 2023-06-05T14:17:41.2582488Z --- PASS: TestFmtObject/Cluster (0.00s) 2023-06-05T14:17:41.2582879Z === CONT TestIsDeleted/Not_deleted 2023-06-05T14:17:41.2583216Z === CONT TestIsDeleted/Error_IsNotFound 2023-06-05T14:17:41.2583632Z === CONT TestIsDeleted/Error_IsGone 2023-06-05T14:17:41.2583907Z === CONT TestIsDeleted/Marked_for_deletion_error_IsNotFound 2023-06-05T14:17:41.2584291Z === CONT TestIsDeleted/Marked_for_deletion_error_IsGone 2023-06-05T14:17:41.2584760Z --- PASS: TestIsDeleted (0.00s) 2023-06-05T14:17:41.2585239Z --- PASS: TestIsDeleted/Marked_for_deletion_no_error (0.00s) 2023-06-05T14:17:41.2585753Z --- PASS: TestIsDeleted/Not_deleted (0.00s) 2023-06-05T14:17:41.2586275Z --- PASS: TestIsDeleted/Error_IsNotFound (0.00s) 2023-06-05T14:17:41.2586835Z --- PASS: TestIsDeleted/Error_IsGone (0.00s) 2023-06-05T14:17:41.2587467Z --- PASS: TestIsDeleted/Marked_for_deletion_error_IsNotFound (0.00s) 2023-06-05T14:17:41.2588142Z --- PASS: TestIsDeleted/Marked_for_deletion_error_IsGone (0.00s) 2023-06-05T14:17:41.2588686Z === CONT TestReadObjects_DropsInvalid/some_invalid_resources 2023-06-05T14:17:41.2589255Z --- PASS: TestReadObjects_DropsInvalid (0.00s) 2023-06-05T14:17:41.2589876Z --- PASS: TestReadObjects_DropsInvalid/valid_resources (0.00s) 2023-06-05T14:17:41.2590555Z --- PASS: TestReadObjects_DropsInvalid/some_invalid_resources (0.00s) 2023-06-05T14:17:41.2591537Z PASS 2023-06-05T14:17:41.2591940Z ================================================================================ 2023-06-05T14:17:41.7817676Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/remoteagentconfig:remoteagentconfig_test: 2023-06-05T14:17:41.7818529Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/remoteagentconfig:remoteagentconfig_test: 2023-06-05T14:17:41.7819086Z === RUN TestGetTerminalID 2023-06-05T14:17:41.7819582Z --- PASS: TestGetTerminalID (0.00s) 2023-06-05T14:17:41.7819987Z === RUN TestGetTerminalIDError 2023-06-05T14:17:41.7820502Z --- PASS: TestGetTerminalIDError (0.00s) 2023-06-05T14:17:41.7820964Z === RUN TestIsTargetConfigMap 2023-06-05T14:17:41.7821474Z --- PASS: TestIsTargetConfigMap (0.00s) 2023-06-05T14:17:41.7821855Z === RUN TestWrongName 2023-06-05T14:17:41.7822269Z --- PASS: TestWrongName (0.00s) 2023-06-05T14:17:41.7822655Z === RUN TestWrongNamespace 2023-06-05T14:17:41.7823138Z --- PASS: TestWrongNamespace (0.00s) 2023-06-05T14:17:41.7823584Z === RUN TestUpdateRemoteAgentConfig 2023-06-05T14:17:41.7824043Z remoteagentconfig_test.go:161: PASS: Read(string) 2023-06-05T14:17:41.7824611Z remoteagentconfig_test.go:161: PASS: SafeWrite(string,string,[]uint8,fs.FileMode) 2023-06-05T14:17:41.7825341Z --- PASS: TestUpdateRemoteAgentConfig (0.00s) 2023-06-05T14:17:41.7825796Z === RUN TestUpdatesOldFile 2023-06-05T14:17:41.7826266Z remoteagentconfig_test.go:186: PASS: Read(string) 2023-06-05T14:17:41.7826865Z remoteagentconfig_test.go:186: PASS: SafeWrite(string,string,[]uint8,fs.FileMode) 2023-06-05T14:17:41.7827435Z --- PASS: TestUpdatesOldFile (0.00s) 2023-06-05T14:17:41.7827888Z === RUN TestDoesntUpdateExistingConfig 2023-06-05T14:17:41.7828362Z remoteagentconfig_test.go:209: PASS: Read(string) 2023-06-05T14:17:41.7828946Z --- PASS: TestDoesntUpdateExistingConfig (0.00s) 2023-06-05T14:17:41.7829397Z === RUN TestMissingTemplate 2023-06-05T14:17:41.7829875Z --- PASS: TestMissingTemplate (0.00s) 2023-06-05T14:17:41.7830226Z PASS 2023-06-05T14:17:41.7830571Z ================================================================================ 2023-06-05T14:17:42.8832706Z INFO: From Testing //pkg/sds/k8s/controllers/resiliencemanager/pkg/certs:certs_test: 2023-06-05T14:17:42.8833341Z ==================== Test output for //pkg/sds/k8s/controllers/resiliencemanager/pkg/certs:certs_test: 2023-06-05T14:17:42.8834187Z === RUN TestGencerts 2023-06-05T14:17:42.8835250Z --- PASS: TestGencerts (0.00s) 2023-06-05T14:17:42.8835634Z PASS 2023-06-05T14:17:42.8836072Z ================================================================================ 2023-06-05T14:17:43.3451966Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/applynodelabels:applynodelabels_test: 2023-06-05T14:17:43.3452801Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/applynodelabels:applynodelabels_test: 2023-06-05T14:17:43.3453286Z === RUN TestReconcile 2023-06-05T14:17:43.3453776Z --- PASS: TestReconcile (0.02s) 2023-06-05T14:17:43.3454191Z === RUN TestUpdateHostNodeLabels 2023-06-05T14:17:43.3454675Z --- PASS: TestUpdateHostNodeLabels (0.02s) 2023-06-05T14:17:43.3455077Z === RUN TestGetTargetLabelsFromIEN 2023-06-05T14:17:43.3455552Z --- PASS: TestGetTargetLabelsFromIEN (0.00s) 2023-06-05T14:17:43.3455951Z === RUN TestGetUpdatedNodeLabels 2023-06-05T14:17:43.3456459Z --- PASS: TestGetUpdatedNodeLabels (0.00s) 2023-06-05T14:17:43.3456914Z === RUN TestApplyPatchToNode 2023-06-05T14:17:43.3457232Z --- PASS: TestApplyPatchToNode (0.02s) 2023-06-05T14:17:43.3457485Z === RUN TestGetUpdateLabelsPatch 2023-06-05T14:17:43.3457790Z --- PASS: TestGetUpdateLabelsPatch (0.00s) 2023-06-05T14:17:43.3457997Z PASS 2023-06-05T14:17:43.3458205Z ================================================================================ 2023-06-05T14:17:44.1200112Z INFO: From Testing //pkg/edge/webhooks/edge-injector:edge-injector_test: 2023-06-05T14:17:44.1201500Z ==================== Test output for //pkg/edge/webhooks/edge-injector:edge-injector_test: 2023-06-05T14:17:44.1202352Z === RUN TestCommonLabels 2023-06-05T14:17:44.1202910Z --- PASS: TestCommonLabels (0.00s) 2023-06-05T14:17:44.1203292Z === RUN TestOtherLabels 2023-06-05T14:17:44.1203787Z --- PASS: TestOtherLabels (0.00s) 2023-06-05T14:17:44.1204168Z === RUN TestInjectSecretDirect 2023-06-05T14:17:44.1205473Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"handling secret label for pod","level":0,"logging.googleapis.com/sourceLocation":{"function":"edge-infra.dev/pkg/edge/webhooks/edge-injector.InjectSecret","file":"pkg/edge/webhooks/edge-injector/pod_injector.go","line":17}} 2023-06-05T14:17:44.1207518Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"injected secret label unto pod","secretName":"couchdb-secret-942ea513-72bb-41f1-b44c-a39faeb2ffd3","logging.googleapis.com/sourceLocation":{"function":"edge-infra.dev/pkg/edge/webhooks/edge-injector.InjectSecret","file":"pkg/edge/webhooks/edge-injector/pod_injector.go","line":22}} 2023-06-05T14:17:44.1209148Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"injected secret name env unto pod","secretName":"couchdb-secret-942ea513-72bb-41f1-b44c-a39faeb2ffd3","injection type":"direct","logging.googleapis.com/sourceLocation":{"function":"edge-infra.dev/pkg/edge/webhooks/edge-injector.InjectSecret","file":"pkg/edge/webhooks/edge-injector/pod_injector.go","line":31}} 2023-06-05T14:17:44.1210264Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"handling secret label for pod","level":0,"logging.googleapis.com/sourceLocation":{"function":"edge-infra.dev/pkg/edge/webhooks/edge-injector.InjectSecret","file":"pkg/edge/webhooks/edge-injector/pod_injector.go","line":17}} 2023-06-05T14:17:44.1211626Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"injected secret label unto pod","secretName":"node-secret-57e9786a-e146-4e58-9a53-b1e0a88487a4","logging.googleapis.com/sourceLocation":{"function":"edge-infra.dev/pkg/edge/webhooks/edge-injector.InjectSecret","file":"pkg/edge/webhooks/edge-injector/pod_injector.go","line":22}} 2023-06-05T14:17:44.1212912Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"injected secret name env unto pod","secretName":"node-secret-57e9786a-e146-4e58-9a53-b1e0a88487a4","injection type":"direct","logging.googleapis.com/sourceLocation":{"function":"edge-infra.dev/pkg/edge/webhooks/edge-injector.InjectSecret","file":"pkg/edge/webhooks/edge-injector/pod_injector.go","line":31}} 2023-06-05T14:17:44.1213649Z --- PASS: TestInjectSecretDirect (0.00s) 2023-06-05T14:17:44.1214013Z === RUN TestCouchDBUserSecret 2023-06-05T14:17:44.1214826Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"Starting EventSource","level":-1,"controller":"pod","controllerGroup":"","controllerKind":"Pod","source":"kind source: *v1.Pod"} 2023-06-05T14:17:44.1215718Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"Starting Controller","level":-1,"controller":"pod","controllerGroup":"","controllerKind":"Pod","level":0} 2023-06-05T14:17:44.1216443Z ktest.go:115: creating namespace testcouchdbusersecret-5109ff32 2023-06-05T14:17:44.1216943Z === RUN TestCouchDBUserSecret/CouchDBUser_Secret 2023-06-05T14:17:44.1217417Z === RUN TestCouchDBUserSecret/CouchDBUser_Secret/Pod_Created 2023-06-05T14:17:44.1217918Z === RUN TestCouchDBUserSecret/CouchDBUser_Secret/Pod_Updated 2023-06-05T14:17:44.1218475Z === RUN TestCouchDBUserSecret/CouchDBUser_Secret/CouchDB_Secret_Created 2023-06-05T14:17:44.1219465Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"Starting workers","level":-1,"controller":"pod","controllerGroup":"","controllerKind":"Pod","worker count":1} 2023-06-05T14:17:44.1220493Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"reconciling for pod secret","level":-1,"name":"podsecretreconciler","pod":"testcouchdbusersecret-5109ff32/couchdb-user-5109ff32","level":0} 2023-06-05T14:17:44.1222392Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"successfully created couchdb user","level":-1,"name":"podsecretreconciler","pod":"testcouchdbusersecret-5109ff32/couchdb-user-5109ff32","level":-1,"nodeName":"node-5109ff32","secretName":"couchdb-secret-5109ff32","level":0} 2023-06-05T14:17:44.1224060Z {"severity":"INFO","time":"2023-06-05T14:17:40Z","message":"Successfully reconcile secret","level":-1,"name":"podsecretreconciler","pod":"testcouchdbusersecret-5109ff32/couchdb-user-5109ff32","level":-1,"nodeName":"node-5109ff32","secretName":"couchdb-secret-5109ff32","level":0} 2023-06-05T14:17:44.1225004Z --- PASS: TestCouchDBUserSecret (1.11s) 2023-06-05T14:17:44.1225548Z --- PASS: TestCouchDBUserSecret/CouchDBUser_Secret (1.07s) 2023-06-05T14:17:44.1226135Z --- PASS: TestCouchDBUserSecret/CouchDBUser_Secret/Pod_Created (0.01s) 2023-06-05T14:17:44.1226860Z --- PASS: TestCouchDBUserSecret/CouchDBUser_Secret/Pod_Updated (0.01s) 2023-06-05T14:17:44.1227620Z --- PASS: TestCouchDBUserSecret/CouchDBUser_Secret/CouchDB_Secret_Created (1.03s) 2023-06-05T14:17:44.1228084Z === RUN TestNodeSecret 2023-06-05T14:17:44.1228622Z ktest.go:115: creating namespace testnodesecret-5109ff32 2023-06-05T14:17:44.1229079Z === RUN TestNodeSecret/Node_Secret 2023-06-05T14:17:44.1229504Z === RUN TestNodeSecret/Node_Secret/Pod_Created 2023-06-05T14:17:44.1229954Z === RUN TestNodeSecret/Node_Secret/Pod_Updated 2023-06-05T14:17:44.1231057Z {"severity":"INFO","time":"2023-06-05T14:17:41Z","message":"reconciling for pod secret","level":-1,"name":"podsecretreconciler","pod":"testnodesecret-5109ff32/node-info-5109ff32","level":0} 2023-06-05T14:17:44.1231763Z === RUN TestNodeSecret/Node_Secret/Node_Secret_Created 2023-06-05T14:17:44.1233085Z {"severity":"INFO","time":"2023-06-05T14:17:41Z","message":"successfully created node info secret","level":-1,"name":"podsecretreconciler","pod":"testnodesecret-5109ff32/node-info-5109ff32","level":-1,"nodeName":"node-info-5109ff32","secretName":"node-secret-5109ff32","level":0} 2023-06-05T14:17:44.1234760Z {"severity":"INFO","time":"2023-06-05T14:17:41Z","message":"Successfully reconcile secret","level":-1,"name":"podsecretreconciler","pod":"testnodesecret-5109ff32/node-info-5109ff32","level":-1,"nodeName":"node-info-5109ff32","secretName":"node-secret-5109ff32","level":0} 2023-06-05T14:17:44.1235683Z --- PASS: TestNodeSecret (1.09s) 2023-06-05T14:17:44.1236233Z --- PASS: TestNodeSecret/Node_Secret (1.05s) 2023-06-05T14:17:44.1236848Z --- PASS: TestNodeSecret/Node_Secret/Pod_Created (0.03s) 2023-06-05T14:17:44.1237421Z --- PASS: TestNodeSecret/Node_Secret/Pod_Updated (0.01s) 2023-06-05T14:17:44.1238031Z --- PASS: TestNodeSecret/Node_Secret/Node_Secret_Created (1.01s) 2023-06-05T14:17:44.1238450Z PASS 2023-06-05T14:17:44.1239800Z {"severity":"INFO","time":"2023-06-05T14:17:42Z","message":"Stopping and waiting for non leader election runnables","level":0,"logging.googleapis.com/sourceLocation":{"function":"sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func3","file":"external/io_k8s_sigs_controller_runtime/pkg/manager/internal.go","line":567}} 2023-06-05T14:17:44.1241755Z {"severity":"INFO","time":"2023-06-05T14:17:42Z","message":"Stopping and waiting for leader election runnables","level":0,"logging.googleapis.com/sourceLocation":{"function":"sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func3","file":"external/io_k8s_sigs_controller_runtime/pkg/manager/internal.go","line":571}} 2023-06-05T14:17:44.1243116Z {"severity":"INFO","time":"2023-06-05T14:17:42Z","message":"Shutdown signal received, waiting for all workers to finish","level":-1,"controller":"pod","controllerGroup":"","controllerKind":"Pod","level":0} 2023-06-05T14:17:44.1244167Z {"severity":"INFO","time":"2023-06-05T14:17:42Z","message":"All workers finished","level":-1,"controller":"pod","controllerGroup":"","controllerKind":"Pod","level":0} 2023-06-05T14:17:44.1245906Z {"severity":"INFO","time":"2023-06-05T14:17:42Z","message":"Stopping and waiting for caches","level":0,"logging.googleapis.com/sourceLocation":{"function":"sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func3","file":"external/io_k8s_sigs_controller_runtime/pkg/manager/internal.go","line":577}} 2023-06-05T14:17:44.1247843Z {"severity":"INFO","time":"2023-06-05T14:17:42Z","message":"Stopping and waiting for webhooks","level":0,"logging.googleapis.com/sourceLocation":{"function":"sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func3","file":"external/io_k8s_sigs_controller_runtime/pkg/manager/internal.go","line":581}} 2023-06-05T14:17:44.1249545Z {"severity":"INFO","time":"2023-06-05T14:17:42Z","message":"Wait completed, proceeding to shutdown the manager","level":0,"logging.googleapis.com/sourceLocation":{"function":"sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func3","file":"external/io_k8s_sigs_controller_runtime/pkg/manager/internal.go","line":585}} 2023-06-05T14:17:44.1250377Z ================================================================================ 2023-06-05T14:17:44.3037396Z INFO: From Testing //pkg/edge/api/clients:clients_test: 2023-06-05T14:17:44.3037972Z ==================== Test output for //pkg/edge/api/clients:clients_test: 2023-06-05T14:17:44.3038397Z === RUN TestMapSecretToAccessKey 2023-06-05T14:17:44.3038932Z --- PASS: TestMapSecretToAccessKey (0.00s) 2023-06-05T14:17:44.3039306Z PASS 2023-06-05T14:17:44.3039642Z ================================================================================ 2023-06-05T14:17:44.7831605Z INFO: From Testing //pkg/edge/datasync/couchdb:couchdb_test: 2023-06-05T14:17:44.7832236Z ==================== Test output for //pkg/edge/datasync/couchdb:couchdb_test: 2023-06-05T14:17:44.7832687Z === RUN TestSecurity 2023-06-05T14:17:44.7833144Z couchdb_security_test.go:31: no admin user/password provided 2023-06-05T14:17:44.7833747Z --- SKIP: TestSecurity (0.00s) 2023-06-05T14:17:44.7834114Z === RUN TestURIFormatting 2023-06-05T14:17:44.7834647Z --- PASS: TestURIFormatting (0.00s) 2023-06-05T14:17:44.7835117Z === RUN TestPBKDF2Gen 2023-06-05T14:17:44.7835593Z --- PASS: TestPBKDF2Gen (0.00s) 2023-06-05T14:17:44.7836131Z === RUN TestFromSecret_MustPrehash 2023-06-05T14:17:44.7836670Z --- PASS: TestFromSecret_MustPrehash (0.00s) 2023-06-05T14:17:44.7837084Z === RUN TestFromSecret 2023-06-05T14:17:44.7837552Z --- PASS: TestFromSecret (0.00s) 2023-06-05T14:17:44.7837958Z === RUN TestToSecret_MustPrehash 2023-06-05T14:17:44.7838462Z --- PASS: TestToSecret_MustPrehash (0.00s) 2023-06-05T14:17:44.7838858Z === RUN TestToSecret 2023-06-05T14:17:44.7839293Z --- PASS: TestToSecret (0.00s) 2023-06-05T14:17:44.7839729Z === RUN TestCredentialsManagerFromSecret 2023-06-05T14:17:44.7840332Z --- PASS: TestCredentialsManagerFromSecret (0.00s) 2023-06-05T14:17:44.7840723Z PASS 2023-06-05T14:17:44.7841058Z ================================================================================ 2023-06-05T14:17:45.2579148Z INFO: From Testing //pkg/f8n/warehouse/k8s/apis/v1alpha1:v1alpha1_test: 2023-06-05T14:17:45.2579849Z ==================== Test output for //pkg/f8n/warehouse/k8s/apis/v1alpha1:v1alpha1_test: 2023-06-05T14:17:45.2580382Z === RUN TestClusterInfo_Resolve 2023-06-05T14:17:45.2580949Z --- SKIP: TestClusterInfo_Resolve (0.00s) 2023-06-05T14:17:45.2581297Z === RUN TestNewShipment 2023-06-05T14:17:45.2581694Z === RUN TestNewShipment/WithArtifacts_and_FromRepo 2023-06-05T14:17:45.2582215Z --- PASS: TestNewShipment (0.00s) 2023-06-05T14:17:45.2582800Z --- PASS: TestNewShipment/WithArtifacts_and_FromRepo (0.00s) 2023-06-05T14:17:45.2583270Z === RUN TestNewUnpackedPallet 2023-06-05T14:17:45.2583727Z === RUN TestNewUnpackedPallet/Partial_Artifact_and_FromRepo 2023-06-05T14:17:45.2584311Z --- PASS: TestNewUnpackedPallet (0.00s) 2023-06-05T14:17:45.2585040Z --- PASS: TestNewUnpackedPallet/Partial_Artifact_and_FromRepo (0.00s) 2023-06-05T14:17:45.2585493Z PASS 2023-06-05T14:17:45.2586274Z ================================================================================ 2023-06-05T14:17:46.0652923Z INFO: From Testing //pkg/f8n/lighthouse/config:config_test: 2023-06-05T14:17:46.0654065Z ==================== Test output for //pkg/f8n/lighthouse/config:config_test: 2023-06-05T14:17:46.0654543Z === RUN TestParseChannelList 2023-06-05T14:17:46.0655280Z --- PASS: TestParseChannelList (0.00s) 2023-06-05T14:17:46.0655715Z === RUN TestParseChannelListDefault 2023-06-05T14:17:46.0656257Z --- PASS: TestParseChannelListDefault (0.00s) 2023-06-05T14:17:46.0656665Z === RUN TestNewSysCfg 2023-06-05T14:17:46.0657049Z --- PASS: TestNewSysCfg (0.00s) 2023-06-05T14:17:46.0657434Z === RUN TestSetWatchClient 2023-06-05T14:17:46.0657859Z --- PASS: TestSetWatchClient (0.00s) 2023-06-05T14:17:46.0658199Z PASS 2023-06-05T14:17:46.0658507Z ================================================================================ 2023-06-05T14:17:46.3461275Z INFO: From Testing //pkg/edge/gitops/fns/addhelmrepository:addhelmrepository_test: 2023-06-05T14:17:46.3462078Z ==================== Test output for //pkg/edge/gitops/fns/addhelmrepository:addhelmrepository_test: 2023-06-05T14:17:46.3462638Z === RUN TestAddHelmRepository 2023-06-05T14:17:46.3463312Z === RUN TestAddHelmRepository/testdata/simple-tenant-repo 2023-06-05T14:17:46.3463904Z --- PASS: TestAddHelmRepository (0.00s) 2023-06-05T14:17:46.3464536Z --- PASS: TestAddHelmRepository/testdata/simple-tenant-repo (0.00s) 2023-06-05T14:17:46.3465038Z === RUN TestConfigValidation 2023-06-05T14:17:46.3465536Z --- PASS: TestConfigValidation (0.00s) 2023-06-05T14:17:46.3465903Z PASS 2023-06-05T14:17:46.3466328Z ================================================================================ 2023-06-05T14:17:46.8724292Z INFO: From Testing //pkg/f8n/warehouse/oci/cache:cache_test: 2023-06-05T14:17:46.8724924Z ==================== Test output for //pkg/f8n/warehouse/oci/cache:cache_test: 2023-06-05T14:17:46.8725362Z === RUN TestNew 2023-06-05T14:17:46.8725806Z --- PASS: TestNew (0.00s) 2023-06-05T14:17:46.8726165Z === RUN TestCache 2023-06-05T14:17:46.8726539Z === RUN TestCache/Add 2023-06-05T14:17:46.8726888Z === RUN TestCache/Get 2023-06-05T14:17:46.8727160Z 2023/06/05 14:17:46 GET /v2/ 2023-06-05T14:17:46.8727865Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/manifests/be597c3450f86f97567a 404 NAME_UNKNOWN Unknown name 2023-06-05T14:17:46.8729039Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/blobs/sha256:cf379b0eedeb498e835fea8519f07a0e74e7214d7c6c3f676e4e5d9546305cfe 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:46.8730214Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/blobs/sha256:f6d6769f3effdd2ec6235de76c0afcd5bbd05fb064c4ca21b2d0bba78ece5860 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:46.8731122Z 2023/06/05 14:17:46 POST /v2/test-cache/cert-manager/blobs/uploads/ 2023-06-05T14:17:46.8732165Z 2023/06/05 14:17:46 POST /v2/test-cache/cert-manager/blobs/uploads/ 2023-06-05T14:17:46.8732863Z 2023/06/05 14:17:46 PATCH /v2/test-cache/cert-manager/blobs/uploads/221607434056995314 2023-06-05T14:17:46.8733854Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/blobs/uploads/221607434056995314?digest=sha256%3Acf379b0eedeb498e835fea8519f07a0e74e7214d7c6c3f676e4e5d9546305cfe 2023-06-05T14:17:46.8734752Z 2023/06/05 14:17:46 PATCH /v2/test-cache/cert-manager/blobs/uploads/4276779294024484750 2023-06-05T14:17:46.8735774Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/blobs/uploads/4276779294024484750?digest=sha256%3Af6d6769f3effdd2ec6235de76c0afcd5bbd05fb064c4ca21b2d0bba78ece5860 2023-06-05T14:17:46.8736667Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/manifests/be597c3450f86f97567a 2023-06-05T14:17:46.8737357Z cache_test.go:125: ref 127.0.0.1:37081/test-cache/shoot:eebfa403d8e8c5cf622b 2023-06-05T14:17:46.8738229Z cache_test.go:125: ref 127.0.0.1:37081/test-cache/shoot@sha256:a788611c13beef65136b2e492fc36d1da0fc874378654c7fb4b8f76f4623883d 2023-06-05T14:17:46.8739545Z cache_test.go:125: ref 127.0.0.1:37081/test-cache/cert-manager:be597c3450f86f97567a 2023-06-05T14:17:46.8740012Z 2023/06/05 14:17:46 GET /v2/ 2023-06-05T14:17:46.8740692Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/manifests/be597c3450f86f97567a 2023-06-05T14:17:46.8741361Z 2023/06/05 14:17:46 GET /v2/ 2023-06-05T14:17:46.8741964Z 2023/06/05 14:17:46 GET /v2/test-cache/cert-manager/manifests/be597c3450f86f97567a 2023-06-05T14:17:46.8742851Z 2023/06/05 14:17:46 GET /v2/test-cache/cert-manager/blobs/sha256:cf379b0eedeb498e835fea8519f07a0e74e7214d7c6c3f676e4e5d9546305cfe 2023-06-05T14:17:46.8743876Z 2023/06/05 14:17:46 GET /v2/test-cache/cert-manager/blobs/sha256:f6d6769f3effdd2ec6235de76c0afcd5bbd05fb064c4ca21b2d0bba78ece5860 2023-06-05T14:17:46.8744714Z cache_test.go:140: ref 127.0.0.1:37081/test-cache/cert-manager:be597c3450f86f97567a 2023-06-05T14:17:46.8745627Z cache_test.go:140: ref 127.0.0.1:37081/test-cache/cert-manager@sha256:3417750aba6e60c7dda93a35c8941aa85d77f534605910ed68eff91bcf23a731 2023-06-05T14:17:46.8746631Z cache_test.go:158: ref 127.0.0.1:37081/test-cache/cert-manager@sha256:3417750aba6e60c7dda93a35c8941aa85d77f534605910ed68eff91bcf23a731 2023-06-05T14:17:46.8747578Z cache_test.go:158: ref 127.0.0.1:37081/test-cache/cert-manager:be597c3450f86f97567a 2023-06-05T14:17:46.8748268Z cache_test.go:158: ref 127.0.0.1:37081/test-cache/shoot:eebfa403d8e8c5cf622b 2023-06-05T14:17:46.8749163Z cache_test.go:158: ref 127.0.0.1:37081/test-cache/shoot@sha256:a788611c13beef65136b2e492fc36d1da0fc874378654c7fb4b8f76f4623883d 2023-06-05T14:17:46.8749670Z 2023/06/05 14:17:46 GET /v2/ 2023-06-05T14:17:46.8750397Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/manifests/if3ea447d1a482eec4c5 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:17:46.8751470Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/blobs/sha256:f6d6769f3effdd2ec6235de76c0afcd5bbd05fb064c4ca21b2d0bba78ece5860 2023-06-05T14:17:46.8752646Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/blobs/sha256:cf379b0eedeb498e835fea8519f07a0e74e7214d7c6c3f676e4e5d9546305cfe 2023-06-05T14:17:46.8753511Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/manifests/if3ea447d1a482eec4c5 2023-06-05T14:17:46.8754424Z cache_test.go:171: 127.0.0.1:37081/test-cache/cert-manager@sha256:3417750aba6e60c7dda93a35c8941aa85d77f534605910ed68eff91bcf23a731 2023-06-05T14:17:46.8755221Z cache_test.go:172: ref 127.0.0.1:37081/test-cache/cert-manager:if3ea447d1a482eec4c5 2023-06-05T14:17:46.8755654Z 2023/06/05 14:17:46 GET /v2/ 2023-06-05T14:17:46.8756251Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/manifests/if3ea447d1a482eec4c5 2023-06-05T14:17:46.8756681Z === RUN TestCache/Get_ResolveTag 2023-06-05T14:17:46.8757039Z 2023/06/05 14:17:46 GET /v2/ 2023-06-05T14:17:46.8757601Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/manifests/be597c3450f86f97567a 2023-06-05T14:17:46.8758598Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/manifests/sha256:861d3aa54b5392b2532d5d3773e52f256d6709e123f6cd4a0e75ea576f133090 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:17:46.8759754Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/manifests/sha256:7583182abe86d722630e567e32376b3cac125c0419d00de4526e686fa57472d2 404 MANIFEST_UNKNOWN Unknown manifest 2023-06-05T14:17:46.8760938Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/blobs/sha256:e0d85b86a8c42b19803a9a87fc0644ae41ce576d9c627bc5643d51a7b0d21289 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:46.8762092Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/blobs/sha256:13de334deeb3505019e46d990c04c2c2bdb670ceb87fd8fdc92b36d9f89ed397 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:46.8763220Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/blobs/sha256:277e49632b62d73da71411c5825eccb01c8b8214abd9b79ef3af66a5f3568dfc 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:46.8763991Z 2023/06/05 14:17:46 POST /v2/test-cache/cert-manager/blobs/uploads/ 2023-06-05T14:17:46.8764607Z 2023/06/05 14:17:46 POST /v2/test-cache/cert-manager/blobs/uploads/ 2023-06-05T14:17:46.8765518Z 2023/06/05 14:17:46 POST /v2/test-cache/cert-manager/blobs/uploads/ 2023-06-05T14:17:46.8766479Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/blobs/sha256:676039c983ac28389ba2102400548d8e5da9fc05e1d108abf1e02d7e1b8d3e5c 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:46.8767514Z 2023/06/05 14:17:46 PATCH /v2/test-cache/cert-manager/blobs/uploads/7165903716971561958 2023-06-05T14:17:46.8768196Z 2023/06/05 14:17:46 PATCH /v2/test-cache/cert-manager/blobs/uploads/2986680969985053263 2023-06-05T14:17:46.8768854Z 2023/06/05 14:17:46 POST /v2/test-cache/cert-manager/blobs/uploads/ 2023-06-05T14:17:46.8769541Z 2023/06/05 14:17:46 PATCH /v2/test-cache/cert-manager/blobs/uploads/7946620616468780201 2023-06-05T14:17:46.8770586Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/blobs/uploads/7165903716971561958?digest=sha256%3A13de334deeb3505019e46d990c04c2c2bdb670ceb87fd8fdc92b36d9f89ed397 2023-06-05T14:17:46.8772360Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/blobs/uploads/2986680969985053263?digest=sha256%3A277e49632b62d73da71411c5825eccb01c8b8214abd9b79ef3af66a5f3568dfc 2023-06-05T14:17:46.8773266Z 2023/06/05 14:17:46 PATCH /v2/test-cache/cert-manager/blobs/uploads/5967526415655854547 2023-06-05T14:17:46.8774271Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/blobs/uploads/7946620616468780201?digest=sha256%3Ae0d85b86a8c42b19803a9a87fc0644ae41ce576d9c627bc5643d51a7b0d21289 2023-06-05T14:17:46.8775278Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/manifests/sha256:861d3aa54b5392b2532d5d3773e52f256d6709e123f6cd4a0e75ea576f133090 2023-06-05T14:17:46.8776352Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/blobs/uploads/5967526415655854547?digest=sha256%3A676039c983ac28389ba2102400548d8e5da9fc05e1d108abf1e02d7e1b8d3e5c 2023-06-05T14:17:46.8777377Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/manifests/sha256:7583182abe86d722630e567e32376b3cac125c0419d00de4526e686fa57472d2 2023-06-05T14:17:46.8778160Z 2023/06/05 14:17:46 PUT /v2/test-cache/cert-manager/manifests/be597c3450f86f97567a 2023-06-05T14:17:46.8778891Z cache_test.go:184: ref 127.0.0.1:37081/test-cache/cert-manager:be597c3450f86f97567a 2023-06-05T14:17:46.8779307Z 2023/06/05 14:17:46 GET /v2/ 2023-06-05T14:17:46.8779909Z 2023/06/05 14:17:46 HEAD /v2/test-cache/cert-manager/manifests/be597c3450f86f97567a 2023-06-05T14:17:46.8780411Z --- PASS: TestCache (0.09s) 2023-06-05T14:17:46.8780932Z --- PASS: TestCache/Add (0.02s) 2023-06-05T14:17:46.8781387Z --- PASS: TestCache/Get (0.04s) 2023-06-05T14:17:46.8781916Z --- PASS: TestCache/Get_ResolveTag (0.03s) 2023-06-05T14:17:46.8782282Z PASS 2023-06-05T14:17:46.8782628Z ================================================================================ 2023-06-05T14:17:48.7922251Z INFO: From Testing //pkg/edge/controllers/clusterctl/pkg/plugins:plugins_test: 2023-06-05T14:17:48.7922911Z ==================== Test output for //pkg/edge/controllers/clusterctl/pkg/plugins:plugins_test: 2023-06-05T14:17:48.7923406Z === RUN TestCreateKustomizationSyncedObj 2023-06-05T14:17:48.7924086Z --- PASS: TestCreateKustomizationSyncedObj (0.00s) 2023-06-05T14:17:48.7924633Z === RUN TestOktaPlugin_Reconcile 2023-06-05T14:17:48.7924989Z Client with ID 123 deleted successfully 2023-06-05T14:17:48.7925352Z Client with ID 123 deleted successfully 2023-06-05T14:17:48.7925837Z --- PASS: TestOktaPlugin_Reconcile (0.08s) 2023-06-05T14:17:48.7926197Z === RUN TestOktaPlugin_Component 2023-06-05T14:17:48.7926688Z --- PASS: TestOktaPlugin_Component (0.00s) 2023-06-05T14:17:48.7927122Z === RUN TestStoreCredentialsPlugin_Reconcile 2023-06-05T14:17:48.7927752Z --- PASS: TestStoreCredentialsPlugin_Reconcile (0.11s) 2023-06-05T14:17:48.7928313Z === RUN TestStoreCredentialsPlugin_ReconcileDSDSStore 2023-06-05T14:17:48.7928941Z --- PASS: TestStoreCredentialsPlugin_ReconcileDSDSStore (0.81s) 2023-06-05T14:17:48.7929434Z === RUN TestStoreCredentialsPlugin_Reconcile_NonStore 2023-06-05T14:17:48.7930010Z --- PASS: TestStoreCredentialsPlugin_Reconcile_NonStore (1.01s) 2023-06-05T14:17:48.7930522Z === RUN TestStoreCredentialsPlugin_Component 2023-06-05T14:17:48.7931816Z --- PASS: TestStoreCredentialsPlugin_Component (0.00s) 2023-06-05T14:17:48.7932292Z PASS 2023-06-05T14:17:48.7932906Z ================================================================================ 2023-06-05T14:17:50.7063238Z INFO: From Testing //pkg/f8n/gcp/k8s/controllers/projectinit:projectinit_test: 2023-06-05T14:17:50.7064451Z ==================== Test output for //pkg/f8n/gcp/k8s/controllers/projectinit:projectinit_test: 2023-06-05T14:17:50.7064990Z === RUN TestProjectInitController 2023-06-05T14:17:50.7065814Z {"severity":"info","ts":1685974649.0447464,"message":"Starting EventSource","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","source":"kind source: *v1beta1.Project"} 2023-06-05T14:17:50.7067047Z {"severity":"info","ts":1685974649.044823,"message":"Starting EventSource","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","source":"kind source: *v1beta1.ComputeFirewall"} 2023-06-05T14:17:50.7068227Z {"severity":"info","ts":1685974649.0448306,"message":"Starting EventSource","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","source":"kind source: *v1beta1.ComputeSSLPolicy"} 2023-06-05T14:17:50.7069451Z {"severity":"info","ts":1685974649.0448365,"message":"Starting EventSource","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","source":"kind source: *v1beta1.IAMPolicyMember"} 2023-06-05T14:17:50.7070703Z {"severity":"info","ts":1685974649.0448425,"message":"Starting EventSource","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","source":"kind source: *v1beta1.IAMServiceAccountKey"} 2023-06-05T14:17:50.7071902Z {"severity":"info","ts":1685974649.0448487,"message":"Starting EventSource","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","source":"kind source: *v1.Secret"} 2023-06-05T14:17:50.7073122Z {"severity":"info","ts":1685974649.0448556,"message":"Starting EventSource","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","source":"kind source: *v1beta1.SecretManagerSecret"} 2023-06-05T14:17:50.7074446Z {"severity":"info","ts":1685974649.044861,"message":"Starting EventSource","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","source":"kind source: *v1beta1.SecretManagerSecretVersion"} 2023-06-05T14:17:50.7075621Z {"severity":"info","ts":1685974649.0448673,"message":"Starting Controller","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project"} 2023-06-05T14:17:50.7076688Z {"severity":"info","ts":1685974649.4581108,"message":"Starting workers","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","worker count":1} 2023-06-05T14:17:50.7077741Z framework.go:146: created project ret-edge-foo-fighters 2023-06-05T14:17:50.7078382Z === RUN TestProjectInitController/TestArtifactRegistryPolicyReconciliation 2023-06-05T14:17:50.7083384Z {"severity":"info","ts":1685974651.2936304,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"69663086-178c-4845-9ebf-77c9295b7b94","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy created\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh created\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp created\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp created\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh created\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp created\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default created\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader created\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key created"} 2023-06-05T14:17:50.7090607Z {"severity":"error","ts":1685974651.2937567,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"69663086-178c-4845-9ebf-77c9295b7b94","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7096563Z {"severity":"error","ts":1685974651.2938313,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"69663086-178c-4845-9ebf-77c9295b7b94","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7102550Z {"severity":"info","ts":1685974651.4464462,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"b09dd8de-ac3f-423b-91ab-578cd907d6d7","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7110052Z {"severity":"error","ts":1685974651.4465477,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"b09dd8de-ac3f-423b-91ab-578cd907d6d7","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7116657Z {"severity":"error","ts":1685974651.4466102,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"b09dd8de-ac3f-423b-91ab-578cd907d6d7","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7122550Z {"severity":"info","ts":1685974651.7124054,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"d4cf2de8-ffc6-47cc-a0bf-e17bd281db61","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7130720Z {"severity":"error","ts":1685974651.712515,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"d4cf2de8-ffc6-47cc-a0bf-e17bd281db61","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7136331Z {"severity":"error","ts":1685974651.712585,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"d4cf2de8-ffc6-47cc-a0bf-e17bd281db61","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7142313Z {"severity":"info","ts":1685974651.80058,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"69634825-7e87-42b0-9bcb-9069a4993fa9","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7149520Z {"severity":"error","ts":1685974651.8006866,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"69634825-7e87-42b0-9bcb-9069a4993fa9","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7155347Z {"severity":"error","ts":1685974651.800749,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"69634825-7e87-42b0-9bcb-9069a4993fa9","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7162009Z {"severity":"info","ts":1685974651.881783,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"737ae315-3b23-4f68-b2ac-26ffd04d8414","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7169156Z {"severity":"error","ts":1685974651.8818796,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"737ae315-3b23-4f68-b2ac-26ffd04d8414","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7175269Z {"severity":"error","ts":1685974651.8819382,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"737ae315-3b23-4f68-b2ac-26ffd04d8414","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7185187Z {"severity":"info","ts":1685974651.9714832,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"85b3bc30-750c-465c-9c50-bf20263f3d29","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7197067Z {"severity":"error","ts":1685974651.9715865,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"85b3bc30-750c-465c-9c50-bf20263f3d29","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7206406Z {"severity":"error","ts":1685974651.9716449,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"85b3bc30-750c-465c-9c50-bf20263f3d29","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7217554Z {"severity":"info","ts":1685974652.271892,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"86ac7da6-a0c3-4cbc-bbbb-32e4f42100c2","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7229648Z {"severity":"error","ts":1685974652.2719762,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"86ac7da6-a0c3-4cbc-bbbb-32e4f42100c2","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7239124Z {"severity":"error","ts":1685974652.2720294,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"86ac7da6-a0c3-4cbc-bbbb-32e4f42100c2","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7249703Z {"severity":"info","ts":1685974652.375706,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"04a1858e-d02a-4182-9eec-95f01345abe5","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7257737Z {"severity":"error","ts":1685974652.3758106,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"04a1858e-d02a-4182-9eec-95f01345abe5","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7263517Z {"severity":"error","ts":1685974652.375872,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"04a1858e-d02a-4182-9eec-95f01345abe5","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7270392Z {"severity":"info","ts":1685974652.912867,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"dfc5d382-81d6-451e-9bb0-fff874bbdbf0","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7277239Z {"severity":"error","ts":1685974652.9129725,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"dfc5d382-81d6-451e-9bb0-fff874bbdbf0","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7283311Z {"severity":"error","ts":1685974652.9130394,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"dfc5d382-81d6-451e-9bb0-fff874bbdbf0","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7285244Z === RUN TestProjectInitController/TestFirewallReconciliation 2023-06-05T14:17:50.7290156Z {"severity":"info","ts":1685974654.2563295,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"1e3b6148-17fc-4d95-b889-fd4f017ec8cc","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7297180Z {"severity":"error","ts":1685974654.256427,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"1e3b6148-17fc-4d95-b889-fd4f017ec8cc","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7302678Z {"severity":"error","ts":1685974654.256501,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"1e3b6148-17fc-4d95-b889-fd4f017ec8cc","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7308625Z {"severity":"info","ts":1685974654.3479004,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"c3ebe9c9-f5fe-464a-a95a-7fd4362a5693","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7316012Z {"severity":"error","ts":1685974654.3480017,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"c3ebe9c9-f5fe-464a-a95a-7fd4362a5693","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7321910Z {"severity":"error","ts":1685974654.3480635,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"c3ebe9c9-f5fe-464a-a95a-7fd4362a5693","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7328560Z {"severity":"info","ts":1685974656.237072,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"35d30c77-cb96-4375-9114-89d9b9c762df","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7336230Z {"severity":"error","ts":1685974656.2371788,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"35d30c77-cb96-4375-9114-89d9b9c762df","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7342423Z {"severity":"error","ts":1685974656.2372372,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"35d30c77-cb96-4375-9114-89d9b9c762df","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7349462Z {"severity":"info","ts":1685974656.8844557,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"1dbd38bb-6bab-4b43-84b1-bf66aad075ab","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7356511Z {"severity":"error","ts":1685974656.8845437,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"1dbd38bb-6bab-4b43-84b1-bf66aad075ab","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7362889Z {"severity":"error","ts":1685974656.8846087,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"1dbd38bb-6bab-4b43-84b1-bf66aad075ab","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7369515Z {"severity":"info","ts":1685974658.2942433,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"d29c4bd2-d8b3-479d-b24f-fcb4705ed331","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7376586Z {"severity":"error","ts":1685974658.294371,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"d29c4bd2-d8b3-479d-b24f-fcb4705ed331","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7382037Z {"severity":"error","ts":1685974658.2944458,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"d29c4bd2-d8b3-479d-b24f-fcb4705ed331","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7388033Z {"severity":"info","ts":1685974660.2811093,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"37fef28c-daa2-445d-832b-8780cb1e33d1","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7400406Z {"severity":"error","ts":1685974660.2812443,"message":"failed to reconcile","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"37fef28c-daa2-445d-832b-8780cb1e33d1","error":"waiting for IAMSAKey to become ready: ","stacktrace":"edge-infra.dev/pkg/f8n/gcp/k8s/controllers/projectinit.(*Reconciler).Reconcile\n\tpkg/f8n/gcp/k8s/controllers/projectinit/project_controller.go:127\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7409610Z {"severity":"error","ts":1685974660.2813122,"message":"Reconciler error","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"37fef28c-daa2-445d-832b-8780cb1e33d1","error":"waiting for IAMSAKey to become ready: ","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:17:50.7413117Z === RUN TestProjectInitController/TestInventory 2023-06-05T14:17:50.7421176Z {"severity":"info","ts":1685974662.2728693,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"88513376-7420-403c-9b27-8854d2fda112","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7429314Z {"severity":"info","ts":1685974662.2835538,"logger":"reconcile","message":"pull secret resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"88513376-7420-403c-9b27-8854d2fda112","changeset":"Secret/projectinit-7f781ff1/ret-edge-foo-fighters-platform-docker-pull-cfg created"} 2023-06-05T14:17:50.7434790Z {"severity":"info","ts":1685974662.306367,"logger":"reconcile","message":"secretManager resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"88513376-7420-403c-9b27-8854d2fda112","changeset":"SecretManagerSecret/projectinit-7f781ff1/ret-edge-foo-fighters-platform-docker-pull-cfg created\nSecretManagerSecretVersion/projectinit-7f781ff1/ret-edge-foo-fighters-platform-docker-pull-cfg created"} 2023-06-05T14:17:50.7439308Z {"severity":"info","ts":1685974662.3064413,"logger":"reconcile","message":"updating inventory","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"88513376-7420-403c-9b27-8854d2fda112"} 2023-06-05T14:17:50.7447911Z {"severity":"info","ts":1685974662.3754406,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"f9eed420-94c3-44c6-a3c9-1fcef7a21d2e","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7454397Z {"severity":"info","ts":1685974662.3806164,"logger":"reconcile","message":"pull secret resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"f9eed420-94c3-44c6-a3c9-1fcef7a21d2e","changeset":"Secret/projectinit-7f781ff1/ret-edge-foo-fighters-platform-docker-pull-cfg unchanged"} 2023-06-05T14:17:50.7458288Z {"severity":"info","ts":1685974662.4002328,"logger":"reconcile","message":"secretManager resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"f9eed420-94c3-44c6-a3c9-1fcef7a21d2e","changeset":"SecretManagerSecret/projectinit-7f781ff1/ret-edge-foo-fighters-platform-docker-pull-cfg unchanged\nSecretManagerSecretVersion/projectinit-7f781ff1/ret-edge-foo-fighters-platform-docker-pull-cfg unchanged"} 2023-06-05T14:17:50.7461641Z {"severity":"info","ts":1685974662.4003167,"logger":"reconcile","message":"updating inventory","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"f9eed420-94c3-44c6-a3c9-1fcef7a21d2e"} 2023-06-05T14:17:50.7462880Z === RUN TestProjectInitController/TestSSLPolicyReconciliation 2023-06-05T14:17:50.7467694Z {"severity":"info","ts":1685974665.3056965,"logger":"reconcile","message":"resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"6ea9de83-3b8a-496a-bf7b-1219a2f4a5b1","changeset":"ComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-k8s-proxy unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-iap-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-allow-zscaler-ssh-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-rdp unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-default-allow-ssh unchanged\nComputeFirewall/projectinit-7f781ff1/ret-edge-foo-fighters-deny-ssh-rdp unchanged\nComputeSSLPolicy/projectinit-7f781ff1/ret-edge-foo-fighters-ncr-default unchanged\nIAMPolicyMember/projectinit-7f781ff1/ret-edge-foo-fighters-compute-artifactregistry-reader unchanged\nIAMServiceAccountKey/projectinit-7f781ff1/ret-edge-foo-fighters-pltf-pull-cfg-sa-key unchanged"} 2023-06-05T14:17:50.7472841Z {"severity":"info","ts":1685974665.311432,"logger":"reconcile","message":"pull secret resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"6ea9de83-3b8a-496a-bf7b-1219a2f4a5b1","changeset":"Secret/projectinit-7f781ff1/ret-edge-foo-fighters-platform-docker-pull-cfg unchanged"} 2023-06-05T14:17:50.7476549Z {"severity":"info","ts":1685974665.3248518,"logger":"reconcile","message":"secretManager resources applied","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"6ea9de83-3b8a-496a-bf7b-1219a2f4a5b1","changeset":"SecretManagerSecret/projectinit-7f781ff1/ret-edge-foo-fighters-platform-docker-pull-cfg unchanged\nSecretManagerSecretVersion/projectinit-7f781ff1/ret-edge-foo-fighters-platform-docker-pull-cfg unchanged"} 2023-06-05T14:17:50.7479626Z {"severity":"info","ts":1685974665.3249354,"logger":"reconcile","message":"updating inventory","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project","Project":{"name":"ret-edge-foo-fighters","namespace":"projectinit-7f781ff1"},"namespace":"projectinit-7f781ff1","name":"ret-edge-foo-fighters","reconcileID":"6ea9de83-3b8a-496a-bf7b-1219a2f4a5b1"} 2023-06-05T14:17:50.7480872Z === RUN TestProjectInitController/TestSecret 2023-06-05T14:17:50.7481451Z {"severity":"info","ts":1685974669.258773,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:17:50.7482352Z {"severity":"info","ts":1685974669.2588134,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:17:50.7483203Z {"severity":"info","ts":1685974669.2588322,"message":"Shutdown signal received, waiting for all workers to finish","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project"} 2023-06-05T14:17:50.7484298Z {"severity":"info","ts":1685974669.2589192,"message":"All workers finished","controller":"project","controllerGroup":"resourcemanager.cnrm.cloud.google.com","controllerKind":"Project"} 2023-06-05T14:17:50.7485020Z {"severity":"info","ts":1685974669.2589302,"message":"Stopping and waiting for caches"} 2023-06-05T14:17:50.7485508Z {"severity":"info","ts":1685974669.2591617,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:17:50.7486097Z {"severity":"info","ts":1685974669.2591882,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:17:50.7486825Z --- PASS: TestProjectInitController (35.26s) 2023-06-05T14:17:50.7487621Z --- PASS: TestProjectInitController/TestArtifactRegistryPolicyReconciliation (2.03s) 2023-06-05T14:17:50.7488443Z --- PASS: TestProjectInitController/TestFirewallReconciliation (8.09s) 2023-06-05T14:17:50.7489194Z --- PASS: TestProjectInitController/TestInventory (3.02s) 2023-06-05T14:17:50.7489844Z --- PASS: TestProjectInitController/TestSSLPolicyReconciliation (2.02s) 2023-06-05T14:17:50.7490555Z --- PASS: TestProjectInitController/TestSecret (3.02s) 2023-06-05T14:17:50.7490894Z PASS 2023-06-05T14:17:50.7491159Z ================================================================================ 2023-06-05T14:17:54.5272714Z INFO: From Testing //pkg/f8n/warehouse/forwarder:forwarder_test: 2023-06-05T14:17:54.5273271Z ==================== Test output for //pkg/f8n/warehouse/forwarder:forwarder_test: 2023-06-05T14:17:54.5273746Z The files belonging to this database system will be owned by user "build". 2023-06-05T14:17:54.5274167Z This user must also own the server process. 2023-06-05T14:17:54.5274391Z 2023-06-05T14:17:54.5274764Z The database cluster will be initialized with locale "C.UTF-8". 2023-06-05T14:17:54.5275243Z The default database encoding has accordingly been set to "UTF8". 2023-06-05T14:17:54.5275816Z The default text search configuration will be set to "english". 2023-06-05T14:17:54.5276077Z 2023-06-05T14:17:54.5276215Z Data page checksums are disabled. 2023-06-05T14:17:54.5276427Z 2023-06-05T14:17:54.5277241Z creating directory /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7486/execroot/edge_infra/_tmp/3c20692f92dc812280752c3286334009/pgsql-1274597123/runtime/data ... ok 2023-06-05T14:17:54.5277880Z creating subdirectories ... ok 2023-06-05T14:17:54.5278299Z selecting dynamic shared memory implementation ... posix 2023-06-05T14:17:54.5279315Z selecting default max_connections ... 100 2023-06-05T14:17:54.5279687Z selecting default shared_buffers ... 128MB 2023-06-05T14:17:54.5280145Z selecting default time zone ... UTC 2023-06-05T14:17:54.5280583Z creating configuration files ... ok 2023-06-05T14:17:54.5280923Z running bootstrap script ... ok 2023-06-05T14:17:54.5281450Z performing post-bootstrap initialization ... ok 2023-06-05T14:17:54.5281821Z syncing data to disk ... ok 2023-06-05T14:17:54.5281986Z 2023-06-05T14:17:54.5282180Z Success. You can now start the database server using: 2023-06-05T14:17:54.5282416Z 2023-06-05T14:17:54.5283841Z /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7486/execroot/edge_infra/_tmp/3c20692f92dc812280752c3286334009/pgsql-1274597123/bin/pg_ctl -D /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/sandbox/processwrapper-sandbox/7486/execroot/edge_infra/_tmp/3c20692f92dc812280752c3286334009/pgsql-1274597123/runtime/data -l logfile start 2023-06-05T14:17:54.5284552Z 2023-06-05T14:17:54.5285797Z waiting for server to start....2023-06-05 14:17:53.082 UTC [74796] LOG: starting PostgreSQL 14.2 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 4.8.4-2ubuntu1~14.04.4) 4.8.4, 64-bit 2023-06-05T14:17:54.5286669Z 2023-06-05 14:17:53.083 UTC [74796] LOG: listening on IPv4 address "127.0.0.1", port 38257 2023-06-05T14:17:54.5287883Z 2023-06-05 14:17:53.083 UTC [74796] LOG: could not bind IPv6 address "::1": Cannot assign requested address 2023-06-05T14:17:54.5288625Z 2023-06-05 14:17:53.093 UTC [74796] LOG: listening on Unix socket "/tmp/.s.PGSQL.38257" 2023-06-05T14:17:54.5289387Z 2023-06-05 14:17:53.113 UTC [74800] LOG: database system was shut down at 2023-06-05 14:17:52 UTC 2023-06-05T14:17:54.5290160Z 2023-06-05 14:17:53.121 UTC [74796] LOG: database system is ready to accept connections 2023-06-05T14:17:54.5290524Z done 2023-06-05T14:17:54.5290822Z server started 2023-06-05T14:17:54.5291156Z 2023/06/05 14:17:53 GET /v2/ 2023-06-05T14:17:54.5292034Z 2023/06/05 14:17:53 HEAD /v2/1f8baf6a/f2repo/subscriber-test/manifests/late-test 404 NAME_UNKNOWN Unknown name 2023-06-05T14:17:54.5293165Z 2023/06/05 14:17:53 HEAD /v2/1f8baf6a/f2repo/subscriber-test/blobs/sha256:2cf24dba5fb0a30e26e83b2ac5b9e29e1b161e5c1fa7425e73043362938b9824 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:54.5294341Z 2023/06/05 14:17:53 HEAD /v2/1f8baf6a/f2repo/subscriber-test/blobs/sha256:5c6252906e515b45399e41fda0307669c92e15d7745ea0d49670fe37c5c1b568 404 BLOB_UNKNOWN Unknown blob 2023-06-05T14:17:54.5295150Z 2023/06/05 14:17:53 POST /v2/1f8baf6a/f2repo/subscriber-test/blobs/uploads/ 2023-06-05T14:17:54.5295585Z === RUN TestParseRef 2023-06-05T14:17:54.5296063Z === RUN TestParseRef/only_registry_and_package_as_repository 2023-06-05T14:17:54.5297206Z name_test.go:33: us-east1-docker.pkg.dev/ret-edge-infragang0/warehouse/cert-manager@sha256:deadb33fdeadb33fdeadb33fdeadb33fdeadb33fdeadb33fdeadb33fdeadb33f 2023-06-05T14:17:54.5298006Z === RUN TestParseRef/nested_repository 2023-06-05T14:17:54.5299155Z name_test.go:33: us-east1-docker.pkg.dev/ret-edge-infragang0/warehouse/dev/swim/prometheus-operator@sha256:deadb33fdeadb33fdeadb33fdeadb33fdeadb33fdeadb33fdeadb33fdeadb33f 2023-06-05T14:17:54.5300037Z --- PASS: TestParseRef (0.00s) 2023-06-05T14:17:54.5300681Z --- PASS: TestParseRef/only_registry_and_package_as_repository (0.00s) 2023-06-05T14:17:54.5301475Z --- PASS: TestParseRef/nested_repository (0.00s) 2023-06-05T14:17:54.5301871Z === RUN TestForward 2023-06-05T14:17:54.5302212Z === RUN TestForward/forward 2023-06-05T14:17:54.5302646Z === RUN TestForward/forward/default_destinations 2023-06-05T14:17:54.5303386Z 2023/06/05 14:17:53 PATCH /v2/1f8baf6a/f2repo/subscriber-test/blobs/uploads/4976184404325193820 2023-06-05T14:17:54.5304396Z 2023/06/05 14:17:53 PUT /v2/1f8baf6a/f2repo/subscriber-test/blobs/uploads/4976184404325193820?digest=sha256%3A5c6252906e515b45399e41fda0307669c92e15d7745ea0d49670fe37c5c1b568 2023-06-05T14:17:54.5305972Z {"severity":"info","ts":1685974673.3353379,"message":"failed to ingest registry event. forwarding anyways","ref":"127.0.0.1:40705/1f8baf6a/f2repo/subscriber-test@sha256:883c0bbc3e16dbe5868a852bb6d828609ff3ed0fd1271b44c31bb87df83458bf","error":"no database connection, cant ingest artifact"} 2023-06-05T14:17:54.5307470Z {"severity":"info","ts":1685974673.3355196,"message":"forwarding","dst":"127.0.0.1:40705/1f8baf6a/f2repo/subscriber-test@sha256:883c0bbc3e16dbe5868a852bb6d828609ff3ed0fd1271b44c31bb87df83458bf"} 2023-06-05T14:17:54.5308373Z 2023/06/05 14:17:53 POST /v2/1f8baf6a/f2repo/subscriber-test/blobs/uploads/ 2023-06-05T14:17:54.5309123Z 2023/06/05 14:17:53 PATCH /v2/1f8baf6a/f2repo/subscriber-test/blobs/uploads/3286296910805811901 2023-06-05T14:17:54.5310204Z 2023/06/05 14:17:53 PUT /v2/1f8baf6a/f2repo/subscriber-test/blobs/uploads/3286296910805811901?digest=sha256%3A2cf24dba5fb0a30e26e83b2ac5b9e29e1b161e5c1fa7425e73043362938b9824 2023-06-05T14:17:54.5311098Z 2023/06/05 14:17:53 PUT /v2/1f8baf6a/f2repo/subscriber-test/manifests/late-test 2023-06-05T14:17:54.5311524Z 2023/06/05 14:17:53 GET /v2/ 2023-06-05T14:17:54.5312370Z 2023/06/05 14:17:53 GET /v2/1f8baf6a/f2repo/subscriber-test/manifests/sha256:883c0bbc3e16dbe5868a852bb6d828609ff3ed0fd1271b44c31bb87df83458bf 2023-06-05T14:17:54.5313280Z 2023/06/05 14:17:53 GET /v2/ 2023-06-05T14:17:54.5314320Z {"severity":"info","ts":1685974673.3582098,"message":"forwarded","dst":"127.0.0.1:40705/1f8baf6a/f2repo/subscriber-test@sha256:883c0bbc3e16dbe5868a852bb6d828609ff3ed0fd1271b44c31bb87df83458bf"} 2023-06-05T14:17:54.5315680Z 2023/06/05 14:17:53 HEAD /v2/1f8baf6a/f2repo/subscriber-test/manifests/sha256:883c0bbc3e16dbe5868a852bb6d828609ff3ed0fd1271b44c31bb87df83458bf 2023-06-05T14:17:54.5316238Z 2023/06/05 14:17:53 GET /v2/ 2023-06-05T14:17:54.5317106Z 2023/06/05 14:17:53 GET /v2/1f8baf6a/f2repo/subscriber-test/manifests/sha256:883c0bbc3e16dbe5868a852bb6d828609ff3ed0fd1271b44c31bb87df83458bf 2023-06-05T14:17:54.5317772Z --- PASS: TestForward (0.03s) 2023-06-05T14:17:54.5318289Z --- PASS: TestForward/forward (0.03s) 2023-06-05T14:17:54.5318915Z --- PASS: TestForward/forward/default_destinations (0.03s) 2023-06-05T14:17:54.5319443Z === RUN TestIngestMessage_InsertsArtifactVersion 2023-06-05T14:17:54.5320013Z === RUN TestIngestMessage_InsertsArtifactVersion/ingest 2023-06-05T14:17:54.5320614Z === RUN TestIngestMessage_InsertsArtifactVersion/ingest/inserts_artifact_version 2023-06-05T14:17:54.5321340Z --- PASS: TestIngestMessage_InsertsArtifactVersion (0.29s) 2023-06-05T14:17:54.5322061Z --- PASS: TestIngestMessage_InsertsArtifactVersion/ingest (0.29s) 2023-06-05T14:17:54.5322927Z --- PASS: TestIngestMessage_InsertsArtifactVersion/ingest/inserts_artifact_version (0.29s) 2023-06-05T14:17:54.5323561Z === RUN TestIngestMessage_DeletesArtifactVersion 2023-06-05T14:17:54.5324086Z === RUN TestIngestMessage_DeletesArtifactVersion/ingest 2023-06-05T14:17:54.5324683Z === RUN TestIngestMessage_DeletesArtifactVersion/ingest/deletes_artifact_versions 2023-06-05T14:17:54.5326220Z {"severity":"info","ts":1685974673.7518694,"message":"ignoring because action is present and not INSERT","ref":"us-east1-docker.pkg.dev/ret-edge-pltf-infra/warehouse/lumper-controller@sha256:dc0fe68c3ff914b4d97c2f7d4425cc1ff1ce5b9102c941fc70894738eb670272","action":"DELETE"} 2023-06-05T14:17:54.5327327Z --- PASS: TestIngestMessage_DeletesArtifactVersion (0.10s) 2023-06-05T14:17:54.5328051Z --- PASS: TestIngestMessage_DeletesArtifactVersion/ingest (0.10s) 2023-06-05T14:17:54.5328907Z --- PASS: TestIngestMessage_DeletesArtifactVersion/ingest/deletes_artifact_versions (0.10s) 2023-06-05T14:17:54.5329460Z === RUN TestIngest_Actions 2023-06-05T14:17:54.5329845Z === RUN TestIngest_Actions/ingest 2023-06-05T14:17:54.5330277Z === RUN TestIngest_Actions/ingest/INSERT 2023-06-05T14:17:54.5330713Z === RUN TestIngest_Actions/ingest/DELETE 2023-06-05T14:17:54.5331229Z --- PASS: TestIngest_Actions (0.12s) 2023-06-05T14:17:54.5331944Z --- PASS: TestIngest_Actions/ingest (0.12s) 2023-06-05T14:17:54.5332560Z --- PASS: TestIngest_Actions/ingest/INSERT (0.00s) 2023-06-05T14:17:54.5333182Z --- PASS: TestIngest_Actions/ingest/DELETE (0.01s) 2023-06-05T14:17:54.5333632Z === RUN TestPromote_DefaultDest 2023-06-05T14:17:54.5334057Z === RUN TestPromote_DefaultDest/promote 2023-06-05T14:17:54.5334493Z === RUN TestPromote_DefaultDest/promote/inserts_artifacts 2023-06-05T14:17:54.5335712Z {"severity":"info","ts":1685974674.0536957,"message":"forwarding","dst":"us-east1-docker.pkg.dev/ret-edge-testing-gang/warehouse/promote-defaultdest@sha256:0000000000000000000000000000000000000000000000000000000000000000"} 2023-06-05T14:17:54.5337867Z subscriber_test.go:369: HandleMsg returned non-fatal error: failed to fetch us-east1-docker.pkg.dev/ret-edge-pltf-infra/warehouse/promote-defaultdest@sha256:0000000000000000000000000000000000000000000000000000000000000000: GET https://us-east1-docker.pkg.dev/v2/ret-edge-pltf-infra/warehouse/promote-defaultdest/manifests/sha256:0000000000000000000000000000000000000000000000000000000000000000: MANIFEST_UNKNOWN: Requested entity was not found. 2023-06-05T14:17:54.5338990Z --- PASS: TestPromote_DefaultDest (0.31s) 2023-06-05T14:17:54.5339480Z --- PASS: TestPromote_DefaultDest/promote (0.31s) 2023-06-05T14:17:54.5340523Z --- PASS: TestPromote_DefaultDest/promote/inserts_artifacts (0.31s) 2023-06-05T14:17:54.5341140Z PASS 2023-06-05T14:17:54.5341697Z 2023-06-05 14:17:54.186 UTC [74796] LOG: received fast shutdown request 2023-06-05T14:17:54.5342490Z waiting for server to shut down....2023-06-05 14:17:54.189 UTC [74796] LOG: aborting any active transactions 2023-06-05T14:17:54.5343297Z 2023-06-05 14:17:54.189 UTC [74821] FATAL: terminating connection due to administrator command 2023-06-05T14:17:54.5344072Z 2023-06-05 14:17:54.189 UTC [74824] FATAL: terminating connection due to administrator command 2023-06-05T14:17:54.5344771Z 2023-06-05 14:17:54.189 UTC [74818] FATAL: terminating connection due to administrator command 2023-06-05T14:17:54.5345490Z 2023-06-05 14:17:54.190 UTC [74814] FATAL: terminating connection due to administrator command 2023-06-05T14:17:54.5346406Z 2023-06-05 14:17:54.190 UTC [74796] LOG: background worker "logical replication launcher" (PID 74806) exited with exit code 1 2023-06-05T14:17:54.5347247Z 2023-06-05 14:17:54.204 UTC [74801] LOG: shutting down 2023-06-05T14:17:54.5347853Z 2023-06-05 14:17:54.243 UTC [74796] LOG: database system is shut down 2023-06-05T14:17:54.5348236Z done 2023-06-05T14:17:54.5348551Z server stopped 2023-06-05T14:17:54.5348936Z ================================================================================ 2023-06-05T14:17:55.0011652Z INFO: From Testing //pkg/k8s/runtime/objectrestarter:objectrestarter_test: 2023-06-05T14:17:55.0012330Z ==================== Test output for //pkg/k8s/runtime/objectrestarter:objectrestarter_test: 2023-06-05T14:17:55.0012808Z === RUN TestObjectRestarter 2023-06-05T14:17:55.0013251Z === RUN TestObjectRestarter/TestIsObjectRestartable 2023-06-05T14:17:55.0013775Z === RUN TestObjectRestarter/TestObjectRestarter_Integration 2023-06-05T14:17:55.0014349Z framework.go:161: [integration] skipping: this test can only be ran as an integration test 2023-06-05T14:17:55.0014948Z === RUN TestObjectRestarter/TestObjectRestarter_Unit 2023-06-05T14:17:55.0015520Z framework.go:146: patching deployment with restart annotation 2023-06-05T14:17:55.0016057Z framework.go:146: fetching deployment to confirm it was changed 2023-06-05T14:17:55.0016675Z --- PASS: TestObjectRestarter (9.21s) 2023-06-05T14:17:55.0017291Z --- PASS: TestObjectRestarter/TestIsObjectRestartable (0.00s) 2023-06-05T14:17:55.0017985Z --- SKIP: TestObjectRestarter/TestObjectRestarter_Integration (0.00s) 2023-06-05T14:17:55.0018667Z --- PASS: TestObjectRestarter/TestObjectRestarter_Unit (0.08s) 2023-06-05T14:17:55.0019080Z PASS 2023-06-05T14:17:55.0019415Z ================================================================================ 2023-06-05T14:17:55.8086802Z INFO: From Testing //pkg/edge/datasync/chirp/persister/files:files_test: 2023-06-05T14:17:55.8087452Z ==================== Test output for //pkg/edge/datasync/chirp/persister/files:files_test: 2023-06-05T14:17:55.8087917Z === RUN TestNewFilePersister 2023-06-05T14:17:55.8088360Z === RUN TestNewFilePersister/create_outbox_folders 2023-06-05T14:17:55.8088911Z {"severity":"info","ts":1685974675.6801627,"message":"creating outboxes","outboxes":["tlog","public"]} 2023-06-05T14:17:55.8089465Z {"severity":"info","ts":1685974675.6807892,"message":"created outboxes successfully"} 2023-06-05T14:17:55.8090129Z --- PASS: TestNewFilePersister (0.00s) 2023-06-05T14:17:55.8090728Z --- PASS: TestNewFilePersister/create_outbox_folders (0.00s) 2023-06-05T14:17:55.8091200Z === RUN TestSaveAndDeleteMessage 2023-06-05T14:17:55.8091845Z {"severity":"info","ts":1685974675.6824794,"message":"creating outboxes","outboxes":["tlog","public"]} 2023-06-05T14:17:55.8092328Z {"severity":"info","ts":1685974675.6830595,"message":"created outboxes successfully"} 2023-06-05T14:17:55.8092848Z === RUN TestSaveAndDeleteMessage/save_message_that_have_route_defined 2023-06-05T14:17:55.8093365Z {"severity":"info","ts":1685974675.6860738,"message":"successfully created message files"} 2023-06-05T14:17:55.8094671Z === RUN TestSaveAndDeleteMessage/save_message_without_route_defined_to_'public'_outbox 2023-06-05T14:17:55.8095419Z {"severity":"info","ts":1685974675.7014124,"message":"successfully created message files"} 2023-06-05T14:17:55.8095892Z === RUN TestSaveAndDeleteMessage/save_compressed_message 2023-06-05T14:17:55.8096356Z {"severity":"info","ts":1685974675.7044504,"message":"successfully created message files"} 2023-06-05T14:17:55.8096945Z === RUN TestSaveAndDeleteMessage/save_non-compressed_message 2023-06-05T14:17:55.8097394Z {"severity":"info","ts":1685974675.7070932,"message":"successfully created message files"} 2023-06-05T14:17:55.8097898Z --- PASS: TestSaveAndDeleteMessage (0.03s) 2023-06-05T14:17:55.8098484Z --- PASS: TestSaveAndDeleteMessage/save_message_that_have_route_defined (0.00s) 2023-06-05T14:17:55.8099156Z --- PASS: TestSaveAndDeleteMessage/save_message_without_route_defined_to_'public'_outbox (0.01s) 2023-06-05T14:17:55.8099886Z --- PASS: TestSaveAndDeleteMessage/save_compressed_message (0.00s) 2023-06-05T14:17:55.8100483Z --- PASS: TestSaveAndDeleteMessage/save_non-compressed_message (0.00s) 2023-06-05T14:17:55.8100871Z PASS 2023-06-05T14:17:55.8101141Z ================================================================================ 2023-06-05T14:17:56.2960486Z INFO: From Testing //pkg/edge/controllers/syncedobject:syncedobject_test: 2023-06-05T14:17:56.2961086Z ==================== Test output for //pkg/edge/controllers/syncedobject:syncedobject_test: 2023-06-05T14:17:56.2961525Z === RUN TestController 2023-06-05T14:17:56.2962299Z {"severity":"info","ts":1685974673.3888113,"logger":"controller-runtime.metrics","message":"Metrics server is starting to listen","addr":"127.0.0.1:8080"} 2023-06-05T14:17:56.2962924Z {"severity":"info","ts":1685974673.454241,"message":"Starting server","path":"/metrics","kind":"metrics","addr":"127.0.0.1:8080"} 2023-06-05T14:17:56.2963671Z {"severity":"info","ts":1685974673.4545894,"message":"Starting EventSource","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject","source":"kind source: *v1alpha1.SyncedObject"} 2023-06-05T14:17:56.2964498Z {"severity":"info","ts":1685974673.4546661,"message":"Starting Controller","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject"} 2023-06-05T14:17:56.2965038Z === RUN TestController/TestSyncedObjectMetricsWereSet 2023-06-05T14:17:56.2965647Z {"severity":"info","ts":1685974673.755049,"message":"Starting workers","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject","worker count":1} 2023-06-05T14:17:56.2967265Z {"severity":"info","ts":1685974673.75532,"message":"reconciling started for syncedobject","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject","SyncedObject":{"name":"guid-abc-5","namespace":"default"},"namespace":"default","name":"guid-abc-5","reconcileID":"0af998a9-7010-4723-918e-9e0127602292"} 2023-06-05T14:17:56.2969114Z {"severity":"info","ts":1685974673.7739847,"message":"reconciling finished","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject","SyncedObject":{"name":"guid-abc-5","namespace":"default"},"namespace":"default","name":"guid-abc-5","reconcileID":"0af998a9-7010-4723-918e-9e0127602292"} 2023-06-05T14:17:56.2970034Z === RUN TestController/TestSyncedObjectReconciliation 2023-06-05T14:17:56.2971791Z {"severity":"info","ts":1685974674.7876198,"message":"reconciling started for syncedobject","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject","SyncedObject":{"name":"guid-abc-1234","namespace":"default"},"namespace":"default","name":"guid-abc-1234","reconcileID":"9004ee1c-317e-4bb5-8660-5a2a657939b8"} 2023-06-05T14:17:56.2974137Z {"severity":"info","ts":1685974674.8058066,"message":"reconciling finished","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject","SyncedObject":{"name":"guid-abc-1234","namespace":"default"},"namespace":"default","name":"guid-abc-1234","reconcileID":"9004ee1c-317e-4bb5-8660-5a2a657939b8"} 2023-06-05T14:17:56.2975394Z === RUN TestController/TestSyncedObjectReconciliationWithDir 2023-06-05T14:17:56.2976906Z {"severity":"info","ts":1685974674.850483,"message":"reconciling started for syncedobject","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject","SyncedObject":{"name":"guid-abc-123","namespace":"default"},"namespace":"default","name":"guid-abc-123","reconcileID":"325c67cc-658f-4731-aa77-f22ad9ac6a2d"} 2023-06-05T14:17:56.2978723Z {"severity":"info","ts":1685974674.8676796,"message":"reconciling finished","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject","SyncedObject":{"name":"guid-abc-123","namespace":"default"},"namespace":"default","name":"guid-abc-123","reconcileID":"325c67cc-658f-4731-aa77-f22ad9ac6a2d"} 2023-06-05T14:17:56.2979697Z {"severity":"info","ts":1685974674.9124088,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:17:56.2980386Z {"severity":"info","ts":1685974674.9124563,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:17:56.2981222Z {"severity":"info","ts":1685974674.9125683,"message":"Shutdown signal received, waiting for all workers to finish","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject"} 2023-06-05T14:17:56.2982120Z {"severity":"info","ts":1685974674.9126017,"message":"All workers finished","controller":"syncedobject","controllerGroup":"edge.ncr.com","controllerKind":"SyncedObject"} 2023-06-05T14:17:56.2982820Z {"severity":"info","ts":1685974674.9126093,"message":"Stopping and waiting for caches"} 2023-06-05T14:17:56.2983380Z {"severity":"info","ts":1685974674.9127424,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:17:56.2983979Z {"severity":"info","ts":1685974674.91276,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:17:56.2984589Z --- PASS: TestController (14.32s) 2023-06-05T14:17:56.2985219Z --- PASS: TestController/TestSyncedObjectMetricsWereSet (1.22s) 2023-06-05T14:17:56.2985930Z --- PASS: TestController/TestSyncedObjectReconciliation (0.06s) 2023-06-05T14:17:56.2986652Z --- PASS: TestController/TestSyncedObjectReconciliationWithDir (0.07s) 2023-06-05T14:17:56.2987050Z PASS 2023-06-05T14:17:56.2987360Z ================================================================================ 2023-06-05T14:18:00.4575305Z INFO: From Testing //pkg/edge/info:info_test: 2023-06-05T14:18:00.4575791Z ==================== Test output for //pkg/edge/info:info_test: 2023-06-05T14:18:00.4576146Z === RUN TestFromConfigMap 2023-06-05T14:18:00.4576709Z --- PASS: TestFromConfigMap (0.00s) 2023-06-05T14:18:00.4577238Z === RUN TestToConfigMap 2023-06-05T14:18:00.4577734Z --- PASS: TestToConfigMap (0.00s) 2023-06-05T14:18:00.4578062Z === RUN TestNewValidConfigMap 2023-06-05T14:18:00.4578598Z --- PASS: TestNewValidConfigMap (0.00s) 2023-06-05T14:18:00.4578987Z === RUN TestNewInvalidConfigMap 2023-06-05T14:18:00.4579545Z --- PASS: TestNewInvalidConfigMap (0.00s) 2023-06-05T14:18:00.4579895Z === RUN TestIsEdgeInfoConfigMap 2023-06-05T14:18:00.4580213Z --- PASS: TestIsEdgeInfoConfigMap (0.00s) 2023-06-05T14:18:00.4580471Z === RUN TestFieldsRequired 2023-06-05T14:18:00.4580747Z --- PASS: TestFieldsRequired (0.00s) 2023-06-05T14:18:00.4580977Z === RUN TestTopLevelValidation 2023-06-05T14:18:00.4581274Z --- PASS: TestTopLevelValidation (0.00s) 2023-06-05T14:18:00.4581507Z === RUN TestFromClient 2023-06-05T14:18:00.4581954Z --- PASS: TestFromClient (0.00s) 2023-06-05T14:18:00.4582271Z === RUN TestBuildConfigMap 2023-06-05T14:18:00.4582560Z --- PASS: TestBuildConfigMap (0.00s) 2023-06-05T14:18:00.4582798Z === RUN TestEdgeInfoConfigMap 2023-06-05T14:18:00.4583056Z === RUN TestEdgeInfoConfigMap/TestRBAC_Create 2023-06-05T14:18:00.4583318Z === RUN TestEdgeInfoConfigMap/TestRBAC_Delete 2023-06-05T14:18:00.4583969Z === RUN TestEdgeInfoConfigMap/TestRBAC_Read 2023-06-05T14:18:00.4584256Z === RUN TestEdgeInfoConfigMap/TestRBAC_Update 2023-06-05T14:18:00.4584745Z --- PASS: TestEdgeInfoConfigMap (14.61s) 2023-06-05T14:18:00.4585302Z --- PASS: TestEdgeInfoConfigMap/TestRBAC_Create (0.28s) 2023-06-05T14:18:00.4585670Z --- PASS: TestEdgeInfoConfigMap/TestRBAC_Delete (0.15s) 2023-06-05T14:18:00.4586033Z --- PASS: TestEdgeInfoConfigMap/TestRBAC_Read (0.16s) 2023-06-05T14:18:00.4586393Z --- PASS: TestEdgeInfoConfigMap/TestRBAC_Update (0.16s) 2023-06-05T14:18:00.4586665Z === RUN TestBuildBootstrapSecret 2023-06-05T14:18:00.4586971Z --- PASS: TestBuildBootstrapSecret (0.00s) 2023-06-05T14:18:00.4587206Z === RUN TestSecretFromClient 2023-06-05T14:18:00.4587485Z --- PASS: TestSecretFromClient (0.00s) 2023-06-05T14:18:00.4587816Z === RUN TestOnConfigMapUpdate 2023-06-05T14:18:00.4588109Z --- PASS: TestOnConfigMapUpdate (0.40s) 2023-06-05T14:18:00.4588358Z === RUN TestOnConfigMapUpdateInvalid 2023-06-05T14:18:00.4589229Z {"severity":"error","ts":1685974679.029351,"logger":"TestOnConfigMapUpdateInvalid","message":"fail to parse edge info ConfigMap, will watch for update","error":"edge-info configmap invalid, value(s) not provided: cluster.name","stacktrace":"edge-infra.dev/pkg/edge/info.OnConfigMapUpdate.func1\n\tpkg/edge/info/watch.go:35"} 2023-06-05T14:18:00.4589891Z --- PASS: TestOnConfigMapUpdateInvalid (0.40s) 2023-06-05T14:18:00.4590200Z === RUN TestOnConfigMapUpdateFilterMatchAll 2023-06-05T14:18:00.4590587Z --- PASS: TestOnConfigMapUpdateFilterMatchAll (0.40s) 2023-06-05T14:18:00.4590894Z === RUN TestOnConfigMapUpdateFilterMatchOne 2023-06-05T14:18:00.4591262Z --- PASS: TestOnConfigMapUpdateFilterMatchOne (0.40s) 2023-06-05T14:18:00.4591582Z === RUN TestOnConfigMapUpdateFilterMatchNone 2023-06-05T14:18:00.4591954Z --- PASS: TestOnConfigMapUpdateFilterMatchNone (0.40s) 2023-06-05T14:18:00.4592196Z PASS 2023-06-05T14:18:00.4592406Z ================================================================================ 2023-06-05T14:18:00.7414648Z INFO: From Testing //pkg/f8n/gcp/k8s/controllers/dennis:dennis_test: 2023-06-05T14:18:00.7415266Z ==================== Test output for //pkg/f8n/gcp/k8s/controllers/dennis:dennis_test: 2023-06-05T14:18:00.7415786Z === RUN TestDNSRecordController 2023-06-05T14:18:00.7416532Z {"severity":"info","ts":1685974676.0328374,"message":"Starting EventSource","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","source":"kind source: *v1beta1.ComputeAddress"} 2023-06-05T14:18:00.7417542Z {"severity":"info","ts":1685974676.032915,"message":"Starting Controller","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress"} 2023-06-05T14:18:00.7418263Z === RUN TestDNSRecordController/TestDNSRecordConfigFromYaml 2023-06-05T14:18:00.7419038Z {"severity":"info","ts":1685974676.1337686,"message":"Starting workers","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","worker count":1} 2023-06-05T14:18:00.7420629Z {"severity":"info","ts":1685974676.2669792,"logger":"dennis-controller","message":"applied DNSRecordSets","computeaddress":"dennis-0c4ada03/edge-ingress-ip","changeset":{"DNSRecordSet/dennis-0c4ada03/edge-ingress-ip-a0":"created","DNSRecordSet/dennis-0c4ada03/edge-ingress-ip-a1":"created"}} 2023-06-05T14:18:00.7421506Z === RUN TestDNSRecordController/TestDNSRecordCreation_DifferentNamespace 2023-06-05T14:18:00.7422608Z {"severity":"info","ts":1685974676.3070266,"logger":"dennis-controller","message":"applied DNSRecordSets","computeaddress":"dennis-0c4ada03/diff-namespace","changeset":{"DNSRecordSet/dennis-0c4ada03/diff-namespace":"created"}} 2023-06-05T14:18:00.7423366Z === RUN TestDNSRecordController/TestDNSRecordCreation_SameNamespace 2023-06-05T14:18:00.7424863Z {"severity":"info","ts":1685974676.3307078,"logger":"dennis-controller","message":"applied DNSRecordSets","computeaddress":"dennis-0c4ada03/same-namespace","changeset":{"DNSRecordSet/dennis-0c4ada03/same-namespace":"created"}} 2023-06-05T14:18:00.7426903Z === RUN TestDNSRecordController/TestDNSRecordFromRecordConfigs 2023-06-05T14:18:00.7428819Z {"severity":"info","ts":1685974676.3831656,"logger":"dennis-controller","message":"applied DNSRecordSets","computeaddress":"dennis-0c4ada03/from-record-configs","changeset":{"DNSRecordSet/dennis-0c4ada03/from-record-configs-a0":"created","DNSRecordSet/dennis-0c4ada03/from-record-configs-a1":"created","DNSRecordSet/dennis-0c4ada03/from-record-configs-a2":"created","DNSRecordSet/dennis-0c4ada03/from-record-configs-a3":"created"}} 2023-06-05T14:18:00.7429995Z === RUN TestDNSRecordController/TestDNSRecordMigrateToNewProject 2023-06-05T14:18:00.7431130Z {"severity":"info","ts":1685974676.4369948,"logger":"dennis-controller","message":"applied DNSRecordSets","computeaddress":"dennis-0c4ada03/migrate-projects","changeset":{"DNSRecordSet/dennis-0c4ada03/migrate-projects":"created"}} 2023-06-05T14:18:00.7432637Z {"severity":"info","ts":1685974676.4722981,"logger":"dennis-controller","message":"applied DNSRecordSets","computeaddress":"dennis-0c4ada03/migrate-projects","changeset":{"DNSRecordSet/dennis-0c4ada03/migrate-projects":"unchanged","DNSRecordSet/dennis-0c4ada03/migrate-projects-a0":"created"}} 2023-06-05T14:18:00.7433544Z === RUN TestDNSRecordController/TestDNSRecordNotCreated 2023-06-05T14:18:00.7434079Z === RUN TestDNSRecordController/TestDNSRecordPreventDuplicates 2023-06-05T14:18:00.7437871Z {"severity":"error","ts":1685974677.4927619,"message":"Reconciler error","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","ComputeAddress":{"name":"prevent-duplicates","namespace":"dennis-0c4ada03"},"namespace":"dennis-0c4ada03","name":"prevent-duplicates","reconcileID":"196e208d-4f56-4672-9d3e-636997bdfb00","error":"invalid dns configuration: duplicate domain my-domain.edge-infra.dev. uniqueness key: ret-edge-dennys_edge-infra_my-domain.edge-infra.dev","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:00.7443197Z {"severity":"error","ts":1685974677.4983392,"message":"Reconciler error","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","ComputeAddress":{"name":"prevent-duplicates","namespace":"dennis-0c4ada03"},"namespace":"dennis-0c4ada03","name":"prevent-duplicates","reconcileID":"4175450d-63f5-433c-910d-8b5b8a2dc283","error":"invalid dns configuration: duplicate domain my-domain.edge-infra.dev. uniqueness key: ret-edge-dennys_edge-infra_my-domain.edge-infra.dev","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:00.7449006Z {"severity":"error","ts":1685974677.5089855,"message":"Reconciler error","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","ComputeAddress":{"name":"prevent-duplicates","namespace":"dennis-0c4ada03"},"namespace":"dennis-0c4ada03","name":"prevent-duplicates","reconcileID":"6696e508-854b-4047-9702-77116b310763","error":"invalid dns configuration: duplicate domain my-domain.edge-infra.dev. uniqueness key: ret-edge-dennys_edge-infra_my-domain.edge-infra.dev","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:00.7454752Z {"severity":"error","ts":1685974677.5336432,"message":"Reconciler error","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","ComputeAddress":{"name":"prevent-duplicates","namespace":"dennis-0c4ada03"},"namespace":"dennis-0c4ada03","name":"prevent-duplicates","reconcileID":"54021b9b-9c50-4126-8e71-869cf517aa7b","error":"invalid dns configuration: duplicate domain my-domain.edge-infra.dev. uniqueness key: ret-edge-dennys_edge-infra_my-domain.edge-infra.dev","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:00.7460317Z {"severity":"error","ts":1685974677.5742977,"message":"Reconciler error","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","ComputeAddress":{"name":"prevent-duplicates","namespace":"dennis-0c4ada03"},"namespace":"dennis-0c4ada03","name":"prevent-duplicates","reconcileID":"fcad4968-4e4f-4f67-afec-1869c3e7abb6","error":"invalid dns configuration: duplicate domain my-domain.edge-infra.dev. uniqueness key: ret-edge-dennys_edge-infra_my-domain.edge-infra.dev","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:00.7465784Z {"severity":"error","ts":1685974677.6559749,"message":"Reconciler error","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","ComputeAddress":{"name":"prevent-duplicates","namespace":"dennis-0c4ada03"},"namespace":"dennis-0c4ada03","name":"prevent-duplicates","reconcileID":"25437fbb-6c8e-4621-8bdd-069249d79f33","error":"invalid dns configuration: duplicate domain my-domain.edge-infra.dev. uniqueness key: ret-edge-dennys_edge-infra_my-domain.edge-infra.dev","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:00.7471345Z {"severity":"error","ts":1685974677.8165796,"message":"Reconciler error","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","ComputeAddress":{"name":"prevent-duplicates","namespace":"dennis-0c4ada03"},"namespace":"dennis-0c4ada03","name":"prevent-duplicates","reconcileID":"204c2697-8b53-4534-984d-ad0b9063960f","error":"invalid dns configuration: duplicate domain my-domain.edge-infra.dev. uniqueness key: ret-edge-dennys_edge-infra_my-domain.edge-infra.dev","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:00.7476979Z {"severity":"error","ts":1685974678.1370983,"message":"Reconciler error","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","ComputeAddress":{"name":"prevent-duplicates","namespace":"dennis-0c4ada03"},"namespace":"dennis-0c4ada03","name":"prevent-duplicates","reconcileID":"0c986b47-8099-4737-b1ff-7d3667471b22","error":"invalid dns configuration: duplicate domain my-domain.edge-infra.dev. uniqueness key: ret-edge-dennys_edge-infra_my-domain.edge-infra.dev","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:00.7482372Z {"severity":"error","ts":1685974678.7779465,"message":"Reconciler error","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress","ComputeAddress":{"name":"prevent-duplicates","namespace":"dennis-0c4ada03"},"namespace":"dennis-0c4ada03","name":"prevent-duplicates","reconcileID":"6e84995f-9499-4500-8e7e-4213f0534738","error":"invalid dns configuration: duplicate domain my-domain.edge-infra.dev. uniqueness key: ret-edge-dennys_edge-infra_my-domain.edge-infra.dev","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:00.7484655Z === RUN TestDNSRecordController/TestDNSRecordSSA 2023-06-05T14:18:00.7485819Z {"severity":"info","ts":1685974679.5098538,"logger":"dennis-controller","message":"applied DNSRecordSets","computeaddress":"dennis-0c4ada03/server-side-apply","changeset":{"DNSRecordSet/dennis-0c4ada03/server-side-apply":"created"}} 2023-06-05T14:18:00.7487164Z {"severity":"info","ts":1685974679.5406015,"logger":"dennis-controller","message":"applied DNSRecordSets","computeaddress":"dennis-0c4ada03/server-side-apply","changeset":{"DNSRecordSet/dennis-0c4ada03/server-side-apply":"configured"}} 2023-06-05T14:18:00.7487891Z === RUN TestDNSRecordController/TestDNSRecordSetGarbageCollection 2023-06-05T14:18:00.7488470Z framework.go:161: [integration] skipping: this test can only be ran as an integration test 2023-06-05T14:18:00.7489078Z {"severity":"info","ts":1685974679.5444717,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:18:00.7489887Z {"severity":"info","ts":1685974679.5445292,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:18:00.7490849Z {"severity":"info","ts":1685974679.5445614,"message":"Shutdown signal received, waiting for all workers to finish","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress"} 2023-06-05T14:18:00.7492245Z {"severity":"info","ts":1685974679.5446353,"message":"All workers finished","controller":"computeaddress","controllerGroup":"compute.cnrm.cloud.google.com","controllerKind":"ComputeAddress"} 2023-06-05T14:18:00.7492917Z {"severity":"info","ts":1685974679.5446777,"message":"Stopping and waiting for caches"} 2023-06-05T14:18:00.7493408Z {"severity":"info","ts":1685974679.54475,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:18:00.7493938Z {"severity":"info","ts":1685974679.5447872,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:18:00.7494553Z --- PASS: TestDNSRecordController (18.16s) 2023-06-05T14:18:00.7495232Z --- PASS: TestDNSRecordController/TestDNSRecordConfigFromYaml (0.24s) 2023-06-05T14:18:00.7495961Z --- PASS: TestDNSRecordController/TestDNSRecordCreation_DifferentNamespace (0.03s) 2023-06-05T14:18:00.7496686Z --- PASS: TestDNSRecordController/TestDNSRecordCreation_SameNamespace (0.02s) 2023-06-05T14:18:00.7497403Z --- PASS: TestDNSRecordController/TestDNSRecordFromRecordConfigs (0.09s) 2023-06-05T14:18:00.7498128Z --- PASS: TestDNSRecordController/TestDNSRecordMigrateToNewProject (0.06s) 2023-06-05T14:18:00.7498797Z --- PASS: TestDNSRecordController/TestDNSRecordNotCreated (1.01s) 2023-06-05T14:18:00.7499448Z --- PASS: TestDNSRecordController/TestDNSRecordPreventDuplicates (2.01s) 2023-06-05T14:18:00.7500081Z --- PASS: TestDNSRecordController/TestDNSRecordSSA (0.05s) 2023-06-05T14:18:00.7500736Z --- SKIP: TestDNSRecordController/TestDNSRecordSetGarbageCollection (0.00s) 2023-06-05T14:18:00.7501136Z PASS 2023-06-05T14:18:00.7501428Z ================================================================================ 2023-06-05T14:18:03.0006547Z INFO: From Testing //pkg/edge/controllers/bannerctl:bannerctl_test: 2023-06-05T14:18:03.0007279Z ==================== Test output for //pkg/edge/controllers/bannerctl:bannerctl_test: 2023-06-05T14:18:03.0007710Z === RUN TestBannerController 2023-06-05T14:18:03.0008430Z {"severity":"info","ts":1685974676.1240647,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1alpha1.Banner"} 2023-06-05T14:18:03.0009497Z {"severity":"info","ts":1685974676.1243072,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1beta1.Project"} 2023-06-05T14:18:03.0010507Z {"severity":"info","ts":1685974676.1244233,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1alpha1.Cluster"} 2023-06-05T14:18:03.0012284Z {"severity":"info","ts":1685974676.1245017,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1beta1.ContainerNodePool"} 2023-06-05T14:18:03.0013325Z {"severity":"info","ts":1685974676.1245883,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1beta1.IAMCustomRole"} 2023-06-05T14:18:03.0014333Z {"severity":"info","ts":1685974676.1246583,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1beta1.IAMPolicyMember"} 2023-06-05T14:18:03.0015292Z {"severity":"info","ts":1685974676.1247115,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1beta1.Service"} 2023-06-05T14:18:03.0016796Z {"severity":"info","ts":1685974676.1247592,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1beta1.StorageBucket"} 2023-06-05T14:18:03.0018053Z {"severity":"info","ts":1685974676.1248302,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1alpha1.SyncedObject"} 2023-06-05T14:18:03.0019096Z {"severity":"info","ts":1685974676.1248965,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1beta1.LoggingLogExclusion"} 2023-06-05T14:18:03.0020188Z {"severity":"info","ts":1685974676.124952,"message":"Starting EventSource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","source":"kind source: *v1beta1.ArtifactRegistryRepository"} 2023-06-05T14:18:03.0021132Z {"severity":"info","ts":1685974676.125018,"message":"Starting Controller","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner"} 2023-06-05T14:18:03.0021829Z === RUN TestBannerController/TestBannerCreation_CouchdbConfig 2023-06-05T14:18:03.0022537Z {"severity":"info","ts":1685974676.6295493,"message":"Starting workers","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","worker count":1} 2023-06-05T14:18:03.0024367Z {"severity":"info","ts":1685974678.1795013,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"c127a697-0852-401c-9e03-a3b497feaef2"} 2023-06-05T14:18:03.0026930Z {"severity":"info","ts":1685974678.1889863,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"c127a697-0852-401c-9e03-a3b497feaef2","namespace":"guid-xyz-098","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-xyz-098","uid":"f34e3872-9b26-48a6-83f1-3742e69a7826","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0029081Z {"severity":"info","ts":1685974678.20096,"logger":"project","message":"project is not ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"c127a697-0852-401c-9e03-a3b497feaef2","reason":""} 2023-06-05T14:18:03.0032673Z {"severity":"error","ts":1685974678.217952,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"c127a697-0852-401c-9e03-a3b497feaef2","error":"project isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0035482Z {"severity":"info","ts":1685974678.2181382,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"ee0cffda-6a47-4287-80d7-6dd7fc2fea7f"} 2023-06-05T14:18:03.0038228Z {"severity":"info","ts":1685974678.2300375,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"ee0cffda-6a47-4287-80d7-6dd7fc2fea7f","namespace":"guid-xyz-098","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-xyz-098","uid":"f34e3872-9b26-48a6-83f1-3742e69a7826","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0040509Z {"severity":"info","ts":1685974678.2379699,"logger":"project","message":"project is not ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"ee0cffda-6a47-4287-80d7-6dd7fc2fea7f","reason":""} 2023-06-05T14:18:03.0044125Z {"severity":"error","ts":1685974678.24256,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"ee0cffda-6a47-4287-80d7-6dd7fc2fea7f","error":"project isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0046998Z {"severity":"info","ts":1685974678.2427144,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c"} 2023-06-05T14:18:03.0049400Z {"severity":"info","ts":1685974678.2574797,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","namespace":"guid-xyz-098","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-xyz-098","uid":"f34e3872-9b26-48a6-83f1-3742e69a7826","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0055139Z {"severity":"info","ts":1685974678.2730968,"logger":"project","message":"project is ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","project":{"name":"banner-project","namespace":"guid-xyz-098","uid":"a0eecb1b-8e89-4fd2-bc86-4e6cc5bef15c","resourceVersion":"636","generation":2,"creationTimestamp":"2023-06-05T14:17:58Z","annotations":{"bsl.edge.ncr.com/banner":"couchdb-enabled","bsl.edge.ncr.com/organization":"test-org","cnrm.cloud.google.com/project-id":"ret-edge-dho2i0jbcm70e60zd8li0"},"ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-xyz-098","uid":"f34e3872-9b26-48a6-83f1-3742e69a7826","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"resourcemanager.cnrm.cloud.google.com/v1beta1","time":"2023-06-05T14:17:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:bsl.edge.ncr.com/banner":{},"f:bsl.edge.ncr.com/organization":{},"f:cnrm.cloud.google.com/project-id":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"f34e3872-9b26-48a6-83f1-3742e69a7826\"}":{}}},"f:spec":{".":{},"f:billingAccountRef":{},"f:folderRef":{},"f:name":{},"f:resourceID":{}},"f:status":{".":{},"f:conditions":{},"f:number":{}}}}]}} 2023-06-05T14:18:03.0058184Z Fetching cluster registration data... 2023-06-05T14:18:03.0058670Z [LaunchDarkly] 2023/06/05 14:17:58 INFO: Starting LaunchDarkly client 6.0.3 2023-06-05T14:18:03.0059301Z [LaunchDarkly] 2023/06/05 14:17:58 INFO: Waiting up to 10000 milliseconds for LaunchDarkly client to start... 2023-06-05T14:18:03.0059901Z [LaunchDarkly] 2023/06/05 14:17:58 INFO: Initialized LaunchDarkly client 2023-06-05T14:18:03.0067102Z {"severity":"error","ts":1685974678.3229318,"logger":"createRemoteAccessComputeAddress","message":"failed to delete existing remote access ComputeAddress resource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","name":"guid-xyz-098-remote-access-ip-1","namespace":"guid-xyz-098","error":"computeaddresses.compute.cnrm.cloud.google.com \"guid-xyz-098-remote-access-ip-1\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).createRemoteAccessComputeAddress\n\tpkg/edge/controllers/bannerctl/remote_access.go:56\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProjectInfra\n\tpkg/edge/controllers/bannerctl/bannerctl.go:475\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:350\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0072748Z {"severity":"info","ts":1685974678.3237648,"logger":"remote-access-sobj","message":"creating k8s resources for vpnctl","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","projectID":"ret-edge-dho2i0jbcm70e60zd8li0"} 2023-06-05T14:18:03.0074920Z {"severity":"info","ts":1685974678.324163,"logger":"remote-access-sobj","message":"creating k8s resources for remote access","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","projectID":"ret-edge-dho2i0jbcm70e60zd8li0"} 2023-06-05T14:18:03.0075972Z Fetching cluster registration data... 2023-06-05T14:18:03.0090380Z {"severity":"info","ts":1685974678.9462972,"logger":"project-infra","message":"project infrastructure applied","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","changeset":"Service/guid-xyz-098/cloudresourcemanager.googleapis.com created\nService/guid-xyz-098/cloudtrace.googleapis.com created\nService/guid-xyz-098/compute.googleapis.com created\nService/guid-xyz-098/container.googleapis.com created\nService/guid-xyz-098/iamcredentials.googleapis.com created\nService/guid-xyz-098/logging.googleapis.com created\nService/guid-xyz-098/monitoring.googleapis.com created\nService/guid-xyz-098/secretmanager.googleapis.com created\nService/guid-xyz-098/stackdriver.googleapis.com created\nComputeAddress/guid-xyz-098/couchdb-ip-1 created\nComputeAddress/guid-xyz-098/remote-access-ip-guid-xyz-098 created\nSyncedObject/guid-xyz-098/banner-proxy-guid-xyz-098 created\nSyncedObject/guid-xyz-098/couchctl-sa created\nSyncedObject/guid-xyz-098/cushion-cm created\nSyncedObject/guid-xyz-098/cushion-sa created\nSyncedObject/guid-xyz-098/ncr-charts created\nSyncedObject/guid-xyz-098/remote-access created\nSyncedObject/guid-xyz-098/remote-access-auth-service created\nSyncedObject/guid-xyz-098/remote-access-cert-guid-xyz-098 created\nSyncedObject/guid-xyz-098/remote-access-host created\nSyncedObject/guid-xyz-098/vpn-controller created\nSyncedObject/guid-xyz-098/vpn-controller-gcp-sa created\nSyncedObject/guid-xyz-098/vpn-controller-rb created\nSyncedObject/guid-xyz-098/vpn-controller-secret-admin-binding created\nSyncedObject/guid-xyz-098/vpn-controller-workload-id-binding created\nIAMCustomRole/guid-xyz-098/fluxlist created\nIAMCustomRole/guid-xyz-098/fluxobjectget created\nIAMPolicyMember/guid-xyz-098/cluster-infra-kcc-sa-gke-admin created\nIAMPolicyMember/guid-xyz-098/cluster-infra-kcc-sa-secretadmin created\nIAMPolicyMember/guid-xyz-098/cluster-infra-kcc-sa-workload-identity-user created\nIAMPolicyMember/guid-xyz-098/couchctl-banner-secret-admin created\nIAMPolicyMember/guid-xyz-098/couchctl-workload-identity-user created\nIAMPolicyMember/guid-xyz-098/cushion-foreman-pubsubedit created\nIAMPolicyMember/guid-xyz-098/cushion-foreman-pubsubsub created\nIAMPolicyMember/guid-xyz-098/cushion-foreman-pubsubview created\nIAMPolicyMember/guid-xyz-098/cushion-workload-identity-user created\nIAMPolicyMember/guid-xyz-098/k8s-cfg-connector-logging-logwriter created\nIAMPolicyMember/guid-xyz-098/k8s-cfg-connector-owner created\nIAMPolicyMember/guid-xyz-098/k8s-cfg-connector-pubsub-admin created\nIAMPolicyMember/guid-xyz-098/k8s-cfg-connector-workload-id created\nIAMPolicyMember/guid-xyz-098/syncedobject-infra-kcc-sa-pubsub-publisher created\nIAMPolicyMember/guid-xyz-098/syncedobject-infra-kcc-sa-pubsub-subscriber created\nIAMPolicyMember/guid-xyz-098/syncedobject-infra-kcc-sa-workload-identity-user created\nIAMServiceAccount/guid-xyz-098/cluster-infra-kcc-sa created\nIAMServiceAccount/guid-xyz-098/couchctl created\nIAMServiceAccount/guid-xyz-098/cushion created\nIAMServiceAccount/guid-xyz-098/k8s-cfg-connector created\nIAMServiceAccount/guid-xyz-098/syncedobject-infra-kcc-sa created\nLoggingLogExclusion/guid-xyz-098/aggregated-logs-exclusion created\nPubSubSubscription/guid-xyz-098/cushion created\nStorageBucket/guid-xyz-098/ret-edge-dho2i0jbcm70e60zd8li0 created"} 2023-06-05T14:18:03.0101817Z {"severity":"info","ts":1685974678.9465716,"logger":"copy-platform-secrets","message":"copying platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","source":"mock gcp projectid","destination":"ret-edge-dho2i0jbcm70e60zd8li0"} 2023-06-05T14:18:03.0104505Z {"severity":"info","ts":1685974678.9466157,"logger":"copy-platform-secrets","message":"copied platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","projectID":"ret-edge-dho2i0jbcm70e60zd8li0"} 2023-06-05T14:18:03.0106887Z {"severity":"info","ts":1685974678.946637,"logger":"add-tenant","message":"adding tenant by invoking kpt function with chariot","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","projectID":"ret-edge-dho2i0jbcm70e60zd8li0"} 2023-06-05T14:18:03.0108967Z {"severity":"info","ts":1685974678.9466426,"logger":"add-tenant","message":"committed kpt fn","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","sha":""} 2023-06-05T14:18:03.0134163Z {"severity":"info","ts":1685974678.9812236,"message":"reconciled banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"d888a37f-e96e-4b55-9856-731ccc49235c","banner":{"kind":"Banner","apiVersion":"edge.ncr.com/v1alpha1","metadata":{"name":"guid-xyz-098","uid":"f34e3872-9b26-48a6-83f1-3742e69a7826","resourceVersion":"635","generation":1,"creationTimestamp":"2023-06-05T14:17:58Z","managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:17:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:spec":{".":{},"f:bsl":{".":{},"f:enterpriseUnit":{},"f:organization":{".":{},"f:name":{}}},"f:displayName":{},"f:enablements":{},"f:gcp":{".":{},"f:projectId":{}}}}},{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:17:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{".":{},"f:conditions":{},"f:projectRef":{}}},"subresource":"status"}]},"spec":{"displayName":"couchdb-enabled","bsl":{"enterpriseUnit":{},"organization":{"name":"test-org"}},"gcp":{"projectId":"ret-edge-dho2i0jbcm70e60zd8li0"},"enablements":["couchdb"]},"status":{"projectRef":"guid-xyz-098/banner-project","projectNumber":"123","conditions":[{"type":"Ready","status":"True","observedGeneration":1,"lastTransitionTime":"2023-06-05T14:17:58Z","reason":"ProvisionSucceeded","message":"successfully set up banner"}],"inventory":{"entries":[{"id":"guid-xyz-098_cloudresourcemanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_cloudtrace.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_compute.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_container.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_iamcredentials.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_logging.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_monitoring.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_secretmanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_stackdriver.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_couchdb-ip-1_compute.cnrm.cloud.google.com_ComputeAddress","v":"v1beta1"},{"id":"guid-xyz-098_remote-access-ip-guid-xyz-098_compute.cnrm.cloud.google.com_ComputeAddress","v":"v1beta1"},{"id":"guid-xyz-098_banner-proxy-guid-xyz-098_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_couchctl-sa_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_cushion-cm_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_cushion-sa_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_ncr-charts_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_remote-access_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_remote-access-auth-service_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_remote-access-cert-guid-xyz-098_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_remote-access-host_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_vpn-controller_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_vpn-controller-gcp-sa_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_vpn-controller-rb_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_vpn-controller-secret-admin-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_vpn-controller-workload-id-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_fluxlist_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-xyz-098_fluxobjectget_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-xyz-098_cluster-infra-kcc-sa-gke-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cluster-infra-kcc-sa-secretadmin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cluster-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_couchctl-banner-secret-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_couchctl-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cushion-foreman-pubsubedit_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cushion-foreman-pubsubsub_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cushion-foreman-pubsubview_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cushion-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_k8s-cfg-connector-logging-logwriter_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_k8s-cfg-connector-owner_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_k8s-cfg-connector-pubsub-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_k8s-cfg-connector-workload-id_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_syncedobject-infra-kcc-sa-pubsub-publisher_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_syncedobject-infra-kcc-sa-pubsub-subscriber_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_syncedobject-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cluster-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-xyz-098_couchctl_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-xyz-098_cushion_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-xyz-098_k8s-cfg-connector_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-xyz-098_syncedobject-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-xyz-098_aggregated-logs-exclusion_logging.cnrm.cloud.google.com_LoggingLogExclusion","v":"v1beta1"},{"id":"guid-xyz-098_cushion_pubsub.cnrm.cloud.google.com_PubSubSubscription","v":"v1beta1"},{"id":"guid-xyz-098_ret-edge-dho2i0jbcm70e60zd8li0_storage.cnrm.cloud.google.com_StorageBucket","v":"v1beta1"}]}}}} 2023-06-05T14:18:03.0150609Z {"severity":"info","ts":1685974678.981405,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91"} 2023-06-05T14:18:03.0153083Z {"severity":"info","ts":1685974678.9844606,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","namespace":"guid-xyz-098","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-xyz-098","uid":"f34e3872-9b26-48a6-83f1-3742e69a7826","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0159005Z {"severity":"info","ts":1685974678.9885786,"logger":"project","message":"project is ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","project":{"name":"banner-project","namespace":"guid-xyz-098","uid":"a0eecb1b-8e89-4fd2-bc86-4e6cc5bef15c","resourceVersion":"636","generation":2,"creationTimestamp":"2023-06-05T14:17:58Z","annotations":{"bsl.edge.ncr.com/banner":"couchdb-enabled","bsl.edge.ncr.com/organization":"test-org","cnrm.cloud.google.com/project-id":"ret-edge-dho2i0jbcm70e60zd8li0"},"ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-xyz-098","uid":"f34e3872-9b26-48a6-83f1-3742e69a7826","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"resourcemanager.cnrm.cloud.google.com/v1beta1","time":"2023-06-05T14:17:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:bsl.edge.ncr.com/banner":{},"f:bsl.edge.ncr.com/organization":{},"f:cnrm.cloud.google.com/project-id":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"f34e3872-9b26-48a6-83f1-3742e69a7826\"}":{}}},"f:spec":{".":{},"f:billingAccountRef":{},"f:folderRef":{},"f:name":{},"f:resourceID":{}},"f:status":{".":{},"f:conditions":{},"f:number":{}}}}]}} 2023-06-05T14:18:03.0162063Z Fetching cluster registration data... 2023-06-05T14:18:03.0162586Z === RUN TestBannerController/TestBannerCreation_SecondaryResources 2023-06-05T14:18:03.0169608Z {"severity":"error","ts":1685974679.002832,"logger":"createRemoteAccessComputeAddress","message":"failed to delete existing remote access ComputeAddress resource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","name":"guid-xyz-098-remote-access-ip-1","namespace":"guid-xyz-098","error":"computeaddresses.compute.cnrm.cloud.google.com \"guid-xyz-098-remote-access-ip-1\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).createRemoteAccessComputeAddress\n\tpkg/edge/controllers/bannerctl/remote_access.go:56\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProjectInfra\n\tpkg/edge/controllers/bannerctl/bannerctl.go:475\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:350\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0175300Z {"severity":"info","ts":1685974679.0029957,"logger":"remote-access-sobj","message":"creating k8s resources for vpnctl","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","projectID":"ret-edge-dho2i0jbcm70e60zd8li0"} 2023-06-05T14:18:03.0177477Z {"severity":"info","ts":1685974679.003108,"logger":"remote-access-sobj","message":"creating k8s resources for remote access","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","projectID":"ret-edge-dho2i0jbcm70e60zd8li0"} 2023-06-05T14:18:03.0178497Z Fetching cluster registration data... 2023-06-05T14:18:03.0193192Z {"severity":"info","ts":1685974679.296006,"logger":"project-infra","message":"project infrastructure applied","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","changeset":"Service/guid-xyz-098/cloudresourcemanager.googleapis.com unchanged\nService/guid-xyz-098/cloudtrace.googleapis.com unchanged\nService/guid-xyz-098/compute.googleapis.com unchanged\nService/guid-xyz-098/container.googleapis.com unchanged\nService/guid-xyz-098/iamcredentials.googleapis.com unchanged\nService/guid-xyz-098/logging.googleapis.com unchanged\nService/guid-xyz-098/monitoring.googleapis.com unchanged\nService/guid-xyz-098/secretmanager.googleapis.com unchanged\nService/guid-xyz-098/stackdriver.googleapis.com unchanged\nComputeAddress/guid-xyz-098/couchdb-ip-1 unchanged\nComputeAddress/guid-xyz-098/remote-access-ip-guid-xyz-098 unchanged\nSyncedObject/guid-xyz-098/banner-proxy-guid-xyz-098 unchanged\nSyncedObject/guid-xyz-098/couchctl-sa unchanged\nSyncedObject/guid-xyz-098/cushion-cm unchanged\nSyncedObject/guid-xyz-098/cushion-sa unchanged\nSyncedObject/guid-xyz-098/ncr-charts unchanged\nSyncedObject/guid-xyz-098/remote-access unchanged\nSyncedObject/guid-xyz-098/remote-access-auth-service unchanged\nSyncedObject/guid-xyz-098/remote-access-cert-guid-xyz-098 unchanged\nSyncedObject/guid-xyz-098/remote-access-host unchanged\nSyncedObject/guid-xyz-098/vpn-controller unchanged\nSyncedObject/guid-xyz-098/vpn-controller-gcp-sa unchanged\nSyncedObject/guid-xyz-098/vpn-controller-rb unchanged\nSyncedObject/guid-xyz-098/vpn-controller-secret-admin-binding unchanged\nSyncedObject/guid-xyz-098/vpn-controller-workload-id-binding unchanged\nIAMCustomRole/guid-xyz-098/fluxlist unchanged\nIAMCustomRole/guid-xyz-098/fluxobjectget unchanged\nIAMPolicyMember/guid-xyz-098/cluster-infra-kcc-sa-gke-admin unchanged\nIAMPolicyMember/guid-xyz-098/cluster-infra-kcc-sa-secretadmin unchanged\nIAMPolicyMember/guid-xyz-098/cluster-infra-kcc-sa-workload-identity-user unchanged\nIAMPolicyMember/guid-xyz-098/couchctl-banner-secret-admin unchanged\nIAMPolicyMember/guid-xyz-098/couchctl-workload-identity-user unchanged\nIAMPolicyMember/guid-xyz-098/cushion-foreman-pubsubedit unchanged\nIAMPolicyMember/guid-xyz-098/cushion-foreman-pubsubsub unchanged\nIAMPolicyMember/guid-xyz-098/cushion-foreman-pubsubview unchanged\nIAMPolicyMember/guid-xyz-098/cushion-workload-identity-user unchanged\nIAMPolicyMember/guid-xyz-098/k8s-cfg-connector-logging-logwriter unchanged\nIAMPolicyMember/guid-xyz-098/k8s-cfg-connector-owner unchanged\nIAMPolicyMember/guid-xyz-098/k8s-cfg-connector-pubsub-admin unchanged\nIAMPolicyMember/guid-xyz-098/k8s-cfg-connector-workload-id unchanged\nIAMPolicyMember/guid-xyz-098/syncedobject-infra-kcc-sa-pubsub-publisher unchanged\nIAMPolicyMember/guid-xyz-098/syncedobject-infra-kcc-sa-pubsub-subscriber unchanged\nIAMPolicyMember/guid-xyz-098/syncedobject-infra-kcc-sa-workload-identity-user unchanged\nIAMServiceAccount/guid-xyz-098/cluster-infra-kcc-sa unchanged\nIAMServiceAccount/guid-xyz-098/couchctl unchanged\nIAMServiceAccount/guid-xyz-098/cushion unchanged\nIAMServiceAccount/guid-xyz-098/k8s-cfg-connector unchanged\nIAMServiceAccount/guid-xyz-098/syncedobject-infra-kcc-sa unchanged\nLoggingLogExclusion/guid-xyz-098/aggregated-logs-exclusion unchanged\nPubSubSubscription/guid-xyz-098/cushion unchanged\nStorageBucket/guid-xyz-098/ret-edge-dho2i0jbcm70e60zd8li0 unchanged"} 2023-06-05T14:18:03.0203996Z {"severity":"info","ts":1685974679.2962868,"logger":"project-infra","message":"inventory","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","diff":[]} 2023-06-05T14:18:03.0206707Z {"severity":"info","ts":1685974679.2964063,"logger":"copy-platform-secrets","message":"copying platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","source":"mock gcp projectid","destination":"ret-edge-dho2i0jbcm70e60zd8li0"} 2023-06-05T14:18:03.0209596Z {"severity":"info","ts":1685974679.2964272,"logger":"copy-platform-secrets","message":"copied platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","projectID":"ret-edge-dho2i0jbcm70e60zd8li0"} 2023-06-05T14:18:03.0212166Z {"severity":"info","ts":1685974679.2964401,"logger":"add-tenant","message":"adding tenant by invoking kpt function with chariot","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","projectID":"ret-edge-dho2i0jbcm70e60zd8li0"} 2023-06-05T14:18:03.0214349Z {"severity":"info","ts":1685974679.2964463,"logger":"add-tenant","message":"committed kpt fn","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","projectID":"ret-edge-dho2i0jbcm70e60zd8li0","sha":""} 2023-06-05T14:18:03.0239616Z {"severity":"info","ts":1685974679.3047729,"message":"reconciled banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-xyz-098"},"namespace":"","name":"guid-xyz-098","reconcileID":"4f1f649d-a4ef-43ad-8dc7-f9a562455b91","banner":{"kind":"Banner","apiVersion":"edge.ncr.com/v1alpha1","metadata":{"name":"guid-xyz-098","uid":"f34e3872-9b26-48a6-83f1-3742e69a7826","resourceVersion":"697","generation":1,"creationTimestamp":"2023-06-05T14:17:58Z","managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:17:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:spec":{".":{},"f:bsl":{".":{},"f:enterpriseUnit":{},"f:organization":{".":{},"f:name":{}}},"f:displayName":{},"f:enablements":{},"f:gcp":{".":{},"f:projectId":{}}}}},{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:17:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{".":{},"f:conditions":{},"f:inventory":{".":{},"f:entries":{}},"f:projectNumber":{},"f:projectRef":{}}},"subresource":"status"}]},"spec":{"displayName":"couchdb-enabled","bsl":{"enterpriseUnit":{},"organization":{"name":"test-org"}},"gcp":{"projectId":"ret-edge-dho2i0jbcm70e60zd8li0"},"enablements":["couchdb"]},"status":{"projectRef":"guid-xyz-098/banner-project","projectNumber":"123","conditions":[{"type":"Ready","status":"True","observedGeneration":1,"lastTransitionTime":"2023-06-05T14:17:58Z","reason":"ProvisionSucceeded","message":"successfully set up banner"}],"inventory":{"entries":[{"id":"guid-xyz-098_cloudresourcemanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_cloudtrace.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_compute.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_container.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_iamcredentials.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_logging.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_monitoring.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_secretmanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_stackdriver.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-xyz-098_couchdb-ip-1_compute.cnrm.cloud.google.com_ComputeAddress","v":"v1beta1"},{"id":"guid-xyz-098_remote-access-ip-guid-xyz-098_compute.cnrm.cloud.google.com_ComputeAddress","v":"v1beta1"},{"id":"guid-xyz-098_banner-proxy-guid-xyz-098_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_couchctl-sa_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_cushion-cm_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_cushion-sa_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_ncr-charts_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_remote-access_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_remote-access-auth-service_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_remote-access-cert-guid-xyz-098_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_remote-access-host_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_vpn-controller_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_vpn-controller-gcp-sa_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_vpn-controller-rb_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_vpn-controller-secret-admin-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_vpn-controller-workload-id-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-xyz-098_fluxlist_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-xyz-098_fluxobjectget_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-xyz-098_cluster-infra-kcc-sa-gke-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cluster-infra-kcc-sa-secretadmin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cluster-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_couchctl-banner-secret-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_couchctl-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cushion-foreman-pubsubedit_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cushion-foreman-pubsubsub_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cushion-foreman-pubsubview_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cushion-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_k8s-cfg-connector-logging-logwriter_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_k8s-cfg-connector-owner_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_k8s-cfg-connector-pubsub-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_k8s-cfg-connector-workload-id_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_syncedobject-infra-kcc-sa-pubsub-publisher_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_syncedobject-infra-kcc-sa-pubsub-subscriber_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_syncedobject-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-xyz-098_cluster-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-xyz-098_couchctl_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-xyz-098_cushion_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-xyz-098_k8s-cfg-connector_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-xyz-098_syncedobject-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-xyz-098_aggregated-logs-exclusion_logging.cnrm.cloud.google.com_LoggingLogExclusion","v":"v1beta1"},{"id":"guid-xyz-098_cushion_pubsub.cnrm.cloud.google.com_PubSubSubscription","v":"v1beta1"},{"id":"guid-xyz-098_ret-edge-dho2i0jbcm70e60zd8li0_storage.cnrm.cloud.google.com_StorageBucket","v":"v1beta1"}]}}}} 2023-06-05T14:18:03.0256555Z {"severity":"info","ts":1685974679.3049545,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"78644732-d418-4efc-8c64-b13b7958ec2d"} 2023-06-05T14:18:03.0259259Z {"severity":"info","ts":1685974679.3139753,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"78644732-d418-4efc-8c64-b13b7958ec2d","namespace":"guid-abc-123","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0265629Z {"severity":"error","ts":1685974679.319532,"logger":"project","message":"failed to get project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"78644732-d418-4efc-8c64-b13b7958ec2d","error":"Project.resourcemanager.cnrm.cloud.google.com \"banner-project\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProject\n\tpkg/edge/controllers/bannerctl/bannerctl.go:592\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:333\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0272059Z {"severity":"error","ts":1685974679.3243628,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"78644732-d418-4efc-8c64-b13b7958ec2d","error":"Project.resourcemanager.cnrm.cloud.google.com \"banner-project\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0275050Z {"severity":"info","ts":1685974679.3245022,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"cf1936e0-851b-4d8d-9cf8-4c6ce26b39ca"} 2023-06-05T14:18:03.0277541Z {"severity":"info","ts":1685974679.3271837,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"cf1936e0-851b-4d8d-9cf8-4c6ce26b39ca","namespace":"guid-abc-123","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0279886Z {"severity":"info","ts":1685974679.3304338,"logger":"project","message":"project is not ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"cf1936e0-851b-4d8d-9cf8-4c6ce26b39ca","reason":""} 2023-06-05T14:18:03.0283454Z {"severity":"error","ts":1685974679.3354502,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"cf1936e0-851b-4d8d-9cf8-4c6ce26b39ca","error":"project isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0286572Z {"severity":"info","ts":1685974679.335578,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"e20e0bb0-0c9a-4ba3-aacf-5b7e76358d28"} 2023-06-05T14:18:03.0288993Z {"severity":"info","ts":1685974679.3381994,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"e20e0bb0-0c9a-4ba3-aacf-5b7e76358d28","namespace":"guid-abc-123","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0291132Z {"severity":"info","ts":1685974679.3421893,"logger":"project","message":"project is not ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"e20e0bb0-0c9a-4ba3-aacf-5b7e76358d28","reason":""} 2023-06-05T14:18:03.0294892Z {"severity":"error","ts":1685974679.3477993,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"e20e0bb0-0c9a-4ba3-aacf-5b7e76358d28","error":"project isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0297872Z {"severity":"info","ts":1685974679.3479073,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"8d4cf7e7-d297-4afe-9fea-f042d5cdac54"} 2023-06-05T14:18:03.0300323Z {"severity":"info","ts":1685974679.3507752,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"8d4cf7e7-d297-4afe-9fea-f042d5cdac54","namespace":"guid-abc-123","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0302745Z {"severity":"info","ts":1685974679.3544755,"logger":"project","message":"project is not ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"8d4cf7e7-d297-4afe-9fea-f042d5cdac54","reason":""} 2023-06-05T14:18:03.0306494Z {"severity":"error","ts":1685974679.36024,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"8d4cf7e7-d297-4afe-9fea-f042d5cdac54","error":"project isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0309457Z {"severity":"info","ts":1685974679.3627348,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f"} 2023-06-05T14:18:03.0311911Z {"severity":"info","ts":1685974679.366082,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","namespace":"guid-abc-123","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0317618Z {"severity":"info","ts":1685974679.3705626,"logger":"project","message":"project is ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","project":{"name":"banner-project","namespace":"guid-abc-123","uid":"89983e5e-d431-4b1b-afa1-7604529f88c2","resourceVersion":"704","generation":2,"creationTimestamp":"2023-06-05T14:17:59Z","annotations":{"bsl.edge.ncr.com/banner":"testy-mcbanner","bsl.edge.ncr.com/organization":"test-org","cnrm.cloud.google.com/project-id":"ret-edge-obwgmua22wew5umo5a2r1"},"ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"resourcemanager.cnrm.cloud.google.com/v1beta1","time":"2023-06-05T14:17:59Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:bsl.edge.ncr.com/banner":{},"f:bsl.edge.ncr.com/organization":{},"f:cnrm.cloud.google.com/project-id":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"262b2233-0f3e-462a-9060-48f12dc9f4a4\"}":{}}},"f:spec":{".":{},"f:billingAccountRef":{},"f:folderRef":{},"f:name":{},"f:resourceID":{}},"f:status":{".":{},"f:conditions":{},"f:number":{}}}}]}} 2023-06-05T14:18:03.0337225Z Fetching cluster registration data... 2023-06-05T14:18:03.0337670Z cluster registration data retrieved 2023-06-05T14:18:03.0338074Z Cluster registered with Edge! 2023-06-05T14:18:03.0338673Z Cluster edge ID: test-registration-id 2023-06-05T14:18:03.0345831Z {"severity":"error","ts":1685974679.3822572,"logger":"createRemoteAccessComputeAddress","message":"failed to delete existing remote access ComputeAddress resource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","projectID":"ret-edge-obwgmua22wew5umo5a2r1","name":"guid-abc-123-remote-access-ip-1","namespace":"guid-abc-123","error":"computeaddresses.compute.cnrm.cloud.google.com \"guid-abc-123-remote-access-ip-1\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).createRemoteAccessComputeAddress\n\tpkg/edge/controllers/bannerctl/remote_access.go:56\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProjectInfra\n\tpkg/edge/controllers/bannerctl/bannerctl.go:475\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:350\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0351812Z {"severity":"info","ts":1685974679.3824062,"logger":"remote-access-sobj","message":"creating k8s resources for vpnctl","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0354299Z {"severity":"info","ts":1685974679.382523,"logger":"remote-access-sobj","message":"creating k8s resources for remote access","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0366542Z {"severity":"info","ts":1685974679.715297,"logger":"project-infra","message":"project infrastructure applied","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","projectID":"ret-edge-obwgmua22wew5umo5a2r1","changeset":"Service/guid-abc-123/cloudresourcemanager.googleapis.com created\nService/guid-abc-123/cloudtrace.googleapis.com created\nService/guid-abc-123/compute.googleapis.com created\nService/guid-abc-123/container.googleapis.com created\nService/guid-abc-123/iamcredentials.googleapis.com created\nService/guid-abc-123/logging.googleapis.com created\nService/guid-abc-123/monitoring.googleapis.com created\nService/guid-abc-123/secretmanager.googleapis.com created\nService/guid-abc-123/stackdriver.googleapis.com created\nComputeAddress/guid-abc-123/remote-access-ip-guid-abc-123 created\nSyncedObject/guid-abc-123/banner-proxy-guid-abc-123 created\nSyncedObject/guid-abc-123/ncr-charts created\nSyncedObject/guid-abc-123/remote-access created\nSyncedObject/guid-abc-123/remote-access-auth-service created\nSyncedObject/guid-abc-123/remote-access-cert-guid-abc-123 created\nSyncedObject/guid-abc-123/remote-access-host created\nSyncedObject/guid-abc-123/vpn-controller created\nSyncedObject/guid-abc-123/vpn-controller-gcp-sa created\nSyncedObject/guid-abc-123/vpn-controller-rb created\nSyncedObject/guid-abc-123/vpn-controller-secret-admin-binding created\nSyncedObject/guid-abc-123/vpn-controller-workload-id-binding created\nIAMCustomRole/guid-abc-123/fluxlist created\nIAMCustomRole/guid-abc-123/fluxobjectget created\nIAMPolicyMember/guid-abc-123/cluster-infra-kcc-sa-gke-admin created\nIAMPolicyMember/guid-abc-123/cluster-infra-kcc-sa-secretadmin created\nIAMPolicyMember/guid-abc-123/cluster-infra-kcc-sa-workload-identity-user created\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-logging-logwriter created\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-owner created\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-pubsub-admin created\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-workload-id created\nIAMPolicyMember/guid-abc-123/syncedobject-infra-kcc-sa-pubsub-publisher created\nIAMPolicyMember/guid-abc-123/syncedobject-infra-kcc-sa-pubsub-subscriber created\nIAMPolicyMember/guid-abc-123/syncedobject-infra-kcc-sa-workload-identity-user created\nIAMServiceAccount/guid-abc-123/cluster-infra-kcc-sa created\nIAMServiceAccount/guid-abc-123/k8s-cfg-connector created\nIAMServiceAccount/guid-abc-123/syncedobject-infra-kcc-sa created\nLoggingLogExclusion/guid-abc-123/aggregated-logs-exclusion created\nStorageBucket/guid-abc-123/ret-edge-obwgmua22wew5umo5a2r1 created"} 2023-06-05T14:18:03.0377413Z {"severity":"info","ts":1685974679.7155285,"logger":"copy-platform-secrets","message":"copying platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","projectID":"ret-edge-obwgmua22wew5umo5a2r1","projectID":"ret-edge-obwgmua22wew5umo5a2r1","source":"mock gcp projectid","destination":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0380124Z {"severity":"info","ts":1685974679.7155545,"logger":"copy-platform-secrets","message":"copied platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","projectID":"ret-edge-obwgmua22wew5umo5a2r1","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0382438Z {"severity":"info","ts":1685974679.7155643,"logger":"add-tenant","message":"adding tenant by invoking kpt function with chariot","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0384522Z {"severity":"info","ts":1685974679.7155702,"logger":"add-tenant","message":"committed kpt fn","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","projectID":"ret-edge-obwgmua22wew5umo5a2r1","sha":""} 2023-06-05T14:18:03.0405518Z {"severity":"info","ts":1685974679.721302,"message":"reconciled banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"ac7ad29e-8974-4f52-b5e4-f0e2800c732f","banner":{"kind":"Banner","apiVersion":"edge.ncr.com/v1alpha1","metadata":{"name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","resourceVersion":"703","generation":1,"creationTimestamp":"2023-06-05T14:17:59Z","managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:17:59Z","fieldsType":"FieldsV1","fieldsV1":{"f:spec":{".":{},"f:bsl":{".":{},"f:enterpriseUnit":{},"f:organization":{".":{},"f:name":{}}},"f:displayName":{},"f:gcp":{".":{},"f:projectId":{}}}}},{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:17:59Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{".":{},"f:conditions":{},"f:projectRef":{}}},"subresource":"status"}]},"spec":{"displayName":"testy-mcbanner","bsl":{"enterpriseUnit":{},"organization":{"name":"test-org"}},"gcp":{"projectId":"ret-edge-obwgmua22wew5umo5a2r1"}},"status":{"projectRef":"guid-abc-123/banner-project","projectNumber":"123","conditions":[{"type":"Ready","status":"True","observedGeneration":1,"lastTransitionTime":"2023-06-05T14:17:59Z","reason":"ProvisionSucceeded","message":"successfully set up banner"}],"clusterInfraClusterEdgeID":"test-registration-id","clusterInfraClusterProjectID":"ret-edge-obwgmua22wew5umo5a2r1","inventory":{"entries":[{"id":"guid-abc-123_cloudresourcemanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_cloudtrace.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_compute.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_container.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_iamcredentials.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_logging.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_monitoring.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_secretmanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_stackdriver.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_remote-access-ip-guid-abc-123_compute.cnrm.cloud.google.com_ComputeAddress","v":"v1beta1"},{"id":"guid-abc-123_banner-proxy-guid-abc-123_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_ncr-charts_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access-auth-service_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access-cert-guid-abc-123_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access-host_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-gcp-sa_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-rb_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-secret-admin-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-workload-id-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_fluxlist_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-abc-123_fluxobjectget_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa-gke-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa-secretadmin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-logging-logwriter_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-owner_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-pubsub-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-workload-id_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa-pubsub-publisher_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa-pubsub-subscriber_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-abc-123_aggregated-logs-exclusion_logging.cnrm.cloud.google.com_LoggingLogExclusion","v":"v1beta1"},{"id":"guid-abc-123_ret-edge-obwgmua22wew5umo5a2r1_storage.cnrm.cloud.google.com_StorageBucket","v":"v1beta1"}]}}}} 2023-06-05T14:18:03.0419493Z {"severity":"info","ts":1685974679.7215216,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5"} 2023-06-05T14:18:03.0422087Z {"severity":"info","ts":1685974679.7379649,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","namespace":"guid-abc-123","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0427820Z {"severity":"info","ts":1685974679.7500024,"logger":"project","message":"project is ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","project":{"name":"banner-project","namespace":"guid-abc-123","uid":"89983e5e-d431-4b1b-afa1-7604529f88c2","resourceVersion":"704","generation":2,"creationTimestamp":"2023-06-05T14:17:59Z","annotations":{"bsl.edge.ncr.com/banner":"testy-mcbanner","bsl.edge.ncr.com/organization":"test-org","cnrm.cloud.google.com/project-id":"ret-edge-obwgmua22wew5umo5a2r1"},"ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"resourcemanager.cnrm.cloud.google.com/v1beta1","time":"2023-06-05T14:17:59Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:bsl.edge.ncr.com/banner":{},"f:bsl.edge.ncr.com/organization":{},"f:cnrm.cloud.google.com/project-id":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"262b2233-0f3e-462a-9060-48f12dc9f4a4\"}":{}}},"f:spec":{".":{},"f:billingAccountRef":{},"f:folderRef":{},"f:name":{},"f:resourceID":{}},"f:status":{".":{},"f:conditions":{},"f:number":{}}}}]}} 2023-06-05T14:18:03.0430797Z Fetching cluster registration data... 2023-06-05T14:18:03.0431208Z cluster registration data retrieved 2023-06-05T14:18:03.0431632Z Cluster registered with Edge! 2023-06-05T14:18:03.0432146Z Cluster edge ID: test-registration-id 2023-06-05T14:18:03.0439187Z {"severity":"error","ts":1685974679.7606242,"logger":"createRemoteAccessComputeAddress","message":"failed to delete existing remote access ComputeAddress resource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","projectID":"ret-edge-obwgmua22wew5umo5a2r1","name":"guid-abc-123-remote-access-ip-1","namespace":"guid-abc-123","error":"computeaddresses.compute.cnrm.cloud.google.com \"guid-abc-123-remote-access-ip-1\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).createRemoteAccessComputeAddress\n\tpkg/edge/controllers/bannerctl/remote_access.go:56\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProjectInfra\n\tpkg/edge/controllers/bannerctl/bannerctl.go:475\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:350\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0444882Z {"severity":"info","ts":1685974679.7607527,"logger":"remote-access-sobj","message":"creating k8s resources for vpnctl","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0447147Z {"severity":"info","ts":1685974679.7608495,"logger":"remote-access-sobj","message":"creating k8s resources for remote access","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0459303Z {"severity":"info","ts":1685974680.008517,"logger":"project-infra","message":"project infrastructure applied","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","projectID":"ret-edge-obwgmua22wew5umo5a2r1","changeset":"Service/guid-abc-123/cloudresourcemanager.googleapis.com unchanged\nService/guid-abc-123/cloudtrace.googleapis.com unchanged\nService/guid-abc-123/compute.googleapis.com unchanged\nService/guid-abc-123/container.googleapis.com unchanged\nService/guid-abc-123/iamcredentials.googleapis.com unchanged\nService/guid-abc-123/logging.googleapis.com unchanged\nService/guid-abc-123/monitoring.googleapis.com unchanged\nService/guid-abc-123/secretmanager.googleapis.com unchanged\nService/guid-abc-123/stackdriver.googleapis.com unchanged\nComputeAddress/guid-abc-123/remote-access-ip-guid-abc-123 unchanged\nSyncedObject/guid-abc-123/banner-proxy-guid-abc-123 unchanged\nSyncedObject/guid-abc-123/ncr-charts unchanged\nSyncedObject/guid-abc-123/remote-access unchanged\nSyncedObject/guid-abc-123/remote-access-auth-service unchanged\nSyncedObject/guid-abc-123/remote-access-cert-guid-abc-123 unchanged\nSyncedObject/guid-abc-123/remote-access-host unchanged\nSyncedObject/guid-abc-123/vpn-controller unchanged\nSyncedObject/guid-abc-123/vpn-controller-gcp-sa unchanged\nSyncedObject/guid-abc-123/vpn-controller-rb unchanged\nSyncedObject/guid-abc-123/vpn-controller-secret-admin-binding unchanged\nSyncedObject/guid-abc-123/vpn-controller-workload-id-binding unchanged\nIAMCustomRole/guid-abc-123/fluxlist unchanged\nIAMCustomRole/guid-abc-123/fluxobjectget unchanged\nIAMPolicyMember/guid-abc-123/cluster-infra-kcc-sa-gke-admin unchanged\nIAMPolicyMember/guid-abc-123/cluster-infra-kcc-sa-secretadmin unchanged\nIAMPolicyMember/guid-abc-123/cluster-infra-kcc-sa-workload-identity-user unchanged\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-logging-logwriter unchanged\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-owner unchanged\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-pubsub-admin unchanged\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-workload-id unchanged\nIAMPolicyMember/guid-abc-123/syncedobject-infra-kcc-sa-pubsub-publisher unchanged\nIAMPolicyMember/guid-abc-123/syncedobject-infra-kcc-sa-pubsub-subscriber unchanged\nIAMPolicyMember/guid-abc-123/syncedobject-infra-kcc-sa-workload-identity-user unchanged\nIAMServiceAccount/guid-abc-123/cluster-infra-kcc-sa unchanged\nIAMServiceAccount/guid-abc-123/k8s-cfg-connector unchanged\nIAMServiceAccount/guid-abc-123/syncedobject-infra-kcc-sa unchanged\nLoggingLogExclusion/guid-abc-123/aggregated-logs-exclusion unchanged\nStorageBucket/guid-abc-123/ret-edge-obwgmua22wew5umo5a2r1 unchanged"} 2023-06-05T14:18:03.0468577Z {"severity":"info","ts":1685974680.0087333,"logger":"project-infra","message":"inventory","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","projectID":"ret-edge-obwgmua22wew5umo5a2r1","diff":[]} 2023-06-05T14:18:03.0471302Z {"severity":"info","ts":1685974680.008811,"logger":"copy-platform-secrets","message":"copying platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","projectID":"ret-edge-obwgmua22wew5umo5a2r1","projectID":"ret-edge-obwgmua22wew5umo5a2r1","source":"mock gcp projectid","destination":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0473998Z {"severity":"info","ts":1685974680.0088356,"logger":"copy-platform-secrets","message":"copied platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","projectID":"ret-edge-obwgmua22wew5umo5a2r1","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0476381Z {"severity":"info","ts":1685974680.0088468,"logger":"add-tenant","message":"adding tenant by invoking kpt function with chariot","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0478519Z {"severity":"info","ts":1685974680.0088563,"logger":"add-tenant","message":"committed kpt fn","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","projectID":"ret-edge-obwgmua22wew5umo5a2r1","sha":""} 2023-06-05T14:18:03.0500319Z {"severity":"info","ts":1685974680.0538173,"message":"reconciled banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"bb9a0436-726b-483b-adad-ed8f503bb6d5","banner":{"kind":"Banner","apiVersion":"edge.ncr.com/v1alpha1","metadata":{"name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","resourceVersion":"753","generation":1,"creationTimestamp":"2023-06-05T14:17:59Z","managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:17:59Z","fieldsType":"FieldsV1","fieldsV1":{"f:spec":{".":{},"f:bsl":{".":{},"f:enterpriseUnit":{},"f:organization":{".":{},"f:name":{}}},"f:displayName":{},"f:gcp":{".":{},"f:projectId":{}}}}},{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:17:59Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{".":{},"f:clusterInfraClusterEdgeID":{},"f:clusterInfraClusterProjectID":{},"f:conditions":{},"f:inventory":{".":{},"f:entries":{}},"f:projectNumber":{},"f:projectRef":{}}},"subresource":"status"}]},"spec":{"displayName":"testy-mcbanner","bsl":{"enterpriseUnit":{},"organization":{"name":"test-org"}},"gcp":{"projectId":"ret-edge-obwgmua22wew5umo5a2r1"}},"status":{"projectRef":"guid-abc-123/banner-project","projectNumber":"123","conditions":[{"type":"Ready","status":"True","observedGeneration":1,"lastTransitionTime":"2023-06-05T14:17:59Z","reason":"ProvisionSucceeded","message":"successfully set up banner"}],"clusterInfraClusterEdgeID":"test-registration-id","clusterInfraClusterProjectID":"ret-edge-obwgmua22wew5umo5a2r1","inventory":{"entries":[{"id":"guid-abc-123_cloudresourcemanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_cloudtrace.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_compute.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_container.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_iamcredentials.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_logging.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_monitoring.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_secretmanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_stackdriver.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_remote-access-ip-guid-abc-123_compute.cnrm.cloud.google.com_ComputeAddress","v":"v1beta1"},{"id":"guid-abc-123_banner-proxy-guid-abc-123_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_ncr-charts_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access-auth-service_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access-cert-guid-abc-123_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access-host_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-gcp-sa_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-rb_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-secret-admin-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-workload-id-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_fluxlist_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-abc-123_fluxobjectget_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa-gke-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa-secretadmin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-logging-logwriter_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-owner_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-pubsub-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-workload-id_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa-pubsub-publisher_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa-pubsub-subscriber_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-abc-123_aggregated-logs-exclusion_logging.cnrm.cloud.google.com_LoggingLogExclusion","v":"v1beta1"},{"id":"guid-abc-123_ret-edge-obwgmua22wew5umo5a2r1_storage.cnrm.cloud.google.com_StorageBucket","v":"v1beta1"}]}}}} 2023-06-05T14:18:03.0514275Z {"severity":"info","ts":1685974680.0540757,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753"} 2023-06-05T14:18:03.0516953Z {"severity":"info","ts":1685974680.063599,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","namespace":"guid-abc-123","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0522720Z {"severity":"info","ts":1685974680.0698786,"logger":"project","message":"project is ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","project":{"name":"banner-project","namespace":"guid-abc-123","uid":"89983e5e-d431-4b1b-afa1-7604529f88c2","resourceVersion":"704","generation":2,"creationTimestamp":"2023-06-05T14:17:59Z","annotations":{"bsl.edge.ncr.com/banner":"testy-mcbanner","bsl.edge.ncr.com/organization":"test-org","cnrm.cloud.google.com/project-id":"ret-edge-obwgmua22wew5umo5a2r1"},"ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"resourcemanager.cnrm.cloud.google.com/v1beta1","time":"2023-06-05T14:17:59Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:bsl.edge.ncr.com/banner":{},"f:bsl.edge.ncr.com/organization":{},"f:cnrm.cloud.google.com/project-id":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"262b2233-0f3e-462a-9060-48f12dc9f4a4\"}":{}}},"f:spec":{".":{},"f:billingAccountRef":{},"f:folderRef":{},"f:name":{},"f:resourceID":{}},"f:status":{".":{},"f:conditions":{},"f:number":{}}}}]}} 2023-06-05T14:18:03.0525683Z Fetching cluster registration data... 2023-06-05T14:18:03.0526171Z cluster registration data retrieved 2023-06-05T14:18:03.0526564Z Cluster registered with Edge! 2023-06-05T14:18:03.0527066Z Cluster edge ID: test-registration-id 2023-06-05T14:18:03.0534108Z {"severity":"error","ts":1685974680.086258,"logger":"createRemoteAccessComputeAddress","message":"failed to delete existing remote access ComputeAddress resource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","projectID":"ret-edge-obwgmua22wew5umo5a2r1","name":"guid-abc-123-remote-access-ip-1","namespace":"guid-abc-123","error":"computeaddresses.compute.cnrm.cloud.google.com \"guid-abc-123-remote-access-ip-1\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).createRemoteAccessComputeAddress\n\tpkg/edge/controllers/bannerctl/remote_access.go:56\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProjectInfra\n\tpkg/edge/controllers/bannerctl/bannerctl.go:475\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:350\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0541918Z {"severity":"info","ts":1685974680.0864246,"logger":"remote-access-sobj","message":"creating k8s resources for vpnctl","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0544293Z {"severity":"info","ts":1685974680.0865319,"logger":"remote-access-sobj","message":"creating k8s resources for remote access","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0556734Z {"severity":"info","ts":1685974680.3319929,"logger":"project-infra","message":"project infrastructure applied","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","projectID":"ret-edge-obwgmua22wew5umo5a2r1","changeset":"Service/guid-abc-123/cloudresourcemanager.googleapis.com unchanged\nService/guid-abc-123/cloudtrace.googleapis.com unchanged\nService/guid-abc-123/compute.googleapis.com unchanged\nService/guid-abc-123/container.googleapis.com unchanged\nService/guid-abc-123/iamcredentials.googleapis.com unchanged\nService/guid-abc-123/logging.googleapis.com unchanged\nService/guid-abc-123/monitoring.googleapis.com unchanged\nService/guid-abc-123/secretmanager.googleapis.com unchanged\nService/guid-abc-123/stackdriver.googleapis.com unchanged\nComputeAddress/guid-abc-123/remote-access-ip-guid-abc-123 unchanged\nSyncedObject/guid-abc-123/banner-proxy-guid-abc-123 unchanged\nSyncedObject/guid-abc-123/ncr-charts unchanged\nSyncedObject/guid-abc-123/remote-access unchanged\nSyncedObject/guid-abc-123/remote-access-auth-service unchanged\nSyncedObject/guid-abc-123/remote-access-cert-guid-abc-123 unchanged\nSyncedObject/guid-abc-123/remote-access-host unchanged\nSyncedObject/guid-abc-123/vpn-controller unchanged\nSyncedObject/guid-abc-123/vpn-controller-gcp-sa unchanged\nSyncedObject/guid-abc-123/vpn-controller-rb unchanged\nSyncedObject/guid-abc-123/vpn-controller-secret-admin-binding unchanged\nSyncedObject/guid-abc-123/vpn-controller-workload-id-binding unchanged\nIAMCustomRole/guid-abc-123/fluxlist unchanged\nIAMCustomRole/guid-abc-123/fluxobjectget unchanged\nIAMPolicyMember/guid-abc-123/cluster-infra-kcc-sa-gke-admin unchanged\nIAMPolicyMember/guid-abc-123/cluster-infra-kcc-sa-secretadmin unchanged\nIAMPolicyMember/guid-abc-123/cluster-infra-kcc-sa-workload-identity-user unchanged\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-logging-logwriter unchanged\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-owner unchanged\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-pubsub-admin unchanged\nIAMPolicyMember/guid-abc-123/k8s-cfg-connector-workload-id unchanged\nIAMPolicyMember/guid-abc-123/syncedobject-infra-kcc-sa-pubsub-publisher unchanged\nIAMPolicyMember/guid-abc-123/syncedobject-infra-kcc-sa-pubsub-subscriber unchanged\nIAMPolicyMember/guid-abc-123/syncedobject-infra-kcc-sa-workload-identity-user unchanged\nIAMServiceAccount/guid-abc-123/cluster-infra-kcc-sa unchanged\nIAMServiceAccount/guid-abc-123/k8s-cfg-connector unchanged\nIAMServiceAccount/guid-abc-123/syncedobject-infra-kcc-sa unchanged\nLoggingLogExclusion/guid-abc-123/aggregated-logs-exclusion unchanged\nStorageBucket/guid-abc-123/ret-edge-obwgmua22wew5umo5a2r1 unchanged"} 2023-06-05T14:18:03.0565566Z {"severity":"info","ts":1685974680.3321822,"logger":"project-infra","message":"inventory","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","projectID":"ret-edge-obwgmua22wew5umo5a2r1","diff":[]} 2023-06-05T14:18:03.0568631Z {"severity":"info","ts":1685974680.3322604,"logger":"copy-platform-secrets","message":"copying platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","projectID":"ret-edge-obwgmua22wew5umo5a2r1","projectID":"ret-edge-obwgmua22wew5umo5a2r1","source":"mock gcp projectid","destination":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0571672Z {"severity":"info","ts":1685974680.3322864,"logger":"copy-platform-secrets","message":"copied platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","projectID":"ret-edge-obwgmua22wew5umo5a2r1","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0574023Z {"severity":"info","ts":1685974680.3322957,"logger":"add-tenant","message":"adding tenant by invoking kpt function with chariot","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","projectID":"ret-edge-obwgmua22wew5umo5a2r1"} 2023-06-05T14:18:03.0576165Z {"severity":"info","ts":1685974680.3323011,"logger":"add-tenant","message":"committed kpt fn","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","projectID":"ret-edge-obwgmua22wew5umo5a2r1","sha":""} 2023-06-05T14:18:03.0597598Z {"severity":"info","ts":1685974680.3382268,"message":"reconciled banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-abc-123"},"namespace":"","name":"guid-abc-123","reconcileID":"84d36e5d-ceee-4be9-9152-cc3e378c7753","banner":{"kind":"Banner","apiVersion":"edge.ncr.com/v1alpha1","metadata":{"name":"guid-abc-123","uid":"262b2233-0f3e-462a-9060-48f12dc9f4a4","resourceVersion":"753","generation":1,"creationTimestamp":"2023-06-05T14:17:59Z","managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:17:59Z","fieldsType":"FieldsV1","fieldsV1":{"f:spec":{".":{},"f:bsl":{".":{},"f:enterpriseUnit":{},"f:organization":{".":{},"f:name":{}}},"f:displayName":{},"f:gcp":{".":{},"f:projectId":{}}}}},{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:17:59Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{".":{},"f:clusterInfraClusterEdgeID":{},"f:clusterInfraClusterProjectID":{},"f:conditions":{},"f:inventory":{".":{},"f:entries":{}},"f:projectNumber":{},"f:projectRef":{}}},"subresource":"status"}]},"spec":{"displayName":"testy-mcbanner","bsl":{"enterpriseUnit":{},"organization":{"name":"test-org"}},"gcp":{"projectId":"ret-edge-obwgmua22wew5umo5a2r1"}},"status":{"projectRef":"guid-abc-123/banner-project","projectNumber":"123","conditions":[{"type":"Ready","status":"True","observedGeneration":1,"lastTransitionTime":"2023-06-05T14:17:59Z","reason":"ProvisionSucceeded","message":"successfully set up banner"}],"clusterInfraClusterEdgeID":"test-registration-id","clusterInfraClusterProjectID":"ret-edge-obwgmua22wew5umo5a2r1","inventory":{"entries":[{"id":"guid-abc-123_cloudresourcemanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_cloudtrace.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_compute.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_container.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_iamcredentials.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_logging.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_monitoring.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_secretmanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_stackdriver.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-abc-123_remote-access-ip-guid-abc-123_compute.cnrm.cloud.google.com_ComputeAddress","v":"v1beta1"},{"id":"guid-abc-123_banner-proxy-guid-abc-123_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_ncr-charts_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access-auth-service_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access-cert-guid-abc-123_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_remote-access-host_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-gcp-sa_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-rb_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-secret-admin-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_vpn-controller-workload-id-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-abc-123_fluxlist_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-abc-123_fluxobjectget_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa-gke-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa-secretadmin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-logging-logwriter_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-owner_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-pubsub-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector-workload-id_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa-pubsub-publisher_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa-pubsub-subscriber_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-abc-123_cluster-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-abc-123_k8s-cfg-connector_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-abc-123_syncedobject-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-abc-123_aggregated-logs-exclusion_logging.cnrm.cloud.google.com_LoggingLogExclusion","v":"v1beta1"},{"id":"guid-abc-123_ret-edge-obwgmua22wew5umo5a2r1_storage.cnrm.cloud.google.com_StorageBucket","v":"v1beta1"}]}}}} 2023-06-05T14:18:03.0610486Z === RUN TestBannerController/TestBannerCreation_UsingWarehouse 2023-06-05T14:18:03.0612364Z {"severity":"info","ts":1685974680.393856,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"dfb0847d-570f-4606-b810-be27c2f70284"} 2023-06-05T14:18:03.0615101Z {"severity":"info","ts":1685974680.4004936,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"dfb0847d-570f-4606-b810-be27c2f70284","namespace":"dev1-banner-use-warehouse","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"dev1-banner-use-warehouse","uid":"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0621804Z {"severity":"error","ts":1685974680.4050343,"logger":"project","message":"failed to get project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"dfb0847d-570f-4606-b810-be27c2f70284","error":"Project.resourcemanager.cnrm.cloud.google.com \"banner-project\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProject\n\tpkg/edge/controllers/bannerctl/bannerctl.go:592\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:333\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0628675Z {"severity":"error","ts":1685974680.4085526,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"dfb0847d-570f-4606-b810-be27c2f70284","error":"Project.resourcemanager.cnrm.cloud.google.com \"banner-project\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0631860Z {"severity":"info","ts":1685974680.4086523,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"0cfc62d4-1830-473e-bbad-779cc8723657"} 2023-06-05T14:18:03.0634731Z {"severity":"info","ts":1685974680.4110417,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"0cfc62d4-1830-473e-bbad-779cc8723657","namespace":"dev1-banner-use-warehouse","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"dev1-banner-use-warehouse","uid":"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0637232Z {"severity":"info","ts":1685974680.4141552,"logger":"project","message":"project is not ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"0cfc62d4-1830-473e-bbad-779cc8723657","reason":""} 2023-06-05T14:18:03.0641222Z {"severity":"error","ts":1685974680.417627,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"0cfc62d4-1830-473e-bbad-779cc8723657","error":"project isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0644351Z {"severity":"info","ts":1685974680.417716,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"adcec5a1-1744-4a3a-8625-5867688873c3"} 2023-06-05T14:18:03.0647181Z {"severity":"info","ts":1685974680.419872,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"adcec5a1-1744-4a3a-8625-5867688873c3","namespace":"dev1-banner-use-warehouse","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"dev1-banner-use-warehouse","uid":"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0649615Z {"severity":"info","ts":1685974680.4229455,"logger":"project","message":"project is not ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"adcec5a1-1744-4a3a-8625-5867688873c3","reason":""} 2023-06-05T14:18:03.0653540Z {"severity":"error","ts":1685974680.4264534,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"adcec5a1-1744-4a3a-8625-5867688873c3","error":"project isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0656642Z {"severity":"info","ts":1685974680.428773,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"2a8cc83e-8d69-49c2-8638-53291b5edab6"} 2023-06-05T14:18:03.0659417Z {"severity":"info","ts":1685974680.4310727,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"2a8cc83e-8d69-49c2-8638-53291b5edab6","namespace":"dev1-banner-use-warehouse","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"dev1-banner-use-warehouse","uid":"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0661964Z {"severity":"info","ts":1685974680.434283,"logger":"project","message":"project is not ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"2a8cc83e-8d69-49c2-8638-53291b5edab6","reason":""} 2023-06-05T14:18:03.0666174Z {"severity":"error","ts":1685974680.4378793,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"2a8cc83e-8d69-49c2-8638-53291b5edab6","error":"project isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0669338Z {"severity":"info","ts":1685974680.4498522,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"fd1b5e07-024e-45bd-9eb8-a314deba81a1"} 2023-06-05T14:18:03.0672150Z {"severity":"info","ts":1685974680.4524903,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"fd1b5e07-024e-45bd-9eb8-a314deba81a1","namespace":"dev1-banner-use-warehouse","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"dev1-banner-use-warehouse","uid":"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0678352Z {"severity":"info","ts":1685974680.4557319,"logger":"project","message":"project is ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"fd1b5e07-024e-45bd-9eb8-a314deba81a1","project":{"name":"banner-project","namespace":"dev1-banner-use-warehouse","uid":"9ca30886-6f9a-4251-ac22-83f536e88fa1","resourceVersion":"760","generation":2,"creationTimestamp":"2023-06-05T14:18:00Z","annotations":{"bsl.edge.ncr.com/banner":"testy-mcbanner-dev1","bsl.edge.ncr.com/organization":"test-org-dev1","cnrm.cloud.google.com/project-id":"ret-edge-bimhmz3lmkw0ddbgq851r"},"ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"dev1-banner-use-warehouse","uid":"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"resourcemanager.cnrm.cloud.google.com/v1beta1","time":"2023-06-05T14:18:00Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:bsl.edge.ncr.com/banner":{},"f:bsl.edge.ncr.com/organization":{},"f:cnrm.cloud.google.com/project-id":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0\"}":{}}},"f:spec":{".":{},"f:billingAccountRef":{},"f:folderRef":{},"f:name":{},"f:resourceID":{}},"f:status":{".":{},"f:conditions":{},"f:number":{}}}}]}} 2023-06-05T14:18:03.0681488Z Fetching cluster registration data... 2023-06-05T14:18:03.0681921Z cluster registration data retrieved 2023-06-05T14:18:03.0682320Z Cluster registered with Edge! 2023-06-05T14:18:03.0682868Z Cluster edge ID: test-registration-id 2023-06-05T14:18:03.0690255Z {"severity":"error","ts":1685974680.4675782,"logger":"createRemoteAccessComputeAddress","message":"failed to delete existing remote access ComputeAddress resource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"fd1b5e07-024e-45bd-9eb8-a314deba81a1","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","name":"dev1-banner-use-warehouse-remote-access-ip-1","namespace":"dev1-banner-use-warehouse","error":"computeaddresses.compute.cnrm.cloud.google.com \"dev1-banner-use-warehouse-remote-access-ip-1\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).createRemoteAccessComputeAddress\n\tpkg/edge/controllers/bannerctl/remote_access.go:56\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProjectInfra\n\tpkg/edge/controllers/bannerctl/bannerctl.go:475\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:350\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0696629Z {"severity":"info","ts":1685974680.467733,"logger":"remote-access-sobj","message":"featureflag \"use-warehouse\" enabled, creation of vpnctl k8s resources skipped","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"fd1b5e07-024e-45bd-9eb8-a314deba81a1","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r"} 2023-06-05T14:18:03.0697967Z === RUN TestBannerController/TestBannerCreation_WithInventoryPruning 2023-06-05T14:18:03.0710167Z {"severity":"info","ts":1685974680.7228963,"logger":"project-infra","message":"project infrastructure applied","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"fd1b5e07-024e-45bd-9eb8-a314deba81a1","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","changeset":"Service/dev1-banner-use-warehouse/artifactregistry.googleapis.com created\nService/dev1-banner-use-warehouse/cloudresourcemanager.googleapis.com created\nService/dev1-banner-use-warehouse/cloudtrace.googleapis.com created\nService/dev1-banner-use-warehouse/compute.googleapis.com created\nService/dev1-banner-use-warehouse/container.googleapis.com created\nService/dev1-banner-use-warehouse/iamcredentials.googleapis.com created\nService/dev1-banner-use-warehouse/logging.googleapis.com created\nService/dev1-banner-use-warehouse/monitoring.googleapis.com created\nService/dev1-banner-use-warehouse/secretmanager.googleapis.com created\nService/dev1-banner-use-warehouse/stackdriver.googleapis.com created\nArtifactRegistryRepository/dev1-banner-use-warehouse/warehouse created\nComputeAddress/dev1-banner-use-warehouse/remote-access-ip-dev1-banner-use-warehouse created\nSyncedObject/dev1-banner-use-warehouse/banner-proxy-dev1-banner-use-warehouse created\nSyncedObject/dev1-banner-use-warehouse/ncr-charts created\nIAMCustomRole/dev1-banner-use-warehouse/fluxlist created\nIAMCustomRole/dev1-banner-use-warehouse/fluxobjectget created\nIAMPolicyMember/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761-gke-admin created\nIAMPolicyMember/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761-secretadmin created\nIAMPolicyMember/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761-workload-identity-user created\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-logging-logwriter created\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-owner created\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-pubsub-admin created\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-workload-id created\nIAMPolicyMember/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761-pubsub-publisher created\nIAMPolicyMember/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761-pubsub-subscriber created\nIAMPolicyMember/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761-workload-identity-user created\nIAMServiceAccount/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761 created\nIAMServiceAccount/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761 created\nIAMServiceAccount/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761 created\nLoggingLogExclusion/dev1-banner-use-warehouse/aggregated-logs-exclusion created\nStorageBucket/dev1-banner-use-warehouse/ret-edge-bimhmz3lmkw0ddbgq851r created"} 2023-06-05T14:18:03.0719774Z {"severity":"info","ts":1685974680.7230473,"logger":"check-API","message":"waiting for service api to become Ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"fd1b5e07-024e-45bd-9eb8-a314deba81a1","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","reason":"","api":"secretmanager.googleapis.com"} 2023-06-05T14:18:03.0723922Z {"severity":"error","ts":1685974680.7293358,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"fd1b5e07-024e-45bd-9eb8-a314deba81a1","error":"gcp api isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0726961Z {"severity":"info","ts":1685974680.729451,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"1ff6ec74-722e-44ad-badd-b154ff45f8c9"} 2023-06-05T14:18:03.0729735Z {"severity":"info","ts":1685974680.7367628,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"1ff6ec74-722e-44ad-badd-b154ff45f8c9","namespace":"guid-inventory-pruning","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-inventory-pruning","uid":"243acb63-10c0-4caa-9d29-73e7b7a64a55","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0732319Z {"severity":"info","ts":1685974680.741607,"logger":"project","message":"project is not ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"1ff6ec74-722e-44ad-badd-b154ff45f8c9","reason":""} 2023-06-05T14:18:03.0736432Z {"severity":"error","ts":1685974680.7455587,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"1ff6ec74-722e-44ad-badd-b154ff45f8c9","error":"project isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0739442Z {"severity":"info","ts":1685974680.7456644,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"9313f5f0-2f65-445e-9567-514385a4d543"} 2023-06-05T14:18:03.0742361Z {"severity":"info","ts":1685974680.7478533,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"9313f5f0-2f65-445e-9567-514385a4d543","namespace":"dev1-banner-use-warehouse","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"dev1-banner-use-warehouse","uid":"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0748663Z {"severity":"info","ts":1685974680.7512867,"logger":"project","message":"project is ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"9313f5f0-2f65-445e-9567-514385a4d543","project":{"name":"banner-project","namespace":"dev1-banner-use-warehouse","uid":"9ca30886-6f9a-4251-ac22-83f536e88fa1","resourceVersion":"760","generation":2,"creationTimestamp":"2023-06-05T14:18:00Z","annotations":{"bsl.edge.ncr.com/banner":"testy-mcbanner-dev1","bsl.edge.ncr.com/organization":"test-org-dev1","cnrm.cloud.google.com/project-id":"ret-edge-bimhmz3lmkw0ddbgq851r"},"ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"dev1-banner-use-warehouse","uid":"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"resourcemanager.cnrm.cloud.google.com/v1beta1","time":"2023-06-05T14:18:00Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:bsl.edge.ncr.com/banner":{},"f:bsl.edge.ncr.com/organization":{},"f:cnrm.cloud.google.com/project-id":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0\"}":{}}},"f:spec":{".":{},"f:billingAccountRef":{},"f:folderRef":{},"f:name":{},"f:resourceID":{}},"f:status":{".":{},"f:conditions":{},"f:number":{}}}}]}} 2023-06-05T14:18:03.0751889Z Fetching cluster registration data... 2023-06-05T14:18:03.0752304Z cluster registration data retrieved 2023-06-05T14:18:03.0752709Z Cluster registered with Edge! 2023-06-05T14:18:03.0753264Z Cluster edge ID: test-registration-id 2023-06-05T14:18:03.0760624Z {"severity":"error","ts":1685974680.764707,"logger":"createRemoteAccessComputeAddress","message":"failed to delete existing remote access ComputeAddress resource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"9313f5f0-2f65-445e-9567-514385a4d543","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","name":"dev1-banner-use-warehouse-remote-access-ip-1","namespace":"dev1-banner-use-warehouse","error":"computeaddresses.compute.cnrm.cloud.google.com \"dev1-banner-use-warehouse-remote-access-ip-1\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).createRemoteAccessComputeAddress\n\tpkg/edge/controllers/bannerctl/remote_access.go:56\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProjectInfra\n\tpkg/edge/controllers/bannerctl/bannerctl.go:475\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:350\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0766923Z {"severity":"info","ts":1685974680.7648733,"logger":"remote-access-sobj","message":"featureflag \"use-warehouse\" enabled, creation of vpnctl k8s resources skipped","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"9313f5f0-2f65-445e-9567-514385a4d543","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r"} 2023-06-05T14:18:03.0779906Z {"severity":"info","ts":1685974680.9393358,"logger":"project-infra","message":"project infrastructure applied","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"9313f5f0-2f65-445e-9567-514385a4d543","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","changeset":"Service/dev1-banner-use-warehouse/artifactregistry.googleapis.com unchanged\nService/dev1-banner-use-warehouse/cloudresourcemanager.googleapis.com unchanged\nService/dev1-banner-use-warehouse/cloudtrace.googleapis.com unchanged\nService/dev1-banner-use-warehouse/compute.googleapis.com unchanged\nService/dev1-banner-use-warehouse/container.googleapis.com unchanged\nService/dev1-banner-use-warehouse/iamcredentials.googleapis.com unchanged\nService/dev1-banner-use-warehouse/logging.googleapis.com unchanged\nService/dev1-banner-use-warehouse/monitoring.googleapis.com unchanged\nService/dev1-banner-use-warehouse/secretmanager.googleapis.com unchanged\nService/dev1-banner-use-warehouse/stackdriver.googleapis.com unchanged\nArtifactRegistryRepository/dev1-banner-use-warehouse/warehouse unchanged\nComputeAddress/dev1-banner-use-warehouse/remote-access-ip-dev1-banner-use-warehouse unchanged\nSyncedObject/dev1-banner-use-warehouse/banner-proxy-dev1-banner-use-warehouse unchanged\nSyncedObject/dev1-banner-use-warehouse/ncr-charts unchanged\nIAMCustomRole/dev1-banner-use-warehouse/fluxlist unchanged\nIAMCustomRole/dev1-banner-use-warehouse/fluxobjectget unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761-gke-admin unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761-secretadmin unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761-workload-identity-user unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-logging-logwriter unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-owner unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-pubsub-admin unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-workload-id unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761-pubsub-publisher unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761-pubsub-subscriber unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761-workload-identity-user unchanged\nIAMServiceAccount/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761 unchanged\nIAMServiceAccount/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761 unchanged\nIAMServiceAccount/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761 unchanged\nLoggingLogExclusion/dev1-banner-use-warehouse/aggregated-logs-exclusion unchanged\nStorageBucket/dev1-banner-use-warehouse/ret-edge-bimhmz3lmkw0ddbgq851r unchanged"} 2023-06-05T14:18:03.0789483Z {"severity":"info","ts":1685974680.9394789,"logger":"project-infra","message":"inventory","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"9313f5f0-2f65-445e-9567-514385a4d543","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","diff":[]} 2023-06-05T14:18:03.0792146Z {"severity":"info","ts":1685974680.939515,"logger":"check-API","message":"waiting for service api to become Ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"9313f5f0-2f65-445e-9567-514385a4d543","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","reason":"","api":"secretmanager.googleapis.com"} 2023-06-05T14:18:03.0796175Z {"severity":"error","ts":1685974680.9535062,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"9313f5f0-2f65-445e-9567-514385a4d543","error":"gcp api isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0799139Z {"severity":"info","ts":1685974680.9536521,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3"} 2023-06-05T14:18:03.0801783Z {"severity":"info","ts":1685974680.9629378,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","namespace":"guid-inventory-pruning","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-inventory-pruning","uid":"243acb63-10c0-4caa-9d29-73e7b7a64a55","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0808030Z {"severity":"info","ts":1685974680.9681234,"logger":"project","message":"project is ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","project":{"name":"banner-project","namespace":"guid-inventory-pruning","uid":"12101102-a2d7-40d5-b69b-5ca3c709e168","resourceVersion":"799","generation":2,"creationTimestamp":"2023-06-05T14:18:00Z","annotations":{"bsl.edge.ncr.com/banner":"test-banner-prune","bsl.edge.ncr.com/organization":"test-org","cnrm.cloud.google.com/project-id":"ret-edge-2r3hgjx5b6upn3o8m5qgj"},"ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-inventory-pruning","uid":"243acb63-10c0-4caa-9d29-73e7b7a64a55","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"resourcemanager.cnrm.cloud.google.com/v1beta1","time":"2023-06-05T14:18:00Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:bsl.edge.ncr.com/banner":{},"f:bsl.edge.ncr.com/organization":{},"f:cnrm.cloud.google.com/project-id":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"243acb63-10c0-4caa-9d29-73e7b7a64a55\"}":{}}},"f:spec":{".":{},"f:billingAccountRef":{},"f:folderRef":{},"f:name":{},"f:resourceID":{}},"f:status":{".":{},"f:conditions":{},"f:number":{}}}}]}} 2023-06-05T14:18:03.0811129Z Fetching cluster registration data... 2023-06-05T14:18:03.0811868Z cluster registration data retrieved 2023-06-05T14:18:03.0812297Z Cluster registered with Edge! 2023-06-05T14:18:03.0812836Z Cluster edge ID: test-registration-id 2023-06-05T14:18:03.0820133Z {"severity":"error","ts":1685974680.9798121,"logger":"createRemoteAccessComputeAddress","message":"failed to delete existing remote access ComputeAddress resource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj","name":"guid-inventory-pruning-remote-access-ip-1","namespace":"guid-inventory-pruning","error":"computeaddresses.compute.cnrm.cloud.google.com \"guid-inventory-pruning-remote-access-ip-1\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).createRemoteAccessComputeAddress\n\tpkg/edge/controllers/bannerctl/remote_access.go:56\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProjectInfra\n\tpkg/edge/controllers/bannerctl/bannerctl.go:475\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:350\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0826110Z {"severity":"info","ts":1685974680.9799805,"logger":"remote-access-sobj","message":"creating k8s resources for vpnctl","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj"} 2023-06-05T14:18:03.0828407Z {"severity":"info","ts":1685974680.9800868,"logger":"remote-access-sobj","message":"creating k8s resources for remote access","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj"} 2023-06-05T14:18:03.0842742Z {"severity":"info","ts":1685974681.3686461,"logger":"project-infra","message":"project infrastructure applied","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj","changeset":"Service/guid-inventory-pruning/cloudresourcemanager.googleapis.com created\nService/guid-inventory-pruning/cloudtrace.googleapis.com created\nService/guid-inventory-pruning/compute.googleapis.com created\nService/guid-inventory-pruning/container.googleapis.com created\nService/guid-inventory-pruning/iamcredentials.googleapis.com created\nService/guid-inventory-pruning/logging.googleapis.com created\nService/guid-inventory-pruning/monitoring.googleapis.com created\nService/guid-inventory-pruning/secretmanager.googleapis.com created\nService/guid-inventory-pruning/stackdriver.googleapis.com created\nComputeAddress/guid-inventory-pruning/remote-access-ip-guid-inventory-pruning created\nSyncedObject/guid-inventory-pruning/banner-proxy-guid-inventory-pruning created\nSyncedObject/guid-inventory-pruning/ncr-charts created\nSyncedObject/guid-inventory-pruning/remote-access created\nSyncedObject/guid-inventory-pruning/remote-access-auth-service created\nSyncedObject/guid-inventory-pruning/remote-access-cert-guid-inventory-pruning created\nSyncedObject/guid-inventory-pruning/remote-access-host created\nSyncedObject/guid-inventory-pruning/vpn-controller created\nSyncedObject/guid-inventory-pruning/vpn-controller-gcp-sa created\nSyncedObject/guid-inventory-pruning/vpn-controller-rb created\nSyncedObject/guid-inventory-pruning/vpn-controller-secret-admin-binding created\nSyncedObject/guid-inventory-pruning/vpn-controller-workload-id-binding created\nIAMCustomRole/guid-inventory-pruning/fluxlist created\nIAMCustomRole/guid-inventory-pruning/fluxobjectget created\nIAMPolicyMember/guid-inventory-pruning/cluster-infra-kcc-sa-gke-admin created\nIAMPolicyMember/guid-inventory-pruning/cluster-infra-kcc-sa-secretadmin created\nIAMPolicyMember/guid-inventory-pruning/cluster-infra-kcc-sa-workload-identity-user created\nIAMPolicyMember/guid-inventory-pruning/k8s-cfg-connector-logging-logwriter created\nIAMPolicyMember/guid-inventory-pruning/k8s-cfg-connector-owner created\nIAMPolicyMember/guid-inventory-pruning/k8s-cfg-connector-pubsub-admin created\nIAMPolicyMember/guid-inventory-pruning/k8s-cfg-connector-workload-id created\nIAMPolicyMember/guid-inventory-pruning/syncedobject-infra-kcc-sa-pubsub-publisher created\nIAMPolicyMember/guid-inventory-pruning/syncedobject-infra-kcc-sa-pubsub-subscriber created\nIAMPolicyMember/guid-inventory-pruning/syncedobject-infra-kcc-sa-workload-identity-user created\nIAMServiceAccount/guid-inventory-pruning/cluster-infra-kcc-sa created\nIAMServiceAccount/guid-inventory-pruning/k8s-cfg-connector created\nIAMServiceAccount/guid-inventory-pruning/syncedobject-infra-kcc-sa created\nLoggingLogExclusion/guid-inventory-pruning/aggregated-logs-exclusion created\nStorageBucket/guid-inventory-pruning/ret-edge-2r3hgjx5b6upn3o8m5qgj created"} 2023-06-05T14:18:03.0854039Z {"severity":"info","ts":1685974681.3688655,"logger":"copy-platform-secrets","message":"copying platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj","source":"mock gcp projectid","destination":"ret-edge-2r3hgjx5b6upn3o8m5qgj"} 2023-06-05T14:18:03.0857001Z {"severity":"info","ts":1685974681.3688872,"logger":"copy-platform-secrets","message":"copied platform secrets to new banner project","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj"} 2023-06-05T14:18:03.0859471Z {"severity":"info","ts":1685974681.368896,"logger":"add-tenant","message":"adding tenant by invoking kpt function with chariot","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj"} 2023-06-05T14:18:03.0861689Z {"severity":"info","ts":1685974681.368901,"logger":"add-tenant","message":"committed kpt fn","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj","sha":""} 2023-06-05T14:18:03.0885167Z {"severity":"info","ts":1685974681.3769403,"message":"reconciled banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"52749d42-aeff-44b6-a743-570f3e9f74d3","banner":{"kind":"Banner","apiVersion":"edge.ncr.com/v1alpha1","metadata":{"name":"guid-inventory-pruning","uid":"243acb63-10c0-4caa-9d29-73e7b7a64a55","resourceVersion":"798","generation":1,"creationTimestamp":"2023-06-05T14:18:00Z","managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:18:00Z","fieldsType":"FieldsV1","fieldsV1":{"f:spec":{".":{},"f:bsl":{".":{},"f:enterpriseUnit":{},"f:organization":{".":{},"f:name":{}}},"f:displayName":{},"f:gcp":{".":{},"f:projectId":{}}}}},{"manager":"bannerctl_test","operation":"Update","apiVersion":"edge.ncr.com/v1alpha1","time":"2023-06-05T14:18:00Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{".":{},"f:conditions":{},"f:projectRef":{}}},"subresource":"status"}]},"spec":{"displayName":"test-banner-prune","bsl":{"enterpriseUnit":{},"organization":{"name":"test-org"}},"gcp":{"projectId":"ret-edge-2r3hgjx5b6upn3o8m5qgj"}},"status":{"projectRef":"guid-inventory-pruning/banner-project","projectNumber":"123","conditions":[{"type":"Ready","status":"True","observedGeneration":1,"lastTransitionTime":"2023-06-05T14:18:01Z","reason":"ProvisionSucceeded","message":"successfully set up banner"}],"clusterInfraClusterEdgeID":"test-registration-id","clusterInfraClusterProjectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj","inventory":{"entries":[{"id":"guid-inventory-pruning_cloudresourcemanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-inventory-pruning_cloudtrace.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-inventory-pruning_compute.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-inventory-pruning_container.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-inventory-pruning_iamcredentials.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-inventory-pruning_logging.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-inventory-pruning_monitoring.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-inventory-pruning_secretmanager.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-inventory-pruning_stackdriver.googleapis.com_serviceusage.cnrm.cloud.google.com_Service","v":"v1beta1"},{"id":"guid-inventory-pruning_remote-access-ip-guid-inventory-pruning_compute.cnrm.cloud.google.com_ComputeAddress","v":"v1beta1"},{"id":"guid-inventory-pruning_banner-proxy-guid-inventory-pruning_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_ncr-charts_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_remote-access_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_remote-access-auth-service_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_remote-access-cert-guid-inventory-pruning_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_remote-access-host_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_vpn-controller_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_vpn-controller-gcp-sa_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_vpn-controller-rb_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_vpn-controller-secret-admin-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_vpn-controller-workload-id-binding_edge.ncr.com_SyncedObject","v":"v1alpha1"},{"id":"guid-inventory-pruning_fluxlist_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-inventory-pruning_fluxobjectget_iam.cnrm.cloud.google.com_IAMCustomRole","v":"v1beta1"},{"id":"guid-inventory-pruning_cluster-infra-kcc-sa-gke-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-inventory-pruning_cluster-infra-kcc-sa-secretadmin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-inventory-pruning_cluster-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-inventory-pruning_k8s-cfg-connector-logging-logwriter_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-inventory-pruning_k8s-cfg-connector-owner_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-inventory-pruning_k8s-cfg-connector-pubsub-admin_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-inventory-pruning_k8s-cfg-connector-workload-id_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-inventory-pruning_syncedobject-infra-kcc-sa-pubsub-publisher_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-inventory-pruning_syncedobject-infra-kcc-sa-pubsub-subscriber_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-inventory-pruning_syncedobject-infra-kcc-sa-workload-identity-user_iam.cnrm.cloud.google.com_IAMPolicyMember","v":"v1beta1"},{"id":"guid-inventory-pruning_cluster-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-inventory-pruning_k8s-cfg-connector_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-inventory-pruning_syncedobject-infra-kcc-sa_iam.cnrm.cloud.google.com_IAMServiceAccount","v":"v1beta1"},{"id":"guid-inventory-pruning_aggregated-logs-exclusion_logging.cnrm.cloud.google.com_LoggingLogExclusion","v":"v1beta1"},{"id":"guid-inventory-pruning_ret-edge-2r3hgjx5b6upn3o8m5qgj_storage.cnrm.cloud.google.com_StorageBucket","v":"v1beta1"}]}}}} 2023-06-05T14:18:03.0900942Z {"severity":"info","ts":1685974681.3771265,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"7d3af287-919b-4fd1-9986-fa5bd27d2efb"} 2023-06-05T14:18:03.0903809Z {"severity":"info","ts":1685974681.380085,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"7d3af287-919b-4fd1-9986-fa5bd27d2efb","namespace":"dev1-banner-use-warehouse","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"dev1-banner-use-warehouse","uid":"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0910111Z {"severity":"info","ts":1685974681.3839746,"logger":"project","message":"project is ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"7d3af287-919b-4fd1-9986-fa5bd27d2efb","project":{"name":"banner-project","namespace":"dev1-banner-use-warehouse","uid":"9ca30886-6f9a-4251-ac22-83f536e88fa1","resourceVersion":"760","generation":2,"creationTimestamp":"2023-06-05T14:18:00Z","annotations":{"bsl.edge.ncr.com/banner":"testy-mcbanner-dev1","bsl.edge.ncr.com/organization":"test-org-dev1","cnrm.cloud.google.com/project-id":"ret-edge-bimhmz3lmkw0ddbgq851r"},"ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"dev1-banner-use-warehouse","uid":"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"resourcemanager.cnrm.cloud.google.com/v1beta1","time":"2023-06-05T14:18:00Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:bsl.edge.ncr.com/banner":{},"f:bsl.edge.ncr.com/organization":{},"f:cnrm.cloud.google.com/project-id":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0fe883fc-b467-4c3d-9e8b-3ff74b7057c0\"}":{}}},"f:spec":{".":{},"f:billingAccountRef":{},"f:folderRef":{},"f:name":{},"f:resourceID":{}},"f:status":{".":{},"f:conditions":{},"f:number":{}}}}]}} 2023-06-05T14:18:03.0913567Z Fetching cluster registration data... 2023-06-05T14:18:03.0914010Z cluster registration data retrieved 2023-06-05T14:18:03.0914406Z Cluster registered with Edge! 2023-06-05T14:18:03.0914930Z Cluster edge ID: test-registration-id 2023-06-05T14:18:03.0922053Z {"severity":"error","ts":1685974681.3967876,"logger":"createRemoteAccessComputeAddress","message":"failed to delete existing remote access ComputeAddress resource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"7d3af287-919b-4fd1-9986-fa5bd27d2efb","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","name":"dev1-banner-use-warehouse-remote-access-ip-1","namespace":"dev1-banner-use-warehouse","error":"computeaddresses.compute.cnrm.cloud.google.com \"dev1-banner-use-warehouse-remote-access-ip-1\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).createRemoteAccessComputeAddress\n\tpkg/edge/controllers/bannerctl/remote_access.go:56\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProjectInfra\n\tpkg/edge/controllers/bannerctl/bannerctl.go:475\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:350\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0928205Z {"severity":"info","ts":1685974681.3969707,"logger":"remote-access-sobj","message":"featureflag \"use-warehouse\" enabled, creation of vpnctl k8s resources skipped","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"7d3af287-919b-4fd1-9986-fa5bd27d2efb","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r"} 2023-06-05T14:18:03.0941589Z {"severity":"info","ts":1685974681.60511,"logger":"project-infra","message":"project infrastructure applied","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"7d3af287-919b-4fd1-9986-fa5bd27d2efb","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","changeset":"Service/dev1-banner-use-warehouse/artifactregistry.googleapis.com unchanged\nService/dev1-banner-use-warehouse/cloudresourcemanager.googleapis.com unchanged\nService/dev1-banner-use-warehouse/cloudtrace.googleapis.com unchanged\nService/dev1-banner-use-warehouse/compute.googleapis.com unchanged\nService/dev1-banner-use-warehouse/container.googleapis.com unchanged\nService/dev1-banner-use-warehouse/iamcredentials.googleapis.com unchanged\nService/dev1-banner-use-warehouse/logging.googleapis.com unchanged\nService/dev1-banner-use-warehouse/monitoring.googleapis.com unchanged\nService/dev1-banner-use-warehouse/secretmanager.googleapis.com unchanged\nService/dev1-banner-use-warehouse/stackdriver.googleapis.com unchanged\nArtifactRegistryRepository/dev1-banner-use-warehouse/warehouse unchanged\nComputeAddress/dev1-banner-use-warehouse/remote-access-ip-dev1-banner-use-warehouse unchanged\nSyncedObject/dev1-banner-use-warehouse/banner-proxy-dev1-banner-use-warehouse unchanged\nSyncedObject/dev1-banner-use-warehouse/ncr-charts unchanged\nIAMCustomRole/dev1-banner-use-warehouse/fluxlist unchanged\nIAMCustomRole/dev1-banner-use-warehouse/fluxobjectget unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761-gke-admin unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761-secretadmin unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761-workload-identity-user unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-logging-logwriter unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-owner unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-pubsub-admin unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761-workload-id unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761-pubsub-publisher unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761-pubsub-subscriber unchanged\nIAMPolicyMember/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761-workload-identity-user unchanged\nIAMServiceAccount/dev1-banner-use-warehouse/clsterctl-if552e0ef892fce51761 unchanged\nIAMServiceAccount/dev1-banner-use-warehouse/kcc-if552e0ef892fce51761 unchanged\nIAMServiceAccount/dev1-banner-use-warehouse/soctl-if552e0ef892fce51761 unchanged\nLoggingLogExclusion/dev1-banner-use-warehouse/aggregated-logs-exclusion unchanged\nStorageBucket/dev1-banner-use-warehouse/ret-edge-bimhmz3lmkw0ddbgq851r unchanged"} 2023-06-05T14:18:03.0951229Z {"severity":"info","ts":1685974681.6053116,"logger":"project-infra","message":"inventory","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"7d3af287-919b-4fd1-9986-fa5bd27d2efb","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","diff":[]} 2023-06-05T14:18:03.0953737Z {"severity":"info","ts":1685974681.605367,"logger":"check-API","message":"waiting for service api to become Ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"7d3af287-919b-4fd1-9986-fa5bd27d2efb","projectID":"ret-edge-bimhmz3lmkw0ddbgq851r","reason":"","api":"secretmanager.googleapis.com"} 2023-06-05T14:18:03.0957850Z {"severity":"error","ts":1685974681.6109068,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"dev1-banner-use-warehouse"},"namespace":"","name":"dev1-banner-use-warehouse","reconcileID":"7d3af287-919b-4fd1-9986-fa5bd27d2efb","error":"gcp api isnt ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0960886Z {"severity":"info","ts":1685974681.6110177,"message":"reconciling started for banner","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"7e9e3f44-b49a-42bf-b8c7-ef46f2681712"} 2023-06-05T14:18:03.0963856Z {"severity":"info","ts":1685974681.613634,"logger":"namespace","message":"namespace created","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"7e9e3f44-b49a-42bf-b8c7-ef46f2681712","namespace":"guid-inventory-pruning","ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-inventory-pruning","uid":"243acb63-10c0-4caa-9d29-73e7b7a64a55","controller":true,"blockOwnerDeletion":true}]} 2023-06-05T14:18:03.0970134Z {"severity":"info","ts":1685974681.6169488,"logger":"project","message":"project is ready","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"7e9e3f44-b49a-42bf-b8c7-ef46f2681712","project":{"name":"banner-project","namespace":"guid-inventory-pruning","uid":"12101102-a2d7-40d5-b69b-5ca3c709e168","resourceVersion":"799","generation":2,"creationTimestamp":"2023-06-05T14:18:00Z","annotations":{"bsl.edge.ncr.com/banner":"test-banner-prune","bsl.edge.ncr.com/organization":"test-org","cnrm.cloud.google.com/project-id":"ret-edge-2r3hgjx5b6upn3o8m5qgj"},"ownerReferences":[{"apiVersion":"edge.ncr.com/v1alpha1","kind":"Banner","name":"guid-inventory-pruning","uid":"243acb63-10c0-4caa-9d29-73e7b7a64a55","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"bannerctl_test","operation":"Update","apiVersion":"resourcemanager.cnrm.cloud.google.com/v1beta1","time":"2023-06-05T14:18:00Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:bsl.edge.ncr.com/banner":{},"f:bsl.edge.ncr.com/organization":{},"f:cnrm.cloud.google.com/project-id":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"243acb63-10c0-4caa-9d29-73e7b7a64a55\"}":{}}},"f:spec":{".":{},"f:billingAccountRef":{},"f:folderRef":{},"f:name":{},"f:resourceID":{}},"f:status":{".":{},"f:conditions":{},"f:number":{}}}}]}} 2023-06-05T14:18:03.0973392Z Fetching cluster registration data... 2023-06-05T14:18:03.0973829Z cluster registration data retrieved 2023-06-05T14:18:03.0974258Z Cluster registered with Edge! 2023-06-05T14:18:03.0974789Z Cluster edge ID: test-registration-id 2023-06-05T14:18:03.0981928Z {"severity":"error","ts":1685974681.6297774,"logger":"createRemoteAccessComputeAddress","message":"failed to delete existing remote access ComputeAddress resource","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"7e9e3f44-b49a-42bf-b8c7-ef46f2681712","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj","name":"guid-inventory-pruning-remote-access-ip-1","namespace":"guid-inventory-pruning","error":"computeaddresses.compute.cnrm.cloud.google.com \"guid-inventory-pruning-remote-access-ip-1\" not found","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).createRemoteAccessComputeAddress\n\tpkg/edge/controllers/bannerctl/remote_access.go:56\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcileProjectInfra\n\tpkg/edge/controllers/bannerctl/bannerctl.go:475\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:350\nedge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:296\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.0988022Z {"severity":"info","ts":1685974681.6299958,"logger":"remote-access-sobj","message":"creating k8s resources for vpnctl","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"7e9e3f44-b49a-42bf-b8c7-ef46f2681712","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj"} 2023-06-05T14:18:03.0990531Z {"severity":"info","ts":1685974681.6301467,"logger":"remote-access-sobj","message":"creating k8s resources for remote access","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"7e9e3f44-b49a-42bf-b8c7-ef46f2681712","projectID":"ret-edge-2r3hgjx5b6upn3o8m5qgj"} 2023-06-05T14:18:03.0991709Z === RUN TestBannerController/TestBannerDeletion_ResourceLifecycle 2023-06-05T14:18:03.0992360Z framework.go:161: [integration] skipping: this test can only be ran as an integration test 2023-06-05T14:18:03.0992994Z {"severity":"info","ts":1685974681.7871113,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:18:03.0993617Z {"severity":"info","ts":1685974681.7871523,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:18:03.0994470Z {"severity":"info","ts":1685974681.787188,"message":"Shutdown signal received, waiting for all workers to finish","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner"} 2023-06-05T14:18:03.0999153Z {"severity":"error","ts":1685974681.787857,"message":"unable to update banner status","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"7e9e3f44-b49a-42bf-b8c7-ef46f2681712","error":"client rate limiter Wait returned an error: context canceled","stacktrace":"edge-infra.dev/pkg/edge/controllers/bannerctl.(*BannerReconciler).Reconcile\n\tpkg/edge/controllers/bannerctl/bannerctl.go:298\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.1005051Z {"severity":"error","ts":1685974681.7879674,"message":"Reconciler error","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner","Banner":{"name":"guid-inventory-pruning"},"namespace":"","name":"guid-inventory-pruning","reconcileID":"7e9e3f44-b49a-42bf-b8c7-ef46f2681712","error":"client rate limiter Wait returned an error: context canceled","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:03.1007405Z {"severity":"info","ts":1685974681.7880166,"message":"All workers finished","controller":"banner","controllerGroup":"edge.ncr.com","controllerKind":"Banner"} 2023-06-05T14:18:03.1008111Z {"severity":"info","ts":1685974681.7880394,"message":"Stopping and waiting for caches"} 2023-06-05T14:18:03.1008707Z {"severity":"info","ts":1685974681.788228,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:18:03.1009347Z {"severity":"info","ts":1685974681.7883074,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:18:03.1010213Z --- PASS: TestBannerController (19.66s) 2023-06-05T14:18:03.1010919Z --- PASS: TestBannerController/TestBannerCreation_CouchdbConfig (2.87s) 2023-06-05T14:18:03.1011994Z --- PASS: TestBannerController/TestBannerCreation_SecondaryResources (1.39s) 2023-06-05T14:18:03.1012772Z --- PASS: TestBannerController/TestBannerCreation_UsingWarehouse (0.32s) 2023-06-05T14:18:03.1013566Z --- PASS: TestBannerController/TestBannerCreation_WithInventoryPruning (1.08s) 2023-06-05T14:18:03.1014400Z --- SKIP: TestBannerController/TestBannerDeletion_ResourceLifecycle (0.00s) 2023-06-05T14:18:03.1014988Z === RUN TestCreateClusterControllerIAMSA 2023-06-05T14:18:03.1015628Z --- PASS: TestCreateClusterControllerIAMSA (0.00s) 2023-06-05T14:18:03.1016214Z === RUN TestClusterControllerIAMMembers 2023-06-05T14:18:03.1016840Z --- PASS: TestClusterControllerIAMMembers (0.00s) 2023-06-05T14:18:03.1017363Z === RUN TestClusterControllerSAResources 2023-06-05T14:18:03.1018000Z --- PASS: TestClusterControllerSAResources (0.00s) 2023-06-05T14:18:03.1018507Z === RUN TestCouchExternalSecret 2023-06-05T14:18:03.1019057Z --- PASS: TestCouchExternalSecret (0.00s) 2023-06-05T14:18:03.1019502Z === RUN TestCreateInfraSAResources 2023-06-05T14:18:03.1020111Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Starting LaunchDarkly client 6.0.3 2023-06-05T14:18:03.1020751Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Waiting up to 10000 milliseconds for LaunchDarkly client to start... 2023-06-05T14:18:03.1021357Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Initialized LaunchDarkly client 2023-06-05T14:18:03.1021885Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Starting LaunchDarkly client 6.0.3 2023-06-05T14:18:03.1022476Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Waiting up to 10000 milliseconds for LaunchDarkly client to start... 2023-06-05T14:18:03.1023090Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Initialized LaunchDarkly client 2023-06-05T14:18:03.1023681Z --- PASS: TestCreateInfraSAResources (0.00s) 2023-06-05T14:18:03.1024230Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Starting LaunchDarkly client 6.0.3 2023-06-05T14:18:03.1024825Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Waiting up to 10000 milliseconds for LaunchDarkly client to start... 2023-06-05T14:18:03.1025402Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Initialized LaunchDarkly client 2023-06-05T14:18:03.1025996Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Starting LaunchDarkly client 6.0.3 2023-06-05T14:18:03.1026626Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Waiting up to 10000 milliseconds for LaunchDarkly client to start... 2023-06-05T14:18:03.1027234Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Initialized LaunchDarkly client 2023-06-05T14:18:03.1027789Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Starting LaunchDarkly client 6.0.3 2023-06-05T14:18:03.1028404Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Waiting up to 10000 milliseconds for LaunchDarkly client to start... 2023-06-05T14:18:03.1029013Z [LaunchDarkly] 2023/06/05 14:18:02 INFO: Initialized LaunchDarkly client 2023-06-05T14:18:03.1029502Z === RUN TestCreateVPNCtlResources 2023-06-05T14:18:03.1030315Z {"severity":"info","ts":1685974682.971123,"logger":"remote-access-sobj","message":"creating k8s resources for vpnctl"} 2023-06-05T14:18:03.1031226Z {"severity":"info","ts":1685974682.9712405,"logger":"remote-access-sobj","message":"creating k8s resources for remote access"} 2023-06-05T14:18:03.1032330Z {"severity":"info","ts":1685974682.9713898,"logger":"remote-access-sobj","message":"featureflag \"use-warehouse\" enabled, creation of vpnctl k8s resources skipped"} 2023-06-05T14:18:03.1033126Z --- PASS: TestCreateVPNCtlResources (0.00s) 2023-06-05T14:18:03.1033585Z === RUN TestCreateKCCIAMSA 2023-06-05T14:18:03.1034088Z --- PASS: TestCreateKCCIAMSA (0.00s) 2023-06-05T14:18:03.1034478Z === RUN TestCreateKCCIAMMembers 2023-06-05T14:18:03.1034984Z --- PASS: TestCreateKCCIAMMembers (0.00s) 2023-06-05T14:18:03.1035478Z === RUN TestCreateClusterInfraKCCResources 2023-06-05T14:18:03.1036443Z --- PASS: TestCreateClusterInfraKCCResources (0.00s) 2023-06-05T14:18:03.1036890Z === RUN TestShipment 2023-06-05T14:18:03.1037325Z --- PASS: TestShipment (0.00s) 2023-06-05T14:18:03.1037949Z === RUN TestCreateSyncedObjectCtlIAMSA 2023-06-05T14:18:03.1038558Z --- PASS: TestCreateSyncedObjectCtlIAMSA (0.00s) 2023-06-05T14:18:03.1039078Z === RUN TestCreateSyncedObjectCtlIAMMembers 2023-06-05T14:18:03.1039724Z --- PASS: TestCreateSyncedObjectCtlIAMMembers (0.00s) 2023-06-05T14:18:03.1040258Z === RUN TestSyncedObjectCtlSAResources 2023-06-05T14:18:03.1040877Z --- PASS: TestSyncedObjectCtlSAResources (0.00s) 2023-06-05T14:18:03.1041281Z PASS 2023-06-05T14:18:03.1041626Z ================================================================================ 2023-06-05T14:18:07.2690482Z INFO: From Testing //pkg/edge/datasync/controllers/couchctl:couchctl_test: 2023-06-05T14:18:07.2691110Z ==================== Test output for //pkg/edge/datasync/controllers/couchctl:couchctl_test: 2023-06-05T14:18:07.2691726Z === RUN TestServerControllerStore 2023-06-05T14:18:07.2692478Z {"severity":"info","ts":1685974648.3979816,"message":"Starting EventSource","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer","source":"kind source: *v1alpha1.CouchDBServer"} 2023-06-05T14:18:07.2693526Z {"severity":"info","ts":1685974648.3983104,"message":"Starting EventSource","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer","source":"kind source: *v1.Secret"} 2023-06-05T14:18:07.2694498Z {"severity":"info","ts":1685974648.3988483,"message":"Starting Controller","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer"} 2023-06-05T14:18:07.2695536Z {"severity":"info","ts":1685974648.3983014,"message":"Starting EventSource","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode","source":"kind source: *v1.IENode"} 2023-06-05T14:18:07.2696441Z {"severity":"info","ts":1685974648.399499,"message":"Starting Controller","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode"} 2023-06-05T14:18:07.2697070Z === RUN TestServerControllerStore/TestIENodeReconciler 2023-06-05T14:18:07.2697731Z {"severity":"info","ts":1685974648.500252,"message":"Starting workers","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode","worker count":1} 2023-06-05T14:18:07.2698577Z {"severity":"info","ts":1685974648.5003877,"message":"Starting workers","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer","worker count":1} 2023-06-05T14:18:07.2699439Z {"severity":"info","ts":1685974650.5818603,"logger":"test_servercontroller_store","message":"Successfully created touchpoint couchdb server","name":"touchpoint","namespace":"","lane":"1"} 2023-06-05T14:18:07.2704775Z {"severity":"error","ts":1685974651.0048652,"logger":"test_servercontroller_store","message":"fail to reconcile replication creds","name":"store-server","namespace":"data-sync-couchdb","type":"store","error":"Secret \"couchdb-local-creds\" not found","stacktrace":"edge-infra.dev/pkg/edge/datasync/controllers/couchctl.(*CouchServerReconciler).reconcile\n\tpkg/edge/datasync/controllers/couchctl/server_controller.go:195\nedge-infra.dev/pkg/edge/datasync/controllers/couchctl.(*CouchServerReconciler).Reconcile\n\tpkg/edge/datasync/controllers/couchctl/server_controller.go:109\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:07.2708148Z {"severity":"info","ts":1685974651.267016,"logger":"test_servercontroller_store","message":"Successfully set up CouchDB server","name":"couchdb-lane-1","namespace":"data-sync-couchdb","type":"touchpoint"} 2023-06-05T14:18:07.2709652Z {"severity":"info","ts":1685974651.543625,"logger":"test_servercontroller_store","message":"Successfully set up CouchDB server","name":"store-server","namespace":"data-sync-couchdb","type":"store"} 2023-06-05T14:18:07.2710483Z TouchPoint CouchDBReplicationSet couchdb-lane-1 data-sync-couchdb 2023-06-05T14:18:07.2711144Z TouchPoint CouchDBReplicationSet store-server data-sync-couchdb 2023-06-05T14:18:07.2711725Z === RUN TestServerControllerStore/TestStoreCouchdbManifestsDeployed 2023-06-05T14:18:07.2712765Z {"severity":"info","ts":1685974661.2310615,"logger":"test_servercontroller_store","message":"Successfully set up CouchDB server","name":"test-store-couchdb","namespace":"data-sync-couchdb","type":"store"} 2023-06-05T14:18:07.2713481Z === RUN TestServerControllerStore/TestStoreToLaneServer 2023-06-05T14:18:07.2714026Z === RUN TestServerControllerStore/TestStore_LocalCredsCreation 2023-06-05T14:18:07.2714545Z === RUN TestServerControllerStore/TestTouchpoint_Resources 2023-06-05T14:18:07.2715693Z {"severity":"info","ts":1685974661.5674334,"logger":"test_servercontroller_store","message":"Successfully set up CouchDB server","name":"test-store-couchdb-1","namespace":"couchctl-4936f738-store-1","type":"store"} 2023-06-05T14:18:07.2716928Z {"severity":"info","ts":1685974661.594092,"logger":"test_servercontroller_store","message":"Successfully set up CouchDB server","name":"test-touchpoint","namespace":"couchctl-4936f738-touchpoint","type":"touchpoint"} 2023-06-05T14:18:07.2717780Z TouchPoint CouchDBReplicationSet test-store-couchdb-1 couchctl-4936f738-store-1 2023-06-05T14:18:07.2718489Z TouchPoint CouchDBReplicationSet test-touchpoint couchctl-4936f738-touchpoint 2023-06-05T14:18:07.2719171Z TouchPoint CouchDBReplicationSet couchdb-lane-1 data-sync-couchdb 2023-06-05T14:18:07.2719800Z TouchPoint CouchDBReplicationSet store-server data-sync-couchdb 2023-06-05T14:18:07.2720431Z TouchPoint CouchDBReplicationSet test-store-couchdb data-sync-couchdb 2023-06-05T14:18:07.2720963Z {"severity":"info","ts":1685974671.6912377,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:18:07.2721497Z {"severity":"info","ts":1685974671.6912906,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:18:07.2722299Z {"severity":"info","ts":1685974671.6913228,"message":"Shutdown signal received, waiting for all workers to finish","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer"} 2023-06-05T14:18:07.2723233Z {"severity":"info","ts":1685974671.6913385,"message":"Shutdown signal received, waiting for all workers to finish","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode"} 2023-06-05T14:18:07.2724112Z {"severity":"info","ts":1685974671.6913645,"message":"All workers finished","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode"} 2023-06-05T14:18:07.2725072Z {"severity":"info","ts":1685974671.691374,"message":"All workers finished","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer"} 2023-06-05T14:18:07.2725792Z {"severity":"info","ts":1685974671.69138,"message":"Stopping and waiting for caches"} 2023-06-05T14:18:07.2726360Z {"severity":"info","ts":1685974671.6916635,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:18:07.2726987Z {"severity":"info","ts":1685974671.691691,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:18:07.2727709Z --- PASS: TestServerControllerStore (37.36s) 2023-06-05T14:18:07.2728412Z --- PASS: TestServerControllerStore/TestIENodeReconciler (12.71s) 2023-06-05T14:18:07.2729555Z --- PASS: TestServerControllerStore/TestStoreCouchdbManifestsDeployed (0.28s) 2023-06-05T14:18:07.2730366Z --- PASS: TestServerControllerStore/TestStoreToLaneServer (0.00s) 2023-06-05T14:18:07.2731394Z --- PASS: TestServerControllerStore/TestStore_LocalCredsCreation (0.16s) 2023-06-05T14:18:07.2732446Z --- PASS: TestServerControllerStore/TestTouchpoint_Resources (10.13s) 2023-06-05T14:18:07.2732938Z === RUN TestServerController 2023-06-05T14:18:07.2733620Z {"severity":"info","ts":1685974683.2957482,"message":"Starting EventSource","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer","source":"kind source: *v1alpha1.CouchDBServer"} 2023-06-05T14:18:07.2734820Z {"severity":"info","ts":1685974683.2958045,"message":"Starting EventSource","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer","source":"kind source: *v1.Secret"} 2023-06-05T14:18:07.2735801Z {"severity":"info","ts":1685974683.2958088,"message":"Starting Controller","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer"} 2023-06-05T14:18:07.2736555Z === RUN TestServerController/TestCouchdbManifestsDeployed 2023-06-05T14:18:07.2737327Z {"severity":"info","ts":1685974683.3965366,"message":"Starting workers","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer","worker count":1} 2023-06-05T14:18:07.2738597Z {"severity":"info","ts":1685974685.41428,"logger":"test_servercontroller","message":"Successfully set up CouchDB server","name":"test-couchdb","namespace":"couchctl-14497d18-server","type":"cloud"} 2023-06-05T14:18:07.2739338Z === RUN TestServerController/TestServerCreation_ExistingManagedCert 2023-06-05T14:18:07.2739935Z === RUN TestServerController/TestServerCreation_ReplicationSecret 2023-06-05T14:18:07.2741260Z {"severity":"info","ts":1685974685.854927,"logger":"test_servercontroller","message":"Successfully set up CouchDB server","name":"test-server-exisitingmanagedcert","namespace":"couchctl-14497d18-existingmanagedcert","type":"cloud"} 2023-06-05T14:18:07.2746333Z {"severity":"error","ts":1685974685.9119782,"logger":"test_servercontroller","message":"fail to reconcile replication creds","name":"test-server-replicationsecret","namespace":"couchctl-14497d18-replicationsecret","type":"cloud","error":"could not retrieve domain from couchdb managed cert","stacktrace":"edge-infra.dev/pkg/edge/datasync/controllers/couchctl.(*CouchServerReconciler).reconcile\n\tpkg/edge/datasync/controllers/couchctl/server_controller.go:181\nedge-infra.dev/pkg/edge/datasync/controllers/couchctl.(*CouchServerReconciler).Reconcile\n\tpkg/edge/datasync/controllers/couchctl/server_controller.go:109\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:07.2750277Z {"severity":"info","ts":1685974685.964569,"logger":"test_servercontroller","message":"Successfully set up CouchDB server","name":"test-server-replicationsecret","namespace":"couchctl-14497d18-replicationsecret","type":"cloud"} 2023-06-05T14:18:07.2751148Z === RUN TestServerController/TestServerCreation_SecondaryResources 2023-06-05T14:18:07.2752302Z {"severity":"info","ts":1685974686.081335,"logger":"test_servercontroller","message":"Successfully set up CouchDB server","name":"test-server","namespace":"couchctl-14497d18-secondaryresources","type":"cloud"} 2023-06-05T14:18:07.2753520Z {"severity":"info","ts":1685974686.1277752,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:18:07.2754329Z {"severity":"info","ts":1685974686.12782,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:18:07.2755318Z {"severity":"info","ts":1685974686.127835,"message":"Shutdown signal received, waiting for all workers to finish","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer"} 2023-06-05T14:18:07.2756329Z {"severity":"info","ts":1685974686.127874,"message":"All workers finished","controller":"couchdbserver","controllerGroup":"datasync.edge.ncr.com","controllerKind":"CouchDBServer"} 2023-06-05T14:18:07.2757041Z {"severity":"info","ts":1685974686.1279066,"message":"Stopping and waiting for caches"} 2023-06-05T14:18:07.2757575Z {"severity":"info","ts":1685974686.1280122,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:18:07.2758160Z {"severity":"info","ts":1685974686.1280415,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:18:07.2758793Z --- PASS: TestServerController (14.15s) 2023-06-05T14:18:07.2759505Z --- PASS: TestServerController/TestCouchdbManifestsDeployed (2.34s) 2023-06-05T14:18:07.2760276Z --- PASS: TestServerController/TestServerCreation_ExistingManagedCert (0.11s) 2023-06-05T14:18:07.2761061Z --- PASS: TestServerController/TestServerCreation_ReplicationSecret (0.26s) 2023-06-05T14:18:07.2761833Z --- PASS: TestServerController/TestServerCreation_SecondaryResources (0.11s) 2023-06-05T14:18:07.2762439Z === RUN TestUserToSecurityBackwardCompatibility 2023-06-05T14:18:07.2763175Z --- PASS: TestUserToSecurityBackwardCompatibility (0.00s) 2023-06-05T14:18:07.2763708Z === RUN TestUserToSecurityReadOnlyUser 2023-06-05T14:18:07.2764303Z --- PASS: TestUserToSecurityReadOnlyUser (0.00s) 2023-06-05T14:18:07.2764829Z === RUN TestUserToSecurityCreateViewUser 2023-06-05T14:18:07.2765416Z --- PASS: TestUserToSecurityCreateViewUser (0.00s) 2023-06-05T14:18:07.2765951Z === RUN TestHasDBSecurityRole 2023-06-05T14:18:07.2766476Z --- PASS: TestHasDBSecurityRole (0.00s) 2023-06-05T14:18:07.2766908Z === RUN TestUpdateDBSecurityForUser 2023-06-05T14:18:07.2767470Z --- PASS: TestUpdateDBSecurityForUser (0.00s) 2023-06-05T14:18:07.2767863Z PASS 2023-06-05T14:18:07.2768189Z ================================================================================ 2023-06-05T14:18:07.7311502Z INFO: From Testing //pkg/f8n/warehouse/k8s/controllers/lumperctl:lumperctl_test: 2023-06-05T14:18:07.7313005Z stdout (/github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/_tmp/actions/stdout-2619) 3229291 exceeds maximum size of --experimental_ui_max_stdouterr_bytes=1048576 bytes; skipping 2023-06-05T14:18:14.0159612Z INFO: From Testing //pkg/sds/k8s/controllers/nodeagent:nodeagent_test: 2023-06-05T14:18:14.0160286Z ==================== Test output for //pkg/sds/k8s/controllers/nodeagent:nodeagent_test: 2023-06-05T14:18:14.0160808Z === RUN TestControllerWithDefaults 2023-06-05T14:18:14.0161549Z {"severity":"info","ts":1685974678.5350235,"message":"Starting EventSource","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode","source":"kind source: *v1.IENode"} 2023-06-05T14:18:14.0162617Z {"severity":"info","ts":1685974678.535081,"message":"Starting Controller","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode"} 2023-06-05T14:18:14.0163439Z {"severity":"info","ts":1685974678.5351453,"message":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *v1.ConfigMap"} 2023-06-05T14:18:14.0163940Z {"severity":"info","ts":1685974678.535183,"message":"Starting Controller","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} 2023-06-05T14:18:14.0164764Z {"severity":"info","ts":1685974678.535253,"message":"Starting EventSource","controller":"secret","controllerGroup":"","controllerKind":"Secret","source":"kind source: *v1.Secret"} 2023-06-05T14:18:14.0165240Z {"severity":"info","ts":1685974678.5352702,"message":"Starting Controller","controller":"secret","controllerGroup":"","controllerKind":"Secret"} 2023-06-05T14:18:14.0165813Z === RUN TestControllerWithDefaults/TestIENodeCreate 2023-06-05T14:18:14.0166205Z {"severity":"info","ts":1685974678.6356149,"message":"Starting workers","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","worker count":1} 2023-06-05T14:18:14.0166695Z {"severity":"info","ts":1685974678.635634,"message":"Starting workers","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode","worker count":1} 2023-06-05T14:18:14.0167176Z {"severity":"info","ts":1685974678.6356344,"message":"Starting workers","controller":"secret","controllerGroup":"","controllerKind":"Secret","worker count":1} 2023-06-05T14:18:14.0167580Z {"severity":"info","ts":1685974680.7378874,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:18:14.0167956Z {"severity":"info","ts":1685974680.7379434,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:18:14.0168400Z {"severity":"info","ts":1685974680.7379692,"message":"Shutdown signal received, waiting for all workers to finish","controller":"secret","controllerGroup":"","controllerKind":"Secret"} 2023-06-05T14:18:14.0168921Z {"severity":"info","ts":1685974680.7379766,"message":"Shutdown signal received, waiting for all workers to finish","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode"} 2023-06-05T14:18:14.0169461Z {"severity":"info","ts":1685974680.7379816,"message":"Shutdown signal received, waiting for all workers to finish","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} 2023-06-05T14:18:14.0169939Z {"severity":"info","ts":1685974680.7380106,"message":"All workers finished","controller":"secret","controllerGroup":"","controllerKind":"Secret"} 2023-06-05T14:18:14.0170397Z {"severity":"info","ts":1685974680.7380166,"message":"All workers finished","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode"} 2023-06-05T14:18:14.0170866Z {"severity":"info","ts":1685974680.7380316,"message":"All workers finished","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} 2023-06-05T14:18:14.0171251Z {"severity":"info","ts":1685974680.7380602,"message":"Stopping and waiting for caches"} 2023-06-05T14:18:14.0172455Z {"severity":"info","ts":1685974680.7381504,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:18:14.0172799Z {"severity":"info","ts":1685974680.7381885,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:18:14.0173306Z --- PASS: TestControllerWithDefaults (17.37s) 2023-06-05T14:18:14.0173698Z --- PASS: TestControllerWithDefaults/TestIENodeCreate (2.20s) 2023-06-05T14:18:14.0174030Z === RUN TestControllerWithAlternatePlugins 2023-06-05T14:18:14.0174460Z {"severity":"info","ts":1685974688.7836888,"message":"Starting EventSource","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode","source":"kind source: *v1.IENode"} 2023-06-05T14:18:14.0174973Z {"severity":"info","ts":1685974688.7837405,"message":"Starting Controller","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode"} 2023-06-05T14:18:14.0175460Z {"severity":"info","ts":1685974688.783723,"message":"Starting EventSource","controller":"secret","controllerGroup":"","controllerKind":"Secret","source":"kind source: *v1.Secret"} 2023-06-05T14:18:14.0175975Z {"severity":"info","ts":1685974688.7837534,"message":"Starting Controller","controller":"secret","controllerGroup":"","controllerKind":"Secret"} 2023-06-05T14:18:14.0176455Z {"severity":"info","ts":1685974688.7837071,"message":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *v1.ConfigMap"} 2023-06-05T14:18:14.0177151Z {"severity":"info","ts":1685974688.7837892,"message":"Starting Controller","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} 2023-06-05T14:18:14.0177549Z === RUN TestControllerWithAlternatePlugins/TestIENodeCreate 2023-06-05T14:18:14.0178063Z {"severity":"info","ts":1685974688.884196,"message":"Starting workers","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","worker count":1} 2023-06-05T14:18:14.0178527Z {"severity":"info","ts":1685974688.8843222,"message":"Starting workers","controller":"secret","controllerGroup":"","controllerKind":"Secret","worker count":1} 2023-06-05T14:18:14.0179000Z {"severity":"info","ts":1685974688.8843136,"message":"Starting workers","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode","worker count":1} 2023-06-05T14:18:14.0181020Z {"severity":"error","ts":1685974688.8843613,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"nodeagent-plugins","reconcileID":"5deff9de-0211-4564-8637-e76eaf5cfa23","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0183755Z {"severity":"error","ts":1685974688.8844337,"message":"Reconciler error","controller":"secret","controllerGroup":"","controllerKind":"Secret","Secret":{"name":"example-secret","namespace":"sds"},"namespace":"sds","name":"example-secret","reconcileID":"9e3653df-52d9-47fa-bf8f-bdc363e48110","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0186566Z {"severity":"error","ts":1685974688.8844807,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"alternate-nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"alternate-nodeagent-plugins","reconcileID":"e02617ad-5440-4790-9151-4f68baf17613","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0189388Z {"severity":"error","ts":1685974688.8897219,"message":"Reconciler error","controller":"secret","controllerGroup":"","controllerKind":"Secret","Secret":{"name":"example-secret","namespace":"sds"},"namespace":"sds","name":"example-secret","reconcileID":"3b1d8eb7-23b7-4bb3-82d7-3034294929c9","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0192170Z {"severity":"error","ts":1685974688.8897526,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"nodeagent-plugins","reconcileID":"57869f15-0bbf-4051-a154-e36672f12c0c","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0194944Z {"severity":"error","ts":1685974688.8898225,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"alternate-nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"alternate-nodeagent-plugins","reconcileID":"8411732d-37bf-4b10-b276-b9a04fea9a75","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0197689Z {"severity":"error","ts":1685974688.9001443,"message":"Reconciler error","controller":"secret","controllerGroup":"","controllerKind":"Secret","Secret":{"name":"example-secret","namespace":"sds"},"namespace":"sds","name":"example-secret","reconcileID":"43441908-b31b-4ea7-a007-32cdd4ec9aae","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0200379Z {"severity":"error","ts":1685974688.9001603,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"nodeagent-plugins","reconcileID":"75bd7d34-c911-4dd3-86d1-ad95e49ada7d","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0203239Z {"severity":"error","ts":1685974688.9002235,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"alternate-nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"alternate-nodeagent-plugins","reconcileID":"b00e2f5f-07ed-43e6-98bf-8dca0af8f752","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0206115Z {"severity":"error","ts":1685974688.920661,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"nodeagent-plugins","reconcileID":"53d1320a-bbd3-4968-9fa6-62a55342fe28","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0208854Z {"severity":"error","ts":1685974688.9207623,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"alternate-nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"alternate-nodeagent-plugins","reconcileID":"428a0409-0d1f-4338-a18d-a41302b7999e","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0211797Z {"severity":"error","ts":1685974688.9206667,"message":"Reconciler error","controller":"secret","controllerGroup":"","controllerKind":"Secret","Secret":{"name":"example-secret","namespace":"sds"},"namespace":"sds","name":"example-secret","reconcileID":"e6b7d4a9-db17-4eca-9d9b-857c9a021f95","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0214671Z {"severity":"error","ts":1685974688.9611928,"message":"Reconciler error","controller":"secret","controllerGroup":"","controllerKind":"Secret","Secret":{"name":"example-secret","namespace":"sds"},"namespace":"sds","name":"example-secret","reconcileID":"d3e7aea8-c37a-4841-90bf-652780645277","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0217482Z {"severity":"error","ts":1685974688.9611943,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"nodeagent-plugins","reconcileID":"b337e750-eb39-486b-bedc-f9219d9c6e9e","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0220272Z {"severity":"error","ts":1685974688.9612994,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"alternate-nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"alternate-nodeagent-plugins","reconcileID":"ce3f59d6-c330-4b0c-a21f-89486aa5e89f","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0223030Z {"severity":"error","ts":1685974689.0417013,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"nodeagent-plugins","reconcileID":"1e73e0fc-6d36-4a7a-a7f6-2fdc05280860","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0225821Z {"severity":"error","ts":1685974689.041736,"message":"Reconciler error","controller":"secret","controllerGroup":"","controllerKind":"Secret","Secret":{"name":"example-secret","namespace":"sds"},"namespace":"sds","name":"example-secret","reconcileID":"25e3b3d1-0b45-41ae-8559-2f292af8fab4","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0228659Z {"severity":"error","ts":1685974689.0418005,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"alternate-nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"alternate-nodeagent-plugins","reconcileID":"32755c46-414d-4179-bfd9-fb468320cdc8","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0231375Z {"severity":"error","ts":1685974689.2022872,"message":"Reconciler error","controller":"secret","controllerGroup":"","controllerKind":"Secret","Secret":{"name":"example-secret","namespace":"sds"},"namespace":"sds","name":"example-secret","reconcileID":"64f9cdfd-fd56-4f8f-a0b6-8994177bd8e9","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0234092Z {"severity":"error","ts":1685974689.202287,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"nodeagent-plugins","reconcileID":"0c6e41f1-68f5-4ddd-b167-bcd76d208b7a","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0236925Z {"severity":"error","ts":1685974689.2023885,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"alternate-nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"alternate-nodeagent-plugins","reconcileID":"0a04fb96-d540-44ed-bfab-5f5b5768507d","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0239756Z {"severity":"error","ts":1685974689.5231087,"message":"Reconciler error","controller":"secret","controllerGroup":"","controllerKind":"Secret","Secret":{"name":"example-secret","namespace":"sds"},"namespace":"sds","name":"example-secret","reconcileID":"a195a461-2c4f-47ad-87c0-4eff80485f2f","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0242549Z {"severity":"error","ts":1685974689.5231307,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"nodeagent-plugins","reconcileID":"e75ae805-3d8f-4059-88cf-bb84b36cdee0","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0245328Z {"severity":"error","ts":1685974689.523188,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"alternate-nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"alternate-nodeagent-plugins","reconcileID":"8a4c9338-b71e-49f4-b248-81253eff49f9","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0248117Z {"severity":"error","ts":1685974690.1643054,"message":"Reconciler error","controller":"secret","controllerGroup":"","controllerKind":"Secret","Secret":{"name":"example-secret","namespace":"sds"},"namespace":"sds","name":"example-secret","reconcileID":"7dc72dc3-0075-4834-82e2-d4d48d1c6d2b","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0250907Z {"severity":"error","ts":1685974690.1642997,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"nodeagent-plugins","reconcileID":"1a1d7435-261c-4ff6-91b4-1da8652f853e","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0255447Z {"severity":"error","ts":1685974690.164408,"message":"Reconciler error","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","ConfigMap":{"name":"alternate-nodeagent-plugins","namespace":"sds"},"namespace":"sds","name":"alternate-nodeagent-plugins","reconcileID":"0db2fbce-0975-4fd2-966e-401a117e9f01","error":"IENode.dsds.edge.ncr.com \"edge-worker\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:14.0256840Z {"severity":"info","ts":1685974692.829549,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:18:14.0257198Z {"severity":"info","ts":1685974692.8296013,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:18:14.0257649Z {"severity":"info","ts":1685974692.8296177,"message":"Shutdown signal received, waiting for all workers to finish","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} 2023-06-05T14:18:14.0258171Z {"severity":"info","ts":1685974692.829625,"message":"Shutdown signal received, waiting for all workers to finish","controller":"secret","controllerGroup":"","controllerKind":"Secret"} 2023-06-05T14:18:14.0258653Z {"severity":"info","ts":1685974692.8296382,"message":"All workers finished","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} 2023-06-05T14:18:14.0259087Z {"severity":"info","ts":1685974692.8296514,"message":"All workers finished","controller":"secret","controllerGroup":"","controllerKind":"Secret"} 2023-06-05T14:18:14.0259585Z {"severity":"info","ts":1685974692.8296516,"message":"Shutdown signal received, waiting for all workers to finish","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode"} 2023-06-05T14:18:14.0260078Z {"severity":"info","ts":1685974692.8296604,"message":"All workers finished","controller":"ienode","controllerGroup":"dsds.edge.ncr.com","controllerKind":"IENode"} 2023-06-05T14:18:14.0260467Z {"severity":"info","ts":1685974692.8296742,"message":"Stopping and waiting for caches"} 2023-06-05T14:18:14.0260790Z {"severity":"info","ts":1685974692.8297834,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:18:14.0261142Z {"severity":"info","ts":1685974692.8297973,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:18:14.0261562Z --- PASS: TestControllerWithAlternatePlugins (12.10s) 2023-06-05T14:18:14.0261988Z --- PASS: TestControllerWithAlternatePlugins/TestIENodeCreate (4.04s) 2023-06-05T14:18:14.0262263Z PASS 2023-06-05T14:18:14.0262497Z ================================================================================ 2023-06-05T14:18:45.9363553Z INFO: From Testing //pkg/edge/controllers/envctl:envctl_test: 2023-06-05T14:18:45.9364329Z ==================== Test output for //pkg/edge/controllers/envctl:envctl_test: 2023-06-05T14:18:45.9365255Z === RUN TestPersistenceController 2023-06-05T14:18:45.9365716Z {"severity":"info","ts":1685974672.1806765,"message":"Starting EventSource","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","source":"kind source: *v1alpha1.Persistence"} 2023-06-05T14:18:45.9369092Z {"severity":"info","ts":1685974672.1809533,"message":"Starting EventSource","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","source":"kind source: *v1.StatefulSet"} 2023-06-05T14:18:45.9370032Z {"severity":"info","ts":1685974672.181031,"message":"Starting EventSource","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","source":"kind source: *v1.Node"} 2023-06-05T14:18:45.9370564Z {"severity":"info","ts":1685974672.1810832,"message":"Starting Controller","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence"} 2023-06-05T14:18:45.9370961Z === RUN TestPersistenceController/TestPersistence 2023-06-05T14:18:45.9371385Z {"severity":"info","ts":1685974672.6837811,"message":"Starting workers","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","worker count":1} 2023-06-05T14:18:45.9372994Z {"severity":"info","ts":1685974673.2544634,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8fe4c954-1eb4-4098-9a02-34c47edd7425"} 2023-06-05T14:18:45.9374558Z {"severity":"info","ts":1685974673.2826126,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8fe4c954-1eb4-4098-9a02-34c47edd7425","statefuleset name":"test-1-lane-1","lane or node name: ":"test-1-lane-1"} 2023-06-05T14:18:45.9375798Z {"severity":"info","ts":1685974673.2931361,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8fe4c954-1eb4-4098-9a02-34c47edd7425","statefuleset name":"test-1-lane-2","lane or node name: ":"test-1-lane-2"} 2023-06-05T14:18:45.9377076Z {"severity":"info","ts":1685974673.3595185,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8fe4c954-1eb4-4098-9a02-34c47edd7425","changeset":"StatefulSet/default/test-1-lane-1 created\nStatefulSet/default/test-1-lane-2 created"} 2023-06-05T14:18:45.9378467Z {"severity":"info","ts":1685974673.3757687,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"78ef7806-b26b-488e-87ef-db4743c9704f"} 2023-06-05T14:18:45.9380046Z {"severity":"info","ts":1685974673.400363,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"78ef7806-b26b-488e-87ef-db4743c9704f","statefuleset name":"test-1-lane-2","lane or node name: ":"test-1-lane-2"} 2023-06-05T14:18:45.9382116Z {"severity":"info","ts":1685974673.40064,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"78ef7806-b26b-488e-87ef-db4743c9704f","statefuleset name":"test-1-lane-1","lane or node name: ":"test-1-lane-1"} 2023-06-05T14:18:45.9384577Z {"severity":"info","ts":1685974673.4586053,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"78ef7806-b26b-488e-87ef-db4743c9704f","changeset":"StatefulSet/default/test-1-lane-1 unchanged\nStatefulSet/default/test-1-lane-2 unchanged"} 2023-06-05T14:18:45.9386167Z {"severity":"info","ts":1685974675.3422546,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"caafbb2a-2e52-4828-a810-12430dbe7b09"} 2023-06-05T14:18:45.9389714Z {"severity":"error","ts":1685974675.3423696,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"caafbb2a-2e52-4828-a810-12430dbe7b09","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9392118Z {"severity":"info","ts":1685974675.347375,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"e19ca95d-1478-41dc-9247-b6595f5ecc9f"} 2023-06-05T14:18:45.9394894Z {"severity":"error","ts":1685974675.3474708,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"e19ca95d-1478-41dc-9247-b6595f5ecc9f","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9396833Z {"severity":"info","ts":1685974675.3475406,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"89615cff-fb16-439c-b10f-4356a3c48113"} 2023-06-05T14:18:45.9398954Z {"severity":"error","ts":1685974675.3475628,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"89615cff-fb16-439c-b10f-4356a3c48113","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9400909Z {"severity":"info","ts":1685974675.3733563,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"dbb22eea-d6a2-49d3-867a-dd87fabcba79"} 2023-06-05T14:18:45.9403200Z {"severity":"error","ts":1685974675.3734617,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"dbb22eea-d6a2-49d3-867a-dd87fabcba79","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9404899Z {"severity":"info","ts":1685974675.4137673,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"46581c62-6365-4581-95e3-4f516ad2d205"} 2023-06-05T14:18:45.9406987Z {"severity":"error","ts":1685974675.4138799,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"46581c62-6365-4581-95e3-4f516ad2d205","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9408651Z {"severity":"info","ts":1685974675.4958143,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"f4cd318b-9f90-4b8c-9794-5f1fe3cdbe81"} 2023-06-05T14:18:45.9410811Z {"severity":"error","ts":1685974675.495914,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"f4cd318b-9f90-4b8c-9794-5f1fe3cdbe81","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9412773Z {"severity":"info","ts":1685974675.656351,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"02771966-a485-401b-9d2e-1510e49a2329"} 2023-06-05T14:18:45.9414990Z {"severity":"error","ts":1685974675.656447,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"02771966-a485-401b-9d2e-1510e49a2329","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9416817Z {"severity":"info","ts":1685974675.9773872,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"e272da84-0d57-4878-ba80-8a484cebe819"} 2023-06-05T14:18:45.9419111Z {"severity":"error","ts":1685974675.9774902,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"e272da84-0d57-4878-ba80-8a484cebe819","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9420866Z {"severity":"info","ts":1685974676.618346,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"ab02ca29-89db-422c-a4d4-e06d14cc894f"} 2023-06-05T14:18:45.9422967Z {"severity":"error","ts":1685974676.6184478,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"ab02ca29-89db-422c-a4d4-e06d14cc894f","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9424657Z {"severity":"info","ts":1685974677.3840497,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"d149d05f-4a02-478d-9674-a0c3896b4935"} 2023-06-05T14:18:45.9426031Z {"severity":"info","ts":1685974677.4005053,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"d149d05f-4a02-478d-9674-a0c3896b4935","statefuleset name":"test-2-lane-1","lane or node name: ":"test-2-lane-1"} 2023-06-05T14:18:45.9427245Z {"severity":"info","ts":1685974677.4187143,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"d149d05f-4a02-478d-9674-a0c3896b4935","changeset":"StatefulSet/default/test-2-lane-1 created"} 2023-06-05T14:18:45.9428443Z {"severity":"info","ts":1685974677.4303606,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"92f8a845-e071-4b32-ad1b-999b5955841a"} 2023-06-05T14:18:45.9429689Z {"severity":"info","ts":1685974677.4467506,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"92f8a845-e071-4b32-ad1b-999b5955841a","statefuleset name":"test-2-lane-1","lane or node name: ":"test-2-lane-1"} 2023-06-05T14:18:45.9430900Z {"severity":"info","ts":1685974677.4649222,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"92f8a845-e071-4b32-ad1b-999b5955841a","changeset":"StatefulSet/default/test-2-lane-1 unchanged"} 2023-06-05T14:18:45.9431990Z {"severity":"info","ts":1685974677.8989213,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"3e9d9440-1422-4a35-931d-037490fc7d8d"} 2023-06-05T14:18:45.9434100Z {"severity":"error","ts":1685974677.8990324,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"3e9d9440-1422-4a35-931d-037490fc7d8d","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9435792Z {"severity":"info","ts":1685974679.40667,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"5f44a58f-d48e-498e-bcad-2e2301145ce7"} 2023-06-05T14:18:45.9437993Z {"severity":"error","ts":1685974679.4067802,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"5f44a58f-d48e-498e-bcad-2e2301145ce7","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9439807Z {"severity":"info","ts":1685974679.412155,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"9c70f267-833f-49c8-8b0a-c419dbc44bf3"} 2023-06-05T14:18:45.9441881Z {"severity":"error","ts":1685974679.4122608,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"9c70f267-833f-49c8-8b0a-c419dbc44bf3","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9443552Z {"severity":"info","ts":1685974679.4225953,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"ae425009-1684-4272-8a4d-73da02368a7a"} 2023-06-05T14:18:45.9445638Z {"severity":"error","ts":1685974679.422694,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"ae425009-1684-4272-8a4d-73da02368a7a","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9447324Z {"severity":"info","ts":1685974679.443038,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"f055ec47-fe47-4f82-9e0a-b33852409e92"} 2023-06-05T14:18:45.9449430Z {"severity":"error","ts":1685974679.4431734,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"f055ec47-fe47-4f82-9e0a-b33852409e92","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9451225Z {"severity":"info","ts":1685974679.4835565,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"1711b798-3541-4e7b-8860-e11ac1745810"} 2023-06-05T14:18:45.9453650Z {"severity":"error","ts":1685974679.4836726,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"1711b798-3541-4e7b-8860-e11ac1745810","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9455625Z {"severity":"info","ts":1685974679.5641146,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"cdd2df74-62bc-45cc-aa41-61150e972713"} 2023-06-05T14:18:45.9457753Z {"severity":"error","ts":1685974679.5642338,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"cdd2df74-62bc-45cc-aa41-61150e972713","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9459507Z {"severity":"info","ts":1685974679.7344632,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"064f6ff8-c8fa-4150-a17e-ac2407da3e0f"} 2023-06-05T14:18:45.9461611Z {"severity":"error","ts":1685974679.73464,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"064f6ff8-c8fa-4150-a17e-ac2407da3e0f","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9463371Z {"severity":"info","ts":1685974680.0558133,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"6eeb9b13-30ad-4ced-a863-6ad31662d532"} 2023-06-05T14:18:45.9465637Z {"severity":"error","ts":1685974680.0559273,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"6eeb9b13-30ad-4ced-a863-6ad31662d532","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9467473Z {"severity":"info","ts":1685974680.4602113,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"3523fcdb-d5a3-4312-8b05-5a7cf65cd329"} 2023-06-05T14:18:45.9469601Z {"severity":"error","ts":1685974680.460332,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"3523fcdb-d5a3-4312-8b05-5a7cf65cd329","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9471284Z {"severity":"info","ts":1685974680.6967905,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"58072edf-80c8-4d07-b00c-4b5c5071583f"} 2023-06-05T14:18:45.9473895Z {"severity":"error","ts":1685974680.6969173,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"58072edf-80c8-4d07-b00c-4b5c5071583f","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9475588Z {"severity":"info","ts":1685974681.4230618,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"95e5b48f-b0b7-4796-9aa6-46c2c245d58e"} 2023-06-05T14:18:45.9476777Z {"severity":"info","ts":1685974681.4362063,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"95e5b48f-b0b7-4796-9aa6-46c2c245d58e","changeset":""} 2023-06-05T14:18:45.9477838Z {"severity":"info","ts":1685974681.9781742,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"94f08f35-4a3d-428d-9f95-530446e4a16c"} 2023-06-05T14:18:45.9480266Z {"severity":"error","ts":1685974681.9782865,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"94f08f35-4a3d-428d-9f95-530446e4a16c","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9481485Z === RUN TestPersistenceController/TestPersistenceScaling 2023-06-05T14:18:45.9482348Z {"severity":"info","ts":1685974684.5384731,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"e65295b5-73b5-42e8-803f-6a7ad3cd5a31"} 2023-06-05T14:18:45.9484436Z {"severity":"error","ts":1685974684.5385904,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"e65295b5-73b5-42e8-803f-6a7ad3cd5a31","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9486258Z {"severity":"info","ts":1685974685.4612048,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"c89a1428-fa66-4422-80dd-27d7311ade2e"} 2023-06-05T14:18:45.9487442Z {"severity":"info","ts":1685974685.4688308,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"c89a1428-fa66-4422-80dd-27d7311ade2e","statefuleset name":"test-1-lane-1","lane or node name: ":"test-1-lane-1"} 2023-06-05T14:18:45.9488678Z {"severity":"info","ts":1685974685.4690988,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"c89a1428-fa66-4422-80dd-27d7311ade2e","statefuleset name":"test-1-lane-2","lane or node name: ":"test-1-lane-2"} 2023-06-05T14:18:45.9490125Z {"severity":"info","ts":1685974685.4921808,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"c89a1428-fa66-4422-80dd-27d7311ade2e","changeset":"StatefulSet/default/test-1-lane-1 created\nStatefulSet/default/test-1-lane-2 created"} 2023-06-05T14:18:45.9491387Z {"severity":"info","ts":1685974685.4996402,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8d08d967-22e5-482f-84f8-b81dd15ba8c0"} 2023-06-05T14:18:45.9492788Z {"severity":"info","ts":1685974685.5072272,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8d08d967-22e5-482f-84f8-b81dd15ba8c0","statefuleset name":"test-1-lane-1","lane or node name: ":"test-1-lane-1"} 2023-06-05T14:18:45.9494037Z {"severity":"info","ts":1685974685.5074646,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8d08d967-22e5-482f-84f8-b81dd15ba8c0","statefuleset name":"test-1-lane-2","lane or node name: ":"test-1-lane-2"} 2023-06-05T14:18:45.9495321Z {"severity":"info","ts":1685974685.5265193,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8d08d967-22e5-482f-84f8-b81dd15ba8c0","changeset":"StatefulSet/default/test-1-lane-1 unchanged\nStatefulSet/default/test-1-lane-2 unchanged"} 2023-06-05T14:18:45.9496481Z {"severity":"info","ts":1685974685.5807745,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"04348e8a-9a76-4cd4-b90a-29f81419806f"} 2023-06-05T14:18:45.9497649Z {"severity":"info","ts":1685974685.5915997,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"04348e8a-9a76-4cd4-b90a-29f81419806f","statefuleset name":"test-1-lane-1","lane or node name: ":"test-1-lane-1"} 2023-06-05T14:18:45.9498863Z {"severity":"info","ts":1685974685.5918765,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"04348e8a-9a76-4cd4-b90a-29f81419806f","statefuleset name":"test-1-lane-2","lane or node name: ":"test-1-lane-2"} 2023-06-05T14:18:45.9500161Z {"severity":"info","ts":1685974685.6123,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"04348e8a-9a76-4cd4-b90a-29f81419806f","changeset":"StatefulSet/default/test-1-lane-1 unchanged\nStatefulSet/default/test-1-lane-2 unchanged"} 2023-06-05T14:18:45.9501325Z {"severity":"info","ts":1685974687.4769616,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"d7991d84-d9ab-4f31-ab2b-fc6f5302de1c"} 2023-06-05T14:18:45.9503025Z {"severity":"info","ts":1685974687.492122,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"d7991d84-d9ab-4f31-ab2b-fc6f5302de1c","statefuleset name":"test-1-lane-1","lane or node name: ":"test-1-lane-1"} 2023-06-05T14:18:45.9504427Z {"severity":"info","ts":1685974687.5048423,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"d7991d84-d9ab-4f31-ab2b-fc6f5302de1c","changeset":"StatefulSet/default/test-1-lane-1 unchanged"} 2023-06-05T14:18:45.9505616Z {"severity":"info","ts":1685974687.5102315,"message":"pruned objects","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"d7991d84-d9ab-4f31-ab2b-fc6f5302de1c","changeset":"StatefulSet/default/test-1-lane-2 deleted"} 2023-06-05T14:18:45.9506719Z {"severity":"info","ts":1685974687.5193963,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"d711d573-0655-4dd6-adca-2d229f38d601"} 2023-06-05T14:18:45.9507904Z {"severity":"info","ts":1685974687.5322464,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"d711d573-0655-4dd6-adca-2d229f38d601","statefuleset name":"test-1-lane-1","lane or node name: ":"test-1-lane-1"} 2023-06-05T14:18:45.9509111Z {"severity":"info","ts":1685974687.5457485,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"d711d573-0655-4dd6-adca-2d229f38d601","changeset":"StatefulSet/default/test-1-lane-1 unchanged"} 2023-06-05T14:18:45.9510443Z {"severity":"info","ts":1685974689.65935,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"19ed56b6-1748-4e2d-9b67-1e688908cf3d"} 2023-06-05T14:18:45.9512573Z {"severity":"error","ts":1685974689.659465,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"19ed56b6-1748-4e2d-9b67-1e688908cf3d","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9514259Z {"severity":"info","ts":1685974690.4993482,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8594ec2b-d9e3-478d-8574-7d6f62e90d5d"} 2023-06-05T14:18:45.9516489Z {"severity":"error","ts":1685974690.4994278,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8594ec2b-d9e3-478d-8574-7d6f62e90d5d","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9518261Z {"severity":"info","ts":1685974690.5047073,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"84115ea6-4df5-4da3-80a7-409e18654a6d"} 2023-06-05T14:18:45.9520432Z {"severity":"error","ts":1685974690.5047843,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"84115ea6-4df5-4da3-80a7-409e18654a6d","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9522125Z {"severity":"info","ts":1685974690.515082,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"66a7def2-c57f-47cb-8a4c-24edaed73003"} 2023-06-05T14:18:45.9524241Z {"severity":"error","ts":1685974690.5151594,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"66a7def2-c57f-47cb-8a4c-24edaed73003","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9525923Z {"severity":"info","ts":1685974690.5354824,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"471b516e-bf1c-4250-aabb-7b642a7878dc"} 2023-06-05T14:18:45.9528330Z {"severity":"error","ts":1685974690.53557,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"471b516e-bf1c-4250-aabb-7b642a7878dc","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9530152Z {"severity":"info","ts":1685974690.5758736,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"6f69a103-9cc2-4706-9654-c11120059b54"} 2023-06-05T14:18:45.9532480Z {"severity":"error","ts":1685974690.5759547,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"6f69a103-9cc2-4706-9654-c11120059b54","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9534192Z {"severity":"info","ts":1685974690.6563466,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8ba2f570-ff4f-4103-9b77-fdc2ca303367"} 2023-06-05T14:18:45.9536282Z {"severity":"error","ts":1685974690.6564386,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8ba2f570-ff4f-4103-9b77-fdc2ca303367","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9537973Z {"severity":"info","ts":1685974690.8168776,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"640d0406-67b4-4d63-9290-4cd3350f2ae8"} 2023-06-05T14:18:45.9540231Z {"severity":"error","ts":1685974690.8169959,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"640d0406-67b4-4d63-9290-4cd3350f2ae8","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9541991Z {"severity":"info","ts":1685974691.1377542,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"f417fd73-4977-4935-bdf5-be373b3c895b"} 2023-06-05T14:18:45.9544080Z {"severity":"error","ts":1685974691.1378577,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"f417fd73-4977-4935-bdf5-be373b3c895b","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9545747Z {"severity":"info","ts":1685974691.7782474,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8d88afb7-2e4d-4c38-ba07-a7a10df53a34"} 2023-06-05T14:18:45.9547994Z {"severity":"error","ts":1685974691.7783642,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"8d88afb7-2e4d-4c38-ba07-a7a10df53a34","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9549732Z {"severity":"info","ts":1685974693.059357,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"e7963fae-007b-42f0-b61e-91584997e448"} 2023-06-05T14:18:45.9551808Z {"severity":"error","ts":1685974693.05949,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"e7963fae-007b-42f0-b61e-91584997e448","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9553600Z {"severity":"info","ts":1685974693.5240695,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"1985a6ee-c12a-4112-af8f-619106298475"} 2023-06-05T14:18:45.9554904Z {"severity":"info","ts":1685974693.5307019,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"1985a6ee-c12a-4112-af8f-619106298475","statefuleset name":"test-2-lane-1","lane or node name: ":"test-2-lane-1"} 2023-06-05T14:18:45.9556108Z {"severity":"info","ts":1685974693.5406923,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"1985a6ee-c12a-4112-af8f-619106298475","changeset":"StatefulSet/default/test-2-lane-1 created"} 2023-06-05T14:18:45.9557273Z {"severity":"info","ts":1685974693.5472572,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"d4f721cb-905b-4d21-a132-ae804ce5816f"} 2023-06-05T14:18:45.9558456Z {"severity":"info","ts":1685974693.5540502,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"d4f721cb-905b-4d21-a132-ae804ce5816f","statefuleset name":"test-2-lane-1","lane or node name: ":"test-2-lane-1"} 2023-06-05T14:18:45.9559696Z {"severity":"info","ts":1685974693.5626988,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"d4f721cb-905b-4d21-a132-ae804ce5816f","changeset":"StatefulSet/default/test-2-lane-1 unchanged"} 2023-06-05T14:18:45.9560802Z {"severity":"info","ts":1685974695.536867,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"412e6755-e33b-4778-940e-5fadeffe2e6d"} 2023-06-05T14:18:45.9562145Z {"severity":"info","ts":1685974695.544055,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"412e6755-e33b-4778-940e-5fadeffe2e6d","statefuleset name":"test-2-lane-1","lane or node name: ":"test-2-lane-1"} 2023-06-05T14:18:45.9563361Z {"severity":"info","ts":1685974695.544253,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"412e6755-e33b-4778-940e-5fadeffe2e6d","statefuleset name":"test-2-lane-2","lane or node name: ":"test-2-lane-2"} 2023-06-05T14:18:45.9564621Z {"severity":"info","ts":1685974695.5626447,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"412e6755-e33b-4778-940e-5fadeffe2e6d","changeset":"StatefulSet/default/test-2-lane-1 unchanged\nStatefulSet/default/test-2-lane-2 created"} 2023-06-05T14:18:45.9565882Z {"severity":"info","ts":1685974695.5695643,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"e225763c-cc5b-4450-8aab-d2a13f798338"} 2023-06-05T14:18:45.9567156Z {"severity":"info","ts":1685974695.5760767,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"e225763c-cc5b-4450-8aab-d2a13f798338","statefuleset name":"test-2-lane-1","lane or node name: ":"test-2-lane-1"} 2023-06-05T14:18:45.9568397Z {"severity":"info","ts":1685974695.5762537,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"e225763c-cc5b-4450-8aab-d2a13f798338","statefuleset name":"test-2-lane-2","lane or node name: ":"test-2-lane-2"} 2023-06-05T14:18:45.9569708Z {"severity":"info","ts":1685974695.5920174,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"e225763c-cc5b-4450-8aab-d2a13f798338","changeset":"StatefulSet/default/test-2-lane-1 unchanged\nStatefulSet/default/test-2-lane-2 unchanged"} 2023-06-05T14:18:45.9570864Z {"severity":"info","ts":1685974695.6197593,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"90c609f2-725e-482b-8cea-e92462663217"} 2023-06-05T14:18:45.9573441Z {"severity":"error","ts":1685974695.6198723,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"90c609f2-725e-482b-8cea-e92462663217","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9575139Z {"severity":"info","ts":1685974698.5563345,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"819ee3ae-6a49-4fa0-853a-90c44e96230d"} 2023-06-05T14:18:45.9577233Z {"severity":"error","ts":1685974698.5564084,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"819ee3ae-6a49-4fa0-853a-90c44e96230d","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9579097Z {"severity":"info","ts":1685974698.558247,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"4c2fe241-04c1-43be-9ee9-a086d79bf545"} 2023-06-05T14:18:45.9581417Z {"severity":"error","ts":1685974698.5583055,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"4c2fe241-04c1-43be-9ee9-a086d79bf545","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9583158Z {"severity":"info","ts":1685974698.5615218,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"85a1a1a5-068f-4512-8abf-37e546692893"} 2023-06-05T14:18:45.9585263Z {"severity":"error","ts":1685974698.561594,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"85a1a1a5-068f-4512-8abf-37e546692893","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9586923Z {"severity":"info","ts":1685974698.581883,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"c579a96e-81ed-4cd7-be7b-7673e831ac0b"} 2023-06-05T14:18:45.9589022Z {"severity":"error","ts":1685974698.5819683,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"c579a96e-81ed-4cd7-be7b-7673e831ac0b","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9590880Z {"severity":"info","ts":1685974698.6223683,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"2f89aae8-702e-4138-87c3-8976405459cb"} 2023-06-05T14:18:45.9593067Z {"severity":"error","ts":1685974698.6224663,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"2f89aae8-702e-4138-87c3-8976405459cb","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9594734Z {"severity":"info","ts":1685974698.7028673,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"ac6e418f-10f7-485d-ab80-fd160d9d7a5e"} 2023-06-05T14:18:45.9596819Z {"severity":"error","ts":1685974698.7029586,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"ac6e418f-10f7-485d-ab80-fd160d9d7a5e","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9598518Z {"severity":"info","ts":1685974698.8634744,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"bf9915ce-ed14-460a-b926-71a6a59db676"} 2023-06-05T14:18:45.9600641Z {"severity":"error","ts":1685974698.8635812,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"bf9915ce-ed14-460a-b926-71a6a59db676","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9602314Z {"severity":"info","ts":1685974699.1841872,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"aaca3e07-a198-463b-908d-cdd51871833d"} 2023-06-05T14:18:45.9604516Z {"severity":"error","ts":1685974699.1842835,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"aaca3e07-a198-463b-908d-cdd51871833d","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9606288Z {"severity":"info","ts":1685974699.8244154,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"49edf143-ec3e-4e2f-bc9c-bf1ca3d6af1e"} 2023-06-05T14:18:45.9608388Z {"severity":"error","ts":1685974699.8245232,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"49edf143-ec3e-4e2f-bc9c-bf1ca3d6af1e","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9610087Z {"severity":"info","ts":1685974700.7406256,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"99ce70c1-a3e6-4a00-84fb-8ea018bccbdc"} 2023-06-05T14:18:45.9612451Z {"severity":"error","ts":1685974700.740726,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"99ce70c1-a3e6-4a00-84fb-8ea018bccbdc","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9614193Z {"severity":"info","ts":1685974701.1053061,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"b4c5b5f6-4e03-4605-830e-ebf425016bcd"} 2023-06-05T14:18:45.9616438Z {"severity":"error","ts":1685974701.1054149,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"b4c5b5f6-4e03-4605-830e-ebf425016bcd","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9618225Z {"severity":"info","ts":1685974701.5848398,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"d09f792f-9033-4c4e-9f9a-f1544044fed2"} 2023-06-05T14:18:45.9619414Z {"severity":"info","ts":1685974701.592021,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"d09f792f-9033-4c4e-9f9a-f1544044fed2","statefuleset name":"test-3-lane-1","lane or node name: ":"test-3-lane-1"} 2023-06-05T14:18:45.9620680Z {"severity":"info","ts":1685974701.6038134,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"d09f792f-9033-4c4e-9f9a-f1544044fed2","changeset":"StatefulSet/default/test-3-lane-1 created"} 2023-06-05T14:18:45.9621774Z {"severity":"info","ts":1685974701.6108613,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"906ff32b-1547-451d-b4d5-db57711e88c4"} 2023-06-05T14:18:45.9622953Z {"severity":"info","ts":1685974701.6182196,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"906ff32b-1547-451d-b4d5-db57711e88c4","statefuleset name":"test-3-lane-1","lane or node name: ":"test-3-lane-1"} 2023-06-05T14:18:45.9624151Z {"severity":"info","ts":1685974701.6275177,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"906ff32b-1547-451d-b4d5-db57711e88c4","changeset":"StatefulSet/default/test-3-lane-1 unchanged"} 2023-06-05T14:18:45.9625255Z {"severity":"info","ts":1685974703.5993974,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"13a5a091-a05b-4047-aa4d-ae8644571bae"} 2023-06-05T14:18:45.9626433Z {"severity":"info","ts":1685974703.6078033,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"13a5a091-a05b-4047-aa4d-ae8644571bae","statefuleset name":"test-3-lane-1","lane or node name: ":"test-3-lane-1"} 2023-06-05T14:18:45.9627628Z {"severity":"info","ts":1685974703.6161969,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"13a5a091-a05b-4047-aa4d-ae8644571bae","changeset":"StatefulSet/default/test-3-lane-1 unchanged"} 2023-06-05T14:18:45.9628908Z {"severity":"info","ts":1685974703.6658545,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"3059d459-b0d4-4f16-9264-ec23105cab6a"} 2023-06-05T14:18:45.9631150Z {"severity":"error","ts":1685974703.666008,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"3059d459-b0d4-4f16-9264-ec23105cab6a","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9632813Z {"severity":"info","ts":1685974706.6187935,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"c6ff9663-8dfd-406f-bc32-b89a2c478eee"} 2023-06-05T14:18:45.9634934Z {"severity":"error","ts":1685974706.6188803,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"c6ff9663-8dfd-406f-bc32-b89a2c478eee","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9636627Z {"severity":"info","ts":1685974706.6242003,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"9ca55349-7769-48dc-ab29-c80997859f4b"} 2023-06-05T14:18:45.9638717Z {"severity":"error","ts":1685974706.6242712,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"9ca55349-7769-48dc-ab29-c80997859f4b","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9640560Z {"severity":"info","ts":1685974706.6345625,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"deb0b7c8-bfd1-4463-bc33-a3448be27798"} 2023-06-05T14:18:45.9642649Z {"severity":"error","ts":1685974706.6346354,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"deb0b7c8-bfd1-4463-bc33-a3448be27798","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9644450Z {"severity":"info","ts":1685974706.6549637,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"efef47c0-3dd3-4d22-8cae-c3582aa09c8f"} 2023-06-05T14:18:45.9646571Z {"severity":"error","ts":1685974706.6550496,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"efef47c0-3dd3-4d22-8cae-c3582aa09c8f","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9648240Z {"severity":"info","ts":1685974706.6954272,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"4d08e984-b144-412b-b1f5-f9f84773af0a"} 2023-06-05T14:18:45.9650351Z {"severity":"error","ts":1685974706.6955118,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"4d08e984-b144-412b-b1f5-f9f84773af0a","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9652391Z {"severity":"info","ts":1685974706.7759144,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"78c48c1f-a7b1-4d6a-a690-71565c376866"} 2023-06-05T14:18:45.9654745Z {"severity":"error","ts":1685974706.776015,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"78c48c1f-a7b1-4d6a-a690-71565c376866","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9656571Z {"severity":"info","ts":1685974706.9364917,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"7dda462b-a452-4d98-b233-5bf2c0e1a11b"} 2023-06-05T14:18:45.9658675Z {"severity":"error","ts":1685974706.936586,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"7dda462b-a452-4d98-b233-5bf2c0e1a11b","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9660418Z {"severity":"info","ts":1685974707.2572691,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"54877cfb-82fb-45d6-8401-ff6bd287d3e6"} 2023-06-05T14:18:45.9662521Z {"severity":"error","ts":1685974707.2573717,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"54877cfb-82fb-45d6-8401-ff6bd287d3e6","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9664210Z {"severity":"info","ts":1685974707.8980496,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"5bb1827f-5b5f-4aa2-8801-f69d7af18ef5"} 2023-06-05T14:18:45.9666454Z {"severity":"error","ts":1685974707.8981647,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"5bb1827f-5b5f-4aa2-8801-f69d7af18ef5","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9668237Z {"severity":"info","ts":1685974708.7861497,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"bcd0b90c-f28f-4ade-adb6-74b8bebea0d0"} 2023-06-05T14:18:45.9670396Z {"severity":"error","ts":1685974708.7862535,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"bcd0b90c-f28f-4ade-adb6-74b8bebea0d0","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9672102Z {"severity":"info","ts":1685974709.1789644,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"06168a80-fb19-4554-ad91-72e7296eea21"} 2023-06-05T14:18:45.9674173Z {"severity":"error","ts":1685974709.1790848,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"06168a80-fb19-4554-ad91-72e7296eea21","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9675841Z {"severity":"info","ts":1685974709.6515684,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"c631a6d0-05fb-49ba-9a08-407f8c1302d0"} 2023-06-05T14:18:45.9677032Z {"severity":"info","ts":1685974709.6586275,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"c631a6d0-05fb-49ba-9a08-407f8c1302d0","statefuleset name":"test-4-lane-1","lane or node name: ":"test-4-lane-1"} 2023-06-05T14:18:45.9678411Z {"severity":"info","ts":1685974709.658847,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"c631a6d0-05fb-49ba-9a08-407f8c1302d0","statefuleset name":"test-4-lane-2","lane or node name: ":"test-4-lane-2"} 2023-06-05T14:18:45.9679836Z {"severity":"info","ts":1685974709.68058,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"c631a6d0-05fb-49ba-9a08-407f8c1302d0","changeset":"StatefulSet/default/test-4-lane-1 created\nStatefulSet/default/test-4-lane-2 created"} 2023-06-05T14:18:45.9681000Z {"severity":"info","ts":1685974709.6893525,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"5fec6239-ed61-4c76-8c74-c415ae489bdd"} 2023-06-05T14:18:45.9682191Z {"severity":"info","ts":1685974709.696542,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"5fec6239-ed61-4c76-8c74-c415ae489bdd","statefuleset name":"test-4-lane-1","lane or node name: ":"test-4-lane-1"} 2023-06-05T14:18:45.9683439Z {"severity":"info","ts":1685974709.6968188,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"5fec6239-ed61-4c76-8c74-c415ae489bdd","statefuleset name":"test-4-lane-2","lane or node name: ":"test-4-lane-2"} 2023-06-05T14:18:45.9684731Z {"severity":"info","ts":1685974709.7139173,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"5fec6239-ed61-4c76-8c74-c415ae489bdd","changeset":"StatefulSet/default/test-4-lane-1 unchanged\nStatefulSet/default/test-4-lane-2 unchanged"} 2023-06-05T14:18:45.9685897Z {"severity":"info","ts":1685974710.9818807,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"6ab08166-e9ef-4021-91b6-9234a8af0990"} 2023-06-05T14:18:45.9687983Z {"severity":"error","ts":1685974710.9819956,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-1","namespace":"default"},"namespace":"default","name":"test-1","reconcileID":"6ab08166-e9ef-4021-91b6-9234a8af0990","error":"Persistence.edge.ncr.com \"test-1\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9689703Z {"severity":"info","ts":1685974711.6656196,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"767b6eaf-8c50-4290-bfaf-675bf46d4fe1"} 2023-06-05T14:18:45.9691031Z {"severity":"info","ts":1685974711.6733181,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"767b6eaf-8c50-4290-bfaf-675bf46d4fe1","statefuleset name":"test-4-lane-1","lane or node name: ":"test-4-lane-1"} 2023-06-05T14:18:45.9692603Z {"severity":"info","ts":1685974711.6820595,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"767b6eaf-8c50-4290-bfaf-675bf46d4fe1","changeset":"StatefulSet/default/test-4-lane-1 unchanged"} 2023-06-05T14:18:45.9693771Z {"severity":"info","ts":1685974711.685984,"message":"pruned objects","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"767b6eaf-8c50-4290-bfaf-675bf46d4fe1","changeset":"StatefulSet/default/test-4-lane-2 deleted"} 2023-06-05T14:18:45.9694861Z {"severity":"info","ts":1685974711.6926308,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"144c22b3-345c-471a-8579-3af8749f8293"} 2023-06-05T14:18:45.9696031Z {"severity":"info","ts":1685974711.6999342,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"144c22b3-345c-471a-8579-3af8749f8293","statefuleset name":"test-4-lane-1","lane or node name: ":"test-4-lane-1"} 2023-06-05T14:18:45.9697215Z {"severity":"info","ts":1685974711.7086194,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"144c22b3-345c-471a-8579-3af8749f8293","changeset":"StatefulSet/default/test-4-lane-1 unchanged"} 2023-06-05T14:18:45.9698356Z {"severity":"info","ts":1685974711.7098005,"message":"pruned objects","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"144c22b3-345c-471a-8579-3af8749f8293","changeset":"StatefulSet/default/test-4-lane-2 deleted"} 2023-06-05T14:18:45.9699439Z {"severity":"info","ts":1685974711.739471,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"41a027f3-bfa8-49a2-965b-0f1334eac352"} 2023-06-05T14:18:45.9701570Z {"severity":"error","ts":1685974711.7395625,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"41a027f3-bfa8-49a2-965b-0f1334eac352","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9703431Z {"severity":"info","ts":1685974714.6882994,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"f91c26f5-43b3-438e-ab32-f89aabb45be6"} 2023-06-05T14:18:45.9705636Z {"severity":"error","ts":1685974714.6883776,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"f91c26f5-43b3-438e-ab32-f89aabb45be6","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9707297Z {"severity":"info","ts":1685974714.69365,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"59c94307-c334-4c82-9987-1eaf94f71246"} 2023-06-05T14:18:45.9709383Z {"severity":"error","ts":1685974714.693715,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"59c94307-c334-4c82-9987-1eaf94f71246","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9711084Z {"severity":"info","ts":1685974714.704056,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"c32af9aa-83b0-4ef1-a424-6fe720c0406a"} 2023-06-05T14:18:45.9713166Z {"severity":"error","ts":1685974714.7041636,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"c32af9aa-83b0-4ef1-a424-6fe720c0406a","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9714839Z {"severity":"info","ts":1685974714.724539,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"ab4fc604-994d-4df4-895d-4891514938a3"} 2023-06-05T14:18:45.9717119Z {"severity":"error","ts":1685974714.724648,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"ab4fc604-994d-4df4-895d-4891514938a3","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9718919Z {"severity":"info","ts":1685974714.7650132,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"6e25c62a-e4b2-4eb1-b21f-4ea45153384c"} 2023-06-05T14:18:45.9721069Z {"severity":"error","ts":1685974714.7651064,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"6e25c62a-e4b2-4eb1-b21f-4ea45153384c","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9722748Z {"severity":"info","ts":1685974714.845528,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"f0100918-eaf7-42a3-837f-59d81ad70b56"} 2023-06-05T14:18:45.9724843Z {"severity":"error","ts":1685974714.8456583,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"f0100918-eaf7-42a3-837f-59d81ad70b56","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9726589Z {"severity":"info","ts":1685974715.0062096,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"7ea896be-d0d7-4dab-927b-a69555c3f05b"} 2023-06-05T14:18:45.9728801Z {"severity":"error","ts":1685974715.0063124,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"7ea896be-d0d7-4dab-927b-a69555c3f05b","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9730601Z {"severity":"info","ts":1685974715.3268845,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"9a543030-09ae-4873-a8d7-3a85fff2773d"} 2023-06-05T14:18:45.9732991Z {"severity":"error","ts":1685974715.3270051,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"9a543030-09ae-4873-a8d7-3a85fff2773d","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9734686Z {"severity":"info","ts":1685974715.968178,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"2e00b498-11f6-4ed5-af73-1cd0dbc4016e"} 2023-06-05T14:18:45.9736791Z {"severity":"error","ts":1685974715.968306,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"2e00b498-11f6-4ed5-af73-1cd0dbc4016e","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9738485Z {"severity":"info","ts":1685974716.860718,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"b83404b8-07d8-4fa0-92d3-4a2f922daf83"} 2023-06-05T14:18:45.9740861Z {"severity":"error","ts":1685974716.8608406,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-3","namespace":"default"},"namespace":"default","name":"test-3","reconcileID":"b83404b8-07d8-4fa0-92d3-4a2f922daf83","error":"Persistence.edge.ncr.com \"test-3\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9742670Z {"severity":"info","ts":1685974717.2484825,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"50ed5e47-16d3-4dff-94c3-5dc355fd427b"} 2023-06-05T14:18:45.9744761Z {"severity":"error","ts":1685974717.2485816,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"50ed5e47-16d3-4dff-94c3-5dc355fd427b","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9746446Z {"severity":"info","ts":1685974717.7136285,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"f5fc3f2d-7994-4106-845a-a417f0ea4041"} 2023-06-05T14:18:45.9747769Z {"severity":"info","ts":1685974717.7205653,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"f5fc3f2d-7994-4106-845a-a417f0ea4041","statefuleset name":"test-5-lane-1","lane or node name: ":"test-5-lane-1"} 2023-06-05T14:18:45.9748978Z {"severity":"info","ts":1685974717.7311027,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"f5fc3f2d-7994-4106-845a-a417f0ea4041","changeset":"StatefulSet/default/test-5-lane-1 created"} 2023-06-05T14:18:45.9750119Z {"severity":"info","ts":1685974717.7382758,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"a1822c27-7ef5-41cf-a050-4e90c923a2b4"} 2023-06-05T14:18:45.9751293Z {"severity":"info","ts":1685974717.746986,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"a1822c27-7ef5-41cf-a050-4e90c923a2b4","statefuleset name":"test-5-lane-1","lane or node name: ":"test-5-lane-1"} 2023-06-05T14:18:45.9752496Z {"severity":"info","ts":1685974717.7551668,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"a1822c27-7ef5-41cf-a050-4e90c923a2b4","changeset":"StatefulSet/default/test-5-lane-1 unchanged"} 2023-06-05T14:18:45.9753714Z {"severity":"info","ts":1685974719.0274773,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"55bafbe3-edce-4ce5-8ee4-c2463b8d4751"} 2023-06-05T14:18:45.9755941Z {"severity":"error","ts":1685974719.0276024,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-2","namespace":"default"},"namespace":"default","name":"test-2","reconcileID":"55bafbe3-edce-4ce5-8ee4-c2463b8d4751","error":"Persistence.edge.ncr.com \"test-2\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9757641Z {"severity":"info","ts":1685974719.7260907,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"8227c878-5907-4a02-8fe5-31763cf4bb3b"} 2023-06-05T14:18:45.9758820Z {"severity":"info","ts":1685974719.733316,"message":"creating stateful set for lane","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"8227c878-5907-4a02-8fe5-31763cf4bb3b","statefuleset name":"test-5-lane-1","lane or node name: ":"test-5-lane-1"} 2023-06-05T14:18:45.9760062Z {"severity":"info","ts":1685974719.7417333,"message":"stateful sets created","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"8227c878-5907-4a02-8fe5-31763cf4bb3b","changeset":"StatefulSet/default/test-5-lane-1 unchanged"} 2023-06-05T14:18:45.9761158Z {"severity":"info","ts":1685974719.8093054,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"84782dc3-cac2-40c1-bb3c-41fb775b09ad"} 2023-06-05T14:18:45.9763252Z {"severity":"error","ts":1685974719.8094192,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-4","namespace":"default"},"namespace":"default","name":"test-4","reconcileID":"84782dc3-cac2-40c1-bb3c-41fb775b09ad","error":"Persistence.edge.ncr.com \"test-4\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9764939Z {"severity":"info","ts":1685974722.7491384,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"f6f8d5f5-8f2b-4869-a4e7-c0ba50b55bdc"} 2023-06-05T14:18:45.9767125Z {"severity":"error","ts":1685974722.7492478,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"f6f8d5f5-8f2b-4869-a4e7-c0ba50b55bdc","error":"Persistence.edge.ncr.com \"test-5\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9768879Z {"severity":"info","ts":1685974722.754516,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"843a6f57-13de-4441-bea8-f28701c07f8f"} 2023-06-05T14:18:45.9771045Z {"severity":"error","ts":1685974722.7545745,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"843a6f57-13de-4441-bea8-f28701c07f8f","error":"Persistence.edge.ncr.com \"test-5\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9772966Z {"severity":"info","ts":1685974722.7649052,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"d598200c-c42c-42d1-84ac-88544ac6ca4a"} 2023-06-05T14:18:45.9775048Z {"severity":"error","ts":1685974722.7649963,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"d598200c-c42c-42d1-84ac-88544ac6ca4a","error":"Persistence.edge.ncr.com \"test-5\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9776693Z {"severity":"info","ts":1685974722.7852378,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"4ae5ed95-2486-455b-b0b0-5437d4c6e088"} 2023-06-05T14:18:45.9778916Z {"severity":"error","ts":1685974722.785329,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"4ae5ed95-2486-455b-b0b0-5437d4c6e088","error":"Persistence.edge.ncr.com \"test-5\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9780811Z {"severity":"info","ts":1685974722.8256333,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"19405f4d-eef5-4fb7-be85-e0443db173ba"} 2023-06-05T14:18:45.9782910Z {"severity":"error","ts":1685974722.8257158,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"19405f4d-eef5-4fb7-be85-e0443db173ba","error":"Persistence.edge.ncr.com \"test-5\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9784572Z {"severity":"info","ts":1685974722.9061048,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"a1c20d8a-9558-4570-b9ff-75155f1e682e"} 2023-06-05T14:18:45.9786649Z {"severity":"error","ts":1685974722.9062054,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"a1c20d8a-9558-4570-b9ff-75155f1e682e","error":"Persistence.edge.ncr.com \"test-5\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9788277Z {"severity":"info","ts":1685974723.0667062,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"493e882c-8d56-4855-af78-c8f15000f466"} 2023-06-05T14:18:45.9790505Z {"severity":"error","ts":1685974723.066817,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"493e882c-8d56-4855-af78-c8f15000f466","error":"Persistence.edge.ncr.com \"test-5\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9792293Z {"severity":"info","ts":1685974723.387409,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"c1e09a84-f23c-4bff-84a7-a042911b9a85"} 2023-06-05T14:18:45.9794384Z {"severity":"error","ts":1685974723.3875139,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"c1e09a84-f23c-4bff-84a7-a042911b9a85","error":"Persistence.edge.ncr.com \"test-5\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9796071Z {"severity":"info","ts":1685974724.027729,"message":"reconciling started for persistence","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"a339a760-58cb-4e71-9ccb-51f6a9096d5b"} 2023-06-05T14:18:45.9798159Z {"severity":"error","ts":1685974724.0278478,"message":"Reconciler error","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence","Persistence":{"name":"test-5","namespace":"default"},"namespace":"default","name":"test-5","reconcileID":"a339a760-58cb-4e71-9ccb-51f6a9096d5b","error":"Persistence.edge.ncr.com \"test-5\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:326\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\texternal/io_k8s_sigs_controller_runtime/pkg/internal/controller/controller.go:234"} 2023-06-05T14:18:45.9799363Z {"severity":"info","ts":1685974724.7604756,"message":"Stopping and waiting for non leader election runnables"} 2023-06-05T14:18:45.9799776Z {"severity":"info","ts":1685974724.7605445,"message":"Stopping and waiting for leader election runnables"} 2023-06-05T14:18:45.9800246Z {"severity":"info","ts":1685974724.760572,"message":"Shutdown signal received, waiting for all workers to finish","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence"} 2023-06-05T14:18:45.9800776Z {"severity":"info","ts":1685974724.7605965,"message":"All workers finished","controller":"persistence","controllerGroup":"edge.ncr.com","controllerKind":"Persistence"} 2023-06-05T14:18:45.9801177Z {"severity":"info","ts":1685974724.7606013,"message":"Stopping and waiting for caches"} 2023-06-05T14:18:45.9801521Z {"severity":"info","ts":1685974724.7607229,"message":"Stopping and waiting for webhooks"} 2023-06-05T14:18:45.9801868Z {"severity":"info","ts":1685974724.7607462,"message":"Wait completed, proceeding to shutdown the manager"} 2023-06-05T14:18:45.9802254Z --- PASS: TestPersistenceController (64.94s) 2023-06-05T14:18:45.9802786Z --- PASS: TestPersistenceController/TestPersistence (12.26s) 2023-06-05T14:18:45.9803234Z --- PASS: TestPersistenceController/TestPersistenceScaling (40.32s) 2023-06-05T14:18:45.9803575Z PASS 2023-06-05T14:18:45.9803782Z ================================================================================ 2023-06-05T14:18:46.0062976Z INFO: Elapsed time: 133.604s, Critical Path: 82.61s 2023-06-05T14:18:46.0063531Z INFO: 3017 processes: 773 disk cache hit, 1772 remote cache hit, 295 internal, 177 processwrapper-sandbox. 2023-06-05T14:18:46.0321034Z //cmd/f8n/monitoring/alertman/cli:cli_test PASSED in 0.1s 2023-06-05T14:18:46.0321800Z //config/pallets:pallets_test PASSED in 2.3s 2023-06-05T14:18:46.0322703Z //pkg/edge/api/apierror:apierror_test PASSED in 0.2s 2023-06-05T14:18:46.0327359Z //pkg/edge/api/clients:clients_test PASSED in 0.2s 2023-06-05T14:18:46.0328042Z //pkg/edge/api/graph/integration:integration_test PASSED in 14.2s 2023-06-05T14:18:46.0328644Z //pkg/edge/api/graph/mapper:mapper_test PASSED in 0.4s 2023-06-05T14:18:46.0329354Z //pkg/edge/api/graph/resolver:resolver_test PASSED in 0.5s 2023-06-05T14:18:46.0332413Z //pkg/edge/api/middleware:middleware_test PASSED in 0.2s 2023-06-05T14:18:46.0333200Z //pkg/edge/api/services:services_test PASSED in 4.7s 2023-06-05T14:18:46.0333911Z //pkg/edge/api/utils:utils_test PASSED in 0.6s 2023-06-05T14:18:46.0334868Z //pkg/edge/bootstrapping:bootstrapping_test PASSED in 0.3s 2023-06-05T14:18:46.0336943Z //pkg/edge/bsl:bsl_test PASSED in 2.1s 2023-06-05T14:18:46.0339128Z //pkg/edge/bsl-reconciler:bsl-reconciler_test PASSED in 7.9s 2023-06-05T14:18:46.0340179Z //pkg/edge/chariot:chariot_test PASSED in 0.5s 2023-06-05T14:18:46.0342550Z //pkg/edge/clientutils:clientutils_test PASSED in 0.4s 2023-06-05T14:18:46.0345369Z //pkg/edge/component/build/updatemanifests:updatemanifests_test PASSED in 0.1s 2023-06-05T14:18:46.0346962Z //pkg/edge/controllers/bannerctl:bannerctl_test PASSED in 19.9s 2023-06-05T14:18:46.0348746Z //pkg/edge/controllers/clusterctl:clusterctl_test PASSED in 24.7s 2023-06-05T14:18:46.0349327Z //pkg/edge/controllers/clusterctl/pkg/iamutils:iamutils_test PASSED in 0.3s 2023-06-05T14:18:46.0351239Z //pkg/edge/controllers/clusterctl/pkg/plugins:plugins_test PASSED in 20.2s 2023-06-05T14:18:46.0355454Z //pkg/edge/controllers/envctl:envctl_test PASSED in 65.2s 2023-06-05T14:18:46.0356347Z //pkg/edge/controllers/envctl/pkg/nameutils:nameutils_test PASSED in 0.3s 2023-06-05T14:18:46.0357873Z //pkg/edge/controllers/syncedobject:syncedobject_test PASSED in 14.7s 2023-06-05T14:18:46.0358802Z //pkg/edge/ctlfish/monitor:monitor_test PASSED in 1.2s 2023-06-05T14:18:46.0363011Z //pkg/edge/ctlfish/option:option_test PASSED in 0.4s 2023-06-05T14:18:46.0364764Z //pkg/edge/datasync/apis/v1alpha1:v1alpha1_test PASSED in 0.3s 2023-06-05T14:18:46.0366646Z //pkg/edge/datasync/chirp/persister/files:files_test PASSED in 0.7s 2023-06-05T14:18:46.0368914Z //pkg/edge/datasync/chirp/provider:provider_test PASSED in 0.4s 2023-06-05T14:18:46.0370279Z //pkg/edge/datasync/chirp/server/http:http_test PASSED in 0.2s 2023-06-05T14:18:46.0372147Z //pkg/edge/datasync/controllers/couchctl:couchctl_test PASSED in 51.7s 2023-06-05T14:18:46.0374680Z //pkg/edge/datasync/controllers/couchctl/couchdb:couchdb_test PASSED in 1.5s 2023-06-05T14:18:46.0375622Z //pkg/edge/datasync/couchdb:couchdb_test PASSED in 0.1s 2023-06-05T14:18:46.0377100Z //pkg/edge/datasync/cushion:cushion_test PASSED in 0.2s 2023-06-05T14:18:46.0378346Z //pkg/edge/datasync/internal/configmap:configmap_test PASSED in 0.3s 2023-06-05T14:18:46.0380762Z //pkg/edge/datasync/internal/signature:signature_test PASSED in 0.4s 2023-06-05T14:18:46.0381848Z //pkg/edge/gitops/chariot/client:client_test PASSED in 0.1s 2023-06-05T14:18:46.0384949Z //pkg/edge/gitops/fns/addcluster:addcluster_test PASSED in 0.3s 2023-06-05T14:18:46.0391260Z //pkg/edge/gitops/fns/addcontainercluster:addcontainercluster_test PASSED in 0.1s 2023-06-05T14:18:46.0391898Z //pkg/edge/gitops/fns/addcontainerpool:addcontainerpool_test PASSED in 0.1s 2023-06-05T14:18:46.0392648Z //pkg/edge/gitops/fns/addexternalsecret:addexternalsecret_test PASSED in 0.8s 2023-06-05T14:18:46.0393424Z //pkg/edge/gitops/fns/addhelmrepository:addhelmrepository_test PASSED in 0.1s 2023-06-05T14:18:46.0394132Z //pkg/edge/gitops/fns/addnamespace:addnamespace_test PASSED in 0.3s 2023-06-05T14:18:46.0395572Z //pkg/edge/gitops/fns/addtenant:addtenant_test PASSED in 0.1s 2023-06-05T14:18:46.0398006Z //pkg/edge/gitops/fns/clusterselgen:clusterselgen_test PASSED in 0.1s 2023-06-05T14:18:46.0398831Z //pkg/edge/gitops/fns/deleteresource:deleteresource_test PASSED in 0.1s 2023-06-05T14:18:46.0401913Z //pkg/edge/gitops/fns/edgerelease:edgerelease_test PASSED in 0.5s 2023-06-05T14:18:46.0402672Z //pkg/edge/gitops/fns/trimmer:trimmer_test PASSED in 0.0s 2023-06-05T14:18:46.0404930Z //pkg/edge/iam/util:util_test PASSED in 0.3s 2023-06-05T14:18:46.0406736Z //pkg/edge/info:info_test PASSED in 16.8s 2023-06-05T14:18:46.0408375Z //pkg/edge/linkerd/controllers:controllers_test PASSED in 36.3s 2023-06-05T14:18:46.0410811Z //pkg/edge/registration:registration_test PASSED in 3.3s 2023-06-05T14:18:46.0412278Z //pkg/edge/shipment/generator:generator_test PASSED in 0.5s 2023-06-05T14:18:46.0414907Z //pkg/edge/webhooks/edge-injector:edge-injector_test PASSED in 20.2s 2023-06-05T14:18:46.0416280Z //pkg/f8n/devinfra/gcp/job/storage:storage_test PASSED in 0.2s 2023-06-05T14:18:46.0418183Z //pkg/f8n/devinfra/ghappman:ghappman_test PASSED in 0.2s 2023-06-05T14:18:46.0421041Z //pkg/f8n/devinfra/gridbug:gridbug_test PASSED in 0.1s 2023-06-05T14:18:46.0421833Z //pkg/f8n/devinfra/jack:jack_test PASSED in 0.2s 2023-06-05T14:18:46.0430412Z //pkg/f8n/devinfra/jack/guest_services:guest_services_test PASSED in 0.2s 2023-06-05T14:18:46.0431297Z //pkg/f8n/devinfra/jack/plugin/approved_label:approved_label_test PASSED in 0.1s 2023-06-05T14:18:46.0433759Z //pkg/f8n/devinfra/jack/plugin/approved_label:bulldoze_sync_label_test PASSED in 0.0s 2023-06-05T14:18:46.0434943Z //pkg/f8n/devinfra/jack/plugin/changelog:changelog_test PASSED in 0.6s 2023-06-05T14:18:46.0435818Z //pkg/f8n/devinfra/jack/plugin/enforce_milestone:enforce_milestone_test PASSED in 0.0s 2023-06-05T14:18:46.0436690Z //pkg/f8n/devinfra/jack/plugin/epics:epics_test PASSED in 0.2s 2023-06-05T14:18:46.0437283Z //pkg/f8n/devinfra/jack/plugin/list:list_test PASSED in 0.2s 2023-06-05T14:18:46.0437684Z //pkg/f8n/devinfra/jack/plugin/pr:pr_test PASSED in 0.1s 2023-06-05T14:18:46.0438114Z //pkg/f8n/devinfra/jack/plugin/project:project_test PASSED in 0.1s 2023-06-05T14:18:46.0438548Z //pkg/f8n/devinfra/jack/plugin/size:size_test PASSED in 0.2s 2023-06-05T14:18:46.0439664Z //pkg/f8n/devinfra/jack/plugin/triage_issue:triage_issue_test PASSED in 0.3s 2023-06-05T14:18:46.0440543Z //pkg/f8n/devinfra/jack/plugin/triage_parent:triage_parent_test PASSED in 0.2s 2023-06-05T14:18:46.0441094Z //pkg/f8n/devinfra/jack/plugin/type:type_test PASSED in 0.1s 2023-06-05T14:18:46.0442331Z //pkg/f8n/devinfra/jack/plugin/uploadjob:uploadjob_test PASSED in 0.1s 2023-06-05T14:18:46.0443413Z //pkg/f8n/gcp/k8s/controllers/dennis:dennis_test PASSED in 18.3s 2023-06-05T14:18:46.0444944Z //pkg/f8n/gcp/k8s/controllers/logsink:logsink_test PASSED in 16.8s 2023-06-05T14:18:46.0447483Z //pkg/f8n/gcp/k8s/controllers/projectinit:projectinit_test PASSED in 35.6s 2023-06-05T14:18:46.0448759Z //pkg/f8n/kinform/client:client_test PASSED in 0.3s 2023-06-05T14:18:46.0449941Z //pkg/f8n/kinform/model:model_test PASSED in 0.3s 2023-06-05T14:18:46.0452143Z //pkg/f8n/kinform/server:server_test PASSED in 0.2s 2023-06-05T14:18:46.0453531Z //pkg/f8n/kinform/sql:sql_test PASSED in 9.1s 2023-06-05T14:18:46.0455831Z //pkg/f8n/lighthouse:lighthouse_test PASSED in 16.0s 2023-06-05T14:18:46.0457491Z //pkg/f8n/lighthouse/config:config_test PASSED in 0.1s 2023-06-05T14:18:46.0458773Z //pkg/edge/logging/k8s/controllers/fluentbitctl:fluentbitctl_test PASSED in 7.9s 2023-06-05T14:18:46.0460826Z //pkg/f8n/monitoring/billman/costs:costs_test PASSED in 0.1s 2023-06-05T14:18:46.0462677Z //pkg/f8n/monitoring/k8s/controllers/prometheusctl:prometheusctl_test PASSED in 18.4s 2023-06-05T14:18:46.0464050Z //pkg/f8n/warehouse/forwarder:forwarder_test PASSED in 7.4s 2023-06-05T14:18:46.0465960Z //pkg/f8n/warehouse/k8s/apis/meta:meta_test PASSED in 0.1s 2023-06-05T14:18:46.0468610Z //pkg/f8n/warehouse/k8s/apis/v1alpha1:v1alpha1_test PASSED in 0.2s 2023-06-05T14:18:46.0469405Z //pkg/f8n/warehouse/k8s/controllers/lumperctl:lumperctl_test PASSED in 57.8s 2023-06-05T14:18:46.0473567Z //pkg/f8n/warehouse/lift/cmd/internal/command:command_test PASSED in 0.1s 2023-06-05T14:18:46.0474375Z //pkg/f8n/warehouse/lift/cmd/pack:pack_test PASSED in 0.2s 2023-06-05T14:18:46.0475228Z //pkg/f8n/warehouse/lift/cmd/pallets:pallets_test PASSED in 2.5s 2023-06-05T14:18:46.0475997Z //pkg/f8n/warehouse/lift/pack:pack_test PASSED in 0.1s 2023-06-05T14:18:46.0476642Z //pkg/f8n/warehouse/lift/unpack:unpack_test PASSED in 1.6s 2023-06-05T14:18:46.0478787Z //pkg/f8n/warehouse/oci:oci_test PASSED in 0.6s 2023-06-05T14:18:46.0482184Z //pkg/f8n/warehouse/oci/cache:cache_test PASSED in 0.2s 2023-06-05T14:18:46.0482994Z //pkg/f8n/warehouse/oci/cache/providers/disk:disk_test PASSED in 0.1s 2023-06-05T14:18:46.0483656Z //pkg/f8n/warehouse/oci/cache/providers/memory:memory_test PASSED in 0.2s 2023-06-05T14:18:46.0485806Z //pkg/f8n/warehouse/oci/layer:layer_test PASSED in 0.3s 2023-06-05T14:18:46.0487896Z //pkg/f8n/warehouse/oci/layout:layout_test PASSED in 0.4s 2023-06-05T14:18:46.0489562Z //pkg/f8n/warehouse/oci/mutate:mutate_test PASSED in 0.1s 2023-06-05T14:18:46.0490266Z //pkg/f8n/warehouse/pallet/resolve:resolve_test PASSED in 0.2s 2023-06-05T14:18:46.0491266Z //pkg/f8n/warehouse/promote:promote_test PASSED in 0.5s 2023-06-05T14:18:46.0493338Z //pkg/k8s/certmanager:certmanager_test PASSED in 6.7s 2023-06-05T14:18:46.0495570Z //pkg/k8s/kustomize:kustomize_test PASSED in 0.1s 2023-06-05T14:18:46.0498053Z //pkg/k8s/object:object_test PASSED in 0.1s 2023-06-05T14:18:46.0499598Z //pkg/k8s/runtime/conditions:conditions_test PASSED in 0.1s 2023-06-05T14:18:46.0501963Z //pkg/k8s/runtime/controller/reconcile:reconcile_test PASSED in 0.1s 2023-06-05T14:18:46.0504166Z //pkg/k8s/runtime/inventory:inventory_test PASSED in 16.1s 2023-06-05T14:18:46.0506631Z //pkg/k8s/runtime/objectrestarter:objectrestarter_test PASSED in 9.4s 2023-06-05T14:18:46.0508087Z //pkg/k8s/runtime/sap:sap_test PASSED in 15.4s 2023-06-05T14:18:46.0509897Z //pkg/k8s/runtime/sap/install:install_test PASSED in 0.2s 2023-06-05T14:18:46.0513411Z //pkg/k8s/unstructured:unstructured_test PASSED in 0.1s 2023-06-05T14:18:46.0513960Z //pkg/lib/fog:fog_test PASSED in 0.0s 2023-06-05T14:18:46.0516413Z //pkg/lib/gcp/cloudsql:cloudsql_test PASSED in 0.3s 2023-06-05T14:18:46.0516971Z //pkg/lib/gcp/iam:iam_test PASSED in 0.1s 2023-06-05T14:18:46.0519001Z //pkg/lib/gcp/secretmanager:secretmanager_test PASSED in 0.1s 2023-06-05T14:18:46.0520353Z //pkg/lib/runtime/subscriber/metrics:metrics_test PASSED in 0.1s 2023-06-05T14:18:46.0522383Z //pkg/lib/server:server_test PASSED in 0.1s 2023-06-05T14:18:46.0524213Z //pkg/lib/server/inmemorylistener:inmemorylistener_test PASSED in 0.1s 2023-06-05T14:18:46.0527363Z //pkg/lib/text/drawing:drawing_test PASSED in 0.0s 2023-06-05T14:18:46.0528344Z //pkg/sds/k8s/authserver:authserver_test PASSED in 1.0s 2023-06-05T14:18:46.0530268Z //pkg/sds/k8s/controllers/coredns/pkg:pkg_test PASSED in 0.2s 2023-06-05T14:18:46.0533165Z //pkg/sds/k8s/controllers/nodeagent:nodeagent_test PASSED in 29.7s 2023-06-05T14:18:46.0536253Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/applynodelabels:applynodelabels_test PASSED in 0.2s 2023-06-05T14:18:46.0537608Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/example:example_test PASSED in 0.1s 2023-06-05T14:18:46.0538452Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/grubstringupdater:grubstringupdater_test PASSED in 0.5s 2023-06-05T14:18:46.0538975Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/networking:networking_test PASSED in 0.5s 2023-06-05T14:18:46.0542724Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration:ntpconfiguration_test PASSED in 0.6s 2023-06-05T14:18:46.0543685Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/chronyd:chronyd_test PASSED in 0.6s 2023-06-05T14:18:46.0545228Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/timesyncd:timesyncd_test PASSED in 0.1s 2023-06-05T14:18:46.0546215Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/osuserpasswordupdater:osuserpasswordupdater_test PASSED in 0.1s 2023-06-05T14:18:46.0547781Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/remoteagentconfig:remoteagentconfig_test PASSED in 0.2s 2023-06-05T14:18:46.0550181Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient:thinclient_test PASSED in 1.0s 2023-06-05T14:18:46.0552026Z //pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient/selector:selector_test PASSED in 0.2s 2023-06-05T14:18:46.0554239Z //pkg/sds/k8s/controllers/pxe:pxe_test PASSED in 13.9s 2023-06-05T14:18:46.0559788Z //pkg/sds/k8s/controllers/remoteaccess/pkg:pkg_test PASSED in 0.7s 2023-06-05T14:18:46.0560623Z //pkg/sds/k8s/controllers/resiliencemanager/pkg/certs:certs_test PASSED in 0.1s 2023-06-05T14:18:46.0561421Z //pkg/sds/lib/os/grub:grub_test PASSED in 0.1s 2023-06-05T14:18:46.0562155Z //pkg/sds/lib/remotecli/msgsvc:msgsvc_test PASSED in 0.1s 2023-06-05T14:18:46.0562907Z //pkg/sds/lib/remotecli/remotecli:remotecli_test PASSED in 0.1s 2023-06-05T14:18:46.0564153Z //pkg/tools/hack/cmd/owners:owners_test PASSED in 0.0s 2023-06-05T14:18:46.0564976Z //test/f2/x/ktest/kssert:kssert_test PASSED in 0.1s 2023-06-05T14:18:46.0566386Z //test/fixtures:fixtures_test PASSED in 1.8s 2023-06-05T14:18:46.0568158Z //test/framework/config:config_test PASSED in 0.2s 2023-06-05T14:18:46.0571265Z //third_party/k8s/fluxcd:fluxcd_test PASSED in 1.3s 2023-06-05T14:18:46.0577368Z 2023-06-05T14:18:46.0577731Z Executed 144 out of 144 tests: 144 tests pass. 2023-06-05T14:18:46.0578316Z There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. 2023-06-05T14:18:46.0697851Z 2023/06/05 14:18:46 Querying Bazel for container_push based on changeset 2023-06-05T14:18:47.9339705Z INFO: Invocation ID: 13b1b9bb-5bed-4a6c-b495-6da0e0e6ee87 2023-06-05T14:18:47.9340451Z INFO: Options provided by the client: 2023-06-05T14:18:47.9340797Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:18:47.9341203Z INFO: Reading rc options for 'build' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:18:47.9341611Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:18:47.9341998Z INFO: Reading rc options for 'build' from /etc/bazel.bazelrc: 2023-06-05T14:18:47.9342309Z 'build' options: --config=cache 2023-06-05T14:18:47.9343084Z INFO: Reading rc options for 'build' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:18:47.9343885Z 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:18:47.9345172Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:18:47.9346086Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:18:47.9346740Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:18:47.9347646Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:18:48.3689375Z INFO: Build option --define has changed, discarding analysis cache. 2023-06-05T14:18:53.1301938Z DEBUG: /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/external/io_bazel_rules_docker/container/push.bzl:80:14: Pushing an image based on a tarball can be very expensive. If the image set on @//cmd/sds/xorg:container_push is the output of a docker_build, consider dropping the '.tar' extension. If the image is checked in, consider using container_import instead. 2023-06-05T14:18:53.3546559Z INFO: Analyzed 42 targets (1617 packages loaded, 46024 targets configured). 2023-06-05T14:18:53.3547815Z INFO: Found 42 targets... 2023-06-05T14:19:48.7886817Z INFO: Elapsed time: 60.862s, Critical Path: 49.94s 2023-06-05T14:19:48.7887727Z INFO: 12235 processes: 920 disk cache hit, 2534 remote cache hit, 6140 internal, 2525 local, 116 processwrapper-sandbox. 2023-06-05T14:20:01.4103665Z INFO: Invocation ID: debb293e-1658-47b6-8116-af0a7b7a2a91 2023-06-05T14:20:01.7174467Z Loading: 2023-06-05T14:20:01.7230176Z Loading: 2023-06-05T14:20:01.7232353Z Loading: 0 packages loaded 2023-06-05T14:20:01.7338009Z Analyzing: target //cmd/edge/api:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:01.7750731Z INFO: Analyzed target //cmd/edge/api:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:01.7751098Z INFO: Found 1 target... 2023-06-05T14:20:02.0479567Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt ... ( 1 action running) 2023-06-05T14:20:02.0779054Z Target //cmd/edge/api:container_push_path up-to-date: 2023-06-05T14:20:02.0779664Z bazel-bin/cmd/edge/api/container_push_path.path 2023-06-05T14:20:02.0817712Z INFO: Elapsed time: 0.682s, Critical Path: 0.02s 2023-06-05T14:20:02.0818145Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:02.0818613Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:03.9424997Z INFO: Invocation ID: 10b5cca6-a0b3-4610-9bc0-479487d93d26 2023-06-05T14:20:04.2791000Z Loading: 2023-06-05T14:20:04.2825218Z Loading: 2023-06-05T14:20:04.2825520Z Loading: 0 packages loaded 2023-06-05T14:20:04.2882077Z Analyzing: target //cmd/edge/bannerctl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:04.3318824Z INFO: Analyzed target //cmd/edge/bannerctl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:04.3319196Z INFO: Found 1 target... 2023-06-05T14:20:04.4012449Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:04.4263708Z Target //cmd/edge/bannerctl:container_push_path up-to-date: 2023-06-05T14:20:04.4264135Z bazel-bin/cmd/edge/bannerctl/container_push_path.path 2023-06-05T14:20:04.4292983Z INFO: Elapsed time: 0.498s, Critical Path: 0.01s 2023-06-05T14:20:04.4293299Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:04.4293716Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:06.1571264Z INFO: Invocation ID: 5e7f77b3-4f4e-4424-af9d-955fc9c497a9 2023-06-05T14:20:06.4541697Z Loading: 2023-06-05T14:20:06.4574353Z Loading: 2023-06-05T14:20:06.4575320Z Loading: 0 packages loaded 2023-06-05T14:20:06.4619386Z Analyzing: target //cmd/edge/bsl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:06.4990814Z INFO: Analyzed target //cmd/edge/bsl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:06.4991189Z INFO: Found 1 target... 2023-06-05T14:20:06.5675330Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:06.5916216Z Target //cmd/edge/bsl:container_push_path up-to-date: 2023-06-05T14:20:06.5916825Z bazel-bin/cmd/edge/bsl/container_push_path.path 2023-06-05T14:20:06.5946763Z INFO: Elapsed time: 0.448s, Critical Path: 0.01s 2023-06-05T14:20:06.5947174Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:06.5947438Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:08.1706512Z INFO: Invocation ID: 30f9110e-d3cb-4606-a883-343511027bb5 2023-06-05T14:20:08.4701693Z Loading: 2023-06-05T14:20:08.4751779Z Loading: 2023-06-05T14:20:08.4752228Z Loading: 0 packages loaded 2023-06-05T14:20:08.4805928Z Analyzing: target //cmd/edge/chariot2:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:08.5087089Z INFO: Analyzed target //cmd/edge/chariot2:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:08.5087438Z INFO: Found 1 target... 2023-06-05T14:20:08.5693117Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:08.5937366Z Target //cmd/edge/chariot2:container_push_path up-to-date: 2023-06-05T14:20:08.5937776Z bazel-bin/cmd/edge/chariot2/container_push_path.path 2023-06-05T14:20:08.5975586Z INFO: Elapsed time: 0.437s, Critical Path: 0.01s 2023-06-05T14:20:08.5975894Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:08.5976172Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:10.3774023Z INFO: Invocation ID: 7bed317b-7c60-480c-9666-97040e5a4048 2023-06-05T14:20:10.6761888Z Loading: 2023-06-05T14:20:10.6806910Z Loading: 2023-06-05T14:20:10.6807288Z Loading: 0 packages loaded 2023-06-05T14:20:10.6858682Z Analyzing: target //cmd/edge/clusterctl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:10.7233593Z INFO: Analyzed target //cmd/edge/clusterctl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:10.7233967Z INFO: Found 1 target... 2023-06-05T14:20:10.7858256Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:10.8106336Z Target //cmd/edge/clusterctl:container_push_path up-to-date: 2023-06-05T14:20:10.8106828Z bazel-bin/cmd/edge/clusterctl/container_push_path.path 2023-06-05T14:20:10.8134584Z INFO: Elapsed time: 0.446s, Critical Path: 0.01s 2023-06-05T14:20:10.8134862Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:10.8135126Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:12.4526812Z INFO: Invocation ID: 44b3a37d-bd44-46ac-8851-e9b5bab75342 2023-06-05T14:20:12.7814808Z Loading: 2023-06-05T14:20:12.7859402Z Loading: 2023-06-05T14:20:12.7860359Z Loading: 0 packages loaded 2023-06-05T14:20:12.7903808Z Analyzing: target //cmd/edge/ctlfish:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:12.8261681Z INFO: Analyzed target //cmd/edge/ctlfish:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:12.8262127Z INFO: Found 1 target... 2023-06-05T14:20:12.9028208Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:12.9277581Z Target //cmd/edge/ctlfish:container_push_path up-to-date: 2023-06-05T14:20:12.9278155Z bazel-bin/cmd/edge/ctlfish/container_push_path.path 2023-06-05T14:20:12.9307289Z INFO: Elapsed time: 0.490s, Critical Path: 0.01s 2023-06-05T14:20:12.9307593Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:12.9308032Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:15.2519046Z INFO: Invocation ID: 72e20db8-4726-4fa8-86e5-046c3c9516a9 2023-06-05T14:20:15.5848992Z Loading: 2023-06-05T14:20:15.5888880Z Loading: 2023-06-05T14:20:15.5889178Z Loading: 0 packages loaded 2023-06-05T14:20:15.5938350Z Analyzing: target //cmd/edge/datasync/chirp:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:15.6284718Z INFO: Analyzed target //cmd/edge/datasync/chirp:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:15.6285141Z INFO: Found 1 target... 2023-06-05T14:20:15.6929931Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:15.7170241Z Target //cmd/edge/datasync/chirp:container_push_path up-to-date: 2023-06-05T14:20:15.7170672Z bazel-bin/cmd/edge/datasync/chirp/container_push_path.path 2023-06-05T14:20:15.7196896Z INFO: Elapsed time: 0.478s, Critical Path: 0.01s 2023-06-05T14:20:15.7197188Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:15.7197469Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:17.5469777Z INFO: Invocation ID: 20267a9f-b2db-4da1-b580-a7a8a26f869a 2023-06-05T14:20:17.8292415Z Loading: 2023-06-05T14:20:17.8325919Z Loading: 2023-06-05T14:20:17.8326190Z Loading: 0 packages loaded 2023-06-05T14:20:17.8378985Z Analyzing: target //cmd/edge/datasync/couchctl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:17.8699228Z INFO: Analyzed target //cmd/edge/datasync/couchctl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:17.8699655Z INFO: Found 1 target... 2023-06-05T14:20:17.9338510Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:17.9595022Z Target //cmd/edge/datasync/couchctl:container_push_path up-to-date: 2023-06-05T14:20:17.9595468Z bazel-bin/cmd/edge/datasync/couchctl/container_push_path.path 2023-06-05T14:20:17.9620335Z INFO: Elapsed time: 0.426s, Critical Path: 0.01s 2023-06-05T14:20:17.9620637Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:17.9620895Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:19.5803836Z INFO: Invocation ID: fc9d6751-ee57-4d63-8b04-4d36f70b458f 2023-06-05T14:20:19.9226520Z Loading: 2023-06-05T14:20:19.9272705Z Loading: 2023-06-05T14:20:19.9273018Z Loading: 0 packages loaded 2023-06-05T14:20:19.9339550Z Analyzing: target //cmd/edge/datasync/cushion:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:19.9722567Z INFO: Analyzed target //cmd/edge/datasync/cushion:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:19.9722943Z INFO: Found 1 target... 2023-06-05T14:20:20.0425037Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:20.0668706Z Target //cmd/edge/datasync/cushion:container_push_path up-to-date: 2023-06-05T14:20:20.0669163Z bazel-bin/cmd/edge/datasync/cushion/container_push_path.path 2023-06-05T14:20:20.0695800Z INFO: Elapsed time: 0.499s, Critical Path: 0.01s 2023-06-05T14:20:20.0696132Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:20.0696393Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:21.7147893Z INFO: Invocation ID: 96737c47-ec7d-45be-ab3e-5c355a91abf1 2023-06-05T14:20:22.0246123Z Loading: 2023-06-05T14:20:22.0284247Z Loading: 2023-06-05T14:20:22.0284738Z Loading: 0 packages loaded 2023-06-05T14:20:22.0328224Z Analyzing: target //cmd/edge/datasync/datasyncinit:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:22.0665659Z INFO: Analyzed target //cmd/edge/datasync/datasyncinit:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:22.0666283Z INFO: Found 1 target... 2023-06-05T14:20:22.1313123Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:22.1554711Z Target //cmd/edge/datasync/datasyncinit:container_push_path up-to-date: 2023-06-05T14:20:22.1556004Z bazel-bin/cmd/edge/datasync/datasyncinit/container_push_path.path 2023-06-05T14:20:22.1584589Z INFO: Elapsed time: 0.454s, Critical Path: 0.01s 2023-06-05T14:20:22.1585589Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:22.1586001Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:23.7769469Z INFO: Invocation ID: 89281b71-3f17-48c1-9601-ab74e354229f 2023-06-05T14:20:24.1081949Z Loading: 2023-06-05T14:20:24.1115059Z Loading: 2023-06-05T14:20:24.1115381Z Loading: 0 packages loaded 2023-06-05T14:20:24.1171293Z Analyzing: target //cmd/edge/datasync/shoot:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:24.1455069Z INFO: Analyzed target //cmd/edge/datasync/shoot:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:24.1455482Z INFO: Found 1 target... 2023-06-05T14:20:24.2076684Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:24.2318183Z Target //cmd/edge/datasync/shoot:container_push_path up-to-date: 2023-06-05T14:20:24.2318650Z bazel-bin/cmd/edge/datasync/shoot/container_push_path.path 2023-06-05T14:20:24.2347804Z INFO: Elapsed time: 0.469s, Critical Path: 0.01s 2023-06-05T14:20:24.2348076Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:24.2348322Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:25.7702026Z INFO: Invocation ID: 57806e7b-1a89-471c-a050-21fd6cb4158a 2023-06-05T14:20:26.0922711Z Loading: 2023-06-05T14:20:26.0955030Z Loading: 2023-06-05T14:20:26.0956647Z Loading: 0 packages loaded 2023-06-05T14:20:26.0999845Z Analyzing: target //cmd/edge/edge-injector:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:26.1326947Z INFO: Analyzed target //cmd/edge/edge-injector:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:26.1327326Z INFO: Found 1 target... 2023-06-05T14:20:26.1943788Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:26.2212339Z Target //cmd/edge/edge-injector:container_push_path up-to-date: 2023-06-05T14:20:26.2212794Z bazel-bin/cmd/edge/edge-injector/container_push_path.path 2023-06-05T14:20:26.2240086Z INFO: Elapsed time: 0.464s, Critical Path: 0.01s 2023-06-05T14:20:26.2240357Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:26.2240616Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:27.8389202Z INFO: Invocation ID: 26b584f3-2ef5-4def-8ecc-f2de0bb17ae7 2023-06-05T14:20:28.1813044Z Loading: 2023-06-05T14:20:28.1842647Z Loading: 2023-06-05T14:20:28.1842915Z Loading: 0 packages loaded 2023-06-05T14:20:28.1892327Z Analyzing: target //cmd/edge/edge-sql:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:28.2158698Z INFO: Analyzed target //cmd/edge/edge-sql:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:28.2159071Z INFO: Found 1 target... 2023-06-05T14:20:28.2767399Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:28.3018324Z Target //cmd/edge/edge-sql:container_push_path up-to-date: 2023-06-05T14:20:28.3018735Z bazel-bin/cmd/edge/edge-sql/container_push_path.path 2023-06-05T14:20:28.3048697Z INFO: Elapsed time: 0.476s, Critical Path: 0.01s 2023-06-05T14:20:28.3049044Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:28.3050647Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:30.0119262Z INFO: Invocation ID: e19fd7ce-0f46-40d7-96b9-c2817b1938cc 2023-06-05T14:20:30.3378535Z Loading: 2023-06-05T14:20:30.3409731Z Loading: 2023-06-05T14:20:30.3409997Z Loading: 0 packages loaded 2023-06-05T14:20:30.3453370Z Analyzing: target //cmd/edge/iam/active-ttl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:30.3788195Z INFO: Analyzed target //cmd/edge/iam/active-ttl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:30.3788582Z INFO: Found 1 target... 2023-06-05T14:20:30.4436303Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:30.4684295Z Target //cmd/edge/iam/active-ttl:container_push_path up-to-date: 2023-06-05T14:20:30.4684835Z bazel-bin/cmd/edge/iam/active-ttl/container_push_path.path 2023-06-05T14:20:30.4709428Z INFO: Elapsed time: 0.470s, Critical Path: 0.01s 2023-06-05T14:20:30.4709721Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:30.4709980Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:32.1152913Z INFO: Invocation ID: 737cc453-4212-41a7-bb76-7583f80ee0c3 2023-06-05T14:20:32.4174314Z Loading: 2023-06-05T14:20:32.4206030Z Loading: 2023-06-05T14:20:32.4206420Z Loading: 0 packages loaded 2023-06-05T14:20:32.4248647Z Analyzing: target //cmd/edge/iam/init:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:32.4592289Z INFO: Analyzed target //cmd/edge/iam/init:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:32.4592646Z INFO: Found 1 target... 2023-06-05T14:20:32.5235440Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:32.5476199Z Target //cmd/edge/iam/init:container_push_path up-to-date: 2023-06-05T14:20:32.5476629Z bazel-bin/cmd/edge/iam/init/container_push_path.path 2023-06-05T14:20:32.5503410Z INFO: Elapsed time: 0.446s, Critical Path: 0.01s 2023-06-05T14:20:32.5503915Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:32.5504221Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:34.3318008Z INFO: Invocation ID: 6460513b-4b57-4db9-a105-edb54bca03e9 2023-06-05T14:20:34.6591618Z Loading: 2023-06-05T14:20:34.6624729Z Loading: 2023-06-05T14:20:34.6625176Z Loading: 0 packages loaded 2023-06-05T14:20:34.6678364Z Analyzing: target //cmd/edge/iam/operator:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:34.6998593Z INFO: Analyzed target //cmd/edge/iam/operator:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:34.6998960Z INFO: Found 1 target... 2023-06-05T14:20:34.7646788Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:34.7892451Z Target //cmd/edge/iam/operator:container_push_path up-to-date: 2023-06-05T14:20:34.7893074Z bazel-bin/cmd/edge/iam/operator/container_push_path.path 2023-06-05T14:20:34.7918331Z INFO: Elapsed time: 0.470s, Critical Path: 0.01s 2023-06-05T14:20:34.7918849Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:34.7919312Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:37.1598087Z INFO: Invocation ID: 47161202-90ce-4ad4-856d-b925ccdbb670 2023-06-05T14:20:37.4668891Z Loading: 2023-06-05T14:20:37.4699647Z Loading: 2023-06-05T14:20:37.4700071Z Loading: 0 packages loaded 2023-06-05T14:20:37.4752671Z Analyzing: target //cmd/edge/iam/provider:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:37.5357205Z INFO: Analyzed target //cmd/edge/iam/provider:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:37.5357569Z INFO: Found 1 target... 2023-06-05T14:20:37.6304913Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:37.6546543Z Target //cmd/edge/iam/provider:container_push_path up-to-date: 2023-06-05T14:20:37.6547296Z bazel-bin/cmd/edge/iam/provider/container_push_path.path 2023-06-05T14:20:37.6572559Z INFO: Elapsed time: 0.507s, Critical Path: 0.01s 2023-06-05T14:20:37.6573040Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:37.6573287Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:39.7203206Z INFO: Invocation ID: 19d5d03b-9a0c-4577-8b16-80b1a3383f4c 2023-06-05T14:20:40.0302659Z Loading: 2023-06-05T14:20:40.0340909Z Loading: 2023-06-05T14:20:40.0341253Z Loading: 0 packages loaded 2023-06-05T14:20:40.0391707Z Analyzing: target //cmd/edge/linkerdctl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:40.0727051Z INFO: Analyzed target //cmd/edge/linkerdctl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:40.0727426Z INFO: Found 1 target... 2023-06-05T14:20:40.1801250Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:40.2046191Z Target //cmd/edge/linkerdctl:container_push_path up-to-date: 2023-06-05T14:20:40.2046733Z bazel-bin/cmd/edge/linkerdctl/container_push_path.path 2023-06-05T14:20:40.2072004Z INFO: Elapsed time: 0.497s, Critical Path: 0.01s 2023-06-05T14:20:40.2072404Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:40.2072826Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:41.8618127Z INFO: Invocation ID: 2ff4aced-4d08-4197-ab40-65e9ad20b042 2023-06-05T14:20:42.1508670Z Loading: 2023-06-05T14:20:42.1536483Z Loading: 2023-06-05T14:20:42.1536758Z Loading: 0 packages loaded 2023-06-05T14:20:42.1587593Z Analyzing: target //cmd/edge/envctl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:42.1907843Z INFO: Analyzed target //cmd/edge/envctl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:42.1908221Z INFO: Found 1 target... 2023-06-05T14:20:42.2604184Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:42.2851891Z Target //cmd/edge/envctl:container_push_path up-to-date: 2023-06-05T14:20:42.2852389Z bazel-bin/cmd/edge/envctl/container_push_path.path 2023-06-05T14:20:42.2878537Z INFO: Elapsed time: 0.437s, Critical Path: 0.01s 2023-06-05T14:20:42.2878830Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:42.2879090Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:43.9377976Z INFO: Invocation ID: 8d69107b-0c13-4671-8b6e-6b9588148b3c 2023-06-05T14:20:44.2237102Z Loading: 2023-06-05T14:20:44.2270002Z Loading: 2023-06-05T14:20:44.2272192Z Loading: 0 packages loaded 2023-06-05T14:20:44.2315789Z Analyzing: target //cmd/edge/syncedobjectctl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:44.2643081Z INFO: Analyzed target //cmd/edge/syncedobjectctl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:44.2643460Z INFO: Found 1 target... 2023-06-05T14:20:44.3369967Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:44.3618709Z Target //cmd/edge/syncedobjectctl:container_push_path up-to-date: 2023-06-05T14:20:44.3619161Z bazel-bin/cmd/edge/syncedobjectctl/container_push_path.path 2023-06-05T14:20:44.3645722Z INFO: Elapsed time: 0.437s, Critical Path: 0.01s 2023-06-05T14:20:44.3646203Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:44.3646518Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:46.0367184Z INFO: Invocation ID: 81dffb26-99cd-4027-910a-4118ba441e02 2023-06-05T14:20:46.3463200Z Loading: 2023-06-05T14:20:46.3502843Z Loading: 2023-06-05T14:20:46.3505074Z Loading: 0 packages loaded 2023-06-05T14:20:46.3558869Z Analyzing: target //cmd/f8n/kinform/client:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:46.3853654Z INFO: Analyzed target //cmd/f8n/kinform/client:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:46.3854026Z INFO: Found 1 target... 2023-06-05T14:20:46.4569012Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:46.4820633Z Target //cmd/f8n/kinform/client:container_push_path up-to-date: 2023-06-05T14:20:46.4821113Z bazel-bin/cmd/f8n/kinform/client/container_push_path.path 2023-06-05T14:20:46.4847789Z INFO: Elapsed time: 0.458s, Critical Path: 0.01s 2023-06-05T14:20:46.4848086Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:46.4848358Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:48.1395069Z INFO: Invocation ID: fddf2399-9a92-426d-a518-138e9f608e91 2023-06-05T14:20:48.4396065Z Loading: 2023-06-05T14:20:48.4440491Z Loading: 2023-06-05T14:20:48.4440780Z Loading: 0 packages loaded 2023-06-05T14:20:48.4480544Z Analyzing: target //cmd/f8n/kinform/server:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:48.4768610Z INFO: Analyzed target //cmd/f8n/kinform/server:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:48.4768984Z INFO: Found 1 target... 2023-06-05T14:20:48.5425915Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:48.5659346Z Target //cmd/f8n/kinform/server:container_push_path up-to-date: 2023-06-05T14:20:48.5660165Z bazel-bin/cmd/f8n/kinform/server/container_push_path.path 2023-06-05T14:20:48.5683841Z INFO: Elapsed time: 0.440s, Critical Path: 0.01s 2023-06-05T14:20:48.5684312Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:48.5684692Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:50.2168467Z INFO: Invocation ID: 7c0d662c-7ee6-4f3f-adf4-b8b37be52822 2023-06-05T14:20:50.5258698Z Loading: 2023-06-05T14:20:50.5297276Z Loading: 2023-06-05T14:20:50.5297643Z Loading: 0 packages loaded 2023-06-05T14:20:50.5348689Z Analyzing: target //cmd/edge/logging/fluentbitctl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:50.5639798Z INFO: Analyzed target //cmd/edge/logging/fluentbitctl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:50.5640248Z INFO: Found 1 target... 2023-06-05T14:20:50.6311670Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:50.6560534Z Target //cmd/edge/logging/fluentbitctl:container_push_path up-to-date: 2023-06-05T14:20:50.6561050Z bazel-bin/cmd/edge/logging/fluentbitctl/container_push_path.path 2023-06-05T14:20:50.6586430Z INFO: Elapsed time: 0.452s, Critical Path: 0.01s 2023-06-05T14:20:50.6586950Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:50.6587262Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:52.4233735Z INFO: Invocation ID: 90f8edca-0992-4eaf-8534-06fc50a3314b 2023-06-05T14:20:52.7171793Z Loading: 2023-06-05T14:20:52.7201976Z Loading: 2023-06-05T14:20:52.7203479Z Loading: 0 packages loaded 2023-06-05T14:20:52.7246014Z Analyzing: target //cmd/f8n/monitoring/am-webhook:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:52.7537323Z INFO: Analyzed target //cmd/f8n/monitoring/am-webhook:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:52.7537708Z INFO: Found 1 target... 2023-06-05T14:20:52.8217974Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:52.8460840Z Target //cmd/f8n/monitoring/am-webhook:container_push_path up-to-date: 2023-06-05T14:20:52.8461661Z bazel-bin/cmd/f8n/monitoring/am-webhook/container_push_path.path 2023-06-05T14:20:52.8487389Z INFO: Elapsed time: 0.435s, Critical Path: 0.01s 2023-06-05T14:20:52.8487787Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:52.8488152Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:54.6081191Z INFO: Invocation ID: b2254a03-da19-4721-b437-5aa77a866da7 2023-06-05T14:20:54.8942100Z Loading: 2023-06-05T14:20:54.8983915Z Loading: 2023-06-05T14:20:54.8984206Z Loading: 0 packages loaded 2023-06-05T14:20:54.9026164Z Analyzing: target //cmd/f8n/monitoring/plank:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:54.9303433Z INFO: Analyzed target //cmd/f8n/monitoring/plank:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:54.9303980Z INFO: Found 1 target... 2023-06-05T14:20:54.9962780Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:55.0201641Z Target //cmd/f8n/monitoring/plank:container_push_path up-to-date: 2023-06-05T14:20:55.0202196Z bazel-bin/cmd/f8n/monitoring/plank/container_push_path.path 2023-06-05T14:20:55.0226507Z INFO: Elapsed time: 0.425s, Critical Path: 0.01s 2023-06-05T14:20:55.0226804Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:55.0227067Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:56.6814041Z INFO: Invocation ID: ae00bccd-b2ad-4642-8d83-7003b9405aab 2023-06-05T14:20:56.9567095Z Loading: 2023-06-05T14:20:56.9595305Z Loading: 2023-06-05T14:20:56.9595601Z Loading: 0 packages loaded 2023-06-05T14:20:56.9643558Z Analyzing: target //cmd/f8n/monitoring/prometheus:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:56.9958555Z INFO: Analyzed target //cmd/f8n/monitoring/prometheus:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:56.9958970Z INFO: Found 1 target... 2023-06-05T14:20:57.0615234Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:57.0857420Z Target //cmd/f8n/monitoring/prometheus:container_push_path up-to-date: 2023-06-05T14:20:57.0857875Z bazel-bin/cmd/f8n/monitoring/prometheus/container_push_path.path 2023-06-05T14:20:57.0883850Z INFO: Elapsed time: 0.417s, Critical Path: 0.01s 2023-06-05T14:20:57.0884179Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:57.0884563Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:20:58.8343669Z INFO: Invocation ID: fc61d958-e1c5-46f3-9324-847755af64cd 2023-06-05T14:20:59.1402114Z Loading: 2023-06-05T14:20:59.1440554Z Loading: 2023-06-05T14:20:59.1442128Z Loading: 0 packages loaded 2023-06-05T14:20:59.1486370Z Analyzing: target //cmd/f8n/rebar/gridbug:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:20:59.1782925Z INFO: Analyzed target //cmd/f8n/rebar/gridbug:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:20:59.1783288Z INFO: Found 1 target... 2023-06-05T14:20:59.2460882Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:20:59.2700766Z Target //cmd/f8n/rebar/gridbug:container_push_path up-to-date: 2023-06-05T14:20:59.2701347Z bazel-bin/cmd/f8n/rebar/gridbug/container_push_path.path 2023-06-05T14:20:59.2724888Z INFO: Elapsed time: 0.448s, Critical Path: 0.01s 2023-06-05T14:20:59.2725180Z INFO: 2 processes: 2 internal. 2023-06-05T14:20:59.2725532Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:01.0786448Z INFO: Invocation ID: 65abcb87-86bf-429e-b9e9-f08cd2c8e1c3 2023-06-05T14:21:01.3574030Z Loading: 2023-06-05T14:21:01.3611033Z Loading: 2023-06-05T14:21:01.3611294Z Loading: 0 packages loaded 2023-06-05T14:21:01.3662152Z Analyzing: target //cmd/f8n/rebar/jack:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:01.3946025Z INFO: Analyzed target //cmd/f8n/rebar/jack:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:01.3946406Z INFO: Found 1 target... 2023-06-05T14:21:01.4627724Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:01.4872953Z Target //cmd/f8n/rebar/jack:container_push_path up-to-date: 2023-06-05T14:21:01.4873611Z bazel-bin/cmd/f8n/rebar/jack/container_push_path.path 2023-06-05T14:21:01.4899684Z INFO: Elapsed time: 0.421s, Critical Path: 0.01s 2023-06-05T14:21:01.4900179Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:01.4900597Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:03.1064001Z INFO: Invocation ID: 1d24d2ad-66c8-4682-b940-6f229abc963e 2023-06-05T14:21:03.4505154Z Loading: 2023-06-05T14:21:03.4533704Z Loading: 2023-06-05T14:21:03.4534824Z Loading: 0 packages loaded 2023-06-05T14:21:03.4584502Z Analyzing: target //cmd/f8n/rebar/overlook:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:03.4849623Z INFO: Analyzed target //cmd/f8n/rebar/overlook:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:03.4850087Z INFO: Found 1 target... 2023-06-05T14:21:03.5504522Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:03.5743624Z Target //cmd/f8n/rebar/overlook:container_push_path up-to-date: 2023-06-05T14:21:03.5744070Z bazel-bin/cmd/f8n/rebar/overlook/container_push_path.path 2023-06-05T14:21:03.5769495Z INFO: Elapsed time: 0.480s, Critical Path: 0.01s 2023-06-05T14:21:03.5770073Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:03.5770534Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:05.1768020Z INFO: Invocation ID: bd9c39b7-ac04-49e6-935a-ab4cb1314d40 2023-06-05T14:21:05.4764766Z Loading: 2023-06-05T14:21:05.4794551Z Loading: 2023-06-05T14:21:05.4795627Z Loading: 0 packages loaded 2023-06-05T14:21:05.4837307Z Analyzing: target //cmd/f8n/rebar/slacker:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:05.5132588Z INFO: Analyzed target //cmd/f8n/rebar/slacker:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:05.5133315Z INFO: Found 1 target... 2023-06-05T14:21:05.5768196Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:05.6011265Z Target //cmd/f8n/rebar/slacker:container_push_path up-to-date: 2023-06-05T14:21:05.6011892Z bazel-bin/cmd/f8n/rebar/slacker/container_push_path.path 2023-06-05T14:21:05.6036016Z INFO: Elapsed time: 0.437s, Critical Path: 0.01s 2023-06-05T14:21:05.6036290Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:05.6036541Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:07.2820276Z INFO: Invocation ID: ce8c319c-5d4e-4962-a4b2-82f3e1cfe739 2023-06-05T14:21:07.5843627Z Loading: 2023-06-05T14:21:07.5871047Z Loading: 2023-06-05T14:21:07.5872615Z Loading: 0 packages loaded 2023-06-05T14:21:07.5918004Z Analyzing: target //cmd/f8n/warehouse/lumperctl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:07.6240668Z INFO: Analyzed target //cmd/f8n/warehouse/lumperctl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:07.6241068Z INFO: Found 1 target... 2023-06-05T14:21:07.6945835Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:07.7187752Z Target //cmd/f8n/warehouse/lumperctl:container_push_path up-to-date: 2023-06-05T14:21:07.7188551Z bazel-bin/cmd/f8n/warehouse/lumperctl/container_push_path.path 2023-06-05T14:21:07.7212948Z INFO: Elapsed time: 0.450s, Critical Path: 0.01s 2023-06-05T14:21:07.7213411Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:07.7213800Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:09.3633380Z INFO: Invocation ID: 63e1c3a0-66dc-47c1-bdb0-822db706381b 2023-06-05T14:21:09.6486890Z Loading: 2023-06-05T14:21:09.6528159Z Loading: 2023-06-05T14:21:09.6528509Z Loading: 0 packages loaded 2023-06-05T14:21:09.6577772Z Analyzing: target //cmd/f8n/warehouse/registryforwarder:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:09.6875842Z INFO: Analyzed target //cmd/f8n/warehouse/registryforwarder:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:09.6876307Z INFO: Found 1 target... 2023-06-05T14:21:09.7543622Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:09.7782366Z Target //cmd/f8n/warehouse/registryforwarder:container_push_path up-to-date: 2023-06-05T14:21:09.7782884Z bazel-bin/cmd/f8n/warehouse/registryforwarder/container_push_path.path 2023-06-05T14:21:09.7806915Z INFO: Elapsed time: 0.428s, Critical Path: 0.01s 2023-06-05T14:21:09.7807349Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:09.7807874Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:11.5049512Z INFO: Invocation ID: cbbf98c3-eaf9-4819-801c-429255d52101 2023-06-05T14:21:11.8027911Z Loading: 2023-06-05T14:21:11.8067829Z Loading: 2023-06-05T14:21:11.8068300Z Loading: 0 packages loaded 2023-06-05T14:21:11.8108398Z Analyzing: target //cmd/sds/authserver:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:11.8441078Z INFO: Analyzed target //cmd/sds/authserver:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:11.8441447Z INFO: Found 1 target... 2023-06-05T14:21:11.9150789Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:11.9397258Z Target //cmd/sds/authserver:container_push_path up-to-date: 2023-06-05T14:21:11.9397997Z bazel-bin/cmd/sds/authserver/container_push_path.path 2023-06-05T14:21:11.9424247Z INFO: Elapsed time: 0.447s, Critical Path: 0.01s 2023-06-05T14:21:11.9424552Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:11.9424822Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:13.5779686Z INFO: Invocation ID: 417d1c26-e46d-4c86-96d7-a45da450684e 2023-06-05T14:21:13.8921233Z Loading: 2023-06-05T14:21:13.8962493Z Loading: 2023-06-05T14:21:13.8964245Z Loading: 0 packages loaded 2023-06-05T14:21:13.9013992Z Analyzing: target //cmd/sds/corednsctl:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:13.9312923Z INFO: Analyzed target //cmd/sds/corednsctl:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:13.9313726Z INFO: Found 1 target... 2023-06-05T14:21:14.0028912Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:14.0274346Z Target //cmd/sds/corednsctl:container_push_path up-to-date: 2023-06-05T14:21:14.0274766Z bazel-bin/cmd/sds/corednsctl/container_push_path.path 2023-06-05T14:21:14.0301598Z INFO: Elapsed time: 0.462s, Critical Path: 0.01s 2023-06-05T14:21:14.0301902Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:14.0302174Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:15.6611354Z INFO: Invocation ID: 47b321e7-a1b9-4429-9e1c-d03fbd0ebf49 2023-06-05T14:21:15.9691153Z Loading: 2023-06-05T14:21:15.9728202Z Loading: 2023-06-05T14:21:15.9728690Z Loading: 0 packages loaded 2023-06-05T14:21:15.9770070Z Analyzing: target //cmd/sds/nodeagent:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:16.0074130Z INFO: Analyzed target //cmd/sds/nodeagent:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:16.0074751Z INFO: Found 1 target... 2023-06-05T14:21:16.0815739Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:16.1058777Z Target //cmd/sds/nodeagent:container_push_path up-to-date: 2023-06-05T14:21:16.1059576Z bazel-bin/cmd/sds/nodeagent/container_push_path.path 2023-06-05T14:21:16.1086477Z INFO: Elapsed time: 0.458s, Critical Path: 0.01s 2023-06-05T14:21:16.1086893Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:16.1087248Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:17.9522614Z INFO: Invocation ID: 4537b613-e3fa-4213-8392-622ed891e1bd 2023-06-05T14:21:18.2295423Z Loading: 2023-06-05T14:21:18.2325108Z Loading: 2023-06-05T14:21:18.2325407Z Loading: 0 packages loaded 2023-06-05T14:21:18.2373809Z Analyzing: target //cmd/sds/patchmanager:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:18.2703687Z INFO: Analyzed target //cmd/sds/patchmanager:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:18.2704085Z INFO: Found 1 target... 2023-06-05T14:21:18.3413888Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:18.3651881Z Target //cmd/sds/patchmanager:container_push_path up-to-date: 2023-06-05T14:21:18.3652356Z bazel-bin/cmd/sds/patchmanager/container_push_path.path 2023-06-05T14:21:18.3677145Z INFO: Elapsed time: 0.425s, Critical Path: 0.01s 2023-06-05T14:21:18.3677434Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:18.3677704Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:20.0002059Z INFO: Invocation ID: 1107dcf5-9209-4106-a10f-f283f0188d9e 2023-06-05T14:21:20.2906325Z Loading: 2023-06-05T14:21:20.2946646Z Loading: 2023-06-05T14:21:20.2947025Z Loading: 0 packages loaded 2023-06-05T14:21:20.2993112Z Analyzing: target //cmd/sds/pxe:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:20.3473718Z INFO: Analyzed target //cmd/sds/pxe:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:20.3474107Z INFO: Found 1 target... 2023-06-05T14:21:20.4180800Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:20.4420171Z Target //cmd/sds/pxe:container_push_path up-to-date: 2023-06-05T14:21:20.4420992Z bazel-bin/cmd/sds/pxe/container_push_path.path 2023-06-05T14:21:20.4449280Z INFO: Elapsed time: 0.454s, Critical Path: 0.01s 2023-06-05T14:21:20.4449702Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:20.4450040Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:22.1187777Z INFO: Invocation ID: e9cffb67-6f33-43ea-87f2-35e7fa9a4cb9 2023-06-05T14:21:22.4306790Z Loading: 2023-06-05T14:21:22.4342673Z Loading: 2023-06-05T14:21:22.4343106Z Loading: 0 packages loaded 2023-06-05T14:21:22.4392615Z Analyzing: target //cmd/sds/remoteaccess:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:22.4706803Z INFO: Analyzed target //cmd/sds/remoteaccess:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:22.4707373Z INFO: Found 1 target... 2023-06-05T14:21:22.5416726Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:22.5655452Z Target //cmd/sds/remoteaccess:container_push_path up-to-date: 2023-06-05T14:21:22.5655899Z bazel-bin/cmd/sds/remoteaccess/container_push_path.path 2023-06-05T14:21:22.5680214Z INFO: Elapsed time: 0.458s, Critical Path: 0.01s 2023-06-05T14:21:22.5680492Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:22.5680757Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:24.3246687Z INFO: Invocation ID: 445176c1-b318-4491-83c2-c026b056d81e 2023-06-05T14:21:24.6109257Z Loading: 2023-06-05T14:21:24.6141933Z Loading: 2023-06-05T14:21:24.6142922Z Loading: 0 packages loaded 2023-06-05T14:21:24.6181866Z Analyzing: target //cmd/sds/resiliencemanager:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:24.6477552Z INFO: Analyzed target //cmd/sds/resiliencemanager:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:24.6477968Z INFO: Found 1 target... 2023-06-05T14:21:24.7198096Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:24.7443936Z Target //cmd/sds/resiliencemanager:container_push_path up-to-date: 2023-06-05T14:21:24.7444392Z bazel-bin/cmd/sds/resiliencemanager/container_push_path.path 2023-06-05T14:21:24.7471192Z INFO: Elapsed time: 0.432s, Critical Path: 0.01s 2023-06-05T14:21:24.7471620Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:24.7471952Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:26.3890668Z INFO: Invocation ID: 81c4f9ce-52fc-4180-aba5-d4620344a92c 2023-06-05T14:21:26.6577547Z Loading: 2023-06-05T14:21:26.6619556Z Loading: 2023-06-05T14:21:26.6619879Z Loading: 0 packages loaded 2023-06-05T14:21:26.6670876Z Analyzing: target //cmd/sds/retaildevicemanager:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:26.6943659Z INFO: Analyzed target //cmd/sds/retaildevicemanager:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:26.6944079Z INFO: Found 1 target... 2023-06-05T14:21:26.7637426Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:26.7878008Z Target //cmd/sds/retaildevicemanager:container_push_path up-to-date: 2023-06-05T14:21:26.7878635Z bazel-bin/cmd/sds/retaildevicemanager/container_push_path.path 2023-06-05T14:21:26.7901260Z INFO: Elapsed time: 0.410s, Critical Path: 0.01s 2023-06-05T14:21:26.7901623Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:26.7902309Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:28.5670409Z INFO: Invocation ID: dc20efa2-7c8b-43bc-b574-980284a22a22 2023-06-05T14:21:28.8767793Z Loading: 2023-06-05T14:21:28.8799822Z Loading: 2023-06-05T14:21:28.8801336Z Loading: 0 packages loaded 2023-06-05T14:21:28.8842328Z Analyzing: target //cmd/sds/xorg:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:28.9157548Z INFO: Analyzed target //cmd/sds/xorg:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:28.9157931Z INFO: Found 1 target... 2023-06-05T14:21:28.9855813Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:29.0103350Z Target //cmd/sds/xorg:container_push_path up-to-date: 2023-06-05T14:21:29.0103758Z bazel-bin/cmd/sds/xorg/container_push_path.path 2023-06-05T14:21:29.0127687Z INFO: Elapsed time: 0.455s, Critical Path: 0.01s 2023-06-05T14:21:29.0127969Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:29.0128240Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:30.6526182Z INFO: Invocation ID: 07bd17f8-7f8c-40b3-b4b6-19a5b1d2ae04 2023-06-05T14:21:30.9465867Z Loading: 2023-06-05T14:21:30.9499656Z Loading: 2023-06-05T14:21:30.9500457Z Loading: 0 packages loaded 2023-06-05T14:21:30.9554642Z Analyzing: target //cmd/x/gbug:container_push_path (0 packages loaded, 0 targets configured) 2023-06-05T14:21:30.9828762Z INFO: Analyzed target //cmd/x/gbug:container_push_path (0 packages loaded, 0 targets configured). 2023-06-05T14:21:30.9829591Z INFO: Found 1 target... 2023-06-05T14:21:31.0496551Z [0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2023-06-05T14:21:31.0735483Z Target //cmd/x/gbug:container_push_path up-to-date: 2023-06-05T14:21:31.0735894Z bazel-bin/cmd/x/gbug/container_push_path.path 2023-06-05T14:21:31.0760048Z INFO: Elapsed time: 0.434s, Critical Path: 0.01s 2023-06-05T14:21:31.0760353Z INFO: 2 processes: 2 internal. 2023-06-05T14:21:32.1461192Z INFO: Build completed successfully, 2 total actions 2023-06-05T14:21:32.1462208Z INFO: Invocation ID: 7a55848b-fa6c-49f5-8a2e-14b2c7910281 2023-06-05T14:21:32.1462855Z INFO: Options provided by the client: 2023-06-05T14:21:32.1463395Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:21:32.1464084Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:32.1464745Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:21:32.1465405Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:21:32.1466842Z Inherited 'build' options: --config=cache 2023-06-05T14:21:32.1467527Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:32.1468920Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:21:32.1470657Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:21:32.1472333Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:21:32.1473499Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:21:32.1474891Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:21:32.5370766Z INFO: Build option --action_env has changed, discarding analysis cache. 2023-06-05T14:21:34.7693199Z INFO: Analyzed target //cmd/edge/api:container_push (1171 packages loaded, 25842 targets configured). 2023-06-05T14:21:34.7693657Z INFO: Found 1 target... 2023-06-05T14:21:38.6597807Z Target //cmd/edge/api:container_push up-to-date: 2023-06-05T14:21:38.6598214Z bazel-bin/cmd/edge/api/container_push.digest 2023-06-05T14:21:38.6598532Z bazel-bin/cmd/edge/api/container_push 2023-06-05T14:21:38.6676933Z INFO: Elapsed time: 6.526s, Critical Path: 2.47s 2023-06-05T14:21:38.6677393Z INFO: 1540 processes: 364 disk cache hit, 1174 remote cache hit, 2 internal. 2023-06-05T14:21:38.6683595Z INFO: Running command line: bazel-bin/cmd/edge/api/container_push 2023-06-05T14:21:41.5488675Z 2023/06/05 14:21:41 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-backend:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-backend@sha256:151340c33e3ab6a10d367c08c50fe0fd2d405c26f8e79cab4badf1d857402aad 2023-06-05T14:21:41.5692126Z INFO: Invocation ID: 10d5bb89-f917-46d8-90a5-08373bf1746b 2023-06-05T14:21:41.5692779Z INFO: Options provided by the client: 2023-06-05T14:21:41.5693512Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:21:41.5693950Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:41.5694531Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:21:41.5695104Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:21:41.5695580Z Inherited 'build' options: --config=cache 2023-06-05T14:21:41.5695968Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:41.5696785Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:21:41.5697809Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:21:41.5698734Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:21:41.5699619Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:21:41.5700445Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:21:42.0778225Z INFO: Analyzed target //cmd/edge/bannerctl:container_push (18 packages loaded, 286 targets configured). 2023-06-05T14:21:42.0778685Z INFO: Found 1 target... 2023-06-05T14:21:42.7259902Z Target //cmd/edge/bannerctl:container_push up-to-date: 2023-06-05T14:21:42.7260328Z bazel-bin/cmd/edge/bannerctl/container_push.digest 2023-06-05T14:21:42.7260663Z bazel-bin/cmd/edge/bannerctl/container_push 2023-06-05T14:21:42.7308245Z INFO: Elapsed time: 1.174s, Critical Path: 0.51s 2023-06-05T14:21:42.7308688Z INFO: 42 processes: 28 disk cache hit, 12 remote cache hit, 2 internal. 2023-06-05T14:21:42.7430530Z INFO: Running command line: bazel-bin/cmd/edge/bannerctl/container_push 2023-06-05T14:21:45.4823430Z 2023/06/05 14:21:45 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/bannerctl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/bannerctl@sha256:85c02f0f954480811293353f1e25c3f54db599f75bc302cf55eb6ee76d2944e9 2023-06-05T14:21:45.4998479Z INFO: Invocation ID: ab0789e4-256d-43b3-a2f0-92ffdd56384c 2023-06-05T14:21:45.4998889Z INFO: Options provided by the client: 2023-06-05T14:21:45.4999293Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:21:45.4999721Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:45.5000113Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:21:45.5000633Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:21:45.5000969Z Inherited 'build' options: --config=cache 2023-06-05T14:21:45.5001353Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:45.5002159Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:21:45.5003493Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:21:45.5004583Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:21:45.5005242Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:21:45.5006025Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:21:45.8912190Z INFO: Analyzed target //cmd/edge/bsl:container_push (1 packages loaded, 25 targets configured). 2023-06-05T14:21:45.8912966Z INFO: Found 1 target... 2023-06-05T14:21:47.2576345Z Target //cmd/edge/bsl:container_push up-to-date: 2023-06-05T14:21:47.2576830Z bazel-bin/cmd/edge/bsl/container_push.digest 2023-06-05T14:21:47.2577153Z bazel-bin/cmd/edge/bsl/container_push 2023-06-05T14:21:47.2631706Z INFO: Elapsed time: 1.772s, Critical Path: 0.97s 2023-06-05T14:21:47.2632117Z INFO: 253 processes: 35 disk cache hit, 216 remote cache hit, 2 internal. 2023-06-05T14:21:47.2789647Z INFO: Running command line: bazel-bin/cmd/edge/bsl/container_push 2023-06-05T14:21:50.0577900Z 2023/06/05 14:21:50 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-bsl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-bsl@sha256:374149b993fa6122c6b5109f350fe4db42c1bbdcdc8b58b1278abcd0f574e89c 2023-06-05T14:21:50.0762109Z INFO: Invocation ID: 52fa6030-6c83-470b-b746-fcc450b6d16a 2023-06-05T14:21:50.0762622Z INFO: Options provided by the client: 2023-06-05T14:21:50.0762979Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:21:50.0763425Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:50.0763831Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:21:50.0764214Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:21:50.0764533Z Inherited 'build' options: --config=cache 2023-06-05T14:21:50.0764914Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:50.0765792Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:21:50.0766800Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:21:50.0767724Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:21:50.0768385Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:21:50.0769172Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:21:50.4167907Z INFO: Analyzed target //cmd/edge/chariot2:container_push (0 packages loaded, 8 targets configured). 2023-06-05T14:21:50.4168762Z INFO: Found 1 target... 2023-06-05T14:21:50.7818609Z Target //cmd/edge/chariot2:container_push up-to-date: 2023-06-05T14:21:50.7819493Z bazel-bin/cmd/edge/chariot2/container_push.digest 2023-06-05T14:21:50.7839067Z bazel-bin/cmd/edge/chariot2/container_push 2023-06-05T14:21:50.7876355Z INFO: Elapsed time: 0.722s, Critical Path: 0.27s 2023-06-05T14:21:50.7876731Z INFO: 5 processes: 3 remote cache hit, 2 internal. 2023-06-05T14:21:50.8016521Z INFO: Running command line: bazel-bin/cmd/edge/chariot2/container_push 2023-06-05T14:21:53.5784254Z 2023/06/05 14:21:53 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/chariot2:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/chariot2@sha256:5119539b56417b12cc1b678359d39b8cf78b0cdb7a37b5819256364f58730f15 2023-06-05T14:21:53.5955846Z INFO: Invocation ID: 10a19d8b-ace2-44ba-8d19-a05c86574c79 2023-06-05T14:21:53.5956628Z INFO: Options provided by the client: 2023-06-05T14:21:53.5957024Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:21:53.5957475Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:53.5957882Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:21:53.5958268Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:21:53.5958586Z Inherited 'build' options: --config=cache 2023-06-05T14:21:53.5958969Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:53.5959770Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:21:53.5960775Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:21:53.5961761Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:21:53.5962423Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:21:53.5963207Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:21:54.0956338Z INFO: Analyzed target //cmd/edge/clusterctl:container_push (13 packages loaded, 570 targets configured). 2023-06-05T14:21:54.0956767Z INFO: Found 1 target... 2023-06-05T14:21:56.1622976Z Target //cmd/edge/clusterctl:container_push up-to-date: 2023-06-05T14:21:56.1623417Z bazel-bin/cmd/edge/clusterctl/container_push.digest 2023-06-05T14:21:56.1623754Z bazel-bin/cmd/edge/clusterctl/container_push 2023-06-05T14:21:56.1687440Z INFO: Elapsed time: 2.580s, Critical Path: 1.15s 2023-06-05T14:21:56.1687916Z INFO: 1109 processes: 284 disk cache hit, 823 remote cache hit, 2 internal. 2023-06-05T14:21:56.1851553Z INFO: Running command line: bazel-bin/cmd/edge/clusterctl/container_push 2023-06-05T14:21:58.9429200Z 2023/06/05 14:21:58 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/clusterctl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/clusterctl@sha256:42f6558b284aa7b09b68fc87054d42b730e36f95a5c7fba840b6b28f51c19ae1 2023-06-05T14:21:58.9604009Z INFO: Invocation ID: 4faa5ef2-9d43-4870-9a68-46d833452113 2023-06-05T14:21:58.9604978Z INFO: Options provided by the client: 2023-06-05T14:21:58.9605711Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:21:58.9606306Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:58.9606711Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:21:58.9607082Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:21:58.9607418Z Inherited 'build' options: --config=cache 2023-06-05T14:21:58.9607797Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:21:58.9608601Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:21:58.9609605Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:21:58.9610532Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:21:58.9611188Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:21:58.9612252Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:21:59.3248376Z INFO: Analyzed target //cmd/edge/ctlfish:container_push (0 packages loaded, 5 targets configured). 2023-06-05T14:21:59.3248807Z INFO: Found 1 target... 2023-06-05T14:21:59.7600975Z Target //cmd/edge/ctlfish:container_push up-to-date: 2023-06-05T14:21:59.7601386Z bazel-bin/cmd/edge/ctlfish/container_push.digest 2023-06-05T14:21:59.7601727Z bazel-bin/cmd/edge/ctlfish/container_push 2023-06-05T14:21:59.7634041Z INFO: Elapsed time: 0.814s, Critical Path: 0.32s 2023-06-05T14:21:59.7634425Z INFO: 3 processes: 1 remote cache hit, 2 internal. 2023-06-05T14:21:59.7743860Z INFO: Running command line: bazel-bin/cmd/edge/ctlfish/container_push 2023-06-05T14:22:02.6273333Z 2023/06/05 14:22:02 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/ctlfish:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/ctlfish@sha256:914282d34cb4c47fdf63e21f9cb095c8630fb7142709a191f9dd2f93d3ea532b 2023-06-05T14:22:02.6450932Z INFO: Invocation ID: 8127930c-eb99-467c-acf2-7fc35791b4a6 2023-06-05T14:22:02.6451683Z INFO: Options provided by the client: 2023-06-05T14:22:02.6452046Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:02.6452453Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:02.6452861Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:02.6453241Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:02.6453578Z Inherited 'build' options: --config=cache 2023-06-05T14:22:02.6453941Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:02.6454747Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:02.6456104Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:02.6457187Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:02.6457849Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:02.6458638Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:03.3701279Z INFO: Analyzed target //cmd/edge/datasync/chirp:container_push (5 packages loaded, 1852 targets configured). 2023-06-05T14:22:03.3701748Z INFO: Found 1 target... 2023-06-05T14:22:05.6669737Z Target //cmd/edge/datasync/chirp:container_push up-to-date: 2023-06-05T14:22:05.6670173Z bazel-bin/cmd/edge/datasync/chirp/container_push.digest 2023-06-05T14:22:05.6766441Z bazel-bin/cmd/edge/datasync/chirp/container_push 2023-06-05T14:22:05.6766844Z INFO: Elapsed time: 3.038s, Critical Path: 1.88s 2023-06-05T14:22:05.6767242Z INFO: 867 processes: 164 disk cache hit, 702 remote cache hit, 1 internal. 2023-06-05T14:22:05.6921591Z INFO: Running command line: bazel-bin/cmd/edge/datasync/chirp/container_push 2023-06-05T14:22:08.4446339Z 2023/06/05 14:22:08 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/data-sync-messaging:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/data-sync-messaging@sha256:236113e7f57982683def6be41280b0a3c2907098c572390681825638ee0d3922 2023-06-05T14:22:08.4613710Z INFO: Invocation ID: 4be5cb9b-c81f-4d0b-9bea-164dc0b06396 2023-06-05T14:22:08.4614346Z INFO: Options provided by the client: 2023-06-05T14:22:08.4614708Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:08.4615130Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:08.4615518Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:08.4615901Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:08.4616240Z Inherited 'build' options: --config=cache 2023-06-05T14:22:08.4616617Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:08.4617419Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:08.4618425Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:08.4619337Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:08.4620002Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:08.4621283Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:08.8906680Z INFO: Analyzed target //cmd/edge/datasync/couchctl:container_push (6 packages loaded, 102 targets configured). 2023-06-05T14:22:08.8907533Z INFO: Found 1 target... 2023-06-05T14:22:11.3936562Z Target //cmd/edge/datasync/couchctl:container_push up-to-date: 2023-06-05T14:22:11.3937019Z bazel-bin/cmd/edge/datasync/couchctl/container_push.digest 2023-06-05T14:22:11.3937363Z bazel-bin/cmd/edge/datasync/couchctl/container_push 2023-06-05T14:22:11.4008249Z INFO: Elapsed time: 2.945s, Critical Path: 1.82s 2023-06-05T14:22:11.4008703Z INFO: 920 processes: 179 disk cache hit, 739 remote cache hit, 2 internal. 2023-06-05T14:22:11.4074178Z INFO: Running command line: bazel-bin/cmd/edge/datasync/couchctl/container_push 2023-06-05T14:22:14.1957796Z 2023/06/05 14:22:14 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/couchctl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/couchctl@sha256:b58dd203bd4811e96d10c5cab61babcd1f6c796ef42fd3b7ad85c82546d98561 2023-06-05T14:22:14.2128959Z INFO: Invocation ID: 4079b41e-1a22-4a6b-8d30-4d3b8e9b4671 2023-06-05T14:22:14.2129604Z INFO: Options provided by the client: 2023-06-05T14:22:14.2129972Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:14.2130473Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:14.2130875Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:14.2131276Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:14.2131879Z Inherited 'build' options: --config=cache 2023-06-05T14:22:14.2132265Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:14.2133072Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:14.2134092Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:14.2135003Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:14.2135650Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:14.2136434Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:14.5491839Z INFO: Analyzed target //cmd/edge/datasync/cushion:container_push (0 packages loaded, 15 targets configured). 2023-06-05T14:22:14.5492283Z INFO: Found 1 target... 2023-06-05T14:22:15.1609721Z Target //cmd/edge/datasync/cushion:container_push up-to-date: 2023-06-05T14:22:15.1610162Z bazel-bin/cmd/edge/datasync/cushion/container_push.digest 2023-06-05T14:22:15.1610538Z bazel-bin/cmd/edge/datasync/cushion/container_push 2023-06-05T14:22:15.1646498Z INFO: Elapsed time: 0.961s, Critical Path: 0.51s 2023-06-05T14:22:15.1646911Z INFO: 30 processes: 3 disk cache hit, 25 remote cache hit, 2 internal. 2023-06-05T14:22:15.1812769Z INFO: Running command line: bazel-bin/cmd/edge/datasync/cushion/container_push 2023-06-05T14:22:17.9403419Z 2023/06/05 14:22:17 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/cushion:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/cushion@sha256:edfe9fcfc77d83a41c838989d990bab49fef2b27e0f4c6158fd7a9758116b681 2023-06-05T14:22:17.9591131Z INFO: Invocation ID: fc106134-2a5c-4af0-beae-aa1c696df3f3 2023-06-05T14:22:17.9591693Z INFO: Options provided by the client: 2023-06-05T14:22:17.9592300Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:17.9592736Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:17.9593140Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:17.9593527Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:17.9593869Z Inherited 'build' options: --config=cache 2023-06-05T14:22:17.9594247Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:17.9595067Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:17.9596073Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:17.9596988Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:17.9597641Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:17.9598426Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:18.3881969Z INFO: Analyzed target //cmd/edge/datasync/datasyncinit:container_push (0 packages loaded, 106 targets configured). 2023-06-05T14:22:18.3882395Z INFO: Found 1 target... 2023-06-05T14:22:19.1299966Z Target //cmd/edge/datasync/datasyncinit:container_push up-to-date: 2023-06-05T14:22:19.1300494Z bazel-bin/cmd/edge/datasync/datasyncinit/container_push.digest 2023-06-05T14:22:19.1300896Z bazel-bin/cmd/edge/datasync/datasyncinit/container_push 2023-06-05T14:22:19.1374902Z INFO: Elapsed time: 1.188s, Critical Path: 0.63s 2023-06-05T14:22:19.1376302Z INFO: 98 processes: 46 disk cache hit, 51 remote cache hit, 1 internal. 2023-06-05T14:22:19.1525459Z INFO: Running command line: bazel-bin/cmd/edge/datasync/datasyncinit/container_push 2023-06-05T14:22:21.8778830Z 2023/06/05 14:22:21 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/datasyncinit:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/datasyncinit@sha256:f66d84add052f564b1954ca4b5591cc161bb2a3c3e0ea98403d72e4b11ac07b1 2023-06-05T14:22:21.8966229Z INFO: Invocation ID: 3c723c44-af5f-4845-9db1-3951ae9e5cc8 2023-06-05T14:22:21.8966643Z INFO: Options provided by the client: 2023-06-05T14:22:21.8967000Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:21.8967410Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:21.8967816Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:21.8968198Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:21.8968516Z Inherited 'build' options: --config=cache 2023-06-05T14:22:21.8968894Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:21.8970085Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:21.8971274Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:21.8972494Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:21.8973165Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:21.8973973Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:22.2464010Z INFO: Analyzed target //cmd/edge/datasync/shoot:container_push (0 packages loaded, 30 targets configured). 2023-06-05T14:22:22.2464432Z INFO: Found 1 target... 2023-06-05T14:22:22.7007212Z Target //cmd/edge/datasync/shoot:container_push up-to-date: 2023-06-05T14:22:22.7007643Z bazel-bin/cmd/edge/datasync/shoot/container_push.digest 2023-06-05T14:22:22.7007994Z bazel-bin/cmd/edge/datasync/shoot/container_push 2023-06-05T14:22:22.7038532Z INFO: Elapsed time: 0.819s, Critical Path: 0.36s 2023-06-05T14:22:22.7038984Z INFO: 12 processes: 1 disk cache hit, 10 remote cache hit, 1 internal. 2023-06-05T14:22:22.7096270Z INFO: Running command line: bazel-bin/cmd/edge/datasync/shoot/container_push 2023-06-05T14:22:25.6411281Z 2023/06/05 14:22:25 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/shoot:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/shoot@sha256:0e6a95e1c2e83076139ff402f72edb6a7f21d6cf5b9a63dbd82669dae8a27bb0 2023-06-05T14:22:25.6590026Z INFO: Invocation ID: 7a5722c5-245b-4fb1-b96d-d657bd7521a0 2023-06-05T14:22:25.6590507Z INFO: Options provided by the client: 2023-06-05T14:22:25.6590865Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:25.6591279Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:25.6591682Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:25.6592065Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:25.6592401Z Inherited 'build' options: --config=cache 2023-06-05T14:22:25.6592785Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:25.6593595Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:25.6594607Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:25.6595519Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:25.6596503Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:25.6597335Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:26.0052828Z INFO: Analyzed target //cmd/edge/edge-injector:container_push (0 packages loaded, 13 targets configured). 2023-06-05T14:22:26.0053259Z INFO: Found 1 target... 2023-06-05T14:22:26.4777466Z Target //cmd/edge/edge-injector:container_push up-to-date: 2023-06-05T14:22:26.4777907Z bazel-bin/cmd/edge/edge-injector/container_push.digest 2023-06-05T14:22:26.4778253Z bazel-bin/cmd/edge/edge-injector/container_push 2023-06-05T14:22:26.4804714Z INFO: Elapsed time: 0.833s, Critical Path: 0.39s 2023-06-05T14:22:26.4805186Z INFO: 4 processes: 2 disk cache hit, 1 remote cache hit, 1 internal. 2023-06-05T14:22:26.4857205Z INFO: Running command line: bazel-bin/cmd/edge/edge-injector/container_push 2023-06-05T14:22:29.3208728Z 2023/06/05 14:22:29 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-injector:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-injector@sha256:f278919dd9a97a52ceb6836dae30ef20479e41721c4ce8dc823389cde9c07e59 2023-06-05T14:22:29.3378539Z INFO: Invocation ID: 17038554-010e-4053-9624-d58507c96391 2023-06-05T14:22:29.3379188Z INFO: Options provided by the client: 2023-06-05T14:22:29.3379764Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:29.3380383Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:29.3380794Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:29.3381177Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:29.3381540Z Inherited 'build' options: --config=cache 2023-06-05T14:22:29.3381909Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:29.3382756Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:29.3383790Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:29.3384865Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:29.3385540Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:29.3386408Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:29.6910764Z INFO: Analyzed target //cmd/edge/edge-sql:container_push (3 packages loaded, 12 targets configured). 2023-06-05T14:22:29.6911271Z INFO: Found 1 target... 2023-06-05T14:22:31.4243381Z Target //cmd/edge/edge-sql:container_push up-to-date: 2023-06-05T14:22:31.4243789Z bazel-bin/cmd/edge/edge-sql/container_push.digest 2023-06-05T14:22:31.4244120Z bazel-bin/cmd/edge/edge-sql/container_push 2023-06-05T14:22:31.4279545Z INFO: Elapsed time: 2.099s, Critical Path: 1.46s 2023-06-05T14:22:31.4280371Z INFO: 303 processes: 52 disk cache hit, 249 remote cache hit, 2 internal. 2023-06-05T14:22:31.4328080Z INFO: Running command line: bazel-bin/cmd/edge/edge-sql/container_push 2023-06-05T14:22:34.1528800Z 2023/06/05 14:22:34 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-sql:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-sql@sha256:b81b97a708aaa711e5733d7c121a64fd3d6f1bdd67d5bd0722e0b94d8a52fc98 2023-06-05T14:22:34.1704568Z INFO: Invocation ID: 5a118367-ead3-4400-828f-e3cef12c04a9 2023-06-05T14:22:34.1705095Z INFO: Options provided by the client: 2023-06-05T14:22:34.1705517Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:34.1705933Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:34.1706392Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:34.1706777Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:34.1707140Z Inherited 'build' options: --config=cache 2023-06-05T14:22:34.1707503Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:34.1708319Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:34.1709319Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:34.1710233Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:34.1710897Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:34.1711689Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:34.6461590Z INFO: Analyzed target //cmd/edge/iam/active-ttl:container_push (30 packages loaded, 271 targets configured). 2023-06-05T14:22:34.6462092Z INFO: Found 1 target... 2023-06-05T14:22:36.1632440Z Target //cmd/edge/iam/active-ttl:container_push up-to-date: 2023-06-05T14:22:36.1632880Z bazel-bin/cmd/edge/iam/active-ttl/container_push.digest 2023-06-05T14:22:36.1633241Z bazel-bin/cmd/edge/iam/active-ttl/container_push 2023-06-05T14:22:36.1693988Z INFO: Elapsed time: 2.006s, Critical Path: 1.05s 2023-06-05T14:22:36.1694433Z INFO: 567 processes: 81 disk cache hit, 484 remote cache hit, 2 internal. 2023-06-05T14:22:36.1962392Z INFO: Running command line: bazel-bin/cmd/edge/iam/active-ttl/container_push 2023-06-05T14:22:39.0115708Z 2023/06/05 14:22:39 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/iam-active-ttl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/iam-active-ttl@sha256:11e48c736a3f2aab57cdc4df36e6d8f28c0f2a9d5b2e721aac6b3490d64c73bf 2023-06-05T14:22:39.0290761Z INFO: Invocation ID: 123bc5c9-7af4-4e81-a89a-a2f6ccd37f26 2023-06-05T14:22:39.0291352Z INFO: Options provided by the client: 2023-06-05T14:22:39.0292055Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:39.0292479Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:39.0292909Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:39.0293707Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:39.0294104Z Inherited 'build' options: --config=cache 2023-06-05T14:22:39.0294663Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:39.0295532Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:39.0296551Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:39.0297489Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:39.0298162Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:39.0298966Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:39.3987787Z INFO: Analyzed target //cmd/edge/iam/init:container_push (0 packages loaded, 7 targets configured). 2023-06-05T14:22:39.3988274Z INFO: Found 1 target... 2023-06-05T14:22:39.9912294Z Target //cmd/edge/iam/init:container_push up-to-date: 2023-06-05T14:22:39.9912705Z bazel-bin/cmd/edge/iam/init/container_push.digest 2023-06-05T14:22:39.9913023Z bazel-bin/cmd/edge/iam/init/container_push 2023-06-05T14:22:39.9948781Z INFO: Elapsed time: 0.975s, Critical Path: 0.43s 2023-06-05T14:22:39.9949184Z INFO: 160 processes: 80 disk cache hit, 78 remote cache hit, 2 internal. 2023-06-05T14:22:40.0234722Z INFO: Running command line: bazel-bin/cmd/edge/iam/init/container_push 2023-06-05T14:22:42.8822808Z 2023/06/05 14:22:42 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-iam-init:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-iam-init@sha256:f207a8ea0a2edf27084e455394087a5a9f56a47b0ddfd531d6cb2bbf233b97d3 2023-06-05T14:22:42.8993063Z INFO: Invocation ID: 0d9be9be-2536-4e5a-9cee-d107d9ddd4ee 2023-06-05T14:22:42.8993808Z INFO: Options provided by the client: 2023-06-05T14:22:42.8994292Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:42.8994702Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:42.8995105Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:42.8995518Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:42.8995843Z Inherited 'build' options: --config=cache 2023-06-05T14:22:42.8996222Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:42.8997016Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:42.8998022Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:42.8999302Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:42.9000317Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:42.9001101Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:43.3550464Z INFO: Analyzed target //cmd/edge/iam/operator:container_push (14 packages loaded, 170 targets configured). 2023-06-05T14:22:43.3551316Z INFO: Found 1 target... 2023-06-05T14:22:44.3266954Z Target //cmd/edge/iam/operator:container_push up-to-date: 2023-06-05T14:22:44.3267439Z bazel-bin/cmd/edge/iam/operator/container_push.digest 2023-06-05T14:22:44.3267778Z bazel-bin/cmd/edge/iam/operator/container_push 2023-06-05T14:22:44.3317392Z INFO: Elapsed time: 1.441s, Critical Path: 0.86s 2023-06-05T14:22:44.3317861Z INFO: 71 processes: 13 disk cache hit, 56 remote cache hit, 2 internal. 2023-06-05T14:22:44.3631862Z INFO: Running command line: bazel-bin/cmd/edge/iam/operator/container_push 2023-06-05T14:22:47.1958255Z 2023/06/05 14:22:47 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-iam-operator:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-iam-operator@sha256:90e20b45f6a4ccaa4fc832e87b45dd46bf1f5d5b913d33a3576d66e6884acd7c 2023-06-05T14:22:47.2133162Z INFO: Invocation ID: a19a32e4-02d1-4c3a-b328-c275cfeed87c 2023-06-05T14:22:47.2133874Z INFO: Options provided by the client: 2023-06-05T14:22:47.2134458Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:47.2135202Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:47.2136112Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:47.2136933Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:47.2137550Z Inherited 'build' options: --config=cache 2023-06-05T14:22:47.2138236Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:47.2139754Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:47.2141572Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:47.2142661Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:47.2143423Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:47.2144482Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:48.2356591Z INFO: Analyzed target //cmd/edge/iam/provider:container_push (59 packages loaded, 13978 targets configured). 2023-06-05T14:22:48.2357083Z INFO: Found 1 target... 2023-06-05T14:22:50.9126694Z Target //cmd/edge/iam/provider:container_push up-to-date: 2023-06-05T14:22:50.9127166Z bazel-bin/cmd/edge/iam/provider/container_push.digest 2023-06-05T14:22:50.9127938Z bazel-bin/cmd/edge/iam/provider/container_push 2023-06-05T14:22:50.9236786Z INFO: Elapsed time: 3.714s, Critical Path: 2.28s 2023-06-05T14:22:50.9237701Z INFO: 89 processes: 14 disk cache hit, 73 remote cache hit, 2 internal. 2023-06-05T14:22:50.9547829Z INFO: Running command line: bazel-bin/cmd/edge/iam/provider/container_push 2023-06-05T14:22:53.7122977Z 2023/06/05 14:22:53 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-iam-provider:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-iam-provider@sha256:7ce223a4355a60218cbb2eb29486395716364277db0cfa10a7523c90adca8f35 2023-06-05T14:22:53.7304721Z INFO: Invocation ID: be3563bf-78a4-4fe3-8e52-5dca4b14d30b 2023-06-05T14:22:53.7305544Z INFO: Options provided by the client: 2023-06-05T14:22:53.7306202Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:53.7307263Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:53.7307912Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:53.7308358Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:53.7308760Z Inherited 'build' options: --config=cache 2023-06-05T14:22:53.7309255Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:53.7310195Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:53.7311193Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:53.7312115Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:53.7312814Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:53.7313625Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:54.3702126Z INFO: Analyzed target //cmd/edge/linkerdctl:container_push (133 packages loaded, 779 targets configured). 2023-06-05T14:22:54.3702923Z INFO: Found 1 target... 2023-06-05T14:22:55.9117514Z Target //cmd/edge/linkerdctl:container_push up-to-date: 2023-06-05T14:22:55.9117967Z bazel-bin/cmd/edge/linkerdctl/container_push.digest 2023-06-05T14:22:55.9118303Z bazel-bin/cmd/edge/linkerdctl/container_push 2023-06-05T14:22:55.9181498Z INFO: Elapsed time: 2.196s, Critical Path: 0.93s 2023-06-05T14:22:55.9181930Z INFO: 224 processes: 26 disk cache hit, 196 remote cache hit, 2 internal. 2023-06-05T14:22:55.9377417Z INFO: Running command line: bazel-bin/cmd/edge/linkerdctl/container_push 2023-06-05T14:22:58.7085133Z 2023/06/05 14:22:58 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/linkerdctl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/linkerdctl@sha256:e8e13fcf4fdca1a03a8df5b1c28a432b74bb93210f1e1fa409300cfc14392f24 2023-06-05T14:22:58.7279611Z INFO: Invocation ID: cd71d8a5-1d97-4c27-a07e-919400de9d15 2023-06-05T14:22:58.7280435Z INFO: Options provided by the client: 2023-06-05T14:22:58.7281116Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:22:58.7282386Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:58.7283066Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:22:58.7283453Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:22:58.7283792Z Inherited 'build' options: --config=cache 2023-06-05T14:22:58.7284181Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:22:58.7285461Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:22:58.7287109Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:22:58.7288773Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:22:58.7289938Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:22:58.7291592Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:22:59.0653593Z INFO: Analyzed target //cmd/edge/envctl:container_push (0 packages loaded, 10 targets configured). 2023-06-05T14:22:59.0653999Z INFO: Found 1 target... 2023-06-05T14:23:00.0174895Z Target //cmd/edge/envctl:container_push up-to-date: 2023-06-05T14:23:00.0175357Z bazel-bin/cmd/edge/envctl/container_push.digest 2023-06-05T14:23:00.0175735Z bazel-bin/cmd/edge/envctl/container_push 2023-06-05T14:23:00.0231441Z INFO: Elapsed time: 1.305s, Critical Path: 0.50s 2023-06-05T14:23:00.0232075Z INFO: 202 processes: 110 disk cache hit, 90 remote cache hit, 2 internal. 2023-06-05T14:23:00.0432149Z INFO: Running command line: bazel-bin/cmd/edge/envctl/container_push 2023-06-05T14:23:02.8170737Z 2023/06/05 14:23:02 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/envctl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/envctl@sha256:5c8b6317529286b415c9a89525449f58b0bc56c7caffdcb279146fd34120e376 2023-06-05T14:23:02.8341785Z INFO: Invocation ID: 5fdc57ac-7a99-4367-a117-95f0d91f4fb5 2023-06-05T14:23:02.8342215Z INFO: Options provided by the client: 2023-06-05T14:23:02.8342623Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:02.8343023Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:02.8343443Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:02.8343829Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:02.8344227Z Inherited 'build' options: --config=cache 2023-06-05T14:23:02.8344591Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:02.8345560Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:02.8347116Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:02.8348229Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:02.8348889Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:02.8349680Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:03.1861581Z INFO: Analyzed target //cmd/edge/syncedobjectctl:container_push (0 packages loaded, 8 targets configured). 2023-06-05T14:23:03.1862032Z INFO: Found 1 target... 2023-06-05T14:23:04.0089830Z Target //cmd/edge/syncedobjectctl:container_push up-to-date: 2023-06-05T14:23:04.0090302Z bazel-bin/cmd/edge/syncedobjectctl/container_push.digest 2023-06-05T14:23:04.0090663Z bazel-bin/cmd/edge/syncedobjectctl/container_push 2023-06-05T14:23:04.0125315Z INFO: Elapsed time: 1.188s, Critical Path: 0.46s 2023-06-05T14:23:04.0125734Z INFO: 31 processes: 9 disk cache hit, 20 remote cache hit, 2 internal. 2023-06-05T14:23:04.0675647Z INFO: Running command line: bazel-bin/cmd/edge/syncedobjectctl/container_push 2023-06-05T14:23:06.7980439Z 2023/06/05 14:23:06 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/syncedobjectctl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/syncedobjectctl@sha256:e87009f378d2ba92acb530fe2a63bfb28f6e2cfa64c300c4a9dd8fded8d7c2d2 2023-06-05T14:23:06.8154579Z INFO: Invocation ID: 97932d02-8208-4af3-be55-cc801b0c973b 2023-06-05T14:23:06.8155414Z INFO: Options provided by the client: 2023-06-05T14:23:06.8155920Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:06.8156400Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:06.8156802Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:06.8157169Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:06.8157502Z Inherited 'build' options: --config=cache 2023-06-05T14:23:06.8157885Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:06.8158693Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:06.8159698Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:06.8160623Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:06.8161283Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:06.8162052Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:07.2006428Z INFO: Analyzed target //cmd/f8n/kinform/client:container_push (0 packages loaded, 16 targets configured). 2023-06-05T14:23:07.2006882Z INFO: Found 1 target... 2023-06-05T14:23:08.0786811Z Target //cmd/f8n/kinform/client:container_push up-to-date: 2023-06-05T14:23:08.0787288Z bazel-bin/cmd/f8n/kinform/client/container_push.digest 2023-06-05T14:23:08.0787679Z bazel-bin/cmd/f8n/kinform/client/container_push 2023-06-05T14:23:08.0863268Z INFO: Elapsed time: 1.278s, Critical Path: 0.42s 2023-06-05T14:23:08.0863716Z INFO: 141 processes: 9 disk cache hit, 130 remote cache hit, 2 internal. 2023-06-05T14:23:08.1032511Z INFO: Running command line: bazel-bin/cmd/f8n/kinform/client/container_push 2023-06-05T14:23:10.8955040Z 2023/06/05 14:23:10 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/kinform:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/kinform@sha256:30392d4af8760efe73740c30d6f0db8863e035f7a78233fde16198a056e335c6 2023-06-05T14:23:10.9145251Z INFO: Invocation ID: e6aa0e07-b196-4ccb-b94a-c3fc6599a5e8 2023-06-05T14:23:10.9145896Z INFO: Options provided by the client: 2023-06-05T14:23:10.9146357Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:10.9146968Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:10.9147639Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:10.9148253Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:10.9148647Z Inherited 'build' options: --config=cache 2023-06-05T14:23:10.9149095Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:10.9150048Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:10.9151281Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:10.9152403Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:10.9153071Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:10.9153866Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:11.3260532Z INFO: Analyzed target //cmd/f8n/kinform/server:container_push (3 packages loaded, 40 targets configured). 2023-06-05T14:23:11.3260978Z INFO: Found 1 target... 2023-06-05T14:23:12.0977799Z Target //cmd/f8n/kinform/server:container_push up-to-date: 2023-06-05T14:23:12.0978218Z bazel-bin/cmd/f8n/kinform/server/container_push.digest 2023-06-05T14:23:12.0978559Z bazel-bin/cmd/f8n/kinform/server/container_push 2023-06-05T14:23:12.1028349Z INFO: Elapsed time: 1.199s, Critical Path: 0.43s 2023-06-05T14:23:12.1029095Z INFO: 35 processes: 10 disk cache hit, 23 remote cache hit, 2 internal. 2023-06-05T14:23:12.1162597Z INFO: Running command line: bazel-bin/cmd/f8n/kinform/server/container_push 2023-06-05T14:23:14.8355663Z 2023/06/05 14:23:14 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/kinform-server:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/kinform-server@sha256:1d804641a40fc027205c6cbb0f57815e5a771d803d65bb8839f8803576632b8f 2023-06-05T14:23:14.8522111Z INFO: Invocation ID: 55c3c9ee-b2b8-419b-bdf3-115cd96df152 2023-06-05T14:23:14.8523302Z INFO: Options provided by the client: 2023-06-05T14:23:14.8523985Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:14.8524725Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:14.8525347Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:14.8525938Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:14.8526508Z Inherited 'build' options: --config=cache 2023-06-05T14:23:14.8527114Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:14.8528081Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:14.8529094Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:14.8530025Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:14.8530673Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:14.8531646Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:15.2392507Z INFO: Analyzed target //cmd/edge/logging/fluentbitctl:container_push (2 packages loaded, 16 targets configured). 2023-06-05T14:23:15.2392967Z INFO: Found 1 target... 2023-06-05T14:23:16.6465602Z Target //cmd/edge/logging/fluentbitctl:container_push up-to-date: 2023-06-05T14:23:16.6466137Z bazel-bin/cmd/edge/logging/fluentbitctl/container_push.digest 2023-06-05T14:23:16.6466506Z bazel-bin/cmd/edge/logging/fluentbitctl/container_push 2023-06-05T14:23:16.6501663Z INFO: Elapsed time: 1.807s, Critical Path: 0.93s 2023-06-05T14:23:16.6502107Z INFO: 304 processes: 49 disk cache hit, 253 remote cache hit, 2 internal. 2023-06-05T14:23:16.6748866Z INFO: Running command line: bazel-bin/cmd/edge/logging/fluentbitctl/container_push 2023-06-05T14:23:19.3998137Z 2023/06/05 14:23:19 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/fluentbitctl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/fluentbitctl@sha256:2eb8484d064173722107989152c0233fcd0fe31fb900d7afc44366a7619b6626 2023-06-05T14:23:19.4168560Z INFO: Invocation ID: a60a7430-5fdf-4e0f-ad7c-b2df65b1e888 2023-06-05T14:23:19.4168980Z INFO: Options provided by the client: 2023-06-05T14:23:19.4169341Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:19.4169759Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:19.4170245Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:19.4170637Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:19.4170959Z Inherited 'build' options: --config=cache 2023-06-05T14:23:19.4171345Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:19.4172849Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:19.4174041Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:19.4174959Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:19.4175618Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:19.4176432Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:19.8890124Z INFO: Analyzed target //cmd/f8n/monitoring/am-webhook:container_push (6 packages loaded, 27 targets configured). 2023-06-05T14:23:20.6334843Z INFO: Found 1 target... 2023-06-05T14:23:20.6335286Z Target //cmd/f8n/monitoring/am-webhook:container_push up-to-date: 2023-06-05T14:23:20.6335684Z bazel-bin/cmd/f8n/monitoring/am-webhook/container_push.digest 2023-06-05T14:23:20.6336034Z bazel-bin/cmd/f8n/monitoring/am-webhook/container_push 2023-06-05T14:23:20.6367507Z INFO: Elapsed time: 1.229s, Critical Path: 0.41s 2023-06-05T14:23:20.6367907Z INFO: 11 processes: 9 remote cache hit, 2 internal. 2023-06-05T14:23:20.6590147Z INFO: Running command line: bazel-bin/cmd/f8n/monitoring/am-webhook/container_push 2023-06-05T14:23:23.4892107Z 2023/06/05 14:23:23 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/am-webhook:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/am-webhook@sha256:98236d24feb216d7a578627d7cd63a9b4d2d15e19017676fa9582524e5d2dcd4 2023-06-05T14:23:23.5057547Z INFO: Invocation ID: bf366cfa-b687-4a6f-ac60-d17fb08a4db5 2023-06-05T14:23:23.5058233Z INFO: Options provided by the client: 2023-06-05T14:23:23.5058615Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:23.5059028Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:23.5059413Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:23.5059804Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:23.5060138Z Inherited 'build' options: --config=cache 2023-06-05T14:23:23.5060519Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:23.5061446Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:23.5062506Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:23.5063401Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:23.5064052Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:23.5065180Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:23.9652813Z INFO: Analyzed target //cmd/f8n/monitoring/plank:container_push (16 packages loaded, 196 targets configured). 2023-06-05T14:23:23.9653242Z INFO: Found 1 target... 2023-06-05T14:23:24.8201674Z Target //cmd/f8n/monitoring/plank:container_push up-to-date: 2023-06-05T14:23:24.8202184Z bazel-bin/cmd/f8n/monitoring/plank/container_push.digest 2023-06-05T14:23:24.8202549Z bazel-bin/cmd/f8n/monitoring/plank/container_push 2023-06-05T14:23:24.8254713Z INFO: Elapsed time: 1.328s, Critical Path: 0.51s 2023-06-05T14:23:24.8255183Z INFO: 67 processes: 16 disk cache hit, 49 remote cache hit, 2 internal. 2023-06-05T14:23:24.8400872Z INFO: Running command line: bazel-bin/cmd/f8n/monitoring/plank/container_push 2023-06-05T14:23:27.6510944Z 2023/06/05 14:23:27 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/plank:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/plank@sha256:38a0cd3bae7c4065feae7cd5070faf3ce85014ac1fd958bcea434354d2cd6741 2023-06-05T14:23:27.6694624Z INFO: Invocation ID: 7f320715-1076-4a35-9d81-51703fda55a6 2023-06-05T14:23:27.6695228Z INFO: Options provided by the client: 2023-06-05T14:23:27.6695803Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:27.6696548Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:27.6697329Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:27.6698616Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:27.6699017Z Inherited 'build' options: --config=cache 2023-06-05T14:23:27.6699644Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:27.6700490Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:27.6701583Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:27.6702517Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:27.6703194Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:27.6703997Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:28.0452166Z INFO: Analyzed target //cmd/f8n/monitoring/prometheus:container_push (0 packages loaded, 13 targets configured). 2023-06-05T14:23:28.0452625Z INFO: Found 1 target... 2023-06-05T14:23:29.5847423Z Target //cmd/f8n/monitoring/prometheus:container_push up-to-date: 2023-06-05T14:23:29.5847911Z bazel-bin/cmd/f8n/monitoring/prometheus/container_push.digest 2023-06-05T14:23:29.5848422Z bazel-bin/cmd/f8n/monitoring/prometheus/container_push 2023-06-05T14:23:29.5900350Z INFO: Elapsed time: 1.930s, Critical Path: 1.05s 2023-06-05T14:23:29.5900846Z INFO: 505 processes: 82 disk cache hit, 421 remote cache hit, 2 internal. 2023-06-05T14:23:29.6191929Z INFO: Running command line: bazel-bin/cmd/f8n/monitoring/prometheus/container_push 2023-06-05T14:23:32.3498071Z 2023/06/05 14:23:32 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/prometheus-stackdriver:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/prometheus-stackdriver@sha256:5c972cee0cb4644be1d17dcdabe1c0716d24e10b624010db80ac40cd8b4f8121 2023-06-05T14:23:32.3669376Z INFO: Invocation ID: dd9001d9-ec8a-4965-a4dc-7068b470e804 2023-06-05T14:23:32.3670280Z INFO: Options provided by the client: 2023-06-05T14:23:32.3670680Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:32.3671075Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:32.3671480Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:32.3671869Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:32.3672212Z Inherited 'build' options: --config=cache 2023-06-05T14:23:32.3672621Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:32.3673442Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:32.3674441Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:32.3675372Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:32.3676039Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:32.3676841Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:32.8083107Z INFO: Analyzed target //cmd/f8n/rebar/gridbug:container_push (1 packages loaded, 175 targets configured). 2023-06-05T14:23:32.8083540Z INFO: Found 1 target... 2023-06-05T14:23:33.8381873Z Target //cmd/f8n/rebar/gridbug:container_push up-to-date: 2023-06-05T14:23:33.8382294Z bazel-bin/cmd/f8n/rebar/gridbug/container_push.digest 2023-06-05T14:23:33.8382650Z bazel-bin/cmd/f8n/rebar/gridbug/container_push 2023-06-05T14:23:33.8439960Z INFO: Elapsed time: 1.485s, Critical Path: 0.69s 2023-06-05T14:23:33.8440455Z INFO: 74 processes: 11 disk cache hit, 61 remote cache hit, 2 internal. 2023-06-05T14:23:33.8609400Z INFO: Running command line: bazel-bin/cmd/f8n/rebar/gridbug/container_push 2023-06-05T14:23:36.6335057Z 2023/06/05 14:23:36 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/gridbug:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/gridbug@sha256:86fbef6f08a2ba50d17b6620f4d58dece97cc67056c255a7cac281abdabc27a4 2023-06-05T14:23:36.6510562Z INFO: Invocation ID: b593276d-d5f5-4141-a16e-312d747d1a6f 2023-06-05T14:23:36.6511180Z INFO: Options provided by the client: 2023-06-05T14:23:36.6511608Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:36.6512004Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:36.6512412Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:36.6512800Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:36.6513693Z Inherited 'build' options: --config=cache 2023-06-05T14:23:36.6514113Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:36.6515106Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:36.6516191Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:36.6517124Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:36.6517776Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:36.6518573Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:37.2183151Z INFO: Analyzed target //cmd/f8n/rebar/jack:container_push (23 packages loaded, 543 targets configured). 2023-06-05T14:23:37.2183572Z INFO: Found 1 target... 2023-06-05T14:23:38.1429764Z Target //cmd/f8n/rebar/jack:container_push up-to-date: 2023-06-05T14:23:38.1430168Z bazel-bin/cmd/f8n/rebar/jack/container_push.digest 2023-06-05T14:23:38.1430494Z bazel-bin/cmd/f8n/rebar/jack/container_push 2023-06-05T14:23:38.1482342Z INFO: Elapsed time: 1.505s, Critical Path: 0.57s 2023-06-05T14:23:38.1482816Z INFO: 101 processes: 15 disk cache hit, 84 remote cache hit, 2 internal. 2023-06-05T14:23:38.1697588Z INFO: Running command line: bazel-bin/cmd/f8n/rebar/jack/container_push 2023-06-05T14:23:40.8946261Z 2023/06/05 14:23:40 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/jack-bot:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/jack-bot@sha256:76cb71a9c1c0c147c8109aa38fb773d1295f6f3ae7dd7ab2a1bf787edb80a850 2023-06-05T14:23:40.9120149Z INFO: Invocation ID: adb4dcf0-660e-4452-862f-f28fa9524e47 2023-06-05T14:23:40.9121061Z INFO: Options provided by the client: 2023-06-05T14:23:40.9121427Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:40.9121839Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:40.9122245Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:40.9122647Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:40.9122982Z Inherited 'build' options: --config=cache 2023-06-05T14:23:40.9123374Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:40.9124186Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:40.9125188Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:40.9126503Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:40.9127166Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:40.9128180Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:41.3158431Z INFO: Analyzed target //cmd/f8n/rebar/overlook:container_push (0 packages loaded, 8 targets configured). 2023-06-05T14:23:41.3158873Z INFO: Found 1 target... 2023-06-05T14:23:42.0396145Z Target //cmd/f8n/rebar/overlook:container_push up-to-date: 2023-06-05T14:23:42.0396934Z bazel-bin/cmd/f8n/rebar/overlook/container_push.digest 2023-06-05T14:23:42.0397559Z bazel-bin/cmd/f8n/rebar/overlook/container_push 2023-06-05T14:23:42.0444870Z INFO: Elapsed time: 1.141s, Critical Path: 0.40s 2023-06-05T14:23:42.0445466Z INFO: 27 processes: 1 disk cache hit, 24 remote cache hit, 2 internal. 2023-06-05T14:23:42.0631132Z INFO: Running command line: bazel-bin/cmd/f8n/rebar/overlook/container_push 2023-06-05T14:23:44.7877134Z 2023/06/05 14:23:44 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/overlook:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/overlook@sha256:d7cd13a22e0562e449b52c41b3ae13da2c9f59961f338996c0e91e409cd4c614 2023-06-05T14:23:44.8048677Z INFO: Invocation ID: 324096a5-8df5-479c-b5b9-0c86b09d32c4 2023-06-05T14:23:44.8049373Z INFO: Options provided by the client: 2023-06-05T14:23:44.8049807Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:44.8050229Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:44.8050646Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:44.8051049Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:44.8051638Z Inherited 'build' options: --config=cache 2023-06-05T14:23:44.8052130Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:44.8052962Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:44.8054017Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:44.8055025Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:44.8055693Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:44.8056487Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:45.1752481Z INFO: Analyzed target //cmd/f8n/rebar/slacker:container_push (0 packages loaded, 5 targets configured). 2023-06-05T14:23:45.1753144Z INFO: Found 1 target... 2023-06-05T14:23:46.4963951Z Target //cmd/f8n/rebar/slacker:container_push up-to-date: 2023-06-05T14:23:46.4964378Z bazel-bin/cmd/f8n/rebar/slacker/container_push.digest 2023-06-05T14:23:46.4964836Z bazel-bin/cmd/f8n/rebar/slacker/container_push 2023-06-05T14:23:46.5026581Z INFO: Elapsed time: 1.704s, Critical Path: 0.97s 2023-06-05T14:23:46.5027434Z INFO: 260 processes: 36 disk cache hit, 222 remote cache hit, 2 internal. 2023-06-05T14:23:46.5231056Z INFO: Running command line: bazel-bin/cmd/f8n/rebar/slacker/container_push 2023-06-05T14:23:49.3062406Z 2023/06/05 14:23:49 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/slacker:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/slacker@sha256:ad4da6f9bda8a704da0c641f7489a79f46b4d054f5314a1ec7c642ccef5112c6 2023-06-05T14:23:49.3235339Z INFO: Invocation ID: fa436bbf-a3b5-4f68-8fcd-7d6839514a2a 2023-06-05T14:23:49.3236094Z INFO: Options provided by the client: 2023-06-05T14:23:49.3236573Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:49.3236988Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:49.3237420Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:49.3237805Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:49.3238152Z Inherited 'build' options: --config=cache 2023-06-05T14:23:49.3238515Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:49.3239315Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:49.3240446Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:49.3241369Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:49.3242026Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:49.3242815Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:49.7568667Z INFO: Analyzed target //cmd/f8n/warehouse/lumperctl:container_push (1 packages loaded, 27 targets configured). 2023-06-05T14:23:49.7569111Z INFO: Found 1 target... 2023-06-05T14:23:51.2989006Z Target //cmd/f8n/warehouse/lumperctl:container_push up-to-date: 2023-06-05T14:23:51.2989656Z bazel-bin/cmd/f8n/warehouse/lumperctl/container_push.digest 2023-06-05T14:23:51.2990070Z bazel-bin/cmd/f8n/warehouse/lumperctl/container_push 2023-06-05T14:23:51.3058631Z INFO: Elapsed time: 1.989s, Critical Path: 0.94s 2023-06-05T14:23:51.3059105Z INFO: 580 processes: 110 disk cache hit, 468 remote cache hit, 2 internal. 2023-06-05T14:23:51.3337549Z INFO: Running command line: bazel-bin/cmd/f8n/warehouse/lumperctl/container_push 2023-06-05T14:23:54.1394164Z 2023/06/05 14:23:54 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/lumperctl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/lumperctl@sha256:6f212e9c385b3adb63aa0b1c1ac56e5ba14453cc4709cfa0f652f88f9c7721de 2023-06-05T14:23:54.1566205Z INFO: Invocation ID: a2979fe2-fcfc-4204-805b-dd125c79c9c4 2023-06-05T14:23:54.1566800Z INFO: Options provided by the client: 2023-06-05T14:23:54.1567157Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:54.1569966Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:54.1570541Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:54.1571242Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:54.1571954Z Inherited 'build' options: --config=cache 2023-06-05T14:23:54.1572346Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:54.1573135Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:54.1574147Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:54.1575082Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:54.1575748Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:54.1576532Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:54.5276378Z INFO: Analyzed target //cmd/f8n/warehouse/registryforwarder:container_push (0 packages loaded, 11 targets configured). 2023-06-05T14:23:54.5276834Z INFO: Found 1 target... 2023-06-05T14:23:55.3298737Z Target //cmd/f8n/warehouse/registryforwarder:container_push up-to-date: 2023-06-05T14:23:55.3299607Z bazel-bin/cmd/f8n/warehouse/registryforwarder/container_push.digest 2023-06-05T14:23:55.3300304Z bazel-bin/cmd/f8n/warehouse/registryforwarder/container_push 2023-06-05T14:23:55.3342937Z INFO: Elapsed time: 1.187s, Critical Path: 0.45s 2023-06-05T14:23:55.3343707Z INFO: 43 processes: 12 disk cache hit, 29 remote cache hit, 2 internal. 2023-06-05T14:23:55.3658734Z INFO: Running command line: bazel-bin/cmd/f8n/warehouse/registryforwarder/container_push 2023-06-05T14:23:58.1038415Z 2023/06/05 14:23:58 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/registryforwarder:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/registryforwarder@sha256:7e859b80a168fe25c7f20b50793317114dd0df7f00d96fc849f2ec01c259dc46 2023-06-05T14:23:58.1245788Z INFO: Invocation ID: 70d16969-51c3-4878-89f3-a4c59ac4e0f4 2023-06-05T14:23:58.1246187Z INFO: Options provided by the client: 2023-06-05T14:23:58.1246568Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:23:58.1246987Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:58.1247407Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:23:58.1247775Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:23:58.1248105Z Inherited 'build' options: --config=cache 2023-06-05T14:23:58.1248491Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:23:58.1249291Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:23:58.1250667Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:23:58.1252154Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:23:58.1252834Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:23:58.1253623Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:23:58.5925128Z INFO: Analyzed target //cmd/sds/authserver:container_push (4 packages loaded, 21 targets configured). 2023-06-05T14:23:58.5925595Z INFO: Found 1 target... 2023-06-05T14:23:59.3143345Z Target //cmd/sds/authserver:container_push up-to-date: 2023-06-05T14:23:59.3143792Z bazel-bin/cmd/sds/authserver/container_push.digest 2023-06-05T14:23:59.3144130Z bazel-bin/cmd/sds/authserver/container_push 2023-06-05T14:23:59.3183116Z INFO: Elapsed time: 1.206s, Critical Path: 0.32s 2023-06-05T14:23:59.3467132Z INFO: 166 processes: 64 disk cache hit, 100 remote cache hit, 2 internal. 2023-06-05T14:23:59.3467656Z INFO: Running command line: bazel-bin/cmd/sds/authserver/container_push 2023-06-05T14:24:02.0632133Z 2023/06/05 14:24:02 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/authserver:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/authserver@sha256:cb52582f7521fc4aea6fba5a33377d6e41afa022388f0f481b4c416945123b3e 2023-06-05T14:24:02.0805052Z INFO: Invocation ID: a169a495-7f26-4a1b-85d9-ed2ee2cd6f1f 2023-06-05T14:24:02.0805751Z INFO: Options provided by the client: 2023-06-05T14:24:02.0806140Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:24:02.0806666Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:02.0807343Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:24:02.0807736Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:24:02.0808070Z Inherited 'build' options: --config=cache 2023-06-05T14:24:02.0808434Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:02.0809264Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:24:02.0810419Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:24:02.0811346Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:24:02.0812249Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:24:02.0813038Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:24:02.4237012Z INFO: Analyzed target //cmd/sds/corednsctl:container_push (0 packages loaded, 20 targets configured). 2023-06-05T14:24:02.4237874Z INFO: Found 1 target... 2023-06-05T14:24:03.1510366Z Target //cmd/sds/corednsctl:container_push up-to-date: 2023-06-05T14:24:03.1511253Z bazel-bin/cmd/sds/corednsctl/container_push.digest 2023-06-05T14:24:03.1511571Z bazel-bin/cmd/sds/corednsctl/container_push 2023-06-05T14:24:03.1560949Z INFO: Elapsed time: 1.085s, Critical Path: 0.39s 2023-06-05T14:24:03.1561377Z INFO: 62 processes: 19 disk cache hit, 41 remote cache hit, 2 internal. 2023-06-05T14:24:03.1702438Z INFO: Running command line: bazel-bin/cmd/sds/corednsctl/container_push 2023-06-05T14:24:05.9471491Z 2023/06/05 14:24:05 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/corednsctl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/corednsctl@sha256:da571211c1bce3226a164549bfec22d3b0e22ee5e450967c99df92a4222c6bc2 2023-06-05T14:24:05.9642965Z INFO: Invocation ID: 754fe6bb-8e73-49ac-8810-301bf082b733 2023-06-05T14:24:05.9643669Z INFO: Options provided by the client: 2023-06-05T14:24:05.9644207Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:24:05.9644818Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:05.9645246Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:24:05.9645646Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:24:05.9645994Z Inherited 'build' options: --config=cache 2023-06-05T14:24:05.9646365Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:05.9647239Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:24:05.9648304Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:24:05.9649250Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:24:05.9649955Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:24:05.9650761Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:24:06.3348948Z INFO: Analyzed target //cmd/sds/nodeagent:container_push (0 packages loaded, 34 targets configured). 2023-06-05T14:24:06.3349372Z INFO: Found 1 target... 2023-06-05T14:24:07.7262849Z Target //cmd/sds/nodeagent:container_push up-to-date: 2023-06-05T14:24:07.7263588Z bazel-bin/cmd/sds/nodeagent/container_push.digest 2023-06-05T14:24:07.7264233Z bazel-bin/cmd/sds/nodeagent/container_push 2023-06-05T14:24:07.7328642Z INFO: Elapsed time: 1.775s, Critical Path: 0.99s 2023-06-05T14:24:07.7329432Z INFO: 271 processes: 53 disk cache hit, 216 remote cache hit, 2 internal. 2023-06-05T14:24:07.7564648Z INFO: Running command line: bazel-bin/cmd/sds/nodeagent/container_push 2023-06-05T14:24:10.5841219Z 2023/06/05 14:24:10 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/nodeagent:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/nodeagent@sha256:e77d0f94ef6f0c929abae917489b453552a1233cea944b237647680d2d7e7b14 2023-06-05T14:24:10.6049847Z INFO: Invocation ID: 999bd10d-3f5e-4ca7-a6dc-7bbefc885289 2023-06-05T14:24:10.6050683Z INFO: Options provided by the client: 2023-06-05T14:24:10.6051876Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:24:10.6052731Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:10.6053420Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:24:10.6054089Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:24:10.6054732Z Inherited 'build' options: --config=cache 2023-06-05T14:24:10.6055543Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:10.6057106Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:24:10.6058321Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:24:10.6059775Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:24:10.6060756Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:24:10.6062078Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:24:11.1657330Z INFO: Analyzed target //cmd/sds/patchmanager:container_push (74 packages loaded, 397 targets configured). 2023-06-05T14:24:11.1657767Z INFO: Found 1 target... 2023-06-05T14:24:11.8373283Z Target //cmd/sds/patchmanager:container_push up-to-date: 2023-06-05T14:24:11.8374131Z bazel-bin/cmd/sds/patchmanager/container_push.digest 2023-06-05T14:24:11.8374947Z bazel-bin/cmd/sds/patchmanager/container_push 2023-06-05T14:24:11.8434741Z INFO: Elapsed time: 1.248s, Critical Path: 0.29s 2023-06-05T14:24:11.8435338Z INFO: 96 processes: 6 disk cache hit, 88 remote cache hit, 2 internal. 2023-06-05T14:24:11.8635233Z INFO: Running command line: bazel-bin/cmd/sds/patchmanager/container_push 2023-06-05T14:24:14.5852020Z 2023/06/05 14:24:14 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/patchctl:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/patchctl@sha256:afdab9fe38140a64589a5832f0ba7c336aaec8769f3aa80daa94c5c2949041db 2023-06-05T14:24:14.6030352Z INFO: Invocation ID: 4e159c2f-342f-4dd2-a6cd-8004a8f2a8a3 2023-06-05T14:24:14.6030920Z INFO: Options provided by the client: 2023-06-05T14:24:14.6031288Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:24:14.6031814Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:14.6032214Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:24:14.6032585Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:24:14.6032912Z Inherited 'build' options: --config=cache 2023-06-05T14:24:14.6033437Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:14.6034598Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:24:14.6035625Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:24:14.6036745Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:24:14.6037420Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:24:14.6038181Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:24:15.0188749Z INFO: Analyzed target //cmd/sds/pxe:container_push (1 packages loaded, 21 targets configured). 2023-06-05T14:24:15.0189181Z INFO: Found 1 target... 2023-06-05T14:24:16.5150553Z Target //cmd/sds/pxe:container_push up-to-date: 2023-06-05T14:24:16.5151311Z bazel-bin/cmd/sds/pxe/container_push.digest 2023-06-05T14:24:16.5151860Z bazel-bin/cmd/sds/pxe/container_push 2023-06-05T14:24:16.5234100Z INFO: Elapsed time: 1.926s, Critical Path: 0.98s 2023-06-05T14:24:16.5234566Z INFO: 441 processes: 143 disk cache hit, 296 remote cache hit, 2 internal. 2023-06-05T14:24:16.5544760Z INFO: Running command line: bazel-bin/cmd/sds/pxe/container_push 2023-06-05T14:24:19.2942819Z 2023/06/05 14:24:19 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/pxe-controller:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/pxe-controller@sha256:7f74323b96a19995fb24d97f5a198fa7b3727e22caeb14161bed36aceb4ce56e 2023-06-05T14:24:19.3119310Z INFO: Invocation ID: 16917c6d-86ac-40a4-b012-bf1339e0796f 2023-06-05T14:24:19.3119730Z INFO: Options provided by the client: 2023-06-05T14:24:19.3120067Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:24:19.3120510Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:19.3120910Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:24:19.3121292Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:24:19.3121624Z Inherited 'build' options: --config=cache 2023-06-05T14:24:19.3122041Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:19.3122847Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:24:19.3123883Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:24:19.3124804Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:24:19.3125468Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:24:19.3126614Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:24:19.6746244Z INFO: Analyzed target //cmd/sds/remoteaccess:container_push (0 packages loaded, 32 targets configured). 2023-06-05T14:24:19.6747530Z INFO: Found 1 target... 2023-06-05T14:24:20.5272678Z Target //cmd/sds/remoteaccess:container_push up-to-date: 2023-06-05T14:24:20.5273096Z bazel-bin/cmd/sds/remoteaccess/container_push.digest 2023-06-05T14:24:20.5273432Z bazel-bin/cmd/sds/remoteaccess/container_push 2023-06-05T14:24:20.5307474Z INFO: Elapsed time: 1.229s, Critical Path: 0.49s 2023-06-05T14:24:20.5307885Z INFO: 28 processes: 18 disk cache hit, 8 remote cache hit, 2 internal. 2023-06-05T14:24:20.5571982Z INFO: Running command line: bazel-bin/cmd/sds/remoteaccess/container_push 2023-06-05T14:24:23.2762544Z 2023/06/05 14:24:23 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/vpn-controller:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/vpn-controller@sha256:f8dd7a8b65217357ea31342bf353b547453c8f16515f4707f9093dc436733cce 2023-06-05T14:24:23.2935867Z INFO: Invocation ID: 94372492-1f71-41fa-a714-850294a136a9 2023-06-05T14:24:23.2936430Z INFO: Options provided by the client: 2023-06-05T14:24:23.2936809Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:24:23.2937235Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:23.2937640Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:24:23.2938023Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:24:23.2938354Z Inherited 'build' options: --config=cache 2023-06-05T14:24:23.2938714Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:23.2939526Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:24:23.2940525Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:24:23.2941441Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:24:23.2942096Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:24:23.2942888Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:24:23.7935475Z INFO: Analyzed target //cmd/sds/resiliencemanager:container_push (17 packages loaded, 107 targets configured). 2023-06-05T14:24:23.7935952Z INFO: Found 1 target... 2023-06-05T14:24:24.7366540Z Target //cmd/sds/resiliencemanager:container_push up-to-date: 2023-06-05T14:24:24.7435817Z bazel-bin/cmd/sds/resiliencemanager/container_push.digest 2023-06-05T14:24:24.7436286Z bazel-bin/cmd/sds/resiliencemanager/container_push 2023-06-05T14:24:24.7436830Z INFO: Elapsed time: 1.458s, Critical Path: 0.48s 2023-06-05T14:24:24.7437243Z INFO: 119 processes: 12 disk cache hit, 105 remote cache hit, 2 internal. 2023-06-05T14:24:24.7605393Z INFO: Running command line: bazel-bin/cmd/sds/resiliencemanager/container_push 2023-06-05T14:24:27.5997256Z 2023/06/05 14:24:27 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/resiliencemanager:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/resiliencemanager@sha256:92e289905851252d13b146a9cb27e72382d2d73049dfe21ca93a8d56fa19fa72 2023-06-05T14:24:27.6170920Z INFO: Invocation ID: d96e6f8e-ece3-4731-a9cc-b368c8229d85 2023-06-05T14:24:27.6171997Z INFO: Options provided by the client: 2023-06-05T14:24:27.6172454Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:24:27.6172962Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:27.6173431Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:24:27.6173879Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:24:27.6174246Z Inherited 'build' options: --config=cache 2023-06-05T14:24:27.6174770Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:27.6175605Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:24:27.6176607Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:24:27.6177535Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:24:27.6178182Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:24:27.6178983Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:24:28.0391471Z INFO: Analyzed target //cmd/sds/retaildevicemanager:container_push (2 packages loaded, 39 targets configured). 2023-06-05T14:24:28.0391926Z INFO: Found 1 target... 2023-06-05T14:24:28.8429148Z Target //cmd/sds/retaildevicemanager:container_push up-to-date: 2023-06-05T14:24:28.8429627Z bazel-bin/cmd/sds/retaildevicemanager/container_push.digest 2023-06-05T14:24:28.8429984Z bazel-bin/cmd/sds/retaildevicemanager/container_push 2023-06-05T14:24:28.8466311Z INFO: Elapsed time: 1.239s, Critical Path: 0.45s 2023-06-05T14:24:28.8466751Z INFO: 19 processes: 6 disk cache hit, 11 remote cache hit, 2 internal. 2023-06-05T14:24:28.8723720Z INFO: Running command line: bazel-bin/cmd/sds/retaildevicemanager/container_push 2023-06-05T14:24:31.6243475Z 2023/06/05 14:24:31 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/retail-device-manager:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/retail-device-manager@sha256:ac1b65770699e32e65f0d9ded1d487ccd25bcbe2877228b5bd36166c7b00a9a6 2023-06-05T14:24:31.6429686Z INFO: Invocation ID: 5c0bee9f-b93f-4cde-81f9-b5ad23873bb2 2023-06-05T14:24:31.6430462Z INFO: Options provided by the client: 2023-06-05T14:24:31.6430956Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:24:31.6431373Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:31.6431780Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:24:31.6432154Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:24:31.6432494Z Inherited 'build' options: --config=cache 2023-06-05T14:24:31.6432874Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:31.6434063Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:24:31.6435350Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:24:31.6436271Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:24:31.6436919Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:24:31.6437736Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:24:32.0874235Z DEBUG: /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/external/io_bazel_rules_docker/container/push.bzl:80:14: Pushing an image based on a tarball can be very expensive. If the image set on @//cmd/sds/xorg:container_push is the output of a docker_build, consider dropping the '.tar' extension. If the image is checked in, consider using container_import instead. 2023-06-05T14:24:32.1201418Z INFO: Analyzed target //cmd/sds/xorg:container_push (12 packages loaded, 163 targets configured). 2023-06-05T14:24:32.1201848Z INFO: Found 1 target... 2023-06-05T14:24:32.9615853Z Target //cmd/sds/xorg:container_push up-to-date: 2023-06-05T14:24:32.9616274Z bazel-bin/cmd/sds/xorg/container_push.digest 2023-06-05T14:24:32.9616581Z bazel-bin/cmd/sds/xorg/container_push 2023-06-05T14:24:32.9664329Z INFO: Elapsed time: 1.333s, Critical Path: 0.48s 2023-06-05T14:24:32.9664760Z INFO: 76 processes: 26 disk cache hit, 48 remote cache hit, 2 internal. 2023-06-05T14:24:32.9893346Z INFO: Running command line: bazel-bin/cmd/sds/xorg/container_push 2023-06-05T14:24:46.6600240Z 2023/06/05 14:24:46 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/xorg:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/xorg@sha256:de3e926ea26f80017f1f43546e5a51c62e6cef8ac6fd3d3e005f09006c3dccb7 2023-06-05T14:24:46.6787681Z INFO: Invocation ID: 69231425-f211-4cb1-83f5-9bb688828e37 2023-06-05T14:24:46.6788199Z INFO: Options provided by the client: 2023-06-05T14:24:46.6788561Z Inherited 'common' options: --isatty=0 --terminal_columns=80 2023-06-05T14:24:46.6789000Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:46.6789406Z Inherited 'common' options: --incompatible_allow_tags_propagation 2023-06-05T14:24:46.6789799Z INFO: Reading rc options for 'run' from /etc/bazel.bazelrc: 2023-06-05T14:24:46.6790131Z Inherited 'build' options: --config=cache 2023-06-05T14:24:46.6790511Z INFO: Reading rc options for 'run' from /__w/edge-infra/edge-infra/.bazelrc: 2023-06-05T14:24:46.6791328Z Inherited 'build' options: --sandbox_default_allow_network=false --noexperimental_check_external_repository_files --reuse_sandbox_directories --noexperimental_action_cache_store_output_metadata --disk_cache=~/.cache/bazel --workspace_status_command=hack/workspace_status.sh --stamp 2023-06-05T14:24:46.6792381Z INFO: Found applicable config definition build:cache in file /etc/bazel.bazelrc: --google_default_credentials --remote_upload_local_results=true --remote_cache=https://storage.googleapis.com/edge-bzl-ci-cache/amIR9j360TakI0c2iBiL5A== 2023-06-05T14:24:46.6793711Z INFO: Found applicable config definition build:cache in file /__w/edge-infra/edge-infra/.bazelrc: --remote_local_fallback --remote_download_outputs=toplevel --experimental_inmemory_jdeps_files=true --experimental_inmemory_dotd_files=true 2023-06-05T14:24:46.6794620Z INFO: Found applicable config definition common:ci in file /__w/edge-infra/edge-infra/.bazelrc: --logging=3 2023-06-05T14:24:46.6795403Z INFO: Found applicable config definition build:ci in file /__w/edge-infra/edge-infra/.bazelrc: --noshow_progress --color=yes --sandbox_fake_username --announce_rc --sandbox_debug --verbose_failures --disk_cache=/__w/_tool/.cache/bazel --action_env=LANG=C.UTF-8 2023-06-05T14:24:47.0461145Z INFO: Analyzed target //cmd/x/gbug:container_push (0 packages loaded, 24 targets configured). 2023-06-05T14:24:47.0461623Z INFO: Found 1 target... 2023-06-05T14:24:47.6822528Z Target //cmd/x/gbug:container_push up-to-date: 2023-06-05T14:24:47.6822952Z bazel-bin/cmd/x/gbug/container_push.digest 2023-06-05T14:24:47.6823310Z bazel-bin/cmd/x/gbug/container_push 2023-06-05T14:24:47.6874009Z INFO: Elapsed time: 1.019s, Critical Path: 0.32s 2023-06-05T14:24:47.6874450Z INFO: 27 processes: 2 disk cache hit, 23 remote cache hit, 2 internal. 2023-06-05T14:24:47.7060778Z INFO: Running command line: bazel-bin/cmd/x/gbug/container_push 2023-06-05T14:24:50.4701931Z 2023/06/05 14:24:50 Successfully pushed Docker image to us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/gbug:dev - us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/gbug@sha256:e6a3602a99bc90a87dd1a42c80f7487c3ef59b5adbf99b933a8eda56d8926a4b 2023-06-05T14:24:50.4712985Z 2023/06/05 14:24:50 Parsing release tags and applying to published artifacts 2023-06-05T14:24:50.4713367Z 2023/06/05 14:24:50 Tags: 2023-06-05T14:24:50.4713944Z - 0.3.6-rc.1685973271.build.5177987294-commit.0903c3c 2023-06-05T14:24:50.4714260Z - 0903c3c70a566d60ec1eec3a086ca85d0c24cc62 2023-06-05T14:24:50.4714549Z - 5177987294 2023-06-05T14:24:50.4714791Z - 2023-06-05.13-54-31.0000UTC 2023-06-05T14:24:50.4717494Z - chore-bump-golint 2023-06-05T14:25:16.1365340Z 2023/06/05 14:25:16 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-backend@sha256:151340c33e3ab6a10d367c08c50fe0fd2d405c26f8e79cab4badf1d857402aad 2023-06-05T14:25:42.1135117Z 2023/06/05 14:25:42 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/bannerctl@sha256:85c02f0f954480811293353f1e25c3f54db599f75bc302cf55eb6ee76d2944e9 2023-06-05T14:26:08.2680940Z 2023/06/05 14:26:08 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-bsl@sha256:374149b993fa6122c6b5109f350fe4db42c1bbdcdc8b58b1278abcd0f574e89c 2023-06-05T14:26:34.1866170Z 2023/06/05 14:26:34 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/chariot2@sha256:5119539b56417b12cc1b678359d39b8cf78b0cdb7a37b5819256364f58730f15 2023-06-05T14:26:59.7754333Z 2023/06/05 14:26:59 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/clusterctl@sha256:42f6558b284aa7b09b68fc87054d42b730e36f95a5c7fba840b6b28f51c19ae1 2023-06-05T14:27:25.5876203Z 2023/06/05 14:27:25 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/ctlfish@sha256:914282d34cb4c47fdf63e21f9cb095c8630fb7142709a191f9dd2f93d3ea532b 2023-06-05T14:27:51.2279987Z 2023/06/05 14:27:51 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/data-sync-messaging@sha256:236113e7f57982683def6be41280b0a3c2907098c572390681825638ee0d3922 2023-06-05T14:28:17.0523645Z 2023/06/05 14:28:17 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/couchctl@sha256:b58dd203bd4811e96d10c5cab61babcd1f6c796ef42fd3b7ad85c82546d98561 2023-06-05T14:28:43.0861711Z 2023/06/05 14:28:43 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/cushion@sha256:edfe9fcfc77d83a41c838989d990bab49fef2b27e0f4c6158fd7a9758116b681 2023-06-05T14:29:09.0777179Z 2023/06/05 14:29:09 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/datasyncinit@sha256:f66d84add052f564b1954ca4b5591cc161bb2a3c3e0ea98403d72e4b11ac07b1 2023-06-05T14:29:34.8252946Z 2023/06/05 14:29:34 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/shoot@sha256:0e6a95e1c2e83076139ff402f72edb6a7f21d6cf5b9a63dbd82669dae8a27bb0 2023-06-05T14:30:00.8808119Z 2023/06/05 14:30:00 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-injector@sha256:f278919dd9a97a52ceb6836dae30ef20479e41721c4ce8dc823389cde9c07e59 2023-06-05T14:30:26.6876252Z 2023/06/05 14:30:26 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-sql@sha256:b81b97a708aaa711e5733d7c121a64fd3d6f1bdd67d5bd0722e0b94d8a52fc98 2023-06-05T14:30:52.8241000Z 2023/06/05 14:30:52 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/iam-active-ttl@sha256:11e48c736a3f2aab57cdc4df36e6d8f28c0f2a9d5b2e721aac6b3490d64c73bf 2023-06-05T14:31:19.2238095Z 2023/06/05 14:31:19 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-iam-init@sha256:f207a8ea0a2edf27084e455394087a5a9f56a47b0ddfd531d6cb2bbf233b97d3 2023-06-05T14:31:45.4922797Z 2023/06/05 14:31:45 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-iam-operator@sha256:90e20b45f6a4ccaa4fc832e87b45dd46bf1f5d5b913d33a3576d66e6884acd7c 2023-06-05T14:32:11.1824707Z 2023/06/05 14:32:11 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/edge-iam-provider@sha256:7ce223a4355a60218cbb2eb29486395716364277db0cfa10a7523c90adca8f35 2023-06-05T14:32:37.2676178Z 2023/06/05 14:32:37 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/linkerdctl@sha256:e8e13fcf4fdca1a03a8df5b1c28a432b74bb93210f1e1fa409300cfc14392f24 2023-06-05T14:33:02.8786184Z 2023/06/05 14:33:02 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/envctl@sha256:5c8b6317529286b415c9a89525449f58b0bc56c7caffdcb279146fd34120e376 2023-06-05T14:33:28.3273930Z 2023/06/05 14:33:28 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/syncedobjectctl@sha256:e87009f378d2ba92acb530fe2a63bfb28f6e2cfa64c300c4a9dd8fded8d7c2d2 2023-06-05T14:33:53.8321413Z 2023/06/05 14:33:53 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/kinform@sha256:30392d4af8760efe73740c30d6f0db8863e035f7a78233fde16198a056e335c6 2023-06-05T14:34:19.3644040Z 2023/06/05 14:34:19 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/kinform-server@sha256:1d804641a40fc027205c6cbb0f57815e5a771d803d65bb8839f8803576632b8f 2023-06-05T14:34:45.0705075Z 2023/06/05 14:34:45 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/fluentbitctl@sha256:2eb8484d064173722107989152c0233fcd0fe31fb900d7afc44366a7619b6626 2023-06-05T14:35:10.7988603Z 2023/06/05 14:35:10 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/am-webhook@sha256:98236d24feb216d7a578627d7cd63a9b4d2d15e19017676fa9582524e5d2dcd4 2023-06-05T14:35:36.5479244Z 2023/06/05 14:35:36 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/plank@sha256:38a0cd3bae7c4065feae7cd5070faf3ce85014ac1fd958bcea434354d2cd6741 2023-06-05T14:36:03.0553385Z 2023/06/05 14:36:03 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/prometheus-stackdriver@sha256:5c972cee0cb4644be1d17dcdabe1c0716d24e10b624010db80ac40cd8b4f8121 2023-06-05T14:36:29.1165394Z 2023/06/05 14:36:29 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/gridbug@sha256:86fbef6f08a2ba50d17b6620f4d58dece97cc67056c255a7cac281abdabc27a4 2023-06-05T14:36:54.7209978Z 2023/06/05 14:36:54 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/jack-bot@sha256:76cb71a9c1c0c147c8109aa38fb773d1295f6f3ae7dd7ab2a1bf787edb80a850 2023-06-05T14:37:20.2313894Z 2023/06/05 14:37:20 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/overlook@sha256:d7cd13a22e0562e449b52c41b3ae13da2c9f59961f338996c0e91e409cd4c614 2023-06-05T14:37:46.1259049Z 2023/06/05 14:37:46 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/slacker@sha256:ad4da6f9bda8a704da0c641f7489a79f46b4d054f5314a1ec7c642ccef5112c6 2023-06-05T14:38:11.8936567Z 2023/06/05 14:38:11 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/lumperctl@sha256:6f212e9c385b3adb63aa0b1c1ac56e5ba14453cc4709cfa0f652f88f9c7721de 2023-06-05T14:38:37.5623858Z 2023/06/05 14:38:37 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/registryforwarder@sha256:7e859b80a168fe25c7f20b50793317114dd0df7f00d96fc849f2ec01c259dc46 2023-06-05T14:39:03.2214523Z 2023/06/05 14:39:03 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/authserver@sha256:cb52582f7521fc4aea6fba5a33377d6e41afa022388f0f481b4c416945123b3e 2023-06-05T14:39:28.9749405Z 2023/06/05 14:39:28 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/corednsctl@sha256:da571211c1bce3226a164549bfec22d3b0e22ee5e450967c99df92a4222c6bc2 2023-06-05T14:39:55.0511789Z 2023/06/05 14:39:55 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/nodeagent@sha256:e77d0f94ef6f0c929abae917489b453552a1233cea944b237647680d2d7e7b14 2023-06-05T14:40:20.8131274Z 2023/06/05 14:40:20 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/patchctl@sha256:afdab9fe38140a64589a5832f0ba7c336aaec8769f3aa80daa94c5c2949041db 2023-06-05T14:40:46.4430770Z 2023/06/05 14:40:46 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/pxe-controller@sha256:7f74323b96a19995fb24d97f5a198fa7b3727e22caeb14161bed36aceb4ce56e 2023-06-05T14:41:12.5229162Z 2023/06/05 14:41:12 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/vpn-controller@sha256:f8dd7a8b65217357ea31342bf353b547453c8f16515f4707f9093dc436733cce 2023-06-05T14:41:38.2685724Z 2023/06/05 14:41:38 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/resiliencemanager@sha256:92e289905851252d13b146a9cb27e72382d2d73049dfe21ca93a8d56fa19fa72 2023-06-05T14:42:03.9263383Z 2023/06/05 14:42:03 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/retail-device-manager@sha256:ac1b65770699e32e65f0d9ded1d487ccd25bcbe2877228b5bd36166c7b00a9a6 2023-06-05T14:42:29.6153933Z 2023/06/05 14:42:29 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/xorg@sha256:de3e926ea26f80017f1f43546e5a51c62e6cef8ac6fd3d3e005f09006c3dccb7 2023-06-05T14:42:55.1335325Z 2023/06/05 14:42:55 tagged us-east1-docker.pkg.dev/ret-edge-pltf-infra/workloads/gbug@sha256:e6a3602a99bc90a87dd1a42c80f7487c3ef59b5adbf99b933a8eda56d8926a4b 2023-06-05T14:42:55.1335901Z 2023/06/05 14:42:55 Done. 2023-06-05T14:42:55.1439667Z ##[group]Run collect-bazel-test-reports.sh "${REPORT_DIR}" 2023-06-05T14:42:55.1440054Z collect-bazel-test-reports.sh "${REPORT_DIR}" 2023-06-05T14:42:55.1440403Z shell: sh -e {0} 2023-06-05T14:42:55.1440588Z env: 2023-06-05T14:42:55.1440777Z REPORT_DIR: tmp/junit 2023-06-05T14:42:55.1463253Z ##[endgroup] 2023-06-05T14:42:55.2417437Z report dir: tmp/junit 2023-06-05T14:42:55.2417933Z collecting junit reports to tmp/junit 2023-06-05T14:42:55.2432881Z cleaning tmp/junit 2023-06-05T14:42:55.2433123Z creating tmp/junit 2023-06-05T14:42:55.2717826Z INFO: Invocation ID: e994a7b0-1b81-424b-8fee-37e9baf4c0e3 2023-06-05T14:42:55.7649922Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/third_party/k8s/fluxcd/fluxcd_test/test.xml to tmp/junit/sodyAjTJXh.xml 2023-06-05T14:42:55.7693662Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/config/pallets/pallets_test/test.xml to tmp/junit/QSw1T5N7eZ.xml 2023-06-05T14:42:55.7727734Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/lib/gcp/iam/iam_test/test.xml to tmp/junit/FO4jYb4Ara.xml 2023-06-05T14:42:55.7761947Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/lib/gcp/cloudsql/cloudsql_test/test.xml to tmp/junit/YFl5BJZMsx.xml 2023-06-05T14:42:55.7798194Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/lib/gcp/secretmanager/secretmanager_test/test.xml to tmp/junit/rL8d6dHyUM.xml 2023-06-05T14:42:55.7834930Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/lib/server/server_test/test.xml to tmp/junit/KcJ6A01Xhw.xml 2023-06-05T14:42:55.7871682Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/lib/server/inmemorylistener/inmemorylistener_test/test.xml to tmp/junit/5HeFvfowfK.xml 2023-06-05T14:42:55.7905225Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/lib/fog/fog_test/test.xml to tmp/junit/HXnLPVnJtV.xml 2023-06-05T14:42:55.7937985Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/lib/runtime/subscriber/metrics/metrics_test/test.xml to tmp/junit/266WEfq8pj.xml 2023-06-05T14:42:55.7971704Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/lib/text/drawing/drawing_test/test.xml to tmp/junit/lGaSuL7GwG.xml 2023-06-05T14:42:55.8004576Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/webhooks/edge-injector/edge-injector_test/test.xml to tmp/junit/VHMA7tdcGW.xml 2023-06-05T14:42:55.8038168Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/shipment/generator/generator_test/test.xml to tmp/junit/JfJXYQ5BRh.xml 2023-06-05T14:42:55.8071357Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/component/build/updatemanifests/updatemanifests_test/test.xml to tmp/junit/XJuk582r0K.xml 2023-06-05T14:42:55.8104063Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/controllers/bannerctl/bannerctl_test/test.xml to tmp/junit/Lc3tQz3Jw6.xml 2023-06-05T14:42:55.8138477Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/controllers/clusterctl/clusterctl_test/test.xml to tmp/junit/Zq9MpprlnM.xml 2023-06-05T14:42:55.8168887Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/controllers/clusterctl/pkg/plugins/plugins_test/test.xml to tmp/junit/rpv4m9gWsY.xml 2023-06-05T14:42:55.8202670Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/controllers/clusterctl/pkg/iamutils/iamutils_test/test.xml to tmp/junit/Zt4RJHRMwc.xml 2023-06-05T14:42:55.8237692Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/controllers/syncedobject/syncedobject_test/test.xml to tmp/junit/AjBamPvqT6.xml 2023-06-05T14:42:55.8272168Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/controllers/envctl/envctl_test/test.xml to tmp/junit/iY8smuNVim.xml 2023-06-05T14:42:55.8305839Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/controllers/envctl/pkg/nameutils/nameutils_test/test.xml to tmp/junit/pgeAeyTAAw.xml 2023-06-05T14:42:55.8340858Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/chariot/chariot_test/test.xml to tmp/junit/vwqhgKrpyY.xml 2023-06-05T14:42:55.8375813Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/registration/registration_test/test.xml to tmp/junit/4gCr4PixmQ.xml 2023-06-05T14:42:55.8408651Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/bsl/bsl_test/test.xml to tmp/junit/gKy6TCV5zw.xml 2023-06-05T14:42:55.8442787Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/linkerd/controllers/controllers_test/test.xml to tmp/junit/KWAD2bpagz.xml 2023-06-05T14:42:55.8475394Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/api/graph/resolver/resolver_test/test.xml to tmp/junit/TCQ6QaYMm7.xml 2023-06-05T14:42:55.8507267Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/api/graph/mapper/mapper_test/test.xml to tmp/junit/k8OAwyV5H7.xml 2023-06-05T14:42:55.8542064Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/api/graph/integration/integration_test/test.xml to tmp/junit/F3FRu7Eswe.xml 2023-06-05T14:42:55.8583234Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/api/middleware/middleware_test/test.xml to tmp/junit/SrSUrBEgNz.xml 2023-06-05T14:42:55.8617240Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/api/services/services_test/test.xml to tmp/junit/76VxiM2Cuj.xml 2023-06-05T14:42:55.8659162Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/api/clients/clients_test/test.xml to tmp/junit/Mf9nt8wHsv.xml 2023-06-05T14:42:55.8691132Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/api/utils/utils_test/test.xml to tmp/junit/0SNoocfyzS.xml 2023-06-05T14:42:55.8722779Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/api/apierror/apierror_test/test.xml to tmp/junit/WBqismTrJ3.xml 2023-06-05T14:42:55.8755518Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/deleteresource/deleteresource_test/test.xml to tmp/junit/vzdgx2nxcs.xml 2023-06-05T14:42:55.8788553Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/addhelmrepository/addhelmrepository_test/test.xml to tmp/junit/FfWfNlP0Pu.xml 2023-06-05T14:42:55.8820482Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/trimmer/trimmer_test/test.xml to tmp/junit/CbKCgMoUI1.xml 2023-06-05T14:42:55.8854859Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/addexternalsecret/addexternalsecret_test/test.xml to tmp/junit/C9yBpupa1M.xml 2023-06-05T14:42:55.8887348Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/addcontainercluster/addcontainercluster_test/test.xml to tmp/junit/gnNkXNYxiC.xml 2023-06-05T14:42:55.8921564Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/addnamespace/addnamespace_test/test.xml to tmp/junit/Qwuib4TcwD.xml 2023-06-05T14:42:55.8955364Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/edgerelease/edgerelease_test/test.xml to tmp/junit/8V08KqCp4t.xml 2023-06-05T14:42:55.8989149Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/clusterselgen/clusterselgen_test/test.xml to tmp/junit/9qO9FEGbgA.xml 2023-06-05T14:42:55.9022011Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/addcontainerpool/addcontainerpool_test/test.xml to tmp/junit/jePzocSTpd.xml 2023-06-05T14:42:55.9055556Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/addcluster/addcluster_test/test.xml to tmp/junit/OcC0LwccPG.xml 2023-06-05T14:42:55.9095258Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/fns/addtenant/addtenant_test/test.xml to tmp/junit/bVWLmcWLIE.xml 2023-06-05T14:42:55.9135108Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/gitops/chariot/client/client_test/test.xml to tmp/junit/ZwLWpjXmfY.xml 2023-06-05T14:42:55.9169076Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/iam/util/util_test/test.xml to tmp/junit/66ZYiwY0ff.xml 2023-06-05T14:42:55.9204799Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/clientutils/clientutils_test/test.xml to tmp/junit/nxpGT4q56m.xml 2023-06-05T14:42:55.9238919Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/bootstrapping/bootstrapping_test/test.xml to tmp/junit/8NBCqcVUkr.xml 2023-06-05T14:42:55.9272393Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/bsl-reconciler/bsl-reconciler_test/test.xml to tmp/junit/6hy9ZcvZEN.xml 2023-06-05T14:42:55.9307335Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/datasync/cushion/cushion_test/test.xml to tmp/junit/4mBbxDuHhB.xml 2023-06-05T14:42:55.9340506Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/datasync/controllers/couchctl/couchctl_test/test.xml to tmp/junit/y06wOjksX4.xml 2023-06-05T14:42:55.9375496Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/datasync/controllers/couchctl/couchdb/couchdb_test/test.xml to tmp/junit/9TYJWx5Nzu.xml 2023-06-05T14:42:55.9407862Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/datasync/chirp/provider/provider_test/test.xml to tmp/junit/mnX2UAbChe.xml 2023-06-05T14:42:55.9442212Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/datasync/chirp/server/http/http_test/test.xml to tmp/junit/OHKMV59VN0.xml 2023-06-05T14:42:55.9476895Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/datasync/chirp/persister/files/files_test/test.xml to tmp/junit/EVS3uSev2e.xml 2023-06-05T14:42:55.9511501Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/datasync/apis/v1alpha1/v1alpha1_test/test.xml to tmp/junit/QsmBvLNu5e.xml 2023-06-05T14:42:55.9544370Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/datasync/couchdb/couchdb_test/test.xml to tmp/junit/BEDaTv5WYM.xml 2023-06-05T14:42:55.9576769Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/datasync/internal/configmap/configmap_test/test.xml to tmp/junit/3CM8BP4rqF.xml 2023-06-05T14:42:55.9610656Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/datasync/internal/signature/signature_test/test.xml to tmp/junit/4h2uxcEb2r.xml 2023-06-05T14:42:55.9644140Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/ctlfish/option/option_test/test.xml to tmp/junit/sAEh88VVck.xml 2023-06-05T14:42:55.9681290Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/ctlfish/monitor/monitor_test/test.xml to tmp/junit/XAm9u3Z5Zz.xml 2023-06-05T14:42:55.9716021Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/info/info_test/test.xml to tmp/junit/Aa8sXMRdQk.xml 2023-06-05T14:42:55.9751688Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/gridbug/gridbug_test/test.xml to tmp/junit/50fimlJqhO.xml 2023-06-05T14:42:55.9784100Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/ghappman/ghappman_test/test.xml to tmp/junit/V1wxPPaygP.xml 2023-06-05T14:42:55.9817580Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/gcp/job/storage/storage_test/test.xml to tmp/junit/MikftMsVCO.xml 2023-06-05T14:42:55.9849982Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/jack_test/test.xml to tmp/junit/cnFT35wHIu.xml 2023-06-05T14:42:55.9890814Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/guest_services/guest_services_test/test.xml to tmp/junit/rDZZMqItwa.xml 2023-06-05T14:42:55.9923549Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/project/project_test/test.xml to tmp/junit/kxRNTM8l4N.xml 2023-06-05T14:42:55.9957918Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/changelog/changelog_test/test.xml to tmp/junit/pAkz4NPh63.xml 2023-06-05T14:42:55.9991518Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/list/list_test/test.xml to tmp/junit/jJCd37slZK.xml 2023-06-05T14:42:56.0032477Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/enforce_milestone/enforce_milestone_test/test.xml to tmp/junit/Bit4muAVZL.xml 2023-06-05T14:42:56.0065340Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/size/size_test/test.xml to tmp/junit/54QXmr1ILg.xml 2023-06-05T14:42:56.0098803Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/epics/epics_test/test.xml to tmp/junit/i0wEcooFsm.xml 2023-06-05T14:42:56.0130763Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/type/type_test/test.xml to tmp/junit/3icxLzawlv.xml 2023-06-05T14:42:56.0163591Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/uploadjob/uploadjob_test/test.xml to tmp/junit/aARydlpNxQ.xml 2023-06-05T14:42:56.0194612Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/approved_label/approved_label_test/test.xml to tmp/junit/a5yuRCnvoP.xml 2023-06-05T14:42:56.0226727Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/approved_label/bulldoze_sync_label_test/test.xml to tmp/junit/t1M6ypMr1x.xml 2023-06-05T14:42:56.0260039Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/triage_parent/triage_parent_test/test.xml to tmp/junit/asUnYkh2kJ.xml 2023-06-05T14:42:56.0292330Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/pr/pr_test/test.xml to tmp/junit/GCIJjLYyZU.xml 2023-06-05T14:42:56.0323580Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/devinfra/jack/plugin/triage_issue/triage_issue_test/test.xml to tmp/junit/aEoCWhimMS.xml 2023-06-05T14:42:56.0356214Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/lighthouse/config/config_test/test.xml to tmp/junit/PacTmcRl1W.xml 2023-06-05T14:42:56.0388399Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/lighthouse/lighthouse_test/test.xml to tmp/junit/UB6JEL7kmu.xml 2023-06-05T14:42:56.0421631Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/edge/logging/k8s/controllers/fluentbitctl/fluentbitctl_test/test.xml to tmp/junit/uPZxO8WGO4.xml 2023-06-05T14:42:56.0454885Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/gcp/k8s/controllers/logsink/logsink_test/test.xml to tmp/junit/HsqXgNf48l.xml 2023-06-05T14:42:56.0486983Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/gcp/k8s/controllers/dennis/dennis_test/test.xml to tmp/junit/fPYtsp5gOv.xml 2023-06-05T14:42:56.0520207Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/gcp/k8s/controllers/projectinit/projectinit_test/test.xml to tmp/junit/7tAevBQl0w.xml 2023-06-05T14:42:56.0555024Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/monitoring/billman/costs/costs_test/test.xml to tmp/junit/UB9MqvrP4N.xml 2023-06-05T14:42:56.0590016Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/monitoring/k8s/controllers/prometheusctl/prometheusctl_test/test.xml to tmp/junit/eToar5EcKy.xml 2023-06-05T14:42:56.0624360Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/forwarder/forwarder_test/test.xml to tmp/junit/8bssOlqNJo.xml 2023-06-05T14:42:56.0660114Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/k8s/controllers/lumperctl/lumperctl_test/test.xml to tmp/junit/tPbUZoA2vY.xml 2023-06-05T14:42:56.0693041Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/k8s/apis/meta/meta_test/test.xml to tmp/junit/XUzyrwburF.xml 2023-06-05T14:42:56.0723911Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/k8s/apis/v1alpha1/v1alpha1_test/test.xml to tmp/junit/SkmYSR2IYN.xml 2023-06-05T14:42:56.0755719Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/promote/promote_test/test.xml to tmp/junit/7rGAG1p3xz.xml 2023-06-05T14:42:56.0789606Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/lift/pack/pack_test/test.xml to tmp/junit/XgDazXyBLQ.xml 2023-06-05T14:42:56.0829724Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/lift/cmd/pallets/pallets_test/test.xml to tmp/junit/klce3BWwfT.xml 2023-06-05T14:42:56.0862033Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/lift/cmd/pack/pack_test/test.xml to tmp/junit/jJj4r1dG34.xml 2023-06-05T14:42:56.0893148Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/lift/cmd/internal/command/command_test/test.xml to tmp/junit/nmEilBcgDU.xml 2023-06-05T14:42:56.0925318Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/lift/unpack/unpack_test/test.xml to tmp/junit/vGXl4omurE.xml 2023-06-05T14:42:56.0958054Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/pallet/resolve/resolve_test/test.xml to tmp/junit/sZ8uokfIGq.xml 2023-06-05T14:42:56.0990068Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/oci/oci_test/test.xml to tmp/junit/WLq6IfCbTw.xml 2023-06-05T14:42:56.1024385Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/oci/mutate/mutate_test/test.xml to tmp/junit/RmN1YLfL72.xml 2023-06-05T14:42:56.1056426Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/oci/cache/providers/memory/memory_test/test.xml to tmp/junit/nUNGgm3RYO.xml 2023-06-05T14:42:56.1090180Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/oci/cache/providers/disk/disk_test/test.xml to tmp/junit/hoiQEIhSmy.xml 2023-06-05T14:42:56.1123244Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/oci/cache/cache_test/test.xml to tmp/junit/SS02YvtPNg.xml 2023-06-05T14:42:56.1157109Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/oci/layout/layout_test/test.xml to tmp/junit/l1B0jHCImM.xml 2023-06-05T14:42:56.1187599Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/warehouse/oci/layer/layer_test/test.xml to tmp/junit/NelxbjZn8P.xml 2023-06-05T14:42:56.1219225Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/kinform/sql/sql_test/test.xml to tmp/junit/SHsr8W07pk.xml 2023-06-05T14:42:56.1254394Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/kinform/client/client_test/test.xml to tmp/junit/7pU1KwUm1A.xml 2023-06-05T14:42:56.1287178Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/kinform/server/server_test/test.xml to tmp/junit/SKulst5GHI.xml 2023-06-05T14:42:56.1318931Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/f8n/kinform/model/model_test/test.xml to tmp/junit/M7U38nhVUt.xml 2023-06-05T14:42:56.1350191Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/k8s/certmanager/certmanager_test/test.xml to tmp/junit/gTf53tb4ui.xml 2023-06-05T14:42:56.1382616Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/k8s/runtime/controller/reconcile/reconcile_test/test.xml to tmp/junit/7iu06LRa26.xml 2023-06-05T14:42:56.1414607Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/k8s/runtime/inventory/inventory_test/test.xml to tmp/junit/KkrPFrdxDt.xml 2023-06-05T14:42:56.1446343Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/k8s/runtime/objectrestarter/objectrestarter_test/test.xml to tmp/junit/zop5aK1Vkq.xml 2023-06-05T14:42:56.1479876Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/k8s/runtime/sap/install/install_test/test.xml to tmp/junit/aI8C0d5FWa.xml 2023-06-05T14:42:56.1512029Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/k8s/runtime/sap/sap_test/test.xml to tmp/junit/wNv3yaRrhh.xml 2023-06-05T14:42:56.1546598Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/k8s/runtime/conditions/conditions_test/test.xml to tmp/junit/hXENIlEPJR.xml 2023-06-05T14:42:56.1580117Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/k8s/kustomize/kustomize_test/test.xml to tmp/junit/9VVNUFv48t.xml 2023-06-05T14:42:56.1614865Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/k8s/object/object_test/test.xml to tmp/junit/IDTD2tb8cg.xml 2023-06-05T14:42:56.1646977Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/k8s/unstructured/unstructured_test/test.xml to tmp/junit/GNgHDybmhW.xml 2023-06-05T14:42:56.1681575Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/lib/remotecli/remotecli/remotecli_test/test.xml to tmp/junit/gZwkMun2DO.xml 2023-06-05T14:42:56.1715131Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/lib/remotecli/msgsvc/msgsvc_test/test.xml to tmp/junit/5Py98WPYik.xml 2023-06-05T14:42:56.1750765Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/lib/os/grub/grub_test/test.xml to tmp/junit/ayX5qN2c8N.xml 2023-06-05T14:42:56.1783990Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/coredns/pkg/pkg_test/test.xml to tmp/junit/nZMX5ta24I.xml 2023-06-05T14:42:56.1818203Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/pxe/pxe_test/test.xml to tmp/junit/F61rPdNiB3.xml 2023-06-05T14:42:56.1852356Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/resiliencemanager/pkg/certs/certs_test/test.xml to tmp/junit/L06n4m5Mge.xml 2023-06-05T14:42:56.1884582Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/remoteaccess/pkg/pkg_test/test.xml to tmp/junit/203PxkC9e8.xml 2023-06-05T14:42:56.1917809Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/applynodelabels/applynodelabels_test/test.xml to tmp/junit/pSASnIN39a.xml 2023-06-05T14:42:56.1950325Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/chronyd/chronyd_test/test.xml to tmp/junit/tVeQ7SHjQO.xml 2023-06-05T14:42:56.1983362Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/ntpconfiguration_test/test.xml to tmp/junit/5euiA3E0Ox.xml 2023-06-05T14:42:56.2015332Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/ntpconfiguration/timesyncd/timesyncd_test/test.xml to tmp/junit/P3Q4x0qmtH.xml 2023-06-05T14:42:56.2057416Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient/thinclient_test/test.xml to tmp/junit/kKfJRStyn2.xml 2023-06-05T14:42:56.2089149Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/thinclient/selector/selector_test/test.xml to tmp/junit/98SOnGjxrq.xml 2023-06-05T14:42:56.2127551Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/osuserpasswordupdater/osuserpasswordupdater_test/test.xml to tmp/junit/N935lJxqyX.xml 2023-06-05T14:42:56.2161549Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/example/example_test/test.xml to tmp/junit/lVka1ebxKX.xml 2023-06-05T14:42:56.2194054Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/remoteagentconfig/remoteagentconfig_test/test.xml to tmp/junit/SmCjQAXZYc.xml 2023-06-05T14:42:56.2229230Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/networking/networking_test/test.xml to tmp/junit/665bs3r4RP.xml 2023-06-05T14:42:56.2283512Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/pkg/plugins/grubstringupdater/grubstringupdater_test/test.xml to tmp/junit/qVE8za0DR0.xml 2023-06-05T14:42:56.2323131Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/controllers/nodeagent/nodeagent_test/test.xml to tmp/junit/sYfiqSeC3c.xml 2023-06-05T14:42:56.2357314Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/sds/k8s/authserver/authserver_test/test.xml to tmp/junit/W7DF63Cj85.xml 2023-06-05T14:42:56.2390397Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/pkg/tools/hack/cmd/owners/owners_test/test.xml to tmp/junit/yS919dSd9y.xml 2023-06-05T14:42:56.2423708Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/cmd/f8n/monitoring/alertman/cli/cli_test/test.xml to tmp/junit/7A5oBHv55o.xml 2023-06-05T14:42:56.2456100Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/test/fixtures/fixtures_test/test.xml to tmp/junit/ZTMFZEEave.xml 2023-06-05T14:42:56.2487777Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/test/f2/x/ktest/kssert/kssert_test/test.xml to tmp/junit/JW2GDANCz9.xml 2023-06-05T14:42:56.2520460Z copying /github/home/.cache/bazel/_bazel_build/9a23684a20f67a43fb0c3edb0ee63c73/execroot/edge_infra/bazel-out/k8-fastbuild/testlogs/test/framework/config/config_test/test.xml to tmp/junit/zns0Nzbeen.xml 2023-06-05T14:42:56.2534774Z done 2023-06-05T14:42:56.2614439Z ##[group]Run art "tmp/junit" 2023-06-05T14:42:56.2614761Z art "tmp/junit" 2023-06-05T14:42:56.2615073Z shell: sh -e {0} 2023-06-05T14:42:56.2615257Z env: 2023-06-05T14:42:56.2615431Z REPORT_DIR: tmp/junit 2023-06-05T14:42:56.2615628Z ##[endgroup] 2023-06-05T14:42:56.4424968Z github actions detected 2023-06-05T14:42:56.5043159Z uploading job artifacts to edge-test-jobs/actions/edge-infra/presubmit/5177987294/ci 2023-06-05T14:42:56.5043525Z uploading tmp/junit... 2023-06-05T14:43:06.1867297Z ##[group]Run delete-repo.sh 2023-06-05T14:43:06.1867717Z delete-repo.sh 2023-06-05T14:43:06.1868404Z shell: sh -e {0} 2023-06-05T14:43:06.1868598Z env: 2023-06-05T14:43:06.1868792Z REPORT_DIR: tmp/junit 2023-06-05T14:43:06.1868978Z ##[endgroup] 2023-06-05T14:43:06.2791926Z Checking if current directory is a Git repo and deleting it if so 2023-06-05T14:43:06.2792517Z .git folder exists. Cleaning up directory. 2023-06-05T14:43:06.5652250Z Stop and remove container: 882731f15bff46e4aad07a6dd98eaa0d_useast1dockerpkgdevretedgepltfinfraworkloadsbuildfractionsdev_e3bc32 2023-06-05T14:43:06.5657688Z ##[command]/usr/bin/docker rm --force db1823c375d25f16d93ab871d9daa7ffffa6986cefd2877f4c359c10fc159f0f 2023-06-05T14:43:07.4280122Z db1823c375d25f16d93ab871d9daa7ffffa6986cefd2877f4c359c10fc159f0f 2023-06-05T14:43:07.4321958Z Remove container network: github_network_670a5edc05b6408fbe88397f3db1a871 2023-06-05T14:43:07.4328056Z ##[command]/usr/bin/docker network rm github_network_670a5edc05b6408fbe88397f3db1a871 2023-06-05T14:43:08.4393651Z github_network_670a5edc05b6408fbe88397f3db1a871 2023-06-05T14:43:08.4544927Z Cleaning up orphan processes