Questions tagged [google-kubernetes-engine]
Google Kubernetes Engine is a cluster manager and orchestrator for running Docker containers. It schedules your containers into the cluster and manages them automatically based on requirements you define (such as CPU and memory). It's built on the open source Kubernetes system, giving you the flexibility to take advantage of on-premises, hybrid, or public cloud infrastructure. It was formerly called Google Container Engine.
570 questions
0 votes
1 answer
115 views
Traffic of NODES from GKE public cluster not masqueraded
I configure ip-masq-agent in my public GKE cluster. All pods sends traffic to Internet via cloudNAT router, it's OK. I need nodes traffic to Internet via cloudNAT router, but it's not working, traffic ...
0 votes
0 answers
61 views
Is it possible to restrict Custom Calico DaemonSet deployment to a single node pool in GKE (Dataplane V1)
I’m running a large Google Kubernetes Engine GKE cluster (Dataplane V1, 100+ nodes, ~800 services over 3 node pools). For better security for critical service, I need to strictly isolate a single ...
2 votes
0 answers
828 views
Access issue to the GKE nodes that have 'Read Only Local SSD Detected' warnings
I noticed for some nodes 'Read Only Local SSD Detected' warnings: # kubectl get events --field-selector reason=ReadOnlyLocalSSDDetected -o wide LAST SEEN TYPE REASON OBJECT ...
0 votes
0 answers
86 views
Google Kubernetes Engine, prometheus-metrics-collector fails to start on nodes Windows Server 2022 LTSC
I have in GKE a nodepool with a node based on the below configuration: --image-type "WINDOWS_LTSC_CONTAINERD" --windows-os-version=ltsc2022 The node is created and started, and one pod is ...
1 vote
0 answers
48 views
Kubernetes engine error with apiVersion and kind
I'm getting an error This apiVersion and/or kind does not reference a schema known by Cloud Code. Please ensure you are using a valid apiVersion and kind. on both manifest.yaml and nordered-service....
0 votes
1 answer
90 views
GKE NodePort Service not exposing on Node's IP Address with Service Port
Asking for help? Comment out what you need so we can get more information to help you! Cluster information: Kubernetes version: Cloud being used: GKE Installation method: N/A Host OS: N/A CNI and ...
1 vote
0 answers
37 views
Kubernetes Cluster on azure cloud with OS redhat 8.4 with kubeadm v1.30.8 - coredns and calico nodes are stuck in unknown state
We have migrated kubernetes VMs from AWS to Azure,and after the migration we are seeing calico and coredns pods are in unknow state. Could someone please post your suggestions. [root@master01 net.d]# ...
0 votes
1 answer
158 views
Wikijs - Ingress "All backend services are in UNHEALTHY state"
Problem: I'm running Wiki.js on a GKE zonal cluster and encountering an issue with my Ingress configuration. The Ingress controller returns "All backend services are in UNHEALTHY state" and ...
0 votes
1 answer
642 views
WikiJS "EACCES: permission denied, mkdir '/wiki/data/cache'" despite volume mount
Problem: I'm running WikiJS on Kubernetes (GKE) and encountering permission issues. The application can't create the cache directory, throwing: "EACCES: permission denied, mkdir '/wiki/data/cache'...
0 votes
0 answers
48 views
Sync NodeJS program inside kubernetes cluster hangs (while idle)
I been deploying a NodeJs server to GKE without problems for some time. The app is a simple node server The docker final command just invokes the start script: CMD ["node", "scripts/...
0 votes
0 answers
79 views
GCP GKE version mismatch between nodepool and nodes
I've an issue where the nodepool version on my gke cluster shows the same version as my control plane version but the nodes inside the nodepool are on an much older version , infact, they haven't been ...
0 votes
1 answer
63 views
how does gclb learns where istio ingress gateway is located , which node
I was going through how traffic flows from interent to application when working with istio , in that they used gclb as loadbalancer , I wanted to know how gclb knows which node or in general any ...
0 votes
0 answers
71 views
Google Cloud GKE dashboard cluttered with deployment patch events from Strimzi Kafka operator - how to get rid of this?
I'm using the Strimzi Kafka operator in my k8s cluster. It's working fine and Kafka is up and running. But the operator reconciliation is triggering a change in the deployment every two minutes, which,...
1 vote
0 answers
231 views
File System Certificate Issues with Hashicorp Consul Connect Injector
I have my Consul Server deployed as a K8S StatefulSet. I get the following error in one of the replicas: 2024-08-14T15:04:03.126Z [ERROR] agent.http: Request error: method=GET url=/v1/config/file-...
0 votes
1 answer
303 views
Mysterious IP address using up quota in GCP
I only have three external IP addresses: Two of these are from my K8s cluster and the first one is from a compute engine VM. However, I can't create the third node in my cluster because my quota of ...
1 vote
0 answers
99 views
How to solve 502 bad gateway in GKE cluster
I'm getting below error in GKE logging cluster on PROD ENV I have 2 GKE cluster running in GCP Im using GCE Ingress and google managed certificate Dev Env Cluster Prod Env Cluster 1 service is ...
1 vote
0 answers
136 views
What are my groups in kubernetes (GKE) on GCP?
The answer is supposedly easy: $ kubectl auth whoami But it says that I belong only to system:authenticated. That's not pretty informative, and I believe I must belong to system:masters. Why? Because ...
0 votes
1 answer
766 views
Google Cloud Composer 2 Environment won't become healthy
I am trying to create a Google Cloud Composer 2 environment in my project, but it fails to become healthy. I am creating it with the default settings and a service account that has the Cloud Composer ...
0 votes
1 answer
572 views
What should be the NodeClassRef for Karpenter's NodePool in GKE?
I have created a GKE cluster in GCP and wanted to install Karpenter on it for the autoscaling. While trying to install Karpenter, pods gives the error asking to create the NodeClaim resource which ...
0 votes
1 answer
2k views
Ansible "Failed to create temporary directory" (GCP)
I've encountered an issue with my Ansible playbook that provisions both a Kubernetes cluster and other servers within our cloud infrastructure. Specifically, the problem arises when I configure the &...
0 votes
1 answer
296 views
How to find what caused an AUTO_REPAIR_NODES event in GKE
We've had a whole bunch of AUTO_REPAIR_NODES events suddenly occur on a previously stable GKE cluster, and can't figure out why. We found this page: https://cloud.google.com/kubernetes-engine/docs/how-...
0 votes
1 answer
291 views
How to remove an unhealthy node in Google Kubernetes Engine Autopilot?
My Kubernetes cluster running on GKE autopilot has an unhealthy node. The node has a Ready status, but all the pods running on it have a CreateContainerError status and seems to be stuck polling ...
0 votes
1 answer
535 views
GKE Autopilot - consume reservation
I had some issues creating GKE deployment with nvidia t4 GPU (Node scale up in zones europe-west1-b associated with this pod failed: GCE out of resources. Pod is at risk of not being scheduled.) so I ...
2 votes
1 answer
523 views
How to use a reserved external IP address from Shared VPC host project in a service project's GKE LoadBalancer service
I've found two references (here and here) in the GCP docs saying that I may reserve an IPv4 address in the host project and use it in the service project: A regional external IP address must be ...
0 votes
1 answer
947 views
Kubernetes API returns 403 Forbidden from inside a pod with seemingly correct ClusterRole bound to pod Service Account
I have a Python script that runs inside a k8s pod (Google Kubernetes Engine 1.25) and queries K8S API to create VaultStaticSecret's resources. I'll paste Helm Chart templates for brevity: apiVersion: ...
0 votes
1 answer
1k views
All cluster resources were brought up, but: 1 nodes out of 1 are unhealthy
Unable to create a gke autopilot cluster using shared vpc . The same shared vpc works fine with standard private cluster . Repeated this multiple times with the same error. Followed google ...
0 votes
0 answers
190 views
Google Cloud Kubernetes reservations
Recently our GKE environment was suspended. When the account was re-activated Kubernetes was not working because only 1 of 3 servers were available. Two zones reported ZONE_RESOURCE_POOL_EXHAUSTED for ...
0 votes
1 answer
225 views
GCP Workload Identity works for some workload, not for others even if K8s service account is the same
We deploy our microservices in two distinct GKE clusters, one for testing, other for production. Our workloads make use of workload identity. In "test environment" all works well, all ...
0 votes
1 answer
189 views
Is a GKE Ingress sufficient as a proxy for gunicorn?
I am running a Python application behind Gunicorn in a container in GKE (Google Kubernetes Engine). The application sits behind a GKE Ingress, i.e., an HTTP(S) Load Balancer. The Gunicorn ...
0 votes
1 answer
630 views
How do I filter the command gcloud container operations list? What's the syntax?
If you have 20 GKE clusters, gcloud container operations list returns too much data. Google Cloud's official docs lack good examples of how to do filtering: Their docs just mention --filter=[...
0 votes
0 answers
55 views
Possible to deploy service to GKE Autopilot cluster without YAML?
Is it possible to deploy to GKE Autopilot cluster without YAML and just command line? I have inherited a project where deployment generates command line to deploy to CloudRun. I am in the process of ...
1 vote
1 answer
377 views
gke autopilot cluster creation failure
I am trying to create GKE Autopilot cluster and the creation fails. I see just this error. "All cluster resources were brought up, but: 1 nodes out of 1 are unhealthy". Not sure if there are ...
1 vote
1 answer
923 views
What CNI is used (and what are the alternatives) in GKE?
I'm confused with Google Cloud's documentation on GKE. In the Compare network models doc, it says GKE has a fully integrated networking model which suggests to me it has its own CNI implementation. ...
1 vote
0 answers
304 views
HEALTH CHECK not resolving for ClamAV hosted in GKE cluster
Couldn't resolve health check related issue for the clamAV:1.2 deployment hosted in the GKE cluster in the port 3310, 7357. Facing some backend services are in UNHEALTHY state, in the ingress after ...
-2 votes
1 answer
169 views
Set up minikube installation with gke
I just want to set up minikube on kubernetes While installing facing an error Minikube start--kubernetes-version=vm-driver="hyperv'--hyperv-virtual-switch=minikube I want to resolve above error ...
2 votes
1 answer
3k views
What would lead to a "Cancelling deletion of pod" message?
I see these messages in my GKE logs several times a day... Cancelling deletion of Pod <pod-namespace>/<pod name> It looks like they are happening due to the taint-controller with a ...
0 votes
0 answers
471 views
Kubernetes outages potentially being caused by kube-dns
We've got a production kubernetes cluster that has been having a bunch of ~1-5 minute outages on a semi-regular basis. We're trying to troubleshoot, but running into various gaps of information/...
0 votes
1 answer
101 views
GCP Automatic Instance Template replacement issue in Compute Engine
I'm using Google Kubernetes Engine where my cluster's node pool is connected to Compute Engine instances defined by instance templates. I'm controlling these instance templates by Managed Instance ...
0 votes
1 answer
662 views
Getting error while secrets for gke ingress
Using gke cluster but ingress is not loading a load Balancer error:error syncing to gcp: error running load balancer syncing routine secret does not exist I want to know the reason why iam getting ...
1 vote
0 answers
305 views
Google Cloud Load Balancer URL limit?
I've been in a process of migrating our application to use Gateway (gke-l7-global-external-managed). Part of deployment are the 'review' applications, e.g. apiVersion: gateway.networking.k8s.io/...
0 votes
0 answers
132 views
GKE Arm-based cluster starts in invalid state
After I install a new GKE cluster on Arm-based VM it immediately starts in a failing state. Specifically antrea-controller-horizontal-autoscaler cannot be run as it has no toleration for Arm-based ...
2 votes
1 answer
3k views
Error:unable to upgrade connection:Authorization error (user=kube apiserver, verb=create, resource=nodes, sub resource=proxy)
I have set up my cluster with my app but now I'm facing issue in my gke cluster Error:unable to upgrade connection:Authorization error (user=kube apiserver, verb=create, resource=nodes, sub resource=...
1 vote
1 answer
650 views
Kubernetes cluster with certificate authority
Certificate error after upgrade of kubernetes Error is SSL certificate problem:unable to get local issuer certificate After doing multiple modifications Now I'm getting above error.
1 vote
1 answer
2k views
How to find the maximum number of nodes in a GCP Kubernetes cluster?
In a GCP Kubernetes cluster is there a command to find out the maximum number of nodes? I have a Kubernetes cluster and need to identify if I can fit my pods to the nodes since there is a taint ...
0 votes
0 answers
151 views
Will I be charged for GKE Autopilot if I didn't run anything?
If I have installed Google kubernetes autopilot cluster and didn't install anything on it, will I be charged? Here https://cloud.google.com/kubernetes-engine/docs/concepts/autopilot-overview is a ...
0 votes
1 answer
2k views
How to fix HPA deprecation warning on GKE?
Observed output kubectl describe hpa Warning: autoscaling/v2beta2 HorizontalPodAutoscaler is deprecated in v1.23+, unavailable in v1.26+; use autoscaling/v2 HorizontalPodAutoscaler Attempted fix ...
1 vote
1 answer
344 views
Can't rebuild deployment with PersistentVolumeClaim
I want to create a MongoDB deployment with a PersistentVolumeClaim. apiVersion: v1 kind: PersistentVolumeClaim metadata: name: auth-mongo-pvc spec: accessModes: - ReadWriteOnce resources: ...
0 votes
0 answers
90 views
How to manage utility pods on GKE autopilot?
My company is going to migrate to GCP, and I found some issues with how we want to manage our infrastructure and projects. Our stack is mainly based on Kubernetes, right now we have 2 clusters: ...
1 vote
0 answers
38 views
Strange behavior of GCP Load Balancer
I had a strange behavior with google global lb. On the one zone traffic evenly , but on other zone with same load traffic loads pods not evenly. Configs at zones are the same. Can it appears to gcp ...
1 vote
0 answers
3k views
Is it possible to have multiple ingress paths under the same host that point to the same backend service
I'm trying to restrict access to certain paths on my service how can I accomplish this on kubernetes? I have a service that runs a basic API but it also runs an admin service. Is it possible to use ...