AI Infrastructure
Kubernetes, Terraform, and GPUs — the substrate every AI system eventually lands on.
Who this is for
Infrastructure and cloud engineers provisioning the platform underneath the models.
What you should be able to do
Stand up reproducible, cost-bounded infrastructure for AI workloads across clouds.
The delivery flow
The order the work actually happens in. Each step is where a decision gets made and written down, not a chapter heading.
- Landing zone
- Network + egress
- Identity + secrets
- Cluster / compute
- GPU scheduling
- IaC modules
- Cost guardrails
- DR + backup
Reference repository structure
A starting layout that keeps agents, infrastructure, and security policy as first-class directories rather than folders someone adds late.
project/ ├── apps/ # web, api, admin surfaces ├── agents/ # planner, researcher, reviewer, orchestrator ├── infrastructure/ # terraform, kubernetes, helm, docker ├── security/ # policies, threat models, IAM scopes ├── monitoring/ # dashboards, alerts, SLOs ├── pipelines/ # CI/CD and evaluation gates ├── tests/ └── docs/
Reading path
12 published guides on this track. Every one is a live page on this site — nothing here is a placeholder.
- Docker vs Kubernetes: What Cloud Engineers Need to Know
- Docker vs Kubernetes: When to Use Each (With Real Examples) [2026]
- Terraform for Beginners 2026: Infrastructure as Code in 30 Minutes
- Terraform for Beginners: Your First Infrastructure as Code Project in 2026
- Terraform vs CloudFormation vs Pulumi: Infrastructure as Code Comparison for 2026
- Kubernetes for Beginners 2026: A Plain-English Guide to Container Orchestration
- Kubernetes for Beginners: Complete Guide to Container Orchestration
- Terraform Guide — IaC Best Practices [2026]
- Terraform vs CloudFormation vs Pulumi: IaC Compared [2026]
- Terraform vs CloudFormation vs Pulumi: IaC for 2026
- Terraform vs Pulumi vs CDK: Which IaC Tool for 2026?
- 5 Kubernetes Cost Optimization Strategies That Save $50K/Year
Reference implementations
Citadel’s open-source repositories for this track — Terraform modules, MCP servers, and reference architectures you can read, fork, and run. Apache/MIT licensed; check each repository for its terms.
- GitHubterraform-aws-eksProduction-grade AWS EKS Terraform module with managed node groups, Fargate profiles, IRSA, cluster add-ons, and EKS access APIterraform-aws-eks on github.com (external site, opens in a new tab)
- GitHubterraform-azure-aksProduction Azure AKS Terraform module with workload identity, Azure CNI Overlay, Defender, and GitOpsterraform-azure-aks on github.com (external site, opens in a new tab)
- GitHubterraform-gcp-gkeProduction GKE Terraform module with Autopilot, Standard, Workload Identity, and Binary Authorizationterraform-gcp-gke on github.com (external site, opens in a new tab)
- GitHubterraform-aws-vpc-completeProduction-grade AWS VPC Terraform module with multi-tier subnets, NAT Gateways, Flow Logs, VPC Endpoints, IPv6, IPAM, and VPC Peeringterraform-aws-vpc-complete on github.com (external site, opens in a new tab)
- GitHubmulti-cloud-landing-zoneMulti-cloud landing zone architecture for AWS, Azure, and GCP with identity federationmulti-cloud-landing-zone on github.com (external site, opens in a new tab)
- GitHubai-finops-optimization-agentMulti-cloud FinOps optimization agent — cost anomaly detection, rightsizing recommendations, waste eliminationai-finops-optimization-agent on github.com (external site, opens in a new tab)
- GitHubterraform-aws-auto-healing-eksSelf-healing EKS cluster with Karpenter autoscaling, node health monitoring, and automatic remediationterraform-aws-auto-healing-eks on github.com (external site, opens in a new tab)
Primary sources
The standards, framework documents, and vendor references this track is built against. Go here when you need the authoritative wording rather than a summary — in a security review or an audit, the source is what counts.
- Kubernetes documentation (external site, opens in a new tab)
- Terraform Registry (external site, opens in a new tab)
- FinOps Foundation Framework (external site, opens in a new tab)
- NVIDIA GPU Operator (external site, opens in a new tab)
- Helm documentation (external site, opens in a new tab)
- AWS EKS Best Practices Guide (external site, opens in a new tab)