About the role#
The Inference Infrastructure team builds and maintains AIBrix, a Kubernetes-native control plane for large-scale LLM inference. We design and operate the platforms that power machine learning training, inference, and distributed storage across global datacenters. You will work in a large-scale environment to help build the next generation of cloud-native, GPU-optimized orchestration systems.
What you'll need#
- Currently pursuing a PhD in Computer Science or a related discipline, or 2+ years of relevant experience.
- Ability to commit to a 12-week internship during Summer 2027.
- Strong understanding of large model inference, distributed and parallel systems, or high-performance networking.
- Hands-on experience building cloud or ML infrastructure, including resource management, scheduling, request routing, monitoring, or orchestration.
- Solid knowledge of container and orchestration technologies.
- Proficiency in at least one major programming language: Go, Rust, Python, or C++.
- Experience with large-scale cluster management systems like Kubernetes or Ray is a plus.
- Familiarity with GPU orchestration, workload scheduling, and scaling in production environments.
- Experience with GPU programming or inference engines.
- Familiarity with public cloud providers and their ML platforms.
- Strong knowledge of ML systems and distributed training or inference platforms.
What you'll do#
- Design and build large-scale, container-based cluster management and orchestration systems.
- Architect cloud-native GPU and AI accelerator infrastructure for cost-efficient and secure ML platforms.
- Collaborate with teams to deliver inference solutions using LLM engines.
- Research advances in open source, AI/ML, and LLM infrastructure to integrate best practices into production systems.
- Write high-quality, maintainable, testable, and scalable code.
Location & details#
- Location: Seattle, Washington.
- Term: Summer 2027.
- Modality: On-site.
- Employment: Full-time internship.


