Research Intern (Inference Infrastructure)

ByteDance logo

ByteDance

10,001+ employees · China, China · Software Development

Actively hiringPaidSummer 2027Software Development
Apply Now

Best applied by Nov 22


About the role#

The Inference Infrastructure team builds and maintains AIBrix, a Kubernetes-native control plane for large-scale LLM inference. We design and operate the platforms that power machine learning training, inference, and distributed storage across global datacenters. You will join us to build cloud-native, GPU-optimized orchestration systems that support millions of containers daily. This role involves working in a large-scale environment to help bring AI workloads from research to production.

What you'll need#

  • Currently pursuing a PhD in Computer Science or a related field, or possess 2+ years of relevant experience.
  • Ability to commit to a 12-week internship during Summer 2027.
  • Strong understanding of large model inference, distributed systems, or high-performance networking.
  • Hands-on experience building cloud or ML infrastructure, including resource management, scheduling, or request routing.
  • Solid knowledge of Docker and Kubernetes.
  • Proficiency in at least one major programming language: Go, Rust, Python, or C++.
  • Experience with large-scale cluster management systems like Kubernetes or Ray is preferred.
  • Experience with GPU orchestration, workload scheduling, or isolation in production is preferred.
  • Familiarity with GPU programming, inference engines, public cloud ML platforms, or ML systems like PyTorch and DeepSpeed is a plus.

What you'll do#

  • Design and build large-scale, container-based cluster management and orchestration systems.
  • Architect cloud-native GPU and AI accelerator infrastructure for secure and cost-efficient ML platforms.
  • Collaborate with teams to deliver inference solutions using engines such as vLLM, SGLang, and TensorRT-LLM.
  • Integrate best practices from systems research and open-source developments into production.
  • Write maintainable, testable, and scalable code for production systems.

Location & details#

  • Location: San Jose, California.
  • Modality: On-site.
  • Term: Summer 2027 (12 weeks).
  • Employment: Full-time internship.
  • Compensation: $60 per hour.
Relevant fieldsComputer Science

About ByteDance

ByteDance develops platforms for content, entertainment, and commerce. The company operates in over 30 countries and maintains a user base exceeding 2.5 billion people. Its primary focus is the creation of tools for digital interaction and media discovery. The organization employs more than 10,000 people.

LinkedInWebsiteCareers emailByteDance contact channels unlock with a free account
All ByteDance internships

How to get in at ByteDance

Applying early to ByteDance gives you a distinct advantage before the applicant pool becomes unmanageable. Intern Insider sends an instant alert the moment a role matching your target is published anywhere, so you apply among the first, and early applicants get seen before the pile grows. You can avoid the black hole of the standard application queue by connecting with the people actually managing the hiring process. Intern Insider surfaces the recruiters behind the company's roles so you can reach out directly to ask about the role or a referral, which materially improves response rates.

Get alerts for new ByteDance internships

Interns who landed roles with Intern Insider

“I didn't realize how much time I was wasting until I tried Intern Insider. Instead of scrolling for hours, I just apply directly through the platform.”
Jemma V., Private Wealth Intern

Jemma V.

Private Wealth Intern

“Finding the latest internships used to be a hassle. I'd have multiple sites and repos open at once, but with Intern Insider, everything's in one place, which has made my application process much faster and more organized.”
Kentaro B., Software Engineer Intern

Kentaro B.

Software Engineer Intern

Apply to more than this one.

10,000+ open internships in one place, with the deadlines and the people to email.

Create free account
Apply by Nov 22Apply Now
Privacy

Cookies

Manage optional cookies and similar technologies. You can update these choices anytime. Read our privacy policy

EssentialKeep you signed in and support security and basic site features.Always on
AnalyticsHelp us improve the site by measuring how people use it.
AdvertisingHelp us show relevant ads and measure how well they work.