Machine Learning Engineer Intern (AML-Engine-Orchestration)

ByteDance logo

ByteDance

10,001+ employees · China, China · Software Development

Actively hiringPaidSoftware Development
Apply Now

Best applied by Nov 22


About the role#

The Data-AML-Engine Orchestration team builds large-scale machine learning infrastructure. These systems power online model serving across products like TikTok. You will develop the orchestration, scheduling, and resource management systems that connect heterogeneous compute infrastructure with production machine learning workloads. Your work will directly affect GPU utilization, serving latency, infrastructure reliability, and engineer productivity.

What you'll need#

  • Currently pursuing a Bachelor's or Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field.
  • Proficiency in at least one of Go, C++, or Python.
  • Solid foundation in data structures, algorithms, and software engineering principles.
  • Familiarity with Linux and a foundational understanding of operating systems, computer networks, concurrent programming, and distributed systems.
  • Strong hands-on and exploratory abilities, with a willingness to investigate systems through source code, metrics, logs, profiling, and experiments.
  • A systematic and quantitative approach to problem solving, with the ability to define measurements, test hypotheses, and validate system improvements.
  • Demonstrated ownership and collaboration through coursework, research, internships, open-source contributions, or other engineering projects.
  • Experience with Kubernetes, container runtimes, resource scheduling, quota management, multi-tenant systems, or FinOps.
  • Contributions to open-source infrastructure projects such as Kubernetes, Volcano, Koordinator, or OpenKruise.
  • Experience with model serving systems such as vLLM, SGLang, Triton, KServe, or Ray Serve, or an understanding of KV Cache, Continuous Batching, Prefill/Decode disaggregation, or model parallelism.
  • Experience with online services, gateways, traffic management, autoscaling, performance optimization, or highly available distributed systems.
  • Experience with GPU/NPU programming, heterogeneous resource scheduling, model distribution, or inference performance analysis.

What you'll do#

  • Design and build foundational orchestration capabilities for machine learning platforms, including Kubernetes Operators, container runtimes, and lifecycle management for jobs, services, and stateful workloads.
  • Build multi-tenant resource and quota systems that support priorities, preemption, fair sharing, elasticity, and cross-cluster scheduling.
  • Improve GPU utilization and cost efficiency through resource pooling and FinOps.
  • Build lifecycle orchestration for online model serving, including model and image distribution, deployment, upgrades, rollback, autoscaling, multi-cluster operation, and disaster recovery.
  • Build serving orchestration and traffic management capabilities for disaggregated serving clusters, including topology-aware scheduling, KV Cache affinity, intelligent request routing, and QoS/SLA management.

Location & details#

  • Location: San Jose, California
  • Modality: On-site
  • Employment: Full-time internship
  • Compensation: $45 per hour
  • Hiring process: Rolling basis
Relevant fieldsComputer Science

About ByteDance

ByteDance develops platforms for content, entertainment, and commerce. The company operates in over 30 countries and maintains a user base exceeding 2.5 billion people. Its primary focus is the creation of tools for digital interaction and media discovery. The organization employs more than 10,000 people.

LinkedInWebsiteCareers emailByteDance contact channels unlock with a free account
All ByteDance internships

How to get in at ByteDance

Applying early to ByteDance gives you a distinct advantage before the applicant pool becomes unmanageable. Intern Insider sends an instant alert the moment a role matching your target is published anywhere, so you apply among the first, and early applicants get seen before the pile grows. You can avoid the black hole of the standard application queue by connecting with the people actually managing the hiring process. Intern Insider surfaces the recruiters behind the company's roles so you can reach out directly to ask about the role or a referral, which materially improves response rates.

Get alerts for new ByteDance internships

Interns who landed roles with Intern Insider

“Finding the latest internships used to be a hassle. I'd have multiple sites and repos open at once, but with Intern Insider, everything's in one place, which has made my application process much faster and more organized.”
Kentaro B., Software Engineer Intern

Kentaro B.

Software Engineer Intern

“I saved so much time by not having to scroll through LinkedIn, Indeed, and all the other job boards. Everything I need is in one place.”
Pasha R., Business Strategy Intern

Pasha R.

Business Strategy Intern

Apply to more than this one.

10,000+ open internships in one place, with the deadlines and the people to email.

Create free account
Apply by Nov 22Apply Now
Privacy

Cookies

Manage optional cookies and similar technologies. You can update these choices anytime. Read our privacy policy

EssentialKeep you signed in and support security and basic site features.Always on
AnalyticsHelp us improve the site by measuring how people use it.
AdvertisingHelp us show relevant ads and measure how well they work.