Intern, Architecture Research Engineer (MoE Placement for Serving at Scale)

Samsung Semiconductor logo

Samsung Semiconductor

10,001+ employees · San Jose, California, United States · Semiconductor Manufacturing

Actively hiringPaidSemiconductor Manufacturing
Apply Now

Best applied by Nov 21


About the role#

As an Architecture Research Engineer Intern within the AGI Computing Lab, you will focus on the design challenges of serving Mixture-of-Experts (MoE) models at scale. You will work on distributed accelerators to improve performance and memory efficiency for future AI workloads.

What you'll need#

  • Currently pursuing a master's or PhD in Computer Science or Electrical Engineering.
  • At least one academic quarter or semester remaining in your program.
  • Research experience in distributed ML systems or AI hardware like GPUs, TPUs, or NPUs.
  • Experience developing performance models or simulators for large-scale ML systems.
  • Understanding of system-level characteristics related to MoE inference and expert parallelism.
  • Familiarity with PyTorch or JAX and LLM serving frameworks such as vLLM, SGLang, or TensorRT-LLM.
  • Strong analytical, problem-solving, and communication skills.
  • Ability to work both independently and as part of a team.
  • Published papers in Microarchitecture, Systems, or ML Systems conferences are preferred.
  • Background in optimization methods, such as graph partitioning or integer linear programming, is a plus.

What you'll do#

  • Research expert placement, replication, and migration strategies for MoE models.
  • Co-optimize expert placement with memory hierarchy, interconnect topology, and parallelism strategies.
  • Analyze expert load imbalance, temporal drift, and cross-layer affinity using real-world workloads.
  • Extend analytical simulators and design-space exploration tools to evaluate hardware design points.
  • Collaborate with compiler and runtime teams to integrate placement-aware scheduling.
  • Contribute to ML systems and architecture research, including writing research papers.
  • Monitor advancements in LLM serving and ML architectures.

Location & details#

  • This role is based in San Jose, California.
  • The position requires daily on-site presence.
  • This is a full-time, paid internship.

About Samsung Semiconductor

Samsung Semiconductor operates as a subsidiary of Samsung Electronics. The company manufactures semiconductor components for device makers. It started operations in 1974. The organization employs more than 10,000 people.

LinkedInWebsiteCareers emailSamsung Semiconductor contact channels unlock with a free account
All Samsung Semiconductor internships

How to get in at Samsung Semiconductor

Applying to Samsung Semiconductor early matters because recruiters review applications as they arrive. Intern Insider sends an instant alert the moment a role matching your target is published anywhere, so you apply among the first, early applicants get seen before the pile grows. You should aim to be in the first wave of candidates to ensure your resume reaches a human reader. Reaching out to the right person often helps you stand out from the general applicant pool. Intern Insider surfaces the recruiters behind the company's roles so you can reach out directly to ask about the role or a referral, which materially improves response rates. A brief, professional message to a recruiter can clarify your interest and help you learn more about the team.

Get alerts for new Samsung Semiconductor internships

Interns who landed roles with Intern Insider

“I went from juggling multiple tabs to having everything I needed on one platform. The convenience is unmatched and worth every penny.”
Setare M., System Integration Intern

Setare M.

System Integration Intern

“Getting my first internship was the hardest. Intern Insider's exclusive job board and AI resume builder really helped me.”
Richard Y., Finance Student

Richard Y.

Finance Student

Apply to more than this one.

10,000+ open internships in one place, with the deadlines and the people to email.

Create free account
Apply by Nov 21Apply Now
Privacy

Cookies

Manage optional cookies and similar technologies. You can update these choices anytime. Read our privacy policy

EssentialKeep you signed in and support security and basic site features.Always on
AnalyticsHelp us improve the site by measuring how people use it.
AdvertisingHelp us show relevant ads and measure how well they work.