About the role#
Together AI builds the inference platform for generative AI models. This role bridges the gap between research and real-world application. You will focus on translating model training research into production-ready deployments. Your work involves data-centric development, hyperparameter tuning, and checkpoint evaluation. You will work with dedicated GPU clusters to create efficient, specialized models for our customers.
What you'll do#
- Research and prototype new speculator algorithms. You will experiment with architectural ideas and data curation to improve accuracy and efficiency in speculative decoding.
- Own a project from start to finish. This includes data preparation, training, and evaluation, with a clear path to production.
- Learn how inference systems work by working with our core inference and Applied ML research teams.
- Collaborate with customers to understand their specific needs and integrate your work into our production platform.
- Present your results to the team at the end of your internship and influence the direction of our speculator work.
What you'll need#
- Currently pursuing a degree in Computer Science, Electrical Engineering, Information Science, or a related field.
- A genuine interest in data curation and processing with strong attention to detail.
- Ability to perform hyperparameter searches and understand the trade-offs when tuning models.
- Experience evaluating model checkpoints for quality, performance, and reliability.
- Proficiency in Python and PyTorch.
- Familiarity with SLURM or Kubernetes clusters and managing jobs in high-performance computing environments.
- Knowledge of modern LLMs and generative models.
- Basic understanding of distributed training frameworks like FSDP or DeepSpeed.
- Publications at research conferences or journals such as NeurIPS, ICML, ICLR, ACL, EMNLP, or Interspeech.
Location & details#
- Location: San Francisco, California.
- Term: Summer 2027 (May 17 to August 6 or June 14 to September 3).
- Modality: On-site.
- This is a full-time, paid internship.
About Together AI
Together AI operates a cloud platform for AI engineers and researchers. The company provides tools for inference, model shaping, and pre-training. Founded in 2022, it maintains its headquarters in San Francisco, California. The organization employs 415 people and serves clients ranging from AI startups to SaaS companies.
How to get in at Together AI
Securing an internship at Together AI requires speed, as early applicants are often reviewed before the candidate pool becomes unmanageable. Intern Insider sends an instant alert the moment a role matching your target is published anywhere, ensuring you apply among the first. This helps you avoid the frustration of submitting an application to a queue that has already grown too large to navigate. You can use this timing to your advantage to stay ahead of the competition. Beyond timing, reaching out to the right person often yields better results than a standard submission. Intern Insider surfaces the recruiters behind the roles at Together AI so you can contact them directly to ask about the position or a referral. This approach materially improves your response rates compared to waiting for an automated update. It is a more direct way to show your interest to the people actually managing the hiring process.
