About the role#
As an intern on the Applied Machine Learning Ark team, you will contribute to the development and operation of Large Language Model service platforms. You will work on full-stack solutions that include model training, inference frameworks, and intelligent agent systems. This role focuses on the data-driven feedback loops that inform model improvements and system optimizations.
What you'll need#
- Current enrollment in a Bachelor's degree program in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
- A solid foundation in machine learning and deep learning.
- Practical experience with LLM-based systems such as agents, tool calling, retrieval, or multi-agent systems.
- Strong Python skills and experience with a mainstream ML or agent evaluation framework.
- Demonstrated ability in research or engineering through internships, open-source work, publications, or substantial projects.
- Preferred: Publications at top-tier ML/NLP venues, particularly in agent learning or evaluation.
- Preferred: Experience with metric design, model-based judging, annotation, statistical analysis, or feedback-driven optimization loops.
- Preferred: Familiarity with LLM post-training, reasoning and planning methods, continual learning, or large-scale log and trace analysis.
What you'll do#
- Design evaluation systems for LLM-based agents, focusing on task success, tool use, reasoning quality, and reliability.
- Create benchmarks and automated judging pipelines that integrate rule-based checks, model-based judging, and human review.
- Examine agent execution traces and user feedback to find failure patterns and translate them into system improvements.
- Collaborate with research, platform, and product teams to move methods into production and support the closed loop from experience to capability.
Location & details#
- Location: Seattle, Washington, United States
- Term: Summer 2027
- Work Modality: On-site
- Position Type: Full-time intern
- Compensation: $42.75 per hour


