About the role#
As an AI & Data Science Intern, you will join the Northeast DevSecOps team to support our agentic AI harnesses. You will work alongside experienced engineers to improve system reliability, prevent output drift, and manage performance regressions. This role involves hands-on work with live AI systems used across the organization. You will also participate in limited client-facing engagements under mentorship to observe how AI capabilities are demonstrated in professional services.
What you'll do#
- Define and implement evaluation frameworks to measure the accuracy, reliability, and consistency of agentic AI harnesses.
- Design and run structured evaluations to detect regressions, output drift, and behavioral degradation.
- Build and maintain benchmark datasets and ground-truth corpora.
- Analyze results and collaborate with the AI and AppSec teams to drive iterative improvements.
- Research and apply prompt evaluation techniques and LLM benchmarking methodologies.
- Instrument harnesses with telemetry to capture latency, token usage, error rates, and output quality.
- Analyze telemetry data to identify patterns and surface anomalies.
- Support model and prompt tuning efforts while documenting changes and measuring their impact.
- Contribute to building an internal AI governance pipeline and maintain an audit trail for harness behavior.
- Document governance processes, methodologies, and tuning decisions in a version-controlled format.
What you'll need#
- Currently enrolled or recently graduated with a degree or substantial coursework in data science, statistics, computer science, engineering, or a related field.
- Proficiency or strong interest in Python.
- Exposure to data manipulation libraries like pandas and numpy or LLM APIs.
- Genuine curiosity about large language models, agentic systems, and how AI performs in applied contexts.
- Strong analytical and written communication skills with the ability to translate data findings into clear observations.
- Technical aptitude and comfort working with ambiguity.
Location & details#
- This is a remote, part-time, paid internship at $20 per hour.
- The term is 12 weeks with an expected commitment of 25-29 hours per week, Monday through Friday.
- You must be physically located within the United States for the duration of the internship.
- This position is not available for candidates residing in Alaska, California, Hawaii, New Mexico, New York, Oregon, Washington, or Wyoming.
- Candidates located in the Eastern or Central time zones are preferred.
- You must have a personal computing device and access to high-speed internet during working hours.
About GuidePoint Security
GuidePoint Security is an IT services and consulting firm focused on cybersecurity. Founded in 2011 and based in Reston, Virginia, the company employs over 1,300 people. It provides expertise and solutions to help organizations assess risk and manage their security posture. The firm serves a client base that includes government agencies and large corporations.
How to get in at GuidePoint Security
Applying to GuidePoint Security early is a significant advantage because recruiters review applications in the order they arrive. Intern Insider sends an instant alert the moment a role matching your target is published, which helps you apply among the first before the pile grows. It is a simple way to stay ahead of the competition. You can also reach out to recruiters directly to ask about the role or a referral, which often improves your response rate. Intern Insider surfaces the specific recruiters behind the company's roles so you can make that connection. Reaching out personally shows you have done your homework, and it is a better strategy than waiting for a response from a general portal.
