About the role#
This internship focuses on rethinking visual perception by integrating sensing and computation. Instead of treating these as separate stages, you will explore architectures that fuse them. The goal is to design sensors that compress, select, and process data before it leaves the chip. You will work on achieving significant gains in perception efficiency by co-designing hardware and algorithms across the full pipeline.
What you'll need#
- Currently pursuing a PhD in Computer Science, Electrical Engineering, Optical Engineering, Applied Mathematics, Physics, or a related technical field.
- Strong research background in computer vision and machine learning.
- Hands-on model training experience.
- Experience with at least one of sequence modeling, language modeling, efficient neural network design, or signal processing.
- High-impact research track record demonstrated by publications in venues such as CVPR, ICCV, ECCV, NeurIPS, ICLR, or SIGGRAPH.
- Hands-on hardware prototyping experience involving cameras, structured light, or other active sensing systems.
- Familiarity with on-device or on-sensor compute, embedded ML deployment, and hardware-software co-design tradeoffs.
What you'll do#
- Design and prototype novel sensor or imaging architectures that move computation closer to the sensing front-end.
- Build and characterize imaging pipelines end-to-end, from optical and sensor physics through ISP to downstream perception models.
- Identify where bits are wasted and where intelligence should be injected in imaging pipelines.
- Use your understanding of VLM, LLM, and world models to inform what information the sensing front-end must preserve, discard, or transform.
- Close the loop between foundation model requirements and hardware design.
- Develop or adapt machine vision models co-optimized with hardware constraints such as power, bandwidth, and latency.
Location & details#
- Location: San Jose, California, United States.
- Modality: On-site.
- Employment: Full-time internship.
- Compensation: $75 per hour.
- Timing: Rolling basis for 2027 start.


