Research Scientist Intern - Multimodal Sensing & On-Device Perception

ByteDance logo

ByteDance

10,001+ employees · China, China · Software Development

Actively hiringPaidSoftware Development
Apply Now

Best applied by Nov 22


About the role#

This internship focuses on rethinking visual perception by integrating sensing and computation. Instead of treating these as separate stages, you will explore architectures that fuse them. The goal is to design sensors that compress, select, and process data before it leaves the chip. You will work on achieving significant gains in perception efficiency by co-designing hardware and algorithms across the full pipeline.

What you'll need#

  • Currently pursuing a PhD in Computer Science, Electrical Engineering, Optical Engineering, Applied Mathematics, Physics, or a related technical field.
  • Strong research background in computer vision and machine learning.
  • Hands-on model training experience.
  • Experience with at least one of sequence modeling, language modeling, efficient neural network design, or signal processing.
  • High-impact research track record demonstrated by publications in venues such as CVPR, ICCV, ECCV, NeurIPS, ICLR, or SIGGRAPH.
  • Hands-on hardware prototyping experience involving cameras, structured light, or other active sensing systems.
  • Familiarity with on-device or on-sensor compute, embedded ML deployment, and hardware-software co-design tradeoffs.

What you'll do#

  • Design and prototype novel sensor or imaging architectures that move computation closer to the sensing front-end.
  • Build and characterize imaging pipelines end-to-end, from optical and sensor physics through ISP to downstream perception models.
  • Identify where bits are wasted and where intelligence should be injected in imaging pipelines.
  • Use your understanding of VLM, LLM, and world models to inform what information the sensing front-end must preserve, discard, or transform.
  • Close the loop between foundation model requirements and hardware design.
  • Develop or adapt machine vision models co-optimized with hardware constraints such as power, bandwidth, and latency.

Location & details#

  • Location: San Jose, California, United States.
  • Modality: On-site.
  • Employment: Full-time internship.
  • Compensation: $75 per hour.
  • Timing: Rolling basis for 2027 start.

About ByteDance

ByteDance develops platforms for content, entertainment, and commerce. The company operates in over 30 countries and maintains a user base exceeding 2.5 billion people. Its primary focus is the creation of tools for digital interaction and media discovery. The organization employs more than 10,000 people.

LinkedInWebsiteCareers emailByteDance contact channels unlock with a free account
All ByteDance internships

How to get in at ByteDance

Applying early to ByteDance gives you a distinct advantage before the applicant pool becomes unmanageable. Intern Insider sends an instant alert the moment a role matching your target is published anywhere, so you apply among the first, and early applicants get seen before the pile grows. You can avoid the black hole of the standard application queue by connecting with the people actually managing the hiring process. Intern Insider surfaces the recruiters behind the company's roles so you can reach out directly to ask about the role or a referral, which materially improves response rates.

Get alerts for new ByteDance internships

Interns who landed roles with Intern Insider

“I found tons of jobs here that weren't even posted on LinkedIn. So many hidden opportunities I would have completely missed otherwise!”
Alex B., Marketing Intern

Alex B.

Marketing Intern

“Intern Insider helped me find jobs with way less applicants and I ended up getting an offer within one month of using the platform!”
Shayan A., Embedded Software Intern

Shayan A.

Embedded Software Intern

Apply to more than this one.

10,000+ open internships in one place, with the deadlines and the people to email.

Create free account
Apply by Nov 22Apply Now
Privacy

Cookies

Manage optional cookies and similar technologies. You can update these choices anytime. Read our privacy policy

EssentialKeep you signed in and support security and basic site features.Always on
AnalyticsHelp us improve the site by measuring how people use it.
AdvertisingHelp us show relevant ads and measure how well they work.