Systems Research Engineer Intern - GPU Programming (Summer 2027)
About this role
Developing and optimizing GPU-accelerated kernels and algorithms for ML and AI applications forms the core of daily responsibilities. Collaboration with the modeling and algorithm team allows for the co-design of GPU kernels and model architectures aimed at improving system performance and efficiency. Joining the hardware and software teams involves contributing to the co-design of efficient GPU architectures and programming models while utilizing expertise in parallel computing.
Researching current advancements in GPU programming techniques helps maintain the infrastructure standards of Together AI. Individuals joining this team will spend twelve to fourteen weeks working alongside experienced engineers and researchers across multiple groups. Ideal candidates possess a strong background in parallel computing and a desire to tackle complex performance challenges.
What you will do
- Optimize and fine-tune GPU code to achieve better performance and scalability.
- Collaborate with cross-functional teams to integrate GPU-accelerated solutions into existing software systems.
- Stay up-to-date with the latest advancements in GPU programming techniques and technologies.
- Co-design GPU kernels and model architectures alongside the modeling and algorithm team.
- Contribute to the development of efficient GPU architectures with hardware and software groups.
What you need
- Demonstrate a strong background in GPU programming and parallel computing, such as CUDA and Triton.
- Possess knowledge of machine learning and artificial intelligence applications and models.
- Understand performance profiling and optimization tools specific to GPU programming.
- Showcase excellent problem-solving and analytical skills.
Benefits
- Competitive compensation
- Housing stipends
- Competitive benefits
Skills and tech stack
Questions candidates ask
What are the dates for the summer internship program?
The internship program runs twelve to fourteen weeks. This cohort's internship dates span either May 17th to August 6th or June 14th to September 3rd.
What is the pay rate for this role?
The estimated US hourly rate for this role is $58 to $70 an hour. Individual compensation is determined by experience, skills, and job-related knowledge.
What skills are needed for this position?
Candidates need a strong background in GPU programming and parallel computing such as CUDA and Triton. Knowledge of ML and AI applications along with performance profiling tools is also required.