Site Reliability Engineer, AI Infrastructure (Starshield)
About this role
The Starshield team at SpaceX designs, builds, tests, and operates the largest US government satellite constellation, providing immediate access to critical intelligence and national security data globally. Engineers in this group handle the software and GPU infrastructure that supports these national security missions, deploying solutions for massive AI clusters and managing on-premise compute resources.
Daily responsibilities include managing GPU and CPU infrastructure deployments within Top Secret data centers, building automation for Kubernetes and operating systems, and supporting GPU as a service for external customers. Practitioners collaborate closely with AI engineers to maintain scalable products while improving the entire service lifecycle from design to deployment.
Candidates applying for this position should possess a background in site reliability engineering or DevOps, along with practical skills in Linux, containerization, and automation tools. Successful team members thrive in hands-on infrastructure environments and adapt to the rigorous demands of national security missions.
What you will do
- Manage GPU and CPU infrastructure deployments to Top Secret data centers.
- Provide support and management for GPU as a service for external customers on bare metal hardware and virtualized platforms.
- Design, validate, and productize solutions for AI clusters at a scale of 100k plus GPUs.
- Develop automation to deploy and manage on-premise Kubernetes and AI clusters, as well as operating systems.
- Deploy and manage core infrastructure components such as databases, monitoring tools, and distributed storage.
- Collaborate closely with AI engineers to create highly scalable, operable, and maintainable products.
- Engage in and improve the full lifecycle of services from inception and design through deployment, operation, and refinement.
- Monitor and alert supporting systems to ensure high availability and identify areas for system improvement.
What you need
- Hold a bachelor’s degree in computer science, information systems, IT, or an engineering discipline alongside professional experience in site reliability engineering or DevOps, or equivalent professional experience in lieu of a degree.
- Demonstrate professional experience working with Linux operating systems.
- Bring experience using infrastructure tools such as Terraform or Ansible.
- Show hands-on experience with containerization technologies including OCI containers and Kubernetes.
- Demonstrate scripting capabilities in languages such as Bash or Python.
- Have development experience utilizing Python, C++, or Go.
Nice to have
- 1+ years of experience with Python and Python-based development frameworks
- Experience managing Kubernetes clusters beyond basic usage
- Deep understanding of testing, continuous integration, build, deployment, and continuous monitoring
- Strong networking knowledge of TCP/IP
- Active Top Secret, Top Secret SCI, or DOE Level Q clearance
Benefits
- Company stock or long-term cash awards and potential discretionary bonuses
- Employee Stock Purchase Plan for discounted stock purchases
- Comprehensive medical, vision, and dental coverage
- 401(k) retirement plan access
- Short and long-term disability insurance, life insurance, and paid parental leave
- 3 weeks of paid vacation and 10 or more paid holidays per year
Skills and tech stack
Questions candidates ask
What is the salary range for this position?
Level 1 base salaries range from $125,000.00 to $160,000.00, while Level 2 ranges from $145,000.00 to $195,000.00. Your actual level and base salary are determined on a case-by-case basis based on job-related knowledge, skills, education, and experience.
What are the additional requirements regarding working hours and travel?
Candidates must be willing to work extended hours and weekends as needed. You must also be willing to travel domestically and globally in the future when required.
Is a security clearance required for employment?
This position requires successfully obtaining and maintaining a Top Secret Security Clearance as a condition of employment. While the clearance may not be immediately necessary upon hire, applicants are encouraged to initiate the application process promptly.
Are there citizenship restrictions for applicants?
To conform to U.S. Government export regulations, applicants must be a U.S. citizen or national, a U.S. lawful permanent resident, a refugee, an asylee, or eligible to obtain the required authorizations from the U.S. Department of State.