Senior Software Engineer - Model Platform
About this role
Engineers who possess a first-principles approach and an ownership-oriented outlook will thrive in this environment. The Detection Team at Abnormal builds technology to identify and stop email and cloud-based attacks that were previously undetectable.
As a Senior Software Engineer on the Signals and Serving Team, you will design and maintain model serving infrastructure to make feature development fast, responsive, and stable for machine learning and data science teams. You will scale data processing services, build platforms to combat rapidly generated AI attacks, and manage real-time streaming pipelines.
This role exists to support the broader machine learning infrastructure at Abnormal, empowering data scientists and machine learning engineers to iterate quickly. The ideal candidate brings a drive for solving pragmatic, real-world problems autonomously and collaboratively.
What you will do
- Architect, design, build, deploy, and maintain model serving infrastructure supporting the detection engine.
- Own projects that scale model serving and data processing services to handle ten times current traffic levels.
- Build platforms to fight against rapidly generated artificial intelligence attacks and secure cloud environments.
- Manage real-time and near real-time streaming pipelines along with online feature serving services.
- Construct the machine learning training platform to improve machine learning engineer velocity and product accuracy.
- Collaborate closely with machine learning and data science teams by translating feedback into technical execution.
- Coach and mentor junior engineers through one-on-ones, pair programming, and rigorous code and design reviews.
What you need
- Bring five or more years of experience as a software engineer or in a similar role with a focus on machine learning engineering.
- Maintain large-scale distributed systems on cloud platforms such as AWS, GCP, or Azure using industry best practices.
- Demonstrate experience with maintaining real-time and near real-time data pipelines or streaming services at high scale.
- Collaborate effectively with cross-functional teams including data scientists, product managers, and machine learning engineers.
- Break down complex challenges into manageable steps to operate independently in a fast-paced environment.
- Understand machine learning workflows including feature serving at 50K+ QPS and offline and online equivalency.
- Possess knowledge of security and compliance frameworks related to data engineering and data privacy.
Skills and tech stack
Questions candidates ask
Where is this role located?
This position is remote with a location focus in Canada.
What will I work on regarding the tech stack?
You will architect model serving infrastructure, manage large-scale distributed systems on cloud platforms like AWS, GCP, or Azure, and build real-time streaming pipelines and online feature serving services.
How does the team collaborate with other departments?
You will collaborate closely with machine learning and data science teams by distilling feedback, correlating it to strategy, and executing technical tasks.