Latest AI JobsBrowse Jobs
Keeper Security logo

Senior Software Development Test Engineer (SDET), AI & Automation

Keeper SecurityRemote, USQA Automation
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Experience
Senior · 5+ yrs
Posted
8 Oct 2026
Status
Open · checked 7d ago

About this role

This role suits an experienced software quality professional with a background in testing both traditional applications and AI-driven systems. The position is fully remote within the US, with optional hybrid work in El Dorado Hills, California or Chicago, Illinois.

Role Overview

Keeper Security seeks a Senior Software Development Test Engineer (SDET), AI & Automation to join the AI team and build automated quality practices for security-sensitive, AI-powered products. Operating as an embedded partner among engineers and Product, this position defines test strategies, establishes acceptance criteria, and creates automated test coverage for non-deterministic AI capabilities and deterministic software alike.

Key Responsibilities

Partner with AI engineers, Software Engineers, and Product Managers to define test strategies and acceptance criteria.
Build and maintain automated testing frameworks for backend services, APIs, and AI-enabled applications.
Develop testing approaches for both deterministic software and probabilistic AI/ML outputs.
Establish measurable evaluation criteria, quality thresholds, and tolerances for LLM-driven features.
Integrate automated validation and quality gates into CI/CD pipelines.
Analyze failures to differentiate between actual defects, data problems, and expected model variability.

Requirements

Five or more years of experience in SDET, test automation, or code-intensive quality engineering.
Hands-on background testing AI/ML or model-integrated software.
Programming proficiency in Python, Java, JavaScript/TypeScript, or Rust.
Experience designing and maintaining automated test frameworks across functional, API, and end-to-end scopes.
Familiarity with CI/CD platforms such as GitHub Actions, Jenkins, or GitLab CI.
U.S. Person status (U.S. citizen or lawful permanent resident) due to FedRAMP compliance requirements.

Nice to Have

Experience testing LLMs, retrieval-augmented generation, agentic systems, or prompt-driven workflows.
Familiarity with AI evaluation metrics, benchmarking, and automated model regression frameworks.
Background in performance, security, reliability, or adversarial testing of AI systems.
Experience testing cybersecurity, identity, or Privileged Access Management software.
Familiarity with Docker, Kubernetes, or cloud-based testing environments.

Skills and Tools

Python, Java, JavaScript, TypeScript, Rust
GitHub Actions, Jenkins, GitLab CI
TestRail, Postman, REST Assured
Claude, ChatGPT, GitHub Copilot
Git, Docker, Kubernetes

Salary and Benefits

Medical, dental, and vision coverage including domestic partnerships
Employer-paid life insurance

About the Company

Keeper Security develops zero-knowledge and zero-trust cybersecurity software protecting organizations and individuals globally across more than 150 countries. Its core platform, KeeperPAM, provides cloud-native privileged access management to secure passwords, infrastructure secrets, and remote connections.

How to Apply

Interested candidates should apply on the official company careers page.

Skills and tech stack

PythonJavaJavaScriptTypeScriptRustGitHub ActionsJenkinsGitLab CITestRailPostmanREST AssuredClaudeChatGPTGitHub CopilotGitDockerKubernetesLLMLLMs

Questions candidates ask

Where is this job located?

This position is 100% remote within the United States, with optional hybrid schedules available for candidates based near El Dorado Hills, California or Chicago, Illinois.

How many years of experience are required?

Candidates must have 5 or more years of experience in SDET, software development, test automation, or a related code-intensive quality engineering role.

Are there citizenship or residency requirements for this position?

Yes. Due to FedRAMP compliance requirements, qualified applicants must be a U.S. Person, defined as a U.S. citizen or lawful permanent resident.

What programming languages are used in this role?

The position requires programming skills in Python, Java, JavaScript, TypeScript, Rust, or another general-purpose language.

What benefits are provided?

Provided benefits include medical, dental, and vision coverage (including domestic partnerships) alongside employer-paid life insurance.

Ready to apply?

The application is on the official Keeper Security careers page.

Apply on company site