Latest AI JobsBrowse Jobs
Deposco logo

AI Evaluation Engineer

DeposcoAlpharetta, GAQuality & Solutions
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Posted
23 Feb 2026
Status
Open · checked 7d ago

About this role

Deposco is hiring an AI Evaluation Engineer to join the quality assurance team on a full-time basis, with options for remote work or presence in Alpharetta, Georgia. This position suits an analytical professional with a background in software testing who wants to shape the future of artificial intelligence applications and automation workflows.

Role Overview

As an AI Evaluation Engineer at Deposco, you will ensure the accuracy, reliability, and performance of AI-driven models and services. Reporting to the Vice President of Quality, you will partner with product managers, developers, and data scientists to validate advanced features and omnichannel solutions. This role plays a critical part in supporting company growth and defining the future of testing practices.

Key Responsibilities

Participate in requirements and project meetings to understand deliverables and pinpoint gaps for test case creation.
Design and maintain automated tests using Java or Python for omnichannel software solutions.
Employ automated testing tools for RESTful services tied to marketplace integrations.
Identify marketplace-specific use cases, execute manual tests when needed, and transition them to automated workflows.
Develop automated acceptance and unit tests within an agile environment.
Utilize Jenkins and continuous integration tools to automate development, build, deployment, and testing processes.
Collaborate with product owners in a Scrum team to clarify project requirements.
Analyze test results technically and deliver detailed feedback to the development team.
Assist in troubleshooting production issues through coordinated testing and support efforts.
Produce comprehensive QA documentation such as test plans, scripts, strategies, and requirement traceability matrices.

Requirements

At least 2 years of experience in software quality testing.
Minimum of 2 years of Agile framework experience.
Thorough understanding of the Software Development Life Cycle (SDLC) from requirements gathering to testing, alongside modern testing methodologies.
Proficiency in working with JSON and XML message formats.
Familiarity with Atlassian tools like JIRA and Confluence.
Experience utilizing continuous integration tools such as GitHub.
Solid knowledge of relational databases and the ability to write MySQL queries to validate test results.
Practical exposure to RESTful automation tools.
Competence in at least one object-oriented programming language, with scripting skills as an advantage.
Ability to work independently or collaboratively in a fast-paced environment under tight deadlines.
Strong analytical, organizational, and multitasking abilities.
Demonstrated initiative, accountability, and project ownership.

Nice to Have

A four-year degree in Computer Science or Computer Engineering.
2 years of Python experience.
Background working with integration platforms.

Skills and Tools

Python and Java
RESTful automation tools
Jenkins and GitHub CI tools
MySQL and relational databases
JSON and XML message formats
JIRA and Confluence

Salary and Benefits

Comprehensive health care coverage
Paid time off and life insurance
401(k) plan with company match
Gym reimbursement
Office perks including a coffee bar with cold brew on tap, a full-time barista, and standing desks
Corporate events featuring food trucks and activities like Top Golf
Corporate office amenities featuring co-working spaces, ping-pong tables, and corn-hole boards near Avalon

About the Company

Deposco operates an energetic team recognized six years running as a USA Today Workplace, dedicated to delivering game-changing software solutions to customers while maintaining a vibrant company culture.

How to Apply

To apply for this position, please visit the official Deposco careers page to submit your application.

Skills and tech stack

PythonJava

Questions candidates ask

Is this position remote?

Yes, this role offers remote flexibility while being based out of Alpharetta, GA.

What level of experience is required for the AI Evaluation Engineer?

Candidates must have at least 2 years of experience in software quality testing along with 2 years of Agile experience.

What programming languages are used in this role?

The position requires writing automated tests using Java or Python, with Python experience preferred.

What benefits does Deposco provide?

Benefits include health care, paid time off, life insurance, a 401k plan with match, and gym reimbursement, alongside office perks like a coffee bar, standing desks, and corporate events.

Who does this role report to?

The AI Evaluation Engineer reports directly to the Vice President of Quality.

Ready to apply?

The application is on the official Deposco careers page.

Apply on company site