About this role
Coupang maintains a customer service team focused on operating and evaluating artificial intelligence services that directly impact the shopping experience. Professionals in this group analyze AI outputs, conduct regular quality audits, and establish evaluation criteria to help models perform more effectively.
Daily responsibilities involve auditing AI results, extracting data with SQL and Excel, and collaborating with engineering and data groups to deliver feedback for model improvements. Candidates who enjoy observing how artificial intelligence functions within live production environments and possess a strong background in software quality evaluation or data analysis will find this role a strong match.
What you will do
- Perform regular quality audits and establish evaluation frameworks for artificial intelligence model outputs.
- Analyze evaluation results to identify model improvements and communicate feedback to development and data teams.
- Support project operations by managing schedules, tracking issues, and handling stakeholder communication.
- Define quality metrics and deliver periodic reporting for ongoing initiatives.
- Extract and analyze data using SQL and Excel to generate actionable insights.
What you need
- Bring three or more years of experience in quality assurance, data analysis, service planning, or related areas.
- Demonstrate hands-on experience evaluating software or service quality and establishing evaluation standards.
- Show proficiency in Excel including pivot tables, formulas, and data organization.
- Write basic SQL queries and retrieve data independently.
- Communicate effectively and document analytical results in a structured format.
Nice to have
- AI/ML service or LLM-based product quality evaluation experience
- Project coordination or planning experience such as PM, PMO, or service planning
- Data visualization tool utilization including Tableau or Power BI
- Understanding of AI output evaluation metrics like accuracy, consistency, and safety
- Taiwanese reading proficiency
Skills and tech stack
Questions candidates ask
What is the hiring process for this position?
The evaluation process includes a document review, a phone interview, an in-person or video interview, and a final acceptance notification. Schedule and steps may vary by role and are communicated individually through the email registered in the application.
What kind of experience is required for this role?
Candidates need at least 3 years of experience in QA, data analysis, or service planning, along with a background in software or service quality evaluation. Familiarity with basic SQL, Excel, and structured documentation is also necessary.
Are there any probation terms for this job?
The employment type is permanent with a 12-week probation period included. Depending on business needs, this probation period may be adjusted, shortened, or waived.