About this role
Evaluating whether artificial intelligence actually serves underserved populations requires bridging technical metrics with human impact. Karya needs a research intern to analyze how language technologies affect rural and low-resource communities across India, ensuring these systems are rigorously tested for real-world utility rather than just technical benchmarks.
Embedded within the Evaluations team, the intern will apply qualitative and quantitative social science methods to live evaluation pipelines. Daily efforts will involve investigating socio-technical interactions, supporting field visits, and helping develop novel testing methodologies for speech, text, and translation models.
Ideal candidates are students or recent graduates in disciplines like sociology, anthropology, or economics who want to bring a critical social science lens into technical spaces. A strong conceptual understanding of artificial intelligence combined with an interest in technology and society will enable the successful applicant to thrive in this early-stage research environment.
What you will do
- Apply qualitative, quantitative, or mixed social science research methods to evaluate language technologies and AI systems.
- Contribute to the development of novel AI evaluation and testing methodologies.
- Investigate how technology interacts with rural and low-resource communities in India.
- Work closely with the evaluations team to understand both building and testing phases of machine learning systems.
- Conduct or support focus group discussions and field visits.
- Engage with concepts like model evaluation, human-in-the-loop systems, and socio-technical thinking.
What you need
- Currently pursuing or recently completed an undergraduate or master's degree in a social science discipline such as sociology, anthropology, development studies, gender studies, political science, economics, or science and technology studies.
- Demonstrated interest in and conceptual understanding of artificial intelligence and machine learning systems through coursework, self-directed learning, or prior projects.
- Strong grounding in qualitative, quantitative, or mixed research methods.
- Comfort conducting or supporting focus group discussions and field visits.
- Familiarity with socio-technical systems thinking regarding technology and society.
- Strong written and verbal communication skills with the ability to work in ambiguous, early-stage research settings.
Nice to have
- Multilingual proficiency in Indian languages
- Background in computational social science
Benefits
- Flexible vacation and leave policy
- Flexible work options
- Insurance as per industry standards
- Access to industry stalwarts and networking opportunities
Questions candidates ask
What is the remote or workplace policy for this internship?
The company offers flexible work options alongside field visits and community engagement across India.
What kind of team will I be working with?
You will be embedded within the Evaluations team inside Karya's tech team, working alongside engineers and researchers.
Do I need a technical background or coding skills to apply?
No technical degree or coding is required, but you should have a conceptual understanding of AI and machine learning systems.
What benefits are provided for this role?
Perks include a flexible vacation and leave policy, flexible work options, industry-standard insurance, and access to industry stalwarts and networking opportunities.