About this role
Developing the agent harness in Python involves working on orchestration loops, tool definitions, context management, and failure handling daily. Team members also build evaluation suites to measure agent quality, create AI microservices, and maintain Laravel APIs that integrate agents into the platform.
Knak builds an agentic marketing production platform that helps marketers turn ideas into high-performing campaigns at scale. The company exists to solve the production bottleneck in marketing, handling repeatable tasks like versioning and approvals so creators can focus on strategy. This role exists to scale the AI agents powering the platform, making it a strong fit for engineers who want deep, hands-on experience with agent internals and system architecture.
What you will do
- Design and implement the core agent runtime in Python, covering orchestration, tool execution, and memory management.
- Build and maintain evaluation datasets, automated evaluators, and LLM-as-judge pipelines using tools like LangSmith.
- Diagnose agent failures from traces and run model comparisons to drive measurable performance improvements.
- Develop Python and Node.js microservices for agent hosting alongside Laravel APIs for platform integration.
- Deploy secure infrastructure on AWS services such as Lambda and Bedrock while optimizing MySQL database queries.
- Participate in code reviews, collaborate across product and engineering teams, and mentor teammates on agent development.
What you need
- Bring at least 6 years of professional software development experience.
- Demonstrate hands-on production experience building LLM-powered agents with tool calling and prompt engineering.
- Show experience designing evaluation systems for LLMs, including dataset curation and regression tracking.
- Possess strong proficiency in Python, Node.js, and MySQL.
- Have expertise in RESTful APIs, test-driven development, and CI/CD pipelines using GitHub Actions.
- Understand SaaS architecture, microservices, observability, and AWS cloud infrastructure.
Nice to have
- Interest in or experience with full-stack web development spanning Vue and PHP Laravel
- Experience in AI-powered product development
- Background with LLMs, LangGraph, or AI agent frameworks
- Prior experience in a fast-growing SaaS company
Benefits
- Competitive salaries
- Equity in the company
- Great benefits
- Paid vacation
- Life leave days
- Team lunches and off-sites
Skills and tech stack
Questions candidates ask
What is the remote work policy for this position?
This role is listed as Remote - Canada.
What is the compensation range for the role?
The anticipated base salary range is $135,000 to $170,000 per year, with final compensation determined by relevant experience, skills, qualifications, and internal equity.
What technologies will I be working with?
You will work primarily with Python, Node.js, MySQL, Laravel for APIs, AWS services, and evaluation tools like LangSmith.
What does the recruitment process involve?
The recruitment process includes AI screening for keywords and minimum qualifications as well as video interviews which are transcribed with AI, though humans remain at the core of decision-making.