Senior Data Engineer, AI & Agents
About this role
Appnovation Technologies needs a Senior Data Engineer, AI & Agents to prepare enterprise domain data so that AI agents can consume it reliably. This team builds digital solutions and data platforms across commercial, finance, research and development, and real-world data domains using modern data warehousing infrastructure. The person in this role will build and register domain-grounded data agents over governed datasets, execute lakehouse migrations to open formats, and curate metadata that powers downstream automation and data contracts.
Candidates will succeed here if they bring deep technical fluency in both Databricks and Snowflake alongside strong governance instincts and a collaborative approach to working with business stakeholders. The position exists to bridge the gap between complex enterprise datasets and autonomous agent-based workflows, ensuring that business users can query trusted information with confidence.
What you will do
- Build and register domain data agents at scale over governed tables across Databricks and Snowflake.
- Perform lakehouse migrations by converting source tables to open formats like Apache Iceberg to enable agent-based access.
- Generate and curate catalogue metadata that feeds downstream automation and data-contract workflows.
- Partner directly with business stakeholders and subject-matter experts through iterative build, test, and validation cycles.
- Implement data quality, observability, and lineage while applying governance controls such as masking and security policies.
What you need
- Hold a Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.
- Bring at least five years of professional experience in data engineering with hands-on exposure to modern data warehousing and lakehouse platforms.
- Demonstrate hands-on fluency across both Databricks and Snowflake.
- Show documented experience building data agents or query interfaces over governed datasets such as Snowflake Cortex or Genie.
- Possess advanced SQL and Spark or PySpark skills alongside experience with pipeline orchestration tools like dbt, Apache Airflow, or Databricks Workflows.
Nice to have
- Familiarity with MCP-based data exposure and with embeddings or vector search for retrieval-augmented use cases.
- Experience with AWS and S3 in anticipation of onboarding native cloud data sources.
- Experience with regulated life-sciences data domains including clinical, commercial, or real-world data.
Skills and tech stack
Questions candidates ask
What locations are available for this job?
This posting lists New York, Austin, Miami, and Dallas as locations for the role.
What platforms and tools will I use daily?
The tech stack centers around Databricks, Snowflake, AWS, PySpark, SQL, dbt, Apache Airflow, and Apache Iceberg, along with governance tools like Unity Catalogue.
Who will I work with in this position?
You will partner directly with business stakeholders and subject-matter experts through iterative build, test, and validation cycles.
What are the primary technical deliverables?
Deliverables include building and registering domain data agents over governed tables, performing lakehouse migrations to open formats, and curating catalogue metadata.
The application is on the official Appnovation Technologies careers page.
Apply on company site