Senior Data Engineer, AI & Agents - Lakehouse Mastery

Appnovation Technologies; Miami (FL); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Challenging work

AI platforms access

Diverse culture

Growth opportunities

Collaborative environment

High-profile clients

Leadership access

Job summary

Appnovation Technologies is seeking a Senior Data Engineer, AI & Agents, to prepare enterprise domain data for AI agents, collaborating with stakeholders to build domain-grounded data assets on Databricks and Snowflake.

You will drive lakehouse migrations, design data contracts, ensure data quality and governance, and partner across business units to deliver reliable data assets powering automated AI workflows in a fast-moving digital environment.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.
• 5+ years of professional experience in data engineering, with significant hands‑on experience across modern data warehousing and lakehouse platforms (Databricks and Snowflake preferred).
• Strong data engineering background with genuine, hands‑on fluency across both Databricks and Snowflake.
• Demonstrated experience building data agents or query interfaces over governed datasets (e.g., Snowflake Cortex or Genie).
• Advanced SQL together with Spark / PySpark, and experience with pipeline orchestration (dbt, Apache Airflow, or Databricks Workflows).
• Experience implementing data quality, observability, and lineage, and applying governance controls such as masking and row‑ and column‑level security.
• Excellent stakeholder-facing skills, with a track record of translating business requirements into delivered data assets.

Responsibilities

• Build and register domain data agents at scale over governed tables across Databricks and Snowflake.
• Perform lakehouse migrations, including converting source tables to open formats (e.g., Apache Iceberg) to enable agent-based access.
• Generate and curate catalogue metadata that feeds downstream automation and data-contract workflows.
• Partner with business stakeholders and subject-matter experts through iterative build, test, and validation cycles.

Skills

Stakeholder-facing skills

Data governance

Data quality

Education

Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field

Tools

Databricks

Snowflake

dbt

Airflow

Databricks Workflows

Unity Catalogue

Horizon

Collibra

Apache Iceberg

Python

Job description

Appnovation Technologies is seeking a Senior Data Engineer, AI & Agents, to prepare enterprise domain data for AI agents, collaborating with stakeholders to build domain-grounded data assets on Databricks and Snowflake.

You will drive lakehouse migrations, design data contracts, ensure data quality and governance, and partner across business units to deliver reliable data assets powering automated AI workflows in a fast-moving digital environment.