Data Engineer Consultant — Lakehouse & Pipelines

Indicium AI; Town of Montana (WI); On-site; USD 120,000 - 175,000; Full time

Job summary

Indicium AI is looking for a Data Engineer Consultant to build production-grade data pipelines for major enterprise clients on our US team. You will modernize legacy setups into cloud-native Lakehouses and write code in PySpark, SQL, and Python, deploying with Terraform.

You will collaborate with clients and nearshore squads to deliver in weeks, ensure data quality, lineage, and strict SLAs, and optimize performance and costs. Databricks, dbt, and Airflow expertise are essential for success.

Qualifications

• Hands-On Data Engineering with production code in Python and advanced SQL.
• Databricks Lakehouse experience including PySpark, Unity Catalog and Workflows.
• Infrastructure as Code with Terraform to deploy cloud data infra.

Responsibilities

• Build Lakehouse modernization pipelines converting legacy setups into PySpark, Databricks SQL, and Delta Live Tables.
• Develop modular, tested dbt models and SQL transformations for trusted datasets.
• Automate data infrastructure, enforce governance with Unity Catalog and manage cloud resources with Terraform.
• Build and monitor ELT/ETL workflows using Airflow and Databricks Workflows and ensure data quality and SLAs.
• Collaborate with clients and nearshore teams, participate in standups and code reviews.

Skills

Data engineering

Databricks

dbt

Terraform

Airflow

Tools

Databricks

dbt

Terraform

Python

SQL

Git

Job description

Indicium AI is looking for a Data Engineer Consultant to build production-grade data pipelines for major enterprise clients on our US team. You will modernize legacy setups into cloud-native Lakehouses and write code in PySpark, SQL, and Python, deploying with Terraform.

You will collaborate with clients and nearshore squads to deliver in weeks, ensure data quality, lineage, and strict SLAs, and optimize performance and costs. Databricks, dbt, and Airflow expertise are essential for success.