Data Engineer: Build Scalable Lakehouse Pipelines

InfoVision Inc.; Detroit (MI); On-site; USD 105,000 - 155,000; Full time

Job summary

InfoVision Inc. seeks a Data Engineer to design and build the data infrastructure powering analytics, AI, and client platforms across our engagements. You will work with data scientists, analytics engineers, and solution architects to turn raw data into reliable, production-grade pipelines.

You will own pipeline design and lakehouse architectures, data modeling, quality, observability, and client delivery in a fast-paced environment.

Qualifications

• 3–5 years of data engineering experience with production pipelines.
• Hands-on Databricks experience: Delta Lake, Workflows, Unity Catalog, and Databricks SQL.
• Strong PySpark and SQL for large-scale data transformations.
• Experience with AWS and/or Azure cloud data platforms.
• Familiarity with Delta Live Tables or similar frameworks.
• Solid data modeling knowledge: dimensional modeling, medallion architecture.

Responsibilities

• Design and build scalable data pipelines using Spark and Databricks (batch & streaming).
• Develop Delta Live Tables workflows to automate data quality checks.
• Translate business requirements into structured pipeline logic.
• Design and implement Delta Lake architectures with Bronze/Silver/Gold patterns.
• Configure Unity Catalog for access control, lineage, and governance.
• Optimize storage formats, partitions, and compute to balance cost and performance.
• Build data models for analytics, dashboards, and ML features.
• Collaborate with analytics engineers and data scientists on transformation logic.
• Apply dbt or equivalent tooling where appropriate.
• Work with solution architects and delivery leads to scope, estimate, and deliver data work.

Skills

Databricks

PySpark

SQL

AWS

Azure

Delta Live Tables

Data Modeling

Agile/Sprint

Stakeholder Communication

Education

Bachelor's degree in CS/Engineering/IS

Tools

Databricks Delta Lake

Unity Catalog

DBT

Job description

InfoVision Inc. seeks a Data Engineer to design and build the data infrastructure powering analytics, AI, and client platforms across our engagements. You will work with data scientists, analytics engineers, and solution architects to turn raw data into reliable, production-grade pipelines.

You will own pipeline design and lakehouse architectures, data modeling, quality, observability, and client delivery in a fast-paced environment.