Data Engineer – Scalable Pipelines & Lakehouse

Optomi; Jackson (MI); On-site; USD 90,000 - 150,000; Full time

Job summary

Optomi is seeking a hands-on Data Engineer to design, develop, and maintain scalable data pipelines and data warehouse solutions. You will assemble, cleanse, and transform large datasets from multiple sources while improving quality and performance across analytics initiatives.

You will partner with analytics teams, data architects, and IT to translate data requirements, build reporting solutions, and implement automated data preparation and validation processes using the Databricks Lakehouse

Qualifications

• Hands-on data engineer with pipeline, ETL, SQL, data modeling, and data quality fundamentals.
• Experience in the Databricks Lakehouse ecosystem, Delta Lake, DLT, Unity Catalog, Workflows, Medallion Architecture, and CI/CD.
• Ability to partner with analytics teams, business stakeholders, and IT to translate data needs.

Responsibilities

• Design, develop, and maintain scalable data and ETL pipelines.
• Assemble, cleanse, and transform large datasets from multiple sources.
• Develop and maintain data warehouse solutions and data models.
• Work with stakeholders to gather and translate data requirements.
• Build analytical and reporting solutions.
• Automate manual data preparation and transformation processes.
• Improve data quality, reliability, scalability, and system performance.
• Develop testing strategies and validation processes.
• Create technical documentation and project artifacts.
• Support deployments, production applications, and incident resolution.
• Work with senior engineers and architects on solution design and implementation.

Skills

ETL pipelines

SQL

Data modeling

Data quality

Data warehouse

Delta Lake

Databricks Lakehouse

CI/CD

Stakeholder collaboration

Tools

Delta Lake

Unity Catalog

DLT

Workflows

Medallion Architecture

Job description

Optomi is seeking a hands-on Data Engineer to design, develop, and maintain scalable data pipelines and data warehouse solutions. You will assemble, cleanse, and transform large datasets from multiple sources while improving quality and performance across analytics initiatives.

You will partner with analytics teams, data architects, and IT to translate data requirements, build reporting solutions, and implement automated data preparation and validation processes using the Databricks Lakehouse