Data Engineer: Build Scalable Data Pipelines & Models

Insight Global; New Bremen (OH); On-site; USD 90,000 - 130,000; Full time

Job summary

Insight Global is seeking a data engineer to develop and support data products using SQL and Python. The role includes building ETL/ELT pipelines with Kafka, CDC, and Debezium, and designing CI/CD workflows for platform pipelines and applications.

You will work with Starburst/Trino and DBT-based tooling, alongside the Microsoft Fabric platform, guiding data modeling best practices with analysts and BI developers.

Qualifications

• Bachelor's degree in Computer Science or related field.
• Understanding of data modeling principles.
• SQL experience.
• Experience developing ETL/ELT pipelines using Kafka, CDC and Debezium.

Responsibilities

• Develop and support data products using SQL and Python.
• Develop and support ETL/ELT data pipelines using Kafka, CDC and Debezium.
• Design and support CI/CD workflows for platform pipelines and applications.
• Work with the Starburst/Trino platform using a DBT-based development framework and the Microsoft Fabric platform.
• Collaborate with data analysts and BI developers to guide data modeling best practices.

Skills

Understanding of data modeling

Python programming

BI collaboration

Communication with analysts

Project leadership

Education

Bachelor's degree in Computer Science or related field

Tools

SQL

Fabric

Starburst

Snowflake

Databricks

Trino

Job description

Insight Global is seeking a data engineer to develop and support data products using SQL and Python. The role includes building ETL/ELT pipelines with Kafka, CDC, and Debezium, and designing CI/CD workflows for platform pipelines and applications.

You will work with Starburst/Trino and DBT-based tooling, alongside the Microsoft Fabric platform, guiding data modeling best practices with analysts and BI developers.