Data Engineer

Insight Global; New Bremen (OH); On-site; USD 90,000 - 150,000; Full time

Job summary

Insight Global is seeking a data-focused engineer to develop and support data products using SQL and Python, and to build ETL/ELT pipelines with Kafka, CDC, and Debezium. The role involves CI/CD workflows for platform pipelines, working with Starburst/Trino, DBT, and Microsoft Fabric, and collaborating with BI developers on data modeling and Power BI practices.

You will review code, guide best practices, and ensure changes are thoroughly tested with QA, while documenting requirements and

Qualifications

• Understanding of data modeling principles.
• A high school diploma or equivalent with at least 5 years of experience.
• SQL experience.
• Python experience.
• Experience with Fabric, Starburst, Snowflake, Databricks, and Trino.
• Experience leading smaller projects.

Responsibilities

• Develop and support data products using SQL and Python.
• Build and maintain ETL/ELT pipelines using Kafka, CDC and Debezium.
• Design and support CI/CD workflows for platform pipelines and applications.
• Work with Starburst/Trino and DBT-based development within Microsoft Fabric.
• Collaborate with data analysts and BI developers on data modeling and Power BI practices.
• Perform code reviews and provide feedback for quality improvements.
• Analyze interactions between systems to prevent regressions, document requirements with the Business Analyst.
• Prepare technical specifications and system documentation.
• Provide knowledge transfer to Support and Operations teams.
• Work with QA to ensure changes are tested; write unit/integration tests.

Skills

Data modeling principles

Lead projects

Education

High school diploma or equivalent

Tools

Fabric

Starburst

Snowflake

Databricks

Trino

Job description

Job Description

Develop and support data products using SQL and Python.

Develop and support ETL/ELT data pipelines using Kafka, CDC and Debezium.

Design and support CI/CD workflows for platform pipelines and applications.

Work with the Starburst/Trino platform using a DBT-based development framework, as well as the Microsoft Fabric platform.

Work with data analysts and BI Developers to guide best practices on data modeling and overall use of Power BI

Perform code review of team members to learn new techniques while providing code quality review.

Assist in analysis of interacting systems to ensure changes made to one system will not impact other systems. Work closely with the Business Analyst to ensure proper documentation of requirements.

Prepare technical specifications and other system and programming documentation in accordance with internal standards.

Provide knowledge transfer to Support and Operations personnel related to changes to systems.

Work with Quality Analysts to ensure changes are thoroughly tested before release. Write unit and integration tests for new code. Assist with the diagnosis of problematic applications and system testing.

Stay informed of advances and pertinent changes in hardware and software technologies.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

Skills and Requirements

Understanding of data modeling principles, why they work, and how to best use them

A high school diploma or equivalent, along with at least 5 years' experience

SQL experience

Python experience

Experience in Fabric, Starburst, Snowflake, Databricks, Trino

Experience leading smaller projects

Salary/level will commensurate with experience