Senior Data Engineer — Scalable Pipelines & Data Quality

Veriipro; Chicago (IL); On-site; USD 130,000 - 170,000; Full time

Job summary

Veriipro seeks an experienced data engineer to design scalable ETL/ELT pipelines and integrate data from multiple sources, ensuring quality and governance. The role emphasizes performance optimization and collaboration with data scientists and analysts in a data-driven environment.

You will work with Azure technologies (SQL, Synapse, Databricks) and Informatica Cloud, building robust data architectures and supporting BI initiatives.

Qualifications

• Bachelor’s degree in Computer Science, Data Science, Software Engineering, Information Systems, or a related field.
• 8+ years of experience in data engineering, including data modeling, ETL/ELT, data integration, data quality, data warehousing, analytics, BI, and governance.
• Proficiency in Python, SQL, C#, and/or Java.
• Experience with Azure SQL, Synapse, Cosmos DB, HDInsight, Azure Data Factory, Azure Databricks, Power BI, and Microsoft Fabric.
• Experience with Informatica Cloud, including CIH, DIH, CDGC, MDM, and Data Quality.
• Experience with Snowflake and modern cloud data platforms.
• Strong analytical, problem-solving, communication, and stakeholder collaboration skills.

Responsibilities

• Design and develop scalable data pipelines for data extraction, transformation, integration, and loading.
• Integrate data from databases, data warehouses, APIs, and external systems while ensuring data integrity and consistency.
• Perform data cleansing, transformation, aggregation, filtering, and enrichment.
• Implement data quality checks and validation processes.
• Optimize data pipelines and processing workflows for performance, scalability, and efficiency.
• Monitor data systems, troubleshoot performance issues, and implement optimization techniques.
• Collaborate with data architects, data scientists, AI engineers, and analysts to support data-driven solutions.
• Support data modeling, ETL/ELT, master data management, data warehousing, analytics, BI, and data governance initiatives.

Skills

Python

SQL

C#

Java

Azure SQL

Synapse

Cosmos DB

HDInsight

Azure Data Factory

Azure Databricks

Power BI

Microsoft Fabric

Informatica Cloud

Snowflake

Education

Bachelor’s degree in Computer Science, Data Science, Software Engineering, Information Systems, or a related field

Tools

CIH

DIH

CDGC

MDM

Data Quality

Job description

Veriipro seeks an experienced data engineer to design scalable ETL/ELT pipelines and integrate data from multiple sources, ensuring quality and governance. The role emphasizes performance optimization and collaboration with data scientists and analysts in a data-driven environment.

You will work with Azure technologies (SQL, Synapse, Databricks) and Informatica Cloud, building robust data architectures and supporting BI initiatives.