ETL Data Engineer

Intellibee Inc; Richmond (VA); On-site; USD 80,000 - 110,000; Full time

Job summary

An established industry player is seeking an ETL Data Engineer to enhance data pipelines in Azure. This role focuses on integrating and transforming sensitive datasets, ensuring data quality and auditability. The ideal candidate will have strong experience with Azure-native tools and a commitment to responsible data use. Join a dynamic team in an Agile environment, where your contributions will support public transparency initiatives and drive impactful data solutions. If you are passionate about data engineering and eager to make a difference, this opportunity is for you.

Qualifications

• 3+ years of experience with Azure-native ETL/ELT tools.
• Proficiency in SQL, Python, or PySpark for data transformation.

Responsibilities

• Design and deliver secure, scalable data pipelines in Azure.
• Build ingestion workflows and transformation logic for analytics.

Skills

ETL/ELT pipelines

Azure Data Factory

SQL

Python

PySpark

Delta Lake

Azure Data Lake Storage Gen2

Data masking

DevOps/DataOps practices

Data quality frameworks

Tools

Azure-native tools

Synapse Pipelines

Job description

ETL Data Engineer, Richmond, VA, United States

Data Analyst 3

This position will support the design and delivery of secure, scalable, and traceable data pipelines in Azure, focusing on integrating and transforming sensitive, public-facing datasets. The candidate will build ingestion workflows and transformation logic to support reporting, analytics, and public transparency initiatives. This role requires experience with Azure-native tools, strong ETL/ELT capabilities, and a commitment to data quality, auditability, and responsible data use. The candidate will work with an existing software development team in an Agile/Scrum environment.

Skill Matrix

• Required 3 years of experience building and maintaining ETL/ELT pipelines in enterprise environments using Azure-native tools.
• Required 3 years of hands-on expertise with Azure Data Factory, Dataflows, Synapse Pipelines, or similar orchestration tools.
• Required 3 years of proficiency in SQL, Python, or PySpark for transformation logic and data cleansing workflows.
• Required 3 years of experience with Delta Lake, Azure Data Lake Storage Gen2, JSON, and Parquet formats.
• Ability to build modular, reusable pipeline components using metadata-driven approaches and robust error handling.
• Familiarity with public data sources, government transparency datasets, and publishing workflows.
• Knowledge of data masking, PII handling, and encryption techniques to manage sensitive data responsibly.
• Experience with data quality frameworks, including automated validation, logging, and data reconciliation methods.
• Strong grasp of DevOps/DataOps practices, including versioning, testing, and CI/CD for data pipelines.
• Experience supporting data publishing for oversight, regulatory, or open data initiatives is highly desirable.
• Highly desired certifications such as DP-203 (Azure Data Engineer Associate) or Azure Solutions Architect.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• IT Services and IT Consulting