ETL Data Engineer,Richmond, VA,United States

Intellibee; Richmond (VA); On-site; USD 75,000 - 105,000; Full time

Job summary

A forward-thinking company is seeking a skilled Data Analyst to support the design and delivery of secure data pipelines in Azure. This role focuses on integrating and transforming sensitive datasets, ensuring data quality and auditability. The ideal candidate will have extensive experience with Azure-native tools and a strong commitment to responsible data use. Join a dynamic Agile/Scrum team and contribute to public transparency initiatives by building efficient ETL/ELT workflows. If you are passionate about data and eager to make an impact, this opportunity is perfect for you.

Qualifications

• 3+ years of experience building ETL/ELT pipelines using Azure-native tools.
• Proficiency in SQL, Python, or PySpark for data transformation.

Responsibilities

• Support the design and delivery of secure, scalable data pipelines in Azure.
• Build ingestion workflows and transformation logic for reporting and analytics.

Skills

ETL/ELT pipelines

Azure Data Factory

SQL

Python

PySpark

Delta Lake

Data Lake Storage Gen2

Data quality frameworks

DevOps/DataOps practices

Data masking

Tools

Azure Data Factory

Synapse Pipelines

Job description

Data Analyst 3

This position will support the design and delivery of secure, scalable, and traceable data pipelines in Azure, with a focus on integrating and transforming sensitive, public-facing datasets. The candidate will build ingestion workflows and transformation logic to support reporting, analytics, and public transparency initiatives. This role requires experience with Azure-native tools, strong ETL/ELT capabilities, and a strong commitment to data quality, auditability, and responsible data use. The candidate will be working with an existing software development team in an Agile/Scrum environment.

Skill Matrix:

• Required 3 Years of experience building and maintaining ETL/ELT pipelines in enterprise environments using Azure-native tools.
• Required 3 Years Hands-on expertise with Azure Data Factory, Dataflows, Synapse Pipelines, or similar orchestration tools.
• Required 3 Years of Proficiency in SQL, Python, or PySpark for transformation logic and data cleansing workflows.
• Required 3 Years Experience with Delta Lake, Azure Data Lake Storage Gen2, JSON, and Parquet formats.
• Required 3 Years Ability to build modular, reusable pipeline components using metadata-driven approaches and robust error handling.
• Required 3 Years Familiarity with public data sources, government transparency datasets, and publishing workflows.
• Required 3 Years Knowledge of data masking, PII handling, and encryption techniques to manage sensitive data responsibly.
• Required 3 Years Experience with data quality frameworks, including automated validation, logging, and data reconciliation methods.
• Required 3 Years Strong grasp of DevOps/DataOps practices, including versioning, testing, and CI/CD for data pipelines.
• Required 3 Years Experience supporting data publishing for oversight, regulatory, or open data initiatives is highly desirable.
• Highly desired 3 Years Certifications such as DP-203 (Azure Data Engineer Associate) or Azure Solutions Architect are a plus.