Azure ETL Data Engineer – End-to-End Data Pipelines

Rishabh RPO; Washington (District of Columbia); On-site; USD 100,000 - 160,000; Full time

Job summary

Rishabh RPO is seeking an ETL Data Engineer in Washington DC to design and implement enterprise data projects. You will develop end-to-end data pipelines, integrate cloud and on-prem systems, and ensure data accuracy and governance across diverse data sources.

The role requires strong ETL expertise, Azure cloud skills (ADF, Synapse, Data Lake Gen2), SQL proficiency, and experience with tooling like Informatica, NiFi, and Airflow.

Qualifications

• Bachelor's degree in Information Technology or related field or equivalent experience.
• 15+ years of ETL development experience and end-to-end data pipelines.
• 15+ years gathering requirements for data extraction, transformation and load processes.
• 15+ years understanding data warehousing, data lake and BI concepts.
• 15+ years advising on tools for complex data processing challenges.
• 11+ years in SQL for relational databases.
• 11+ years experience with data formats including Oracle, SQL, Postgres, DB2; CSV, XML; Parquet, AVRO.
• 7+ years contributing to data governance standards for accuracy and security.
• 5+ years with Microsoft Azure data tools (ADF, Synapse, Azure SQL, Data Lake).
• 5+ years with data integration tools (Informatica, NiFi, Airflow, FME).
• 3+ years with visualization tools (MicroStrategy, Tableau, Esri ArcGIS).
• 3+ years in communication and customer-facing roles.
• 3+ years independent/team work; Databricks experience is a plus.

Responsibilities

• Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
• Interfaces with agencies, informs user departments on system requirements, and advises on environment constraints.
• Develops end-to-end ETL pipelines and integrates cloud and on-prem systems.
• Establishes cloud/on-prem connectivity (ADLS, ADF, Synapse, Databricks).
• Hands-on with Azure services like ADF, Synapse, MSSQL, Azure Data Lake Storage Gen2, Blob Storage, Python.
• Builds pipelines to load data from multiple sources into landing layer or SQL tables.
• Familiar with data formats (Oracle, SQL Server, DB2, CSV, XML, Parquet, AVRO).
• Advices on governance standards and ensures data accuracy, security and reliability.
• Automates, monitors, alerts, and manages data pipelines and workflows.

Skills

ETL pipelines

SQL

Azure Data Factory

Azure Synapse

Databricks

Informatica

Apache NiFi

Airflow

Data governance

Data warehousing

Azure cloud services

Python

Education

Bachelor's degree in Information Technology or related field

Tools

Azure Data Factory

Azure Synapse

SQL Server

Azure Data Lake Storage Gen2

Blob Storage

Databricks

Informatica

NiFi

Airflow

Tableau/MicroStrategy/Esri ArcGIS

Job description

Rishabh RPO is seeking an ETL Data Engineer in Washington DC to design and implement enterprise data projects. You will develop end-to-end data pipelines, integrate cloud and on-prem systems, and ensure data accuracy and governance across diverse data sources.

The role requires strong ETL expertise, Azure cloud skills (ADF, Synapse, Data Lake Gen2), SQL proficiency, and experience with tooling like Informatica, NiFi, and Airflow.