ETL Data Engineer

Rishabh RPO; Washington (District of Columbia); On-site; USD 100,000 - 160,000; Full time

Job summary

Rishabh RPO is seeking an ETL Data Engineer in Washington DC to design and implement enterprise data projects. You will develop end-to-end data pipelines, integrate cloud and on-prem systems, and ensure data accuracy and governance across diverse data sources.

The role requires strong ETL expertise, Azure cloud skills (ADF, Synapse, Data Lake Gen2), SQL proficiency, and experience with tooling like Informatica, NiFi, and Airflow.

Qualifications

• Bachelor's degree in Information Technology or related field or equivalent experience.
• 15+ years of ETL development experience and end-to-end data pipelines.
• 15+ years gathering requirements for data extraction, transformation and load processes.
• 15+ years understanding data warehousing, data lake and BI concepts.
• 15+ years advising on tools for complex data processing challenges.
• 11+ years in SQL for relational databases.
• 11+ years experience with data formats including Oracle, SQL, Postgres, DB2; CSV, XML; Parquet, AVRO.
• 7+ years contributing to data governance standards for accuracy and security.
• 5+ years with Microsoft Azure data tools (ADF, Synapse, Azure SQL, Data Lake).
• 5+ years with data integration tools (Informatica, NiFi, Airflow, FME).
• 3+ years with visualization tools (MicroStrategy, Tableau, Esri ArcGIS).
• 3+ years in communication and customer-facing roles.
• 3+ years independent/team work; Databricks experience is a plus.

Responsibilities

• Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
• Interfaces with agencies, informs user departments on system requirements, and advises on environment constraints.
• Develops end-to-end ETL pipelines and integrates cloud and on-prem systems.
• Establishes cloud/on-prem connectivity (ADLS, ADF, Synapse, Databricks).
• Hands-on with Azure services like ADF, Synapse, MSSQL, Azure Data Lake Storage Gen2, Blob Storage, Python.
• Builds pipelines to load data from multiple sources into landing layer or SQL tables.
• Familiar with data formats (Oracle, SQL Server, DB2, CSV, XML, Parquet, AVRO).
• Advices on governance standards and ensures data accuracy, security and reliability.
• Automates, monitors, alerts, and manages data pipelines and workflows.

Skills

ETL pipelines

SQL

Azure Data Factory

Azure Synapse

Databricks

Informatica

Apache NiFi

Airflow

Data governance

Data warehousing

Azure cloud services

Python

Education

Bachelor's degree in Information Technology or related field

Tools

Azure Data Factory

Azure Synapse

SQL Server

Azure Data Lake Storage Gen2

Blob Storage

Databricks

Informatica

NiFi

Airflow

Tableau/MicroStrategy/Esri ArcGIS

Job description

Position Title & Code: ETL Data Engineer

Location: Washington DC 20003

Project End Date: 12/31/2026 (With Possible extension to next fiscal year)

Responsibilities:

• Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
• Interfaces with other agencies, consult with and inform user departments on system requirements, advise on environment constraints and operating difficulties for the current state and advise and resolve problems using cloud solutions and develop and replicate future enhancements to District's data systems.
• Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from the stake holders or analyzing the existing code and perform enhancements or new development.
• Establishing the cloud and on-premise connectivity in different systems like ADLS, ADF, Synapse, Databricks
• Hands on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python etc.
• Worked on creating end to end pipelines to load data by reading it from multiple sources or source systems and load to landing layer or SQL tables.
• Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow)
• Familiarity/experience with various data formats including database specific (Oracle, SQL Server, DB2, QuickBase), text formats(CSV, XML) and Binary(Parquet, AVRO)
• Develops, standardizes and optimizes existing data workflow/pipelines adhering to best practices.
• Adhere and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
• Automates, monitors, alerts, and manages data pipelines and workflows.
• Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back-up, and rollback procedures.
• Works on the development of new systems, upgrades and enhancements to existing systems and ensure systems follow approved standards and consistency after the changes.
• Develops complex programs and reports in database query language.
• Familiarity/experience with data visualization tools.
• Familiarity/experience handling and securing sensitive data based on the level of the sensitivity.

Responsibilities:

• Demonstrates expertise in conveying technical and functional concepts for a specific technical specialty.
• Identifies improvements to project standards to achieve high quality services/ products. This is a professional position which may require subject matter expertise consistent with demanding and rare technological skills.
• May require coordination of programming activities being conducted by the application development team
• Confers with other business and technical personnel to resolve problems of intent, inaccuracy, or feasibility of computer processing and project design.
• Works with necessary personnel to determine if modifications are necessary with interested personnel to determine necessity for modifications or enhancements.
• Leverages excellent written and verbal communication skills to develop new business process and programming solutions as directed by business and technical stakeholders.
• May coordinate activities of application developers.11-
• Able to identify best practices and standards for the use of the product.
• Proven track record of hands-on technical design and code work within large complex systems.
• Proven hands-on technical work with a variety of technologies.
• Demonstrated technical expertise integrating a variety of diverse technical environments and cross-platform technologies.
• Delivers support and design for industry specific applications that require integration with statewide systems or applications.
• Interacts with executive level business users or technical experts.
• Advanced experience in the required technical subject matter.
• May function as a niche technical SME (Subject Matter Expert).
• Has proven experience across large and complex implementations and systems.

Minimum Education/Certification Requirements:

• Bachelor's degree in Information Technology or related field or equivalent experience.

Skill Assessment: (Please include the years of experience last used and brief description on skills below, information is to be submitted along with the resume)

Skill

Required / Desired

Amount of Experience

Years of Experience

Strong knowledge for development of Extract-Transform-Load (ETL) processes, including end-to-end pipelines with data loading from multiple sources

Required

15 Years

Ability to gather and document requirements for data extraction, transformation and load processes

Required

15 Years

Understanding of data warehousing, data lake, business intelligence and information management concepts and standards.

Required

15 Years

Ability to advise internal and external customers on appropriate tools and systems for complex data processing challenges.

Required

15 Years

Knowledge and use of SQL for relational databases

Required

11 Years

Experience with various data formats including database specific (Oracle, SQL, Postgres, DB2), text formats (CSV, XML) and Binary (Parquet, AVRO)

Required

11 Years

Contribute to enterprise data governance standards by ensuring accuracy, consistency, security and reliability

Required

7 Years

Strong experience with Microsoft Azure tools such as Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, Blob Storage

Required

5 Years

Experience with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow and FME

Required

5 Years

Experience with visualization and reporting software such as MicroStrategy, Tableau, and Esri ArcGIS

Highly desired

3 Years

Strong communication skills, both oral and written

Required

3 Years

Ability to provide excellent customer service to external partners

Required

3 Years

Ability to work independently or as part of a larger team

Required

3 Years

Experience performing data functions with Databricks

Highly desired

3 Years