Senior ETL Data Engineer

HRUCKUS; Washington (District of Columbia); On-site; USD 100,000 - 107,000; Full time

Job summary

HRUCKUS seeks a Senior ETL Data Engineer for an onsite assignment in Washington, DC, to support the OCTO Cloud Data Exchange. The role requires leading end-to-end ETL pipelines, data loading, and transformation using Azure tools and Databricks.

The candidate must have 15+ years in ETL development, 11+ years SQL experience, and 5+ years with Azure Data Factory, Synapse, and Data Lake Gen2. Excellent communication is essential for partnership with district agencies.

Qualifications

• 15+ years in ETL development and end-to-end pipelines
• 11+ years using SQL for relational databases
• 15+ years in ETL data architecture and data integration
• 5+ years with Microsoft Azure tools (Data Factory, Synapse, Data Lake)

Responsibilities

• Design, develop, and support complex enterprise data projects.
• Interface with agencies and stakeholders to gather requirements and advise on constraints.
• Leverage Azure Data Factory, Synapse, Databricks, and Informatica for ETL solutions.
• Establish cloud and on-prem connectivity (ADLS, ADF, Synapse, Databricks).
• Automate, monitor, and optimize data pipelines and governance.

Skills

ETL pipelines

SQL

Azure Data Factory

Databricks

Informatica

Data Lake Gen2

Python

Synapse

Azure SQL DB

MSSQL

Education

Bachelor's degree

Tools

Informatica PowerCenter

Apache NiFi

Apache Airflow

FME

Job description

Veteran Firm Seeking a Senior ETL Data Engineer for an Onsite Assignment in Washington, DC

My name is Stephen Hrutka, and I lead a Veteran-owned consulting firm in Washington, DC, focused on strategic sourcing, supply chain, and IT Staffing.

We want to fill a Senior ETL Data Engineer role for the Office of the Chief Technology Officer (OCTO) in the DC Government.

The ideal candidate is a DMV resident with 15+ years of experience in ETL development, 11+ years utilizing SQL for relational databases, and 5+ years of hands‑on expertise with Microsoft Azure tools (Data Factory, Synapse, Data Lake). Experience with data visualization tools and Databricks is highly desired.

Thanks,

www.hruckus.com

Executive Summary

HRUCKUS is looking for an experienced Senior ETL Data Engineer to support data operations for the OCTO Cloud Data Exchange, utilizing native Azure tools to perform critical ETL, data loading, and data transformation tasks.

Position Description

The ETL Data Engineer will curate, process, and transform data, establishing cloud and on‑premise connectivity, standardizing data pipelines, and adhering to enterprise data governance standards.

Position Responsibilities

• Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
• Interfaces with other agencies, consults with and informs user departments on system requirements, advises on environment constraints and operating difficulties for the current state, resolves problems using cloud solutions, and develops future enhancements to the District’s data systems.
• Leverages strong knowledge of Extraction, Transformation, and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, and Informatica.
• Establishes cloud and on‑premise connectivity in different systems like ADLS, ADF, Synapse, and Databricks.
• Utilizes hands‑on experience in Azure cloud services, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, and Python.
• Creates end‑to‑end pipelines to load data by reading it from multiple sources and loading it to landing layers or SQL tables.
• Develops, standardizes, and optimizes existing data workflows/pipelines adhering to best practices.
• Adheres to and contributes to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
• Automates, monitors, alerts, and manages data pipelines and workflows.
• Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back‑up, and rollback procedures.
• Develops complex programs and reports in database query language.
• Identifies improvements to project standards to achieve high‑quality services/products.
• Confers with business and technical personnel to resolve problems of intent, inaccuracy, or feasibility of computer processing and project design.
• Leverages excellent written and verbal communication skills to develop new business processes and programming solutions.
• Delivers support and design for industry‑specific applications requiring integration with statewide systems.
• Functions as a niche technical Subject Matter Expert (SME) with proven experience across large and complex implementations.

Required Qualifications

• Strong knowledge for development of Extract-Transform-Load (ETL) processes, including end-to-end pipelines with data loading from multiple sources (15 Years)
• Ability to gather and document requirements for data extraction, transformation and load processes (15 Years)
• Understanding of data warehousing, data lake, business intelligence and information management concepts and standards (15 Years)
• Ability to advise internal and external customers on appropriate tools and systems for complex data processing challenges (15 Years)
• Knowledge and use of SQL for relational databases (11 Years)
• Experience with various data formats including database specific (Oracle, SQL, Postgres, DB2), text formats (CSV, XML) and Binary (Parquet, AVRO) (11 Years)
• Contribute to enterprise data governance standards by ensuring accuracy, consistency, security and reliability (7 Years)
• Strong experience with Microsoft Azure tools such as Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, Blob Storage (5 Years)
• Experience with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow and FME (5 Years)
• Strong communication skills, both oral and written (3 Years)
• Ability to provide excellent customer service to external partners (3 Years)
• Ability to work independently or as part of a larger team (3 Years)

Minimum Education/ Certification Requirements

Bachelor’s degree in Information Technology or related field or equivalent experience

The target annual salary is $100,016.00 - $107,160.00.