Azure ETL Data Engineer — Cloud Data Pipelines

Socket.dev; Washington (District of Columbia); On-site; USD 120,000 - 150,000; Full time

Job summary

OCTO's Enterprise Data team is seeking an ETL data engineer to support data operations for the Cloud Data Exchange. The role focuses on ETL, data loading, and transformation tasks using native Azure tools.

You will develop end-to-end pipelines, integrate diverse data sources, and ensure data quality and governance across enterprise systems. Expertise in Azure Data Factory, Synapse, Databricks, and Informatica is highly valued.

Qualifications

• Bachelor’s degree or equivalent IT experience.
• Strong knowledge of ETL processes and end-to-end pipeline development.
• Experience with Azure data services and data governance.
• Familiarity with various data formats and databases.

Responsibilities

• Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
• Interfaces with agencies and informs user departments on system requirements and constraints for cloud solutions.
• Establishes cloud and on-prem connectivity across systems like ADLS, ADF, Synapse, Databricks.

Skills

ETL development

End-to-end pipelines

SQL

Azure Data Factory

Azure Synapse

Databricks

Informatica

Data governance

Python

Data integration

Airflow

Education

Bachelor's degree in IT or related field

Tools

Azure Data Factory

Azure Synapse

SQL Server

Databricks

Informatica

Apache NiFi

Apache Airflow

FME

Azure Data Lake Storage Gen2

Job description

OCTO's Enterprise Data team is seeking an ETL data engineer to support data operations for the Cloud Data Exchange. The role focuses on ETL, data loading, and transformation tasks using native Azure tools.

You will develop end-to-end pipelines, integrate diverse data sources, and ensure data quality and governance across enterprise systems. Expertise in Azure Data Factory, Synapse, Databricks, and Informatica is highly valued.