Azure ETL Data Engineer for Cloud Data Exchange

Socket.dev; Washington (District of Columbia); On-site; USD 110,000 - 160,000; Full time

Job summary

OCTO is seeking an ETL Data Engineer for a long-term government contract in Washington, DC. The role focuses on data curation, processing, and transformation using cloud-native Azure tools, building end-to-end pipelines and ensuring governance and security.

You will collaborate with agencies to define requirements, develop scalable ETL processes, and implement both cloud and on-prem connectivity across data systems, leveraging ADF, Synapse, Databricks, and Informatica.

Qualifications

• Bachelor's degree in IT or related field or equivalent experience.
• Experience designing and developing complex data projects.
• Hands-on with cloud data tools and ETL frameworks.

Responsibilities

• Analyze, design, develop, and support complex enterprise data projects.
• Interface with agencies and stakeholders to define requirements.
• Build and optimize end-to-end ETL pipelines using Azure tools.
• Establish cloud and on-prem connectivity across systems.
• Hands-on with Azure Data Factory, Synapse, MSSQL and data lake storage.
• Develop pipelines to load data from multiple sources into SQL tables.
• Work with data integration tools like Informatica, Synapse, NiFi, Airflow.
• Handle diverse data formats (Oracle, SQL Server, DB2, Parquet, AVRO).
• Standardize and optimize data workflows following best practices.
• Contribute to data governance, accuracy, security and reliability.
• Automate, monitor, and manage data pipelines and alerts.
• Assess system changes, propose back-ups and rollback procedures.
• Develop new systems and enhancements while preserving standards.
• Create complex queries and reports in database languages.
• Familiarity with data visualization tools and secure data handling.
• Maintain expertise across large, cross-platform environments.

Skills

ETL knowledge

Cloud data pipelines

Azure data services

data governance awareness

data security practices

Education

Bachelor's degree in IT or related field

Tools

Azure Data Factory

Azure Synapse

Databricks

Informatica

Apache NiFi

Apache Airflow

Oracle

SQL Server

DB2

Parquet

AVRO

Job description

OCTO is seeking an ETL Data Engineer for a long-term government contract in Washington, DC. The role focuses on data curation, processing, and transformation using cloud-native Azure tools, building end-to-end pipelines and ensuring governance and security.

You will collaborate with agencies to define requirements, develop scalable ETL processes, and implement both cloud and on-prem connectivity across data systems, leveraging ADF, Synapse, Databricks, and Informatica.