OCTO ETL Data Engineer

Collaboredge Inc.; Washington (District of Columbia); On-site; USD 81,000 - 99,000; Full time

Job summary

Collaboredge Inc. is seeking an ETL Data Engineer to join the Enterprise Data team supporting OCTO’s Cloud Data Exchange.

This onsite contract role in Washington, DC focuses on building and operationalizing cloud ETL pipelines using native Azure tools, with governance, automation, monitoring, and enhancements to enterprise data systems. The ideal candidate has 3+ years of experience, a Bachelor’s degree in IT or related field, strong SQL and data warehousing knowledge, and hands-on work with

Qualifications

• 3+ years of experience in ETL data engineering.
• Bachelor’s degree in Information Technology or related field or equivalent experience.

Responsibilities

• Analyze, design, develop, implement, replicate, and support complex enterprise data projects end to end.
• Develop and improve ETL frameworks using Azure tools and Informatica.
• Create end-to-end pipelines loading data into landing layers and SQL tables.
• Establish cloud and on-premise connectivity across systems.

Skills

ETL pipelines

SQL

Data warehousing

Azure cloud

Governance

Automation

Communication

Independent work

Education

Bachelor’s degree in Information Technology or related field

Tools

Azure Data Factory

Azure Synapse

Databricks

Informatica PowerCenter

Apache NiFi

Apache Airflow

FME

SQL Server

Oracle

Job description

Collaboredge Inc. is adding an ETL Data Engineer to its Enterprise Data team supporting OCTO’s Cloud Data Exchange. This onsite contract role in Washington, DC focuses on building and operationalizing cloud ETL pipelines using native Azure tools, with added support for governance, automation, monitoring, and enhancements to complex enterprise data systems.

What you’ll work on

• Analyze, design, develop, implement, replicate, and support complex enterprise data projects end to end.
• Interface with other agencies and user departments to gather and refine system requirements, and advise on environment constraints and operating difficulties.
• Support problem solving and future enhancements for District data systems using cloud solutions.
• Develop and improve ETL frameworks using tools such as Azure Data Factory, Azure Synapse, Databricks, and Informatica, based on stakeholder requirements and existing code analysis.
• Establish cloud and on-premise connectivity across systems including ADLS, ADF, Synapse, and Databricks.
• Create end-to-end pipelines that load data from multiple sources into landing layers and SQL tables.
• Standardize and optimize data workflows/pipelines in line with best practices.
• Ensure enterprise data governance standards for data accuracy, consistency, security, and reliability.
• Automate, monitor, alert on, and manage data pipelines and workflows.
• Analyze proposed system changes for feasibility, and recommend alternatives along with backup and rollback procedures.
• Develop database programs and reports using database query language.
• Support the development of new systems, upgrades, and enhancements while ensuring consistency with approved standards.
• Handle and secure sensitive data according to its level of sensitivity.

Requirements

• Strong knowledge of Extract-Transform-Load (ETL) processes, including end-to-end pipelines with data loading from multiple sources.
• Ability to gather and document requirements for data extraction, transformation, and load processes.
• Understanding of data warehousing, data lakes, business intelligence, and information management concepts and standards.
• Ability to advise internal and external customers on appropriate tools and systems for complex data processing challenges.
• Knowledge and use of SQL for relational databases.
• Experience with multiple data formats, including database-specific formats (Oracle, SQL Server, DB2, Quickbase; also includes Postgres per requirements), text formats (CSV, XML), and binary formats (Parquet, AVRO).
• Contribute to enterprise data governance standards by ensuring accuracy, consistency, security, and reliability.
• Strong experience with Microsoft Azure tools including Azure Data Factory, Synapse, SQL Database, Azure Data Lake Storage Gen2, and Blob Storage.
• Experience with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow, and FME.
• Strong communication skills, oral and written; ability to provide excellent customer service to external partners.
• Ability to work independently or as part of a larger team.
• Minimum experience: 3+ years.
• Minimum education/certification: Bachelor’s degree in Information Technology or related field or equivalent experience.

Technologies you may use

Azure Data Factory, Azure Synapse, Databricks, Informatica, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python, ADLS, ADF, SQL, Oracle, SQL Server, DB2, Quickbase, CSV, XML, Parquet, AVRO, Informatica PowerCenter, Apache NiFi, Apache Airflow, FME, MicroStrategy, Tableau, Esri ArcGIS.

Background check

• An extensive criminal history background check is required.
• Cannot submit candidates with recent histories (within the last seven years) of extensive driving, drug, robbery, or any other illegal activity.
• Any criminal activity on the background check will eliminate the candidate from consideration.
• National background checks are required; Federal background checks are NOT compliant under this contract.

Compensation: USD 59 - 72 per hourly. Location: Washington, DC (onsite). Job type: contract.