Data Pipeline Automation Engineer – API & Cloud

Edgewaterit; Albuquerque (NM); On-site; USD 110,000 - 160,000; Full time

Job summary

Edgewater Federal Solutions is seeking an Automation Engineer to support a major national laboratory. The role requires expertise in automation tools, orchestration, and API-driven data integration across diverse data platforms.

You will design and implement scalable data pipelines, work with on-premises databases and cloud services, and collaborate with stakeholders to ensure data quality and security. This on-site position is in Albuquerque, NM.

Qualifications

• BS in a relevant field with 3+ years of data engineering experience.
• Must be able to obtain and maintain a DOE Security Clearance.
• US citizenship and Albuquerque residence are required.

Responsibilities

• Evaluate and recommend data ingestion and pipeline tools to support scalable data workflows.
• Design and implement data pipelines to ingest, process, and transform structured and unstructured data from diverse sources.
• Develop and manage data orchestration workflows to automate and monitor complex data pipelines.
• Design, develop, and maintain APIs to enable data integration across platforms.
• Work with on-premises and cloud databases and platforms (Oracle, MongoDB, AWS, Azure, GCP).
• Integrate data pipelines with various applications for seamless data flow.
• Collaborate with DBAs, solution architects, and stakeholders to meet data requirements.
• Implement and manage Denodo data virtualization or similar solutions.
• Ensure data quality, security, and compliance across the data lifecycle.
• Document processes, architectures, and best practices for data engineering workflows

Skills

Python

SQL

REST API

ETL/ELT

Data Engineering

Problem Solving

Education

BS in relevant field

Tools

dbt

PySpark

Airflow

Prefect

Luigi

Denodo

MongoDB

Oracle

Job description

Edgewater Federal Solutions is seeking an Automation Engineer to support a major national laboratory. The role requires expertise in automation tools, orchestration, and API-driven data integration across diverse data platforms.

You will design and implement scalable data pipelines, work with on-premises databases and cloud services, and collaborate with stakeholders to ensure data quality and security. This on-site position is in Albuquerque, NM.