Automation Engineer: Data Pipelines & API Orchestration

Edgewater Federal Solutions, Inc.; Albuquerque (NM); On-site; USD 90,000 - 120,000; Full time

Job summary

Edgewater Federal Solutions is seeking an Automation Engineer to support a major national laboratory in Albuquerque. The role focuses on automating data workflows, integrating REST APIs, and building scalable data pipelines using tools like Ansible, Puppet, Chef, and cloud services.

Ideal candidates will have 3+ years in data engineering, strong Python/SQL skills, and experience with ETL/ELT, data virtualization (Denodo preferred), and API design for data integration.

Qualifications

• BS in a relevant discipline with 3+ years of related experience.
• Must be able to obtain and maintain a DOE Security Clearance.
• US citizen, onsite work in Albuquerque area.

Responsibilities

• Evaluate and recommend data ingestion and pipeline tools to support scalable data workflows.
• Design and implement data pipelines to ingest, process, and transform structured and unstructured data.
• Develop and manage data orchestration workflows to automate complex pipelines.
• Design, develop, and maintain APIs to enable data integration across platforms.
• Work with on-prem and cloud platforms (AWS, Azure, GCP) to support data architectures.
• Integrate data pipelines with various applications for seamless data flow.
• Collaborate with DBAs, solution architects, and stakeholders to meet data requirements.
• Implement and manage data virtualization, with Denodo experience preferred.
• Ensure data quality, security, and compliance throughout the lifecycle.
• Document processes and architectures for data engineering workflows.

Skills

Python

SQL

REST APIs

ETL/ELT

Data engineering

Problem solving

Education

Bachelor's degree in a relevant field

Tools

Denodo

Apache Airflow

Prefect

Luigi

Hadoop

Spark

Kafka

AWS

Azure

GCP

Job description

Edgewater Federal Solutions is seeking an Automation Engineer to support a major national laboratory in Albuquerque. The role focuses on automating data workflows, integrating REST APIs, and building scalable data pipelines using tools like Ansible, Puppet, Chef, and cloud services.

Ideal candidates will have 3+ years in data engineering, strong Python/SQL skills, and experience with ETL/ELT, data virtualization (Denodo preferred), and API design for data integration.