Data Engineer: API-Driven Pipelines & Data Lakes

Cloud7Works; United States; On-site; USD 100,000 - 130,000; Full time

Job summary

A leading IT solutions provider is seeking a Data Engineer to design and maintain scalable data pipelines, integrating data from various sources. Candidates should have 3-5+ years of experience in data engineering with skills in SQL and Python, and be proficient in ETL/ELT processes using tools such as Apache Airflow and Spark. This role involves working on API-driven systems and supports critical government applications. Join us for an opportunity to make a meaningful impact.

Qualifications

• 3-5+ years in data engineering or backend data systems.
• Experience leading data pipeline projects.
• Proficient in SQL and Python or Scala.

Responsibilities

• Design and maintain scalable data pipelines.
• Map, validate, and transform data sources.
• Support data integration for application lifecycle modernization.

Skills

Data pipeline optimization

ETL/ELT pipeline development

SQL

Python

Containerization

Tools

Apache Airflow

Spark

Kafka

Databricks

Docker

Job description

A leading IT solutions provider is seeking a Data Engineer to design and maintain scalable data pipelines, integrating data from various sources. Candidates should have 3-5+ years of experience in data engineering with skills in SQL and Python, and be proficient in ETL/ELT processes using tools such as Apache Airflow and Spark. This role involves working on API-driven systems and supports critical government applications. Join us for an opportunity to make a meaningful impact.