Data Engineer

Eliassen Group; Dallas (TX); Hybrid; USD 86,788 - 100,564; Full time

Benefits offered by this job

Medical, Dental, and Vision benefits

401k with company matching

Life insurance

Job summary

A leading technology consulting firm is seeking a Data Engineer to join their Enterprise Data organization. This role involves designing and delivering cloud-native data solutions, focusing on platform engineering and CI/CD processes using tools like Airflow, Spark, and Kubernetes. The ideal candidate has strong programming skills in Python and experience with AWS and Azure. This hybrid position requires collaboration with global teams to create scalable data platforms and ensure high availability. A comprehensive benefits package is included.

Qualifications

• Proven experience with Airflow, Spark, and Kubernetes.
• Strong programming skills in Python.
• Understanding of cloud platforms, preferably AWS and Azure.
• Experience with Infrastructure as Code using Terraform or CloudFormation.
• Solid grasp of RDBMS concepts.
• Experience with CI/CD tools such as GitHub and Jenkins.

Responsibilities

• Design, build, and maintain data pipelines and platform services using Airflow and Spark.
• Develop Python-based solutions for data ingestion and transformation.
• Configure containerized applications on Kubernetes in AWS and Azure.
• Implement Infrastructure as Code for platform engineering.
• Establish CI/CD pipelines with tools such as GitHub and Artifactory.
• Configure monitoring and alerting for high availability.

Skills

Airflow

Spark

Kubernetes

Python

Terraform

CloudFormation

Jenkins

GitHub

RDBMS

API integration

Typescript

Tools

AWS

Azure

Job description

Hybrid Every Other Week onsite in Westlake, TX

Our client seeks a Data Engineer to join the Enterprise Data organization and collaborate with global engineers on cloud-native data solutions. You will design and deliver data platforms and pipelines using Airflow, Spark, Kubernetes, and Python across AWS and Azure. The role focuses on platform engineering, CI/CD, containerized deployments, and high availability to enable next-generation digital services.

Due to client requirements, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

Rate: $63.00 to $73.00/hr. w2

Responsibilities

• Design, build, and maintain data pipelines and platform services using Airflow and Spark.
• Develop Python-based solutions to enable data ingestion, transformation, and orchestration.
• Configure and deploy containerized applications on Kubernetes in AWS and Azure.
• Implement Infrastructure as Code for platform engineering using tools such as Terraform, CloudFormation, or ARM templates.
• Apply RDBMS concepts to design and optimize data models and queries.
• Establish CI/CD pipelines with tools such as GitHub, Artifactory, and Jenkins.
• Configure monitoring and alerting to ensure a highly available and reliable platform.
• Collaborate with cross-functional teams to address evolving requirements and deliver scalable solutions.
• Communicate technical decisions and influence best practices within the team.

Experience Requirements

• Proven experience with Airflow, Spark, and Kubernetes.
• Strong programming skills in Python.
• Working understanding of cloud platforms, preferably AWS and Azure.
• Hands‑on experience with Infrastructure as Code using Terraform, CloudFormation, or ARM.
• Solid grasp of RDBMS concepts and hands‑on experience.
• Strong knowledge of configuring and deploying containerized applications in public cloud environments.
• Experience with CI/CD tools such as GitHub, Artifactory, and Jenkins.
• Experience configuring alerts and monitors for high availability.
• Strong problem‑solving skills and experience working with evolving requirements.
• Strong communication and influencing skills.
• API integration experience (preferred).
• Public cloud certification in Azure or AWS (preferred).
• Typescript programming experience (preferred).