Hybrid Cloud Data Platform Engineer

Eliassen Group; Dallas (TX); Hybrid; USD 86,788 - 100,564; Full time

Benefits offered by this job

Medical, Dental, and Vision benefits

401k with company matching

Life insurance

Job summary

A leading technology consulting firm is seeking a Data Engineer to join their Enterprise Data organization. This role involves designing and delivering cloud-native data solutions, focusing on platform engineering and CI/CD processes using tools like Airflow, Spark, and Kubernetes. The ideal candidate has strong programming skills in Python and experience with AWS and Azure. This hybrid position requires collaboration with global teams to create scalable data platforms and ensure high availability. A comprehensive benefits package is included.

Qualifications

• Proven experience with Airflow, Spark, and Kubernetes.
• Strong programming skills in Python.
• Understanding of cloud platforms, preferably AWS and Azure.
• Experience with Infrastructure as Code using Terraform or CloudFormation.
• Solid grasp of RDBMS concepts.
• Experience with CI/CD tools such as GitHub and Jenkins.

Responsibilities

• Design, build, and maintain data pipelines and platform services using Airflow and Spark.
• Develop Python-based solutions for data ingestion and transformation.
• Configure containerized applications on Kubernetes in AWS and Azure.
• Implement Infrastructure as Code for platform engineering.
• Establish CI/CD pipelines with tools such as GitHub and Artifactory.
• Configure monitoring and alerting for high availability.

Skills

Airflow

Spark

Kubernetes

Python

Terraform

CloudFormation

Jenkins

GitHub

RDBMS

API integration

Typescript

Tools

AWS

Azure

Job description

A leading technology consulting firm is seeking a Data Engineer to join their Enterprise Data organization. This role involves designing and delivering cloud-native data solutions, focusing on platform engineering and CI/CD processes using tools like Airflow, Spark, and Kubernetes. The ideal candidate has strong programming skills in Python and experience with AWS and Azure. This hybrid position requires collaboration with global teams to create scalable data platforms and ensure high availability. A comprehensive benefits package is included.