Data Engineer: Python & AWS Glue Pipelines

Valiant Technologies LLC; Plano (TX); Sur place; USD 105 000 - 145 000; Plein temps

Résumé du poste

Valiant Technologies LLC in Plano, TX is seeking a hands-on Data Engineer with strong Python and AWS experience to build and maintain data pipelines and connectivity across enterprise data platforms.

The role emphasizes practical data integration, data lake/lakehouse support, CI/CD pipelines with Jenkins and Bitbucket, and collaboration with platform and engineering teams to ensure reliable data services.

Qualifications

• Strong hands-on Python programming experience.
• Practical AWS experience with S3, AWS CLI, EC2, Glue, and Lake Formation.
• Understanding of data lakes and data pipeline development.
• Experience with CI/CD pipelines, Jenkins, and Bitbucket.
• Ability to build, test, troubleshoot, and maintain production data pipelines.

Responsabilités

• Build and maintain data pipelines using Python and AWS services.
• Develop data ingestion and connectivity solutions for enterprise data platforms.
• Work with AWS data lake services, including S3, Glue, and Lake Formation.
• Use AWS CLI and EC2 to support data engineering workloads.
• Implement and maintain CI/CD pipelines using Jenkins and Bitbucket.
• Troubleshoot data pipeline issues and improve data quality and reliability.
• Collaborate with platform and engineering teams to support shared data services.

Connaissances

Python

AWS

Data pipelines

CI/CD

Outils

AWS CLI

Jenkins

Bitbucket

S3

EC2

Glue

Lake Formation

Description du poste

Valiant Technologies LLC in Plano, TX is seeking a hands-on Data Engineer with strong Python and AWS experience to build and maintain data pipelines and connectivity across enterprise data platforms.

The role emphasizes practical data integration, data lake/lakehouse support, CI/CD pipelines with Jenkins and Bitbucket, and collaboration with platform and engineering teams to ensure reliable data services.