Data Engineer

Quantum Technologies. LLC; Plano (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

Quantum Technologies LLC is seeking a hands-on Data Engineer to design and operate data pipelines using Python and AWS services, focusing on lakehouse and data lake platforms.

You will build ingestion and connectivity across enterprise data platforms, work with S3, Glue, Lake Formation, and CI/CD pipelines, and collaborate with platform and engineering teams to improve data quality and reliability.

Qualifications

• Proficiency in Python for building data pipelines.
• Hands-on AWS experience with S3, Glue, Lake Formation.
• Experience with data lakes and data lakehouse architectures.
• Familiarity with CI/CD tools like Jenkins and Bitbucket.
• Ability to test, troubleshoot, and maintain production pipelines.

Responsibilities

• Build and maintain data pipelines using Python and AWS services.
• Develop data ingestion and connectivity solutions for enterprise data platforms.
• Work with AWS data lake services, including S3, Glue, and Lake Formation.
• Use AWS CLI and EC2 to support data engineering workloads.
• Implement and maintain CI/CD pipelines using Jenkins and Bitbucket.
• Troubleshoot data pipeline issues and improve data quality and reliability.
• Collaborate with platform and engineering teams to support shared data services.

Skills

Python

AWS services

Data pipelines

CI/CD

Production pipelines

Tools

Snowflake

Databricks

Apache Iceberg

Terraform

PySpark

Apache Spark

Job description

Data Engineer – Python & AWS Glue Data Platforms:

We are seeking a hands‑on Data Engineer with strong Python and AWS experience to build and maintain data pipelines and connectivity solutions across enterprise data platforms. This role focuses on developing reliable data integrations and supporting data lake and lakehouse technologies rather than designing enterprise architecture.

Key Responsibilities:

• Build and maintain data pipelines using Python and AWS services.
• Develop data ingestion and connectivity solutions for enterprise data platforms.
• Work with AWS data lake services, including S3, Glue, and Lake Formation.
• Use AWS CLI and EC2 to support data engineering workloads.
• Implement and maintain CI/CD pipelines using Jenkins and Bitbucket.
• Troubleshoot data pipeline issues and improve data quality and reliability.
• Collaborate with platform and engineering teams to support shared data services.

Required Skills:

• Strong hands‑on Python programming experience.
• Practical AWS experience with S3, AWS CLI, EC2, Glue, and Lake Formation.
• Understanding of data lakes and data pipeline development.
• Experience with CI/CD pipelines, Jenkins, and Bitbucket.
• Ability to build, test, troubleshoot, and maintain production data pipelines.

Preferred Skills:

• Snowflake, Databricks, and Apache Iceberg.
• AWS Bedrock and exposure to AI agentic workflows.
• Terraform, PySpark, or Apache Spark.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.