Data Engineer – Pipelines, ETL & Cloud (AWS/Azure)

Quantum Technologies. LLC; Atlanta (GA); On-site; USD 100,000 - 150,000; Full time

Job summary

Quantum Technologies. LLC is seeking a Data Engineer to design, develop, and maintain reliable data pipelines and processing solutions. The role emphasizes Python and SQL proficiency, ETL/ELT expertise, and work with data warehousing on cloud platforms such as AWS or Azure.

You will build scalable pipelines, optimize queries, and ensure data quality while collaborating with data analysts and business teams. Experience with PySpark or Spark is a plus.

Qualifications

• Proficiency in Python and SQL.
• Experience with PySpark or Apache Spark is preferred.
• Knowledge of ETL/ELT concepts and data warehousing.

Responsibilities

• Develop and maintain scalable data pipelines using Python.
• Design and implement ETL processes for data integration.
• Write and optimize complex SQL queries.
• Perform data extraction, transformation, and loading.
• Develop data validation and quality-checking processes.
• Work with structured and unstructured datasets.
• Support data warehouse development and maintenance.
• Collaborate with data analysts and business teams.

Skills

Python

SQL

PySpark

ETL

Data Warehousing

AWS

Azure

Data Modeling

Data Pipelines

Job description

Quantum Technologies. LLC is seeking a Data Engineer to design, develop, and maintain reliable data pipelines and processing solutions. The role emphasizes Python and SQL proficiency, ETL/ELT expertise, and work with data warehousing on cloud platforms such as AWS or Azure.

You will build scalable pipelines, optimize queries, and ensure data quality while collaborating with data analysts and business teams. Experience with PySpark or Spark is a plus.