Data Engineer: Cloud Pipelines, ETL & Data Warehousing

MACHINE LEARNING TECHNOLOGIES LLC; Atlanta (GA); On-site; USD 110,000 - 160,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Atlanta, GA is seeking a Data Engineer to design, build, and maintain scalable data pipelines using Python and SQL, with emphasis on cloud-based data platforms and ETL/ELT processes.

The role involves data warehousing, collaboration with data analysts and business teams, and handling both structured and unstructured datasets in a government domain. 22 months + extension, W-2/1099/C2C options may apply.

Qualifications

• Strong programming skills in Python and SQL.
• Experience building scalable data pipelines and ETL/ELT processes.
• Familiarity with data warehousing concepts and data modeling.
• Hands-on experience with cloud platforms (AWS or Azure).
• Knowledge of PySpark and Apache Spark is a plus.
• Ability to collaborate with data analysts and business teams.

Responsibilities

• Develop and maintain scalable data pipelines using Python.
• Design and implement ETL processes for data integration.
• Write and optimize complex SQL queries.
• Perform data extraction, transformation, and loading.
• Develop data validation and quality-checking processes.
• Collaborate with data analysts and business teams.
• Support data warehouse development and maintenance.

Skills

Python

SQL

PySpark

Apache Spark

ETL

Data Warehousing

AWS

Azure

Data Pipelines

Tools

PySpark

Apache Spark

AWS

Azure

Job description

MACHINE LEARNING TECHNOLOGIES LLC in Atlanta, GA is seeking a Data Engineer to design, build, and maintain scalable data pipelines using Python and SQL, with emphasis on cloud-based data platforms and ETL/ELT processes.

The role involves data warehousing, collaboration with data analysts and business teams, and handling both structured and unstructured datasets in a government domain. 22 months + extension, W-2/1099/C2C options may apply.