Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC; Atlanta (GA); On-site; USD 110,000 - 160,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Atlanta, GA is seeking a Data Engineer to design, build, and maintain scalable data pipelines using Python and SQL, with emphasis on cloud-based data platforms and ETL/ELT processes.

The role involves data warehousing, collaboration with data analysts and business teams, and handling both structured and unstructured datasets in a government domain. 22 months + extension, W-2/1099/C2C options may apply.

Qualifications

• Strong programming skills in Python and SQL.
• Experience building scalable data pipelines and ETL/ELT processes.
• Familiarity with data warehousing concepts and data modeling.
• Hands-on experience with cloud platforms (AWS or Azure).
• Knowledge of PySpark and Apache Spark is a plus.
• Ability to collaborate with data analysts and business teams.

Responsibilities

• Develop and maintain scalable data pipelines using Python.
• Design and implement ETL processes for data integration.
• Write and optimize complex SQL queries.
• Perform data extraction, transformation, and loading.
• Develop data validation and quality-checking processes.
• Collaborate with data analysts and business teams.
• Support data warehouse development and maintenance.

Skills

Python

SQL

PySpark

Apache Spark

ETL

Data Warehousing

AWS

Azure

Data Pipelines

Tools

PySpark

Apache Spark

AWS

Azure

Job description

Job Overview

Job ID: J53675

Job Title: Data Engineer

Location: Atlanta, GA

Duration: 22 Months + Extension

Domain Exposure: Government

Work Authorization: US Citizen,Green Card,OPT-EAD,CPT,H-1B,H4-EAD,L2-EAD,GC-EAD

Client: To Be Discussed Later

Employment Type: W-2, 1099, C2C

Job Description

We are looking for a Data Engineer to design, develop, and maintain reliable data pipelines and data processing solutions. The ideal candidate should have strong programming skills in Python and SQL, along with knowledge of data warehousing, ETL processes, and cloud-based data platforms.

Key Responsibilities

• Develop and maintain scalable data pipelines using Python.


• Design and implement ETL processes for data integration.


• Write and optimize complex SQL queries.


• Perform data extraction, transformation, and loading.


• Develop data validation and quality-checking processes.


• Work with structured and unstructured datasets.


• Support data warehouse development and maintenance.


• Collaborate with data analysts and business teams.


• Strong programming knowledge in Python.


• Proficiency in SQL and database management.


• Understanding of ETL and ELT processes.


• Knowledge of data warehousing concepts.


• Familiarity with Apache Spark or PySpark.


• Understanding of cloud platforms such as AWS or Azure.


• Knowledge of data modeling and data integration.


• Strong analytical and problem-solving skills.

Technical Environment

Required Skills & Qualifications:

• Python


• SQL


• PySpark


• Apache Spark


• ETL


• Data Warehousing


• AWS


• Azure


• Data Pipelines

Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.