Senior Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC

Atlanta (GA)

Hybrid

USD 93,000 - 133,000

Full time

10 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Senior Data Engineer in Atlanta (Hybrid) to design, develop and optimize scalable data pipelines using Python, PySpark, and SQL. You will build ETL/ELT workflows, work with cloud platforms, and ensure data quality across large datasets.

The role requires 7+ years in data engineering, experience with Spark, Airflow, and modern data warehousing concepts. Collaboration with analysts and architects is essential for delivering robust data solutions.

Qualifications

  • 7+ years of experience in data engineering.
  • Strong hands-on experience with Python and PySpark.
  • Expertise in SQL and database development.
  • Experience with Apache Spark and distributed data processing.
  • Knowledge of ETL/ELT development.
  • Experience with AWS, Azure, or GCP.
  • Knowledge of data warehousing concepts and data modeling.
  • Experience with Apache Airflow or similar orchestration tools.
  • Familiarity with Git and CI/CD pipelines.
  • Strong analytical and problem-solving skills.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Python and PySpark.
  • Build and optimize ETL/ELT workflows for structured and unstructured data.
  • Develop SQL queries and optimize database performance.
  • Process large datasets using Apache Spark.
  • Integrate data from multiple sources into centralized data platforms.
  • Develop data transformation and validation processes.
  • Implement data quality checks and monitoring solutions.
  • Work with cloud-based data storage and processing services.
  • Optimize data processing workflows for performance and scalability.
  • Collaborate with data analysts, architects, and application development teams.
  • Troubleshoot data pipeline failures and resolve production issues.
  • Maintain technical documentation and follow data engineering best practices.

Skills

Python
PySpark
SQL
Apache Spark
Airflow
CI/CD
Git
Data warehousing
ETL/ELT
Cloud platforms

Tools

AWS
Azure
GCP

Job description

Job Description

We are seeking an experienced Senior Data Engineer with strong expertise in Python, PySpark, SQL, and cloud-based data engineering technologies. The ideal candidate will be responsible for designing and implementing scalable data pipelines, processing large datasets, and developing reliable data integration solutions.

Job Overview

Job ID: J55003

Job Title: Senior Data Engineer

Job Title: Senior Data Engineer (Python / PySpark)

Location: Atlanta, GA

Location: Atlanta, GA (Hybrid)

Duration: 12 Months + Extension

Duration: 12 Months Contract

Domain Exposure: Telecom

Client: To Be Discussed Later

Employment Type: W-2, 1099, C2C

Client: To be Disclosed

Job Type: W-2, 1099, C2C

Bill Rate: $82/hr

Work Authorization: US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Roles And Responsibilities
  • Design, develop, and maintain scalable data pipelines using Python and PySpark.
  • Build and optimize ETL and ELT workflows for structured and unstructured data.
  • Develop complex SQL queries and optimize database performance.
  • Process large datasets using Apache Spark.
  • Integrate data from multiple sources into centralized data platforms.
  • Develop data transformation and validation processes.
  • Implement data quality checks and monitoring solutions.
  • Work with cloud-based data storage and processing services.
  • Optimize data processing workflows for performance and scalability.
  • Collaborate with data analysts, architects, and application development teams.
  • Troubleshoot data pipeline failures and resolve production issues.
  • Maintain technical documentation and follow data engineering best practices.
Required Skills
  • 7+ years of experience in data engineering.
  • Strong hands-on experience with Python and PySpark.
  • Expertise in SQL and database development.
  • Experience with Apache Spark and distributed data processing.
  • Strong knowledge of ETL/ELT development.
  • Experience with AWS, Azure, or GCP.
  • Knowledge of data warehousing concepts and data modeling.
  • Experience with Apache Airflow or similar orchestration tools.
  • Familiarity with Git and CI/CD pipelines.
  • Strong analytical and problem-solving skills.
Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Quantum Technologies LLC • Atlanta (GA)

Hybrid
USD 93,000 - 133,000
Data Engineer
Data Engineer

Ethereum Technologies LLC • Charlotte (NC)

On-site
USD 82,000 - 117,000
Data Engineer
Data Engineer

Robotic Process Automation LLC • Charlotte (NC)

On-site
USD 84,000 - 114,000
Data Engineer
Data Engineer

Ethereum Technologies LLC • Charlotte (NC)

On-site
USD 120,000 - 180,000
Data Engineer
Data Engineer

Valiant Technologies LLC • Charlotte (NC)

On-site
USD 120,000 - 190,000
Data Engineer
Data Engineer

Robotics Technologies LLC • Charlotte (NC)

On-site
USD 120,000 - 170,000
Data Engineer
Data Engineer

Quantum Technologies LLC • Charlotte (NC)

On-site
USD 120,000 - 170,000
Senior Data Engineer – Databricks & AWS
Senior Data Engineer – Databricks & AWS

Valiant Technologies LLC • Sunnyvale (CA)

On-site
USD 83,000 - 103,000
Senior Data Engineer – Databricks & AWS
Senior Data Engineer – Databricks & AWS

Robotic Process Automation LLC • Sunnyvale (CA)

On-site
USD 83,000 - 102,000
Senior Data Engineer – Databricks & AWS
Senior Data Engineer – Databricks & AWS

Quantum Technologies LLC • Sunnyvale (CA)

On-site
USD 76,000 - 108,000