Data Engineer

Machine Learning Technologies, LLC; Alpharetta (GA); On-site; USD 110,000 - 170,000; Full time

Job summary

Machine Learning Technologies, LLC is seeking an experienced Data Engineer with hands-on experience in designing, developing, and maintaining scalable data pipelines and processing solutions.

The role emphasizes Python, SQL, ETL/ELT, cloud platforms, data warehousing, and Big Data technologies, with collaboration across Data Scientists, Analysts, and business teams.

Qualifications

• Strong hands-on experience in designing, developing, and maintaining scalable data pipelines and data processing solutions.
• Design, develop, and maintain scalable data pipelines.
• Build and optimize ETL/ELT workflows.
• Extract, transform, and load data from multiple sources.
• Develop data processing solutions using Python, SQL, and Spark.
• Implement data integration and data transformation processes.
• Design and maintain data warehouses and data lakes.
• Work with cloud-based data engineering platforms.
• Monitor and troubleshoot data pipeline performance.
• Ensure data accuracy, quality, security, and reliability.
• Collaborate with Data Scientists, Analysts, and Business Teams.
• Optimize SQL queries and improve data processing performance.
• Follow Agile methodologies and participate in technical discussions.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Build and optimize ETL/ELT workflows.
• Extract, transform, and load data from multiple sources.
• Develop data processing solutions using Python, SQL, and Spark.
• Design and maintain data warehouses and data lakes.
• Monitor and troubleshoot data pipeline performance.
• Collaborate with Data Scientists, Analysts, and Business Teams.

Skills

Python

SQL

ETL/ELT

Cloud platforms

Data warehousing

Big Data

Agile

Tools

Spark

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Summary

We are looking for an experienced Data Engineer with strong hands-on experience in designing, developing, and maintaining scalable data pipelines and data processing solutions. The ideal candidate should have expertise in Python, SQL, ETL/ELT, cloud platforms, data warehousing, and Big Data technologies.

Design, develop, and maintain scalable data pipelines.

Build and optimize ETL/ELT workflows.

Extract, transform, and load data from multiple sources.

Develop data processing solutions using Python, SQL, and Spark.

Implement data integration and data transformation processes.

Design and maintain data warehouses and data lakes.

Work with cloud-based data engineering platforms.

Monitor and troubleshoot data pipeline performance.

Ensure data accuracy, quality, security, and reliability.

Collaborate with Data Scientists, Analysts, and Business Teams.

Optimize SQL queries and improve data processing performance.

Follow Agile methodologies and participate in technical discussions.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.