Data Engineer

Cloud Analytics Technologies, LLC; Alpharetta (GA); On-site; USD 120,000 - 150,000; Full time

Job summary

Cloud Analytics Technologies, LLC is seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines across cloud platforms.

You will optimize ETL/ELT workflows, work with Python, SQL, Spark, and collaborate with Data Scientists and Analysts to ensure data accuracy, security, and performance.

Qualifications

• Experience designing scalable data pipelines.
• Proficiency in Python and SQL for data processing.
• Knowledge of Spark and Big Data technologies.
• Experience with ETL/ELT and data warehousing concepts.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Build and optimize ETL/ELT workflows.
• Extract, transform, and load data from multiple sources.
• Develop data processing solutions using Python, SQL, and Spark.
• Implement data integration and data transformation processes.

Skills

Python

SQL

Spark

Data Pipelines

Tools

ETL Tools

Cloud Platforms

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Summary

We are looking for an experienced Data Engineer with strong hands-on experience in designing, developing, and maintaining scalable data pipelines and data processing solutions. The ideal candidate should have expertise in Python, SQL, ETL/ELT, cloud platforms, data warehousing, and Big Data technologies.

Design, develop, and maintain scalable data pipelines.

Build and optimize ETL/ELT workflows.

Extract, transform, and load data from multiple sources.

Develop data processing solutions using Python, SQL, and Spark.

Implement data integration and data transformation processes.

Design and maintain data warehouses and data lakes.

Work with cloud-based data engineering platforms.

Monitor and troubleshoot data pipeline performance.

Ensure data accuracy, quality, security, and reliability.

Collaborate with Data Scientists, Analysts, and Business Teams.

Optimize SQL queries and improve data processing performance.

Follow Agile methodologies and participate in technical discussions.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.