Azure Data Engineer: ETL, Databricks & Data Lake Expert

Robotics Technologies LLC; Atlanta (GA); On-site; USD 110,000 - 140,000; Full time

Job summary

Robotics Technologies LLC is seeking an experienced Azure Data Engineer to design and maintain enterprise data pipelines and data processing solutions in a cloud environment.

You will work with large datasets using Azure Data Factory, Databricks, and Data Lake Storage to support BI and analytics initiatives, optimize SQL queries, and implement data quality processes while collaborating with BI teams.

Qualifications

• Experience with ETL/ELT data pipelines.
• Experience with Azure Data Factory and Databricks.
• Proficiency in Python and SQL.
• Knowledge of Data Lake Storage and data warehousing concepts.
• Understanding of cloud data architecture.

Responsibilities

• Design and develop ETL/ELT data pipelines.
• Build data integration solutions using Azure Data Factory.
• Work with Azure Databricks and Azure Data Lake.
• Optimize data processing workflows and SQL queries.
• Implement data quality and validation processes.
• Collaborate with analytics and business intelligence teams.

Skills

Azure Data Factory

Azure Databricks

PySpark

Python

SQL

Azure Data Lake Storage

ETL concepts

Data warehousing

Cloud data architecture

Job description

Robotics Technologies LLC is seeking an experienced Azure Data Engineer to design and maintain enterprise data pipelines and data processing solutions in a cloud environment.

You will work with large datasets using Azure Data Factory, Databricks, and Data Lake Storage to support BI and analytics initiatives, optimize SQL queries, and implement data quality processes while collaborating with BI teams.