Azure Data Engineer

InterEx Group; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

InterEx Group is seeking a Data Engineer to design scalable pipelines and Azure-based data warehouses. You will model data, ensure accuracy, and collaborate with stakeholders to deliver meaningful insights.

The ideal candidate has strong SQL skills, Python/Scala scripting experience, and know-how in ETL, data warehousing, and big data tools like Hadoop and Spark. Excellent problem-solving and communication are essential.

Qualifications

• Bachelor's degree in Computer Science, Engineering, IT or related field.
• 5+ years as a Data Engineer with a focus on Microsoft Azure cloud services.
• Proficient in SQL and scripting in Python or Scala.
• Experience with data modeling, data warehousing, and ETL pipelines.
• Familiarity with Hadoop and Spark is a plus.
• Excellent problem-solving and ability to work independently or in a team.
• Strong communication skills across technical and non-technical staff.

Responsibilities

• Design and implement scalable data pipelines and warehouses on Azure.
• Develop data models, structures, and procedures for data accuracy.
• Collaborate with stakeholders to translate data needs into systems.
• Optimize data flows and architecture for performance and quality.
• Ensure compliance with data governance and security policies.
• Provide guidance and training on Azure data services and best practices.

Skills

Data pipelines

Data modeling

SQL

Python

Scala

ETL pipelines

Spark

Hadoop

Big data

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field

Tools

Azure Data Factory

Azure Databricks

SQL

Python

Scala

Hadoop

Spark

Job description

Key Responsibilities:

• Design and implement highly scalable, high-volume data pipelines and warehouses using Azure Data Factory, Azure Databricks, and other Azure services.
• Develop and maintain data models, structures, and procedures to ensure data accuracy and accessibility.
• Work closely with stakeholders to understand their data processing needs and build systems that provide meaningful insights.
• Optimize data flows and architecture to improve system performance and data quality.
• Ensure compliance with data governance and security policies.
• Provide technical guidance and training to team members and stakeholders on Azure data services and best practices.

The ideal candidate will have:

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
• 5+ years of experience as a Data Engineer with a focus on Microsoft Azure cloud services.
• Proficient in SQL and experience with scripting languages such as Python or Scala.
• Experience with data modeling, data warehousing, and building ETL pipelines.
• Familiarity with big data tools and frameworks (e.g., Hadoop, Spark) is a plus.
• Excellent problem-solving skills and the ability to work independently or as part of a team.
• Strong communication skills and the ability to work closely with both technical and non-technical staff.