Azure Data Engineer

InterEx Group; Atlanta (GA); On-site; USD 110,000 - 150,000; Full time

Job summary

InterEx Group is seeking an experienced Data Engineer to design and implement scalable data pipelines and data warehouses in Microsoft Azure. You will collaborate with stakeholders to translate data needs into robust, secure data flows and models that deliver meaningful insights.

The role requires 5+ years in Azure-focused data engineering, strong SQL, and scripting skills (Python/Scala). You will drive data governance compliance and mentor team members on Azure data services.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, IT, or related field.
• 5+ years experience as Data Engineer with a focus on Microsoft Azure cloud services.
• Proficient in SQL and experience with scripting languages such as Python or Scala.
• Experience with data modeling, data warehousing, and building ETL pipelines.
• Familiarity with big data tools and frameworks (e.g., Hadoop, Spark) is a plus.
• Excellent problem-solving skills and the ability to work independently or as part of a team.
• Strong communication skills and the ability to work closely with both technical and non-technical staff.

Responsibilities

• Design and implement highly scalable, high-volume data pipelines and warehouses using Azure Data Factory, Azure Databricks, and other Azure services.
• Develop and maintain data models, structures, and procedures to ensure data accuracy and accessibility.
• Work closely with stakeholders to understand their data processing needs and build systems that provide meaningful insights.
• Optimize data flows and architecture to improve system performance and data quality.
• Ensure compliance with data governance and security policies.
• Provide technical guidance and training to team members and stakeholders on Azure data services and best practices.

Skills

SQL

Python

Scala

Problem solving

Communication

Independent / Teamwork

Education

Bachelor's degree

Tools

Azure Data Factory

Azure Databricks

Hadoop

Spark

ETL pipelines

Data modeling

Data warehousing

Job description

Key Responsibilities:

• Design and implement highly scalable, high-volume data pipelines and warehouses using Azure Data Factory, Azure Databricks, and other Azure services.
• Develop and maintain data models, structures, and procedures to ensure data accuracy and accessibility.
• Work closely with stakeholders to understand their data processing needs and build systems that provide meaningful insights.
• Optimize data flows and architecture to improve system performance and data quality.
• Ensure compliance with data governance and security policies.
• Provide technical guidance and training to team members and stakeholders on Azure data services and best practices.

The ideal candidate will have:

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.
• 5+ years of experience as a Data Engineer with a focus on Microsoft Azure cloud services.
• Proficient in SQL and experience with scripting languages such as Python or Scala.
• Experience with data modeling, data warehousing, and building ETL pipelines.
• Familiarity with big data tools and frameworks (e.g., Hadoop, Spark) is a plus.
• Excellent problem-solving skills and the ability to work independently or as part of a team.
• Strong communication skills and the ability to work closely with both technical and non-technical staff.