Azure Data Engineer: Build Scalable Cloud Pipelines

AlgebraIT; Austin (TX); On-site; USD 100,000 - 130,000; Full time

Job summary

AlgebraIT, a premier IT consulting firm in Austin, Texas, is looking for an experienced Azure Data Engineer to design and implement scalable data pipelines using Azure services. The ideal candidate will have a minimum of 3 years of experience and a Bachelor’s degree in Computer Science or a related field.

This role involves collaborating with data scientists, ensuring data infrastructure reliability, and optimizing data flow. Candidates must be proficient in Azure services and possess strong knowledge in Python and SQL.

Qualifications

• 3+ years of experience in data engineering.
• Proficiency in Azure services (e.g., Data Lake, Databricks, Synapse).
• Strong knowledge of Python, SQL, and data modeling.

Responsibilities

• Design, develop, and maintain data pipelines using Azure Data Factory and other Azure services.
• Collaborate with data scientists and analysts to support data initiatives.
• Ensure the reliability, availability, and performance of the data infrastructure.
• Optimize data flow and pipeline architecture.
• Implement best practices for data security and governance.
• Monitor data pipelines and troubleshoot issues as needed.
• Develop and maintain data integration solutions.
• Document data processes and workflows.
• Stay up-to-date with Azure technology advancements.
• Provide support for data-related technical issues.

Skills

Data engineering experience

Proficiency in Azure services

Knowledge of Python

Knowledge of SQL

Problem-solving skills

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure Data Factory

Azure Data Lake

Databricks

Azure Synapse

Job description

AlgebraIT, a premier IT consulting firm in Austin, Texas, is looking for an experienced Azure Data Engineer to design and implement scalable data pipelines using Azure services. The ideal candidate will have a minimum of 3 years of experience and a Bachelor’s degree in Computer Science or a related field.

This role involves collaborating with data scientists, ensuring data infrastructure reliability, and optimizing data flow. Candidates must be proficient in Azure services and possess strong knowledge in Python and SQL.