Azure Data Engineer

Intellinexus; Cape Town; Remote; ZAR 600,000 - 900,000; Full time

Job summary

Intellinexus is looking for a Data Engineer to design and maintain data infrastructures that empower data-driven decision-making. The role requires collaboration with stakeholders to gather requirements, and involves responsibilities like optimizing data pipelines and ensuring data quality. Strong qualifications in data warehousing and proficiency in SQL along with experience in big data technologies are essential. Opportunities for remote work, career development, and exposure to cutting-edge solutions are provided.

Benefits

Remote and hybrid work opportunities

Support for career development and growth

Exposure to various technologies, solutions, and techniques

Qualifications

• Minimum of 5 years' experience in data engineering or related roles.
• Strong understanding of data warehousing, ETL, and data modeling.
• Proficient in SQL and data querying.

Responsibilities

• Design and maintain data infrastructure to support data needs.
• Develop data pipelines for extracting, transforming, and loading data.
• Ensure data solutions are secure and compliant with governance standards.

Skills

Data warehousing

ETL

Data modeling

SQL

Problem-solving

Communication

Teamwork

Education

Bachelor's degree in Commerce, Computer Science, Data Science, Engineering or related field

Tools

AWS S3

Azure Blob Storage

Azure Data Factory

Azure Data Lake

Azure Synapse Analytics

Azure Databricks

SAP BIP architecture

SAP BusinessObjects Cloud

GitLab

Azure DevOps

Python

Java

Scala

Job description

Intellinexus is a business-led data and business intelligence consultancy that empowers organizations with data-driven decision-making capabilities.

We combine innovation and expertise with access to the best talent to help organizations become smarter, more agile, and more resilient to changes in their operating environments.

Our expert teams apply mastery of data and technology to craft strategies that revolutionize business decision-making and provide organizations with real-time, actionable insights into their performance.

What do we offer?

• Remote and hybrid work opportunities.
• Exposure to various technologies, solutions, and techniques during projects, as we are an SME.
• Support for career development and growth, with investment in our consultants' professional growth.

Overall purpose of the role

The Data Engineer is responsible for designing, building, and maintaining the data infrastructure that supports the organization's data needs. They will collaborate with various teams to gather requirements, develop data pipelines, and ensure data quality and accessibility for analysis and reporting.

Duties & Responsibilities

1. Work with business stakeholders and data analysts to understand data requirements and design scalable data architectures.
2. Develop and maintain data pipelines for extracting, transforming, and loading data from various sources.
3. Design data models and schemas to support efficient querying and analysis.
4. Implement data validation, cleansing, and enrichment processes to ensure data quality.
5. Optimize data pipelines and storage solutions for performance and scalability.
6. Collaborate with other teams to integrate data solutions with existing systems.
7. Ensure data solutions are secure, compliant, and meet governance standards.
8. Provide documentation and support for data engineering solutions.

Desired Experience & Qualifications

• Bachelor's degree in Commerce, Computer Science, Data Science, Engineering, or related field.
• Minimum of 5 years' experience in data engineering or related roles.
• Strong understanding of data warehousing, ETL, and data modeling.
• Experience with big data technologies and cloud storage solutions (AWS S3, Azure Blob Storage).
• Proficient in SQL and data querying.
• Experience with Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, and Azure Databricks.
• Knowledge of SAP BIP architecture and SAP systems like SAP ERP, SAP BW, SAP HANA.
• Experience with SAP BusinessObjects Cloud, Lumira, or SAP Analytics Cloud is a plus.
• Experience with CI/CD pipelines using GitLab, Azure DevOps.
• Proficiency in Python, Java, or Scala.
• Strong problem-solving, analytical, communication, and teamwork skills.
• Ability to work independently and collaboratively.

Interested?

We aim to help you build a successful career with us. We believe in building strong, lasting relationships with our employees and supporting your personal and professional growth through opportunities with Intellinexus and our clients.