We are seeking a highly skilled and analytical Data Engineer to design, build, and optimize scalable data solutions. In this role, you will be responsible for the end-to-end data lifecycle transforming raw data into trusted, governed, and consumable data products. You will leverage Microsoft Fabric and Azure Data platforms to enable advanced analytics and self-service BI, ensuring that our data architecture directly supports the organization's strategic measurement goals and decision-making processes.
Responsibilities
- Data Engineering & Platform Development: Design, build, and maintain robust ETL/ELT pipelines. Implement scalable data solutions using Microsoft Fabric and Azure. Deploy containerized data services (Azure App Containers/Kubernetes).
- Data Modelling & Architecture: Architect dimensional models (Star/Snowflake schemas) and maintain semantic models, data marts, and tabular datasets in alignment with enterprise governance standards.
- BI & Analytics Enablement: Develop advanced Power BI dashboards and datasets. Champion self-service BI by creating governed, user-friendly data layers.
- Advanced Data Processing: Utilize Python and Spark-based frameworks to process large-scale datasets and support data science and decision science initiatives.
- Data Governance & Quality: Ensure high data integrity and lineage. Implement proactive monitoring, logging, and security controls across all data pipelines.
- Agile Collaboration: Work within cross-functional Agile squads to deliver end-to-end data products, collaborating closely with Architects, Analysts, and business stakeholders.
Required Skills and Qualifications:
- Mastery of DAX, complex data modelling, and report visualization.
- Strong Python skills for data engineering, API integration, and automation.
- Expert level T-SQL and comprehensive experience in ETL/ELT development.
- Experience with containerization (Docker/Kubernetes) and Spark-based processing.
- Strong understanding of Kimball methodology, star schemas, data warehousing, and data lake architectures.
- 5+ years of experience in BI, Data Engineering, or Data Analytics roles.
- Degree in Computer Science, Data Engineering, Information Technology, Applied Mathematics, or a related field.
Preferred Qualifications:
- Experience with Data Virtualization tools (e.g., Denodo).
- Experience with enterprise orchestration tools (e.g., Ab Initio).
- Proven proficiency in DevOps practices applied to data pipelines (CI/CD for data).
- Relevant certifications in Azure Data Engineering, Microsoft Fabric, or Power BI.
Work Environment/Benefits:
- Opportunity to work on next-generation cloud platforms (Microsoft Fabric).
- Play a critical role in shaping the data strategy of a data-driven organization.
- Exposure to the full spectrum of data roles, from engineering and warehousing to advanced analytics and BI.
- Work in a highly supportive Agile environment that values innovation, technical excellence, and continuous improvement.
Skills
Docker Python T-SQL Power BI DAX Kubernetes API Integration Data Warehousing Data Modeling microsoft fabric data lake spark Synapse Databricks ADF ETL/ELT Kimball Methodology Azure Data Platform Lakehouse