Data Engineer with Azure Devops in FABRIC environment

Principal33 Group; Snowflake (AZ); Remote; USD 80,000 - 120,000; Full time

Job summary

A leading company is seeking an experienced Data Engineer skilled in Azure DevOps within a FABRIC environment. This remote role involves collaboration with teams to optimize a data reporting platform and demands expertise in data architecture, ETL processes, and cloud services. The ideal candidate will be self-motivated and possess strong problem-solving abilities, along with a passion for developing robust data solutions.

Benefits

Medical insurance for you and your family.

Holiday flat in Valencia for your getaways.

Monthly massages and themed lunches.

Access to Udemy Learning Platform for skill development.

Qualifications

• Hands-on experience with ETL architecture and data modeling.
• Experience with Python and SQL for data processing and debugging.
• Familiarity with Microsoft Azure and DevOps practices.

Responsibilities

• Collaborate with cross-functional teams to support the data reporting platform.
• Conduct thorough testing, debugging, and documentation of changes.
• Provide technical support and training to team members.

Skills

ETL/Data Warehouse

Design and architecture

Developing and maintaining DevOps pipelines

Tools

Jira

Confluence

Azure

Databricks

Job description

Data Engineer with Azure Devops in FABRIC environment

Work with us, and join a community of happy employees.

Mandatory Language

Job Description

This is a remote position.

We are seeking an experienced Data Engineer with Azure Devops in the Microsoft Fabric environment. The successful candidate will be self-motivated and capable of working independently.

Responsibilities

• Collaborate with cross-functional teams to support our data reporting platform and troubleshoot issues.
• Diagnose and resolve application issues.
• Conduct thorough testing, debugging, and documentation of changes.
• Collaborate with development teams to escalate and prioritize critical issues.
• Assist in the deployment and configuration of application updates.
• Provide technical support and training to team members when necessary.
• Maintain accurate records of support requests and resolutions.

Requirements

Skill set:

• ETL/Data Warehouse
• Design and architecture
• Developing and maintaining DevOps pipelines
• Hands-on experience with Jira and Confluence
• Release management in JIRA

Tools and Technologies:

• ETL Architecture – Delta, Lambda, Data Mesh, Hub & Spoke
• Data Modeling – Relational (3NF, Data Vault), Dimensional (Star/Snowflake/Galaxy Schema)
• Cloud – Microsoft Azure and Basics of GCP
• Unit/Integration/Lint testing – Pytest with coverage.py, flake8 / pep8

Technical:

• Requirement analysis and participation in design discussions for optimal data warehouse design.
• Develop codebase using Python, Spark, or other ETL/Big Data tools like Databricks to meet business requirements.
• Produce complex SQL queries for debugging, troubleshooting, and data processing.
• Develop lint tests to ensure coding standards.
• Create utilities with PowerShell for automation in Azure.
• Develop DevOps pipelines with Azure YAML, Jenkins for CI/CD.
• Act as a data architect for complex data solutions.
• Design and plan modern data platforms using Medallion architecture.
• Prepare data architecture blueprints.
• Support QA and end-to-end testing to ensure quality.
• Plan and execute releases using Octopus Deploy.
• Support deployment on UAT and production environments, resolving technical issues.

Benefits

• Medical insurance for you and your family.
• Holiday flat in Valencia for your getaways.
• Gifts for special occasions and anniversaries.
• Team-building events and end-of-year celebrations.
• Day off on your birthday.
• Monthly massages and themed lunches.
• Community and social initiatives.
• Access to Udemy Learning Platform for skill development.
• German language courses and upcoming SAP training.
• Support for personal and professional growth through masterclasses and courses.