Data Solution Architect

Infinity Quest Limited; Polska; Presencial; PLN 180 000 - 300 000; Tempo integral

Resumo da oferta

Infinity Quest Limited is seeking an experienced Data Solution Architect to lead the design and implementation of advanced analytics and data solutions across Azure, Databricks, and Microsoft Fabric. You will oversee end-to-end architecture, ensuring scalable pipelines, data lakes, and real-time analytics with strong security and governance practices.

The role requires hands-on expertise with Azure Databricks, Delta Lake, and Databricks SQL, and a proven track record in cloud data ecosystems.

Qualificações

• 8+ years of experience developing data ingestion and transformation pipelines using Databricks, Synapse Notebooks, Azure Data Factory, or similar technologies.

Responsabilidades

• Lead the architecture, design, and implementation of advanced analytics solutions using Azure Databricks and Microsoft Fabric.

Conhecimentos

SQL

NoSQL

CI/CD

Cloud security

Leadership

Data modeling

Communication

Mentoring

Ferramentas

Azure Databricks

Microsoft Fabric

Delta Lake

Azure Synapse

Azure Data Factory

Power BI

Databricks SQL

Descrição da oferta de emprego

Location: Remote within Poland

Contract: 6 Months, with possible extension

We are looking for an experienced Data Solution Architect to lead the design and implementation of advanced analytics and data solutions across Azure, Databricks, and Microsoft Fabric.

Key Responsibilities

• Lead the architecture, design, and implementation of advanced analytics solutions using Azure Databricks and Microsoft Fabric.
• Design and implement solutions across Fabric Pipelines, Lakehouse, Warehouse, and Real-Time Analytics/EventHouse.
• Design and develop scalable data pipelines and ETL/ELT processes using Azure Databricks, PySpark, and related technologies.
• Work on migration of existing workloads, including Synapse, Databricks, and Data Mart solutions, to Microsoft Fabric.
• Integrate Databricks with Azure Data Lake, Azure Synapse, Azure Data Factory, and on-premise systems.
• Collaborate closely with business stakeholders and IT teams to understand requirements and deliver scalable solutions.
• Oversee end-to-end implementation, ensuring alignment with architectural standards and business requirements.
• Provide technical leadership and mentorship to data engineering teams.
• Ensure appropriate documentation of architecture, processes, and data flows.
• Apply best practices around security, governance, scalability, and code quality.
• Stay current with developments across Databricks, Microsoft Fabric, and the Azure data ecosystem.
• Strong hands-on experience with Azure Databricks, including cluster management, notebooks, and Delta Lake.
• Strong knowledge of Apache Spark, PySpark, Hadoop, and big data processing frameworks.
• Deep understanding of Azure Data Lake Storage, Azure Synapse, and Azure Data Factory.
• Strong experience with ETL/ELT, data warehousing, data lakes, and data engineering.
• Excellent SQL skills and familiarity with NoSQL databases.
• Experience with CI/CD pipelines and Git.
• Knowledge of cloud security and governance best practices.

Nice to Have

• Microsoft Fabric experience.
• Power BI for reporting and dashboarding.
• Spark Streaming and real-time data processing.
• Experience with Azure Resource Manager (ARM) templates and Infrastructure as Code (IaC).

Experience Required

• 8+ years of experience developing data ingestion and transformation pipelines using Databricks, Synapse Notebooks, Azure Data Factory, or similar technologies.
• Strong hands-on experience with Delta Tables, Delta Lake, and ADLS Gen2.
• Experience with Auto Loader and Delta Live Tables for data ingestion and transformation.
• Strong experience with Databricks SQL, including query development and optimization.
• Experience integrating Databricks with Azure Synapse, ADLS Gen2, and Power BI.
• Experience developing, optimizing, and deploying Power BI reports.
• Familiarity with modern CI/CD practices for Databricks and cloud-native data solutions.

Soft Skills

• Excellent communication and stakeholder management skills.
• Ability to explain complex technical concepts to non-technical audiences.
• Strong analytical and problem-solving skills.
• Proactive approach to identifying and resolving technical challenges.
• Strong leadership and mentoring capabilities.