Senior Data Engineer

Blanc Labs; Colombia; Presencial; COP 120.000.000 - 200.000.000; Jornada completa

Descripción de la vacante

Blanc Labs is seeking a senior data engineer to design and optimize scalable data pipelines and lakehouse architectures on Azure. You will implement data governance, semantic models, and graph-based data solutions, collaborating with architects and stakeholders across North and South America.

Responsibilities include building production-grade pipelines, integrating RDF/OWL, Neo4j, and Microsoft data services, and ensuring data quality and performance in the Azure stack.

Formación

• 8+ years of experience in data engineering, with a strong foundation in building production-grade data pipelines.
• Hands-on experience with the Microsoft Azure data stack — Azure Databricks, Azure Synapse Analytics, and/or Azure Data Factory in production environments.
• Hands-on experience with Databricks for data processing, transformation, and analytics workloads.
• Experience implementing data governance and cataloging using Unity Catalog.
• Practical experience with RDF and OWL for knowledge representation and ontology development.
• Hands-on experience with Neo4j or other graph database technologies.
• Experience designing semantic models and understanding of graph theory concepts.
• Proficiency in diagramming and process mapping tools such as Visio and Miro.
• Strong SQL skills and experience with Python or Scala for data engineering tasks.
• Solid understanding of data modeling principles (relational, dimensional, and graph-based).
• Strong analytical and problem-solving skills, with the ability to translate complex data relationships into clear architectural designs.
• Excellent communication skills, with the ability to work across technical and business teams.

Responsabilidades

• Design, build, and maintain scalable data pipelines and lakehouse architectures using Azure Databricks.
• Implement and manage data governance, access control, and lineage using Unity Catalog, aligned with Microsoft Purview.
• Design and develop semantic data models to represent complex business domains and relationships.
• Build and maintain knowledge graphs using RDF (Resource Description Framework) and OWL (Web Ontology Language) standards.
• Design and implement graph database solutions using Neo4j to support relationship-driven data use cases, deployed on Azure infrastructure.
• Develop ontologies and taxonomies to enable consistent data interpretation across systems.
• Translate business processes and data relationships into architecture diagrams using Visio and Miro.
• Collaborate with data architects, analysts, and business stakeholders to align data models with organizational needs across the Microsoft data ecosystem (Azure Synapse, Microsoft Fabric).
• Optimize data pipelines for performance, reliability, and scalability using Azure Data Factory and Databricks Workflows.
• Ensure data quality, consistency, and integrity across ingestion, transformation, and storage layers, including Azure Data Lake Storage (ADLS Gen2) and Delta Lake.
• Support integration of semantic and graph-based data models with downstream analytics and AI/ML applications, including Azure OpenAI Service and Azure AI Studio where applicable.
• Document data architecture, pipelines, and semantic models for cross-team visibility and maintainability.

Conocimientos

SQL

Python

Scala

Data modeling

Graph theory concepts

Communication

Analytical skills

Team collaboration

Herramientas

Azure Databricks

Azure Synapse Analytics

Azure Data Factory

Unity Catalog

Purview

Delta Lake

ADLS Gen2

Neo4j

RDF/OWL

Visio

Miro

Databricks Workflows

Descripción del empleo

Blanc Labs is a premier partner for global enterprises, leading the way in digitization, automation, and the development of next-generation digital products and services. Our expertise in digital transformation powers businesses to accelerate service delivery, drive customer engagement, and foster growth.

What You'll Be Doing

• Design, build, and maintain scalable data pipelines and lakehouse architectures using Azure Databricks
• Implement and manage data governance, access control, and lineage using Unity Catalog, aligned with Microsoft Purview
• Design and develop semantic data models to represent complex business domains and relationships
• Build and maintain knowledge graphs using RDF (Resource Description Framework) and OWL (Web Ontology Language) standards
• Design and implement graph database solutions using Neo4j to support relationship-driven data use cases, deployed on Azure infrastructure
• Develop ontologies and taxonomies to enable consistent data interpretation across systems
• Translate business processes and data relationships into architecture diagrams using Visio and Miro
• Collaborate with data architects, analysts, and business stakeholders to align data models with organizational needs across the Microsoft data ecosystem (Azure Synapse, Microsoft Fabric)
• Optimize data pipelines for performance, reliability, and scalability using Azure Data Factory and Databricks Workflows
• Ensure data quality, consistency, and integrity across ingestion, transformation, and storage layers, including Azure Data Lake Storage (ADLS Gen2) and Delta Lake
• Support integration of semantic and graph-based data models with downstream analytics and AI/ML applications, including Azure OpenAI Service and Azure AI Studio where applicable
• Document data architecture, pipelines, and semantic models for cross-team visibility and maintainability
• 8+ years of experience in data engineering, with a strong foundation in building production-grade data pipelines
• Required: Hands-on experience with the Microsoft Azure data stack — Azure Databricks, Azure Synapse Analytics, and/or Azure Data Factory in production environments
• Hands-on experience with Databricks for data processing, transformation, and analytics workloads
• Experience implementing data governance and cataloging using Unity Catalog
• Practical experience with RDF and OWL for knowledge representation and ontology development
• Hands-on experience with Neo4j or other graph database technologies
• Experience designing semantic models and understanding of graph theory concepts
• Proficiency in diagramming and process mapping tools such as Visio and Miro
• Strong SQL skills and experience with Python or Scala for data engineering tasks
• Solid understanding of data modeling principles (relational, dimensional, and graph-based)
• Strong analytical and problem-solving skills, with the ability to translate complex data relationships into clear architectural designs
• Excellent communication skills, with the ability to work across technical and business teams

Preferred Qualifications

• Experience with SPARQL query language for RDF data
• Familiarity with additional Azure data services — Azure SQL Database, Microsoft Fabric, Azure Event Hubs
• Experience integrating semantic/graph data with AI, ML, or GenAI applications, particularly via Azure OpenAI Service
• Knowledge of metadata management and enterprise data governance frameworks, including Microsoft Purview
• Microsoft certifications (e.g., Azure Data Engineer Associate, Fabric Analytics Engineer Associate) considered a strong plus
• Experience working in Agile/Scrum environments

Blanc Labs is enabling a digital future. Headquartered in Toronto, we partner with clients in North & South America to digitize and automate their operations and build their next generation of digital products and services. We empower clients to enhance their digital offerings and bring creative solutions to the market faster. Learn more at www.blanclabs.com.

Blanc Labs is an equal opportunity employer and is committed to providing employment in accordance with the Ontario Human Rights Code and the Accessibility for Ontarians with Disabilities Act. Accommodations within reason due to a disability or medical need are available on request for candidates taking part in the recruitment process.