Senior Data Engineer — Azure Data & Graph Architect

Blanc Labs; Colombia; Presencial; COP 120.000.000 - 200.000.000; Jornada completa

Descripción de la vacante

Blanc Labs is seeking a senior data engineer to design and optimize scalable data pipelines and lakehouse architectures on Azure. You will implement data governance, semantic models, and graph-based data solutions, collaborating with architects and stakeholders across North and South America.

Responsibilities include building production-grade pipelines, integrating RDF/OWL, Neo4j, and Microsoft data services, and ensuring data quality and performance in the Azure stack.

Formación

• 8+ years of experience in data engineering, with a strong foundation in building production-grade data pipelines.
• Hands-on experience with the Microsoft Azure data stack — Azure Databricks, Azure Synapse Analytics, and/or Azure Data Factory in production environments.
• Hands-on experience with Databricks for data processing, transformation, and analytics workloads.
• Experience implementing data governance and cataloging using Unity Catalog.
• Practical experience with RDF and OWL for knowledge representation and ontology development.
• Hands-on experience with Neo4j or other graph database technologies.
• Experience designing semantic models and understanding of graph theory concepts.
• Proficiency in diagramming and process mapping tools such as Visio and Miro.
• Strong SQL skills and experience with Python or Scala for data engineering tasks.
• Solid understanding of data modeling principles (relational, dimensional, and graph-based).
• Strong analytical and problem-solving skills, with the ability to translate complex data relationships into clear architectural designs.
• Excellent communication skills, with the ability to work across technical and business teams.

Responsabilidades

• Design, build, and maintain scalable data pipelines and lakehouse architectures using Azure Databricks.
• Implement and manage data governance, access control, and lineage using Unity Catalog, aligned with Microsoft Purview.
• Design and develop semantic data models to represent complex business domains and relationships.
• Build and maintain knowledge graphs using RDF (Resource Description Framework) and OWL (Web Ontology Language) standards.
• Design and implement graph database solutions using Neo4j to support relationship-driven data use cases, deployed on Azure infrastructure.
• Develop ontologies and taxonomies to enable consistent data interpretation across systems.
• Translate business processes and data relationships into architecture diagrams using Visio and Miro.
• Collaborate with data architects, analysts, and business stakeholders to align data models with organizational needs across the Microsoft data ecosystem (Azure Synapse, Microsoft Fabric).
• Optimize data pipelines for performance, reliability, and scalability using Azure Data Factory and Databricks Workflows.
• Ensure data quality, consistency, and integrity across ingestion, transformation, and storage layers, including Azure Data Lake Storage (ADLS Gen2) and Delta Lake.
• Support integration of semantic and graph-based data models with downstream analytics and AI/ML applications, including Azure OpenAI Service and Azure AI Studio where applicable.
• Document data architecture, pipelines, and semantic models for cross-team visibility and maintainability.

Conocimientos

SQL

Python

Scala

Data modeling

Graph theory concepts

Communication

Analytical skills

Team collaboration

Herramientas

Azure Databricks

Azure Synapse Analytics

Azure Data Factory

Unity Catalog

Purview

Delta Lake

ADLS Gen2

Neo4j

RDF/OWL

Visio

Miro

Databricks Workflows

Descripción del empleo

Blanc Labs is seeking a senior data engineer to design and optimize scalable data pipelines and lakehouse architectures on Azure. You will implement data governance, semantic models, and graph-based data solutions, collaborating with architects and stakeholders across North and South America.

Responsibilities include building production-grade pipelines, integrating RDF/OWL, Neo4j, and Microsoft data services, and ensuring data quality and performance in the Azure stack.