Senior Data Platform Engineer

MPS Group LLC; Bogotá ciudad; Presencial; COP 200.880.000 - 357.120.000; Jornada completa

Descripción de la vacante

MPS Group LLC is seeking a Senior Data Platform Engineer to join a team evaluating and enabling adoption of Microsoft and Databricks capabilities across the enterprise data platform. You will lead hands-on engineering, build reusable integrations, and run proof-of-concepts to validate scalability, governance, and value.

You will partner with platform teams to set standards for data governance, observability, AI-assisted operations, and automation, documenting findings for stakeholders and

Formación

• Must have hands-on experience with Databricks Unity Catalog and data governance concepts.
• Proficient in Python/Java/Scala and cloud-based data platforms.
• Experience designing and evaluating platform integrations and POCs.

Responsabilidades

• Evaluate new Azure and Databricks capabilities for enterprise adoption.
• Design and execute POCs to assess scalability, governance, and value.
• Build integrations and reusable frameworks using APIs and automation tooling.
• Collaborate to define technical standards and adoption recommendations.

Conocimientos

Python

Java

Scala

CI/CD

Data governance

Cloud architecture

Herramientas

Databricks Unity Catalog

Azure Synapse Analytics

REST APIs

GitHub

Platform integration

Descripción del empleo

We're seeking a Senior Data Platform Engineer to join a team responsible for evaluating, validating, and enabling the adoption of emerging Microsoft and Databricks capabilities across the enterprise data platform ecosystem. This team serves as the technical governance and innovation function for platform engineering. New platform features, services, and tooling must be assessed, tested, and validated through proof-of-concepts before enterprise adoption. You will partner closely with platform teams to evaluate technologies such as Databricks Unity Catalog, Data Observability platforms, Databricks Genie, Zero Ops capabilities, and other emerging data platform innovations. The role combines hands-on engineering, platform integration, technical research, and advisory responsibilities.

Your Impact

• Evaluate new Microsoft Azure and Databricks platform capabilities and determine their suitability for enterprise adoption.
• Design and execute proof-of-concepts (POCs) to assess scalability, security, governance, operability, and business value.
• Build integrations and reusable frameworks leveraging APIs, platform services, and automation tooling.
• Collaborate with platform engineering teams to define technical standards, best practices, and adoption recommendations.
• Analyze emerging capabilities related to data governance, observability, AI-assisted operations, and platform automation.
• Develop technical documentation, decision frameworks, and architecture recommendations for stakeholders.
• Contribute to platform modernization initiatives by identifying opportunities to improve operational efficiency, reliability, and developer experience.
• Leverage AI-assisted engineering tools such as GitHub Copilot to accelerate experimentation and platform development.

Skills & Experience

• Strong hands-on experience with Databricks, including Unity Catalog and data governance concepts.
• Experience working with Azure Synapse Analytics and modern Azure data platform services.
• Solid background in API development, REST services, and system integrations.
• Experience integrating enterprise platforms, data services, and cloud-native solutions.
• Proficiency in one or more programming languages such as Python, Java, or Scala.
• Understanding of cloud architecture, automation, CI/CD practices, and source control using GitHub.
• Experience working in engineering teams conducting technical evaluations, pilots, or architectural assessments.
• Strong communication skills with the ability to present findings, risks, and recommendations to technical stakeholders.

Set Yourself Apart With

• Experience evaluating or implementing data observability platforms.
• Knowledge of Databricks Genie, AI-assisted analytics, or conversational data capabilities.
• Exposure to Zero Ops, platform automation, or self-service operational models.
• Experience with enterprise data governance, lineage, metadata management, and platform controls.
• Familiarity with AI-assisted software engineering using GitHub Copilot or similar coding assistants.
• Experience defining enterprise technology standards, governance frameworks, or platform approval processes.