Data Platform Engineer: Build Scalable Databricks Pipelines

Agileengine; Perímetro Urbano Barranquilla; Presencial; COP 198.695.000 - 298.043.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive USD-based compensation

Descripción de la vacante

AgileEngine in Colombia is seeking a Data Platform Engineer to design, build, and support scalable data pipelines on the Databricks platform. You will work with a team to deliver robust data solutions for enterprise applications.

The role requires 3 years of software development experience, Databricks Unity Catalog, Postgres/Aurora/SQL Server expertise, cloud tech (AWS, Serverless), and strong Agile/Scrum and DevSecOps practices. Proficiency in English is expected.

Formación

• 3 years of software development experience and/or commensurate skills building commercial applications.
• Experience with the Databricks platform — Unity Catalog, notebooks and pipelines.
• Administering RDS Postgres and Aurora databases; knowledge of MS SQL Server.
• Cloud technologies: AWS, Serverless, Event-Driven Architecture, SOA, Microservices, CI/CD, IaC.
• Full SDLC with coding standards, design patterns, code reviews and operations.
• Experience in distributed teams using Agile/Scrum and DevSecOps.

Responsabilidades

• Architect, design, and deliver high-quality code following best practices.
• Diagnose and fix production issues and communicate blockers.
• Develop scalable enterprise data pipelines on Databricks.
• Collaborate with leads to raise issues and plan mitigations.
• Contribute to scalable, high-performance backend and frontend components.
• Leverage empirical testing and PoCs for decisions.
• Participate in special projects as needed.

Conocimientos

Databricks

Unity Catalog

PostgreSQL

Aurora

SQL Server

AWS

Serverless

CI/CD

DevSecOps

Agile/Scrum

English (Upper-Intermediate)

Microservices

Architecture patterns

Educación

Bachelor's degree or equivalent

Herramientas

RDS Postgres

Aurora

SQL Server

Descripción del empleo

AgileEngine in Colombia is seeking a Data Platform Engineer to design, build, and support scalable data pipelines on the Databricks platform. You will work with a team to deliver robust data solutions for enterprise applications.

The role requires 3 years of software development experience, Databricks Unity Catalog, Postgres/Aurora/SQL Server expertise, cloud tech (AWS, Serverless), and strong Agile/Scrum and DevSecOps practices. Proficiency in English is expected.