Data Platform Engineer: Build Scalable Databricks Pipelines

AgileEngine, LLC.; Perímetro Urbano Barranquilla; Presencial; COP 396.983.000 - 496.229.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive USD-based compensation

Descripción de la vacante

AgileEngine, LLC. is seeking a Data Platform Engineer to design, build, and support scalable data pipelines on the Databricks platform. You will work across cloud-native technologies to enable reliable data processing for Fortune 500 brands and startups.

Join a people-first culture that values growth, collaboration, and delivering high-quality software. You will translate requirements into robust data architectures and contribute to enterprise-scale data initiatives.

Formación

• 3 years of software development experience and/or commensurate skills.
• Experience with the Databricks platform — leveraging Unity Catalog, creating notebooks and pipelines.
• Demonstrated experience in administering RDS Postgres and Aurora databases, with an understanding of MS SQL Server database administration.
• Proficiency with cloud technologies, i.e., AWS, Serverless, Event-Driven Architecture, SOA, Microservices, Microfrontend, CI/CD, Infrastructure as Code, and other modern technologies.
• Proficiency with professional software engineering practices and the full software development life cycle, including coding standards, architecture/design patterns, code reviews, source control management, build processes, testing, and operations.
• Demonstrated record of successfully contributing to distributed software delivery teams using Agile/Scrum and DevSecOps practices.

Responsabilidades

• Architect, design, and deliver high-quality code independently by following best practices.
• Understand and make well-reasoned design decisions and trade-offs in your work.
• Diagnose and fix production issues.
• Communicate with the development lead to raise issues and anticipate potential barriers.
• Build enterprise applications at scale using expertise in computer science fundamentals.
• Develop scalable, highly available, high-performance components with a deep understanding of front-end and back-end architectures.
• Seek empirical evidence through proofs of concept, tests, and external research.
• Participate in special projects and perform other duties as assigned.

Conocimientos

Databricks

Unity Catalog

AWS

SQL Server administration

CI/CD

Agile/Scrum

Educación

Bachelor’s degree or equivalent experience

Herramientas

RDS PostgreSQL

Aurora

Microsoft SQL Server

Descripción del empleo

AgileEngine, LLC. is seeking a Data Platform Engineer to design, build, and support scalable data pipelines on the Databricks platform. You will work across cloud-native technologies to enable reliable data processing for Fortune 500 brands and startups.

Join a people-first culture that values growth, collaboration, and delivering high-quality software. You will translate requirements into robust data architectures and contribute to enterprise-scale data initiatives.