Data Platform Engineer Id90126

Agileengine; São Paulo; Presencial; BRL 180 000 - 240 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Professional growth

Competitive USD-based compensation

Resumo da oferta

AgileEngine is seeking a Data Platform Engineer to design, build, and support scalable data pipelines on the Databricks platform in São Paulo. The role involves delivering high-quality code and making thoughtful architectural decisions to ensure reliability and performance.

You will work with Databricks, Unity Catalog, and various databases (Postgres/Aurora/SQL Server) while applying Agile/Scrum and DevSecOps practices in a distributed team.

Qualificações

• 3+ years of software development experience building commercial applications
• Experience with the Databricks platform, Unity Catalog, notebooks and pipelines
• Experience administering RDS Postgres and Aurora databases; understanding SQL Server administration
• Proficiency with cloud technologies (AWS, Serverless, Event-Driven Architecture, SOA, Microservices, Microfrontend, CI/CD, Infrastruktur as Code)
• Strong software engineering practices and SDLC including code reviews, testing, and operations
• Experience in distributed teams using Agile/Scrum and DevSecOps practices
• Upper-intermediate English level

Responsabilidades

• Architect, design, and deliver high-quality code independently
• Make well-reasoned design decisions and trade-offs
• Diagnose and fix production issues
• Communicate with the development lead to raise issues
• Build enterprise applications at scale with scalable architectures
• Develop high-performance components across front-end and back-end
• Seek empirical evidence through tests and research
• Participate in special projects and other duties as assigned

Conhecimentos

Software development

Databricks platform

Databases (Postgres, Aurora)

Microsoft SQL Server

Cloud technologies (AWS, serverless,  

CI/CD and IaC

Agile/Scrum and DevSecOps

English (upper-intermediate)

Formação académica

Bachelor’s degree or equivalent experience

Ferramentas

Databricks

PostgreSQL

SQL Server

AWS

CI/CD tooling

Descrição da oferta de emprego

Job Description

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

We are looking for a Data Platform Engineer to design, build, and support scalable data pipelines on the Databricks platform.

WHAT YOU WILL DO

• Architect, design, and deliver high-quality code independently by following best practices.
• Understand and make well-reasoned design decisions and trade-offs in your work.
• Diagnose and fix production issues.
• Communicate with the development lead to raise issues and anticipate potential barriers.
• Build enterprise applications at scale using expertise in computer science fundamentals.
• Develop scalable, highly available, high-performance components with a deep understanding of front-end and back-end architectures.
• Seek empirical evidence through proofs of concept, tests, and external research.
• Participate in special projects and perform other duties as assigned.

MUST HAVES

• 3 years of software development experience and/or commensurate skills building commercial applications with modern software engineering principles and practices.
• Experience with the Databricks platform — leveraging Unity Catalog, creating notebooks and pipelines.
• Demonstrated experience in administering RDS Postgres and Aurora databases, with an understanding of Microsoft SQL Server database administration.
• Proficiency with cloud technologies, i.e., AWS, Serverless, Event-Driven Architecture, SOA, Microservices, Microfrontend, CI/CD, Infrastructure as Code, and other modern technologies.
• Proficiency with professional software engineering practices and the full software development life cycle, including coding standards, architecture/design patterns, code reviews, source control management, build processes, testing, and operations.
• Demonstrated record of successfully contributing to distributed software delivery teams using Agile/Scrum and DevSecOps practices.
• Upper-intermediate English level.

NICE TO HAVES

• Bachelor’s degree in a related field or equivalent experience.

PERKS AND BENEFITS

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.

Requirements

3 years of software development experience and/or commensurate skills building commercial applications with modern software engineering principles and practices. Experience with the Databricks platform — leveraging Unity Catalog, creating notebooks and pipelines. Demonstrated experience in administering RDS Postgres and Aurora databases with an understanding of Microsoft SQL Server database administration. Proficiency with cloud technologies i.e. AWS, Serverless, Event-Driven Architecture, SOA, Microservices, Microfrontend, CI/CD, Infrastructure as code, and other modern technologies. Proficiency with professional software engineering practices and the full software development life cycle, including coding standards, architecture/design patterns, code reviews, source control management, build processes, testing, and operations. Demonstrated record of successfully contributing in distributed software delivery teams using Agile/Scrum and DevSecOps practices.