Data Platform Engineer

Avenue Code; Brasil; Presencial; BRL 120 000 - 240 000; Tempo integral

Resumo da oferta

Avenue Code is seeking a Data Engineer with a platform mindset to build and scale a modern lakehouse on AWS, using Iceberg, Spark, Kafka, and Trino. The role offers hands-on ownership and close collaboration with other teams to shape how experiments are run and how data informs decisions.

You will work with Python, Go, Scala, and Java across data pipelines and backend services, contributing to an experimental, high-impact engineering culture.

Qualificações

• Degree in Computer Science, Engineering, or related field.
• Production-level coding in Python, Go, and Scala or Java.
• Hands-on experience with Iceberg-based data warehouses or lakehouses.
• Experience building RBAC systems across teams.
• Strong knowledge of Spark, Kafka, and AWS (S3, IAM).
• Experience running services on Kubernetes.
• Excellent ownership and cross-team communication.
• Advanced to fluent English for daily international team work.

Responsabilidades

• Build and operate a lakehouse on S3 using Iceberg and Parquet.
• Develop data transformations with Spark (Python, SQL, Scala).
• Build backend services in Go, Scala, or Java.
• Design and support streaming pipelines with Kafka.
• Deploy services on Kubernetes and manage AWS IAM access control.
• Build tools and data products to improve experiment design and analysis.

Conhecimentos

English (advanced to fluent)

Ownership & communication

Team collaboration

Formação académica

Degree in Computer Science, Engineering, or related field

Ferramentas

Apache Spark

Apache Kafka

AWS (S3, IAM)

Kubernetes

Descrição da oferta de emprego

About The Opportunity

At Avenue Code, we are passionate about transforming businesses through technology. We are a leading end-to-end development consultancy for digital transformation across various markets, growing sustainably since day one. We believe that great results are born from strong relationships. Our team combines technical expertise, collaboration, and a welcoming approach to work that makes all the difference.

About The Opportunity

At Avenue Code, we are passionate about transforming businesses through technology. We are a leading end-to-end development consultancy for digital transformation across various markets, growing sustainably since day one. We believe that great results are born from strong relationships. Our team combines technical expertise, collaboration, and a welcoming approach to work that makes all the difference.

We are looking for a Data Engineer with a platform mindset to help build and scale a modern lakehouse on AWS, using Iceberg, Spark, Kafka, and Trino. The platform supports experimentation across the company, so your work will directly shape how teams run experiments and use data to make decisions. The role is hands-on, with real ownership and a lot of collaboration with other teams.

Responsibilities

• Build and operate a lakehouse on S3 using Parquet and Apache Iceberg.
• Develop data transformations with Spark (Python, SQL, Scala).
• Build backend services in Go, Scala, or Java.
• Design and support streaming pipelines with Kafka.
• Deploy services on Kubernetes and manage access control with AWS IAM.
• Build tools and data products that make experiment design and analysis more reliable.

Required Qualifications

• Degree in Computer Science, Engineering, or a related field.
• Solid experience in platform or data platform engineering, including work on experimentation platforms.
• Production-level coding in Python, Go, and Scala or Java.
• Hands-on experience supporting Iceberg-based data warehouses or lakehouses.
• Proven experience building and supporting RBAC systems used by teams across the company.
• Strong knowledge of Spark, Kafka, and AWS (S3, IAM).
• Experience running services on Kubernetes.
• Strong ownership, communication skills, and ability to work with multiple teams.
• Advanced to fluent English for daily communication with international teams.

Avenue Code reinforces its commitment to privacy and to all the principles guaranteed by the most accurate global data protection laws, such as GDPR, LGPD, CCPA and CPRA. The Candidate data shared with Avenue Code will be kept confidential and will not be transmitted to disinterested third parties, nor will it be used for purposes other than the application for open positions. As a Consultancy company, Avenue Code may share your information with its clients and other Companies from the CompassUol Group to which Avenue Code's consultants are allocated to perform its services.