Data Infrastructure Engineer [Talents Bench]

Metal Toad; Brasil; On-site; BRL 180,000 - 300,000; Full time

Job summary

Metal Toad seeks a highly technical Data Infrastructure Engineer to build robust Open Source data platforms on Amazon EKS. You will deploy and manage Trino, Spark, Pinot, and Druid in complex customer environments, following best practices for production-ready infrastructure.

The role emphasizes hands-on development, deep Open Source expertise, and strong English communication to collaborate with diverse teams and clients across projects.

Qualifications

• Advanced to fluent English communication skills are essential for this role.
• Kubernetes and Amazon EKS expertise required.
• Proficiency with Terraform, Helm, Docker, and Karpenter.
• Data OSS experience with Trino, Spark, Pinot, and Druid needed.
• Familiarity with Data Lakes, Spark, and Hive architectures.

Responsibilities

• Infrastructure Implementation: Architect and deploy Open Source Data OSS (Trino, Spark, Pinot, Druid) on Amazon EKS.
• Hands-on Development: Maintain a 100% hands-on approach, using IDEs, Git, and IaC practices.
• Problem Solving: Navigate complex customer hierarchies and technical landscapes to propose bespoke solutions.
• Pioneering Work: Design and implement novel, high-risk solutions not previously established.
• Collaboration: Serve as SME in Open Source technologies, ensuring production-ready builds.

Skills

Communication in English

Problem solving

Data OSS experience

Data Lakes

Open Source believer

Tools

Kubernetes

Amazon EKS

Docker

Terraform

Helm

Karpenter

Job description

About Metal Toad

Metal Toad is a strategic AI partner. We help our customers to use AI to build the engines of their future growth, aligning AI’s capabilities with their most important business opportunities. We are an AWS, Anthropic, and OpenAI partner. Our team includes consultants, software engineers, devops engineers, UX designers, project managers, marketers, and supporting staff. It should go without saying, but everyone working at Metal Toad should be interested in the impact of AI, and believe in a human-first, AI-enabled future.

Job Description

We are looking for a highly technical, hands-on Data Infrastructure Engineer to join our team. This is not a standard Data Engineering role; instead, you will focus on building robust, scalable Data Infrastructure platforms using Open Source software. Your primary mission is to deploy and manage high-performance data technologies—such as Apache Pinot, Apache Druid, and Trino—within a well-architected Amazon EKS environment. You will work on pioneering, high-risk technical solutions, navigating complex customer environments to deliver cutting-edge infrastructure that pushes the boundaries of standard implementations.

Key Responsibilities

• Infrastructure Implementation: Architect and deploy Open Source Data OSS (Trino, Spark, Pinot, Druid) on Amazon EKS.
• Hands-on Development: Maintain a 100% hands-on approach, utilizing IDEs, Git, and strict coding best practices to manage infrastructure as code.
• Problem Solving: Navigate complex customer hierarchies and technical landscapes to identify, propose, and implement bespoke solutions.
• Pioneering Work: Design and implement novel, high-risk solutions that have not been previously established.
• Collaboration: Act as a subject-matter expert in Open Source technologies, ensuring all builds are well-architected and production-ready.

Qualifications Required

• Agree with our Corporate Values Statement.
• Believes in the company's mission: to help people.
• Believes in the principles of open source.
• Advanced to fluent English communication skills are essential for this role.
• Kubernetes/EKS: Deep expertise in Kubernetes and Amazon EKS is a must-have.
• Core Infrastructure Tooling: Proficiency in Terraform, Helm, Docker, and Karpenter.
• Data OSS Expertise: Minimum rating of 3 (on a 5-point scale) in deploying and managing Data OSS software, including Trino, Spark, or Pinot.
• Data Foundations: Strong familiarity with Data Lakes, Spark, and Hive architectures.
• Versatility: A demonstrated willingness to work with non-AWS and broad Open Source ecosystems.
• Soft Skills: High comfort level engaging with complex customer environments and an aptitude for high-stakes technical troubleshooting.

Nice to Have

• Prior hands-on experience working with Fruitstand.
• Demonstrated history of contributing to or managing complex open-source projects in production environments.