Teach Lead Data Engineer (Brazil Based)

Serasa Experian; São Carlos; Presencial; BRL 260 000 - 520 000; Tempo integral

Resumo da oferta

Serasa Experian is seeking a Lead (Senior) Data | Software Engineer to drive the evolution of a petabyte-scale data platform on AWS. You will design and build scalable data pipelines and services, mentoring engineers and leading code reviews.

Collaborate with product, engineering, and operations to enable data-driven marketing solutions, ensure platform reliability, and plan complex initiatives in an agile environment, with travel to São Carlos as needed.

Qualificações

• Expert-level software and data engineering experience in large-scale data platforms.
• Deep experience building petabyte-scale systems using Java-based languages (Scala, Java).
• Strong expertise across the AWS data ecosystem (Glue, S3, Athena, Airflow, Iceberg).
• Advanced understanding of distributed systems and parallel workloads.
• Experience with query optimization, data partitioning, and storage patterns.
• Knowledge of cloud ecosystems (AWS required; Azure/GCP a plus).
• Ability to influence long-term architecture and platform design.
• Excellent code reviews, mentorship, and leadership.
• Hands-on agile experience across multiple teams.
• Proficient with Git-based collaboration.
• Advanced English; willingness to travel to São Carlos.

Responsabilidades

• Design, implement, and evolve a petabyte-scale AWS data platform.
• Build scalable data pipelines using JVM languages, Spark, Python, and cloud-native services.
• Mentor engineers and lead code reviews to raise engineering quality.
• Contribute to architectural decisions guiding platform evolution.
• Plan and deliver complex initiatives with agile teams.
• Ensure operational readiness with testing, monitoring, and release procedures.
• Explore GraphQL, vector databases, and AI/LLM techniques for data access.

Conhecimentos

Expertise in data platforms

Petabyte-scale systems

AWS data services

Distributed systems

Data optimization

Cloud platforms (AWS)

Architecture influence

Mentorship

Agile

Version control

English proficiency

Formação académica

Bachelor’s degree in CS/Engineering or related field

Ferramentas

Git

GitHub

Bitbucket

Descrição da oferta de emprego

Company Description

Experian is a global data and technology company that powers opportunities for people and businesses around the world. We operate across a wide range of markets, including financial services, healthcare, automotive, agribusiness, insurance, among others. Experian invests in people and in advanced new technologies to unlock the power of data. We have an incredible team of 25,200 employees across 32 countries.

Company Description

Experian is a global data and technology company that powers opportunities for people and businesses around the world. We operate across a wide range of markets, including financial services, healthcare, automotive, agribusiness, insurance, among others. Experian invests in people and in advanced new technologies to unlock the power of data. We have an incredible team of 25,200 employees across 32 countries. Our uniqueness is valuing yours. Experian’s people‑centric, inclusive, and purpose‑driven culture has been recognized with several awards – including World’s Best Workplaces™ 2025 (Fortune Global Top 25) and Great Place To Work™ in 26 countries, among others. Check out Experian Life on social media or explore our careers site to understand why. Experian is also proud to be an equal opportunity and affirmative action employer.

Job Description

We are looking for a Lead (Senior) Data | Sofware Engineer to lead the evolution of a petabyte‑scale data platform on AWS. In this role, you will design and build highly scalable, resilient, and high‑performance data pipelines and services, applying advanced software and data engineering practices. You will collaborate closely with product, engineering, and operations teams to enable next‑generation data‑driven marketing solutions, accelerate innovation, and ensure long‑term platform scalability and reliability.

Your Key Responsibilities

• Design, implement, and evolve a petabyte‑scale AWS data platform, applying advanced engineering, distributed systems principles, and cloud‑native practices to ensure performance, reliability, and scalability.
• Build and optimize highly scalable data pipelines using JVM languages (Java, Scala, Kotlin, etc...), Spark, Python, and cloud‑native services, ensuring efficient, resilient, and production‑ready data processing that supports analytics and downstream products.
• Act as a principal‑level technical leader, mentoring engineers, driving high‑quality code reviews, and promoting best practices to elevate engineering maturity across the organization.
• Contribute to architectural and design decisions, working closely with architects, product owners, and engineering leadership to guide platform evolution aligned with business strategy.
• Plan and deliver complex technical initiatives, ensuring high‑quality outcomes, predictable execution, and effective collaboration within agile value‑stream teams.
• Ensure operational readiness by following coding standards, testing practices, monitoring strategies, and release procedures, supporting production deployments to maintain platform stability.
• Explore and adopt modern technologies, such as GraphQL integrations, vector databases, and AI/LLM‑based techniques, enhancing data access, platform usability, and development efficiency.

Qualifications

• Expert‑level software and data engineering experience in large‑scale data platforms.
• Deep experience building petabyte‑scale systems using Java‑based languages such as Scala and Apache Spark.
• Strong expertise across the AWS data ecosystem (Glue, S3, Athena, Managed Airflow, Iceberg).
• Advanced understanding of distributed systems and highly parallelized workloads.
• Strong skills in query optimization, data partitioning, and efficient storage patterns.
• Cloud ecosystem mastery (AWS required; Azure/GCP are pluses).
• Experience influencing long‑term architecture and platform design.
• Excellent code review, mentorship, and technical leadership capabilities.
• Hands‑on experience working in agile environments and collaborating across multiple engineering teams.
• Strong version control and multi‑repo collaboration skills (Git, GitHub, Bitbucket).
• Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience.
• Relevant experience.
• + Advanced English and availability to travel to São Carlos/SP when need it.

Nice to have

• Experience with DBT or modern transformation frameworks.
• Knowledge of concurrent and parallel programming.
• Familiarity with Python, Angular and TypeScript.
• Experience with vector databases (pgvector, Redis vector fields, etc.).
• Practical experience applying AI/LLM techniques to data platforms, data access, or software quality.

Additional Information

At Serasa Experian, we believe that diversity is essential for a healthier and more innovative work environment, where everyone can share experiences and express their ideas. That’s why we promote several initiatives to support inclusive recruitment and the professional development of our people. We also have our affinity groups, created to empower and support individuals from underrepresented groups: ExperianPride (LGBTQIAPN+ community), Ubuntu (racial equity), Women in Experian (gender equity), Aspire (people with disabilities), and Connecting Generations (generations). Experian Careers - Creating a better tomorrow together. Find out what its like to work for Experian by clicking here