Senior Data Engineer

Adyen; São José dos Campos; On-site; BRL 200,000 - 280,000; Full time

Benefits offered by this job

Relocation package (70 km)

Office on-site role

Job summary

Adyen is hiring a Data Engineer to join our data platform initiative in São José dos Campos. You will build and maintain robust ELT pipelines, data models and reporting solutions that support internal stakeholders and external customers.

You will work with Python, PySpark, SQL, Airflow, Hadoop, Spark and Kafka, ensuring data accuracy and performance. The role requires 3 days on-site with relocation support available for candidates within 70 km.

Qualifications

• 8+ years of experience building robust, scalable data environments.
• Fluent in English and Portuguese.

Responsibilities

• Collaborate with data scientists, analysts, software engineers, product managers, and customers to understand requirements and craft solutions.
• Design, develop, deploy and operate production ELT pipelines and data architectures; integrate data from multiple sources.
• Champion data best practices including validation, governance and testing across pipelines.
• Ensure data quality, completeness, reliability and timely delivery with rigorous testing and monitoring.
• Identify and resolve performance bottlenecks in data pipelines and optimize queries and resources.

Skills

Python

PySpark

SQL

Git

Kafka

Tools

Airflow

Hadoop

Spark

Job description

Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition.

For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster.

At Adyen, we treat data and data artifacts as first-class citizens. In this role, you'll be at the core of our data strategy by helping us in building the best-in-class data platform for payments, and creating meaningful data products that drive our external and internal stakeholders. You'll also work in creating and maintaining robust reporting solutions that provide concise, reliable, and trustworthy intelligence to our customers.

What you’ll do

• Collaborative Solution Development: Engage with a diverse range of stakeholders, including data scientists, analysts, software engineers, product managers, and customers, to understand their requirements and craft effective solutions.
• State-of-the-Art Pipelines and Architecture: Design, develop, deploy and operate high-quality production ELT pipelines and data architectures. Integrate data from various sources and formats, ensuring compatibility, consistency, and reliability. Design scalable architectures.
• Champion Data Best Practices: Proactively establish and advocate for best practices in performance, code quality, data validation, data governance, and discoverability across Adyen through mentoring, training, and knowledge sharing.
• High Quality Data and Code: Ensure data is accurate, complete, reliable, relevant, and timely. Implement rigorous testing, monitoring and validation protocols for your code and data, leveraging tools such as Pytest.
• Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and systems. Optimize query performance and resource utilization to meet SLAs and performance requirements, using technologies such as caching, indexing, partitioning, and other Spark optimizations.

Who you are

• You are fluent in English and Portuguese
• You have solid experience in data domain, with +8 years of experience working towards building robust, scalable data environments
• You're highly proficient in programming languages and tooling, such as: Python, PySpark, SQL, Airflow, Hadoop, Spark, Kafka, SQL, Git
• Available to work 3 days on site in São José dos Campos. We offer a relocation package from 70km away from the city, if needed.
• You have interest in data engineering practices and product knowledge, specifically in how to leverage the power of analytics into business
• You mastered the best engineering principles, and you consistently apply them in your day-to-day activities when building data pipelines
• You are able to communicate complex outcomes with clarity over a wide range of audiences
• it's highly desirable that you're someone who's good a good understanding about the payments industry, with focus on Brazilian market specificities

Data positions at Adyen

We know companies handle different definitions for their data-related positions, this is for instance dependent on the size of a company. Since the birth of the Data Solution and the growth of all data streams, we categorized and defined all our positions. Have a look at this blogpost to find out!

Our Diversity, Equity and Inclusion commitments

Our unique approach is a product of our diverse perspectives. This diversity of backgrounds and cultures is essential in helping us maintain our momentum. Our business and technical challenges are unique, and we need as many different voices as possible to join us in solving them - voices like yours. No matter who you are or where you’re from, we welcome you to be your true self at Adyen.

Studies show that women and members of underrepresented communities apply for jobs only if they meet 100% of the qualifications. Does this sound like you? If so, Adyen encourages you to reconsider and apply. We look forward to your application!

What’s next?

Ensuring a smooth and enjoyable candidate experience is critical for us. We aim to get back to you regarding your application within 5 business days. Our interview process tends to take about 4 weeks to complete, but may fluctuate depending on the role. Learn more about our hiring process here . Don’t be afraid to let us know if you need more flexibility.

This role is based out of our São José dos Campos office. We are an office-first company and value in-person collaboration; we do not offer remote-only positions.