Senior Data Engineer

United States Digital Space LLC; Amsterdam; On-site; EUR 90,000 - 130,000; Full time

Job summary

United States Digital Space LLC is seeking a Senior Data Engineer in Amsterdam to build and maintain robust data pipelines on our Big Data Platform. You will work with data scientists, analysts, software engineers, product managers and customers to deliver scalable ELT solutions.

We value expertise in Python, PySpark, Airflow, Hadoop and Spark, and a strong sense of data governance and testing. This on-site role focuses on delivering high-quality data infrastructure for ambitious teams in a

Qualifications

• 7+ years of experience as a Data Engineer or similar role.
• Strong proficiency with Python, PySpark, Airflow and Spark.
• Hands-on experience with Hadoop, Kafka and SQL.
• Excellent data governance, testing and version control practices.

Responsibilities

• Design, develop, deploy and operate production ELT pipelines and data architectures.
• Integrate data from diverse sources ensuring consistency and reliability.
• Mentor teams on best practices in data quality, governance and testing.
• Optimize data pipelines for performance and scalability.
• Collaborate with data scientists, software engineers and product teams.

Skills

Python

PySpark

Airflow

Hadoop

Spark

Kafka

SQL

Git

Data pipelines

Big Data

Job description

This is the company

the company provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At the company, everything we do is engineered for ambition.

For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster.

Senior Data Engineer

At the company, we treat data and data artifacts as first-class citizens. They form our backbone and drive the business and product insights we generate. To this end, the company is looking for a Senior Data Engineers in Amsterdam. We’re looking for engineers that understand the business context and the data needs behind it, and excel in implementing high-quality data pipelines on our Big Data Platform. As a Senior Data Engineer at the company, you will play a crucial role in shaping our data infrastructure and ensuring the seamless flow of data across various systems.

What you’ll do

• Collaborative Solution Development: Engage with a diverse range of stakeholders, including data scientists, analysts, software engineers, product managers, and customers, to understand their requirements and craft effective solutions.
• State-of-the-Art Pipelines and Architecture: Design, develop, deploy and operate high-quality production ELT pipelines and data architectures. Integrate data from various sources and formats, ensuring compatibility, consistency, and reliability. Design scalable architectures.
• Champion Data Best Practices: Proactively establish and advocate for best practices in performance, code quality, data validation, data governance, and discoverability across the company through mentoring, training, and knowledge sharing.
• High Quality Data and Code: Ensure data is accurate, complete, reliable, relevant, and timely. Implement rigorous testing, monitoring and validation protocols for your code and data, leveraging tools such as Pytest.
• Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and systems. Optimize query performance and resource utilisation to meet SLAs and performance requirements, using technologies such as caching, indexing, partitioning, and other Spark optimisations.

Who you are

• Experienced in Big Data: Over 7 years of experience working as a Data Engineer or in a similar role.
• Data & Engineering practices: You possess an expert-level understanding of both Software and Data Engineering practices.
• Technical Super Star: Highly proficient in tools and languages such as: Python, PySpark, Airflow, Hadoop, Spark, Kafka, SQL, Git.
• Clear Communicator: Skilled at articulating complex data-related concepts and outcomes to a diverse range of stakeholders.
• Self-starter: Capable of independently recognising opportunities, devising solutions, leading, prioritising and owning projects.
• Innovator: You have an experimental mindset with a ‘launch fast and iterate’ mentality.
• Data Culture Champion: Experienced in fostering a data-centric culture within large, technical organisations and setting standards for excellence and continuous improvement.

Data positions at the company

We know companies handle different definitions for their data-related positions, this is for instance dependent on the size of a company. Since the birth of the Data Solution and the growth of all data streams, we categorized and defined all our positions. Have a look at this blogpost to find out!

Teams we’re currently hiring for:

• Protect ML
• Finance Analytics
• Payment Lifecycle Data
• Optimise Interfaces

Our Diversity, Equity and Inclusion commitments

Our unique approach is a product of our diverse perspectives. This diversity of backgrounds and cultures is essential in helping us maintain our momentum. Our business and technical challenges are unique, and we need as many different voices as possible to join us in solving them - voices like yours. No matter who you are or where you’re from, we welcome you to be your true self at the company.

Studies show that women and members of underrepresented communities apply for jobs only if they meet 100% of the qualifications. Does this sound like you? If so, the company encourages you to reconsider and apply. We look forward to your application!

What’s next?

Ensuring a smooth and enjoyable candidate experience is critical for us. We aim to get back to you regarding your application within 5 business days. Our interview process tends to take about 4 weeks to complete, but may fluctuate depending on the role. Learn more about our hiring process here. Don’t be afraid to let us know if you need more flexibility.

This role is based out of our Amsterdam office. We are an office‑first company and value in‑person collaboration; we do not offer remote‑only roles.