Contract Senior Data Engineer

YLD; United States; Remote; USD 110,000 - 150,000; Full time

Job summary

YLD is seeking a Data Engineer to build core data platform infrastructure, including pipelines, APIs and data models. You will instrument systems for performance and scale data access for internal and external stakeholders, with secure authentication.

You will select technologies for batch and streaming workloads, mentor engineers, and contribute to a high-quality data platform while aligning with client needs and YLD standards.

Qualifications

• Proven Python development with maintainable, high-performance code.
• Experience building data pipelines using dbt, Kafka, Spark, Kinesis, Lambda, Airflow.
• Strong data modeling knowledge and patterns.
• Advanced SQL skills focusing on CTEs and window functions.
• Experience with monitoring: CloudWatch, Datadog, etc.
• Problem-solving balancing innovation with pragmatic tech choices.
• Able to work in a dynamic production environment and manage client expectations.
• Customer-focused mindset with attention to quality.
• Experience collaborating with leadership and architects.
• Demonstrates ownership and transparency in deliverables.
• Represents YLD brand responsibly with clear communication.

Responsibilities

• Build core infrastructure software: pipelines, APIs, and data models.
• Instrument systems for performance and ongoing enhancement.
• Ensure data offerings serve internal and external stakeholders with secure authentication.
• Choose and implement technologies for scaling data access, batch processing and streaming.
• Mentor and coach other engineers to grow technical expertise.

Skills

Python

Data pipelines

SQL with advanced functions

Data modeling

Mentoring

Problem solving

Communication

Client-facing

Tools

dbt

Kafka

Spark

AWS Kinesis

AWS Lambda

Apache Airflow

Job description

Everything we do is to empower our clients to move forward. Our purposeis to help our clients develop the capabilities they need to outperform their competitors. Our successis a consequence of ensuring our clients are successful. Our companyis built on extraordinary people; we aim to attract, inspire, develop and retain them. YLD is a software engineering and design consultancy; we create digital capabilities for our clients that last beyond our engagement. We have offices in London, Lisbon, Porto.

About the role:

As a Data Engineer in this role, you will be responsible for building core infrastructure software (pipelines, APIs, data modelling) as part of our client's data platform team. Your work will include instrumenting systems for performance, and enhancement throughout. You will work on ensuring these data offerings are to various internal & external stakeholders using secure authentication patterns.

Your role will include choosing and implementing the appropriate technologies for scaling data access patterns, batch processing, and data streaming for soft real-time consumption while considering the unique domain knowledge of the client's business. As a senior collaborator on the team, you will coach & mentor other engineers to support the growth of their technical expertise.

• Proven experience writing highly maintainable, performant Python code;
• Experience building modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow (or similar);
• Understanding of Data Modelling patterns;
• Deep knowledge of complex SQL, with emphasis on Common Table Expressions, window functions, and their performance;
• Experience with end-to-end monitoring & alerting experience (CloudWatch, Datadog, etc.).
• Problem-solving skills that balance innovation with pragmatic technology choices to solve business needs;
• Comfortable working in a dynamic production environment and taking care of client expectations effectively;
• Distinct customer focus and quality mindset;
• Experience working closely with engineering leadership and architects to deliver high-quality solutions;
• Experience maintaining a high degree of ownership and transparency in deliverables;
• An exemplar of YLD’s brand and safe-guarder of our reputation;
• Exceptional communication skills, able to communicate complex ideas simply

Our typical Recruitment Process looks like this:

• 1st Interview with someone from the Talent team (30/45 mins)
• Technical Interview with our Senior Developers (1h30)
• Call with the Client Partner (30 mins)

We live and breathe our values, and know you will too:

• Growing every day
• Including everyone
• Relationships built on honesty and ethics
• Inspiring solutions
• Winning together

We’re an equal-opportunity employer and value diversity of all kinds. We don’t discriminate based on race, religion, colour, national origin, gender, sexual orientation, pregnancy or maternity, age, marital status, or disability status. Likewise, we also offer a remote-first working environment, meaning that flexible working and work-life balance come as standard for all employees.