Senior Data Engineer (Fully Remote)

YLD; United States; Remoto; USD 110.000 - 160.000; Tempo pieno

Descrizione del lavoro

YLD is a software engineering and design consultancy that helps clients build lasting digital capabilities. They have offices in London, Lisbon, and Porto and focus on attracting, inspiring, developing, and retaining extraordinary people.

We are seeking a data platform engineer to contribute to core infrastructure, develop robust Python code, and design scalable data pipelines using dbt, Kafka, Spark, and AWS services.

Competenze

• Proven experience writing maintainable, performant Python code.
• Experience building modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow.
• Deep knowledge of complex SQL with emphasis on CTEs, window functions, and performance.
• Strong problem-solving balancing innovation with pragmatic tech choices.
• Experience in dynamic production environments and managing client expectations.

Mansioni

• Build core infrastructure software as part of data platform team.
• Instrument systems for performance and enhancement.
• Ensure data offerings are secure and accessible to stakeholders.
• Collaborate with engineering leadership and architects to deliver high-quality solutions.
• Work with clients to manage expectations in production environment.

Conoscenze

Python

SQL

Problem solving

Client management

Production environment

Strumenti

dbt

Kafka

Spark

AWS Kinesis

AWS Lambda

Apache Airflow

Descrizione del lavoro

• Building core infrastructure software (pipelines, APIs, data modelling) as part of our client's data platform team.
• Instrumenting systems for performance and enhancement throughout.
• Ensuring data offerings are secure and accessible to stakeholders.
• Proven experience writing maintainable, performant Python code.
• Experience building modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow.
• Deep knowledge of complex SQL with emphasis on CTEs, window functions, and performance.
• Problem-solving skills balancing innovation with pragmatic technology choices.
• Comfortable working in a dynamic production environment and managing client expectations.
• Experience working with engineering leadership and architects to deliver high-quality solutions.

Our values:

• Growing every day and including everyone.
• Relationships built on honesty and ethics.
• Inspiring solutions and winning together.

YLD

YLD is a software engineering and design consultancy that empowers clients to build lasting digital capabilities. They have offices in London, Lisbon, and Porto and are built on attracting, inspiring, developing, and retaining extraordinary people.