Senior Big Data Engineer - AI Forecasting

TN United Kingdom; London; On-site; GBP 60,000 - 100,000; Full time

Job summary

An established industry player is seeking a Senior Big Data Engineer to join their innovative AI Forecasting team. This role is pivotal in developing and optimizing data solutions using cutting-edge technologies like Microsoft Azure and Databricks. You'll collaborate with cross-functional teams to create impactful data pipelines and frameworks, ensuring high-quality and scalable solutions. If you're passionate about data and eager to work in a dynamic environment that values creativity and continuous improvement, this opportunity is perfect for you. Join a forward-thinking company that prioritizes technology and data in driving business success.

Benefits

Competitive salary

Pension

Private medical care

Performance bonus

Flexible benefits

Extra day off for birthday

Employee discount

Tech skills development programs

Industry event opportunities

Qualifications

• Experience as a Data Engineer with a passion for data best practices.
• Proficiency with Spark, Azure technologies, Python or Scala, SQL.

Responsibilities

• Develop solutions using Azure and Databricks, focusing on simplicity and maintainability.
• Optimize data pipelines and support production applications.

Skills

Spark/PySpark

Azure Data Technologies

Python

SQL

CI/CD Workflows

Communication Skills

Problem-Solving Skills

Education

Bachelor's Degree in Computer Science or related field

Tools

Databricks

Azure Data Factory

Terraform

Job description

Social network you want to login/join with:

col-narrow-left

Client:

ASOS

Location:

London, United Kingdom

Job Category:

Other

-

EU work permit required:

Yes

col-narrow-right

Job Reference:

efee67eb4d02

Job Views:

15

Posted:

01.05.2025

Expiry Date:

15.06.2025

col-wide

Job Description:

We are looking for a Senior Big Data Engineer to join our cross-functional AI Forecasting team. You will work alongside machine learning engineers and scientists to solve problems and productionise interesting solutions that leverage cutting edge tech.

ASOS Technology is going through an exciting period of transition towards a product operating model, including several strategic programmes to deliver innovative technology and business solutions to support our global growth.

ASOS is a forward-thinking company that recognizes the importance of data and technology in driving business success. The Digital Data Engineering team provides high-quality, scalable data solutions across the digital domain, promoting best practices and modern technologies.

As a Data Engineer, you'll be hands-on, delivering critical projects and processes, enabling digital platforms to maximize their data potential while ensuring continuous improvement, best practices, and team development through pairing. This role offers a chance to unleash your creativity on various data engineering projects.

What you'll be doing:

1. Developing solutions using Microsoft Azure and Databricks, prioritizing simplicity, maintainability, testing, automated deployment, and operational monitoring.
2. Optimizing data pipelines, frameworks, and systems for easier development of data artifacts.
3. Supporting production applications like data pipelines and infrastructure.
4. Creating proof of concepts, exploring innovative data utilization, and presenting findings to product teams, including performance evaluations, data modeling, and cost analysis.
5. Collaborating with engineering leads and product managers to set standards and practices that ensure high delivery cadence and scalable, high-quality solutions.
6. Working within an agile, cross-functional team, taking responsibility for deliverables and quality.
7. Staying updated on emerging data technologies and industry trends to bring value through early adoption.
8. Building strong relationships across business, science, analytics, and engineering teams.
9. Implementing and automating data quality and observability checks, proactively surfacing data quality issues.

What you will need:

• Experience as a Data Engineer, passionate about data and industry best practices.
• Proficiency with Spark/PySpark, Azure Data technologies (Databricks, Data Factory, Event Hubs, Service Bus), Python or Scala, SQL.
• Experience with testing frameworks, open table formats like Delta, Iceberg, or Hudi.
• Familiarity with CI/CD workflows, cloud infrastructure, and Infrastructure as Code (Terraform, Bicep).
• Excellent communication, analytical, and problem-solving skills.
• Experience delivering complex, high-volume, high-quality software systems.
• Experience supporting cloud-based solutions and working within agile methodologies.

Nice to have skills:

• Experience in retail or e-commerce sectors.
• Knowledge of Big Data, Distributed Computing, streaming technologies (Spark Structured Streaming, Flink).
• Additional programming skills (PowerShell, Bash).
• Understanding of Databricks ecosystem and Data Observability frameworks.

Additional Information

What's in it for you?

• Competitive salary, pension, private medical care.
• Performance bonus, flexible benefits, extra day off for birthday.
• Employee discount, tech skills development programs, industry event opportunities.
• Impactful work with cutting-edge technology, and involvement in diversity and inclusion initiatives.

Discover life at ASOS by searching #InsideASOS on social media, or learn about our tech via our podcast and blog links provided.