Data Platform Engineer

LinuxRecruit; City Of London; On-site; GBP 45,000 - 65,000; Full time

Job summary

A dynamic tech company in the UK is searching for a Data Platform Engineer to design and maintain data processing pipelines. This role requires experience in AWS, SQL, and Python while ensuring data quality and collaborating with teams. Candidates should have a strong background in data security and management, as well as big data technologies. The company offers a robust engineering culture and values problem-solving and innovation.

Qualifications

• Experience working within a heavy AWS environment.
• Strong capabilities in data security and management.
• Proficient in handling big data technologies and orchestration tools.

Responsibilities

• Design and maintain data processing pipelines handling vast amounts of information.
• Ensure data quality, integrity, and security in data processing.
• Collaborate with cross-functional teams to solve complex data challenges.

Skills

SQL

Python

AWS

Data security

DevOps

Statistical thinking

Tools

Athena

S3

Glue

Spark

Job description

Love Data and Platform Engineering?

This is your chance to join an exciting scale-up that has developed an AI-driven platform to help large enterprises, private firms, and VC companies find the top scientists, engineers, and researchers. With over one billion data points extracted from eight terabytes of data spanning a decade, you’ll thrive in a fast-paced, agile environment with a robust engineering culture.

As a Data Platform Engineer, you will be at the forefront of designing and maintaining data processing pipelines that handle vast amounts of information. You will ensure data quality, integrity, and security while collaborating with cross-functional teams to tackle complex data challenges. Staying current with the latest trends and technologies, you will drive continuous improvement and innovation in their data processing domains.

To be suitable, you are someone who is experienced in working within a heavy AWS environment, with strong capabilities in data security, management, DevOps, and software engineering. Your critical and statistical thinking skills and passion for solving complex problems will be invaluable. You are proficient in SQL and Python, with experience in AWS services such as Athena, S3, Glue, and Spark, and you are adept at handling big data technologies and orchestration tools.

Technical Account Manager (Observability)

If you’re highly technical, client facing, and passionate about Observability, this is the role for you! A lover of Linux, automation, containers, bare metal environment? Well, this is the right role for you.

As data volumes surge and observability costs climb, this is a rare opportunity to join a high-growth SaaS company at the forefront of modern observability, helping companies tackle these challenges with smarter, more scalable solutions.

We are an equal opportunities employer and welcome applications from all qualified candidates.