Data Platform Engineer

LinuxRecruit; London; On-site; GBP 50,000 - 80,000; Full time

Job summary

Join a leading scale-up in London as a Data Platform Engineer, where you'll design and maintain innovative data processing pipelines. This role requires strong skills in AWS, SQL, and Python, offering a great chance to impact data-driven projects in a dynamic environment.

Qualifications

• Experienced in heavy AWS environments
• Proficient in SQL and Python
• Adept in big data technologies and orchestration tools

Responsibilities

• Design and maintain data processing pipelines
• Ensure data quality, integrity, and security
• Collaborate with cross-functional teams to tackle complex data challenges

Skills

Data Security

Data Management

DevOps

Software Engineering

SQL

Python

Critical Thinking

Statistical Thinking

Tools

AWS

Athena

S3

Glue

Spark

Job description

Love Data and Platform Engineering?

This is your chance to join an exciting scale-up that has developed an AI-driven platform to help large enterprises, private firms, and VC companies find top scientists, engineers, and researchers. With over one billion data points extracted from eight terabytes of data spanning a decade, you’ll thrive in a fast-paced, agile environment with a robust engineering culture.

As a Data Platform Engineer, you will be at the forefront of designing and maintaining data processing pipelines that handle vast amounts of information. You will ensure data quality, integrity, and security while collaborating with cross-functional teams to tackle complex data challenges. Staying current with the latest trends and technologies, you will drive continuous improvement and innovation in data processing domains.

To be suitable, you are experienced in working within a heavy AWS environment, with strong capabilities in data security, management, DevOps, and software engineering. Your critical and statistical thinking skills and passion for solving complex problems will be invaluable. You are proficient in SQL and Python, with experience in AWS services such as Athena, S3, Glue, and Spark, and you are adept at handling big data technologies and orchestration tools.

If this sounds like you and you're keen to learn more, apply below or contact me at 07441 391334 or via email at [e-mail].

AI, Compilers, HPC, Low-latency systems, Python/C++, if any of those get you excited, then keep reading...

An exciting and unique opportunity just came on my desk; however, it won't be for everyone. It’s 5 days a week in the office.

Whatever role you are looking for, our team will work with you to understand your skills, experience, career goals, and aspirations. Kick-start your job search by registering with us today.

Searching for new talent? Let’s go. Get in touch with us today to see how we can help scale your team.