Data Engineer AWS & AI

Women in Data®; Greater London; On-site; GBP 80,000 - 110,000; Full time

Job summary

Women in Data is seeking an AWS Data Engineer to build and run data pipelines for a consumer intelligence business in Central London. You will work with trillions of behavioural signals from opt-in participants and help shape the data platform.

The role offers real ownership in a small, collaborative team, using AWS, Python, SQL and Spark/PySpark, with Claude AI-assisted development. Full right to work in the UK; sponsorship not available.

Qualifications

• Solid commercial experience with AWS, Python and SQL.
• Practical Spark or PySpark experience.
• Excited to be working with, experimenting with and validating AI-generated code.

Responsibilities

• Work on data pipelines behind trillions of behavioural signals.
• Own the platform and work across the full data lifecycle.
• Collaborate in a small, cross-functional team to influence the data platform.

Skills

AWS

Python

SQL

Spark/PySpark

Job description

Every so often a platform comes along that is doing something genuinely new. This is one of them.

We are recruiting an AWS Data Engineer for a consumer intelligence business in Central London.

You'll be working on the data pipelines behind trillions of behavioural signals, all collected from a panel of real people who actively opt in and are paid for their data.

The above is the foundation of the role but the future will be wherever cutting edge data engineering leads!

Why it's amazing

• Real scale, working with AWS, Python, SQL and Spark/PySpark across datasets most engineers won't normally get near
• Real ownership, working in a small, collaborative team where you can influence the platform and work across the full data lifecycle
• AI-assisted engineering, with Claude used daily for development, debugging, testing and documentation, but with engineers responsible for reviewing and validating what it produces
• A genuinely new platform, with the product being built out now following fresh venture and strategic investment

We'd like to hear from you if you have solid commercial experience with AWS, Python and SQL, practical Spark or PySpark experience, and are excited to be working with, experimenting with and validating AI-generated code! Client uses claude but they are open minded on the flavour of AI the right candidate has been using.

Full right to work in the UK required. No sponsorship available.

If you don't tick every box but it's a role you'd like to grow into, still get in touch.

Not for you but know someone who might be right? We also have a referral scheme, with a gift or voucher for anyone you introduce who we go on to place.

#DataEngineering #AWS #PySpark #Python #DataPlatform #AIAssistedDevelopment #LondonJobs #DataJobs #Hiring #DataAndAnalytics

Women in Data advertise roles on behalf of our partners, alliances, and members.

We are proud supporters of Women in Data. Connect, engage and belong to the largest free female data community in the UK - visit: www.womenindata.co.uk to join our community.

Stay connected! Follow us on LinkedIn for updates on career opportunities and more.