AWS Data Engineer

Datatech Analytics; Greater London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

Join a forward-thinking company as an AWS Data Engineer, where you'll lead the charge in enhancing data infrastructure and developing advanced data pipelines. Collaborate with a talented team to integrate cutting-edge technologies like DataOps and Generative AI. This role offers a unique opportunity to work in a hybrid environment, challenging yourself while contributing to the scaling of a robust data platform. If you're passionate about data and eager to make a significant impact, this is the perfect opportunity for you.

Qualifications

• Hands-on experience with AWS services and strong SQL skills.
• Experience with data pipeline and workflow management tools.

Responsibilities

• Develop and optimize ETL/ELT processes for data transformation.
• Implement and maintain CI/CD pipelines for data workflows.

Skills

AWS Services (Lambda, Glue, Athena, RDS, S3)

SQL

Python

Data Pipeline Management (Dagster, Celery, Airflow)

Data Transformation

Communication Skills

Tools

Dagster

Snowflake

Job description

Direct message the job poster from Datatech Analytics

Salary: Negotiable to £80,000 Dependent on Experience

London: Hybrid working 3 days per week in the office 2 days home-based

Job Ref: J12931

A leader in consumer behaviour analytics, seeks a driven AWS Data Engineer to guide data infrastructure architecture, working alongside a small talented team of engineers, analysts, and data scientists. In this role, you’ll enhance the data platform, develop advanced data pipelines, and integrate cutting-edge technologies like DataOps and Generative AI, including Large Language Models (LLMs).

You’ll have proven experience developing AWS Cloud platforms end to end, orchestrating data using Dagster or similar as well as coding in Python and SQL. This is an exciting opportunity for someone looking to challenge themselves in a collaborative environment, with scope to be instrumental in the scaling of the data infrastructure.

Key Responsibilities

• Develop and optimize ETL/ELT processes to support data transformation and integrity for analytics.
• Explore and evaluate new data warehousing solutions, including Snowflake, to improve data accessibility and scalability.
• Partner with product and engineering teams to define data architecture and best practices for reporting.
• Ensure data security, compliance, and governance across data systems.
• Implement and maintain CI/CD pipelines to automate data workflows and enhance system reliability.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance.

Essential Skills and Experience:

• Hands-on experience with AWS services, including Lambda, Glue, Athena, RDS, and S3.
• Strong SQL skills for data transformation, cleaning, and loading.
• Strong coding experience with Python and Pandas.
• Experience of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Strong communication skills to collaborate with remote teams (US, Canada)

Nice to Have

• Familiarity with LLMs including fine-tuning and RAG.
• Knowledge of Statistics
• Knowledge of DataOps best practices, including CI/CD for data workflows.

Please note we can only accept applications from those with current UK working rights for this role, this client cannot offer visa sponsorship.

If this sounds like the role for you then please apply today!

Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.

Datatech is one of the UK’s leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: www.datatech.org.uk

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Analyst and Information Technology

• Industries

  Consumer Services

Referrals increase your chances of interviewing at Datatech Analytics by 2x

Get notified about new Data Engineer jobs in London Area, United Kingdom.

London, England, United Kingdom 3 days ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

Data Engineer - Fintech – up to £120,000 plus bonus

London, England, United Kingdom 2 days ago

Data Visualisation Engineer - £60k base + bonus

London, England, United Kingdom 20 hours ago

London Area, United Kingdom £49,000.00-£55,000.00 1 month ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 19 hours ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 5 days ago

London, England, United Kingdom 5 months ago

London, England, United Kingdom 2 weeks ago

Greater London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 14 hours ago

City Of London, England, United Kingdom £50,000.00-£55,000.00 2 weeks ago

Graduate Software Engineer (Data & Infrastructure)

London, England, United Kingdom 1 week ago

London, England, United Kingdom 4 days ago

London, England, United Kingdom 43 minutes ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.