Data Analytics Engineer

GCS Recruitment

Greater London

On-site

GBP 60,000 - 90,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

GCS Recruitment is seeking an AI-Enabled Data Analytics Engineer to join a fast-growing team focused on scalable analytics, automation, and AI-driven solutions that enhance business decision-making. This hands-on role requires experience with Databricks, Python, SQL and PySpark, plus familiarity with modern AI-assisted development tools.

You will design data pipelines, automate reporting, and collaborate with stakeholders to translate requirements into scalable analytics and AI solutions while

Qualifications

  • Hands-on data engineering and analytics experience.
  • Strong knowledge of Databricks, PySpark and Delta Lake.
  • Experience with AI-assisted development tools (Copilot, ChatGPT, Claude Code).
  • Experience designing ETL/ELT pipelines and data models.

Responsibilities

  • Design, develop, and optimise scalable data pipelines and analytics solutions within Databricks.
  • Build robust data transformation, automation, and reporting solutions using Python, SQL, and PySpark.
  • Leverage AI-assisted development tools to accelerate coding, testing, debugging, documentation, and code reviews.
  • Develop and enhance AI agents, prompt libraries, reusable skills, and automation workflows.
  • Create and maintain AI documentation, business rules, context files, and knowledge repositories.
  • Apply prompt engineering and context engineering techniques to improve AI-generated outputs.
  • Validate AI-generated code, analytics, and recommendations to ensure technical accuracy and business relevance.
  • Collaborate with business stakeholders to gather requirements and translate them into scalable analytics and AI solutions.
  • Champion data quality, governance, continuous improvement, and best practices.

Skills

Analytical thinking
Problem-solving
Stakeholder communication
Team collaboration

Tools

Databricks
SQL
Python
PySpark
Delta Lake
GitHub Copilot
ChatGPT
Claude Code
Cursor
VS Code

Job description

AI-Enabled Data Analytics Engineer

We are currently seeking an experienced AI-Enabled Data Analytics Engineer to join a fast-growing team focused on delivering scalable analytics, automation, and AI-driven solutions that enhance business decision-making.

This is an exciting opportunity for a hands-on engineer with strong expertise in Databricks, Python, SQL, and PySpark, combined with practical experience using modern AI-assisted development tools such as GitHub Copilot, ChatGPT, Claude Code, Cursor, and VS Code.

Key Responsibilities
  • Design, develop, and optimise scalable data pipelines and analytics solutions within Databricks.
  • Build robust data transformation, automation, and reporting solutions using Python, SQL, and PySpark.
  • Leverage AI-assisted development tools to accelerate coding, testing, debugging, documentation, and code reviews.
  • Develop and enhance AI agents, prompt libraries, reusable skills, and automation workflows.
  • Create and maintain AI documentation, business rules, context files, and knowledge repositories.
  • Apply prompt engineering and context engineering techniques to improve AI-generated outputs.
  • Validate AI-generated code, analytics, and recommendations to ensure technical accuracy and business relevance.
  • Collaborate with business stakeholders to gather requirements and translate them into scalable analytics and AI solutions.
  • Champion data quality, governance, continuous improvement, and best practices.
Required Skills & Experience
  • 3+ years of experience within Data Engineering, Analytics Engineering, or Data Analytics.
  • Strong hands-on experience with:
    • Databricks
    • SQL
    • Python
    • PySpark
    • Delta Lake
  • Experience designing ETL/ELT pipelines and data transformation frameworks.
  • Strong understanding of data modelling, performance optimisation, and data quality practices.
  • Experience using AI-assisted development tools including:
    • GitHub Copilot
    • ChatGPT
    • Claude Code
    • Cursor
    • VS Code
  • Experience with Git and GitHub version control.
  • Strong analytical and problem-solving capabilities.
  • Excellent stakeholder management and communication skills.
Desirable Experience
  • AI Agent development.
  • Prompt Engineering.
  • Context Engineering.
  • Workflow Automation.
  • Knowledge Management and Prompt Libraries.
  • Business Process Automation using AI technologies.
What's on Offer?
  • Opportunity to work at the intersection of Data Engineering, Analytics, and AI.
  • Exposure to cutting-edge AI-assisted development practices.
  • Challenging, business-critical projects with significant impact.
  • Collaborative and innovative working environment.

Keywords: Databricks, Python, SQL, PySpark, Delta Lake, Data Engineer, Analytics Engineer, Data Analytics, ETL, ELT, AI Engineer, Generative AI, GitHub Copilot, ChatGPT, Claude Code, Cursor, Prompt Engineering, Context Engineering, Data Pipelines, Automation, Data Modelling.

GCS is acting as an Employment Business in relation to this vacancy.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks AI-Driven Data Analytics Engineer
Databricks AI-Driven Data Analytics Engineer

GCS Recruitment • Greater London

On-site
GBP 60,000 - 90,000
SQL Analytics Engineer (AI-Enabled, Databricks) - Software
SQL Analytics Engineer (AI-Enabled, Databricks) - Software

Salt • Greater London

On-site
GBP 65,000 - 83,000
Data Engineer
Data Engineer

Two Circles • Greater London

On-site
GBP 70,000 - 110,000
Discretionary Bonus
Performance reviews every 6 months
Summer Away Days
+4
Data Engineer
Data Engineer

Searchability® • Greater Manchester

Hybrid
GBP 54,000 - 66,000
Discretionary bonus
Share option plan
Pension scheme
+6
Databricks Data Engineer
Databricks Data Engineer

Tenth Revolution Group • Greater London

Hybrid
GBP 48,000 - 80,000
Annual performance bonus
Flexible benefits package
Databricks Data Engineer
Databricks Data Engineer

NTT • Greater London

On-site
GBP 70,000 - 110,000
Senior Data Engineer
Senior Data Engineer

Harnham • Greater London

Hybrid
GBP 60,000 - 80,000
Senior Data Engineer
Senior Data Engineer

Camden A.I. • Greater London

On-site
GBP 90,000 - 130,000
Data Engineer
Data Engineer

RedRock Resourcing • Birmingham

On-site
GBP 40,000 - 60,000
Databricks Data Engineer
Databricks Data Engineer

Tenth Revolution Group • City Of London

Hybrid
GBP 77,000 - 94,000
Hybrid work model
Databricks/Azure tech stack
Large-scale data platforms
+1