Databricks AI-Driven Data Analytics Engineer

GCS Recruitment; Greater London; Sur place; GBP 60 000 - 90 000; Plein temps

Résumé du poste

GCS Recruitment is seeking an AI-Enabled Data Analytics Engineer to join a fast-growing team focused on scalable analytics, automation, and AI-driven solutions that enhance business decision-making. This hands-on role requires experience with Databricks, Python, SQL and PySpark, plus familiarity with modern AI-assisted development tools.

You will design data pipelines, automate reporting, and collaborate with stakeholders to translate requirements into scalable analytics and AI solutions while

Qualifications

• Hands-on data engineering and analytics experience.
• Strong knowledge of Databricks, PySpark and Delta Lake.
• Experience with AI-assisted development tools (Copilot, ChatGPT, Claude Code).
• Experience designing ETL/ELT pipelines and data models.

Responsabilités

• Design, develop, and optimise scalable data pipelines and analytics solutions within Databricks.
• Build robust data transformation, automation, and reporting solutions using Python, SQL, and PySpark.
• Leverage AI-assisted development tools to accelerate coding, testing, debugging, documentation, and code reviews.
• Develop and enhance AI agents, prompt libraries, reusable skills, and automation workflows.
• Create and maintain AI documentation, business rules, context files, and knowledge repositories.
• Apply prompt engineering and context engineering techniques to improve AI-generated outputs.
• Validate AI-generated code, analytics, and recommendations to ensure technical accuracy and business relevance.
• Collaborate with business stakeholders to gather requirements and translate them into scalable analytics and AI solutions.
• Champion data quality, governance, continuous improvement, and best practices.

Connaissances

Analytical thinking

Problem-solving

Stakeholder communication

Team collaboration

Outils

Databricks

SQL

Python

PySpark

Delta Lake

GitHub Copilot

ChatGPT

Claude Code

Cursor

VS Code

Description du poste

AI-Enabled Data Analytics Engineer

We are currently seeking an experienced AI-Enabled Data Analytics Engineer to join a fast-growing team focused on delivering scalable analytics, automation, and AI-driven solutions that enhance business decision-making.

This is an exciting opportunity for a hands-on engineer with strong expertise in Databricks, Python, SQL, and PySpark, combined with practical experience using modern AI-assisted development tools such as GitHub Copilot, ChatGPT, Claude Code, Cursor, and VS Code.

Key Responsibilities

• Design, develop, and optimise scalable data pipelines and analytics solutions within Databricks.
• Build robust data transformation, automation, and reporting solutions using Python, SQL, and PySpark.
• Leverage AI-assisted development tools to accelerate coding, testing, debugging, documentation, and code reviews.
• Develop and enhance AI agents, prompt libraries, reusable skills, and automation workflows.
• Create and maintain AI documentation, business rules, context files, and knowledge repositories.
• Apply prompt engineering and context engineering techniques to improve AI-generated outputs.
• Validate AI-generated code, analytics, and recommendations to ensure technical accuracy and business relevance.
• Collaborate with business stakeholders to gather requirements and translate them into scalable analytics and AI solutions.
• Champion data quality, governance, continuous improvement, and best practices.

Required Skills & Experience

• 3+ years of experience within Data Engineering, Analytics Engineering, or Data Analytics.
• Strong hands-on experience with:
  • Databricks
  • SQL
  • Python
  • PySpark
  • Delta Lake
• Experience designing ETL/ELT pipelines and data transformation frameworks.
• Strong understanding of data modelling, performance optimisation, and data quality practices.
• Experience using AI-assisted development tools including:
  • GitHub Copilot
  • ChatGPT
  • Claude Code
  • Cursor
  • VS Code
• Experience with Git and GitHub version control.
• Strong analytical and problem-solving capabilities.
• Excellent stakeholder management and communication skills.

Desirable Experience

• AI Agent development.
• Prompt Engineering.
• Context Engineering.
• Workflow Automation.
• Knowledge Management and Prompt Libraries.
• Business Process Automation using AI technologies.

What's on Offer?

• Opportunity to work at the intersection of Data Engineering, Analytics, and AI.
• Exposure to cutting-edge AI-assisted development practices.
• Challenging, business-critical projects with significant impact.
• Collaborative and innovative working environment.

Keywords: Databricks, Python, SQL, PySpark, Delta Lake, Data Engineer, Analytics Engineer, Data Analytics, ETL, ELT, AI Engineer, Generative AI, GitHub Copilot, ChatGPT, Claude Code, Cursor, Prompt Engineering, Context Engineering, Data Pipelines, Automation, Data Modelling.

GCS is acting as an Employment Business in relation to this vacancy.