Databricks Data & AI Systems Integrator

NextGenEnergyJobs; Greater London; Hybrid; GBP 65,000 - 95,000; Full time

Job summary

Octopus Energy Group is seeking a data integration specialist to unify business systems with our Databricks environment, building reusable datasets for business consumption through Excel, dashboards, and natural-language queries. You will design AI-enabled tools and internal apps for fund and finance teams, and work with cross-functional data platform squads to reuse existing capabilities.

We seek practical, ownership-minded engineers who can ship pragmatic solutions, implement governance, and

Qualifications

• Strong systems integration experience across SaaS tools, data sources and REST APIs.
• Track record of building and shipping data products or internal applications used by business.
• Solid Python and SQL used daily for automation and data modelling.
• Hands-on production experience with a cloud data platform (Databricks preferred).
• Experience integrating AI into real tools (LLM APIs, retrieval, agents).
• Identity and access management experience (SSO, service accounts, credential management).
• Experience with Microsoft 365 / SharePoint integration.
• Proven ability to manage cloud/AI costs and attribute spend.
• Pragmatic approach: configure existing infrastructure before building new; ship when possible.
• Clear communicator able to explain trade-offs to non-technical stakeholders and in technical reviews.
• Comfort with ownership in a small team to set working patterns.

Responsibilities

• Integrate business systems into the Databricks environment via APIs and connectors.
• Build data products on top of connected data for Excel, dashboards, and NLQ.
• Design and ship internal apps and AI-enabled tools for fund/asset/finance teams.
• Prototype and productionise new AI capabilities from document AI to agentic workflows.
• Reuse existing platform capabilities and adapt them for OEGEN.
• Set up guardrails in Databricks and Unity Catalog for secure, scalable use.
• Drive cost awareness with tagging, budgets, and usage monitoring.
• Credential and log AI usage with managed keys and patterns for embedding AI.
• Standardise internal app development with templates, authentication, deployment, and docs.
• Consolidate ad-hoc scripts and no-code work into fewer, well-understood integrations.
• Collaborate with non-technical teams to translate problems into builds.

Skills

Systems integration

Data product development

Python

SQL

Databricks

AI integration

Identity and access management

Microsoft 365 / SharePoint

Cost management

Technical communication

Ownership in small teams

Tools

Databricks

Unity Catalog

Lakebase

FastAPI

Streamlit

HTMX

Microsoft 365

SharePoint

REST APIs

Job description

Octopus Energy Group is seeking a data integration specialist to unify business systems with our Databricks environment, building reusable datasets for business consumption through Excel, dashboards, and natural-language queries. You will design AI-enabled tools and internal apps for fund and finance teams, and work with cross-functional data platform squads to reuse existing capabilities.

We seek practical, ownership-minded engineers who can ship pragmatic solutions, implement governance, and