Senior Data Platform Engineer

Dataiku; United Kingdom; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading AI platform company in the UK is looking for a Sr. Data Platform Engineer to deliver data and GenAI solutions. The ideal candidate will have over 5 years of experience in data engineering with expertise in SQL, Python, and strong knowledge of GenAI. You will collaborate across teams to build a scalable data platform driving analytics and insights. Join us to innovate and shape the future of AI.

Benefits

Flexible working hours

Professional development opportunities

Qualifications

• 5+ years of relevant experience in Data Engineering or Data Platform Engineering.
• Strong understanding of security and governance concepts in GenAI.
• Excellent communication skills with senior audiences.

Responsibilities

• Be an expert level engineer within the Dataiku Platform.
• Build & maintain GenAI Platform solutions focused on security.
• Collaborate with engineers to build scalable solutions.

Skills

GenAI development

SQL

Python

Data architecture

DataOps

Tools

Snowflake

Dataiku DSS

Github Actions

Azure DevOps

Job description

Overview

Dataiku is The Universal AI Platform, giving organizations control over their AI talent, processes, and technologies to unleash the creation of analytics, models, and agents. Providing no-, low-, and full-code capabilities, Dataiku meets teams where they are today, allowing them to begin building with AI using their existing skills and knowledge.

Context: Dataiku is looking for a Sr. Data Platform Engineer to join our Enterprise Data and Analytics (EDA) team. As a member of the EDA Team, you will play a central role in delivering data & GenAI solutions to fuel analytics and data-driven insights to various stakeholders and teams within the company.

You will be a key technical member contributing to the Data Platform that fuels centralized analytics, embedded analytics teams, and self-service users across the organization. At this level of seniority, non-technical skills, learning & teaching, and business acumen are critical, along with the expectation of technical excellence as you will help drive technical decision-making and solutioning of key technical challenges both within the team and across the Analytics Community. The technical day to day will primarily be within the Data Platform built using Snowflake, Dataiku & Github.

The primary development will focus on GenAI Platform Capabilities, Python & SQL (among other languages), DataOps processes built within Github Actions & Dataiku, and data platform processes built within Snowflake & Dataiku. Strong software development lifecycle knowledge and DataOps skills are a must! The ideal candidate is naturally curious, has excellent verbal and written communication skills, a sharp analytical mind, a positive attitude towards work and thrives when collaborating towards a shared goal. This is an internal and non-client facing role.

What you’ll do

Dataiku is unique in that every Dataiker is encouraged to use our own product within our Enterprise Data Platform. We are looking for a strong technical engineer to help us to continue to build out our Data Platform internally. GenAI engineering is growing internally, which brings a unique opportunity to help build out a Data Platform for GenAI engineering, along with delivering a scalable platform with governed data to fuel an entire company of current or potential Data Analysts. This role will also play a key part in delivering GenAI architecture & guidance to our stakeholders. Your responsibilities within the team include but are not limited to:

• Be an expert level engineer within the Dataiku Platform including Platform Automation, GenAI Capabilities, Plugin Development, maintenance & troubleshooting
• Be an expert level engineer within Snowflake for data engineering and security/governance features
• Build & maintain GenAI Platform solutions focused on security and governance for engineering delivery
• Build & maintain Python & SQL based platform automation process
• Build & maintain DataOps process for SDLC delivery
• Build & maintain data quality metrics & observability to help drive data quality standards
• Build & maintain administration systems and applications for monitoring, alerting, data observability, access management, platform metrics, and end user transparency
• Assist Data Engineering with building Python & SQL data replication & data pipelines on large & often complex data sets
• Design data models for both short term and long term use cases to support data warehouse scalability
• Identify opportunities for improvements & optimization for greater scalability & delivery velocity
• Collaborate with engineers within GenAI Engineering & Analytics Engineering to build scalable solutions within the Data Platform
• Perform root cause analysis on often complex errors to help ensure data pipeline availability
• Help drive technical & architectural decisions on the data platform including decisions on data architecture, data engineering processes, data quality frameworks, data access security & governance frameworks, DataOps processes & data consumption models
• Help test new features in Dataiku and partner tools to both provide feedback internally and determine value towards internal analytics & data platform integration
• Work closely with key stakeholders across the organization including Infra, embedded analytics teams, Product and Engineering to help foster both technical implementations & requirements gathering
• Promote the Data Platform internally, help train & mentor others within the organization with technical excellence, & provide support on data & platform related inquiries
• Proactively drive innovation internally with dedicated innovation time & projects that aim to be transformational for either the platform, team or company as a whole
• Actively contribute to the expertise level and competencies of the EDA Team and participate in the creation and support of data development standards and best practices

Requirements

• Experience & a strong understanding of GenAI development, security & governance concepts a must
• 5+ years of relevant experience in Data Engineering / Data Platform Engineering /Data Architecture
• Expert level SQL & Python is a must
• Experience in Dataiku DSS is a strong plus
• Prior experience with Snowflake required
• Prior experience with DevOps technologies such as Github Actions, Azure DevOps or Jenkins
• Strong understanding of data architecture & data modeling concepts
• Prior experience building and maintaining replication & data pipelines in a cloud data warehouse or data lake environment
• Strong analytical mindset; proactively clarifies ambiguous problems, challenges assumptions, and proposes pragmatic solutions
• Works effectively with complex stakeholders, translating vague asks into clear, testable requirements
• Excellent written and verbal communication with senior audiences; articulates business value, data products, and platform capabilities; produces precise, concise documentation
• Demonstrated ownership in remote, fast-paced environments: manages multiple projects, adapts to different roles, mentors peers, and invests in continuous learning & knowledge-sharing

What are you waiting for!

At Dataiku, you'll be part of a journey to shape the ever-evolving world of AI. We're not just building a product; we're crafting the future of AI. If you're ready to make a significant impact in a company that values innovation, collaboration, and your personal growth, we can't wait to welcome you to Dataiku!

Our practices are rooted in the idea that everyone should be treated with dignity, decency and fairness. Dataiku also believes that a diverse identity is a source of strength and allows us to optimize across the many dimensions that are needed for our success. Therefore, we are proud to be an equal opportunity employer. If you need assistance or an accommodation, please contact us at [e-mail]

Protect yourself from fraudulent recruitment activity

Dataiku will never ask you for payment of any type during the interview or hiring process. If you experience something unusual or suspect fraudulent activity, please review our page on identifying and reporting fraudulent activity here.