Staff Enterprise Technology Engineer

bp; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

BP in the Trading Analytics and Insights organisation seeks a Senior Dataiku Product Engineer to champion the DSS platform across multiple environments for the TA&I team. You will own platform architecture, automate delivery, and drive cost efficiency at enterprise scale.

You will collaborate with Architects, Product Owners and Engineers to implement platform capabilities, monitor critical metrics, and mentor juniors within a hybrid office/remote setup.

Qualifications

• Bachelor or equivalent in Computer Science, Engineering, Information Systems or related field.
• Enterprise DSS implementation experience with Dataiku DSS and hundreds of users.
• Strong Python, SQL and data engineering skills for platform automation.
• Experience with patching, availability, RBAC, LDAP and scalable data/compute.
• Proficient in Git-based SDLC, Jenkins/ADO pipelines and cloud cost control.
• Knowledge of PowerBI and Dash for data visualization in an enterprise context.

Responsibilities

• Lead platform operations and architecture for the Dataiku DSS environment.
• Define metrics, monitor cost, and ensure reliable enterprise-grade operations.
• Collaborate with Architects, Product Owners and Engineers to deliver platform capabilities.
• Plan and oversee full lifecycle from design to deployment with QA checks.
• Mentor junior engineers and drive continuous improvement through retros and RCA.

Skills

Dataiku DSS

Python

Pandas

SQL

ETL principles

Git

Jenkins

Azure DevOps

Jira

AWS

Terraform

Ansible

PowerBI

Plotly Dash Enterprise

SQL Server Administration

Unix systems

Scripting (Shell)

Data modelling

Education

Bachelor or equivalent in Computer Science or related field

Tools

Dataiku

Git

Jenkins

Azure DevOps

Jira

AWS

Terraform

Ansible

Databricks

Plotly Dash

Job description

Entity:

Technology

Job Family Group:

IT&S Group

Job Description:

We are looking for a Senior Dataiku Product Engineer to work within our digital Trading Analytics DevOps team that supports, maintains and improves the Dataiku platform and wider PowerBI and Plotly ecosystem for the Trading Analytics and Insights (TA&I) organisation within the Trading and Shipping (T&S) Entity. You will have a deep understanding of the Dataiku Data Science Studio platform and act as the champion for its use within commodity trading decision support. Operating at true enterprise scale, supporting hundreds of end users across multiple environments for many different discipline communities.

In This Role You Will

• Working as part of an agile DevOps team you will provide thought leadership on all aspects of platform operations and capability delivery. You will own the technical platform architecture.
• Define key platform and user metrics which will be monitored to pre-empt issues, manage cost and mitigate problem reoccurrence ensuring safe and reliable operations.
• Work with platform Architects and Product Owners to assess new platform capabilities, producing formal assessment and design documentation considering enterprise level requirements and impact on Total Cost of Ownership (TCO).
• Work with Product Engineers to deliver high quality platform solutions to plan through the full lifecycle (design, development, test, implementation).
• Collaborate with the Project Manager / Scrum Lead to estimate and plan deliverables and track execution through the daily standup.
• Collaborate with the Service Delivery Manager to define operational process, practices and standards, supporting major service incidents (P1/P2), subsequently contributing to their Root Cause Analysis (RCA) process.
• Collaborate with TA&I Sponsors, dTA Product Managers and Architects to define the platform product roadmap for both functional and technical capabilities.
• Collaborate with the dTA Product Owner, Scrum Lead and Service Delivery lead to manage the TCO with particular focus on cloud cost optimisation.
• Manage the supplier relationship with Dataiku, including influencing the DSS product roadmap to meet TA&I requirements.
• Define protocol standards for the platform, covering version upgrades, capability roadmap, deployment and hosting, availability/recovery, operations. You will be a standard bearer for quality, reliability, repeatability and cost efficiency.
• Define and apply rigorously repeatable engineering principles through the use of automation for all platform processes; ensuring that all configuration is maintained under source control with automated deployment and test.
• Embody the spirit of continuous improvement through agile sprint retros, RCAs, design review workshops, metrics monitoring forums; coaching and developing junior team members; using data to drive where we invest in the platform automation suite.

Essential Experience & Job Requirements

• Bachelor or equivalent experience in Computer Science, Engineering, Information Systems or other numerate field.
• Demonstrable experience as a Dataiku Data Science Studio Lead Product Engineer responsible for an enterprise DSS implementation with hundreds of users and multiple environments.
• Deep technical and functional expertise across the DSS product: both its use as a Data Science / Data Engineering platform and of its configuration and automation via APIs.
• Experience of defining, crafting and leading the implementation of enterprise-strength platform capabilities: patching/upgrade strategy, regression testing, availability/recovery (RPO/RTO), RBAC security model, LDAP integration, scalability of data and compute for the DSS platform.
• Deep understanding of enterprise use of python for platform automation and pandas for data engineering. Including defining protocol standards and monitoring for anti-patterns.
• Advanced use of SQL for data engineering and reporting including data modelling and design skills and exposure to ETL principles and practices. Has defined standards & guidelines.
• Definition and design of the full SDLC (standards and tooling): development, test, deployment; using git source control and Jenkins (or ADO) pipelines.
• Use of Azure DevOps (or Jira) for agile working practices and ceremonies (standups, sprint planning, retros). Refinement of operational and capability backlogs.
• Knowledge management through ADO task updates, formal documents (Excel, Word) in SharePoint and self-service style wiki pages. .
• Evidence of thought leadership through production of formal designs and implementation of those designs by others.
• Production of architecture results: technical architecture diagrams, Key design decision documents.
• Experience of mentoring and coaching of junior staff through direct review of results and informal technical coaching.

Core Technical Skills

• Dataiku Data Science Studio (DSS)
• Python
• Pandas
• SQL
• ETL principles and practices
• Git
• Jenkins
• Azure DevOps (ADO)
• Jira
• AWS (EC2, EBS, RDS, S3, EKS)
• Terraform
• Ansible
• CI/CD deployment and automation
• Unix systems administration
• Shell scripting
• Databricks SQL Data Warehouse
• RBAC Security Model
• LDAP Integration
• PowerBI
• Plotly Dash Enterprise
• Microsoft SQL Server Database Administration
• Azure concepts: subscription, resource groups

Why Join Us?

At BP, we support our people to grow in a diverse and exciting environment. We believe that our team is strengthened by diversity.

There are many aspects of our employees’ lives that are significant, so we offer benefits to enable your work to fit with your life. These benefits can include flexible working options, a generous paid parental leave policy, excellent retirement benefits, among others.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Reinvent your career as you help our business meet the challenges of the future.

Travel Requirement

No travel is expected with this role

Relocation Assistance

This role is not eligible for relocation

Remote Type

This position is a hybrid of office/remote working

Skills

Agility core practices, Agility core practices, API and platform design, Cloud Platforms, Collaboration, Communication, Configuration management and release, Continuous deployment and release, Creating a high performing team, Database Design, Digital Project Management, Documentation and knowledge sharing, Emerging technology monitoring, Facilitation, Information Security, Mentoring, Metrics definition and instrumentation, NoSql data modelling, Problem Solving, Relational Data Modelling, Risk Management, Scripting, Secure development, Service operations and resiliency, Software Design and Development {+ 7 more}

Legal Disclaimer

We are an equal opportunity employer. We do not discriminate on the basis of protected characteristics like race, religion, color, sex, national origin, sexual orientation, veteran status or disability status.Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process,please contact us.

If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.