DataOps Python Engineer for AI & Ontology Pipelines

Elsevier; Cambridge; On-site; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Country-specific benefits

Job summary

Elsevier is seeking a DataOps Engineer to maintain and evolve data and ontology pipelines that power our AI and NLP technology stack. You will collaborate with Ontology and Data Science teams to build high-quality vocabularies and data products, while crafting automation and software solutions to boost efficiency and customer outcomes.

You will contribute to production-grade pipelines, work with AWS Batch, Step Functions and Lambda, and support ongoing data operations across multiple cloud

Qualifications

• Experience in Python software development.
• Experience with pytest or unittest; code reviews.
• Proficiency with UNIX and command-line environments.
• Experience using GitHub for version control.
• Experience with cloud technologies (AWS, GCP, Azure).
• Excellent teamwork and problem-solving skills.
• Experience in production environments.
• Experience with Puppet or Terraform for orchestration.
• Experience in Python GUI development.
• Experience with ontologies or XML.
• Knowledge of compute clusters and workflow management.

Responsibilities

• Maintain and improve ontology import pipelines.
• Support Ontology Team in building vocabularies and ontologies.
• Provide support for customer projects as needed.
• Develop software to assist manual curation efforts.
• Develop and maintain automation pipelines across the DataOps team.
• Work with AWS Batch, Step Functions, and Lambda-based solutions.
• Collaborate with Data Science and Ontology teams.
• Improve DataOps processes and tooling.

Skills

Python

UNIX

GitHub

Cloud platforms

PyTest

XML

Terraform

Puppet

GUI development

Compute clusters

Tools

AWS

GCP

Azure

Job description

Elsevier is seeking a DataOps Engineer to maintain and evolve data and ontology pipelines that power our AI and NLP technology stack. You will collaborate with Ontology and Data Science teams to build high-quality vocabularies and data products, while crafting automation and software solutions to boost efficiency and customer outcomes.

You will contribute to production-grade pipelines, work with AWS Batch, Step Functions and Lambda, and support ongoing data operations across multiple cloud