Associate Data Engineer – Client‑Focused Analytics

Optima Partners; City of Edinburgh; Hybrid; GBP 28,000 - 44,000; Full time

Benefits offered by this job

Private medical insurance

Salary sacrifice pension scheme

Up to 37 days holiday

Discretionary bonus plan (up to 15%)

Access to perks portal

Dedicated development time and funding

Job summary

Optima Partners, an Edinburgh-based data and business consultancy, seeks an Associate Consultant - Data Engineering to design, build and maintain scalable data pipelines for a diverse client base. You will work in cross-functional teams with data scientists, engineers and consultants while developing practical data solutions.

The role offers exposure to modern data engineering practices, with mentoring and opportunities for career progression within a collaborative, knowledge-sharing culture.

Qualifications

• Working knowledge of Python and SQL for data processing.
• Exposure to Spark, Databricks or similar big data technologies.
• Awareness of Databricks, Delta Lake, notebooks or jobs; production experience not essential.
• Familiarity with AWS, Azure or GCP for data tasks.
• Basic understanding of relational databases and SQL queries.
• Familiarity with Git and collaborative workflows.
• Interest in CI/CD, automated testing and infrastructure as code.

Responsibilities

• Support the development, testing and maintenance of data pipelines that collect, transform and integrate data from a range of sources.
• Assist in implementing and improving data architectures, including data warehouses and data lakes.
• Help build and maintain ETL and ELT workflows with exposure to Databricks Jobs and Delta Lake patterns.
• Work with data scientists, analysts, engineers and client stakeholders to understand requirements and deliver data solutions.
• Support monitoring, troubleshooting and optimisation of data systems under senior guidance.
• Contribute to automation opportunities and improve data engineering workflows.
• Maintain clear technical documentation for data solutions and learning materials.

Skills

Python

SQL

Spark

Databricks

AWS

Azure

GCP

PostgreSQL

Git

CI/CD

Agile

Tools

Databricks

Delta Lake

Job description

Optima Partners, an Edinburgh-based data and business consultancy, seeks an Associate Consultant - Data Engineering to design, build and maintain scalable data pipelines for a diverse client base. You will work in cross-functional teams with data scientists, engineers and consultants while developing practical data solutions.

The role offers exposure to modern data engineering practices, with mentoring and opportunities for career progression within a collaborative, knowledge-sharing culture.