Senior Data Engineer

Vitesse PSP; London; Remote; GBP 50,000 - 90,000; Full time

Job summary

Join a forward-thinking company as a Senior Data Engineer, where your expertise in data processing and engineering will help shape innovative solutions. In this dynamic role, you will design and maintain scalable data pipelines, ensuring the highest standards of security and compliance. Collaborate with multidisciplinary teams to deliver impactful data solutions that drive business success. This role offers the flexibility of remote work while being part of a supportive and inclusive environment. If you're passionate about data and eager to contribute to cutting-edge projects, this opportunity is perfect for you.

Benefits

25 days Holiday per year

Remote working - UK or EU Based

Contributory pension scheme

Enhanced Parental leave

Cycle to Work Scheme

Private Medical Insurance

Unlimited access to therapy sessions

Discounted Gym membership

Financial Coaching

2 days of volunteering leave

Qualifications

• Experience in developing data pipelines in Python and SQL.
• Knowledge of data governance and privacy regulations.
• Familiarity with cloud-native data platforms.

Responsibilities

• Design and maintain scalable data pipelines for structured and unstructured data.
• Optimize data pipelines and queries for performance and cost-efficiency.
• Collaborate with teams to ensure availability of relevant data.

Skills

Python

SQL

Data Processing Pipelines

Data Governance

Agile Methodologies

Data Engineering

Cloud Platforms (AWS/Azure/Databricks)

DevOps

Education

Bachelor's Degree in Computer Science or related field

Tools

Databricks

Terraform

GitHub

Kafka

AWS Kinesis

Azure Stream Analytics

Job description

We are Vitesse, a global leader in cross-border payment solutions, dedicated to empowering businesses with fast, secure, and reliable financial technology. Our engineering department is expanding, and we are looking for a talented Data Platform Engineer to join our team. This role is integral to establishing a robust semantic layer and creating a framework to enable the development of data-heavy features across multiple teams.

As a Senior Data Engineer, you will collaborate closely with our business and engineering teams to design, implement, and maintain data engineering solutions while ensuring security and data best practices. You will work on internal and/or Vitesse SaaS platform data initiatives. As a senior you will work mostly independently with light touch leadership from the squad lead. You will join a multidisciplinary squad of 5 data professionals within the organisation's wider data team. We work remotely with regular contact time in our London based offices.

YOUR RESPONSIBILITIES

• Design, build, and maintain scalable data pipelines for batch and real-time data handling large volumes of structured and unstructured data.
• Develop, enhance, and optimize ELT processes to ingest, transform, enrich and publish data.
• Build quality, trusted, secure data products for consumption in reporting, analytics and science.
• Assure the privacy, security and legal compliance of data in data engineering.
• Optimise data pipelines and queries for better performance and cost-efficiency.
• Integrate data pipelines with monitoring and observability to proactively detect and resolve issues before they impact business operations.
• Design and build data models for lake house storage and analytics.
• Implement and maintain CI/CD pipelines for data engineering.
• Collaborate with business teams, product owners, analysts and data scientists to understand their needs and ensure availability of relevant data.
• Capture and maintain data documentation enabling self-service communities to understand, assess and utilise reusable data assets.
• Research and evaluate cutting-edge data technologies, tools, and practices to improve data engineering processes.
• Mentor early in career data engineers, support the squad lead in PR review.

Requirements

• Developing data processing pipelines in python and SQL for Databricks including many of the following technologies: Spark, Delta, Delta Live Tables, PyTest, Great Expectations (or similar) and Jobs.
• Developing data pipelines for batch and stream processing and analytics.
• Building data pipelines for enterprise data and one other business domain.
• Building and orchestrating data pipelines and analytical processing for streaming data with technologies such as Kafka, AWS Kinesis or Azure Stream Analytics.
• Knowledge of data governance, privacy regulations (e.g. GDPR), and security best practices.
• Delivering data engineering and designing for cloud native data platforms (AWS/ Azure/ Databricks).
• Building DevOps pipelines for data engineering solutions using Terraform, GitHub, DevOps.
• Working within highly agile multidisciplinary scrum teams in Scrum/Kanban.
• Mentoring data engineers, carrying out PR review.

Desirable experience

• Domain knowledge from insurance, payments or equivalent domains.
• Building data pipelines to support AI/ML solutions created in Mosaic AI/ML Flow.
• Background in software engineering.
• Experience automated testing for data.

Benefits

• 25 days Holiday per year (increasing by 1 day per years' service, up to 30 days) + Bank Holidays.
• Remote working - UK or EU Based.
• Contributory pension scheme.
• Enhanced Parental leave.
• Cycle to Work Scheme.
• Private Medical Insurance with AXA.
• Unlimited access to therapy sessions through our partner, Oliva.
• Discounted Gym membership through Gympass.
• Financial Coaching with Octopus Wealth.
• 2 days of volunteering leave per year.
• Sabbatical after 5 years' service.
• Life Assurance - MetLife (UK employees only).
• Ongoing Learning and Development to support you reach your career goals.

Vitesse at our best - our values

The Vitesse values are a true reflection of what it takes to thrive in our business, so it's important to us that any employee who joins our business is aligned with these 3 attributes:

Confident Humility

We don't do ego and we know that unless we all win, none of us win. We admit when we're wrong, ask for help and always think about the wider business before ourselves.

Driven to Succeed

We see the opportunity ahead of us and we won't stop until we fulfil the potential we know we have. We hold ourselves to high standards and deliver high quality outcomes for Vitesse and our customers.

Tenacious Responsibility

We take ownership for our actions and decisions, and face into the challenges that come our way. We are committed to seeing things through to completion, even in the face of adversity.

We are an Equal Opportunity Employer

We are committed to creating an inclusive environment that enables everyone to perform at their best, where we recognise the rights of all individuals to mutual respect and where there is an unbiased acceptance of others. Our policies and practices aim to promote an environment that is free from all forms of unfair discrimination and values the diversity of all people. At the heart of our policy, we seek to treat people fairly and with dignity and respect. Please confirm if selected for an interview, what interview adjustments you would need? You can contact Clara Moretti-Greene on [e-mail] or in her absence contact our People Team [e-mail].