Senior Data Engineer

Version 1; Dublin; Hybrid; EUR 120,000 - 150,000; Full time

Benefits offered by this job

Quarterly profit share

Career progression & mentorship

Flexible/remote working

Healthcare & life insurance

Wellbeing & gym discounts

Job summary

Version 1 is seeking an experienced Data Engineer to join our Dublin team on a hybrid basis. You will build, develop and operate data pipelines, collaborating with data scientists and application developers in a global enterprise.

You will design scalable ETL/DWH solutions using Python, Spark and Databricks, optimise memory and cluster performance, and contribute to documentation while mentoring junior colleagues.

Qualifications

• 10+ years hands-on ETL/DWH development experience.
• Strong programming experience in Python, Spark and SQL.
• Experience designing and scaling end-to-end high-volume data integration processes.

Responsibilities

• Collaborate with solution architects, data architects and developers to gather data integration requirements.
• Develop data pipelines and integrate statistical algorithms into robust, scalable workflows.
• Design, develop and optimize pipelines in Databricks environments.
• Assess Spark performance, memory management and cluster resource usage.
• Mentor juniors and maintain up-to-date documentation.

Skills

ETL/ DWH development

Python

SQL

Spark

Databricks

Data pipelines

Cloud data concepts

Education

Third level IT qualification

Tools

Databricks cluster configuration

Unity Catalog

AWS

SQL Server

Job description

Company Description

Version 1 has celebrated 30 years in business and continues to be trusted by global brands to deliver technology and transformation solutions that drive customer success. Our deep expertise enables our customers to navigate the rapidly evolving technology landscape. We foster strong partnerships with global technology leaders including Microsoft, AWS, Oracle, Red Hat, OutSystems, Snowflake, ensuring that our customers are provided with the highest quality solutions and services.

Company Description

Version 1 has celebrated 30 years in business and continues to be trusted by global brands to deliver technology and transformation solutions that drive customer success. Our deep expertise enables our customers to navigate the rapidly evolving technology landscape. We foster strong partnerships with global technology leaders including Microsoft, AWS, Oracle, Red Hat, OutSystems, Snowflake, ensuring that our customers are provided with the highest quality solutions and services.

• UK & Ireland's premier AWS, Microsoft & Oracle partner
• 3300+ strong, €350/£300m revenue business
• 10+ years as a Great Place to Work in Ireland & UK
• Best Workplace for Women in the UK & Ireland by GPTW
• Best Workplace for Wellbeing in the UK by GPTW

We’re an award-winning employer reflecting how our employees are at the very heart of what we do:

Invest in us and we’ll invest in you!.

Job Description

Are you an experienced Data Engineer who wants to work with cutting edge technologies? Are you keen to build, develop and work at the forefront and centre of data engineering in a global enterprise? If so, this may be the role for you!

This is a hybrid role with the flexibility to work both virtually and from Dublin office.

Reporting To The Data Engineering Manager You Will

• Work with solution architects, data architects, and application developers to gather data integration requirements and develop solutions accordingly
• Collaborate with data scientists to develop and integrate statistical and forecasting algorithms into robust high-performing pipelines.
• Design, develop, and optimize data pipeline solutions scaling to multi-terabyte datasets in Databricks environments
• Assess and improve Spark performance in areas of memory management, caching strategies, and cluster resource optimization
• Manage individual tasks and communicate updates to colleagues following an Agile Scrum methodology
• Mentor junior colleagues, providing guidance and support to help them grow professionally
• Maintain up to date Technical and Operational documentation

How this opportunity is different

This is a great opportunity for an experienced Engineer who wishes to broaden their role through working across multiple data and analytics projects and products. The Data Engineering team is working with new, innovative technologies such as Databricks, Unity Catalog, and AWS alongside established technologies like SQL Server.

Qualifications

• Third level IT qualification or equivalent experience, with a solid foundation in mathematics and/or statistics.
• 10+ years hands-on experience as an ETL/DWH developer with strong knowledge in designing, developing, and scaling end-to-end high-volume data integration processes
• Strong programming experience with Python, SPARK, and SQL
• Strong understanding of Spark execution plans and memory management
• Experience with Databricks cluster configuration, performance, and cost optimization strategies
• Customer focused with excellent communications skills (both oral and written)
• A strong team player that can also work independently

Additional Information

Why Version 1?

At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their wellbeing, professional growth, and financial stability.

• Share in our success with our Quarterly Performance-Related Profit Share Scheme, where employees collectively benefit from a share of our company's profits
• Strong Career Progression & mentorship coaching through our Strength in Balance & Leadership schemes with a dedicated quarterly Pathways Career Development programme
• Flexible/remote working, Version 1 is tremendously understanding of life events and people’s individual circumstances and offer flexibility to help achieve a healthy work life balance
• Financial Wellbeing initiatives including; Pension, Private Healthcare Cover, Life Assurance, Financial advice and an Employee Discount scheme
• Employee Wellbeing schemes including Gym Discounts, Bike to Work, Fitness classes, Mindfulness Workshops, Employee Assistance Programme and much more. Generous holiday allowance, enhanced maternity/paternity leave, marriage/civil partnership leave and special leave policies
• Educational assistance, incentivised certifications, and accreditations, including AWS, Microsoft, Oracle, and Red Hat
• Reward schemes including Version 1’s Annual Excellence Awards & "Call-Out" platform.
• Environment, Social and Community First initiatives allow you to get involved in local fundraising and development opportunities as part of fostering our diversity, inclusion and belonging schemes.

And many more exciting benefits… drop us a note to find out more.

Version 1 is an equal opportunities employer.

We are committed to building a diverse, inclusive and respectful workplace where everyone feels valued and able to thrive. We welcome applications from people of all backgrounds, identities and lived experiences, and we value the different perspectives people bring including those shaped by disability and neurodiversity.

We want every candidate to have a positive and accessible recruitment experience. If you need reasonable adjustments at any stage of the process, please contact your recruiter at Version 1. We will consider all requests carefully, respectfully and confidentially.

Video Links

https://www.youtube.com/watch?v=F_d3ELTH5zo