Data Engineer Consultant Senior

Version-1; Bengaluru; Hybrid; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Quarterly profit share

Career development programs

Flexible/remote working

Pension

Private healthcare

Life assurance

Employee discount

Gym discounts

Mindfulness workshops

Employee assistance programme

Job summary

Version 1 seeks a Senior Data Engineer Consultant to design and deliver modern data and analytics solutions for clients, spanning Microsoft Fabric, Azure, and Power BI. You will own sizable engineering workstreams, mentor teammates, and promote best practices across agile delivery teams.

You will translate business needs into scalable, secure data architectures, build robust ETL/ELT pipelines, and ensure production readiness through testing, monitoring and documentation.

Qualifications

• Strong SQL development, troubleshooting and performance-optimisation skills.
• Practical experience with Python or PySpark, notebooks and distributed data-processing concepts.
• Experience building and operating ETL/ELT pipelines and integrating cloud, on-premises or third-party data sources.
• Experience with Fabric lakehouse and warehouse patterns, orchestration, OneLake concepts and Power BI semantic models, including Direct Lake where appropriate.
• Experience with data warehouses, data lakes and Azure data services such as Azure Data Lake Storage and Azure Data Factory.
• Strong knowledge of dimensional modelling, analytical structures and data-modelling trade-offs.
• Experience implementing unit, integration, reconciliation and regression testing for data solutions.
• Experience with Git, pull requests, source control, CI/CD and automated deployment practices.
• Knowledge of security, data governance, lineage, metadata, retention and privacy-aware design.
• Experience with observability, logging, alerting, failure recovery and production support.
• Experience owning a substantial technical workstream and working effectively in Agile delivery environments.
• Strong written and verbal communication, stakeholder engagement and technical documentation skills.
• Experience mentoring colleagues and conducting constructive design or code reviews.
• Microsoft Fabric certification, or actively working towards certification.
• Experience with Microsoft Entra ID, managed identities, Key Vault, Azure Monitor or Log Analytics.
• Experience with infrastructure as code, reusable deployment templates or environment-management automation.
• Exposure to data science, advanced analytics, AI or machine-learning delivery.
• Experience using AI-assisted development tools such as GitHub Copilot and/or Claude in line with organisational controls.
• Experience in a client-facing consultancy or delivery environment.

Responsibilities

• Translate business requirements into technical designs, delivery estimates, implementation tasks and acceptance criteria.
• Design, build and support Microsoft Fabric solutions using lakehouse, warehouse patterns and orchestration.
• Develop ingestion, ETL/ELT pipelines using SQL, Python or PySpark.
• Design and maintain dimensional and analytical data models and Power BI semantic models.
• Implement automated data-quality, validation, reconciliation and schema-change controls.
• Contribute to architecture decisions and lead detailed design sessions for workstreams.
• Apply security and governance controls including least privilege and metadata governance.
• Use source control, peer review, automated testing, CI/CD and repeatable deployment practices.
• Create and maintain technical documentation including data flows and runbooks.
• Estimate and plan engineering work, manage dependencies and communicate risks in Agile teams.
• Support testing, release, monitoring, incident investigation and continuous improvement in production.
• Mentor junior engineers and promote reusable patterns.
• Communicate solution options, progress, risks and recommendations to stakeholders.

Skills

SQL development

Python

PySpark

ETL/ELT pipelines

Fabric lakehouse

Power BI semantic models

Direct Lake

Azure Data Factory

Azure Data Lake Storage

Data warehouses

Data lakes

Dimensional modeling

Unit testing

Git

CI/CD

Security & governance

Observability

Agile delivery

Communication

Documentation

Mentoring

Microsoft Fabric certification

Microsoft Entra ID

Key Vault

IaC

AI-assisted tools

Client-facing

Tools

Git

Power BI

Azure

Job description

Version 1 has celebrated30 yearsinbusinessand continues to be trusted by global brands to delivertechnology and transformationsolutions that drive customer success. Ourdeepexpertiseenables our customers to navigate the rapidlyevolving technology landscape. We foster strong partnerships withglobal technology leadersincluding Microsoft, AWS, Oracle, Red Hat,OutSystems, Snowflake, ensuring that our customers are provided with the highest quality solutions and services.

We’rean award-winning employer reflecting how our employees are at the very heartof whatwe do:

10+ years as a Great Place to Work in Ireland & UK

Best Workplace for Women in the UK & Ireland by GPTW

Best Workplace for Wellbeing in the UK by GPTW

We’rea corevalues drivencompany, we hire people who share our values, and we reward those who display and foster them,it’sdeeply embedded within our DNA. Invest in us andwe’llinvest in you!.

Job Description

5+ Years as a Data Engineer Consultant Senior, you will design, build and support modern data and analytics solutions for clients. Working withsolutionarchitects,principal consultantsand multidisciplinary delivery teams. You will translate business needs intosecure,scalable, maintainable and supportable Microsoft Fabric and Azure solutions. You will take ownership of substantial engineering workstreams from design through deployment and production support, while mentoring colleagues and promoting good engineering practice.

Key Responsibilities

• Translate business requirements into technical designs, delivery estimates, implementation tasks and acceptance criteria.
• Design, build and support Microsoft Fabric solutions using appropriate lakehouse, warehouse, orchestration and semantic-modelling patterns.
• Develop robust ingestion, ETL/ELT and integration pipelines using SQL, Python or PySpark as appropriate.
• Design and maintain dimensional and analytical data models, including star schemas, facts, dimensions and Power BI semantic models.
• Implement automated data-quality, validation, reconciliation and schema-change controls.
• Contribute to architecture decisions and lead detailed design sessions for assigned components or workstreams.
• Apply security and governance controls including least privilege, classification, lineage, metadata, retention and auditability.
• Use source control, peer review, automated testing, CI/CD and repeatable deployment practices.
• Create and maintain technical documentation including data flows, architecture views, configuration, support procedures and runbooks.
• Estimate and plan engineering work, manage dependencies and communicate delivery risks within Agile teams.
• Support testing, release, monitoring, troubleshooting, incident investigation and continuous improvement in production.
• Mentor junior engineers, review technical work and promote reusable patterns and engineering standards.
• Communicate solution options, progress, risks and recommendations to technical and non-technical stakeholders.

Success Criteria

• Independently delivers complex components and workstreams to an agreed level of quality.
• Identifies technical risks early and escalates architectural decisions with clear options and evidence.
• Produces solutions that are testable, observable, secure, maintainable and ready for operational support.
• Raises team capability through mentoring, review and practical engineering leadership.

Qualifications

• Strong SQL development, troubleshooting and performance-optimisation skills.
• Practical experience with Python or PySpark, notebooks and distributed data-processing concepts.
• Experience building and operating ETL/ELT pipelines and integrating cloud, on-premises or third-party data sources.
• Experience with Fabric lakehouse and warehouse patterns, orchestration, OneLake concepts and Power BI semantic models, including Direct Lake where appropriate.
• Experience with data warehouses, data lakes and Azure data services such as Azure Data Lake Storage and Azure Data Factory.
• Strong knowledge of dimensional modelling, analytical structures and data-modelling trade-offs.
• Experience implementing unit, integration, reconciliation and regression testing for data solutions.
• Experience with Git, pull requests, source control, CI/CD and automated deployment practices.
• Knowledge of security, data governance, lineage, metadata, retention and privacy-aware design.
• Experience with observability, logging, alerting, failure recovery and production support.
• Experience owning a substantial technical workstream and working effectively in Agile delivery environments.
• Strong written and verbal communication, stakeholder engagement and technical documentation skills.
• Experience mentoring colleagues and conducting constructive design or code reviews.
• Microsoft Fabric certification, or actively working towards certification.
• Experience with Microsoft Entra ID, managed identities, Key Vault, Azure Monitor or Log Analytics.
• Experience with infrastructure as code, reusable deployment templates or environment-management automation.
• Exposure to data science, advanced analytics, AI or machine-learning delivery.
• Experience using AI-assisted development tools such as GitHub Copilot and/or Claude in line with organisational controls.
• Experience in a client-facing consultancy or delivery environment.

Additional Information

Why Version 1?

At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their wellbeing, professional growth, and financial stability.

• Share in our success with our Quarterly Performance-Related Profit Share Scheme, where employees collectivelybenefitfrom a share of our company's profits
• Strong Career Progression & mentorship coaching through our Strength in Balance & Leadership schemes with a dedicated quarterly Pathways Career Development programme
• Flexible/remote working, Version 1 is tremendously understanding of life events and people’s individual circumstances and offer flexibility to help achieve a healthy work life balance
• Financial Wellbeing initiativesincluding;Pension, Private Healthcare Cover, Life Assurance, Financialadviceand an Employee Discount scheme
• Employee Wellbeing schemes including Gym Discounts, Bike to Work, Fitness classes, Mindfulness Workshops, Employee Assistance Programme and much more. Generous holiday allowance, enhanced maternity/paternity leave, marriage/civil partnership leave and special leave policies
• Educationalassistance, incentivised certifications, and accreditations, including AWS, Microsoft, Oracle, and Red HAT
• Reward schemes including Version 1’s Annual Excellence Awards & ‘Call-Out’ platform.
• Environment, Social and Community First initiatives allow you to get involved in local fundraising and development opportunities as part of fostering our diversity, inclusion and belonging schemes.

Version1 is an equal opportunities employer.

We are committed to building a diverse,inclusiveand respectful workplace where everyone feels valued and able to thrive. We welcome applications from people of all backgrounds, identities and lived experiences, and we value the different perspectives people bring including those shaped by disability and neurodiversity.

We want every candidate to have a positive and accessible recruitment experience. If you need reasonable adjustments at any stage of the process, please contact your recruiter at Version 1. We will consider all requests carefully,respectfullyand confidentially.