Principal Data Engineer

Persistent Systems; Dublin; Hybrid; EUR 110,000 - 160,000; Full time

Benefits offered by this job

Competitive salary

Hybrid work model

Career growth & certifications

Long service awards

Insurance coverage

Job summary

Persistent Systems is seeking a Principal Data Engineer to design, build, and evolve data solutions for U.S. healthcare.

This hybrid, permanent role sits at the intersection of engineering, analytics, and business strategy, delivering scalable data products and AI-enabled capabilities. You will mentor engineers, drive cloud-based data pipelines, and partner with stakeholders to translate complex needs into practical technical strategies, including a migration to enterprise-grade Databricks

Qualifications

• Bachelor's degree in Computer Science or related field or equivalent experience.
• 8+ years of hands-on experience delivering complex data products or platforms.
• 8+ years designing scalable data solutions with pipeline infra and analytics.
• Experience with high-volume batch data pipelines in Azure environment.
• 5+ years with Databricks and Apache Spark.
• 2+ years with DBT.
• Strong SQL and programming (Python or Scala).
• Knowledge of data modelling, data quality, lineage and observability.
• Experience with data pipeline orchestration tools (Airflow or Databricks).
• Security, reliability, performance, cost, and maintainability considerations in design decisions.

Responsibilities

• Design and build scalable data products and platform components using modern cloud, lakehouse, and software practices.
• Partner with product, business, architecture, security, governance, and engineering teams to translate needs into technical solutions.
• Lead large-scale migration from Databricks clusters to enterprise-managed Databricks clusters.
• Provide technical mentorship and design guidance to junior engineers.
• Contribute to data capability enhancements without direct people-management.

Skills

Azure

Databricks

Apache Spark

SQL

Python

Scala

Data modeling

Airflow

CI/CD

Cloud security

Education

Bachelor's degree in CS or related

Tools

Snowflake

Terraform

GitHub Actions

Job description

We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 20 Fortune 50 companies and 4 of the 5 top banks in both the US and India, and numerous innovators across the healthcare ecosystem.

Our disruptor’s mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum. Persistent has been recognized across top industry platforms for innovation, leadership, and inclusion. We have delivered 21 sequential quarters of growth with $389.7M in Q1 FY26 revenue, up 3.9% Q-o-Q and 18.8% Y-o-Y growth. Our 25,000+ global team members, located in 18 countries, have been instrumental in helping the market leaders transform their industries. We have been named the fastest-growing Indian IT services brand in the “Brand Finance India 100” 2025 report. We were also cited as a Leader in the ISG Provider Lens™ 2025 for Digital Engineering Services 2025 and the Everest Group Talent Readiness for Next-generation Application Services PEAK Matrix® Assessment 2025.

We are fast growing company (with $1 billion dollars in revenue). Plan to grow at Krakow, Poland. If you’re interested in working on bleeding Data and AI technologies, join us.

Read more - https://www.persistent.com/

About Position and details:

• Role: Principal Data Engineer
• Mode: Hybrid
• Job Type: Permanent role

We are looking for a Principal Data Engineer who will contribute to the design, build, and evolution of data solutions which serve U.S. healthcare. You will work at the intersection of engineering, analytics, and business strategy-building scalable, trusted data solutions and enabling advanced analytical, data science and artificial intelligence capabilities.

What you will do:

• Serve as the hands-on data engineering subject matter expert for technical initiatives, contributing to technical direction while designing and delivering critical data capabilities
• Design and build scalable, reliable data products and platform components using modern cloud, Lakehouse, and software engineering practices
• Partner closely with product, business, architecture, security, governance, and engineering stakeholders to translate complex needs into pragmatic technical solutions
• Contribute to a large-scale migration from Databricks Cluster to an Enterprise Managed Databrick cluster.
• Provide technical mentorship to junior team members, design guidance, and constructive review to engineers, raising
• Data capability across the team without direct people-management responsibility

What you will bring:

• Bachelor's degree or higher in a relevant Computer Science field, or equivalent professional experience
• 8+ years demonstrated experience contributing to complex data products or platforms i.e. hands-on in design and delivery of Data solutions
• 8+ years’ experience designing and building scalable data solutions accounting for pipeline infrastructure and analytical operations.
• Experience with high-volume batch data pipelines within a public cloud environment ideally Azure.
• 5+ years’ experience working with Databricks, Apache Spark.
• 2+ years’ experience working with DBT.
• Demonstrated advanced proficiency in SQL and a general-purpose programming language such as Python or Scala
• Demonstrated solid understanding of data modelling, distributed data processing, metadata management, data quality, lineage, and observability
• Proven experience implementing data pipeline orchestration solutions using tooling such as Apache Airflow or Native Databricks orchestration.
• Experience making and communicating design decisions across security, reliability, performance, scalability, cost, and maintainability considerations
• Demonstrated solid understanding of software engineering practices, including automated testing, version control, CI/CD, infrastructure as code, and operational support
• Demonstrated understanding of cloud security, identity and access management, tenant isolation, and privacy principles for sensitive data
• Proven experience partnering with product, business, architecture, AI, security, and governance stakeholders to translate ambiguous requirements into deliverable technical strategies
• Proven ability to communicate complex concepts clearly to technical and non-technical audiences

Other useful skills and experience include:

• Proven hands-on experience with Azure data services or Azure Cloud Ecosystem technologies.
• Proven experience with GitHub Actions Workflows
• Proven experience working with Snowflake, Terraform, or equivalent technologies
• Demonstrated knowledge of data cataloguing, governance, and security controls for sensitive or regulated data
• Experience within the healthcare industry

Please note you must currently be eligible to work in Ireland and attend the office (Dublin or Letterkenny) 2 days weekly. Proof will be required to support your application.

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.com/careers.

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”