Senior Data Platform Engineer (Hybrid Work Model)

Dynamics ATS; Pune District; Hybrid; INR 2,800,000 - 4,000,000; Full time

Job summary

Quorum Software is seeking a Senior Data Platform Engineer in Pune to design, build, and maintain scalable data pipelines that move data across Bronze, Silver, and Gold layers using a Medallion Architecture. You will own data quality, monitoring, and observability while collaborating with teams in India and the US.

You will work with Databricks, Unity Catalog, and Azure data services to deliver analytics, dashboards, and reporting that enable data-driven decisions.

Qualifications

• 5+ years of hands-on data engineering in a production environment.
• Strong Python and SQL, complex joins, and performance tuning.
• Experience with data pipeline design patterns, incremental loading, schema evolution, error handling.

Responsibilities

• Design, build, and maintain scalable data pipelines across Bronze, Silver, and Gold layers.
• Develop and optimize data workflows in Databricks and Unity Catalog.
• Build dashboards and reports with stakeholders, ensuring reliable views of data.
• Own data quality and monitoring for pipelines with SLA adherence.
• Collaborate with distributed teams in India and the US to shape what gets built.

Skills

Python

SQL

Data pipelines

Databricks

Azure data services

Tools

Databricks

Unity Catalog

Databricks Workflows

Azure Data Factory

Azure Synapse

Job description

Senior Data Platform Engineer

Location: Pune, India

Model of Work: Hybrid

About Quorum Software

Quorum Software connects people and information across the energy value chain. Twenty years ago, we built the first software for gas plant accountants. Pipeline operators came next, followed by land administrators, pumpers, and planners. Since 1998, Quorum has helped thousands of energy workers with business workflows that optimize profitability and growth. Our vision for the future connects the global energy ecosystem through cloud-first software, data standards, and integration. The trusted source of decision-ready data for 1,800+ companies, Quorum Software makes the essential connections that let us work better together in the connected energy workplace. For more information, visit quorumsoftware.com

Be a part of our legacy

Quorum Software is the world's largest provider of digital technology focused solely on business workflows that empower the next evolution of energy. From emerging companies to supermajors, throughout every region of the globe, customers rely on Quorum's proven innovation and unmatched global expertise to streamline business operations and make data-driven decisions that optimize profitability and growth. Our industry-leading solutions are transforming energy companies across the entire value chain, helping visionary leaders evolve their organizations into modern energy companies.

Who we are looking for:

Are you excited by challenges?Do you enjoy working in a fast-paced, international and dynamic environment?Then now is the time to join Quorum Software, a rapidly growing company and industry leader in oil & gas transformation.

Job Purpose

We are looking for a Senior Data Platform Engineer to join the OPTI (Office of Product and Technology Innovation) AI Platform team in Pune. You will build, deliver, and maintain the data pipelines, analytics, dashboards, and reporting that run on the Databricks platform of the OPTI AI team, and you will own their data quality and monitoring.

You are a strong individual contributor who takes ownership of complex technical problems, brings opinions to design discussions, and raises the quality bar of everything you touch. You won't just execute tickets: you'll help shape how data moves, transforms, and gets consumed. You will work day to day with the Pune and US, AI Platform team and the team supports what it builds in production.

What You Will Do:

• Design, build, and maintain scalable data pipelines that move and transform data across Bronze, Silver, and Gold layers in a Medallion Architecture
• Develop and optimize data workflows in Databricks, Databricks Workflows, and Unity Catalog
• Build dashboards and reports with stakeholders/SMEs, turning their requirements into reliable, well-designed views of the data
• Own data quality and monitoring for your pipelines: checks, alerting, and observability that keep SLAs met consistently
• Take part in design reviews, bringing practical experience and a critical eye to technical decisions
• Use AI coding tools and our AI Development Life Cycle (AIDLC) as part of how you build, test, and ship

• Work with Azure data services for storage, orchestration, security, and infrastructure, alongside the team's DevOps engineer
• Collaborate with stakeholders, AI Platform team in US and India to shape what gets built and why
• And other duties as assigned.

What to Bring:

Data engineering fundamentals

• 5+ years of hands-on data engineering experience in a production environment
• Strong Python and SQL, complex joins, and performance tuning
• Solid understanding of pipeline design patterns: incremental loading, schema evolution, and error handling
• Experience with multiple ingestion methods: Batch based, JDBC, API driven, KAFKA etc

Databricks and Spark

• Hands-on experience with Apache Spark or other large-scale data processing tools
• Databricks experience strongly preferred, Unity Catalog, and Databricks Workflows
• Working knowledge of Medallion Architecture and how to structure Bronze, Silver, and Gold layers for different data domains and Star-schema presentation layer. Useful knowledge of SCD2, data lineage, data quality measures, etc

Quality, testing, and observability

• A testing mindset: automated tests for transformations, data quality checks, and validation built into the pipeline
• Experience setting up monitoring and alerting for production pipelines, and debugging and optimizing slow or failing ones
• Familiarity with CI/CD for data pipelines, including version control, automated testing, and deployment (GitHub Actions or Azure DevOps)

Reporting

• Strong Experience building dashboards and reports that business users rely on

Azure

• Hands-on experience with Azure data services such as Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Microsoft Purview, and Azure Key Vault
• Hands-on experience with infrastructure as code on Azure, such as Terraform or Bicep

Working style:

• Hands-on experience with AI coding tools like Claude
• Clear written and spoken English, and confidence working with distributed teams across India and the US

Nice to Have:

• Experience in the oil and gas or energy industry, particularly with operational, production, or field data

Additional Details

• Visa Sponsorship: Employment eligibility to work with Quorum Software in India is required as the company will not pursue visa sponsorship for this position.

Quorum Diversity Statement:

At Quorum, we are committed to fostering,cultivating,and preserving a culture of belonging. We want to be the place where a diverse pool of talented peoplejoinus, stay with us and do their best work. With a diverse team of employees, we grow and learn better together. The collective sum of the individual differences, life experiences, knowledge, innovation, self-expression, and talent that our employees invest in their work represents not only part of our culture, but our reputation and our achievements. We are fully focused on equity and equality and believe deeply in diversity of race, gender, sexual orientation, age, religion, ethnicity, national origin, ability, neurodiversity and all the other characteristics that make us unique.

Quorum Business Solutions and Quorum Software are Equal Opportunity Employers. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, ancestry, veteran status, disability, genetic information, or any other basis protected by law.

Those applicants requiring reasonable accommodation to the application and/or interview process should notify a member of the Human Resources Department