Senior Software Engineer (Data Platform)

G-P; India; Remote; INR 1,200,000 - 2,400,000; Full time

Benefits offered by this job

Generous paid parental leave

Flexible time off

Spending accounts

Medical insurance

Dental insurance

Vision insurance

Sabbatical after 5 years

Job summary

G-P is searching for a Senior Software Engineer for its AI-native Data Platform, emphasizing data pipeline design and governance. This role requires a minimum of 5 years' experience in building large-scale data systems and expertise in the Databricks ecosystem. Responsibilities include crafting reusable data processing patterns and ensuring platform performance while managing costs. G-P offers flexibility, competitive salary, and a variety of benefits including generous parental leave and medical insurance.

Qualifications

• 5+ years of experience building and operating production-grade data systems at massive scale.
• Deep, hands-on mastery of the Databricks/Spark ecosystem.
• Proven track record of building real-time/streaming architectures.

Responsibilities

• Lead design and implementation of internal SDKs and frameworks.
• Take full ownership of the cost-effectiveness of the Databricks ecosystem.
• Implement Schema-on-Write validation and Data Contracts.

Skills

Databricks/Spark ecosystem

Real-time/Streaming architectures

Production-grade data systems

Cloud cost optimization

Building APIs/tools/frameworks

Job description

Senior Software Engineer (Data Platform)

India (Remote-First)

About Us

Our leading SaaS-based Global Employment Platform™ enables clients to expand into over 180 countries quickly and efficiently, without the complexities of establishing local entities. At G-P, we’re dedicated to breaking down barriers to global business and creating opportunities for everyone, everywhere.

Our diverse, remote-first teams are essential to our success. We empower our Dream Team members with flexibility and resources, fostering an environment where innovation thrives and every contribution is valued and celebrated.

The work you do here will positively impact lives around the world. We stand by our promise: Opportunity Made Possible. In addition to competitive compensation and benefits, we invite you to join us in expanding your skills and helping to reshape the future of work.

At G-P, we assist organizations in building exceptional global teams in days, not months—streamlining the hiring, onboarding, and management process to unlock growth potential for all.

About the Role

As a Senior Data Engineer, you will be the architectural backbone of the AI-native Data Platform. You won't just build pipelines; you will design the self-service frameworks and high-performance engines that power every product and AI workflow across the company.

You will bridge the gap between strategic leadership and technical execution, ensuring that our Databricks Lakehouse scales efficiently to handle hundreds of services while maintaining world-class data reliability and cost-efficiency.

What You Will Do

Architect the Data Platform

• Lead the design and implementation of internal SDKs and self-service frameworks that enable distributed engineering teams to ingest and transform data autonomously.
• Shift from "pipeline building" to "platform engineering," creating reusable patterns for batch and real-time event processing.

Own Platform Performance

• Take full ownership of the cost-effectiveness of the Databricks ecosystem. You will tune Spark execution plans, optimize shuffle partitions, and implement auto-scaling strategies to manage DBU consumption.
• Ensure the platform remains performant as volume grows, managing the trade-offs between latency, throughput, and cloud spend.

Drive Data Contracts & Governance

• Implement Schema-on-Write validation and Data Contracts to ensure data from hundreds of internal services meets strict quality standards before hitting the Bronze layer.
• Partner with the Data Architect & Data Stewards to enforce data privacy (PII), security standards, and metadata lineage across the global ecosystem.

Lead an AI-Infused SDLC

• Champion the use of AI-assisted development tools (e.g., GitHub Copilot, Cursor) to accelerate the engineering lifecycle and improve code quality.
• Mentor engineers on distributed computing best practices, conducting deep-dive code reviews that focus on scalability and maintainability.

What We Are Looking For

• Scale Specialist: 5+ years of experience building and operating production-grade data systems at massive scale.
• Databricks Expert: Deep, hands‑on mastery of the Databricks/Spark ecosystem (Delta Lake, DLT, Spark UI debugging, and performance tuning).
• Streaming Veteran: Proven track record of building Real‑time/Streaming architectures (Spark Structured Streaming, Kafka, or Kinesis) as a core production requirement.
• Optimisation Mindset: Experience managing and optimizing cloud costs in a high‑growth environment.
• Platform Thinker: Experience building APIs, tools, or frameworks used by other internal engineering teams.

Actual compensation for this position may vary and will depend on multiple factors such as relevant qualifications, experience, education, and geographic location. For Full‑Time Regular Employees, this position is also eligible for additional compensation as follows:

• Sales Roles: This position is eligible for a commission structure in addition to base salary.
• Non‑Sales Roles: This position is eligible for an annual bonus which is paid dependent on various factors, including and without limitation, individual and company performance in addition to base salary.

G-P values its employees and offers excellent benefits and perks including generous paid parental leave, flexible time off, spending accounts, medical insurance, dental insurance, vision insurance, sabbatical after 5 years and more.

Individuals residing, or applying to work, in United States: California or Philadelphia Pennsylvania, please review the following additional information:
G-P will consider qualified applicants with arrest or conviction records in accordance with the California Fair Chance Act, Los Angeles City Fair Chance Act Ordinance, Los Angeles County Fair Chance Act Ordinance, and San Francisco Fair Chance Act Ordinance. Los Angeles applicants can review additional information regarding the Los Angeles City Fair Chance Act here: Fair Chance Initiative for Hiring Ordinance , and Philadelphia applicants can review information pertaining to Philadelphia’s Fair Criminal Record Screening Standards Ordinance here: Fair Chance Poster . Any consideration of a candidate’s background check with arrest or conviction records will include an individualized assessment based on the factors required by applicable law, including the candidate’s specific record and the duties and requirements of the specific job.

G-P. Global Made Possible.

G-P is a proud Equal Opportunity Employer, and we are committed to building and maintaining a diverse, equitable and inclusive culture that celebrates authenticity. We prohibit discrimination and harassment against employees or applicants on the basis of race, color, creed, religion, national origin, ancestry, citizenship status, age, sex or gender (including pregnancy, childbirth, and pregnancy‑related conditions), gender identity or expression (including transgender status), sexual orientation, marital status, military service and veteran status, physical or mental disability, genetic information, or any other legally protected status.

G-P also is committed to providing reasonable accommodations to individuals with disabilities. Individuals with disabilities are encouraged to apply for these positions. If you need an accommodation due to a disability during the interview process, please contact us at [e-mail].