GCP Data Engineer

Persistent Systems; Pune District; Hybrid; INR 1,200,000 - 2,000,000; Full time

Benefits offered by this job

Competitive salary and benefits package

Quarterly growth opportunities

Company-sponsored education and certifications

Flexible work hours

Insurance coverage for self and family

Job summary

A leading technology firm is seeking GCP Data Engineers to design and maintain scalable data pipelines using Python and BigQuery. The role requires 7 to 15 years of experience in data engineering or backend software engineering. Candidates should have strong skills in SQL and a proven track record working with GCP technologies. The position offers a competitive salary along with benefits, and promotes an inclusive workplace culture focused on talent development.

Qualifications

• 7 to 15 years of experience in data engineering or backend software engineering.
• Expertise in Python for data processing and backend development.
• Strong SQL skills and experience with cloud data warehouses like BigQuery.

Responsibilities

• Design and maintain scalable data pipelines using Python and SQL.
• Partner with data scientists to build and evolve services for ML models.
• Manage robust data models and infrastructure on GCP.

Skills

Python

SQL

BigQuery

Dataflow

Kubernetes

Docker

Pandas

Spark

Tools

GCP

Airflow

Kafka

Pub/Sub

Job description

We are seeking GCP Data Engineers with Python, Bigquery, SQL, Composer and CloudRun experience.

• Location: All Persistent Locations
• Experience: 7 to 15 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, build, and maintain scalable, event-driven, and batch data pipelines using Python, SQL, BigQuery and big data technologies (Spark, Dataflow, etc.).
• Partner with data scientists and ML engineers to build, deploy, and evolve services encapsulating DS/ML models at scale.
• Design and implement data algorithm pipelines to efficiently and rapidly process millions of products and requests.
• Architect, build, and manage robust data models and infrastructure on Google Cloud Platform (GCP), with a heavy focus on BigQuery, Dataflow, Pub/Sub, and GKE.
• Build and manage the CI/CD, orchestration (Kubernetes, Airflow), and infrastructure for ML systems.
• Work cross-functionally with product management, data scientists, and analysts to understand problems and design solutions.
• Champion and implement best practices for data quality, reliability, and performance for petabyte-scale datasets.
• Implement and advocate for engineering best practices, helping level up other engineers on the team.

Expertise You'll Bring:

• 7 to 15 years of hands‑on experience in data engineering or backend software engineering.
• Expertise in Python for data processing (e.g., Pandas, Spark) and/or backend development.
• Strong, advanced SQL skills and extensive experience with cloud data warehouses like BigQuery.
• Proven, deep hands‑on experience designing and operating scalable data solutions on Google Cloud Platform (GCP), with expertise in services like BigQuery, Dataflow, Pub/Sub, GCS, Dataproc, and Vertex AI.
• Experience with big data technologies (Spark, Hadoop, MapReduce) and messaging systems (Kafka, Pub/Sub).
• Production experience with containerized development (Docker) and orchestration (Kubernetes).
• Experience building or maintaining the infrastructure for ML systems and integrating models into production services.
• An ability to understand and make tradeoffs between different technologies and patterns.
• Excellent communication skills and ability to work effectively with engineers, product managers, and business stakeholders.
• Experience leveraging modern IDEs and AI‑assisted development tools (e.g., Cursor, GitHub Copilot) to accelerate development cycles.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company‑sponsored higher education and certifications
• Opportunity to work with cutting‑edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values‑Driven, People‑Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility‑friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."