Staff Engineer, GCP Big Data Engineer

Nagarro; Gurugram District; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Nagarro, a Digital Product Engineering company, is seeking a seasoned GCP Big Data Engineer to join our scaling team in India. You will design and implement data pipelines, leverage Spark/PySpark, Python, SQL, and GCP services to deliver scalable solutions across environments.

You’ll work with Kubernetes, CI/CD, and Terraform to ensure reliable deployments, write unit tests, and partner with product teams to map business requirements to robust technical designs.

Qualifications

• 6+ years of total experience in data engineering.
• Strong knowledge and experience in GCP Big Data engineering.
• Experience with Spark, PySpark, GCP (BigQuery, Dataproc, Cloud Run), Kubernetes, SQL.
• Experience with Big Data technologies such as PySpark, BigQuery.
• Proficiency with container orchestration and deployment using Kubernetes.
• Strong expertise in Python & SQL programming and experience with API development frameworks.
• Experience writing unit tests and implementing CI/CD pipelines. Familiarity with Git.
• Proficiency setting up monitoring/alerting systems.
• Terraform is highly desirable.
• Excellent problem-solving and fast-paced work ability.

Responsibilities

• Writing and reviewing high-quality code.
• Translate client business use cases and requirements into technical design.
• Map decisions with requirements and convey to developers.
• Identify multiple solutions and select the best fit for client needs.
• Define guidelines for NFR considerations during project implementation.
• Write and review design documents detailing architecture and high-level design.
• Review architecture for extensibility, scalability, security, and design patterns.

Skills

Spark

PySpark

Python

SQL

GCP BigQuery

Kubernetes

CI/CD

Git

Terraform

API development

Tools

Terraform

Git

Job description

We're Nagarro.

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (17500 experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!

REQUIREMENTS:

• Total experience: 6+ years.
• Excellent knowledge and experience in GCP Bigdata Engineer role.
• Strong working experience with architecture and development in Spark, Python/Pyspark, GCP (Bigquery, Dataproc, Cloud Run etc.), Kubernetes, SQL.
• Experience with Big Data technologies such as PySpark, BigQuery. Strong troubleshooting skills for system maintainability.
• Proficiency in container orchestration and deployment using Kubernetes.
• Strong expertise in Python & SQL programming and experience with API development frameworks
• Experience in writing unit test cases and implementing CI/CD pipelines. Familiarity with version control systems, particularly Git.
• Proficiency in setting up monitoring and alerting systems.
• Experience with infrastructure as code tools like Terraform is highly desirable.
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Strong communication and collaboration skills.

RESPONSIBILITIES:

• Writing and reviewing great quality code.
• Understanding the clients business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements.
• Mapping decisions with requirements and be able to translate the same to developers.
• Identifying different solutions and being able to narrow down the best option that meets the clients requirements.
• Defining guidelines and benchmarks for NFR considerations during project implementation.
• Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers.
• Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed.
• Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it.
• Understanding and relating technology integration scenarios and applying these learnings in projects.