Data Engineer Lead-GCP & BigQuery Specialist

Nexus Corporation; Hyderabad; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Nexus Corporation in Hyderabad is seeking a Senior Data Engineer with 15+ years of cloud data experience to design and manage scalable data platforms on GCP. You will lead data pipelines, architect BigQuery warehouses, and collaborate with data scientists to deliver actionable insights.

The role emphasizes mentoring junior engineers, enforcing data governance and security, and driving migrations from on-prem to the cloud while staying ahead of industry advances.

Qualifications

• 15+ years of data engineering experience, cloud-based solutions.
• Expertise in GCP services including BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer, Cloud Functions.
• Strong SQL and BigQuery SQL for performance optimization.
• Hands-on Python or Java for building data pipelines.
• Deep understanding of data warehousing, data modeling, and schema design.
• Experience with streaming data processing (Beam or Kafka).
• CI/CD familiarity and Git version control.
• Knowledge of data security and compliance standards (GDPR, HIPAA).
• Proven migration experience from on-premise to GCP.
• Excellent problem-solving, mentoring, and cross-functional collaboration.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on GCP.
• Architect data warehouses using BigQuery for performance and cost efficiency.
• Collaborate with data scientists and business stakeholders to deliver insights.
• Ensure data quality, integrity, and security across datasets.
• Develop data governance, modeling, and lifecycle management best practices.
• Implement streaming data solutions with Dataflow, Pub/Sub, and Beam.
• Monitor, troubleshoot, and ensure high availability of pipelines.
• Lead migration of on-premise data systems to GCP with minimal downtime.
• Mentor junior engineers and promote a culture of learning.
• Stay updated with GCP advancements and propose system improvements.

Skills

SQL proficiency

Python/Java

Data modeling

Tools

BigQuery

Dataflow

Pub/Sub

Cloud Storage

Cloud Composer (Airflow)

Cloud Functions

Apache Beam

Git

Kafka

Job description

Role Overview:

We are seeking a highly experienced Senior Data Engineer with over 15 years of expertise in designing, building, and managing scalable data solutions. The ideal candidate will have extensive hands‑on experience with Google Cloud Platform (GCP) services, particularly BigQuery, and a strong background in data pipelines, ETL/ELT processes, and data architecture.This role requires a strategic thinker who can lead complex data engineering projects, mentor junior team members, and collaborate with cross‑functional teams to deliver high‑quality data solutions.

Key Responsibilities:

• Design, develop, and maintain scalable and efficient data pipelines and ETL/ELT workflows using GCP services.
• Architect and implement data warehouse solutions using BigQuery, ensuring optimal performance and cost efficiency.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights.
• Optimize and manage large‑scale datasets, ensuring data quality, integrity, and security.
• Develop and enforce best practices for data governance, data modeling, and data lifecycle management.
• Implement streaming data solutions using tools like Dataflow, Pub/Sub, and Apache Beam.
• Monitor and troubleshoot data pipelines, ensuring high availability and reliability.
• Lead the migration of on‑premise data systems to GCP, ensuring seamless integration and minimal downtime.
• Mentor and guide junior engineers, fostering a culture of continuous learning and innovation.
• Stay updated with the latest advancements in GCP and data engineering technologies, and recommend improvements to existing systems.

Requirements What we are looking for:

• 15+ years of experience in data engineering, with a focus on cloud‑based solutions.
• Expertise in GCP services, including but not limited to:BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer (Airflow), Cloud Functions.
• Strong proficiency in SQL and experience with BigQuery SQL for complex queries and performance optimization.
• \ Hands‑on experience with Python or Java for building data pipelines and automation.
• Deep understanding of data modeling, data warehousing, and schema design.
• Experience with streaming data processing and tools like Apache Beam or Kafka.
• Familiarity with CI/CD pipelines and version control systems like Git.
• Strong knowledge of data security and compliance standards (e.g., GDPR, HIPAA).
• Proven experience in migrating on‑premise data systems to GCP.
• Excellent problem‑solving skills and the ability to work in a fast‑paced, dynamic environment.
• Strong communication and collaboration skills, with the ability to work effectively with both technical and non‑technical stakeholders.