GCP Data Engineer

EliteRecruitments; Bengaluru; On-site; INR 1,500,000 - 3,000,000; Full time

Job summary

EliteRecruitments is seeking a Senior Google BigQuery Data Engineer in Bengaluru to lead the design, development and optimization of our data platform. You will work on BigQuery architecture, partitioning, clustering and modeling.

You will develop complex SQL and Python-based data pipelines, enable batch and streaming ingestion, and explore BigQuery ML for predictive insights while applying governance and security best practices.

Qualifications

• 6+ years in data warehousing / BI.
• Deep BigQuery expertise incl. modeling and optimization.
• Strong SQL and Python coding skills.
• Experience in designing BigQuery data models and schemas.
• Experience with batch and streaming data ingestion.
• Ability to mentor junior data engineers.

Responsibilities

• Architect, design, and implement scalable data solutions with BigQuery core.
• Develop and optimize SQL queries and data pipelines for ingestion, transformation, and loading.
• Utilize BigQuery ML or integrate with GCP ML services for insights.
• Implement data governance and security practices within BigQuery.
• Collaborate with analysts and stakeholders to translate requirements.
• Lead and mentor data engineers on best practices and performance tuning.
• Oversee data warehousing projects focusing on cost-efficiency and scalability.

Skills

SQL

Python

Communication

Independent work

Analytical thinking

Mentoring

Education

Google Cloud Certified Data Engineer

Tools

BigQuery

Dataflow

Looker

Cloud Storage

Job description

Hiring GCP Data Engineers having 6+ years of experience for big4 firm.

Job Summary:

We are seeking a highly skilled Senior Google BigQuery Data Engineer to lead the design, development,

and optimization of our data platform. The ideal candidate will have a deep understanding of BigQuery's

architecture, capabilities, and best practices, including columnar storage, nested and repeated fields, and

separation of compute and storage. A proven track record of delivering complex data warehousing

solutions on the Google Cloud Platform (GCP) is essential.

Responsibilities:

• Architect, design, and implement scalable data solutions leveraging Google BigQuery as the core data warehouse platform, utilizing features such as partitioning, clustering, and materialized views for optimal performance.
• Develop and optimize complex SQL queries and data pipelines using BigQuery for efficient data ingestion, transformation, and loading, including leveraging batch and streaming ingestion methods.
• Utilize BigQuery ML or integrate with other GCP ML services to build predictive models and derive insights from data.
• Implement data governance and security best practices within the BigQuery environment, including data encryption, access controls, and auditing.
• Collaborate with data analysts and business stakeholders to understand data requirements and translate them into BigQuery-based solutions, considering factors like data volume, query complexity, and latency.
• Mentor and guide junior data engineers in BigQuery best practices, including query optimization, performance tuning, and data modeling techniques.
• Lead data warehousing projects focused on BigQuery implementation and optimization, considering cost-efficiency, scalability, and maintainability.

Qualifications:

• 6+ years of experience in data warehousing and business intelligence.
• In-depth expertise in Google BigQuery, including advanced query optimization, performance tuning, and data modeling techniques.
• Strong SQL skills and proficiency in Python or other scripting languages for data processing.
• Proven experience in designing and implementing BigQuery data models and schemas, considering normalization, denormalization, and data partitioning strategies.
• Hands-on experience with BigQuery data ingestion and extraction methods, including batch loading, streaming ingestion, and external tables.
• Knowledge of other GCP services relevant to data engineering (e.g., Dataflow, Cloud Storage, Looker) and their integration with BigQuery.
• Strong problem-solving, analytical, and communication skills.
• Ability to work independently and collaboratively in a fast-paced environment.
• Preferred: Google Cloud certifications (e.g., Certified Data Engineer) and experience with machine learning or data science.
• Cross functional collaboration to understand client requirements and design tailored solutions.
• Prepare and deliver technical presentations and product demonstrations to potential clients.
• Assist in the preparation of proposals and RFP responses, ensuring technical accuracy and feasibility.

Project Delivery:

• Manage and oversee the delivery of data analytics and data warehousing projects from inception
• Ensure projects are delivered on time, within scope, and within budget.
• Coordinate with cross-functional teams to ensure successful project execution and stakeholder satisfaction.
• The ideal candidate should have managed and delivered complex large data sciences projects.