Data Engineer - Google Cloud

Aviato Consulting Pty Ltd; India; On-site; USD 180,000 - 240,000; Full time

Job summary

Aviato Consulting is seeking a Data Engineer with deep Google Cloud expertise to design and deliver data solutions for clients. You will translate business requirements into scalable data architectures, pipelines, and analytics that drive insights.

Responsibilities include building data pipelines, managing data warehousing, real-time processing, and ML workflows using Vertex AI, Looker, and BI tools. A GCP Professional Data Engineer or Cloud Architect certification is mandatory.

Qualifications

• 5+ years experience as a Data Engineer on Google Cloud.
• Proficient in Python with Pandas and NumPy.
• Experience building data pipelines with Apache Beam and Dataflow.
• Experience with BigQuery, Pub/Sub and Kafka.
• Familiarity with ETL, data warehousing, and data modeling.

Responsibilities

• Engage with clients to translate business needs into GCP data solutions.
• Design and develop scalable data pipelines using Beam, Dataflow, and Composer.
• Architect BigQuery data lakes and warehouses with optimized schemas.
• Implement real-time streaming pipelines with Kafka and Pub/Sub.
• Create dashboards using Looker, Data Studio, Power BI, or Tableau.
• Lead and mentor team members on Google Cloud best practices.

Skills

Python (Pandas NumPy)

Cloud data modeling

Client facing

Tools

Apache Beam

Cloud Dataflow

Cloud Composer

BigQuery

Kafka

Pub/Sub

Looker

Power BI

Tableau

Vertex AI

AutoML

Job description

Aviato Consulting is looking for a highly skilled and motivated Data Engineer to join our expanding team. This role is ideal for someone with a deep understanding of Google Cloud data solutions. GCP certification is mandatory for this position.

You will work directly with clients, translating their business requirements into scalable data solutions, while providing technical expertise and guidance.

Key Responsibilities:

Client Engagement: Work closely with clients to understand business needs, gather technical requirements, and design solutions leveraging GCP services.

Data Pipeline Design & Development: Build and manage scalable data pipelines using tools such as Apache Beam, Cloud Dataflow, and Cloud Composer.

Data Warehousing & Lake Solutions: Architect, implement, and optimize BigQuery based data lakes and warehouses.

Real Time Data Processing: Implement and manage streaming data pipelines using Kafka, Pub/Sub, and similar technologies.

Data Analysis & Visualization: Create insightful data dashboards and visualizations using tools like Looker, Data Studio, PowerBI, or Tableau.Build conversational interfaces, RAG pipelines, and intelligent search experiences for enterprise data.

AI & Machine Learning Solutions :Design, deploy, and operationalize ML models and Generative AI applications using Vertex AI (including Gemini, AutoML, and custom models). Implement MLOps pipelines to handle model training, evaluation, deployment, and monitoring.

Technical Leadership & Mentorship: Provide guidance and mentorship to team members and clients, helping them leverage the full potential of Google Cloud.

Required Qualifications:

Experience:

5+ years as a Data Engineer working with Google Cloud

Proven experience in Python with libraries like Pandas and NumPy.

Expertise in building data pipelines using Apache Beam, Cloud Dataflow, or similar tools.

Solid knowledge of Kafka for real-time data streaming.

Proficiency with BigQuery, Google Pub/Sub, and other Google Cloud services.

Familiarity with Apache Hadoop for distributed data processing.

Technical Skills:

Strong understanding of data architecture and processing techniques.

Solid understanding of ETL pipelines, data ingestion, transformation, and storage.

Knowledge of data modeling, data warehousing, and big data management principles.

Certifications:

Google Cloud certification (Professional Data Engineer, Cloud Architect, or similar Pro level) is mandatory for this role.

Soft Skills:

Client facing experience and the ability to manage client relationships effectively.

Strong problem solving skills with a results-oriented approach.

Preferred Qualifications:

Visualization Tools: Experience with tools like Looker, Power BI, or Tableau.

Competitive salary and benefits package.

Opportunities to work with cutting-edge cloud technologies with large customers.

Collaborative work environment that encourages learning and professional growth.

A chance to work on high-impact projects for leading clients in diverse industries.

If you're passionate about data engineering, cloud technologies, and solving complex data problems for clients, we’d love to hear from you!