Data Engineer

Aviato Consulting; India; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

Aviato Consulting is seeking a highly skilled Data Engineer to join our expanding team, with deep Google Cloud data solution expertise and mandatory GCP certification.

You will design scalable data pipelines, architect BigQuery lakes, implement streaming with Pub/Sub and Kafka, and help clients visualize insights with Looker, Data Studio, PowerBI or Tableau.

Qualifications

• 5+ years as a Data Engineer in Google Cloud environments.
• Proficient in Python with Pandas/NumPy.
• Experience building data pipelines with Apache Beam / Dataflow.
• Strong knowledge of Kafka and real-time streaming.
• Proficient in BigQuery and Pub/Sub.
• Familiarity with Hadoop for distributed processing.
• GCP certification (Professional Data Engineer / Cloud Architect) is mandatory.

Responsibilities

• Translate business requirements into scalable data solutions for clients using GCP services.
• Design and develop scalable data pipelines with Apache Beam, Dataflow, and Cloud Composer.
• Architect BigQuery-based data lakes and warehouses; optimize storage and querying.
• Implement real-time streaming pipelines using Kafka and Pub/Sub.
• Create insightful dashboards with Looker, Data Studio, Power BI, or Tableau.
• Lead and mentor team members; provide technical guidance on Google Cloud.

Skills

Google Cloud

Python with Pandas/NumPy

Apache Beam / Dataflow

Kafka / Pub/Sub

BigQuery / Data warehousing

ETL / Data ingestion

Data modeling & warehousing

GCP certification (Professional Data)

Tools

Looker

Data Studio

Power BI

Tableau

Job description

Aviato Consulting is looking for a highly skilled and motivated Data Engineer to join our expanding team. This role is ideal for someone with a deep understanding of Google Cloud data solutions. GCP certification is mandatory for this position.

You will work directly with clients, translating their business requirements into scalable data solutions, while providing technical expertise and guidance.

Key Responsibilities:

• Client Engagement: Work closely with clients to understand business needs, gather technical requirements, and design solutions leveraging GCP services.
• Data Pipeline Design & Development: Build and manage scalable data pipelines using tools such as Apache Beam, Cloud Dataflow, and Cloud Composer.
• Data Warehousing & Lake Solutions: Architect, implement, and optimize BigQuery based data lakes and warehouses.
• Real Time Data Processing: Implement and manage streaming data pipelines using Kafka, Pub/Sub, and similar technologies.
• Data Analysis & Visualization: Create insightful data dashboards and visualizations using tools like Looker, Data Studio, PowerBI, or Tableau.Build conversational interfaces, RAG pipelines, and intelligent search experiences for enterprise data.
• AI & Machine Learning Solutions :Design, deploy, and operationalize ML models and Generative AI applications using Vertex AI (including Gemini, AutoML, and custom models). Implement MLOps pipelines to handle model training, evaluation, deployment, and monitoring.
• Technical Leadership & Mentorship: Provide guidance and mentorship to team members and clients, helping them leverage the full potential of Google Cloud.

Required Qualifications:

• Experience:
• 5+ years as a Data Engineer working with Google Cloud
• Proven experience in Python with libraries like Pandas and NumPy.
• Expertise in building data pipelines using Apache Beam, Cloud Dataflow, or similar tools.
• Solid knowledge of Kafka for real-time data streaming.
• Proficiency with BigQuery, Google Pub/Sub, and other Google Cloud services.
• Familiarity with Apache Hadoop for distributed data processing.
• Technical Skills:
• Strong understanding of data architecture and processing techniques.
• Solid understanding of ETL pipelines, data ingestion, transformation, and storage.
• Knowledge of data modeling, data warehousing, and big data management principles.
• Certifications:
• Google Cloud certification (Professional Data Engineer, Cloud Architect, or similar Pro level) is mandatory for this role.

Soft Skills:

• Client facing experience and the ability to manage client relationships effectively.
• Strong problem solving skills with a results-oriented approach.

Preferred Qualifications:

• Visualization Tools: Experience with tools like Looker, Power BI, or Tableau.
• Competitive salary and benefits package.
• Opportunities to work with cutting-edge cloud technologies with large customers.
• Collaborative work environment that encourages learning and professional growth.
• A chance to work on high-impact projects for leading clients in diverse industries.