Cloud Data Engineer

InfoCepts; Pune District; On-site; INR 3,000,000 - 5,000,000; Full time

Job summary

InfoCepts in Pune, India, is hiring a Cloud Data Engineer to design and optimise cloud-native data solutions across GCP and AWS. The role focuses on migration, modernization, and building scalable data pipelines with emphasis on data quality, governance, and security.

You will work with architects, data engineers, and DevOps to deliver reliable data ecosystems that support analytics and BI initiatives, leveraging Python, SQL, Spark, and Terraform-based deployments.

Qualifications

• Experience in data engineering across AWS and GCP environments.
• Proven ability to design and implement ETL/ELT pipelines.
• Strong Python and SQL for data engineering and automation.

Responsibilities

• Design, build, and maintain scalable cloud-based data pipelines and storage.
• Support migration of data platforms from GCP to AWS and optimize performance.
• Develop batch and real-time ingestion pipelines using cloud services.
• Implement data quality checks, security controls, and governance frameworks.
• Collaborate with architects, DevOps, and stakeholders to deliver solutions.

Skills

Python

SQL

ETL/ELT pipelines

Cloud platforms AWS & GCP

Data migration & modernization

Spark/PySpark

Stakeholder communication

Education

Bachelor's or Master's in CS/IT/Engineering/Data Science

Tools

Docker

Kubernetes

Terraform

Databricks

Job description

Purpose of the Position:

We are seeking a Cloud Data Engineer with expertise across Google Cloud Platform (GCP) and Amazon Web Services (AWS) to support enterprise-scale data platform initiatives. The role involves designing, developing, and optimising cloud-native data solutions, while contributing to the migration and modernisation of data workloads from GCP to AWS. The individual will work closely with architects, data engineers, DevOps teams, and business stakeholders to build scalable, secure, and high-performing data ecosystems that support analytics and business intelligence needs

Key Result Areas and Activities:

• Cloud Data Platform Engineering – Design, build, and maintain scalable cloud-based data pipelines, storage solutions, and data processing frameworks across GCP and AWS environments.
• Cloud Migration & Modernization – Support migration of data platforms, ETL workloads, databases, and analytics solutions from GCP to AWS while ensuring minimal disruption and optimal performance.
• Data Integration & Pipeline Development – Develop and optimize batch and real-time data ingestion pipelines leveraging modern cloud-native services and engineering best practices.
• Data Quality, Security & Governance – Ensure implementation of data quality checks, security controls, compliance standards, and governance frameworks across data platforms.
• Operational Excellence & Stakeholder Collaboration – Collaborate with cross-functional teams to troubleshoot issues, improve platform performance, and deliver business solutions aligned with organisational objectives.
• Strong experience in cloud data engineering using AWS and GCP platforms.
• Expertise in designing and developing ETL/ELT data pipelines.
• Hands-on experience with AWS services such as S3, Glue, EMR, Redshift, Lambda, IAM, Athena, and CloudWatch.
• Working knowledge of GCP services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Composer, and IAM.
• Strong proficiency in Python and SQL for data engineering and automation.
• Experience with migration of data workloads, analytics platforms, and data pipelines between cloud environments.
• Knowledge of CI/CD, Infrastructure as Code (Terraform preferred), and cloud-native deployment practices.Deep understanding of Supply Chain, Procurement, Inventory, Manufacturing, and Operations Analytics.
• Experience with Spark, PySpark, or distributed data processing frameworks.
• Exposure to Databricks or modern Lakehouse architectures.
• Knowledge of containerization technologies such as Docker and Kubernetes.
• Experience with data governance, metadata management, and data catalogue solutions.
• AWS and/or GCP cloud certifications.

Qualifications:

Experience:

• 5+ years of experience in Data Engineering or Cloud Data Engineering.
• Experience working across AWS and GCP ecosystems.
• Proven experience supporting cloud migration and data modernization initiatives.

Education:

• Bachelor's or master's degree in computer science, Information Technology, Engineering, Data Science, or a related field.
• Relevant AWS and/or GCP certifications will be an added advantage.

Qualities:

• Strong analytical and problem-solving mindset.
• Ability to work effectively across multiple cloud platforms.
• Excellent communication and stakeholder management skills.
• Strong ownership and accountability for deliverables.
• Adaptability to evolving technologies and business requirements.
• Focus on solutioning, innovation, and continuous improvement.
• Collaborative team player with a customer-focused approach.