Senior Software Engineer

Carelon Global Solutions; Gurugram District, Bengaluru; On-site; INR 1,500,000 - 2,700,000; Full time

Job summary

Carelon Global Solutions in India is seeking a highly skilled Cloud Data Engineer to design, build, and operate cloud-based data platforms. The role focuses on ingestion, ETL, and scalable data pipelines using AWS, Snowflake, and Databricks.

You will collaborate with cross-functional teams to translate requirements into robust architectures, implement real-time and batch processing, and drive cloud migration initiatives while ensuring security and cost efficiency.

Qualifications

• Minimum education: B.Tech degree/MCA with computer science background or equivalent experience
• Preferred education: BE/B.Tech/MCA
• 4+ years of hands-on experience in data engineering
• Proficiency in AWS and Python for building data pipelines
• Strong experience in building ETL pipelines and workflows
• Deep knowledge of cloud platforms, particularly AWS and GCP
• Expertise in Snowflake for data storage, querying, and analytics
• Knowledge of Databricks, including Lakehouse Architecture, Delta Lake, Unity Catalog, Workflows, and Performance Optimization
• Strong proficiency in Python, PySpark, Spark SQL, and distributed data processing

Responsibilities

• Lead the design and implementation of cloud ingestion and migration platforms
• Develop robust and scalable ETL pipelines for data processing and transformation
• Leverage AWS and GCP to design, deploy, and maintain scalable cloud-based architectures
• Optimize data storage, retrieval, and analytics solutions using Snowflake/BigQuery/Databricks
• Implement solutions for real-time and batch data ingestion
• Ensure data pipelines are reliable, scalable, and secure
• Work closely with cross-functional teams to gather requirements and translate them into technical designs
• Communicate progress and technical challenges effectively to stakeholders

Skills

Strong problem-solving

Analytical skills

Team collaboration

Education

B.Tech or MCA with CS background

BE/B.Tech/MCA

Tools

AWS

Python

Snowflake

Databricks

BigQuery

Spark SQL

PySpark

Job description

We are seeking a highly skilled and motivated Cloud Data Engineering to join our team. The ideal candidate will have extensive experience in building and managing cloud-based data platforms, with expertise in SQL, AWS, Python, , , and Snowflake. This role requires a strong background in data engineering, cloud ingestion, ETL, and cloud migration to design, implement, and lead scalable and efficient data solutions.

JOB RESPONSIBILITY

• Platform Development:
• Lead the design and implementation of cloud ingestion and migration platforms.
• Develop robust and scalable ETL pipelines for data processing and transformation.
• Cloud Integration:
• Leverage AWS and GCP to design, deploy, and maintain scalable cloud-based architectures.
• Optimize data storage, retrieval, and analytics solutions using Snowflake/Bigquery/Databrick.
• Data Operations:
• Implement solutions for real-time and batch data ingestion.
• Ensure data pipelines are reliable, scalable, and secure.
• Collaboration & Stakeholder Management:
• Work closely with cross-functional teams to gather requirements and translate them into technical designs.
• Communicate progress and technical challenges effectively to stakeholders

QUALIFICATION

• Minimum education: B.Tech degree/MCA with computer science background or equivalent experience,
• Preferred education: BE/B.Tech/MCA

EXPERIENCE

• 4+ years of hands-on experience in data engineering.
• Proficiency in AWS and Python for building data pipelines.
• Strong experience in building ETL pipelines and workflows.

SKILLS AND COMPETENCIES

Technical Expertise:

• 4+ years of hands-on experience in data engineering.
• Proficiency in AWS and Python for building data pipelines.
• Deep knowledge of cloud platforms, particularly AWS and GCP.
• Expertise in Snowflake for data storage, querying, and analytics.
• knowledge of Databricks, including Lakehouse Architecture, Delta Lake, Unity Catalog, Workflows, and Performance Optimization.
• Strong proficiency in Python, PySpark, Spark SQL, and distributed data processing.

Cloud Migration & Architecture:

• Experience in designing and executing large-scale cloud migration projects.
• Ability to architect secure and cost-optimized cloud solutions.
• Hands-on experience in industry standard Cloud Migration Framework and Architecture is MUST.
• Architecture of implementing PHI/PII tokenization processes.

Soft Skills:

• Strong problem-solving and analytical skills.
• Excellent written and verbal communication.
• Ability to lead and work collaboratively in a team environment.