Cloud Data Engineer

Blue Cloud Softech Solutions Limited; India; On-site; INR 900,000 - 1,400,000; Full time

Job summary

Blue Cloud Softech Solutions Limited is seeking a Cloud Data Engineer to optimize and scale our cloud data platform, ensuring reliability and cost efficiency. You will work on migrations, lakehouse design, and Databricks-based processing to deliver robust data pipelines.

The role requires strong SQL/PLSQL, experience with Databricks, Delta Lake, and programming in Python/Scala/Java. Collaboration with cross-functional teams and Agile practices are essential.

Qualifications

• 5+ years of experience with Databricks, Spark SQL, Delta Lake.
• 3+ years designing data lake architectures on Databricks.
• Strong SQL/PLSQL and refactoring legacy stored procedures.
• Hands-on data modeling and warehouse design.
• Proficiency in Python, Scala, or Java.
• Bachelor’s degree in CS/IT/Data Engineering or related field.

Responsibilities

• Analyze existing data warehouse to support migration and consolidation.
• Translate legacy procedures into scalable Spark SQL code.
• Design data lake on AWS with S3/Delta Lake and Databricks.
• Build robust ETL pipelines into S3 for Databricks processing.
• Collaborate with architects to implement standardized ingestion frameworks.
• Optimize data models for performance and scalability.
• Document ETL processes and data flows.
• Perform basic data administration like scheduling and troubleshooting.
• Work with cross-functional teams for data source integration.
• Participate in Agile ceremonies and sprint planning.
• Triage and fix data lake issues.
• Maintain code repositories like Git.

Skills

Databricks

Spark SQL

Delta Lake

SQL/PLSQL

Python/Scala/Java

Data modeling

Education

Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related field

Tools

Git

Job description

Job Overview Cloud Data Engineer

In this position you will apply your skills to manage the existing cloud data platform to make it more scalable, reliable, and cost efficient. You will also work on additional projects that would leverage the existing architecture in some cases and use newer technologies where needed

Job Overview Cloud Data Engineer

In this position you will apply your skills to manage the existing cloud data platform to make it more scalable, reliable, and cost efficient. You will also work on additional projects that would leverage the existing architecture in some cases and use newer technologies where needed

Primary Responsibilities

• Analyze and understand existing data warehouse implementations to support migration and consolidation efforts.
• Reverse-engineer legacy stored procedures (PL/SQL, SQL) and translate business logic into scalable Spark SQL code within Databricks notebooks.
• Design and develop data lake solutions on AWS using S3 and Delta Lake architecture, leveraging Databricks for processing and transformation.
• Build and maintain robust data pipelines using ETL tools with ingestion into S3 and processing in Databricks.
• Collaborate with data architects to implement ingestion and transformation frameworks aligned with enterprise standards.
• Evaluate and optimize data models (Star, Snowflake, Flattened) for performance and scalability in the new platform.
• Document ETL processes, data flows, and transformation logic to ensure transparency and maintainability.
• Perform foundational data administration tasks including job scheduling, error troubleshooting, performance tuning, and backup coordination.
• Work closely with cross-functional teams to ensure smooth transition and integration of data sources into the unified platform.
• Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and backlog grooming
• Triage, debug and fix technical issues related to Data Lakes
• Maintain and Manage Code repositories like Git

You Must Have

• 5+ years of experience working with Databricks, including Spark SQL and Delta Lake implementations.
• 3 + years of experience in designing and implementing data lake architectures on Databricks.
• Strong SQL and PL/SQL skills with the ability to interpret and refactor legacy stored procedures.
• Hands-on experience with data modeling and warehouse design principles.
• Proficiency in at least one programming language (Python, Scala, Java).
• Bachelor s degree in Computer Science, Information Technology, Data Engineering, or related field.
• Experience working in Agile environments and contributing to iterative development cycles. Experience working on Agile projects and Agile methodology in general

We Value

• Databricks cloud certification is a big plus
• Exposure to enterprise data governance and metadata management practices.