Data Engineer_Bangalore_5yrs_15 October Joiners Only_Hybrid

RiDiK; Bengaluru; Hybrid; INR 900,000 - 1,500,000; Full time

Job summary

RiDiK is seeking a data engineering/backend Python professional in Bengaluru with 6+ years of experience to design and maintain scalable data pipelines. You will work across PySpark, Spark SQL, and Databricks to build ETL/ELT workflows and Delta Lake architectures, ensuring high-performance data platforms on Azure. Collaboration with stakeholders and DevOps automation will be key.

The role demands strong SQL, cloud familiarity, and a proactive, delivery-focused mindset in a hybrid WFO setup.

Qualifications

• Bachelor's or Master's degree in Computer Science, IT, Engineering.
• 6 years of relevant industry experience in Data Engineering or Backend Python development.
• Strong Python development experience with PySpark and Databricks.
• Experience with Delta Lake, advanced SQL, and large-scale data processing on Azure.
• Familiar with CI/CD, Azure DevOps, data modeling, ETL/ELT concepts.

Responsibilities

• Design, develop, and maintain scalable data pipelines and backend services with Python.
• Build and optimize ETL/ELT workflows using PySpark, Spark SQL, and ADF.
• Develop and manage data ingestion, transformation, and processing on Databricks.
• Implement Delta Lake architectures for reliable, high-performance data platforms.
• Write efficient SQL for large datasets and collaborate with stakeholders.
• Deploy, monitor, and maintain data applications on Azure cloud services.

Skills

Python

PySpark

Spark SQL

Databricks

Delta Lake

SQL

Azure Data Factory

Azure

CI/CD

Azure DevOps

Data modeling

ETL/ELT

REST APIs

Agile/Scrum

Monitoring/Observability

Education

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering

Tools

Databricks

Azure Data Factory

Azure DevOps

REST APIs

Job description

Experience:7years

Loction: Banglore

3 days wfo

Responsibilities

Design, develop, and maintain scalable data pipelines and backend services using Python.

Build and optimize ETLELT workflows using PySpark, Spark SQL, and Azure Data Factory ADF.

Develop and manage data ingestion, transformation, and processing solutions on Databricks.

Implement and maintain Delta Lake architectures to support reliable and high-performance data platforms.

Write efficient and optimized SQL queries for large-scale datasets.

Collaborate with business stakeholders, architects, data analysts, and cross-functional teams to understand requirements and deliver robust solutions.

Work with Azure cloud services to deploy, monitor, and maintain data applications.

Implement CICD pipelines and deployment automation using Azure DevOps.

Perform troubleshooting, performance tuning, and optimization of data workloads.

Ensure adherence to coding standards, security guidelines, and best engineering practices.

Participate in solution design discussions, code reviews, and technical documentation.

Required Skills

• Must-Have Technical Skills Strong programming experience in Python
• Hands-on experience with PySpark and Spark SQL
• Strong experience working with Databricks
• Good understanding of Delta Lake Advanced SQL development and query optimization skills
• Experience with Microsoft Azure services Hands-on experience with Azure Data Factory ADF
• Experience in CICD implementation using Azure
• DevOps Strong understanding of data modeling, ETL ELT concepts, and distributed data processing
• Experience working with large-scale data platforms and cloud-based solutions
• Preferred Skills Experience with data warehousing and lakehouse architectures
• Understanding of data governance and data quality frameworks
• Experience with REST APIs and backend service development
• Exposure to AgileScrum methodologies
• Knowledge of monitoring and observability tools

Soft Skills

• Excellent verbal and written communication skills
• Ability to interact confidently with business stakeholders and technical teams
• Strong analytical and problem-solving abilities Self-driven with a proactive approach to ownership and delivery
• Strong collaboration and teamwork mindset
• Ability to clearly articulate technical concepts to both technical and non-technical audiences

Qualifications Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

6 years of relevant industry experience in Data Engineering, Data Platform Engineering, or Backend Python Development.