Senior Data Engineer

WebSenor Ltd; Udaipur District; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

WebSenor Ltd. is seeking a Senior Data Engineer skilled in Databricks and Big Data technologies to design scalable data architectures, pipelines, and real-time streaming frameworks in a cloud environment. Emphasis on governance, security, and high performance in Azure-based setups.

The role focuses on building end-to-end data solutions, optimizing pipelines, and collaborating with DevOps to scale clusters and streaming infrastructure for large workloads.

Qualifications

• 3+ years experience in Big Data tools: Databricks, Apache Spark, Kafka, and Cloud platforms.
• Proficiency in programming: Python, PySpark, Scala, or Java.
• Strong SQL skills with relational/NoSQL databases.
• Experience with data modeling, data lakes, and scalable solutions.
• Knowledge of Azure (preferred) or other clouds like AWS/GCP.
• Expertise in data governance, security, and quality in Databricks.
• Familiar with Docker, Linux scripting, and Agile workflows.

Responsibilities

• Develop end-to-end data solutions using Databricks for large-scale processing.
• Build and optimize data pipelines for high quality, reliability, and scalability.
• Perform complex data transformations with PySpark and Databricks.
• Integrate Kafka for real-time data streaming and processing.
• Collaborate with DevOps to optimize Databricks clusters and Kafka setups.
• Implement best practices for data governance, security, and privacy.
• Troubleshoot pipelines, resolve performance issues, and ensure data quality.
• Plan and scale Databricks and Kafka infrastructures for large workloads.
• Document workflows, processes, and configurations.
• Work with relational databases and understand complex SQL procedures.

Skills

Databricks

Apache Spark

Kafka

Azure

Python

PySpark

Scala

Java

SQL

Docker

Linux scripting

Agile workflows

Data governance

Security

Data modeling

Tools

MySQL

MS SQL

Snowflake

Job description

Job Overview We are looking for a Senior Data Engineer skilled in Databricks and Big Data technologies. You will focus on creating scalable data architectures, pipelines, and real-time streaming frameworks using Databricks, Apache Spark, and Kafka, preferably on Azure. Your role will ensure data governance, security, and high performance in a cloud environment. Key Responsibilities […]

About the role

Job Overview
We are looking for a Senior Data Engineer skilled in Databricks and Big Data technologies. You will focus on creating scalable data architectures, pipelines, and real-time streaming frameworks using Databricks, Apache Spark, and Kafka, preferably on Azure. Your role will ensure data governance, security, and high performance in a cloud environment.

Key Responsibilities
Develop end-to-end data solutions using Databricks for large-scale processing.
Build and optimize data pipelines for high quality, reliability, and scalability.
Perform complex data transformations with PySpark and Databricks.
Integrate Kafka for real-time data streaming and processing.
Collaborate with DevOps to optimize Databricks clusters and Kafka setups.
Implement best practices for data governance, security, and privacy.
Troubleshoot pipelines, resolve performance issues, and ensure data quality.
Plan and scale Databricks and Kafka infrastructures for large workloads.
Document workflows, processes, and configurations.
Work with relational databases (e.g., MySQL, MS SQL) and understand complex SQL procedures.
Requirements
3+ years experience in Big Data tools: Databricks, Apache Spark, Kafka, and Cloud platforms.
Proficiency in programming: Python, PySpark, Scala, or Java.
Strong SQL skills with relational/NoSQL databases.
Experience with data modeling, data lakes, and scalable solutions.
Knowledge of Azure (preferred) or other clouds like AWS/GCP.
Expertise in data governance, security, and quality in Databricks.
Familiar with Docker, Linux scripting, and Agile workflows.
Preferred Skills
Certifications in Databricks or Azure Data Engineering.
Experience with additional tools like Snowflake.
Strong documentation, communication, and stakeholder managementskills.

What you'll do

• Own delivery for client-facing web, mobile, AI, cloud or digital transformation work based on the role.
• Collaborate with project managers, designers, QA and client stakeholders through discovery, build, launch and support.
• Write clear documentation, communicate risks early and keep delivery quality high.
• Contribute to reusable engineering practices, reviews and mentoring inside the WebSenor team.

What we're looking for

• Strong hands-on experience relevant to this role and a portfolio of shipped production work.
• Clear communication, ownership mindset and ability to work with global clients.
• Comfort with delivery discipline: estimation, reviews, testing, documentation and release readiness.
• Ability to learn fast and work across modern product, engineering and AI-enabled workflows.

What you'll get

• Work on real enterprise client projects with measurable business outcomes.
• Collaborate with experienced engineering, design, QA and delivery teams.
• Growth through mentoring, project ownership and exposure to global clients.
• HR-approved compensation, benefits and policies as finalized during the offer process.

About the team

You will work with WebSenor project managers, UI/UX designers, QA engineers, cloud specialists and senior developers focused on quality delivery for enterprise clients.

Our hiring process

• Application Review: HR and delivery leadership review your profile for role fit.
• Technical Discussion: Meet the technical team for skill, communication and project-readiness evaluation.
• Final Conversation: Discuss compensation, joining timeline and team fit.
• Offer and Onboarding: Receive the offer, documentation checklist and onboarding plan.