Software Engineer

Epsilon Data Management; Bengaluru; On-site; INR 1,200,000 - 2,500,000; Full time

Job summary

Epsilon Data Management in Bengaluru, Karnataka is seeking a Data Engineer to join the Data Engineering Team. You will mainly develop, test, and implement applications for the Hadoop ecosystem and Databricks, handling large-scale data processing and transformations.

The role requires hands-on experience with Python/PySpark, Shell scripting, and AWS, with a focus on delivering reliable, scalable data solutions and collaborating with technical leads to drive data governance and performance

Qualifications

• BE/B.Tech/MCA required.
• 3-5 years of experience in a Linux/Unix environment.
• 1-3 years of experience in Shell Scripting and SQL.
• Strong experience in Python/PySpark.
• Good to have knowledge of Databricks and AWS.
• Experience with JIRA for tracking user stories/bugs.
• Experience with Git/Bitbucket.
• GenAI in data processing is a plus.

Responsibilities

• Provide outstanding customer service, following detailed specifications, in processing client data.
• Design and develop custom data solutions in Databricks.
• Develop efficient, reusable, and reliable code for data processing and transformation.
• Collaborate with Technical Leads, Architects and data platform teams to implement robust data solutions.
• Contribute to data modelling, quality, and governance initiatives for trusted data delivery.
• Perform detailed analysis, troubleshooting, and RCA for production issues and improve reliability.
• Participate in code reviews and promote best practices.
• Collaborate with cross-functional teams to deliver high-quality software.
• Improve deployment processes and ensure reliable solutions.
• Interact with leads/architects to solve challenges faced by Data Engineering teams.
• Contribute to building an environment with continuous improvement of development and delivery processes.

Skills

Shell Scripting

Python/PySpark

AWS

Databricks

SQL

Linux/Unix

JIRA

Git/Bitbucket

GenAI in data processing

Education

BE / B.Tech / MCA

Tools

Databricks

Git

JIRA

Job description

Job Summary

Overview About Business Unit: The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative problem solvers develops and builds products that position Epsilon as a differentiator, encouraging an open and balanced marketplace built on respect for individuals, where every brand interaction holds value. Our full-cycle product engineering and data teams chart the future and set new benchmarks for our products, by using industry standard methodologies and sophisticated capabilities in data, machine learning, and artificial intelligence. Driven by a passion for delivering smart end-to-end solutions, this team plays a key role in Epsilon s success story. The Data Engineering team at Epsilon plays a pivotal role in building the next-generation data platforms that empower Epsilon s ecosystem. We design, develop, and optimize scalable, high-performance data solutions that process terabytes of data every day, driving intelligent insights for clients across industries. This team of problem-solvers and innovators leverages modern big data, cloud, and automation technologies to deliver reliable and efficient data products. Candidate will be a member of the Data Engineering Team and be responsible for developing, Unit Testing, and implementing applications for the Data engineering group predominantly in the Hadoop Ecosystem and Databricks.

Why we are looking for you: You have strong experience in Data Engineering. You are hands‑on with Shell Scripting, Python/PySpark, and enjoy working with massive datasets. You have experience working with AWS. You are self‑driven and enjoy working collaboratively as part of a team. You have an ability to analyse, troubleshoot and resolve customer issues with strong customer focus. You take pride in writing efficient, maintainable code and automating processes to improve efficiency. You enjoy new challenges and are solution oriented.

What you will enjoy in this role

• Opportunity to design, build, and optimize large-scale data solutions that power Epsilon s core products.
• Exposure to diverse data engineering challenges, from ingestion and transformation to performance optimization and data governance.
• Hands‑on experience with modern data platforms, cloud ecosystems, automation frameworks and GenAI.
• A collaborative and agile work environment that values innovation, learning, and continuous improvement.
• Being part of a global Data team that directly impacts data‑driven decision‑making for top‑tier clients.

Responsibilities

• Provide outstanding customer service, following detailed specifications, in the processing of incoming and outgoing client data
• Design and develop custom data solutions in Databricks.
• Develop efficient, reusable, and reliable code for data processing and transformation.
• Work with Technical Leads, Architects and data platform teams to understand and implement robust data solutions.
• Contribute to data modelling, quality, and governance initiatives to ensure trusted data delivery.
• Perform detailed analysis, troubleshooting, and RCA for production issues and optimize system reliability.
• Participate in code reviews, enforce best coding and design practices.
• Collaborate with cross‑functional teams to deliver high‑quality software solutions.
• Improve and optimize deployment challenges and help in delivering reliable solution.
• Interact with technical leads and architects to discover solutions that help solve challenges faced by Data Engineering teams.
• Contribute to building an environment where continuous improvement of the development and delivery process is in focus and our goal is to deliver outstanding software.

Qualifications

• BE / B.Tech / MCA - No correspondence course.
• 3-5 years of experience working in a Linux or Unix environment.
• 1-3 years of experience in Shell Scripting and SQL.
• Must have strong experience in Python/PySpark.
• Good to have knowledge and experience with Databricks.
• Good to have experience working with AWS.
• Experience with JIRA for user‑story/bug tracking.
• Experience with GIT/Bitbucket.
• Experience of leveraging GenAI in data processing will be a plus.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.