Senior Data Engineer

Tredence Inc.; Bengaluru; On-site; INR 2,800,000 - 4,200,000; Full time

Job summary

Tredence, a data analytics firm, seeks a Senior Data Engineer in Bangalore to design and deliver scalable data solutions for retail using Databricks, Delta Lake, and Lakehouse architectures. You will optimize PySpark, Python, and SQL pipelines, ensure data quality, and collaborate with cross-functional teams to drive AI-powered insights.

The role emphasizes data governance, scalable architectures, and staying current with Databricks innovations to enable business impact.

Qualifications

• 4–8 years of professional data engineering experience.
• Deep expertise in Databricks Delta Lake and Lakehouse architectures.
• Strong skills in PySpark, Python, and SQL for data transformations.
• Experience with data catalog solutions and data quality practices.
• BE/B.Tech in Computer Science, IT, or related field.
• Excellent communication across technical and non-technical teams.

Responsibilities

• Design, build, and maintain data pipelines and lakehouse architectures using Databricks Delta Lake.
• Develop and optimize PySpark, Python, and SQL for high-performance data processing.
• Implement data cataloging and data quality frameworks to ensure data integrity.
• Collaborate with data scientists, analysts, and engineers to translate requirements into solutions.
• Monitor pipeline performance, troubleshoot issues, and optimize data workflows.
• Participate in code reviews, documentation, and best-practice enforcement.
• Stay updated with Databricks and big data advancements to propose innovative solutions.

Skills

Databricks

Delta Lake

Lakehouse

PySpark

Python

SQL

Data governance

Education

BE/B.Tech in CS/IT

Tools

Docker

Kubernetes

Cloud platforms

Job description

Job Title: Senior Data Engineer

Location: Bangalore, Karnataka, India (Work from Office)

Industry/Field: Retail

Experience: 4-8 years

Company: Tredence

About Us: Tredence differentiates itself from other analytics services firms by enabling last mile adoption of insights. We drive true business impact by uniting our strengths in business analytics, data science, and software engineering. We help our clients deliver on the artificial intelligence imperative, in a practical and demystified way. To know more about us, visit: www.tredence.com

Job Overview: As a Senior Data Engineer at Tredence, you will spearhead the design, development, and optimization of scalable data solutions using Databricks technologies tailored for the retail sector. Success in this role means enabling seamless ingestion, transformation, and governance of large datasets to drive actionable business insights. You will collaborate closely with cross-functional teams to implement data architectures that support AI-driven analytics. This role is pivotal in advancing Tredence's mission of delivering impactful and practical AI-powered solutions to our clients.

What will your role look like?

• Design, build, and maintain robust data pipelines and lakehouse architectures using Databricks Delta Lake technology.


• Develop and optimize PySpark, Python, and SQL code for high-performance data processing and transformation.


• Implement and manage data cataloging and data quality frameworks to ensure integrity, reliability, and accessibility of datasets.


• Collaborate with data scientists, business analysts, and software engineers to translate business requirements into scalable data solutions.


• Monitor pipeline performance, troubleshoot data issues, and continuously improve data workflows for efficiency and scalability.


• Participate in code reviews, documentation, and best practice enforcement to maintain high quality and maintainability.


• Stay updated with the latest advancements in Databricks and big data technologies to propose innovative solutions.

You will need:

• Demonstrate 4-8 years of professional experience as a Data Engineer, preferably in the retail industry or related domains.


• Exhibit strong expertise in Databricks technologies, including Delta Lake and Lakehouse architecture implementations.


• Utilize advanced skills in PySpark, Python, and SQL for complex data transformations and pipeline development.


• Apply knowledge of data catalog solutions and implement effective data quality practices.


• Hold a BE/B.Tech degree in Computer Science, Information Technology, or a related engineering discipline.


• Communicate effectively across technical and non-technical teams to deliver client-focused data solutions.

Good to Have Skills:

• Gain experience with cloud platforms such as AWS, Azure, or GCP, especially in context with Databricks deployments.


• Acquire certifications related to Databricks and big data engineering.


• Develop familiarity with containerization and orchestration tools like Docker and Kubernetes.


• Build understanding of AI and machine learning workflows integrated with data engineering pipelines.


• Contribute to open source projects or internal tools that support data engineering best practices.

Why you will love this job:

At Tredence, you will work at the forefront of AI-driven analytics delivering business impact in the retail sector. You will enjoy a collaborative and inclusive environment that fosters continuous learning and skill enhancement. This role offers a unique opportunity to grow your expertise in cutting-edge data engineering technologies like Databricks while influencing real-world business outcomes. Our Bangalore office provides a vibrant workspace ideal for innovation, creativity, and career progression within a supportive team culture

Required Skills