Solution Architect -Data Engineer

KSB; Pune District; Hybrid; INR 2,000,000 - 4,000,000; Full time

Job summary

KSB is seeking a Solution Architect- Data Engineer to lead design and implementation of modern data solutions. You will own data architecture, pipelines, and cloud-based analytics platforms, partnering with engineering, analytics, product, and business teams.

You will build scalable data workflows using AWS, Spark, and Databricks, ensure data quality, and drive CI/CD and IaC efforts while shaping the long-term data platform strategy. Exceptional coding and communication skills are essential.

Qualifications

• Bachelor's degree in Software Engineering, Mathematics, Physics, or a related field.
• 3 years of project/coding experience in a company.
• Cloud experience with Databricks and AWS/Azure.
• Strong Python, SQL, and Spark knowledge.

Responsibilities

• Design and build scalable data pipelines and a data lake.
• Define technical standards and reusable data engineering frameworks.
• Ensure data quality, reliability, and performance across data solutions.
• Collaborate with cross-functional teams across data platform and engineering.

Skills

Python

SQL

Spark

Databricks

AWS

Kafka

CI/CD

IaC

Data modeling

Data governance

Production-grade code

Education

Bachelor's degree in Software Engineering, Mathematics, Physics, or related field

3 years project/coding experience in a company

Cloud experience: Databricks, AWS/Azure

Python experience: versioning, packaging, requirements/environments

Data engineering: SQL, Partitioning, Lakehouse

Tools

Databricks

AWS

Azure

Git

Pipelines

Job description

About the Role

We are looking for a Solution Architect- Data Engineer to take ownership of designing, building, and scaling modern data solutions. In this role, you will provide technical leadership across data architecture, data pipelines, and cloud-based analytics platforms. You will work closely with engineering, analytics, product, and business teams to ensure reliable, high-quality, and accessible data across the organization.

Key Responsibilities

• Contribute to the design and development of scalable data pipelines and a growing data lake
• Build and extend data processing workflows using AWS, Python, Apache Spark, and Databricks
• Define technical standards, best practices, and reusable frameworks for data engineering
• Ensure data quality, reliability, performance, and maintainability across data solutions
• Support data modeling, data integration, and transformation processes for analytics and reporting
• Drive automation, monitoring, and CI/CD improvements to ensure operational excellence
• Collaborate across teams, acting as a technical interface between the data platform and engineering, analytics, and business stakeholders.
• Contribute to architecture decisions and long-term data platform strategy

Your Profile

• Outstanding programming experience, preferably in Python; ability to write clean, testable, production-grade code; able to write clean, testable, production-grade code
• Strong SQL skills and familiarity with structured and semi-structured data formats (JSON, Protobuf, Delta format)
• Hands-on experience with Apache Spark, ideally on Databricks, and understanding of the medallion architecture
• Solid grasp of data lakehouse principles, data modeling, and data governance concepts
• Experience building and maintaining CI/CD pipelines (e.g. GitLab CI); familiarity with IaC and deployment
• Cloud Platforms: Experience with AWS (cloud) or comparable cloud providers; familiarity with Databricks as a managed Lakehouse platform
• Experience with event-driven architectures or streaming platforms (e.g. Kafka)
• Proven track record deploying, monitoring, and maintaining data pipelines and services in
  production environments; experience with testing practices
• Able to work autonomously and take ownership of tasks end-to-end
• Clear and concise communicator comfortable working across engineering and data teams

Education & Experience

• Bachelor's degree in Software Engineering, Mathematics, Physics, or a related field
• 3 years of project/coding experience in a company
• Cloud experience:
  • Databricks, AWS/Azure
  • Staging, testing, Git, pipelines
  • Distributed systems, data pipelines
• Python experience:
  • Versioning, package management, requirements/environments
  • Change data capture
• Data engineering experience:
  • SQL
  • Partitioning
  • Data structures (tables, relations)
  • Lakehouse