Senior Data Engineer

Hiring Hub; Sahibzada Ajit Singh Nagar; On-site; INR 2,000,000 - 3,500,000; Full time

Job summary

A prominent AI solutions firm in Punjab is seeking a Senior Data Engineer to design and optimize ETL/ELT pipelines, manage data lakes, and build real-time streaming solutions. Ideal candidates will have 4-6 years of experience, strong skills in SQL, Python, and Java/Scala, and expertise in tools like Snowflake and Spark. This position offers the opportunity to work with top-tier professionals in a dynamic environment focused on AI-driven projects.

Qualifications

• 4-6 years in Data Engineering.
• Familiarity with SQL, Python, and Java/Scala.
• Experience with databases such as PostgreSQL, Oracle, MySQL, and SQL Server.

Responsibilities

• Design, build, and optimize ETL/ELT pipelines using Spark.
• Architect and manage data lakes and warehouses.
• Develop real-time streaming solutions with Kafka Streams.

Skills

Data Engineering

SQL

Python

Java/Scala

ETL pipeline building

Tools

Spark (Scala/PySpark)

AWS

Snowflake

Azure Data Factory

Docker

Kubernetes

Job description

Rs 2,000,000.00 - 3,500,000.00 (Indian Rupee)

Our client, is a fast-growing AI solutions company led by alumni from IITs andIIMs.

In this role, you'll architect, develop, and deploy intelligent systems across diverse domains.You'll work closely with top-tier data scientists, engineers, and product innovators to turncomplex challenges into actionable insights using vast datasets and cutting-edge tools.

If you're eager to make a real-world impact and thrive in a dynamic, future-focusedenvironment, this is your moment to shine.

About the Role

We are seeking a Senior Data Engineer with strong expertise in distributed data systems,real-time streaming, and cloud-based data warehouses. You'll design and maintainscalable data pipelines, optimize performance, and mentor junior engineers.

Key Responsibilities

Design, build, and optimize ETL/ELT pipelines using Spark (Scala/PySpark) andmodern data tools.

• Architect and manage data lakes and warehouses (AWS, Snowflake, ADF) with a strong focus on data modellingand migration.

Develop real-time streaming solutions with Kafka Streams (Java) and ensure highdata reliability.

• Collaborate with cross-functional teams to deliver scalable, AI-ready data solutionsand analytics support.

Contribute to CI/CD, containerization (Docker/Kubernetes), and uphold best practicesin data engineering.

Mentor junior engineers and drive continuous improvement within the team.

Required Skills

• 4-6 years in Data Engineering
• SQL, Python, and Java/Scala knowledge
• At least one of Snowflake / Databricks / Azure Data Factory / dbt
• At least one of PostgreSQL / Oracle / MySQL / SQL Server
• Experience in building ETL pipelines
• Data Migration, Data warehousing, Data modelling
• Knowledge about latest AI models (especially LLMs and VLMs)

Good to have skills:

• Knowledge about Machine Learning techniques
• Either of Power BI / Tableau / Qlik / Looker
• Real-time streaming applications (Kafka streams/Java)