Senior Data Engineer

TymblHub; Gurugram District; Hybrid; INR 3,500,000 - 6,000,000; Full time

Job summary

Brillio Technologies in India (Hybrid/Remote) is seeking a Senior Data Engineer to design and optimize scalable data pipelines using Spark/PySpark on Databricks. The role requires strong Databricks expertise, AWS EMR/S3 experience, and data warehousing knowledge.

The ideal candidate will have 5–10 years of data engineering experience, proficiency in Python and SQL, and familiarity with Airflow or Autosys for workflows. A collaborative, cloud-native data platform environment awaits.

Qualifications

• 5+ years of Data Engineering experience with large-scale pipelines.
• Strong hands-on with Spark / PySpark and Databricks.
• Experience with AWS ecosystem (S3, EMR) and Hadoop/Hive.
• Proficient in Python and SQL; Unix/Shell scripting useful.

Responsibilities

• Design and build scalable data pipelines using Spark/PySpark on Databricks.
• Develop and optimize ETL/ELT workflows for large data sets.
• Work with AWS EMR, S3 and Hadoop ecosystem for distributed processing.
• Build data lake and data warehouse solutions; ensure data quality.

Skills

Spark/PySpark

Databricks

SQL

Python

AWS

ETL Fundamentals

Data Modeling

Unix/Shell scripting

Education

Bachelor's or Master's in CS/Engineering or related field

Tools

Databricks

AWS EMR

Hadoop

Hive

Airflow

Autosys

Git

Job description

# Senior Data EngineerBrillioPosted on October 11, 2026---Experience5 - 10 yrsJob LocationGurgaon / Gurugram, IndiaVacancy1DesignationUnmapped Designation (Legacy Sentinel)Job TypeONSITE---## Job Description## Job Summary**Lead Data Engineer**### Primary Skills* **Athena*** **Step Functions*** **Spark - Pyspark*** **ETL Fundamentals*** **SQL (Basic + Advanced)*** **Glue*** **Python*** **Lambda*** **Data Warehousing*** **EBS /EFS*** **AWS EC2*** **Lake Formation*** **Aurora*** **S3*** **Modern Data Platform Fundamentals*** **PLSQL*** **Data Modelling Fundamentals*** **Cloud front**### SpecializationAWS Data Engineering Basic: Senior Data Engineer## Job Description - AWS Senior Data Engineer**Company:** Brillio Technologies**Role:** Senior Data Engineer**Experience:** 5-10 Years**Location:** India (Hybrid/Remote)**Employment Type:** Full-time## Role OverviewWe are looking for a **Senior Data Engineer with strong Databricks and Big Data expertise** to design, build, and optimize scalable data pipelines and platforms. The ideal candidate will have hands-on experience with **Spark, PySpark, AWS ecosystem, and modern data architectures**, along with exposure to APIs and real-time data processing.## Key Responsibilities* Design and build scalable data pipelines using Spark / PySpark on Databricks* Develop and optimize ETL/ELT workflows for large-scale data processing* Work with AWS EMR, S3, and Hadoop ecosystem for distributed data processing* Build and maintain data lake and data warehouse solutions* Develop and integrate APIs for data ingestion and consumption* Implement data processing workflows using Airflow / Autosys* Optimize data performance using partitioning, caching, and query tuning* Handle structured and semi-structured data from multiple sources* Ensure data quality, governance, and reliability of pipelines* Collaborate with cross-functional teams (Analytics, Product, Engineering)## Requirements### Technical Skills (Must-Have)* Strong expertise in: + Apache Spark / PySpark + Databricks (mandatory) + SQL (PostgreSQL or similar)* Hands-on experience with: + AWS EMR, S3 + Hadoop, Hive ecosystem* Programming skills: + Python (must-have) + Scala (good exposure)* Strong knowledge of: + UNIX / Shell scripting + ETL pipelines and data engineering fundamentals### Additional Skills* Experience with: + Elasticsearch (data storage & retrieval) + Workflow orchestration tools (Airflow, Autosys)* Exposure to: + API development & integration + Version control tools (Git / SVN)* Basic knowledge of HTML (for web/data tasks)### Experience Required* Minimum 5+ years of Data Engineering experience* Strong hands-on experience in Databricks + Big Data stack* Proven experience working on large-scale distributed systems### Education* Bachelor's or Master's degree in Computer Science, Engineering, or related field## Why Join Brillio* Work on cloud-native, large-scale data platforms* Exposure to cutting-edge Databricks & AWS ecosystems* Collaborative and high-performance engineering culture