Senior Data Engineer

Sigmoid

Bengaluru

On-site

INR 900,000 - 1,400,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sigmoid in Bengaluru is seeking a Data Engineer to design, build, and maintain scalable data pipelines that collect, transform, and load data.

You will develop logical and physical data models, implement production-grade workflows with Apache Airflow, and collaborate with upstream and downstream teams to ensure end-to-end data delivery. You will optimise storage and processing for large volumes of data while upholding data security and privacy principles.

Qualifications

  • Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field.
  • 3-6 years of experience working on ETL pipelines.

Responsibilities

  • Design, build, and maintain efficient and scalable data pipelines that collect, transform, and load data.
  • Develop the Logical Data Model and Physical Data Models, including data warehouse designs.
  • Monitoring and Maintenance: Implement monitoring and alerting systems to ensure data pipeline reliability, and perform routine maintenance tasks.
  • Work with upstream and downstream teams to ensure end-to-end execution of the data pipelines.
  • Help set up processes and streamline the workflows to help in the expansion of the team, and collaborate with the other teams.
  • Optimise data processing and storage solutions for efficiency and scalability, working with large volumes of data.
  • Understanding of modern data technologies like Spark, Flink, Iceberg, Parquet, etc.

Skills

Python
NoSQL databases
Relational databases
Data modeling
Airflow
OO design
Problem solving
Security/privacy basics

Education

Bachelor's degree in CS/Software Eng/IT

Tools

Apache Airflow
Spark
Flink
Iceberg
Parquet

Job description

Responsibilities
  • Design, build, and maintain efficient and scalable data pipelines that collect, transform, and load data.
  • Develop the Logical Data Model and Physical Data Models, including data warehouse designs.
  • Monitoring and Maintenance: Implement monitoring and alerting systems to ensure data pipeline reliability, and perform routine maintenance tasks.
  • Work with upstream and downstream teams to ensure end-to-end execution of the data pipelines.
  • Help set up processes and streamline the workflows to help in the expansion of the team, and collaborate with the other teams.
  • Optimise data processing and storage solutions for efficiency and scalability, working with large volumes of data.
  • Understanding of modern data technologies like Spark, Flink, Iceberg, Parquet, etc.
Requirements
  • Education: Bachelor's Degree in Computer Science, Software Engineering, Information Technology, or a related field.
  • Experience: 3-6 years of experience working on ETL pipelines. Key Skills:
Technical Skills
  • Strong programming skills in Python for data manipulation and transformation.
  • Should have in-depth knowledge of a NoSQL OR relational database.
  • Should be able to model data in them.
  • Should have Experience with workflow management tools like Apache Airflow.
  • Should help the team with all phases of development, including design, implementation, and operation of production systems.
  • Should know what good code looks like and be able to write the same.
  • Should have a solid understanding of Object-Oriented design and concepts.
  • Should be able to deal well with ambiguous/undefined problems.
  • Understanding of data security and privacy principles.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Bacancy Technology Inc • Ahmedabad District

On-site
INR 1,500,000 - 3,000,000
Data Engineer
Data Engineer

Staples India • Chennai District

On-site
INR 800,000 - 1,200,000
Data Engineer
Data Engineer

Valuenode Private Limited • India

Remote
INR 1,200,000 - 1,800,000
Data Engineer
Data Engineer

PW (PhysicsWallah) • Dadri

On-site
INR 900,000 - 1,300,000
Data Engineer
Data Engineer

Imagevision • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Senior Data Engineer
Senior Data Engineer

Proclink • Gandhamguda

On-site
INR 800,000 - 1,500,000
Data Engineer
Data Engineer

TEKSALT Solutions • Dadri

On-site
INR 800,000 - 1,200,000
Senior ETL / Data Engineer
Senior ETL / Data Engineer

Durapid Technologies Pvt Ltd • India

On-site
INR 2,500,000 - 4,500,000
Data Engineer
Data Engineer

Meril • Vapi

On-site
INR 800,000 - 1,200,000
Data Engineer
Data Engineer

Grid Dynamics • Bengaluru

Hybrid
INR 900,000 - 1,400,000