Senior Data Engineer

Acesoft Labs; Bengaluru; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Acesoft Labs is seeking a Senior Data Engineer to design and optimize data architectures handling large-scale data from cloud and on-premise systems.

You will architect scalable ETL workflows, enable analytics and ML, and collaborate across teams to deliver end-to-end data solutions, while mentoring junior engineers.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
• 5+ years designing and implementing large-scale data platforms; 2+ years leading/mentoring data engineers.
• Hands-on Python with Pandas/Polars and big data tools such as Databricks (Spark), Flink, or Kafka.

Responsibilities

• Build and optimize data architectures to handle large-scale data from cloud and on-premise systems.
• Architect scalable ETL and data workflows to support analytics and machine learning models.
• Collaborate with cross-functional teams to deliver end-to-end data solutions that drive business insights.
• Own and lead projects focused on data platform modernization, ensuring high performance, security, and scalability.
• Tackle complex data engineering challenges in cloud data infrastructure.

Skills

Data architecture

Data pipelines

ETL development

Leadership & mentoring

Education

Bachelor's or Master's in CS/Engineering

Tools

Python (Pandas, Polars)

Databricks (Spark)

Flink

Kafka

Airflow

Prefect

Job description

As a Senior Data Engineer in the Engineering team:

Join us in:

• Building and optimizing data architectures to handle large-scale data from various sources, including cloud and on-premise systems.
• Architecting scalable ETL and data workflows to support advanced analytics and machine learning models.
• Collaborating with cross-functional teams to deliver end-to-end data solutions that drive business insights.
• Owning and leading projects that focus on data platform modernization, ensuring high performance, security, and scalability.
• Working on complex data engineering challenges that push the boundaries of cloud data infrastructure.

You'll have:

• A Bachelors or Master’s degree in Computer Science, Engineering, or a related technical field.
• 5+ years of experience designing and implementing large-scale data platforms, with at least 2 years of experience leading or mentoring data engineers.
• Hands‑on experience with Python (Pandas, Polars) and modern big data tools such as Databricks (Spark), Flink, or Kafka.
• Strong understanding of data pipeline development, ETL frameworks, and data lakes/warehouses.
• Extensive experience with cloud data platforms such as AWS (S3, Redshift, Lambda, Glue), GCP (BigQuery, Dataflow, Dataproc), or Snowflake.
• Familiarity with workflow orchestration tools like Airflow or Prefect.
• Proven ability to lead data engineering teams and mentor junior engineers.

It would be great if you have:

• Experience working with IoT or real-time streaming data.
• Knowledge of data governance frameworks and best practices.
• Exposure to MLOps workflows and integrating data with machine learning models.
• Experience in the energy or manufacturing sector or familiarity with time-series data.
• A strong understanding of data warehousing concepts, including Kimball model design.
• A deep understanding of data security and compliance requirements, particularly in cloud environments.