Senior Data Engineer

Avathon Government; Bengaluru; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

Avathon is seeking a Senior Data Engineer to join the Engineering team in Bengaluru. You will design robust data pipelines and scalable ETL workflows feeding analytics for renewable energy use cases, including real-time monitoring and predictive maintenance.

You will lead data engineering efforts, mentor junior engineers, and collaborate with cross‑functional teams to deliver end-to-end data solutions across cloud and on‑prem environments.

Qualifications

• 5+ years designing and implementing large-scale data platforms.
• Experience leading or mentoring data engineers.
• Strong Python data tooling proficiency and big data tech stack.

Responsibilities

• Build and optimize data architectures for large-scale data from IoT, PLC, SCADA and cloud/on‑prem systems.
• Architect scalable ETL/workflows to support analytics and ML in renewable domains.
• Collaborate across teams to deliver end-to-end data solutions.
• Own data platform modernization projects focusing on performance, security, and scalability.
• Lead complex data engineering challenges in cloud data infrastructure.

Skills

Python (Pandas/Polars)

Databricks (Spark)

Flink

Kafka

ETL pipelines

Data lakes/warehouses

Cloud platforms (AWS/GCP/Snowflake)

Airflow

Leadership/mentoring

Education

Bachelor's or Master's in Computer Science or related field

Tools

Databricks

Spark

Flink

Kafka

Airflow

Prefect

AWS

GCP

Snowflake

BigQuery

Dataflow

Dataproc

S3/Blob storage

Redshift

Lambda

Glue

Job description

Who We Are & Why Join Us

Avathon is the leading Industrial AI autonomy platform, helping customers across heavy industries – energy, mining, manufacturing, aerospace, defense, and logistics – accelerate the journey toward autonomous operations. Our platform is built on a Computational Knowledge Graph foundation that contextualizes and connects operational data across siloed systems, bringing together time series, structured, unstructured, and machine vision data to power AI-driven applications in asset performance management, supply chain intelligence, visual AI, and global trade management. With capabilities spanning digital twins, normal behavior modeling, natural language processing, and computer vision, Avathon delivers real-time predictive intelligence and agentic decision-making at industrial scale.

Cutting-Edge AI Innovation – Join a team at the forefront of AI, developing groundbreaking solutions that shape the future. High-Growth Environment – Thrive in a fast-scaling startup where agility, collaboration, and rapid professional growth are the norm. Meaningful Impact – Work on AI-driven projects that drive real change across industries and improve lives.

Learn more at: avathon.com

As a Senior Data Engineer in the Engineering team:

Data engineering team builds the robust pipelines that feed the analytics driving the renewable energy sector, enabling real-time monitoring,forecasting,predictive maintenance, and grid optimization for solar, wind, and other sources, ensuring efficiency, reliability, and effective integration into smart grids by managing massive data flows from IoT devices, PLC systems and smart meters. In essence, data engineers create the “data highways” that allow data scientists and AI to turn raw energy data into actionable intelligence, making renewable energy systems smarter, more efficient, and more reliable for a sustainable future

Join us in:

• Building and optimizing data architectures to handle large-scale data from various sources IoT, PLC, SCADA including cloud and on-premise systems.
• Architecting scalable ETL and data workflows to support advanced analytics and machine learning models in Renewable domains
• Collaborating with cross-functional teams to deliver end-to-end data solutions that drive business insights.
• Owning and leading projects that focus on data platform modernization, ensuring high performance, security, and scalability.
• Working on complex data engineering challenges that push the boundaries of cloud data infrastructure.

You’ll have:

• A Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
• 5+ years of experience designing and implementing large-scale data platforms, with at least 2 years of experience leading or mentoring data engineers.
• Hands‑on experience with Python (Pandas, Polars) and modern big data tools such as Databricks (Spark), Flink, or Kafka.
• Strong understanding of data pipeline development, ETL frameworks, and data lakes/warehouses.
• Extensive experience with cloud data platforms such as AWS (S3, Redshift, Lambda, Glue), GCP (BigQuery, Dataflow, Dataproc), or Snowflake.
• Familiarity with workflow orchestration tools like Airflow or Prefect.
• Proven ability to lead data engineering teams and mentor junior engineers.

It would be great if you have:

• Experience working with IoT or real‑time streaming data.
• Knowledge of data governance frameworks and best practices.
• Exposure to MLOps workflows and integrating data with machine learning models.
• Experience in the energy or manufacturing sector or familiarity with time‑series data.
• A strong understanding of data warehousing concepts, including Kimball model design.
• A deep understanding of data security and compliance requirements, particularly in cloud environments.

**A PLUS if you provide the link to your GitHub Website

Avathon is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy, genetic information, disability, status as a protected veteran, or any other protected category under applicable federal, state, and local laws.

Avathon is committed to providing reasonable accommodations throughout the recruiting process. If you need a reasonable accommodation, please contact us to discuss how we can assist you.