Senior Data Engineer

Avathon Government; Bengaluru; On-site; INR 3,000,000 - 5,200,000; Full time

Job summary

Avathon is seeking a Senior Data Engineer to join the Engineering team. You will build robust data pipelines that feed analytics for renewable energy sectors, enabling real-time monitoring, forecasting, predictive maintenance, and grid optimization.

You will work on large-scale datasets from IoT/SCADA, collaborate across teams, mentor junior engineers, and help modernize data platforms in cloud environments. A strong foundation in Python, big data tools, and cloud services is essential.

Qualifications

• Bachelor’s or Master’s degree in CS, Engineering, or related field.
• 5+ years building large-scale data platforms, with 2+ years mentoring.
• Proficient with Python (Pandas, Polars) and Databricks/Spark, Flink or Kafka.
• Experience with cloud data services (AWS/GCP) and Snowflake.
• Familiar with Airflow or Prefect for orchestration.

Responsibilities

• Build robust data pipelines feeding analytics for renewable energy domains.
• Enable real-time monitoring, forecasting, and grid optimization.
• Collaborate with cross-functional teams and mentor junior engineers.
• Lead data platform modernization with a focus on security and scalability.
• Tackle complex data engineering challenges across cloud environments.

Skills

Python (Pandas, Polars)

Databricks (Spark)

Flink

Kafka

Airflow

Prefect

Data pipelines

Mentoring

Education

Bachelor’s or Master’s in CS/Engineering

Tools

AWS (S3, Redshift, Lambda, Glue)

GCP (BigQuery, Dataflow, Dataproc)

Snowflake

CDC/ETL tools

Job description

Who We Are & Why Join Us

Avathon is the leading Industrial AI autonomy platform, helping customers across heavy industries – energy, mining, manufacturing, aerospace, defense, and logistics – accelerate the journey toward autonomous operations. Our platform is built on a Computational Knowledge Graph foundation that contextualizes and connects operational data across siloed systems, bringing together time series, structured, unstructured, and machine vision data to power AI-driven applications in asset performance management, supply chain intelligence, visual AI, and global trade management. With capabilities spanning digital twins, normal behavior modeling, natural language processing, and computer vision, Avathon delivers real-time predictive intelligence and agentic decision-making at industrial scale.

Cutting-Edge AI Innovation – Join a team at the forefront of AI, developing groundbreaking solutions that shape the future. High-Growth Environment – Thrive in a fast-scaling startup where agility, collaboration, and rapid professional growth are the norm. Meaningful Impact – Work on AI-driven projects that drive real change across industries and improve lives.

Learn more at: avathon.com

Senior Data Engineer in the Engineering team:

Data engineering team builds the robust pipelines that feed the analytics driving the renewable energy sector, enabling real-time monitoring, forecasting, predictive maintenance, and grid optimization for solar, wind, and other sources, ensuring efficiency, reliability, and effective integration into smart grids by managing massive data flows from IoT devices, PLC systems and smart meters. In essence, data engineers create the “data highways” that allow data scientists and AI to turn raw energy data into actionable intelligence, making renewable energy systems smarter, more efficient, and more reliable for a sustainable future

Join us in:

• Building and optimizing data architectures to handle large-scale data from various sources IoT, PLC, SCADA including cloud and on-premise systems.
• Architecting scalable ETL and data workflows to support advanced analytics and machine learning models in Renewable domains
• Collaborating with cross-functional teams to deliver end-to-end data solutions that drive business insights.
• Owning and leading projects that focus on data platform modernization, ensuring high performance, security, and scalability.
• Working on complex data engineering challenges that push the boundaries of cloud data infrastructure.

You’ll have:

• A Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
• 5+ years of experience designing and implementing large-scale data platforms, with at least 2 years of experience leading or mentoring data engineers.
• Hands-on experience with Python (Pandas, Polars) and modern big data tools such as Databricks (Spark), Flink, or Kafka.
• Strong understanding of data pipeline development, ETL frameworks, and data lakes/warehouses.
• Extensive experience with cloud data platforms such as AWS (S3, Redshift, Lambda, Glue), GCP (BigQuery, Dataflow, Dataproc), or Snowflake.
• Familiarity with workflow orchestration tools like Airflow or Prefect.
• Proven ability to lead data engineering teams and mentor junior engineers.

It would be great if you have:

• Experience working with IoT or real-time streaming data.
• Knowledge of data governance frameworks and best practices.
• Exposure to MLOps workflows and integrating data with machine learning models.
• Experience in the energy or manufacturing sector or familiarity with time-series data.
• A strong understanding of data warehousing concepts, including Kimball model design.
• A deep understanding of data security and compliance requirements, particularly in cloud environments.

**A PLUS if you provide the link to your GitHub Website

Avathon is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy, genetic information, disability, status as a protected veteran, or any other protected category under applicable federal, state, and local laws.

Avathon is committed to providing reasonable accommodations throughout the recruiting process. If you need a reasonable accommodation, please contact us to discuss how we can assist you.