Senior Data Engineer

Avathon; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Agile and collaborative environment

Opportunities for rapid professional growth

Meaningful projects in renewable energy

Job summary

A pioneering industrial AI company in Bengaluru is seeking a Senior Data Engineer to optimize large-scale data architectures. The role emphasizes designing ETL workflows and requires over 5 years of experience in data platform development. Candidates should possess extensive knowledge of cloud services and strong Python skills. This position offers opportunities for mentorship within a fast-growing team, pushing the boundaries of data engineering in the renewable energy sector.

Qualifications

• 5+ years of experience designing large-scale data platforms.
• At least 2 years of experience leading or mentoring data engineers.
• Extensive experience with cloud data platforms.

Responsibilities

• Building and optimizing data architectures for large-scale data.
• Architecting scalable ETL and data workflows.
• Collaborating with teams to deliver data solutions.

Skills

Python (Pandas, Polars)

ETL frameworks

Data pipeline development

Workflow orchestration tools (Airflow, Prefect)

Collaboration with cross-functional teams

Education

Bachelor’s or Master’s degree in Computer Science or Engineering

Tools

AWS (S3, Redshift, Lambda, Glue)

GCP (BigQuery, Dataflow, Dataproc)

Databricks (Spark)

Kafka

Flink

Job description

Who We Are & Why Join Us

Avathon is revolutionizing industrial AI with a powerful platform that enables businesses to harness the full potential of their operational data. Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360‑degree operational view that enhances decision‑making and efficiency. With advanced capabilities like digital twins, natural language processing, normal behavior modeling, and machine vision, we create real‑time virtual replicas of physical assets, enabling predictive maintenance, performance simulation, and operational optimization. Our AI‑driven models empower companies with scalable solutions for anomaly detection, performance forecasting, and asset lifetime extension—all tailored to the complexities of industrial environments.

Cutting‑Edge AI Innovation – Join a team at the forefront of AI, developing groundbreaking solutions that shape the future.

High‑Growth Environment – Thrive in a fast‑scaling startup where agility, collaboration, and rapid professional growth are the norm.

Meaningful Impact – Work on AI‑driven projects that drive real change across industries and improve lives.

Learn more at: Avathon

As a Senior Data Engineer In The Engineering Team

Data engineering team builds the robust pipelines that feed the analytics driving the renewable energy sector, enabling real‑time monitoring, forecasting, predictive maintenance, and grid optimization for solar, wind, and other sources, ensuring efficiency, reliability, and effective integration into smart grids by managing massive data flows from IoT devices, PLC systems and smart meters. In essence, data engineers create the "data highways" that allow data scientists and AI to turn raw energy data into actionable intelligence, making renewable energy systems smarter, more efficient, and more reliable for a sustainable future.

Join Us In

• Building and optimizing data architectures to handle large‑scale data from various sources IoT, PLC, SCADA including cloud and on‑premise systems.
• Architecting scalable ETL and data workflows to support advanced analytics and machine learning models in Renewable domains.
• Collaborating with cross‑functional teams to deliver end‑to‑end data solutions that drive business insights.
• Owning and leading projects that focus on data platform modernization, ensuring high performance, security, and scalability.
• Working on complex data engineering challenges that push the boundaries of cloud data infrastructure.

You’ll Have

• A Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
• 5+ years of experience designing and implementing large‑scale data platforms, with at least 2 years of experience leading or mentoring data engineers.
• Hands‑on experience with Python (Pandas, Polars) and modern big data tools such as Databricks (Spark), Flink, or Kafka.
• Strong understanding of data pipeline development, ETL frameworks, and data lakes/warehouses.
• Extensive experience with cloud data platforms such as AWS (S3, Redshift, Lambda, Glue), GCP (BigQuery, Dataflow, Dataproc), or Snowflake.
• Familiarity with workflow orchestration tools like Airflow or Prefect.
• Proven ability to lead data engineering teams and mentor junior engineers.

It Would Be Great If You Have

• Experience working with IoT or real‑time streaming data.
• Knowledge of data governance frameworks and best practices.
• Exposure to MLOps workflows and integrating data with machine learning models.
• Experience in the energy or manufacturing sector or familiarity with time‑series data.
• A strong understanding of data warehousing concepts, including Kimball model design.
• A deep understanding of data security and compliance requirements, particularly in cloud environments.
• A PLUS if you provide the link to your GitHub Website.

Avathon is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy, genetic information, disability, status as a protected veteran, or any other protected category under applicable federal, state, and local laws.

Avathon is committed to providing reasonable accommodations throughout the recruiting process. If you need a reasonable accommodation, please contact us to discuss how we can assist you.