Data Engineer

SPAN India; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Benefits offered by this job

Generous paid leave

Comprehensive Insurance & Health Benefits

Centrally located office with access to transit and dining

Job summary

SPAN India in Bengaluru is looking for a Data Engineer to design and create infrastructure for real-time and batch analytics. You will work with teams to provide insights on data and write ETL processes that support data ingestion.

The ideal candidate has a Bachelor's Degree in a quantitative discipline and 2-5 years of relevant experience. This role offers dynamic teamwork and opportunities for collaboration with teams across the globe, all while contributing to clean energy solutions.

Qualifications

• 2 - 5 years of relevant work experience in data engineering or related fields.
• Expert level programming experience in Python, Kotlin or other JVM based languages.
• Experience working with CI/CD systems like Github Actions or Argo-CD.

Responsibilities

• Design and create infrastructure for real-time analytics and batch analytics pipelines.
• Monitor data pipelines/ETL jobs and create tooling for visibility.
• Build tools to manage and operate the data ecosystem.

Skills

Python

Kotlin

Docker

Kubernetes

SQL/Relational databases

Education

Bachelor's Degree in a quantitative discipline

Tools

Terraform

Circle-CI

Tableau

Job description

Overview

SPAN is enabling electrification for all. We are a mission-driven company designing, building, and deploying products that electrify the built environment, reduce carbon emissions, and slow the effects of climate change.

• Decarbonization is the process to reduce or remove greenhouse gas emissions, especially carbon dioxide, from entering our atmosphere.
• Electrification is the process of replacing fossil fuel appliances that run on gas or oil with all-electric upgrades for a cleaner way to power our lives.

The Role

As a Data Engineer you would be working to design, build, test and create infrastructure necessary for real time analytics and batch analytics pipelines. You will work with multiple teams within the org to provide analysis and insights on the data. You will also be involved in writing ETL processes that support data ingestion. You will guide and enforce best practices for data management, governance and security. You will build infrastructure to monitor these data pipelines / ETL jobs / tasks and create tooling/infrastructure for providing visibility into these.

Responsibilities

• Acquire deep business understanding on how SPAN data flows from IoT device to cloud through the system and build scalable and optimized data solutions that impact many stakeholders.
• Be an advocate for data quality and excellence of our platform.
• Build tools that help streamline the management and operation of our data ecosystem.
• Ensure best practices and standards in our data ecosystem are shared across teams.
• Work with teams within the company to build close relationships with our partners to understand the value our platform can bring and how we can make it better.
• Improve data discovery by creating data exploration processes and promoting adoption of data sources across the company.
• Have a desire to write tools and applications to automate work rather than do everything by hand.
• Assist internal teams in building out data logging, alerting and monitoring for their applications.
• Are passionate about CI/CD process.
• Design, develop and establish KPIs to monitor analysis and provide strategic insights to drive growth and performance.

About You

Required Qualifications

• Bachelor's Degree in a quantitative discipline: computer science, statistics, operations research, informatics, engineering, applied mathematics, economics, etc.
• 2 - 5 years of relevant work experience in data engineering, business intelligence, research or related fields.
• Expert level production-grade programming experience in at least one of these languages (Python, Kotlin, or other JVM based languages).
• Experience in writing clean, concise and well structured code in one of the above languages.
• Experience working with Infrastructure-as-code tools: Pulumi, Terraform, etc.
• Experience working with CI/CD systems: Circle-CI, Github Actions, Argo-CD, etc.
• Experience managing data engineering infrastructure through Docker and Kubernetes.
• Experience working with latency data processing solutions like Flink, Prefect, AWS Kinesis, Kafka, Spark Streaming, etc.
• Experience with SQL/Relational databases, OLAP databases like Snowflake.
• Experience working in AWS: S3, Glue, Athena, MSK, EMR, ECR, etc.

Bonus Qualifications

• Experience with the Energy industry
• Experience with building IoT and/or hardware products
• Understanding of electrical systems and residential loads
• Experience with data visualization using Tableau
• Experience in data loading tools like Fivetran as well as data debugging tools such as DataDog

Life at SPAN

Our Bengaluru team plays a pivotal role in SPAN’s continued growth and expansion. Together, we’re driving engineering, product development, and operational excellence to shape the future of home energy solutions. As part of our team in India, you’ll have the opportunity to collaborate closely with our teams in the US and across the globe. This international collaboration fosters innovation, learning, and growth, while helping us achieve our bold mission of electrifying homes and advancing clean energy solutions worldwide. Our in-office culture offers the chance for dynamic interactions and hands-on teamwork, making SPAN a truly collaborative environment where every team member’s contribution matters. Our climate-focused culture is driven by a team of forward-thinkers, engineers, and problem-solvers who push boundaries every day.

• Do mission-driven work: Every role at SPAN directly advances clean energy adoption.
• Bring powerful ideas to life: We encourage diverse ideas and perspectives to drive stronger products.
• Nurture an innovation-first mindset: We encourage big thinking and bold action.
• Deliver exceptional customer value: We value hard work, and the ability to deliver exceptional customer value.

Benefits At SPAN India

• Generous paid leave
• Comprehensive Insurance & Health Benefits
• Centrally located office in Bengaluru with easy access to public transit, dining, and city amenities