Senior Data Engineer

Aumni; Maharashtra; Hybrid; INR 3,000,000 - 5,500,000; Full time

Benefits offered by this job

Medical and life insurance

Paid time off + holidays

On-site gym

Hybrid work culture

Fridays socials

Annual parties and treks

Job summary

Aumni Techworks is seeking a Data Engineer to collaborate with Software Engineering and Product teams to enhance data infrastructure, pipelines, and analytics. You will design and implement scalable data solutions, enabling organizational insights and ML initiatives.

You will work with Spark, EMR, Airflow, Glue, and S3 to build automated, fault-tolerant data systems, partnering with analysts and data scientists to drive impactful data products. A passion for data and automation is essential.

Qualifications

• 5+ years of data engineering experience.
• Experience with data modeling, warehousing and building ETL pipelines.
• Experience programming with Python.
• Experience delivering end-to-end projects independently.
• Knowledge of distributed systems related to data storage and computing.
• 3+ years analyzing data with Postgres, NoSQL, etc.
• 3+ years hands-on with Spark, Iceberg, EMR, Glue, Data Lake and BI tools like Quicksight.
• Infrastructure as Code using Terraform and GitHub Actions.
• Geospatial and time series data experience.
• Monitoring with AWS CloudWatch.

Responsibilities

• Architecture design and implementation of next generation data pipelines, analytics, and BI solutions.
• Manage AWS resources including RDS, EMR, MWAA, and Lambda.
• Build and deliver high quality data architecture and pipelines for analysts and data scientists.
• Interface with other tech teams to extract, transform, and load data from diverse sources.
• Improve reporting and analysis processes, automating self-service for customers.

Skills

Data engineering

Python programming

ETL pipelines

Data modeling

Distributed systems

End-to-end project delivery

Postgres/NoSQL experience

Tools

Apache Spark

EMR

Airflow

Glue

S3

Terraform

GitHub Actions

Iceberg

Data Lake

Quicksight

Job description

As a Data Engineer you will work directly with Software Engineering and Product teams to continuously improve our data infrastructure, design, tools and pipelines. Your work will directly influence and drive organizational insights, customer‑facing features, and machine learning models.

To be successful in this role, you should have strong database design skills, comfort with large data sets, and an eagerness to invent. You should have a passion for data and analytics with the technical skills needed to build for scale and automation.

Key Job Responsibilities

• Architecture design and implementation of next generation data pipelines, analytics, and BI solutions
• Manage AWS resources including RDS, EMR, MWAA, and Lambda
• Build and deliver high quality data architecture and pipelines to support business analysts and data scientists
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources
• Continually improve ongoing reporting and analysis processes, automating or simplifying self‑service support for customers

A day in the life

• Collaborate with Software Engineers, Product Managers, Data Scientists and Business Intelligence Engineers to design, plan and deliver on high priority data initiatives serving internal stakeholders and Pole Star customers.
• Build automated, fault tolerant and scalable data solutions leveraging state of the art technologies including but not limited to Spark, EMR, Python, AirFlow, Glue and S3.
• Look around corners and be creative - Continuously evaluate and improve our strategy, architecture, tooling and codebase to maximize performance, scalability and availability.

Basic Qualifications

• 5+ years of data engineering experience
• Experience with data modeling, warehousing and building ETL pipelines
• Experience programming with at least one modern language, preferably Python
• Experience working on and delivering end to end projects independently
• Knowledge of distributed systems as it pertains to data storage and computing
• 3+ years of analyzing and interpreting data with Postgres, NoSQL etc. experience
• 3+ Years of hands‑on experience with big data framework and storage mechanisms like Apache Spark, Iceberg, EMR, Glue, Data Lake, and BI tools like Quicksight
• Infrastructure as Code using Terraform and Github actions
• Geospatial and time series data experience
• Monitoring platforms, especially AWS CloudWatch

Benefits Of Working At Aumni Techworks

• Our award‑winning culture reminds us of our engineering days.
• Medical insurance (including Parents), Life and Disability insurance
• 24 leaves + 10 public holidays + leaves for Hospitalization, maternity, paternity and bereavement.
• On site Gym, TT, Carrom, Foosball and Pool table
• Hybrid work culture
• Fitness group / rewards
• Friday Socials, Annual parties, treks.