Data Engineer

Avahi; Pune District; On-site; INR 1,500,000 - 2,700,000; Full time

Benefits offered by this job

Remote-first environment

Mentorship program

Career development opportunities

Job summary

Avahi, a remote-first cloud-first consulting company based in India, is seeking a data platform engineer to design and operate AWS data platforms supporting batch and streaming workloads. This role emphasizes data ingestion, governance, and scalable architectures in a remote-ready setup.

You will build pipelines, develop knowledge graphs, and ensure data quality while collaborating with cross-functional teams and integrating CRM/ERP systems.

Qualifications

• 4-5 yrs of experience designing and operating AWS data platforms.
• Strong Python skills for data engineering and maintainable code.
• Experience with Spark, Hadoop, Hive, or Flink; data modeling and governance.

Responsibilities

• Design, build, and maintain scalable AWS data platforms.
• Ingest, transform, and enrich data from internal and external sources.
• Design data governance, cataloging, and lineage.
• Build knowledge graphs to model relationships across core entities.
• Identify data gaps and improve data quality and inference.
• Collaborate with CRM/ERP integrations (Salesforce, SAP, NetSuite, Dynamics 365, Workday).

Skills

AWS data platforms

Python

Distributed data systems

SQL

Spark/Hadoop

Data governance

Infrastructure as Code

English communication

Tools

S3

Glue

Lake Formation

Athena

Redshift

EMR

Kinesis

DynamoDB

OpenSearch

Neptune

Job description

This position is open to candidates based in India only. Applications from outside India will not be considered.

Company Overview

At Avahi, we’re redefining what it means to be a premier cloud-first consulting company, recognized for our people, culture, and innovative solutions. With expertise in Managed Services, Reselling, Staffing, and Professional Services, we are dedicated to delivering exceptional value and putting customers first.

As a remote-first, global team spanning North America, Europe, and Southeast Asia, we foster a collaborative and diverse environment where professional growth, creativity, and mutual respect thrive. Guided by our values—Customer-Centricity, Collaboration, Agility, Innovation, Integrity, and Diversity & Inclusion—we empower businesses to embrace the full potential of a cloud-first approach.

Key Responsibilities

• Design, build, and maintain scalable AWS data platforms supporting batch and streaming pipelines, analytics, and AI/ML workloads, aligned with AWS Well-Architected best practices.
• Build and operate data ingestion, transformation, and enrichment pipelines from internal systems and external APIs, handling structured, semi-structured, unstructured, and graph data.
  Implement data normalization workflows to ensure consistent schemas, high data quality, and reliable analytics, BI, and ML use cases.
• Design and enforce data governance including cataloging, lineage, access control, and auditability.
• Build and maintain knowledge graphs to model relationships across core business entities, enabling advanced analytics and inference.
• Identify data gaps, inconsistencies, and missing relationships using strong analytical and inference skills.
• Integrate data from enterprise platforms such as CRM and ERP systems (Salesforce, HubSpot, SAP, NetSuite, Dynamics 365, Workday).
• Design secure data access layers for analytics, BI, ML, and downstream applications.
  Implement monitoring, observability, and data quality checks for freshness, completeness, and pipeline health.
• Optimize data architectures for performance and cost efficiency using partitioning, indexing, compression, and storage tiering.
• Build internal tooling, dashboards, and standardized scaffolding to improve visibility, maintainability, and onboarding.
• Collaborate with cross-functional teams to deliver high-impact data solutions and share best practices, documentation, and technical guidance.

Required Skills & Qualifications

• 4-5 yrs of strong experience designing and operating AWS data platforms, including S3, Glue, Lake Formation, Athena, Redshift, EMR, Kinesis/MSK, DynamoDB, OpenSearch, and Neptune.
• Strong Python skills for data engineering, focused on modular, testable, and maintainable code.
• Solid understanding of distributed data systems, including batch and streaming pipelines, fault tolerance, idempotency, and event-driven architectures.
• Experience with data warehouse and lakehouse architectures, ETL/ELT pipelines, and analytical query engines.
• Hands-on experience with Spark, Hadoop, Hive, or Flink.
• Strong data modeling skills, including normalized, denormalized, and graph-based models, with safe schema evolution.
• Advanced SQL skills for analytics and data engineering, including window functions, CTEs, and query optimization.
• Experience integrating external APIs and enterprise systems, especially CRM and ERP platforms.
• Knowledge of data governance, security, and compliance, including encryption, access control, and audit logging.
• Experience implementing monitoring, observability, and data quality checks using CloudWatch and CloudTrail.
• Comfort with Infrastructure as Code using CloudFormation or Terraform.
• Strong end-to-end ownership mindset, with a focus on scalability, reliability, and long-term maintainability.
• Professional-level English communication skills, able to explain data architectures and trade-offs to technical and non-technical stakeholders.

Why Work Here

1. Remote-First Flexibility:
   Enjoy work-life harmony in a remote-first environment that allows you to work from anywhere.
2. Innovative Culture:
   We embrace a startup mindset, encouraging creativity, agility, and growth. Be part of a team that explores cutting-edge technology and drives impactful solutions.
3. Career Development:
   Avahi is committed to your growth, offering mentorship and opportunities to advance your career.
4. Purpose-Driven Mission:
   Join us in making a difference. Avahi is dedicated to championing diversity, supporting women in tech, and fostering sustainable practices.
5. Global Collaboration:
   Work alongside a diverse, talented team, sharing insights and collaborating to create innovative solutions that make a real impact.

Join Avahi and make an impact in a fast-paced, customer-focused environment with abundant opportunities for growth.

Accessibility and Inclusivity Statement

At Avahi, we are committed to fostering a workplace that celebrates diversity and inclusivity. We welcome applicants from all backgrounds, experiences, and perspectives, including those from underrepresented communities.

We are proud to be an equal opportunity employer, providing a fair and accessible recruitment process for all candidates. If you require accommodations at any stage of the application or interview process, please let us know, and we will work to meet your needs.

#LI-Remote