Data Engineer

Weekday AI (YC W21); Hyderabad; On-site; INR 2,000,000 - 3,000,000; Full time

Job summary

A technology startup in Hyderabad is looking for an experienced Data Engineer who can design and build data solutions for analytics-driven environments. This role requires strong expertise in Java, AWS, and PostgreSQL, with responsibilities ranging from pipeline development to database optimization. Ideal candidates will have 6-10 years of relevant experience in fast-paced startups. The position offers a full-time contract and opportunities for growth in an innovative environment.

Qualifications

• 6‑10 years of experience as a Backend Engineer or Data Engineer in high-scale environments.
• Expert in Java for backend automation and data processing.
• Strong experience with AWS services including S3, ECS, and Lambda.

Responsibilities

• Design and maintain scalable data pipelines capable of handling 100M+ records.
• Build services using Java and AWS components.
• Own and optimize PostgreSQL environments.

Skills

Java

AWS

PostgreSQL optimization

Data pipeline development

Data ingestion

Job description

Base pay range: Rs 2000000 - Rs 3000000 (ie INR 20-30 LPA)

Min Experience: 6 years

Location: Hyderabad

Job Type: full-time

We are looking for an experienced Data Engineer who can design, build, and scale data solutions for high-volume, analytics-driven environments. This role is ideal for someone who has worked as a Backend Engineer or Data Engineer in fast-paced product startups and has a strong foundation in Java, AWS, and data architecture. You will work closely with engineering, product, and analytics teams to build reliable data pipelines, optimize databases, and support real‑time and batch processing needs at scale.

Key Responsibilities

• Data Engineering & Pipeline Development
• Design, develop, and maintain scalable data pipelines capable of handling 100M+ records and multi‑tenant systems.
• Integrate and streamline data ingestion from third‑party sources such as GitHub, Jira, Jenkins, Bitbucket, and other developer or analytics platforms.
• Implement transformation logic, incremental updates, and automated workflows for continuous data refresh.
• Backend & System Architecture
• Build and optimize services using Java, AWS Lambda, ECS, CloudWatch, S3, RDS, and other cloud‑native components.
• Architect and maintain high‑throughput systems with strong performance, fault tolerance, and security.
• Collaborate with backend teams to standardize data contracts, APIs, and domain models.
• Database & Query Optimization
• Own and optimize PostgreSQL environments — partitioning, indexing, schema evolution, query tuning, and performance debugging.
• Implement data modeling best practices to support complex analytical workloads and reporting needs.
• Ensure data accuracy, consistency, and version control across schema changes and upgrades.
• Data Quality, Monitoring & Automation
• Build monitoring and alerting frameworks to track job reliability, latency, data inconsistencies, and infrastructure performance.
• Create automated systems for validation, deduplication, and enforcement of data standards.
• Work with DevOps or Platform Teams to establish CI/CD pipelines for data workflows.

Required Skills & Experience

• 6‑10 years of hands‑on experience as a Backend Engineer or Data Engineer in high‑scale, data‑centric environments.
• Expert‑level proficiency in Java for building microservices, data processing systems, or backend automation.
• Strong experience with AWS cloud stack — S3, ECS, Lambda, RDS, and CloudWatch.
• Proven ability to ingest, parse, and transform data from multiple external APIs and complex data sources.
• Deep practical knowledge of PostgreSQL optimization techniques including indexing, partitioning, performance tuning, and query planning.
• Hands‑on experience building scalable data workflows, event‑driven systems, or analytics platforms.

Bonus / Good‑to‑Have Skills

• Exposure to dbt, ClickHouse, Kafka, Temporal, Superset, or developer‑analytics ecosystems.
• Experience in distributed systems or streaming‑based architectures.
• Prior work in developer tooling, DevOps analytics, CI/CD intelligence, or productivity insights.

Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

Other

Industries

IT Services and IT Consulting