A leading analytics solutions company based in Bengaluru is seeking a skilled developer to design and develop scalable data pipelines and backend services primarily using Java and Python. The candidate must possess strong proficiency in Data Structures and Algorithms and experience with high-throughput infrastructure, ensuring availability and performance. Familiarity with Trino, Athena, and Kafka is highly desirable. This role emphasizes accountability in execution and collaboration with multiple stakeholders.
Qualifications
Design scalable data pipelines and backend services.
Experience in maintaining high-throughput infrastructures.
Strong proficiency in optimizing high-scale distributed systems.
Responsibilities
Accountable for end-to-end task execution.
Build with scalability, availability, and resilience in mind.
Interface with stakeholders to deliver requirements.
Skills
Java
Python
Data Structures and Algorithms
SQL
Kafka
Tools
Trino
Athena
Airflow
Confluent Schema Registry
Job description
Must have
Architect & Build: Design and develop scalable data pipelines and backend services using Java and Python.
Infrastructure at Scale: Maintain and optimize high-throughput infrastructure, ensuring high availability and low latency.
Design scalable ingestion layers and warehouse schemas that leverage Trino and Athena for high-performance, distributed querying at scale.
Strong proficiency in Data Structures and Algorithms with a focus on optimizing high-scale distributed systems.
Partner with cross-functional teams to deliver technical requirements and resolve platform bottlenecks.
Bonus
Prior experience with product analytics tools is a plus.
Experience in Trino is an added advantage.
Good to have Airflow.
Responsibilities
Strong bias for action; accountable for end-to-end task execution and timely delivery in a fast-paced environment.
Keep scalability/availability/resilience in mind while building.
Interfacing with multiple stakeholders to understand the requirements and deliver accordingly.
Core Tech Stack
Languages:Java (Must-have), Python
Data & Messaging:SQL, Confluent Schema Registry, Kafka