Senior Data Engineer, India

Branch; Bengaluru; On-site; Confidential; Full time

Benefits offered by this job

Comprehensive benefits package

Health and wellness programs

Paid time off

Retirement planning options

Job summary

Madrona Venture Labs is looking for a Senior Data Engineer in Bengaluru, Karnataka, to design and manage components of real-time and batch data pipelines processing petabytes of data. The role entails collaboration with data scientists and engineers to deliver high-quality analytical reports. Suitable candidates should have a Bachelor's in CS, 6+ years of experience, and strong skills in Java, Scala, and Python, alongside AWS or Google Cloud platform experience. The position follows a hybrid schedule and offers a comprehensive benefits package.

Qualifications

• 6+ years of Software Engineering or Data Engineering experience with a focus on big data.
• Strong development skills in Java or Scala and Python.
• Solid background in distributed systems and large-scale data processing.

Responsibilities

• Architect and build data aggregation systems for analytical reports.
• Collaborate with team members to deliver new features.
• Develop clean, testable, and cost-efficient solutions.

Skills

Software Engineering

Data Engineering

Java

Scala

Python

AWS

Kubernetes

Education

Bachelor's in Computer Science or equivalent

Tools

Flink

Spark

Kafka

Iceberg

Druid

Postgres

Redis

Job description

As a Senior Data Engineer, you will design, build, and manage components of our highly available real‑time and batch data pipelines handling petabytes of data. Our pipeline platform is designed to ingest and process billions of events per day, and make the resulting aggregations and insights available within minutes in our analytical data stores. Data Analytics is at the core of our business, and we’re constantly innovating to make our systems more performant, timely, cost‑effective, and capable while maintaining high reliability. You will build on top of our core data infrastructure and pipelines using technologies and tools tailored for massive data sets including Flink, Spark, Kafka, Iceberg and Druid while working in the AWS cloud environment.

If you are interested in building systems that can consume and explore billions of data points a day, work with petabytes of data, and want to push what is possible with data, this is the place for you!

As a Senior Data Engineer, you’ll get to:

• Architect, build, and own real‑time and batch data aggregation systems to deliver quality analytical reports for our internal and external customers.
• Collaborate with Data Scientists, Backend Engineers, Data & Infrastructure Operations, and Products Managers to deliver new features and capabilities for customers.
• Develop clean, safe, testable, and cost‑efficient solutions.
• Make well‑informed decisions with deep knowledge of both the internal and external impacts on teams and projects. Foresee shortcomings ahead of time and be able to drive to resolution.

You’ll be a good fit if you have:

• Bachelors in CS or equivalent.
• 6+ years of Software Engineering or Data Engineering experience with a recent focus on big data.
• Strong development skills in Java or Scala and Python.
• Solid background in the fundamentals of computer science, distributed systems, large scale data processing as well as database schema design and data warehousing.
• Practical experience managing AWS or Google Cloud environments.
• Experience in containerized deployment or Kubernetes is a big plus!
• Good understanding of a broad spectrum of NoSQL, traditional RDBMS, and analytical/columnar data stores including Postgres, Druid, Vertica, Redshift, Hadoop, Hive, Cassandra, Aerospike, and Redis.
• Ability to build systems that balance scalability, availability, and latency.
• Strong ability to advocate for the continual deployment and automation tools, monitoring, and self‑healing systems that can help improve the lives of our engineers.
• Great communication skills and you are a team player who has a proven track record of building strong relationships with management, co‑workers, and customers.
• A desire to learn and grow, push yourself and your team, share lessons with others and provide constructive and continuous feedback, and be receptive to feedback from.

This role will be based at our Bengaluru, KA office and follows a Hybrid schedule that will be aligned with our Return to Office guidelines.

The salary range provided represents base compensation and does not include potential equity, which is available for qualifying positions. At Branch, we are committed to the well‑being of our team by offering a comprehensive benefits package. From health and wellness programs to paid time off and retirement planning options, we provide a range of benefits for qualified employees. For detailed information on the benefits specific to your position, please consult with your recruiter.

Branch is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Candidate Privacy Information: For more information on the data that Branch will collect through your application, and how we use, share, delete, and retain that information as part of our recruitment and employment efforts, please see our HR Privacy Policy.