Backend Engineer, Data Platform

Cervin; United States; Remote; USD 158,000 - 257,000; Full time

Job summary

A leading software delivery platform is seeking a Data Platform Engineer to build and optimize data pipelines that process trillions of events daily. The ideal candidate has over 5 years of backend engineering experience and a strong background in modern data pipeline technologies. This position offers competitive compensation based on location and experience, along with benefits including RSUs and health insurance.

Benefits

Health, vision, and dental insurance

Restricted Stock Units (RSUs)

Mental health benefits

Qualifications

• 5+ years of backend software engineering experience required.
• At least 1 year of experience building data pipelines or data warehouses.
• Strong understanding of data structures, distributed systems, and threading.
• Commitment to high code quality and automated testing.

Responsibilities

• Build and maintain data pipelines for experimentation and analytics.
• Collaborate with engineers and designers to deliver features.
• Monitor and optimize database and pipeline performance.
• Participate in code reviews and improvement processes.

Skills

Backend software engineering

Data pipeline construction

Collaborative environment

Code maintainability

Infrastructure-as-Code tools

Observability tools

Tools

Kinesis

Airflow

Spark

Lambda

Flink

Athena

Clickhouse

Postgres

ElasticSearch

Timestream

Snowflake

Job description

About the Job:

Software powers the world, and LaunchDarkly empowers all teams to deliver and control the best software. As a Data Platform Engineer, you will help us build batch and stream processing pipelines that process trillions of events per day and deliver data to optimized derived tables that power all major internal and external products built on event data.

Our platform serves over twenty trillion feature flags daily. To accommodate the large scale of our systems, we use state-of-the-art pipeline technologies in the AWS ecosystem, including Kinesis, Airflow, Spark, Lambda, Flink and Athena. We store data in databases including Clickhouse, Postgres, ElasticSearch, Timestream and Snowflake. As part of our you-build-it-you-run-it culture, all engineers support the pipelines in production, including in an on-call rotation.

Responsibilities:

• Build and expand our data pipelines and data products supporting Experimentation, Release observability, Metrics, Product Analytics and Flag Insights product lines, as well as internal Business Intelligence.
• Collaborate with frontend engineers, product managers and UX designers to deliver user-facing features
• Monitor and improve database and pipeline performance
• Write unit, integration, and load tests as necessary
• Actively participate in code reviews
• Write and review technical proposals
• Improve engineering standards, tooling, and processes

Qualifications:

• 5+ Years of backend software engineering experience
• Minimum of 1 year experience building product focused Data Pipelines or Data Warehouse
• Demonstrable experience with data pipelines, including some of Kinesis, Airflow, Spark, Lambda, Flink and Athena.
• Experience with event or analytical data sets in databases including some of Clickhouse, Postgres, ElasticSearch, Timestream and Snowflake.
• Familiarity with computer science fundamentals such as data structures, distributed systems, concurrency, and threading
• A commitment to working in a communicative and collaborative environment
• You write code that can be easily understood by others, with an eye towards maintainability
• You hold yourself and others to a high bar when working with production systems
• You value high code quality, automated testing, and other engineering best practices
• Familiarity with Infrastructure-as-Code tools like Terraform or equivalent
• Familiarity with observability tools like Datadog or equivalent

Pay:

• Zone 1: San Francisco/Bay Area or NYC Metropolitan Area, Boston, Seattle - 187,000 - 257,000
• Zone 2: Irvine, LA, Monterey, Santa Barbara, Santa Rosa, Austin, Portland, Philadelphia, Chicago - 168,000 - 231,000
• Zone 3: All other US locations - 158,000 - 218,000

LaunchDarkly operates from a place of high trust and transparency; we are happy to state the pay range for our open roles to best align with your needs. Exact compensation may vary based on skills, experience, and location.

*Within the United States, our geographic pay zones are defined by counties surrounding major metropolitan areas.
**Restricted Stock Units (RSUs), health, vision, and dental insurance, and mental health benefits in addition to salary.

About LaunchDarkly:

Modern software delivery was supposed to be the foundation for a thriving digital business but reality has proven otherwise. Slow, inefficient development cycles, costly outages, and fragmented customer experiences are preventing developers from building their best software. The LaunchDarkly platform helps developers innovate on new features faster while protecting them with a safety valve to instantly rewind when things go wrong. Developers can target product experiences to any customer segment and maximize the business impact of every feature. And by gradually rolling out new application components, they escape nightmare "big-bang" technology migrations.

The LaunchDarkly platform was built to guide engineers to the next frontier of DevOps by:

• Improving the velocity and stability of software releases, without the fear of end customer outages
• Delivering targeted experiences by easily personalizing features to customer cohorts
• Maximizing the business impact of every feature through the ability to experiment and optimize
• Coordinating the release and optimization of software to provide consistent experiences across mobile platforms and device types
• Improving the effectiveness and productivity of engineering teams, by providing insights into engineering cadence and stability

At LaunchDarkly, we believe in the power of teams. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, veteran status, or disability status. LD invites any applicant to review our written Affirmative Action Plan. To do so, contact People Ops at [e-mail].

Learn more about the interview process & what it’s like to work with LaunchDarkly's Product Delivery team!

Do you need a disability accommodation?

Fill out this accommodations request form and someone from our People Operations team will contact you for assistance.