Senior Software Engineer, Data Engineering

airbnb, Inc.; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

A leading company is seeking a Senior Software Engineer in Data Engineering to design and maintain efficient data pipelines. This role involves collaboration with various teams to ensure data quality and compliance, utilizing technologies like Spark and Airflow. The position is US-Remote eligible, promoting a diverse and inclusive work environment.

Benefits

Bonuses

Equity

Benefits

Travel Credits

Qualifications

• 5-9+ years of relevant industry experience.
• Experience with distributed processing technologies.

Responsibilities

• Design, build, and maintain robust data pipelines.
• Develop data models for merchandising optimization.
• Collaborate with Data Scientists and Software Engineers.

Skills

Data Analysis

Communication

Education

BS/Master’s or PhD

Tools

Hadoop

Spark

Kafka

PostgreSQL

MySQL

Airflow

Job description

Senior Software Engineer, Data Engineering

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.

The Community You Will Join:

We are currently hiring for multiple teams:

Payments: We are building a world-class payments platform — one that currently supports 190+ countries and regions, 70+ currencies, connects dozens of payment providers and banks, and processes multiple billions of dollars. As the platform grows, we’ll be adding new payment partners, global licenses, and building new payment experiences for our guests and hosts. The Payments team builds a scalable foundation to support global scale, helps the company grow by bringing new markets and demographics to the platform, and enables new business initiatives to thrive by providing easy-to-use payment services.

Apps and Compliance: This team is responsible for building scalable, high-quality data sets and solutions to enable Airbnb to comply with tax, payments, and legal regulations to ensure business continuity. Additionally, this team builds data sets for Airbnb’s internal applications (e.g., CRM data, projects data, workspace data) to fuel growth and operational efficiency.

The Difference You Will Make:

Payments: As Airbnb expands, it faces challenges managing large data volumes, deriving insights, and creating data-powered products. We aim to ensure our financial data is high fidelity, timely, comprehensive, well-organized, and easily discoverable. Our entire payments infrastructure is undergoing a major overhaul, with systems being redesigned in a service-oriented architecture.

Apps and Compliance: Our charter is to enable Airbnb to comply with tax, payments, and legal regulations across geographies. Our products ingest, process, validate, and deliver large datasets to government authorities with high accuracy and quality. Your work on the critical Compliance data ecosystem will contribute to establishing standards and best practices in Airbnb’s Data Engineering. Solving complex business challenges at scale will influence the tools, processes, and standards used by the broader data community.

A Typical Day:

• Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds.
• Develop data models to enable analysis and manipulation of data for merchandising optimization, ensuring data quality, consistency, and accuracy.
• Build scalable data pipelines using SparkSQL & Scala, leveraging Airflow scheduler/executor framework.
• Collaborate with Data Scientists, Product Managers, and Software Engineers to define data requirements and deliver data solutions that improve merchandising and sales.
• Contribute to Airbnb’s Data Engineering community to influence tooling and standards, enhancing culture and productivity.
• Improve code and data quality through internal tools to detect and mitigate issues automatically.

Your Expertise:

• 5-9+ years of relevant industry experience with a BS/Master’s or 2+ years with a PhD.
• Experience with distributed processing technologies such as Hadoop, Spark, Kafka, and storage systems like HDFS, S3.
• Ability to analyze large datasets, identify gaps, provide insights, and develop effective product solutions.
• Expertise with ETL schedulers like Apache Airflow, Luigi, Oozie, AWS Glue, or similar frameworks.
• Solid understanding of data warehousing concepts and experience with relational databases (PostgreSQL, MySQL) and columnar databases (Redshift, BigQuery, HBase, ClickHouse).
• Excellent written and verbal communication skills.

Your Location:

This position is US-Remote eligible. It may include occasional work at an Airbnb office or attendance at offsites, as agreed. Currently, employees cannot be located in Alaska, Indiana, Nebraska, North Dakota, Ohio, South Dakota, Wisconsin, Alabama, Mississippi, Oklahoma, Delaware, or Rhode Island. This list is subject to change; please check for updates. If employed by another Airbnb entity, your recruiter will inform you of eligible states.

Our Commitment To Inclusion & Belonging:

Airbnb values diversity and encourages all qualified individuals to apply. We believe diverse ideas foster innovation and engagement. For assistance or accommodations during the application process, contact [e-mail].

How We'll Take Care of You:

Our job titles may span multiple career levels. The actual pay depends on factors like experience, skills, and market demand. The role may be eligible for bonuses, equity, benefits, and Travel Credits.