Staff Software Engineer, Data Catalog

JobCubby; Northern (KY); Hybrid; USD 212,000 - 265,000; Full time

Benefits offered by this job

Bonus

Equity

Employee Travel Credits

Job summary

Airbnb is seeking a Staff Software Engineer to lead data catalog infrastructure, metadata management, and data governance initiatives. You will work with cross-functional teams to build scalable tooling that makes data assets discoverable and compliant across Airbnb’s data ecosystem.

You will shape end-to-end data lineage, governance, and metadata integration, collaborating with various data infrastructure teams to ensure data assets are cataloged and governed in line with business and

Qualifications

• 9+ years of experience in software engineering with a focus on data infrastructure and distributed processing technologies.
• Deep knowledge of data governance frameworks and metadata management.
• Proficiency in Java, Python, or Scala.
• Experience with data catalog products and metadata integration tooling.

Responsibilities

• Lead development of data catalog infrastructure and governance products across Airbnb's data ecosystem.
• Collaborate with cross-functional teams to design scalable metadata onboarding and integrations.
• Develop end-to-end data lineage, metadata management, and data quality capabilities.
• Define and implement metadata governance requirements across data systems.

Skills

Java

Python

Scala

Education

BS/MS/PhD in Computer Science or related field

Tools

Hive

Spark

Trino

Flink

SQL databases

Job description

to apply - email only, no card. You can also save this posting or score it againstyour profile with AI.## About the roleThe Staff Software Engineer will lead the development of data catalog infrastructure, including metadata management, data lineage, and data governance products. They will collaborate with cross-functional teams to build scalable tools and processes that ensure all data assets at Airbnb are discoverable and compliant.## RequirementsCandidates must have 9+ years of experience in software engineering with a strong focus on data infrastructure and distributed processing technologies. Proficiency in Java, Python, or Scala is required, along with deep knowledge of data governance frameworks and metadata management.## BenefitsBonusEquityEmployee Travel Credits## Full descriptionAirbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.The Community You Will Join:Airbnb is a mission-driven company dedicated to helping create a world where anyone can belong anywhere. It takes a unified team committed to our core values to achieve this goal. Airbnb's various functions embody the company's innovative spirit and our fast-moving team is committed to leading as a 21st century company.The Difference You Will Make:We are looking for a talented Staff Software Engineer to join our Data Infrastructure organization and lead our efforts in building Data Catalog infrastructure products across Airbnb's Data Ecosystem. In this role, you will work with cross-functional teams to develop and build infrastructure, tooling, standards, and processes to ensure all data assets at Airbnb are cataloged, discoverable and governed.A Typical Day:* Develop and implement data catalog products to support Airbnb data users on data discovery, metadata management, data quality, data lineage.* Develop and implement metadata infrastructure to support data governance and processes, including ownership management, data classification, data privacy, access control and data retention.* Build industry leading end to end data lineage product across online, offline, machine learning, metrics, visualizations and third party datasets.* Collaborate with cross-functional teams to ensure all datasets at Airbnb are cataloged, governanced and meeting business goals and regulatory requirements. Conduct programs to define and ensure metadata quality and metadata governance requirements.* Work with various data infrastructure framework teams to identify, design and build metadata integrations to provide data catalog products for each data system.* Build infrastructure toolings and processes for scalable metadata onboarding and integrations.* Develop and implement metadata driven data policies and procedures to support data governance requirements.Your Expertise:* BS/MS/PhD in Computer Science or a related field, or equivalent work experience.* 9+ years of experience in software engineering, with a focus on data infrastructure.* Experience working with data storage and distributed processing technologies, such as Hive, Spark, Trino, Flink or SQL databases.* Strong programming skills in one or more of the following languages: Java, Python, or Scala.* Experience with data catalog products - metadata infrastructure, metadata management, metadata integration framework and tooling, metadata-driven data management.* Experience with workflow orchestration solutions (e.g. Apache Airflow, Prefect, Kubeflow, etc...)* Strong knowledge of data governance frameworks, policies, and processes, including data classification, data lineage, data quality, data privacy and retention.* Excellent communication skills and the ability to collaborate with cross-functional teams to build empathetic tools and platforms.* Ability to work in areas outside of your usual comfort zone.* Excellent analytical and problem solving skills.Your Location:This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please check back with us if the state you live in is on the exclusion list. If your position is employed by another Airbnb entity, your recruiter will inform you what states you are eligible to work from.Our Commitment To Inclusion & Belonging:Airbnb is committed to working with the broadest talent pool possible. We believe diverse ideas foster innovation and engagement, and allow us to attract creatively-led people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply.We strive to also provide a disability inclusive application and interview process. If you are a candidate with a disability and require reasonable accommodation in order to submit an application, please contact us at: [e-mail]. Please include your full name, the role you're applying for and the accommodation necessary to assist you with the recruiting process.We ask that you only reach out to us if you are a candidate whose disability prevents you from being able to complete our online application.How We'll Take Care of You:Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.Pay Range$212,000 - $265,000 USD