Senior Data Scheduling Infra Developer

eBay; Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

eBay’s Unified Data Platform Team is seeking a Senior Data Scheduling Infra Developer to design, build, and operate a high-performance Airflow-based job scheduling engine. You will customize Airflow, extend its DAG/Operator capabilities, and collaborate with the open-source community to influence the project roadmap and scalability of large-scale analytics workflows.

You will work on security, performance, and reliability improvements while delivering production-grade software.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field; advanced degree preferred.
• 5+ years of software development experience with a strong focus on Python.
• 2+ years hands-on experience with Apache Airflow, including DAG and Operator development.
• Strong understanding of cloud platforms and containers (Docker, Kubernetes).
• Experience with CI/CD tools and practices.
• Demonstrated proficiency building production-grade software with AI coding agents to improve engineering velocity while maintaining high standards for quality, availability, and maintainability.
• Ability to decompose problems and provide agents with the right context, specifications, constraints, and validation criteria.
• Ability to capture and express business, architecture, codebase, and operational knowledge so AI coding agents can execute complex tasks accurately and autonomously.
• Hands-on experience delivering complex, production-quality software using AI coding tools such as Claude Code, Codex, etc.

Responsibilities

• Analyze, customize, and enhance Apache Airflow's source code to develop new features and improve existing functionalities and performance.
• Collaborate with the Airflow community by contributing patches, enhancements, and fixes.
• Implement best practices for Airflow architecture, including security, scalability, and performance optimization.
• Develop and optimize complex Airflow DAGs and Operators for data processing and orchestration.
• Stay updated with the latest trends and advancements in Airflow and related technologies.

Skills

Python

Airflow

Docker

Kubernetes

CI/CD

AI coding agents

Education

Bachelor's degree in Computer Science/IT or related field

Advanced degree preferred

Tools

Apache Airflow

Docker

Kubernetes

Claude Code

Codex

Job description

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.

We are the Unified Data Platform Team at eBay, responsible for the scalability, performance, and reliability of our Analytics Platform. Our mission is to improve availability, security, and orchestration across large-scale data and AI workflows.

As a Senior Data Scheduling Infra Developer, you will play a pivotal role in designing, developing, and operating a high-performance job scheduling and execution engine built on Airflow. This includes customizing, enhancing, and extending Airflow to meet eBay’s needs, while collaborating closely with the open-source community to contribute patches, influence roadmap direction, and advance the state of workflow orchestration at scale.

Key Responsibilities

• Analyze, customize, and enhance Apache Airflow's source code to develop new features and improve existing functionalities and performance.
• Collaborate with the Airflow community by contributing patches, enhancements, and fixes.
• Implement best practices for Airflow architecture, including security, scalability, and performance optimization.
• Develop and optimize complex Airflow DAGs and Operators for data processing and orchestration.
• Stay updated with the latest trends and advancements in Airflow and related technologies.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field. Advanced degree preferred.
• 5+ years of experience in software development, with a strong focus on Python.
• 2+ years of hands‑on experience with Apache Airflow, including DAG and Operator development.
• Strong understanding of cloud platforms and containerization technologies (Docker, Kubernetes).
• Experience with CI/CD tools and practices.
• Demonstrated proficiency building production‑grade software with AI coding agents, improving engineering velocity while maintaining high standards for quality, availability, and maintainability.
• Ability to decompose problems and provide agents with the right context, specifications, constraints, and validation criteria.
• Ability to capture and express business, architecture, codebase, and operational knowledge so AI coding agents can execute complex tasks accurately and autonomously.
• Hands‑on experience delivering complex, production‑quality software using AI coding tools such as Claude Code, Codex, etc.

Preferred Qualifications As a Plus

• Deep understanding of Apache Airflow architecture and internals, with proven experience in customizing its source code.
• Experience as a contributor or committer to the Apache Airflow project or similar open‑source projects.
• Excellent communication skills and ability to collaborate effectively with both internal teams and the open‑source community.
• Experience with big data technologies such as Hadoop, Spark, Kafka, Flink.

Additional Details

eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at [e-mail]. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.

We use cookies to enhance your experience and may use AI tools for administrative tasks in the hiring process. To learn how we handle your personal data and use AI responsibly, please visit our Talent Privacy Notice, Privacy Center, and AI Hiring Guidelines.