Staff Data Engineer

SourcingXPress; Bengaluru; On-site; INR 4,500,000 - 8,500,000; Full time

Benefits offered by this job

Competitive salary and equity

Professional development opportunities

Dynamic work environment

Job summary

SourcingXPress in Bengaluru is looking for a Staff/Senior Data Engineer to design and build the backbone of an AI-powered data platform. The ideal candidate should have over 8 years of experience in data engineering, expertise in building large-scale data pipelines, and proficiency in Python and SQL. This role offers a competitive salary between ₹45-85 Lacs PA, extensive development opportunities, and a chance to contribute to impactful projects in a dynamic environment.

Qualifications

• 8+ years in data engineering with experience in large-scale data pipelines.
• Strong proficiency in Python and SQL; optimization expertise preferred.
• Hands-on experience with Airflow or dbt for pipeline orchestration.

Responsibilities

• Design and build AI-powered data infrastructure.
• Build PB-scale data pipelines for massive data volumes.
• Integrate AI features into data workflows.

Skills

Data pipeline development

SQL optimization

Python programming

Cloud platforms (AWS)

Containerized deployments (Kubernetes)

AI and automation

Collaboration

Problem-solving

Tools

Airflow

dbt

SQL AST parsers (e.g., sqlglot)

Job description

About Altimate AI

Founded in 2022 in San Francisco, Altimate AI is transforming enterprise data operations through AI. Our mission is to reduce the workload on data teams by providing AI‑driven solutions that automate and accelerate critical data tasks. Our flagship product, DataPilot, enables advanced data automation, while DataMates acts as a virtual AI teammate, assisting professionals in daily workflows. Our solutions integrate seamlessly with tools like VSCode, Git, and Slack, covering tasks from data documentation to performance optimization. Backed by prominent VCs and advisors and used by thousands globally, Altimate AI is leading the AI‑powered data engineering revolution. Our team includes Silicon Valley veterans who have built and scaled category‑defining AI and data products from startup to IPO.

Salary Range: ₹45‑85 Lacs PA.

Who We’re Looking For

We're in search of a Staff/Senior Data Engineer who brings a passion for innovation and problem‑solving, not limited to traditional data engineering. This role is for those with deep expertise in building large‑scale data pipelines, SQL optimization, and cloud infrastructure, excited to design and build the backbone of our AI‑powered data solutions. The ideal candidate will play a crucial role in enhancing our AI capabilities, developing high‑performance data systems, and integrating advanced AI using the product into thousands of data teams’ daily workflows.

What You’ll Do

As a Staff/Senior Data Engineer, you will design and build the backbone of our AI‑powered data platform, helping thousands of data teams worldwide work smarter and faster.

Key Responsibilities

• Build PB‑scale data pipelines capable of handling 100K+ jobs and massive daily data volumes.
• Design and maintain cloud‑native data infrastructure on AWS, leveraging Airflow, dbt, and Kubernetes for scalable, efficient deployments.
• Develop an intelligent SQL ecosystem: query optimization, dynamic pipeline generation, and column‑level data lineage using SQL AST parsing (e.g., sqlglot).
• Integrate AI‑driven features into data workflows, enhancing automation, performance, and usability.
• Collaborate closely with Product, AI, and Engineering teams to deliver high‑performance, reliable, and scalable solutions.
• Contribute to open‑source initiatives and share technical expertise with the broader data community.

Required Technical Skills

• 8+ years in data engineering with experience in large‑scale data pipelines and systems.
• Strong proficiency in Python and SQL; expertise in SQL query profiling, optimization, and performance tuning (preferably Snowflake).
• Deep understanding of SQL Abstract Syntax Tree (AST) and experience working with SQL parsers (e.g., sqlglot) for generating column‑level lineage and dynamic ETLs.
• Hands‑on experience with Airflow or dbt for pipeline orchestration.
• Solid understanding of cloud platforms (AWS preferred) and containerized deployments (Kubernetes).
• Passion for combining traditional data engineering with AI‑powered automation.
• Strong problem‑solving, collaboration, and mentoring skills.

Why Join Altimate AI?

• Innovation at the Forefront: Push the boundaries of data engineering by combining traditional techniques with cutting‑edge AI technologies.
• High Visibility: Directly affect the productivity and capabilities of global data teams, as your contributions will be crucial to the daily operations of thousands of users spread across 100s of countries.
• Open Source Contribution: As part of our commitment to the developer community, you will contribute to our open‑source initiatives, gaining recognition in the tech community.
• Career Growth: This role is a launchpad into the rapidly advancing field of AI‑powered data engineering, offering exposure to state‑of‑the‑art technologies and generative AI applications.

Projects You’ll Work On

• PB‑Scale Data Pipelines: Build highly performant, large‑scale infrastructure capable of handling 100K+ jobs and petabytes of data per day.
• Cloud‑Native Data Infrastructure: Design and implement robust, scalable data infrastructure on AWS, utilizing Kubernetes and Airflow for efficient resource management and deployment.
• Intelligent SQL Ecosystem: Develop a sophisticated SQL intelligence platform covering query optimization, dynamic pipeline generation, and column‑level lineage. Apply your expertise in SQL profiling, AST analysis, and parsing to build adaptive pipelines and improve query performance.

What We Offer

• Competitive salary and equity.
• Extensive professional development opportunities and resources for continuous learning.
• Dynamic and intellectually stimulating work environment with a team of talented engineers.
• Opportunities to shape the direction of the company and leave a lasting impact.