Data and AI Lead, Finance

Databricks; Bengaluru; On-site; INR 2,500,000 - 3,500,000; Full time

Benefits offered by this job

Comprehensive benefits

Diversity and inclusion commitment

Job summary

Databricks in Bengaluru is looking for a Finance Data Lead to be the technical authority behind finance data pipelines and AI systems. This role involves architecting complex data solutions, leading AI design for finance use cases, and mentoring data engineers. Applicants should have over 12 years of experience in data engineering and strong skills in SQL and Python.

The position offers a chance to work within a dynamic Finance team with visibility to CFO-level priorities, making it a high-impact role.

Qualifications

• 12+ years of experience in data engineering or finance systems
• Deep proficiency in SQL and Python, hands-on with Apache Spark
• Experience with financial source systems like Netsuite or Salesforce

Responsibilities

• Architect and build finance data pipelines using Databricks
• Lead the design of AI use cases for Finance and Accounting
• Mentor junior engineers and raise the technical quality of the team

Skills

Data engineering

Financial systems

SQL

Python

Apache Spark

ETL pipelines

Education

12+ years of experience in data engineering or finance

Tools

Databricks platform

GitHub Actions

Job description

About The Role

GAQ327R175

This role is part of the Finance Organisation. As Finance Data Lead on the Finance Data and AI team, you will be the technical authority behind data pipelines, AI systems, and internal applications that power Databricks' Finance and Accounting organization. You will report to the Senior Manager, Finance Data and AI and serve as an individual contributor who sets the technical bar, drives architectural decisions, and delivers the highest‑complexity work on the team. The role is based in Bengaluru.

This is a high‑impact role at the intersection of finance domain expertise and data platform capability. You will work closely with a team of finance data engineers as a technical lead and mentor, and partner directly with Accounting, FP&A, and Finance leadership to define what gets built and how.

You will be embedded in a Finance organization that takes data and AI seriously, with visibility to CFO‑level priorities. The team operates with engineering rigor and Finance accountability, and you will have the autonomy to define how the Finance DataLake and modern Finance data infrastructure should evolve at Databricks.

What You Will Do

• Architect, build, and own the most complex finance data pipelines in the Finance DataLake, using Databricks Jobs and Lakeflow Declarative Pipelines with built‑in data validation and reconciliations
• Lead the technical design of AI use cases for the Finance and Accounting organization, including forecasting automation, anomaly detection, and natural‑language interfaces to financial data
• Build and maintain internal Finance applications (Databricks Apps, Genie Spaces, dashboards) that enable self‑service for non‑technical Finance stakeholders
• Design and deliver curated Finance DataLake datasets and enforce row‑level security, data access policies, and Unity Catalog governance standards
• Define and champion coding standards, data modeling conventions, documentation practices, and testing frameworks across the Finance engineering team
• Enforce and evolve Git‑based version control, pull‑request review processes, and CI/CD pipelines (Declarative Automation Bundles, GitHub Actions) to satisfy SOX change‑management requirements
• Lead technical scoping and solutioning for requirements from Accounting, FP&A, Internal Audit, and Procurement teams
• Serve as the primary technical point of contact during financial close, ensuring data accuracy and timely resolution of pipeline issues
• Partner with IT and Engineering on new system integrations, providing detailed technical requirements and leading UAT
• Mentor junior and mid‑level engineers through code reviews, pairing, and design discussions, raising the technical quality of the broader team
• Proactively identify architectural debt, performance bottlenecks, and tooling gaps, and drive resolution with minimal direction

What We Look For

• 12+ years of experience in data engineering, analytics engineering, or finance systems, with a track record of owning complex, production‑grade pipelines end‑to‑end
• Deep proficiency in SQL and Python; hands‑on experience with Apache Spark and the Databricks platform
• Experience building and maintaining ELT/ETL pipelines from financial source systems (Netsuite, Salesforce, Stripe, Zuora, or similar) into a centralized data lake
• Strong understanding of core finance and accounting concepts including close processes, revenue recognition, intercompany, chart of accounts, and financial reporting
• Ability to independently translate ambiguous Finance requirements into well‑architected, maintainable technical solutions
• Comfortable driving technical conversations with both engineering peers and non‑technical Finance stakeholders
• Experience building Finance‑facing dashboards, self‑service BI products, and executive reporting layers
• Familiarity with AI/ML concepts with demonstrated enthusiasm for applying them to Finance workflows

Nice To Have

• Prior experience at a high‑growth SaaS or cloud infrastructure company
• Hands‑on experience with AI/BI tools, Genie, or LLM‑powered applications
• Experience with Declarative Automation Bundles or CI/CD for Finance DataLake pipelines
• CPA, CFA, or formal finance/accounting background

Benefits

We offer comprehensive benefits and perks that meet the needs of all employees.

Our Commitment to Diversity and Inclusion

We are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export‑controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.