Senior Specialist, Intelligence Platform Databricks Engineer

Nasdaq, Inc.

New York (NY)

Hybrid

USD 111,000 - 194,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hybrid work schedule

Job summary

Nasdaq, Inc. is seeking a Senior Platform Engineer to manage Nasdaq's centralized Databricks Lakehouse (the CAP Intelligence Platform) and drive governance across six business units.

You will administer multi-workspace environments, implement Unity Catalog governance, and partner with data stewards to enable self-service and scalable operations. The role emphasizes cost management, compliance reporting, and IaC automation with Terraform, delivering reliable, compliant data platforms in a hybrid

Qualifications

  • Bachelor's degree or equivalent practical experience in a related field.
  • 5+ years in data platform administration, cloud infrastructure, or a comparable technical discipline.
  • Hands-on Databricks administration at scale with Unity Catalog, workspace configuration, and compute management.
  • Experience delivering governance frameworks, compliance reporting, and cost management in a complex, regulated environment.

Responsibilities

  • Administer and support a multi-workspace Databricks environment with Unity Catalog governance.
  • Develop and enforce platform-wide governance, naming, tagging, and metadata standards.
  • Deliver monthly cost and usage reporting across workspaces, compute clusters, serverless workloads, and storage resources.
  • Collaborate with workspace admins and data stewards to enable self-service administration and escalate complex issues.
  • Support Infrastructure-as-Code implementations using Terraform to automate provisioning, governance validation, and reporting.

Skills

Databricks administration
Unity Catalog
Terraform
Cost management
Cross-functional communication

Education

Bachelor's degree in Computer Science, Information Systems, or related field

Tools

Databricks
AWS
Terraform

Job description

As a Senior Specialist, Intelligence Platform Engineer reporting to the AVP of Enterprise Architecture, you'll play a critical role in administering, governing, and scaling Nasdaq's centralized Databricks Lakehouse environment — the CAP Intelligence Platform — which serves multiple business units across the Capital Access Platforms organization. You'll thrive in this position if you're detail-oriented, technically strong, and energized by building platforms that bring data governance, compliance, and operational efficiency together at scale. ## **Key Responsibilities** * Administer and support a multi-workspace Databricks environment, including Unity Catalog governance, service principal management, and enterprise integrations, ensuring platform reliability and operational standards across all business units.* Own platform-wide governance by monitoring compliance with catalog structure, metadata standards, naming conventions, and tagging requirements — producing scorecards, audit reports, and driving remediation where needed.* Deliver monthly cost and usage reporting across workspaces, compute clusters, serverless workloads, and storage resources, identifying optimization opportunities and providing business unit-level consumption transparency.* Partner with workspace administrators and data stewards across six business units to enable self-service administration, develop operational documentation, and serve as the escalation point for complex platform issues.* Support Infrastructure-as-Code implementations using Terraform to automate provisioning, governance validation, and reporting — contributing to a scalable, efficient platform. ## **Required Qualifications** * Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent practical experience.* 5+ years of experience in data platform administration, cloud infrastructure, or a comparable technical discipline.* Hands-on experience administering Databricks at scale, including Unity Catalog, workspace configuration, and compute management.* Proven ability to deliver governance frameworks, compliance reporting, and cost management in a complex, regulated environment.* Strong communicator who works effectively across technical and business teams in matrixed, cross-functional environments. ## **Preferred Qualifications** * Databricks Certified Professional certification or equivalent cloud certifications (e.g., AWS).* Experience in financial services, fintech, or regulated industries, including familiarity with compliance requirements such as Reg SCI.* Background in FinOps principles, identity lifecycle management, or large-scale platform rollouts. This position offers the opportunity for a hybrid work environment at least 3 days a week in-office, subject to change, providing flexibility and accessibility for qualified candidates.**Come as You Are**Nasdaq is an equal opportunity employer. We welcome applications from candidates of all backgrounds and identities.We are committed to fostering an inclusive workplace where diverse perspectives, experiences, and identities are valued and celebrated.We ensure that individuals with disabilities are provided with reasonable accommodation throughout the hiring process.**What We Offer**We’re proud to offer a competitive rewards package that is meaningful, recognizes the unique needs of our employees and their families and incentivizes employees for their contribution to Nasdaq’s overall success.The base pay range for this role is $111,000 - $194,000. In addition to base salary, Nasdaq provides a generous annual bonus/commission (short-term incentive), and equity (long-term incentive), comprehensive benefits, and opportunity for growth. Exact compensation may vary based on several job-related factors that are unique to each candidate, including but not limited to: skill set, experience, education/training, business needs and market demands.Nasdaq’s programs and rewards are intended to allow our employees to:* **Secure Wealth:** 401(k) program with 6% employer match, Employee Stock Purchase Program with 15% discount, Student loan repayment program up to $10k, Company paid life and disability plans, Generous paid time off* **Prioritize Health:** Comprehensive medical, dental and vision coverage, Health spending account with employer contribution, Paid flex days to support mental wellbeing, Gym membership discounts* **Care for Family**: Hybrid home/office schedule (for most positions), Paid parental leave, Fertility benefits, Paid bereavement leave* **Connect with Community:** Company gift matching program, Employee resource groups, Paid volunteer days* **Grow Career:** Education Assistance Program, Robust job skills training and Professional development opportunities**For more information, visit** Nasdaq Benefits & Rewards Career page**.**
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Specialist, Intelligence Platform Databricks Engineer
Senior Specialist, Intelligence Platform Databricks Engineer

Nasdaq, Inc. • Sandy Springs (GA)

Hybrid
USD 111,000 - 194,000
401(k) with employer match
Health, dental, vision coverage
Hybrid home/office schedule
Engineer, Platform Engineering & Reliability Specialist (Azure)
Engineer, Platform Engineering & Reliability Specialist (Azure)

Nasdaq, Inc. • Atlanta (GA)

Hybrid
USD 120,000 - 180,000
401(k) with employer match
Employee Stock Purchase Program
Comprehensive medical, dental and vis
+1
Lead Engineer, Platform Engineering & Reliability
Lead Engineer, Platform Engineering & Reliability

Nasdaq, Inc. • Sandy Springs (GA)

Hybrid
USD 150,000 - 210,000
401(k) match
Employee stock purchase
Life and disability coverage
+3
Data Software Engineer
Data Software Engineer

Nasdaq • Philadelphia

On-site
USD 120,000 - 160,000
401(k) with employer match
Employee Stock Purchase Program
Life and disability plans
+9
Software Engineer - Cloud Solutions & AI
Software Engineer - Cloud Solutions & AI

Nasdaq, Inc. • Boston (MA)

On-site
USD 86,000 - 146,000
401(k) with 6% match
Employee stock purchase program (15%)
Student loan repayment up to $10k
+2
Engineer, Platform Engineering & Reliability Specialist (Azure)
Engineer, Platform Engineering & Reliability Specialist (Azure)

Nasdaq, Inc. • Sandy Springs (GA)

Hybrid
USD 120,000 - 170,000
401(k) with employer match
Employee Stock Purchase Program with 8
Student loan repayment
+4
Lead Engineer, Platform Engineering & Reliability
Lead Engineer, Platform Engineering & Reliability

Nasdaq • Atlanta (GA)

On-site
USD 180,000 - 240,000
401(k) with 6% employer match
Employee Stock Purchase Program 15%
Student loan repayment
+3
Data Software Engineer
Data Software Engineer

Nasdaq, Inc. • Philadelphia

On-site
USD 120,000 - 160,000
401(k) match
Employee Stock Purchase Program
Student loan repayment
Software Engineer - Cloud Solutions & AI
Software Engineer - Cloud Solutions & AI

Nasdaq • Boston (KY)

On-site
USD 86,000 - 146,000
401(k) match
Employee stock purchase program
Student loan repayment
+2
Engineer, Platform Engineering & Reliability Specialist (Azure)
Engineer, Platform Engineering & Reliability Specialist (Azure)

Nasdaq • United States

Hybrid
USD 120,000 - 160,000
6% employer 401(k) match
Employee Stock Purchase Program 15%
Health insurance
+2