Senior Specialist, Intelligence Platform Databricks Engineer

Nasdaq; Atlanta (GA); Hybrid; USD 111,000 - 194,000; Full time

Benefits offered by this job

401(k) match

Employee stock purchase program

Life & disability insurance

Paid time off

Medical, dental, vision

Hybrid work schedule

Gym membership discounts

Parental leave

Fertility benefits

Volunteer days

Education assistance

Professional development

Job summary

Nasdaq operates a centralized Databricks Lakehouse (CAP Intelligence Platform) serving multiple units. The Senior Specialist administers and governs the platform, enabling self-service by workspaces and data stewards while ensuring cost and compliance controls.

Hybrid in-office schedule supports collaboration across teams. Reporting to the AVP of Enterprise Architecture, you will implement IaC with Terraform, optimize performance, and scale governance practices across six business units in a

Qualifications

• Bachelor's degree or equivalent practical experience.
• 5+ years of data platform administration or cloud infrastructure.
• Hands-on Databricks administration at scale (Unity Catalog, compute management).
• Proven governance, compliance reporting, and cost management experience.
• Strong communicator across technical and business teams.

Responsibilities

• Administer and support a multi-workspace Databricks environment with governance.
• Own platform-wide governance, auditing, and remediation efforts.
• Deliver monthly cost and usage reporting across workspaces and resources.
• Collaborate with data stewards and admins across six units for self-service support.
• Support Terraform-based IaC to automate provisioning, governance, and reporting.

Skills

Data governance

Cost management

Cross-functional collaboration

Effective communication

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Unity Catalog

Terraform

Cloud platforms (AWS)

Job description

As a Senior Specialist, Intelligence Platform Engineer reporting to the AVP of Enterprise Architecture, you'll play a critical role in administering, governing, and scaling Nasdaq's centralized Databricks Lakehouse environment - the CAP Intelligence Platform - which serves multiple business units across the Capital Access Platforms organization.

You’ll thrive in this position if you're detail-oriented, technically strong, and energized by building platforms that bring data governance, compliance, and operational efficiency together at scale.

Key Responsibilities

• Administer and support a multi-workspace Databricks environment, including Unity Catalog governance, service principal management, and enterprise integrations, ensuring platform reliability and operational standards across all business units.
• Own platform-wide governance by monitoring compliance with catalog structure, metadata standards, naming conventions, and tagging requirements - producing scorecards, audit reports, and driving remediation where needed.
• Deliver monthly cost and usage reporting across workspaces, compute clusters, serverless workloads, and storage resources, identifying optimization opportunities and providing business unit-level consumption transparency.
• Partner with workspace administrators and data stewards across six business units to enable self-service administration, develop operational documentation, and serve as the escalation point for complex platform issues.
• Support Infrastructure-as-Code implementations using Terraform to automate provisioning, governance validation, and reporting - contributing to a scalable, efficient platform.

Required Qualifications

• Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent practical experience.
• 5+ years of experience in data platform administration, cloud infrastructure, or a comparable technical discipline.
• Hands-on experience administering Databricks at scale, including Unity Catalog, workspace configuration, and compute management.
• Proven ability to deliver governance frameworks, compliance reporting, and cost management in a complex, regulated environment.
• Strong communicator who works effectively across technical and business teams in matrixed, cross-functional environments.

Preferred Qualifications

• Databricks Certified Professional certification or equivalent cloud certifications (e.g., AWS).
• Experience in financial services, fintech, or regulated industries, including familiarity with compliance requirements such as Reg SCI.
• Background in FinOps principles, identity lifecycle management, or large-scale platform rollouts.

This position offers the opportunity for a hybrid work environment at least 3 days a week in-office, subject to change, providing flexibility and accessibility for qualified candidates.

Come as You Are

Nasdaq is an equal opportunity employer. We welcome applications from candidates of all backgrounds and identities.

We are committed to fostering an inclusive workplace where diverse perspectives, experiences, and identities are valued and celebrated.

We ensure that individuals with disabilities are provided with reasonable accommodation throughout the hiring process.

What We Offer

We're proud to offer a competitive rewards package that is meaningful, recognizes the unique needs of our employees and their families and incentivizes employees for their contribution to Nasdaq's overall success.

The base pay range for this role is $111,000 - $194,000. In addition to base salary, Nasdaq provides a generous annual bonus/commission (short-term incentive), and equity (long-term incentive), comprehensive benefits, and opportunity for growth. Exact compensation may vary based on several job-related factors that are unique to each candidate, including but not limited to: skill set, experience, education/training, business needs and market demands.

Nasdaq's programs and rewards are intended to allow our employees to:

• Secure Wealth: 401(k) program with 6% employer match, Employee Stock Purchase Program with 15% discount, Student loan repayment program up to $10k, Company paid life and disability plans, Generous paid time off
• Prioritize Health: Comprehensive medical, dental and vision coverage, Health spending account with employer contribution, Paid flex days to support mental wellbeing, Gym membership discounts
• Care for Family: Hybrid home/office schedule (for most positions), Paid parental leave, Fertility benefits, Paid bereavement leave
• Connect with Community: Company gift matching program, Employee resource groups, Paid volunteer days
• Grow Career: Education Assistance Program, Robust job skills training and Professional development opportunities

For more information, visit Nasdaq Benefits & Rewards Career page.