Senior Data Engineer: AI-Driven Pipelines on Databricks

Livenation; United States; Remote; USD 152,000 - 190,000; Full time

Benefits offered by this job

Health, Vision and Dental benefits

Paid time off

401(k) with company match

Tuition reimbursement

Volunteer time off

Concert tickets

Job summary

Live Nation Entertainment is seeking a Senior Data Engineer to design scalable data pipelines on Databricks and SQL Server, leveraging AI tools to accelerate development and automate governance. The role focuses on modernizing the data platform and delivering reliable data assets across the enterprise.

You will collaborate with data consumers, engineers, and product teams to enable AI use cases, enhance performance, and drive data-driven decisions.

Qualifications

• 5–7+ years of hands-on data engineering experience.
• Advanced proficiency in Python, SQL, PySpark, and ETL/ELT frameworks.
• Strong experience with Databricks and distributed data processing.
• Demonstrated ability to optimize SQL/Spark workloads for performance and cost.
• Experience using AI development tools such as GitHub Copilot, Databricks Assistant, SQL copilots.
• Solid understanding of data modeling, governance, and CI/CD for data pipelines.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Python, and SQL.
• Optimize data workflows and SQL/Spark queries for performance, cost efficiency, and reliability.
• Contribute to the design of our enterprise Data Lake and curated data assets.
• Build robust ingestion frameworks, transformation logic, and reusable data engineering components.
• Support data migrations and modernization efforts from legacy systems to cloud-based platforms.
• Mentor junior data engineers and promote AI-assisted data engineering.
• Work cross-functionally with Product and data consumers to deliver high-quality data solutions.

Skills

Python

SQL

PySpark

ETL/ELT

Databricks

AI tools

GitHub Copilot

Tools

Databricks

Jira

Confluence

Job description

Live Nation Entertainment is seeking a Senior Data Engineer to design scalable data pipelines on Databricks and SQL Server, leveraging AI tools to accelerate development and automate governance. The role focuses on modernizing the data platform and delivering reliable data assets across the enterprise.

You will collaborate with data consumers, engineers, and product teams to enable AI use cases, enhance performance, and drive data-driven decisions.