Senior Data Engineer (Databricks Platform)

Live Nation; York (York County); Remote; USD 128,000 - 160,000; Full time

Job summary

Join a forward-thinking company as a Senior Data Engineer, where you'll leverage your expertise in Python and data platforms to drive innovation. This hands-on role involves enhancing a modern data platform, ensuring data quality and compliance, and collaborating with cross-functional teams. You'll design scalable solutions using cutting-edge technologies like Databricks and AWS, while also enjoying a culture that values creativity and resourcefulness. With a supportive environment that offers growth opportunities and a commitment to diversity, this position is perfect for those looking to make a meaningful impact in the data engineering field.

Benefits

Medical, Dental and Vision benefits

Paid time off including holidays and birthday

401(k) program with company match

Tuition reimbursement

Free concert tickets

Volunteer time off

Qualifications

• Strong coding skills in Python and PySpark for data engineering.
• Experience with data lakes, warehouses, and cloud services.

Responsibilities

• Enhance performance and reliability of existing Data Platform Services.
• Design and develop scalable data platform and integration solutions.

Skills

Python

PySpark

Data Lakes

Data Warehouses

ANSI SQL

Spark SQL

Workflow automation

Agile methodologies

Data management

Education

Bachelor's degree in Computer Science or related field

Tools

Git

CI/CD

Databricks

Airflow

AWS

Jira

Confluence

Job description

Senior Data Engineer (Databricks Platform)

Senior Data Engineer (Databricks Platform)

Apply locations Work From Home - New York, Work From Home - Michigan, Work From Home - Massachusetts, Work From Home - California, Work From Home - Pennsylvania

time type Full time

posted on Posted 2 Days Ago

job requisition id JR-76006

Job Summary:

WHO ARE WE?

Live Nation Entertainment is the world’s leading live entertainment company, comprised of global market leaders: Ticketmaster, Live Nation Concerts, and Live Nation Media & Sponsorship.

WHO ARE YOU?

Passionate and motivated. Driven, with an entrepreneurial spirit. Resourceful, innovative, forward thinking and committed. At Live Nation Entertainment, our people embrace these qualities, so if this sounds like you then please read on!

THE TEAM

The Core Data Services team is at the center of Data and Analytics initiatives. We are building a modern data platform to support enterprise data needs.

THE ROLE

This is a hands-on Data Engineering role that will require strong Python/PySpark coding skills.

WHAT THIS ROLE WILL DO

• Contribute to the enhancements and continuous improvement of performance and reliability of the existing Data Platform Services to meet the requirements from Data Engineering/Product team.
• Design and build self-servicing onboarding and automation capabilities in Core Data Platform services in a scalable, reliable and secure way.
• Design and build platform capabilities to support onboarding and operation effectiveness.
• Design and develop scalable data platform and integration solutions for various data sources leveraging Databricks Unified Platform.
• Ensure data quality and integrity across all data systems.
• Ensure data security and compliance with relevant regulations.
• Implement best practices for data management and governance.
• Develop and maintain documentation for data systems and processes.
• Monitor and troubleshoot data platform issues.
• Participate in on-call rotations/Pagerduty for data platform support.

TECHNICAL SKILLS/COMPETENCIES

• Good understanding of Data Lakes and Data Warehouses is MUST to have.
• Software development, coding expertise in the Data engineering field using any of the Python/PySpark is MUST to have.
• Hands-on experience using version control systems such as Git and CI/CD workflows and practice.
• Design and Develop data ingestion services that are highly performant, reliable and scalable.
• Decent expertise using ANSI SQL and Spark SQL is key to have.
• Workflow automation, orchestration using Airflow or equivalent tools stack.
• Hands-on working knowledge on at least one of these: Databricks, Hadoop and related stacks.
• Working experience in at least one of cloud services from any of the Amazon AWS, Google GCP or Microsoft Azure, preferably AWS.
• Streaming (Kafka) and batch based data sources.
• Diverse data sources and data formats (xml, json, yaml, parquet, avro, delta) and respective use cases.
• Any visualization experience is an advantage.
• An excellent understanding of the nuances that add complexities around time zones, geo, various data formats, data types across different storage systems is nice to have.
• Agile development methodologies using the Atlassian suite: Jira, Confluence.
• Collaborate with cross-functional teams to deliver data solutions and provide technical support and guidance to team members.
• Stay up-to-date with the latest data engineering technologies and trends.

BENEFITS & PERKS

• HEALTH: Medical, Dental and Vision benefits for you and your family, including Flexible Spending Accounts (FSA) and Health Savings Accounts (HSAs).
• YOURSELF: Paid time off policy including holidays, sick time, and day off for your birthday, free concert tickets.
• WEALTH: 401(k) program with company match, Stock Program Reimbursement.
• FAMILY: New parent programs & support including caregiver leave and baby bonus, infertility support.
• CAREER: Tuition reimbursement, student loan repayment internal growth and development programs & trainings.
• OTHERS: Volunteer time off, crowdfunding network.

EQUAL EMPLOYMENT OPPORTUNITY

We are passionate and committed to our people and go beyond the rhetoric of diversity and inclusion.

HIRING PRACTICES

The preceding job description has been designed to indicate the general nature and level of work performed by employees within this classification. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities, and qualifications required of employees assigned to this job.

The expected compensation for this position is:

$128,000.00 USD - $160,000.00 USD

** Pay is based on a number of factors including market location, qualifications, skills, and experience.