Senior Databricks Data Engineer - Reliability

Scientific Games, LLC; Alpharetta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

Scientific Games, LLC is seeking a Senior Databricks Data Engineer to design and optimize production data products on the Databricks Lakehouse Platform on AWS. You will implement observability, dashboards, and proactive alerting to improve diagnostics and production visibility, while reducing costs and increasing reliability.

You will lead and mentor engineers on Databricks development, troubleshooting, and performance optimization, with enterprise-scale, AI-enabled data solutions often in scope.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline required.
• 6+ years of related experience, including 3+ years of hands-on Databricks experience developing and supporting production data solutions.

Responsibilities

• Design, develop, and optimize production Data Products on the Databricks Lakehouse Platform on AWS.
• Implement monitoring, logging, metrics, dashboards, and proactive alerting for production visibility.
• Identify reliability issues, perform root cause analysis, and automate recovery and operational activities.

Skills

Python

SQL

Monitoring/Observability

Data Engineering

Education

Bachelor's degree in Computer Science or related

Tools

Databricks

Delta Lake

Spark

AWS

Job description

Position Summary

Job Description Senior Databricks Data Engineer - Reliability: Designs, develops, and optimizes production Data Products on the Databricks Lakehouse Platform running on AWS, with reliability, observability, performance, scalability, and cost efficiency engineered directly into the solutions built. Engineers monitoring, logging, metrics, dashboards, and proactive alerting to improve diagnostics and production visibility. Identifies recurring reliability issues, performs root cause analysis for complex production issues, and automates recovery and operational activities where practical. Optimizes Spark workloads, Delta Lake, Databricks compute, SQL Warehouses, and storage, diagnosing performance bottlenecks and engineering sustainable improvements while continuously optimizing Databricks and AWS cost efficiency. Develops reusable observability and production-readiness patterns and recovery procedures, supporting appropriate resilience and business continuity requirements. Codes production-grade ETL/ELT and data-processing pipelines using Python/PySpark, SQL, Spark, and Delta Lake, following approved data models and Medallion Architecture patterns. Leads technical reviews and mentors engineers on Databricks development, observability, troubleshooting, and performance optimization. Note: May be internal or external-facing, working in conjunction with Platform Engineering, Governance Engineering, and enterprise architecture functions. May include enterprise-wide, AI-enabled data solutions.

Supervisory Responsibilities

This position has no supervisory responsibilities.

Job Level Description

Works on complex assignments that regularly require the application of independent judgment within approved architecture and engineering standards. Mentors less experienced engineers on Databricks development, observability, troubleshooting, and performance optimization. Participates in production-readiness, performance, and reliability engineering reviews. Able to anticipate and address production reliability, performance, and resilience risks before they reach production.

Qualifications

Education Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline required.

Years of Related Experience

6+ years of related experience, including 3+ years of hands-on Databricks experience developing and supporting production data solutions.

Physical Requirements

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. While performing the duties of this job, the employee is regularly required to sit, stand, walk, bend, use hands, operate a computer, and have specific vision abilities to include close and distance vision, and ability to adjust focus working with computer and business equipment.

Work Conditions

Scientific Games, LLC and its affiliates (collectively, "SG") are engaged in highly regulated gaming and lottery businesses. As a result, certain SG employees may, among other things, be required to obtain a gaming or other license(s), undergo background investigations or security checks, or meet certain standards dictated by law, regulation or contracts. In order to ensure SG complies with its regulatory and contractual commitments, as a condition to hiring and continuing to employ its employees, SG requires all of its employees to meet those requirements that are necessary to fulfill their individual roles. As a prerequisite to employment with SG (to the extent permitted by law), you shall be asked to consent to SG conducting a due diligence/background investigation on you. This job description should not be interpreted as all-inclusive; it is intended to identify major responsibilities and requirements of the job. The employee in this position may be requested to perform other job-related tasks and responsibilities than those stated above.

SG is an Equal Opportunity Employer and does not discriminate against applicants due to race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class.

Relentless innovation. Legendary performance. And unwavering security. All built on a foundation of trusted partnerships. This is what it takes to be a global leader in lottery games, sports betting and technology. And to propel the industry ever forward. At Scientific Games, we elevate play every day. From cutting-edge backend systems to exciting entertainment experiences and trailblazing retail and digital solutions, we care about the details that drive profits for lottery beneficiary programs. We know what people like to play today. And with the power of data analytics, we can predict what they'll want to play tomorrow. We're always thinking about the player experience. Because it's not just a game. It's an instant of optimistic fun. But the best part? We're just getting started. iLottery and sports betting are the new frontier in play. And Scientific Games is the partner of choice for these growing markets. Because when it comes to digital, trust is everything. The lottery experience is always one of excitement. But we're endlessly innovating, always evolving and firmly committed to responsible gaming. So that the future of lottery funding shines bright. It's a future of stability and inspiration. The strength of security paired with the thrill of the new. It's the future of Scientific Games. The driver of today's favorite lottery games and most advanced technologies, and sustainability for tomorrow. And it all starts now.