Senior Databricks Data Engineer - Reliability

sglottery; Alpharetta (GA); On-site; USD 130,000 - 185,000; Full time

Job summary

Scientific Games is hiring a Senior Databricks Data Engineer focused on reliability. You will design and optimize production data products on the Databricks Lakehouse Platform running on AWS, with emphasis on monitoring, observability, and cost efficiency.

You will lead performance tuning of Spark workloads and mentor engineers on best practices. You will collaborate with Platform Engineering and Enterprise Architecture to ensure scalable, resilient data solutions and enterprise-wide data

Qualifications

• Bachelor's degree required in a relevant field.
• 6+ years of related experience, including 3+ years on Databricks.
• Experience designing and optimizing production data solutions.

Responsibilities

• Designs, develops, and optimizes production Data Products on the Databricks Lakehouse Platform on AWS.
• Implements monitoring, logging, metrics, dashboards and proactive alerts for reliability.
• Mentors engineers on Databricks development, observability, and performance optimization.
• Leads technical reviews and fosters production-readiness and cost-efficiency.

Skills

Databricks

Python/PySpark

SQL

Delta Lake

AWS

Spark

Observability

Production readiness

Mentoring

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline

Tools

Databricks

AWS

SQL tooling

Job description

Scientific Games: Scientific Games is the global leader in lottery games, sports betting and technology, and the partner of choice for government lotteries. From cutting-edge backend systems to exciting entertainment experiences and trailblazing retail and digital solutions, we elevate play every day. We push game designs to the next level and are pioneers in data analytics and iLottery. Built on a foundation of trusted partnerships, Scientific Games combines relentless innovation, legendary performance, and unwavering security to responsibly propel the global lottery industry ever forward.

Position Summary

Senior Databricks Data Engineer - Reliability: Designs, develops, and optimizes production Data Products on the Databricks Lakehouse Platform running on AWS, with reliability, observability, performance, scalability, and cost efficiency engineered directly into the solutions built. Engineers monitoring, logging, metrics, dashboards, and proactive alerting to improve diagnostics and production visibility. Identifies recurring reliability issues, performs root cause analysis for complex production issues, and automates recovery and operational activities where practical. Optimizes Spark workloads, Delta Lake, Databricks compute, SQL Warehouses, and storage, diagnosing performance bottlenecks and engineering sustainable improvements while continuously optimizing Databricks and AWS cost efficiency. Develops reusable observability and production-readiness patterns and recovery procedures, supporting appropriate resilience and business continuity requirements. Codes production-grade ETL/ELT and data-processing pipelines using Python/PySpark, SQL, Spark, and Delta Lake, following approved data models and Medallion Architecture patterns. Leads technical reviews and mentors engineers on Databricks development, observability, troubleshooting, and performance optimization. Note: May be internal or external-facing, working in conjunction with Platform Engineering, Governance Engineering, and enterprise architecture functions. May include enterprise-wide, AI-enabled data solutions.

Supervisory Responsibilities

This position has no supervisory responsibilities.

Job Level Description

Works on complex assignments that regularly require the application of independent judgment within approved architecture and engineering standards. Mentors less experienced engineers on Databricks development, observability, troubleshooting, and performance optimization. Participates in production-readiness, performance, and reliability engineering reviews. Able to anticipate and address production reliability, performance, and resilience risks before they reach production.

Qualifications

Education Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline required.

Years of Related Experience 6+ years of related experience, including 3+ years of hands-on Databricks experience developing and supporting production data solutions.

Physical Requirements The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. While performing the duties of this job, the employee is regularly required to sit, stand, walk, bend, use hands, operate a computer, and have specific vision abilities to include close and distance vision, and ability to adjust focus working with computer and business equipment.

Work Conditions Scientific Games, LLC and its affiliates (collectively, "SG") are engaged in highly regulated gaming and lottery businesses. As a result, certain SG employees may, among other things, be required to obtain a gaming or other license(s), undergo background investigations or security checks, or meet certain standards dictated by law, regulation or contracts. In order to ensure SG complies with its regulatory and contractual commitments, as a condition to hiring and continuing to employ its employees, SG requires all of its employees to meet those requirements that are necessary to fulfill their individual roles. As a prerequisite to employment with SG (to the extent permitted by law), you shall be asked to consent to SG conducting a due diligence/background investigation on you.

SG is an Equal Opportunity Employer and does not discriminate against applicants due to race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class. If you'd like more information about your equal employment opportunity