Senior Data Quality Engineer - Labor Management Forecasting

Publix Super Markets; Lakeland (FL); Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Employee stock ownership plan

401(k) retirement savings plan

Group health, dental and vision plans

Paid Time Off

Tuition reimbursement

Job summary

Publix Super Markets, Inc. is seeking a senior data platform engineer to design and deliver scalable data pipelines, migrating data from on-prem SQL Server to Azure Data Lake using standardized patterns.

You will own data processing validation, build reusable transformation frameworks, and help govern data across the lakehouse. You will work with Databricks, Python, SQL, and Azure services to support AI initiatives, reporting, and analytics for multiple business areas in a hybrid Lakeland, FL

Qualifications

• Bachelor’s degree in management information systems, Computer Science, Business, or other analytical disciplines or equivalent experience.

Responsibilities

• Design and implement secure, scalable data ingestion frameworks to migrate data to Azure Data Lake.

Skills

Databricks (Python)

SQL

Python development

Azure cloud

Data pipelines

Data governance

Education

Bachelors degree in MIS/CS/Business

Tools

Azure DevOps

Azure SQL

Snowflake DB

Unity Catalog

Job description

Publix Super Markets, Inc., the largest employee-owned company in the U.S., is driven by a dynamic technology team of 2,300+ professionals delivering innovative solutions to 1,400+ stores and 260,000+ associates across 8 states. From IT security and platform engineering to architecture, software development, and infrastructure, we offer career opportunities at every level - internships through technical leadership. Join a company consistently ranked among Fortune’s “100 Best Companies to Work For” and help us build more than great subs - build the future of technology at Publix.

Become part of the Labor Management team, designing, building, and delivering a robust application that supports Publix business areas in managing labor activities such as forecasting, time attendance and scheduling. In this role, you will own data processing validation and transformation, build and maintain scalable data pipelines, and manage Azure and on-prem data services.

Location: Hybrid (Lakeland, FL)

To support our hybrid work model, candidates must reside, or be willing to relocate, within a commutable distance of Lakeland, FL.

Work Model

Enjoy the best of both worlds - collaborate in person and innovate remotely.

Interview Process

Candidates selected to advance in the interview process will be required to participate in at least one onsite interview at our Lakeland, FL campus.

Why Join Us?

• Hybrid Flexibility: Work remotely when you need focus time and join us onsite for high-impact collaboration and brainstorming sessions.
• Operational Efficiency: Ensure technology solutions support efficient workflows and enable automation to improve operational effectiveness.
• Cutting-Edge AI Projects: Drive innovation in AI platforms, integrating advanced tools and frameworks to solve complex business challenges.
• Empowered Culture: We value autonomy, creativity, and continuous learning - your ideas shape the future of technology in our organization.

Your Impact

• Design and implement secure, scalable ingestion frameworks to migrate data from on prem SQL Server databases into Azure Data Lake using standardized patterns
• Develop and maintain reusable transformation frameworks (e.g., medallion architecture: bronze/silver/gold) to standardize data modeling, improve data reliability, and accelerate downstream analytics and reporting
• Establish data governance, security, and compliance controls across the lakehouse, including data classification, access controls, lineage, and auditing to ensure enterprise and regulatory standards are met
• Design, implement, and monitor data quality events to detect, alert, and resolve data anomalies across pipelines and platforms
• Provide hands-on development, deployment, maintenance, and optimization of data pipelines and workflows using Databricks.
• Collaborate with technical teams and other cross-functional stakeholders to understand requirements, design solutions, and implement them using Databricks' platform.
• Optimize and tune Databricks jobs for performance and scalability.
• Assist technical team through problem determination and resolution on highly complex problems.
• Maintain strong analytical, planning, problem solving, writing, and presentation skills.

Required Qualifications

• Bachelor’s degree in management information systems, Computer Science, Business, or other analytical disciplines or equivalent experience
• 5+ years of experience in application design, development, and delivery in an enterprise environment
• 5+ years of experience developing large-scale data manipulation processes.
• 5+ years of experience working with relational databases.
• 5+ years of experience implementing large scale enterprise applications.
• 5+ years of experience in analyzing complex, enterprise business problems or processes and translating business requirements into technology solutions that factor in system performance, usability, quality, cross-system interdependencies, scalability, and total cost of ownership.
• 2+ years of experience utilizing Databricks for Python
• Proficient in writing complex queries using an ANSI-compliant SQL language against an enterprise relational database management system.
• Experience planning and managing all activities associated with delivering solutions in a large-scale distributed environment.

Preferred Qualifications

• 7+ years of experience in application design, development, and delivery in an enterprise environment
• 7+ years of experience developing large-scale data manipulation processes.
• 7+ years of experience working with relational databases.
• 7+ years of experience implementing large scale enterprise applications.
• 7+ years of experience in analyzing complex, enterprise business problems or processes and translating business requirements into technology solutions that factor in system performance, usability, quality, cross-system interdependencies, scalability, and total cost of ownership.
• Experience in implementing enterprise applications using platform services like azure App service, Azure SQL, Azure Service Bus, notification hubs, event hubs, Microservices, stream analytics, Snowflake DB, Redis Cache, OpenAPI, IoT Hub, application insights, etc.
• Experience with Azure DevOps for managing project tasks, managing code repositories, and creating yaml pipelines for CI/CD builds and deployments.
• Azure AZ-305 certification or equivalent experience in designing/architecting Azure solutions
• Experience with C# and/or Python development
• Experience with Unity Catalog, Data/Delta Lake
• Experience with advanced ML specializations (AutoML, forecasting, ensemble methods)

Benefits Information

• Employee stock ownership plan that contributes Publix stock to associates each year at no cost
• An opportunity to purchase additional shares of our privately-held stock
• 401(k) retirement savings plan
• Group health, dental and vision plans
• Paid Time Off
• Paid Parental Leave
• Short- and long-term disability insurance
• Tuition reimbursement
• Free hot lunches (buffet-style) at facilities with a cafeteria
• Visit our website to see all of our benefits: Benefits - Jobs (publix.com)

Year End Bonus

As a year-end bonus to associates, Publix issues one month’s extra pay (pro-rated in the first year) each year if associate remains employed through issue date of the bonus check that year. This is calculated as a 13th month of pay in the Potential Annual Pay with Bonus line above.

Additional Information

Your application may have additional steps that you will need to complete in order to remain eligible for consideration. Please be sure to monitor your email, including your spam folder, on a daily basis for critical, time-sensitive emails that could require action within 24-48 hours. Please do not use your Publix email address when applying. Once your application has been successfully submitted you will receive a confirmation email.

***Relocation/Household Good Shipment Allowance will NOT be provided.***