Databricks Data Engineer - Lakehouse Specialist

OhioX; Columbus (OH); Hybrid; USD 118,000 - 222,000; Full time

Benefits offered by this job

Medical/Dental/Vision

Retirement plan

Paid time off

Job summary

Nationwide is seeking a Consultant, Data Engineer to join the Altoids line in the Enterprise Data Office. You will design and implement Databricks and Delta Lake data pipelines, develop Python/SQL transformations, and contribute to scalable lakehouse patterns supporting ITDM modernization.

You will partner with engineers, product managers, and stakeholders to translate needs into sprint-ready technical solutions, troubleshoot data issues, and build reusable engineering patterns.

Qualifications

• 3+ years hands-on Databricks, Delta Lake, Python, and SQL experience.
• Experience building enterprise data pipelines and lakehouse/data platform solutions.
• Understanding data quality, modeling, performance optimization, and production operations.
• Ability to communicate clearly and collaborate in Agile teams.

Responsibilities

• Consults on complex data product projects by analyzing requirements and business processes to lead design and implementation of data products.
• Produce data building blocks, data models, and data flows for reporting, dashboards, and data science.
• Translate business data needs into technical stories and sprint estimates.
• Apply secure software engineering practices throughout the delivery lifecycle.
• Create user access methods to structured and unstructured data and ensure data validation.
• Build data cleansing, imputation, and standardization routines across source systems.
• Facilitate data processing using Azure and AWS big data technologies.
• Collaborate with DevSecOps and internal teams on CI/CD best practices.
• Implement production processes to monitor data quality and availability.
• Develop scalable pipelines for streaming and batch data and API integrations.
• Write data unit/integration tests and reusable testing data.
• Practice Git-based code management and participate in team tasks.

Skills

Databricks Delta Lake Python SQL

Enterprise data pipelines

Data quality modeling

Agile collaboration

Education

Undergraduate studies in CS or related field

Tools

Azure

AWS

Redshift

S3

EC2

Jira

Jenkins

Confluence

Job description

Nationwide is seeking a Consultant, Data Engineer to join the Altoids line in the Enterprise Data Office. You will design and implement Databricks and Delta Lake data pipelines, develop Python/SQL transformations, and contribute to scalable lakehouse patterns supporting ITDM modernization.

You will partner with engineers, product managers, and stakeholders to translate needs into sprint-ready technical solutions, troubleshoot data issues, and build reusable engineering patterns.