Data Platform Engineer - Remote | Databricks Modernization

United States Digital Space LLC; United States; Remote; USD 138,000 - 184,000; Full time

Benefits offered by this job

Internet reimbursement

Mobile reimbursement

Professional development resources

33 days PTO + holidays

Volunteering days

Remote-first with flexible hours

Job summary

LivePerson, Inc. is seeking a Senior Software Engineer to join our Europe-based Data Platform team. You will modernize our core data platform by migrating pipelines from legacy ecosystems to a cloud-native Databricks architecture and guide AI-assisted migration strategies.

The role focuses on building scalable data workflows, ensuring data quality, and improving platform reliability while collaborating across time zones to deliver measurable business impact.

Qualifications

• 6–8 years of experience building and supporting distributed data platforms.
• Experience migrating legacy data platforms to cloud-based solutions like Databricks.
• Strong Databricks knowledge and data pipeline modernization skills.
• Proficiency in Python for ETL and Airflow workflow design.
• Experience with cloud platforms (GCP) and Kubernetes.
• Familiarity with AI-assisted development tools to accelerate migrations.

Responsibilities

• Lead the modernization of the data platform by migrating pipelines to Databricks.
• Drive AI-assisted migration to optimize code and architecture.
• Design, build, and optimize scalable data workflows with Airflow and Databricks.
• Champion data quality through validation and testing strategies.
• Improve platform reliability with observability, monitoring, and SLAs.
• Contribute to business insights via data-driven analytics.

Skills

Distributed systems

Platform modernization

Databricks

Python ETL

Airflow

Cloud (GCP)

Kubernetes (GKE)

AI-assisted development

Cross-timezone collaboration

Tools

Databricks

Airflow

Delta Lake

GKE

Hadoop/Spark/Hive/Impala

Job description

LivePerson, Inc. is seeking a Senior Software Engineer to join our Europe-based Data Platform team. You will modernize our core data platform by migrating pipelines from legacy ecosystems to a cloud-native Databricks architecture and guide AI-assisted migration strategies.

The role focuses on building scalable data workflows, ensuring data quality, and improving platform reliability while collaborating across time zones to deliver measurable business impact.