Senior Software Engineer, Data & Platform Services

Devconnectplatform; Berlin; Híbrido; EUR 90.000 - 130.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Deferred pension scheme

ESP P and annual bonus

Internet reimbursement

Mobile reimbursement

33 days paid time off

Descripción de la vacante

LivePerson is seeking a Senior Software Engineer to join its Data Platform team in Europe. You will lead the modernization of our data platform by migrating pipelines from Hadoop/Spark/Impala to a scalable Databricks architecture, and drive AI-assisted engineering to accelerate migrations.

You will design scalable data workflows with Airflow and Databricks, ensure data quality and reliability, and contribute to customer analytics platforms powering conversational AI at scale.

Formación

• 6–8 years of experience building and supporting distributed data platforms.
• Hands-on with migrating legacy Hadoop/Spark/Impala to cloud-native Databricks.
• Deep Databricks expertise: Jobs, Delta Lake, clustering, SQL migrations.

Responsabilidades

• Lead modernization of the data platform by migrating pipelines to Databricks.
• Design, develop, and optimize scalable data workflows with Airflow and Databricks.
• Validate architecture, performance, and quality of migrated data.
• Improve observability, monitoring, and incident response practices.
• Collaborate with teams across time zones to deliver measurable outcomes.
• Apply data analytics to enhance contact center insights and BI.

Conocimientos

Distributed systems

Python

SQL

Airflow

Databricks

Kubernetes

Java/Scala

Cloud computing

Herramientas

Databricks

Airflow

Kubernetes

GKE

GCS

Descripción del empleo

## DescriptionLocation: Berlin, Germany Remote Status: Fully Remote (#LI-Remote)LivePerson (NASDAQ: LPSN) is a leader in trusted enterprise conversational AI and digital transformation. The world's leading brands use our award-winning Conversational Cloud platform to connect with millions of consumers. We power nearly a billion conversational interactions every month, providing uniquely rich data analytics and safety tools to unlock the power of conversational AI for better business outcomes. Fast Company named LivePerson the #1 Most Innovative AI Company in the world.Position OverviewWe're looking for a Senior Software Engineer to join our globally distributed Data Platform team in Europe and play a key role in shaping the future of our data ecosystem.In this high-impact individual contributor role, you'll lead the modernization of our core data platform by migrating mission-critical data pipelines from legacy Hadoop, Spark, and Impala environments to a scalable, cloud-native Databricks architecture. You'll have the opportunity to drive technical decisions, influence platform architecture, and build the foundation that powers data across the business.If you're a hands-on engineer who enjoys solving complex technical challenges, building modern data platforms, and making a lasting impact at scale, we'd love to hear from you!You Will: Key Responsibilities & Impact-Lead the Modernization of Our Data Platform: Take ownership of migrating mission-critical data pipelines from legacy Hadoop, Spark, and Impala environments to a modern, scalable Databricks ecosystem. You'll re-architect ETL workflows, convert complex SQL, and seamlessly migrate integrations, connections, and secrets.-Accelerate Development with AI-Powered Engineering: Leverage cutting-edge AI coding assistants such as Claude and Codex to dramatically accelerate migration efforts. Rather than manually rewriting legacy code, you'll guide AI tools to convert SQL, modernize ETL scripts, untangle dependencies, and generate clean, maintainable code—while applying your engineering expertise to validate architecture, performance, and quality.-Build the Next Generation of Data Pipelines: Design, develop, and optimize scalable data workflows using Airflow and Databricks. You'll create resilient, high-performance pipelines that are reliable, cost-efficient, and built to support growing business needs.-Champion Data Quality: Ensure the accuracy and consistency of migrated data by implementing comprehensive validation and testing strategies. You'll play a critical role in maintaining data integrity throughout the migration journey.-Improve Platform Reliability: Help drive operational excellence by enhancing observability, monitoring, and incident response practices. Contribute to service reliability through SLOs/SLAs and participate in a scalable on-call rotation to support production systems.-Deliver Meaningful Business Impact: Apply your understanding of contact center analytics to build platforms that power customer conversation insights, reporting, and business intelligence. You'll embrace a data-driven mindset, designing systems that are measurable, observable, and continuously improving.You Have: Required Skills & Qualifications-Extensive Software Engineering Experience: 6–8 years of experience building and supporting distributed systems and large-scale data platforms, with a proven ability to own complex technical initiatives from design through production.-Proven Platform Modernization Experience: Hands-on experience leading or playing a key role in migrating enterprise data platforms from legacy technologies—such as Hadoop, Spark, Hive, or Impala—to modern cloud-based solutions like Databricks.-Deep Databricks Expertise: Strong knowledge of the Databricks ecosystem, including Jobs, Delta Lake, cluster configuration and optimization, and migrating complex SQL workloads from Impala or Hive to Spark SQL.-Data Pipeline & Orchestration Skills: Advanced Python programming skills for ETL development and extensive experience designing, building, debugging, and optimizing production data pipelines and orchestration workflows using Airflow and Databricks.-Cloud & Infrastructure Knowledge: Experience working with cloud-native data platforms, particularly Google Cloud Platform (GCP) and Google Cloud Storage (GCS), with an understanding of containerized, Kubernetes-based (GKE) microservice architectures.- Modern Data Platform Expertise:-Strong understanding of distributed data processing architectures and the trade-offs between real-time and batch data processing.-Hands-on experience with legacy big data technologies, including Hadoop and MapReduce, with the ability to modernize and migrate complex data ecosystems.-Knowledge of data integration patterns, including APIs, connectors, webhooks, and event-driven architectures.- Cloud & Platform Engineering:-Experience building, deploying, and managing cloud-native data platforms, with Google Cloud Platform (GCP) experience preferred.-Familiarity with containerized environments and running data workloads on Kubernetes.-A strong focus on building highly reliable, scalable, and observable platforms, with experience implementing monitoring, validation, and data quality controls to ensure successful migrations.- AI-Assisted Software Development:-Experience using AI-powered development tools such as Claude, Codex, or similar coding assistants to accelerate software development, code modernization, and platform migrations.-Skilled at effectively prompting, reviewing, and validating AI-generated code while ensuring architectural integrity, maintainability, and production readiness.- Collaboration & Communication:-Excellent communication and collaboration skills, with experience partnering across engineering teams in multiple time zones.-Comfortable working in a globally distributed environment with colleagues across the US, Europe, Israel, and India.Nice to Have:-Experience working with conversational AI, contact center platforms, or customer engagement technologies.-Proficiency in Java or Scala, particularly when analyzing, maintaining, or modernizing legacy codebases during platform migrations.-Experience designing, implementing, and maintaining CI/CD pipelines to support automated testing, deployment, and reliable software delivery.Our Benefits & PerksWe are committed to supporting the complete well-being, health, financial security, family, and professional growth of our permanent employees.Financial Security & Growth- Additional Pension scheme: deferred pension scheme (LivePerson contributes 20%), ESPP and annual bonus depending on achievements- Equipment: Internet and Mobile reimbursement- Development: Access to internal professional development resources. Time Away & Family Support- Flexible Paid Time Off (PTO): Personal time off 33 days , vacation (28 days) and care days (5)- Paid Public Holidays.Volunteering Days: Use them to make a difference in your community. Whether it's a cleanup, supporting a local initiative or holding an “Ehrenamt”, just let us know! We're here to help you create a meaningful impact.Workplace Flexibility- Remote-First Model: Be flexible, work flexibly and from anywhere - no defined working hours or boundaries with offices in Mannheim and Berlin- Monthly Connection: Join our monthly connection pizza day in the office!Why You’ll Love Working HereAs leaders in enterprise customer conversations, we celebrate diversity, empowering our team to forge impactful conversations globally. LivePerson is a place where uniqueness is embraced, growth is constant, and everyone is empowered to create their own success. We're very proud to have earned recognition from Fast Company, Newsweek, and BuiltIn for being a top innovative, beloved, and remote-friendly workplace, and recognized by Gartner as a leader in the Conversational AI space.