Senior Data Engineer - Databricks Pipelines & Insights

EPAM Systems Inc; España; On-site; EUR 70,000 - 100,000; Full time

Job summary

EPAM Systems Inc in Malaga is seeking a Senior Data Software Engineer (Databricks) to design scalable data pipelines and empower actionable insights across business units.

You will collaborate with data engineers and software developers to build Python-based workflows in Databricks, monitor performance, and translate business needs into robust architectures that support decision making.

Qualifications

• Design scalable data pipelines across ingestion and transformation needs.
• Able to translate business needs into technical data solutions.
• Collaborate with software engineers and project managers to align work with timelines.

Responsibilities

• Architect and implement scalable data pipelines for diverse data needs.
• Collaborate with software engineering teams to integrate data workflows into systems.
• Engage with project managers to align pipeline development with timelines.
• Develop, test, and maintain Python-based data workflows in the Databricks platform.
• Monitor pipeline performance and troubleshoot data issues to ensure quality.
• Share data insights and status updates with stakeholders to inform decisions.
• Participate in planning to design future-proof data infrastructure and integration strategies.

Skills

Data pipeline design

Cross-functional collaboration

Data analysis

Tools

Databricks

Python

Job description

EPAM Systems Inc in Malaga is seeking a Senior Data Software Engineer (Databricks) to design scalable data pipelines and empower actionable insights across business units.

You will collaborate with data engineers and software developers to build Python-based workflows in Databricks, monitor performance, and translate business needs into robust architectures that support decision making.