Senior Data Software Engineer (Databricks)

EPAM Systems; Portugal; Presencial; EUR 60 000 - 90 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Competitive compensation

Flexible work hours

Career growth opportunities

Internal events

Resumo da oferta

EPAM Systems in Portugal is seeking a Senior Data Software Engineer skilled in Databricks to join our team. You will help design and build scalable data pipelines and architectures, driving innovation in our Data practice.

You'll work with Delta Lake, Spark and cloud-native technologies, participate in code reviews and ensure data quality. The role requires strong English communication and a proactive, collaborative mindset in a fast-moving startup environment.

Qualificações

• Solid Databricks experience with Delta Lake workflows.
• Strong knowledge of data architecture and modeling.
• Expertise in Spark with Scala or PySpark.
• Proficiency in cloud-native tech and engineering best practices.
• Experience with AWS/Azure/GCP.
• Experience with big data and performance optimization.
• Client-facing experience and ability to navigate ambiguity.
• Fluent English (B2+)

Responsabilidades

• Design, develop and maintain scalable data pipelines and architectures.
• Optimize data models and ETL with Databricks.
• Implement data quality checks and monitoring.
• Stay updated on data-engineering trends and tools.
• Troubleshoot data-related issues promptly.
• Participate in code reviews for quality

Conhecimentos

Databricks experience

Data modeling

Spark (PySpark/Scala)

Cloud-native technologies

Communication skills

Independence / initiative

Ferramentas

Databricks

Delta Lake

Delta Live Tables

Spark

PySpark

Scala

AWS

Azure

GCP

Containers

CI/CD

Descrição da oferta de emprego

We are seeking a Senior Data Software Engineer skilled in Databricks to join our team in Portugal.

You will be integral to our efforts, bringing a deep understanding of data engineering, expertise in Databricks and an open-minded approach to our collaborative and friendly work environment. This role is ideal for a professional eager to develop scalable data solutions and drive innovation in our Data practice.

Responsibilities

• Design, develop and maintain scalable data pipelines and architectures
• Optimize data models and enhance ETL processes utilizing Databricks and related technologies
• Implement rigorous data quality checks and monitoring to guarantee high integrity
• Keep abreast of the latest trends and technologies in data engineering and advocate for the adoption of beneficial new tools
• Troubleshoot and resolve data-related issues promptly
• Participate in code reviews ensuring adherence to high standards of code quality

Requirements

• Hands-on experience with Databricks, including Delta Lake workflows, Delta Live Tables, along with deployment and versioning strategies
• Solid understanding of data architecture and data modeling skills
• Expertise in Spark, using either Scala or PySpark
• Proficiency in cloud-native technologies and software engineering best practices such as containers, unit tests, linting and code style checks
• Engineering background in AWS, Azure or GCP
• Experience with big data and performance optimization of data-intensive applications
• Proactive approach and prior client-facing experience
• Ability to navigate ambiguity and work independently
• Desire to engage in a transparent, fast-moving startup environment
• Fluent English communication skills at a B2+ level or higher

We offer

• Competitive compensation depending on experience and skills
• Variety of projects within one company
• Being a part of a project following engineering excellence standards
• Individual career path and professional growth opportunities
• Internal events and communities
• Flexible work hours