Senior Data Software Engineer (Databricks)

EPAM Systems; Portugal; Presencial; EUR 65 000 - 90 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Flexible work hours

Career growth opportunities

Internal events

Resumo da oferta

EPAM Systems in Portugal is seeking a Senior Data Software Engineer with hands-on Databricks expertise to design and build scalable data pipelines and architectures.

You will optimize ETL processes, implement data quality checks and monitoring, and drive best practices in cloud-native data engineering across diverse projects while collaborating with client teams. Fluent English (B2+) and the ability to thrive in a fast-moving startup environment are highly valued.

Qualificações

• Hands-on experience with Databricks and Delta Lake workflows.
• Strong data architecture and data modeling skills.
• Expertise in Spark using Scala or PySpark.
• Experience with cloud-native tech and CI practices.
• Proactive, client-facing, and able to navigate ambiguity.

Responsabilidades

• Design, develop and maintain scalable data pipelines and architectures.
• Optimize data models and ETL processes with Databricks.
• Implement data quality checks and monitoring for high integrity.
• Keep up with trends and advocate new tools.
• Troubleshoot data-related issues promptly.
• Participate in code reviews to uphold coding standards.

Conhecimentos

Databricks & Delta Lake

Spark (Scala/PySpark)

Data modeling & architecture

Cloud platforms (AWS/Azure/GCP)

Containers & CI practices

Unit tests & code quality

Client-facing experience

English (B2+)

Proactive/independent work

Ferramentas

Delta Lake

Delta Live Tables

Descrição da oferta de emprego

We are seeking aSenior Data Software Engineer skilled in Databricks to join our team in Portugal.

Responsibilities

• Design, develop and maintain scalable data pipelines and architectures
• Optimize data models and enhance ETL processes utilizing Databricks and related technologies
• Implement rigorous data quality checks and monitoring to guarantee high integrity
• Keep abreast of the latest trends and technologies in data engineering and advocate for the adoption of beneficial new tools
• Troubleshoot and resolve data-related issues promptly
• Participate in code reviews ensuring adherence to high standards of code quality

Requirements

• Hands-on experience with Databricks, including Delta Lake workflows, Delta Live Tables, along with deployment and versioning strategies
• Solid understanding of data architecture and data modeling skills
• Expertise in Spark, using either Scala or PySpark
• Proficiency in cloud-native technologies and software engineering best practices such as containers, unit tests, linting and code style checks
• Engineering background in AWS, Azure or GCP
• Experience with big data and performance optimization of data-intensive applications
• Proactive approach and prior client-facing experience
• Ability to navigate ambiguity and work independently
• Desire to engage in a transparent, fast-moving startup environment
• Fluent English communication skills at a B2+ level or higher

We offer

• Competitive compensation depending on experience and skills
• Variety of projects within one company
• Being a part of a project following engineering excellence standards
• Individual career path and professional growth opportunities
• Internal events and communities
• Flexible work hours