Lead Data Software Engineer (Databricks)

buscojobs España; Guadalajara; Presencial; USD 40,000 - 70,000; Jornada completa

Descripción de la vacante

A leading digital transformation company is seeking a Lead Data Software Engineer with expertise in Databricks. This role involves leading a team to design and maintain data pipelines, ensuring data quality, and staying updated with emerging trends. The ideal candidate will have strong leadership skills and experience in cloud technologies. Join a collaborative and innovative environment with opportunities for continuous learning and career growth.

Servicios

Private health insurance

EPAM Employees Stock Purchase Plan

100% paid sick leave

Referral Program

Professional certification opportunities

Language courses

Formación

• Hands-on experience with Databricks and Delta Lake.
• Ability to lead a development team of 2-5 engineers.
• Fluent English communication skills at a B2+ level.

Responsabilidades

• Lead a small team to design and maintain scalable data pipelines.
• Develop and optimize data models and ETL processes.
• Implement data quality checks and monitoring.

Conocimientos

Data Engineering

Leadership

English

Proactivity

Herramientas

Databricks

Spark

AWS

Azure

GCP

Descripción del empleo

Lead Data Software Engineer (Databricks)

Join to apply for the Lead Data Software Engineer (Databricks) role at EPAM Systems .

We are seeking a Lead Data Software Engineer with expertise in Databricks and a collaborative personality. This role involves joining a friendly environment and contributing significantly to our team of experts.

Do you have extensive experience in Data Engineering and strong knowledge of Databricks? Are you an open-minded professional with good English skills? If so, this could be the perfect opportunity at EPAM.

Responsibilities

• Lead a small team of engineers to design, develop, and maintain scalable data pipelines and architectures.
• Develop and optimize data models and ETL processes using Databricks and other technologies.
• Implement data quality checks and monitoring to ensure high data integrity.
• Stay updated with emerging trends in data engineering and recommend new tools when beneficial.
• Troubleshoot and resolve data-related issues promptly.
• Participate in code reviews to maintain high standards of code quality.

Requirements

• Hands-on experience with Databricks, including Delta Lake, workflows, Delta Live Tables, deployment, and versioning.
• Ability to lead a development team of 2-5 engineers.
• Solid understanding of data architectures and data modeling; experienced in designing and building ETL pipelines with Databricks.
• Expertise in Spark using Scala or PySpark.
• Knowledge of SDLC and Agile frameworks.
• Proficiency in cloud-native technologies and software engineering best practices, including containers, unit tests, linting, and code style checks.
• Experience with AWS, Azure, or GCP.
• Experience with big data and performance optimization of data-intensive applications.
• Proactivity and client-facing experience.
• Ability to work independently and handle ambiguity.
• Desire to work in a transparent and fast-paced startup environment.
• Fluent English communication skills at a B2+ level.

We offer

• Private health insurance
• EPAM Employees Stock Purchase Plan
• 100% paid sick leave
• Referral Program
• Professional certification opportunities
• Language courses

EPAM is a leading digital transformation and product engineering company with over 52,650 employees across more than 55 countries. Since 1993, our multidisciplinary teams have been helping make the future real for clients and communities worldwide. Our Spain office, established in 2018, offers opportunities to collaborate with multinational teams and participate in innovative projects.

Why Join EPAM

• Work-life balance with flexible options, 24 days of annual leave, and paid holidays.
• Continuous learning culture with internal training, mentorship, certifications, and courses.
• Clear career paths in engineering or management, including roles like Solution Architect or Project / Delivery Manager.
• Join a global community of highly skilled experts for collaboration and knowledge sharing.
• Seniority level : Mid-Senior level
• Employment type : Full-time
• Job functions : IT, Engineering, Business Development
• Industries : Software Development, IT Services, and Consulting

J-18808-Ljbffr