Lead Data Software Engineer

EPAM Systems, Inc.; Brasil; Teletrabalho; BRL 300 000 - 460 000; Tempo integral

Resumo da oferta

EPAM Systems, Inc. is seeking a Lead Data Software Engineer in Brazil to drive data pipelines, scale batch/streaming systems, and shape data architecture. You will blend hands-on coding with leadership, coordinating with stakeholders and engineering teams to ensure reliable, scalable solutions.

The role requires 5+ years in data roles, 1+ year leading teams, strong Python and SQL, and Spark/Databricks experience. English proficiency is essential for global collaboration.

Qualificações

• Minimum of 5 years in a similar data engineering/lead role.
• At least 1 year leading and managing teams.
• Strong Python for data engineering; solid SQL skills.
• Hands-on Apache Spark experience for large-scale processing.
• Experience with Databricks; familiar with Kafka and streaming data.
• Excellent English proficiency (B2+).

Responsabilidades

• Lead development of ETL/ELT pipelines and data platforms.
• Guide architecture decisions ensuring reliability and scalability.
• Write user stories and acceptance criteria in agile processes.
• Coordinate cross-team delivery with stakeholders and leadership.
• Oversee production support and ensure timely delivery.

Conhecimentos

Python

SQL

Apache Spark

Databricks

Java

Scala

Spark Streaming

PySpark

Team leadership

English communication

Ferramentas

ADF (Azure Data Factory)

Kafka

Spring Boot

ReactJS

NoSQL

Databricks

Descrição da oferta de emprego

We are looking for a Lead Data Software Engineer to join our company. This position brings together hands-on technical work and leadership responsibility, offering the chance to shape data architecture while driving delivery on critical projects. You will work closely with stakeholders and engineering teams to make sure solutions stay reliable and scalable as demands evolve. If you enjoy pairing hands-on technical involvement with accountability for delivery success, this role could be a strong fit for you.ResponsibilitiesDevelop and preserve the codebase supporting ETL and ELT pipelines, together with large batch, micro-batch, and streaming systemsSet up the infrastructure required to pull, transform, and load data efficiently from a variety of sources using ADF, Spark, Kafka, or comparable technologiesIdentify, plan, and roll out internal process improvements, such as automating manual tasks, improving data delivery, and modifying infrastructure to increase scalabilityArchitect and release data services solutions using technologies such as Spring Boot, ReactJS, NoSQL, and other related UI and API toolsMaintain governance across delivery management and production processes, aligned with the chosen delivery modelAct as the key contact for delivery-related matters with senior leadership and stakeholders, covering escalations, upsells, and ramp-downsProvide technical direction throughout the delivery process, keeping the architecture solid and forward-thinking while ensuring implementation meets quality expectationsWrite user stories and their corresponding acceptance criteria as part of an agile/scrum processCoordinate work across multiple disciplines and stakeholders to keep delivery progressingEnsure project delivery aligns with customer processes and methodologies, applying strong knowledge of different delivery models with an agile-focused approachEstablish a continuous delivery risk management framework that enables proactive decision-making throughout the delivery lifecycleMonitor and enhance delivery productivity over timeServe as a technical resource for Data Engineers, helping ensure their work meets quality and timeliness standardsOversee production support and deployment responsibilitiesRequirementsA minimum of 5 years of experience in a similar positionAt least one year of experience leading and managing teamsSolid command of core Python for data engineering purposesProficient in SQL for querying and processing dataHands-on experience with Apache Spark for large-scale data processingFamiliarity with Anthropic Claude CodeExperience using Databricks for data engineering and analytics tasksExcellent English proficiency (B2 level or higher)Nice to haveExperience with Apache Kafka for managing streaming dataWorking knowledge of JavaHands-on experience with PySparkFamiliarity with ScalaExperience with Spark StreamingWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.