Senior Data Software Engineer

EPAM Systems, Inc.; Brasil; Teletrabalho; BRL 180 000 - 240 000; Tempo integral

Resumo da oferta

EPAM Systems, Inc. is seeking a Senior Data Software Engineer to lead ETL/ELT pipelines, streaming systems and data services. You will partner with stakeholders and engineering teams to ensure scalable, reliable data delivery while guiding delivery decisions and maintaining code quality in an agile setup.

The role blends hands-on coding with leadership, requiring strong Python/SQL, Spark, Databricks and Kafka experience to drive architecture decisions and production readiness.

Qualificações

• 3+ years of experience in a data engineering or data software role.
• Strong Python and SQL fundamentals with data processing focus.
• Experience with Spark-based processing and data platforms.

Responsabilidades

• Build and sustain ETL/ELT pipelines and streaming systems.
• Set up data ingestion from diverse sources using Spark, Kafka or equivalent.
• Create data services with Spring Boot, ReactJS, NoSQL and API/UI tools.
• Oversee delivery governance and production workflows per delivery model.
• Be the primary delivery contact for leadership, escalations and ramp-downs.
• Guide technical decisions to keep architecture solid and scalable.
• Author user stories and acceptance criteria in Agile/scrum.
• Coordinate across disciplines to keep delivery moving forward.
• Implement continuous delivery risk management strategy.
• Support Data Engineers to ensure quality and on-time work.
• Manage production support and deployments.

Conhecimentos

Python

SQL

PySpark

Apache Spark

Databricks

Apache Kafka

Java

Scala

Agile/Scrum

English

Claude Code

Ferramentas

Databricks

Apache Kafka

Anthropic Claude Code

Descrição da oferta de emprego

We are seeking a Senior Data Software Engineer to join our team. This position combines direct technical involvement with leadership responsibilities, offering the chance to influence data architecture while overseeing delivery on intricate projects. You will work in close partnership with stakeholders and engineering teams to ensure solutions stay dependable and scalable over time. If you value blending hands-on technical work with accountability for delivery success, this role could be a strong fit for you.ResponsibilitiesBuild and sustain the codebase behind ETL and ELT pipelines, along with large batch, micro-batch, and streaming systemsEstablish the infrastructure required to pull, convert, and load data efficiently from a range of sources using ADF, Spark, Kafka, or equivalent toolsDetect, plan, and execute internal process enhancements, such as automating repetitive tasks, improving data delivery, and reshaping infrastructure for stronger scalabilityCreate and roll out data services solutions using technologies including Spring Boot, ReactJS, NoSQL, and related UI and API toolsOversee governance of delivery management and production workflows in accordance with the chosen delivery modelFunction as the key contact for delivery-related matters with senior leadership and stakeholders, covering escalations, upsells, and ramp-downsGuide technical decisions throughout delivery, ensuring the architecture stays solid and future-ready while implementation meets expected quality levelsAuthor user stories and their related acceptance criteria within an agile/scrum setupBring together efforts across different disciplines and stakeholders to keep delivery moving forwardConfirm that project delivery follows customer processes and methodologies, relying on strong familiarity with various delivery models and an agile-oriented approachPut together a continuous delivery risk management strategy that supports proactive decision-making across the delivery lifecycleTrack and boost delivery productivity as time goes onSupport Data Engineers as a technical resource, helping guarantee their work is completed with quality and on timeManage production support and deployment dutiesRequirementsAt least 3 years of experience in a comparable roleSolid proficiency in core Python for data engineering workCapable in SQL for querying and handling dataPractical experience with Apache Spark for large-scale data processingFamiliarity with Anthropic Claude CodeExperience leveraging Databricks for data engineering and analytics purposesExcellent English proficiency (B2 level or higher)Nice to haveExperience with Apache Kafka for streaming data eventsFamiliarity with the Java languagePractical experience with PySparkExposure to ScalaExperience with Spark StreamingWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.