Senior Data Software Engineer

EPAM Systems, Inc.; United States; Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Healthcare benefits

Paid time off

LinkedIn Learning access

Global career opportunities

Job summary

EPAM Systems, Inc. is seeking a Senior Data Software Engineer in the United States to blend hands-on data engineering with leadership responsibilities. You will influence data architecture and oversee delivery on complex projects while partnering with stakeholders and engineering teams.

The role requires deep experience with ETL/ELT pipelines, Spark, Kafka, Databricks, and cloud data services. You will guide technical decisions, write user stories, and ensure scalable, reliable data solutions

Qualifications

• Strong Python data engineering experience.
• Proficient SQL for data querying.
• Hands-on Spark and Databricks development.
• Experience with Kafka streaming and NoSQL databases.

Responsibilities

• Build and maintain ETL/ELT pipelines and streaming systems.
• Lead delivery and coordinate with stakeholders in an agile setup.
• Define scalable data architectures and governance.
• Mentor Data Engineers and ensure timely delivery.
• Collaborate across teams to ensure quality and reliability.

Skills

Python

SQL

Apache Spark

Databricks

Java

PySpark

Kafka

NoSQL

Tools

Azure Data Factory

Kafka ecosystem

NoSQL databases

ReactJS

Job description

We are seeking a Senior Data Software Engineer to join our team. This position combines direct technical involvement with leadership responsibilities, offering the chance to influence data architecture while overseeing delivery on intricate projects. You will work in close partnership with stakeholders and engineering teams to ensure solutions stay dependable and scalable over time. If you value blending hands-on technical work with accountability for delivery success, this role could be a strong fit for you.ResponsibilitiesBuild and sustain the codebase behind ETL and ELT pipelines, along with large batch, micro-batch, and streaming systemsEstablish the infrastructure required to pull, convert, and load data efficiently from a range of sources using ADF, Spark, Kafka, or equivalent toolsDetect, plan, and execute internal process enhancements, such as automating repetitive tasks, improving data delivery, and reshaping infrastructure for stronger scalabilityCreate and roll out data services solutions using technologies including Spring Boot, ReactJS, NoSQL, and related UI and API toolsOversee governance of delivery management and production workflows in accordance with the chosen delivery modelFunction as the key contact for delivery-related matters with senior leadership and stakeholders, covering escalations, upsells, and ramp-downsGuide technical decisions throughout delivery, ensuring the architecture stays solid and future-ready while implementation meets expected quality levelsAuthor user stories and their related acceptance criteria within an agile/scrum setupBring together efforts across different disciplines and stakeholders to keep delivery moving forwardConfirm that project delivery follows customer processes and methodologies, relying on strong familiarity with various delivery models and an agile-oriented approachPut together a continuous delivery risk management strategy that supports proactive decision-making across the delivery lifecycleTrack and boost delivery productivity as time goes onSupport Data Engineers as a technical resource, helping guarantee their work is completed with quality and on timeManage production support and deployment dutiesRequirementsAt least 3 years of experience in a comparable roleSolid proficiency in core Python for data engineering workCapable in SQL for querying and handling dataPractical experience with Apache Spark for large-scale data processingFamiliarity with Anthropic Claude CodeExperience leveraging Databricks for data engineering and analytics purposesExcellent English proficiency (B2 level or higher)Nice to haveExperience with Apache Kafka for streaming data eventsFamiliarity with the Java languagePractical experience with PySparkExposure to ScalaExperience with Spark StreamingWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedIn