Senior Data Software Engineer/ AI Agents, Azure, Spark

EPAM Systems, Inc.; Turkey; On-site; TRY 420,000 - 660,000; Full time

Benefits offered by this job

Extra leave days

Private health insurance

Learning & development programs

Mentoring programs

Job summary

EPAM Systems, Inc. is seeking a Senior Data Software Engineer to lead design, development and optimization of scalable data pipelines on Azure using Spark-based processing (PySpark, SparkSQL, Scala).

You will own end-to-end data transformation pipelines and collaborate with data scientists and product stakeholders to drive data-driven insights. You will mentor engineers, set coding standards, and ensure data quality, security, governance and performance across platforms in complex enterprise

Qualifications

• 3+ years in data engineering, preferably in enterprise/financial services.

Responsibilities

• Lead design and optimization of scalable data pipelines on Azure with Spark-based processing.
• Own end-to-end data transformation pipelines: ingestion, transformation, storage, analytics.
• Collaborate with data scientists and product stakeholders to enable data-driven insights.
• Mentor junior engineers and contribute to coding standards.
• Ensure data quality, security, governance, and performance across platforms.

Skills

Azure

Spark ecosystem

PySpark

SparkSQL

Scala

Architecture design

Mentoring

Data governance

English communication

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Data Factory

Databricks

Synapse

Cosmos DB

Job description

We are looking for an experienced Senior Data Software Engineer with strong hands-on expertise in Azure and the Spark ecosystem, primarily focused on building and maintaining data transformation pipelines.The ideal candidate should be comfortable with any Spark-adjacent technology rather than being locked into one specific flavor. The candidate should also combine strong technical skills with leadership capability, contributing to architecture, design, development, and mentoring of engineering teams — preferably in complex enterprise or financial services environments.ResponsibilitiesLead the design, development, and optimization of scalable data engineering solutions on Azure, using Spark-based processing (PySpark, SparkSQL, Scala)Own end-to-end data transformation pipelines, including ingestion, transformation, storage, and analyticsWork with Azure-native data services such as Data Factory, Databricks, and SynapseSupport high-performance data access patterns using Cosmos DB (NoSQL API) when applicableCollaborate with data scientists, AI engineers, and product stakeholders to enable data-driven analytics and insightsMentor and guide junior engineers, setting coding standards and best practicesEnsure data quality, security, governance, and performance across platformsContribute to technical decision-making and solution architecture discussionsRequirements3+ years of experience in data engineering roles, preferably in complex enterprise or financial services environmentsExpertise in Azure and Azure-native data services (Data Factory, Databricks, Synapse)Proficiency in the Spark ecosystem, including PySpark, SparkSQL, and Scala SparkBackground in building and maintaining end-to-end data transformation pipelines covering ingestion, transformation, storage, and analyticsUnderstanding of data quality, security, governance, and performance best practicesCapability to contribute to architecture and solution design discussionsSkills in mentoring engineering teams and establishing coding standardsEnglish proficiency at an Upper-Intermediate level (B2) or higherNice to haveHands-on experience with Microsoft Fabric and OneLake (Delta / OpenLake)Familiarity with Cosmos DB (NoSQL API)Knowledge of financial instruments and financial services dataExposure to AI-assisted development tools (e.g., GitHub Copilot) and awareness of industry-standard LLMsData Science fundamentals and collaboration experience with DS teamsWe offerCONTINUOUS UPSKILLING, LEARNING & DEVELOPMENTDiversity of tasks and projectsAssessment center for objective review of competency levelPersonal development planMentoring programs and leadership developmentCertification and professional development supportAccess to learning platforms including more than 2,500 internal coursesEnglish courses taught by certified teachersCORPORATE BENEFITSExtra leave daysReferral bonusesCOMPENSATION PACKAGECompetitive compensation paid in USDRegular salary and performance reviewsMEDICAL & HEALTHCAREPrivate health insuranceWell-being eventsWORKING ENVIRONMENTRecreation areas and kitchensTea, coffee and snacksSports equipment and game consolesIT EquipmentMicrosoft’s Software Assurance Home Use Program (HUP)Please note that our Talent Attraction Team reviews applications and CVs submitted in English.EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.