Senior Data Software Engineer with Databricks

EPAM Systems Inc; United States; On-site; USD 120,000 - 190,000; Full time

Job summary

EPAM Systems is seeking a Senior Data Software Engineer with a DevOps focus to join our developer team as the first line of defense, handling tickets, root cause analysis, and providing efficient fixes at 1st level support. You will build data pipelines, enhance data processing engines, and develop AI tools, collaborating with diverse stakeholders across data management, marketing, and sales operations.

The role requires strong SQL, experience with Databricks, and knowledge of SAFe or agile

Qualifications

• 3+ years of experience with Databricks.
• Proficiency in SQL.
• Skills in Python, Java, Scala, Spark (PySpark), or JavaScript.
• Experience with REST APIs, SFTP servers, and SDKs.
• Understanding of CI/CD concepts.
• Understanding of Data lakes/lakehouses concepts.
• Knowledge of SAFe or other agile methodologies.
• Proficiency in English at a B2+ level.
• Nice to have SAP-related tools and platforms.

Responsibilities

• Build data pipelines to ingest data from 20+ sources.
• Improve internal data processing engines with cleanup, normalization, quality control, matching, and merging with performance focus.
• Build and manage data-related simple full stack applications.
• Build and manage data-related AI tools and solutions.
• Deliver requirements from stakeholders across data management, marketing, and sales operations.
• Comply with corporate and unit strategies in technical decisions.
• Deal with REST APIs, SFTP servers, and SDKs.

Skills

Databricks

SQL

Python

Java

Scala

Spark

PySpark

JavaScript

REST APIs

CI/CD

Data lakes

SAFe

English (B2+)

SAP HANA

SAP BTP

Cloud Foundry

SAP Datasphere

SAP Crystal Reports

SAP HANA Cloud

Tools

SAP HANA

SAP BTP

Cloud Foundry

SAP Datasphere

SAP Crystal Reports

SAP HANA Cloud

Job description

We are looking for a Senior Data Software Engineer with a focus on DevOps to join our developer team as the first line of defense, checking tickets, conducting root cause analysis, and providing efficient fixes at the 1st level support stage.

Responsibilities

• Build data pipelines to ingest data coming from more than 20 different data sources
• Improve internal data processing engines, including clean-up, normalization, quality control, matching, and merging, with a strong performance component
• Build and manage data-related simple full stack applications
• Build and manage data-related AI tools and solutions
• Deliver on requirements coming from a large spectrum of stakeholders, from data management experts to marketing and sales operatives on the ground
• Comply with corporate and unit strategies when it comes to technical decisions
• Deal with REST APIs, SFTP servers, and SDKs

Requirements

• 3+ years of experience with Databricks
• Proficiency in SQL
• Skills in at least one of the following: Python, Java, Scala, Spark (PySpark), JavaScript
• Experience dealing with REST APIs, SFTP servers, and SDKs
• Understanding of CI/CD concepts
• Understanding of Data lakes/lakehouses concepts
• Knowledge of SAFe or other agile methodologies
• Proficiency in English at a B2+ level
• Nice to have Experience with SAP HANA, SAP BTP, Cloud Foundry, SAP Datasphere
• Knowledge of SAP Crystal Reports, SAP Business Technology Platform (SAP Cloud Platform), SAP HANA Cloud
• Good English communication skills