Senior Data Integration Engineer (Databricks/Snowflake)

EPAM Systems Inc; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

EPAM Systems is seeking a Senior Data Integration Engineer to join its Data Practice and drive strategic data projects. You will build and maintain data pipelines and enterprise data platforms in cloud environments, primarily AWS and Azure, enabling data-driven decision making.

You will collaborate with data scientists and architects, implement data acquisition via APIs and FTP, and ensure data quality, security, and accessibility across raw files, warehouses, and data stores.

Qualifications

• 3+ years of professional experience as a Data Engineer or in a similar role.
• Advanced knowledge of SQL and Python.
• Hands-on experience with public cloud platforms such as AWS and/or Azure.
• Experience with DBMS and ETL/ELT tools.
• Hands-on experience with Databricks and/or Snowflake.
• Practical experience with data acquisition using APIs, FTP downloads, and other data sources.
• Experience with ETL processes, data transformation, and normalization from raw data to structured database schemas.
• Experience with data storage solutions including raw files and database systems.
• Experience building components for enterprise data platforms such as Data Warehouses, Operational Data Stores, and data access layers.
• Experience developing data access solutions including APIs, file extracts, and user query interfaces.
• Strong communication and collaboration skills.
• Good analytical and problem-solving skills.
• Ability to work effectively in a distributed, team-oriented environment.

Responsibilities

• Design, build, and manage enterprise data solutions in public cloud environments such as AWS and Azure.
• Develop and maintain data pipelines and components of enterprise data platforms.
• Implement data acquisition processes using APIs, FTP and other data sources.
• Perform data transformation, normalization, and integration from raw data to structured database schemas.
• Build and maintain data storage solutions including raw files, databases, and data platforms.
• Develop data distribution and access solutions including APIs, file extracts, user queries, and access layers.
• Implement secure and auditable data processes to ensure data integrity, accuracy, and availability.
• Collaborate with data scientists, data architects, and other stakeholders to understand and deliver data requirements.
• Troubleshoot data-related issues and continuously improve the quality and reliability of data systems.
• Contribute to EPAM strategic data projects and enterprise data platform initiatives.

Skills

SQL

Python

Data modeling

Analytical skills

Communication

Teamwork

Education

Bachelor's degree in Computer Science/IT or related

Tools

Databricks

Snowflake

ETL/ELT tools

DBMS

APIs/FTP data acquisition

Job description

We are looking for a Senior Data Integration Engineer to join our growing Data Practice and contribute to EPAM strategic data projects. You will play a key role in building and maintaining data systems and applications that support business decision-making. You will primarily focus on developing data pipelines and data-driven solutions in public cloud environments such as AWS and Azure, as well as supporting data migration from on-premises data centers to the cloud. You will also have the opportunity to build and maintain components of enterprise data platforms, working closely with data scientists, architects, and other technology professionals.

Responsibilities

• Design, build, and manage enterprise data solutions in public cloud environments such as AWS and Azure
• Develop and maintain data pipelines and components of enterprise data platforms
• Implement data acquisition processes using APIs, FTP and other data sources
• Perform data transformation, normalization, and integration from raw data to structured database schemas
• Build and maintain data storage solutions including raw files, databases, and data platforms
• Develop data distribution and access solutions including APIs, file extracts, user queries, and access layers
• Implement secure and auditable data processes to ensure data integrity, accuracy, and availability
• Collaborate with data scientists, data architects, and other stakeholders to understand and deliver data requirements
• Troubleshoot data-related issues and continuously improve the quality and reliability of data systems
• Contribute to EPAM strategic data projects and enterprise data platform initiatives

Requirements

• 3+ years of professional experience as a Data Engineer or in a similar role
• Advanced knowledge of SQL and Python
• Hands-on experience with public cloud platforms such as AWS and/or Azure
• Experience with DBMS and ETL/ELT tools
• Hands-on experience with Databricks and/or Snowflake
• Practical experience with data acquisition using APIs, FTP downloads, and other data sources
• Experience with ETL processes, data transformation, and normalization from raw data to structured database schemas
• Experience with data storage solutions including raw files and database systems
• Experience building components for enterprise data platforms such as Data Warehouses, Operational Data Stores, and data access layers
• Experience developing data access solutions including APIs, file extracts, and user query interfaces
• Bachelor’s degree in Computer Science, Information Technology, or a related technical field
• Strong communication and collaboration skills
• Good analytical and problem-solving skills
• Ability to work effectively in a distributed, team-oriented environment