Senior Data Integration Engineer (AWS, AI, Snowflake)

EPAM Systems; Colombia; Remote; COP 89.280.000 - 156.240.000; Vollzeit

Zusammenfassung

EPAM Systems Inc. is seeking a Senior Data Integration Engineer to build and operate scalable data pipelines in AWS and GCP using Python, SQL, Airflow, Spark, and Databricks or Snowflake. You will collaborate with cross-functional teams to ensure reliable, scalable data flows and align with AI initiatives.

Responsibilities include evaluating colleague code, guiding juniors, planning estimates, and documenting data workflows to support system stability and good practices across the data platform.

Qualifikationen

• 3+ years of data integration experience in complex environments.
• Strong Python and SQL capabilities for building ETL/ELT pipelines.
• Experience with cloud platforms (AWS, GCP) and orchestration (Airflow).

Aufgaben

• Build scalable and durable data integration systems aligned with business requirements.
• Coordinate with multidisciplinary teams to ensure timely, quality deliverables.
• Guide junior colleagues and share knowledge to raise engineering standards.
• Document key decisions and data workflows to support stability and auditability.

Kenntnisse

Python

SQL

Airflow

Spark

Databricks

Snowflake

AWS

GCP

CI/CD

NoSQL

English

Tools

AWS

GCP

Airflow

Jobbeschreibung

We are expanding our data integration capability and need a Senior Data Integration Engineer with solid AI awareness and strong engineering habits. You will build and operate pipelines across AWS and GCP, using Python, SQL, Airflow, Spark, and Databricks or Snowflake to integrate data at scale. Apply now to help us deliver dependable solutions and grow your AI toolkitResponsibilitiesBuild scalable and durable data integration systems aligned with business and technical requirementsCoordinate with multidisciplinary teams to ensure deliverables are timely and meet quality criteriaParticipate in architecture conversations and provide perspectives that guide project directionEvaluate code produced by other engineers and share practical feedback to sustain engineering standardsResolve intricate technical issues encountered throughout the data pipeline lifecycleGuide junior colleagues through knowledge sharing that builds their capabilitiesAssist with planning by helping refine scope and delivering reliable estimatesMonitor technology trends and incorporate worthwhile methods into regular engineering workDocument key technical decisions and data workflows clearly to support system stabilityAlign with stakeholders on clear objectives and validate that deliverables meet expectationsRequirementsAt least 3 years of applicable, relevant professional experienceFunctional knowledge of AI principles and tools, leveraged to enhance data integration solution developmentAdvanced Python capability for creating and sustaining data integration applicationsHands-on experience operating in Amazon Web Services cloud environmentsStrong background in Data Integration, joining and consolidating data from multiple sourcesSkilled use of SQL to manage, organize, and extract data from relational databasesFamiliarity with NoSQL database systems for unstructured and semi-structured data handlingUnderstanding of CI/CD practices that support automated, consistent releases of software and pipelinesWorking knowledge of Google Cloud Platform for managing and deploying cloud-centered data solutionsExperience with Apache Airflow for workflow orchestration and schedulingPractical experience with Databricks or Snowflake for large-scale data processing and analytics supportHands-on knowledge of Apache Spark for analyzing and processing sizable datasetsAwareness of SDLC Methodologies and their use in structured, efficient project managementExperience working in Agile settings that promote iterative, collaborative developmentConfident English communication skills at a B2 level (Upper-Intermediate) or higherWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.