Senior Data Integrations Engineer

One Assessment; Polska; On-site; PLN 180,000 - 280,000; Full time

Job summary

One Assessment is seeking an experienced Data Integrations Engineer to design and maintain backend data pipelines across SIS and LMS platforms and to build robust API integrations.

You will develop bi-directional data integrations, extract and transform data, orchestrate workflows with Dagster in a Python-driven monorepo, and ensure seamless data flow into our CRM while preventing duplicates.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, or a related field.
• 6+ years of experience in Data Integrations or Backend Python Development with API integrations.
• Proficiency in Python programming.
• Experience with data orchestration tools like Dagster is a plus.
• Familiarity with APIs and web services, RESTful APIs.
• Knowledge of AWS services (ECS, Lambda, Secrets Manager).
• Experience with MongoDB and Snowflake databases.
• Understanding of data transformation, mapping techniques and ETL processes.

Responsibilities

• Develop Data Integrations: Build bi-directional and unidirectional data integrations across SIS/LMS platforms.
• Data Extraction and Transformation: Extract data from SIS/LMS and transform into intermediary representations for our platform.
• API Integration: Work with custom web import/export API and ensure seamless data flow into the CRM, avoiding duplication.
• Troubleshoot and Support: Identify and resolve integration issues using error-logging tools like Sentry.

Skills

Data Integrations

Backend Python Development

API integrations

Python programming

Dagster

RESTful APIs

ETL processes

Education

Bachelor's degree in Computer Science, Information Systems, or related field

Tools

Dagster

MongoDB

Snowflake

AWS (ECS, Lambda, Secrets Manager)

Job description

Key Responsibilities:

Develop Data Integrations:

• Build bi-directional and unidirectional data integrations
• SIS and LMS platforms such as Colleague, Banner (via Ethos)
• Utilize Python and Dagster for data orchestration within the monorepo managed by Poetry

Data Extraction and Transformation:

• Extract comprehensive data from SIS/LMS systems
• Transform and map extracted data into intermediary representations suitable for our platform.

API Integration:

• Work with custom web import/export API to define data templates and transformations.
• Ensure seamless data flow into the CRM, handling data transformations and updates to prevent duplication.

Troubleshoot and Support:

• Identify and resolve integration issues, using tools like Sentry for error logging.

Qualifications:

• Bachelor's degree in Computer Science, Information Systems, or a related field.
• 6+ years of relevant experience with Data Integrations or Backend Python Development with API integrations
• Proficiency in Python programming.
• Experience with data orchestration tools like Dagster is a plus
• Familiarity with APIs and web services, particularly RESTful APIs.
• Knowledge of AWS services such as ECS, Lambda, and Secrets Manager.
• Experience with MongoDB and Snowflake databases.
• Understanding of data transformation, mapping techniques, and ETL processes.