Senior Python Data Engineer

Luxoft; Województwo pomorskie; On-site; PLN 50,000 - 70,000; Full time

Job summary

A technology services company in Poland is seeking a highly skilled Python Data Engineer. The ideal candidate will be responsible for developing and maintaining data pipelines to support various project requirements. Candidates should have extensive experience with Python, dbt, and AWS Services. Strong problem-solving skills and a collaborative mindset are essential for this role. Join us to drive automation and enhance data services in a dynamic team environment.

Qualifications

• Proven professional work experience in data engineering and data services.
• Expertise in Python for data manipulation and automation tasks.
• Expertise in dbt ELT framework.
• Experience with AWS Services.

Responsibilities

• Develop and maintain data pipelines and workflows to support project requirements.
• Automate data parsing processes to enhance efficiency and scalability.
• Supervising the Data Engineer team.

Skills

Python for data manipulation

dbt ELT framework

AWS Services (Glue, Fargate, Step Functions, Lambda, Athena)

Data pipeline tools

Job description

Project description

1. Ensure the resilience of the CMS and CIS IT services -> address yellow DG-IS risks and red BANCO risks related to unsupported SAP systems and increased security vulnerabilities, ensuring stable operations and business continuity2. Setup a new business service to:- enable advanced analytics (ECB and Eurosystem) on a centralised repository- replace the current legacy solutions BOSS and BODS (SAP) with a more efficient one- ensure scalability for future data growth and operational longevity for cash survey data- enhance transparency for citizens

Responsibilities

• We are seeking a highly skilled Python Data Engineer to join our team. The ideal candidate will have a strong background in data services and manipulation, with proven experience in transforming and automating data processes. Experience with dbt and AWS Services is a significant advantage.Key Responsibilities:- Develop and maintain data pipelines and workflows to support project requirements.- Automate data parsing processes to enhance efficiency and scalability.- Develop dbt models to mirror transformation done by SAP Business Object Data Services and create new ones- Ensure data integrity and quality throughout the data lifecycle.- supervising the Data Engineer team; at times three additional Data Engineers are assigned to it

SKILLS

Must have

• Required Qualifications:- Proven professional work experience in data engineering and data services.- Expertise in Python for data manipulation and automation tasks.- Expertise in dbt ELT framework- Experience with AWS Services (Glue, Fargate, Step Functions, Lambda, Athena)- Familiarity with data pipeline tools and technologies.

Nice to have

- Proven track record of automating data parsing solutions.- Ability to work independently and as part of a team in a dynamic, fast-paced environment.- Strong problem-solving skills and attention to detail