Senior Data Engineer - AI-Driven Data Pipelines (Hybrid Warsaw)

Talan Group; Warszawa; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Private medical insurance

Life insurance

Smart Office Pack

Training and career development

Multicultural team experience

International project opportunities

Job summary

A global consulting firm based in Warsaw is seeking an experienced data engineer to design and maintain data pipelines. The candidate will be responsible for integrating data from various sources, ensuring data quality, and optimizing processing for efficiency. Qualifications include strong Python and SQL skills, familiarity with ETL frameworks, and experience with cloud services, particularly Google Cloud. This position offers a full-time contract, hybrid work option, and various benefits including private medical insurance and training opportunities.

Qualifications

• Strong experience with Python focused on data processing and pipeline development.
• Advanced SQL skills and solid understanding of data modeling concepts.
• Experience with ETL/ELT frameworks and orchestration tools.
• Hands-on experience with distributed data framework such as Apache Spark.
• Cloud platform experience, particularly Google Cloud services.
• Fluency in both English and Polish is a must.

Responsibilities

• Design, build, and maintain scalable and reliable data pipelines.
• Ingest and integrate data from multiple sources.
• Develop efficient ETL/ELT processes and data workflows.
• Ensure data quality and integrity across the data lifecycle.
• Optimize data storage and processing for performance and cost efficiency.
• Build and maintain data pipelines for AI and Machine Learning.

Skills

Python for data processing

SQL

ETL/ELT frameworks

Workflow orchestration tools

Distributed data processing

Google Cloud services

BI tools

Communication skills

Fluent English

Fluent Polish

Tools

Airflow

Apache Spark

BigQuery

Dataflow

Cloud Composer

LangChain

Power BI

Tableau

Qlik

Job description

A global consulting firm based in Warsaw is seeking an experienced data engineer to design and maintain data pipelines. The candidate will be responsible for integrating data from various sources, ensuring data quality, and optimizing processing for efficiency. Qualifications include strong Python and SQL skills, familiarity with ETL frameworks, and experience with cloud services, particularly Google Cloud. This position offers a full-time contract, hybrid work option, and various benefits including private medical insurance and training opportunities.