Senior Data Engineer

Provectus IT, Inc.; Remote; PLN 120,000 - 180,000; Full time

Job summary

A leading AI consultancy is looking for a talented Data Engineer to join their dynamic team. This position involves collaborating with clients to understand their data needs and constructing robust data pipelines using technologies like Python, Spark, and AWS. The role is remote with flexible working hours. Ideal candidates should have a strong background in data engineering and be equipped to handle both real-time and batch data flows. A comprehensive private medical insurance plan and a range of benefits are offered.

Benefits

Comprehensive private medical insurance

Paid sick leave and vacations

Flexibility in work hours

Career development programs

Qualifications

• Experience with real-time and batch data flow management.
• Proficient in using AWS and related technologies.
• Upper-Intermediate English skills required.

Responsibilities

• Collaborate with clients to understand their IT environments.
• Manage large volumes of varied data sets.
• Work with ML Engineers to create resilient data pipelines.
• Design and maintain ETL/ELT data pipelines.

Skills

Data Engineering

Machine Learning

Python

SQL

AWS

Spark

Apache Kafka

ETL

Infrastructure as Code

Tools

Airflow

dbt

Terraform

AWS CloudFormation

Job description

Provectus, a leading AI consultancy and solutions provider specializing in Data Engineering and Machine Learning . With a focus on helping businesses unlock the power of their data, we leverage the latest technologies to build innovative data platforms that drive results. Our Data Engineering team consists of top-tier professionals who design, implement, and optimize scalable, data-driven architectures for clients across various industries.

We are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers.

Responsibilities:

• Collaborate closely with clients to deeply understand their existing IT environments, applications, business requirements, and digital transformation goals.
• Collect and manage large volumes of varied data sets.
• Work directly with ML Engineers to create robust and resilient data pipelines that feed Data Products.
• Define data models that integrate disparate data across the organization.
• Design, implement, and maintain ETL/ELT data pipelines.
• Perform data transformations using tools such as Spark, Trino, and AWS Athena to handle large volumes of data efficiently.
• Develop, continuously test, and deploy Data API Products with Python and frameworks like Flask or FastAPI.

Requirements:

• Experience handling real-time and batch data flow and data warehousing with tools and technologies like Airflow, Dagster, Kafka, Apache Druid, Spark, dbt, etc.
• Experience in AWS.
• Proficiency in programming languages relevant to data engineering, such as Python and SQL.
• Proficiency with Infrastructure as Code (IaC) technologies like Terraform or AWS CloudFormation.
• Experience in building scalable APIs.
• Familiarity with Data Governance aspects like Quality, Discovery, Lineage, Security, Business Glossary, Modeling, Master Data, and Cost Optimization.
• Upper-Intermediate or higher English skills.
• Ability to take ownership, solve problems proactively, and collaborate effectively in dynamic settings.

Nice to Have:

• Experience with Cloud Data Platforms (e.g., Snowflake, Databricks).
• Experience in building Generative AI Applications (e.g., chatbots, RAG systems).
• Knowledge of BI Tools (Power BI, QuickSight, Looker, Tableau, etc.).
• Experience in building Data Solutions in a Data Mesh architecture.

We offer:

• Participate in internal training programs (Leadership, Public Speaking, etc.) with full support for AWS and other professional certifications.
• Work with the latest AI tools, premium subscriptions, and the freedom to use them in your daily work.
• 100% remote — with flexible hours.
• Collaboration with an international, cross-functional team.
• Comprehensive private medical insuranceor budget for your medical needs.
• Paid sick leave, vacation, and public holidays.
• Equipment and all the tech you need for comfortable, productive work.
• Special gifts for weddings, childbirth, and other personal milestones.

We are waiting for you to become a part of our team!