Senior GCP Data Engineer | Data Pipelines & BigQuery Expert

Lingarogroup; Poland; On-site; PLN 120,000 - 240,000; Full time

Job summary

Lingarogroup is seeking a Data Engineer to design, build, and optimize a GCP-based data ecosystem for a key client, including BigQuery, Cloud Storage, and Cloud Functions. You will model data, gather requirements, and interact directly with clients.

The role requires 4+ years in data engineering, strong SQL/Python, and hands-on experience with Airflow, DBT/Dataform, ETL/ELT, and data warehousing best practices.

Qualifications

• At least 4 years of experience as a Data Engineer working with GCP cloud-based infrastructure & systems.
• Deep knowledge of Google Cloud Platform and cloud computing services.
• Extensive experience in design, build, and deploy data pipelines in the cloud, to ingest data from various sources like databases, APIs or streaming platforms.
• Proficient in database management systems such as SQL (Big Query is a must), NoSQL.
• Programming skills (SQL, Python, other scripting).
• Proficient in data modeling techniques and database optimization.
• Knowledge of at least one orchestration and scheduling tool (Airflow is a must).
• Experience with data integration tools and techniques, such as ETL and ELT
• Knowledge of modern data transformation tools (such as DBT, Dataform).
• Excellent communication skills to effectively collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders.
• Ability to actively participate/lead discussions with clients to identify and assess concrete and ambitious avenues for improvement.
• Tools knowledge: Git, Jira, Confluence, etc.
• Open to learn new technologies and solutions.
• Experience in multinational environment and distributed teams.

Responsibilities

• Design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery).
• Gathering, analyzing, modelling, and documenting business/technical requirements. The role will include direct contact with clients.
• Modelling the data from various sources and technologies. Troubleshooting and supporting the most complex and high impact problems, to deliver new features and functionalities.
• Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems. Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval. Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency.
• Identifying and resolving issues related to data processing, storage, or infrastructure. Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations.
• Train and mentor less experienced data engineers, providing guidance and knowledge transfer.

Skills

GCP

SQL

Python

Data Modeling

Airflow

ETL/ELT

DBT/Dataform

BigQuery

Data integration

Cloud Data Warehousing

Tools

BigQuery

Airflow

DBT

Dataform

Talend

Alteryx

Looker

Power BI

Databricks

Azure

Job description

Lingarogroup is seeking a Data Engineer to design, build, and optimize a GCP-based data ecosystem for a key client, including BigQuery, Cloud Storage, and Cloud Functions. You will model data, gather requirements, and interact directly with clients.

The role requires 4+ years in data engineering, strong SQL/Python, and hands-on experience with Airflow, DBT/Dataform, ETL/ELT, and data warehousing best practices.