Senior Data Engineer – Python / Spark / AWS & GCP

SQUARE ONE RESOURCES sp. z o.o.; Warszawa; On-site; PLN 260,000 - 380,000; Part time

Job summary

SQUARE ONE RESOURCES sp. z o.o. poszukuje doświadczonego specjalisty ds.

Data Engineering. Kandydat będzie pracować nad projektami związanymi z dużymi zbiorami danych, projektowaniem potoków ETL oraz utrzymaniem linii danych w środowisku rozproszonym. Wymagane co najmniej 10 lat doświadczenia w Data Engineering/Software Engineering, silne umiejętności programowania (Python/Java/Scala) oraz znajomość SQL i baz NoSQL (BigQuery, Teradata, MySQL, PostgreSQL, Cassandra).

Qualifications

• 10+ years of experience in Data Engineering, Software Engineering, Distributed Systems, or a related field.
• Strong programming skills in Python, Java, or Scala.
• Strong knowledge of SQL and experience with SQL and NoSQL databases such as BigQuery, Teradata, MySQL, PostgreSQL, or Cassandra.
• Experience with Big Data technologies, including Hadoop, Hive, and Apache Spark.
• Hands-on experience with Airflow or another orchestration tool.
• Strong understanding of ETL, data lineage, data

Skills

Data Engineering

Distributed Systems

Big Data

Programming experience

Tools

BigQuery

Teradata

MySQL/PostgreSQL/Cassandra

Hadoop/Hive/Spark

Airflow

Job description

Nasze wymagania:

• 10+ years of experience in Data Engineering, Software Engineering, Distributed Systems, or a related field.


• Strong programming skills in Python, Java, or Scala.


• Strong knowledge of SQL and experience with SQL and NoSQL databases such as BigQuery, Teradata, MySQL, PostgreSQL, or Cassandra.


• Experience with Big Data technologies, including Hadoop, Hive, and Apache Spark.


• Hands-on experience with Airflow or another orchestration tool.


• Strong understanding of ETL, data lineage, data