Remote Data Engineer - Spark, Python & Cloud

EUROPEAN DYNAMICS; Kentucky; On-site; USD 90,000 - 130,000; Full time

Benefits offered by this job

Competitive salary

Private health coverage

Flexible working hours

Top-of-the-line tools

Professional development

Job summary

EUROPEAN DYNAMICS is expanding its data engineering team in Athens or remote, seeking a Data Engineer to design and implement big data solutions on a scalable cloud platform. You will work in an agile environment, analyzing millions of data points to derive insights and improve analytics for end users.

You will design batch and streaming pipelines with Spark, Python and SQL, build APIs, and collaborate with business analysts to meet requirements.

Qualifications

• Bachelor’s degree in Computer Science or Software Engineering.
• Thorough knowledge of Apache Spark.
• Advanced knowledge of Python and Databases.
• Experience as a Data Engineer.
• Understanding Azure Data Lake Storage and Delta Live Tables.
• Fluency in verbal and written English.
• Strong analytical skills, team and quality oriented.
• Keen to learn and grow as a data engineer.

Responsibilities

• Design and implement batch processing pipelines using Spark (Python or Scala) and SQL.
• Design and implement streaming ETL/ELT processes from a diverse set of data sources.
• Write code supporting the development of big data solutions, implementing complete data integration or analytic use cases.
• Design and implement APIs in any modern Python API framework.
• Communicate effectively with our Business Analysis teams to ensure alignment with business requirements.
• Write representative end-to-end and functional tests using open-source tools.
• Implement monitoring solutions for our data platform through alerts and dashboards.

Skills

Python

Databases

English communication

Analytical thinking

Team collaboration

Education

Bachelor’s degree in Computer Science or Software Engineering

Tools

Apache Spark

Databricks

Docker

Cloud platforms (AWS/Azure/GCP)

fastAPI

SQL

Job description

EUROPEAN DYNAMICS is expanding its data engineering team in Athens or remote, seeking a Data Engineer to design and implement big data solutions on a scalable cloud platform. You will work in an agile environment, analyzing millions of data points to derive insights and improve analytics for end users.

You will design batch and streaming pipelines with Spark, Python and SQL, build APIs, and collaborate with business analysts to meet requirements.