Data Engineer

Trimble; South Africa; Remote; ZAR 1,393,000 - 2,090,000; Full time

Job summary

A leading technology firm is seeking a Data Engineer for a remote role focused on designing scalable data solutions using AWS. The ideal candidate will have strong expertise in AWS data services, ETL processes, and programming skills in Python and SQL. This position emphasizes collaboration with cross-functional teams and a commitment to data governance and quality.

Qualifications

• Experience in AWS platforms and data services.
• Strong competence in ETL processes and data warehousing.
• Advanced skills in Python, SQL, and automation tools.

Responsibilities

• Design scalable data solutions on AWS.
• Develop data pipelines using AWS services.
• Implement data governance policies.

Skills

AWS data services

ETL processes

Python

SQL

Infrastructure automation

Data visualization tools

Tools

AWS Glue

Docker

Kubernetes

Terraform

Job description

Overview

Transporeon is a SaaS company founded in 2000 in Ulm, Germany. The company provides logistics solutions across several areas, including buying and selling logistics services, organizing shipment execution, organizing dock, yard, truck, and driver schedules, and invoice auditing for logistics services. It has grown significantly over the years, reaching €150m in revenue before being acquired by Trimble for $2 billion USD in 2022. Transporeon has one of the largest networks of shippers and carriers in Europe, with approximately 1,400 employees: https://www.transporeon.com/en

What you will do

• Design and implement scalable data solutions on AWS, including data lakes, warehouses, and streaming systems. (We might migrate our data lake to Azure, so Azure knowledge is beneficial).
• Develop, optimize, and maintain data pipelines using AWS services.
• Implement robust ETL/ELT processes and event-driven data ingestion.
• Establish and enforce data governance policies, ensuring data quality, security, and compliance.
• Optimize cloud resources for performance, availability, and cost-efficiency.
• Partner with cross-functional teams to gather requirements and deliver comprehensive cloud-based solutions.
• Identify opportunities to enhance systems, processes, and technologies while troubleshooting complex technical challenges.

Our current tech stack

• AWS: Glue, Lambda, Step Function, Batch, ECS, Quicksight, Machine Learning, Sagemaker, etc.
• DevOps: CloudFormation, Terraform, Git, CodeBuild
• Database: Redshift, PostgreSQL, DynamoDB, Athena
• Language: Bash, Python, SQL
• AI: Cursor

What you bring

• Experience in AWS platforms, including data services. Basic knowledge of Azure is preferred.
• Experience in data engineering, strong competence in ETL processes, data warehousing, and big data technologies.
• Advanced skills in scripting, Python, SQL, and infrastructure automation tools.
• Familiarity with containerization (e.g., Docker) and orchestration (e.g., Kubernetes).
• Experience with data visualization tools (e.g., QuickSight) is a plus.
• Openness to work daily with AI tools like Cursor.
• Ability to work independently and responsibly; if you are not living near our offices, self-discipline and interpersonal skills to work remotely.

Job Location

Remote role in the following countries: Estonia, Latvia, Lithuania, Poland, Slovakia, Hungary, Romania, Portugal, Spain, Italy, Croatia. We are not offering freelancing contracts, only local employment contracts.

Our Inclusiveness Commitment

We believe in celebrating our differences. Diversity, Equity, and Inclusion guide our current success and our ongoing efforts to improve. We actively seek to add members to our community who represent our customers and the places we live and work. We have programs to ensure our people are seen, heard, and welcomed, and that they belong, no matter who they are or where they come from.