Big Data Engineer

Jobgether; Remote; MYR 60,000 - 85,000; Full time

Job summary

A recruitment firm is seeking a Data Engineer to work remotely. This role involves designing and implementing scalable data solutions that support business decisions. The ideal candidate will have experience in developing data pipelines, using technologies like Databricks, SQL, and Python. Responsibilities include building ETL workflows and managing data lakes on cloud platforms (Azure, AWS). The position offers flexibility, professional growth opportunities, and a collaborative work culture.

Benefits

Flexible remote working conditions

Opportunities for professional growth

Collaborative company culture

Access to modern technologies

Health and wellness benefits

Work‑life balance

Qualifications

• 3–6 years of experience in Data Engineering or related roles.
• Hands‑on experience with big data processing frameworks and data lakes.
• Strong understanding of distributed systems and big data technologies.

Responsibilities

• Design, build, and optimize ETL/ELT workflows using Databricks, SQL, and Python/PySpark.
• Develop and maintain robust, scalable, and efficient data pipelines for processing large datasets.
• Work on cloud platforms (Azure, AWS) to build and manage data lakes and scalable architectures.

Skills

Python

SQL

Databricks

Apache Spark

PySpark

Azure

AWS

ETL

CI/CD

Git

Education

Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field

Tools

Azure Data Factory

AWS Glue

Jenkins

Azure DevOps

Job description

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Data Engineer - REMOTE. In this role, you will design and implement scalableadó data solutions that empower the business to make data-driven decisions. You will play a crucial role in developing data pipelines and working with cutting-edge technologies on cloud platforms. This position offersifts exciting opportunity to contribute to our client’s operational improvement by leveraging comprehensive data » insights that enhance customer experiences. Collaborating with various teams, you will ensure high-quality data management practices are upheld, ultimately driving impactful results for the organization. Join us to be part of a dynamic team focused on innovation and customer satisfaction.

Accountabilities

• Design, build, and optimize ETL/ELT workflows using Databricks, SQL, and Python/PySpark.
• Develop and maintain robust, scalable, and efficient data pipelines for processing large datasets.
• Work on cloud platforms (Azure, AWS) to build and manage data lakes and scalable architectures.
• Utilize cloud services like Azure Data Factory and AWS Glue for data processing.
• Use Databricks for big data processing and analytics.
• Leverage Apache Spark for distributed computing and data transformations.
• Create and manage SQL-based data solutions ensuring scalability and performance.
• Develop and enforce data quality checks and validations.
• Collaborate with cross-functional teams to deliver impactful data solutions.
• Leverage CI/CD pipelines to streamline development and deployment of workflows.
• Maintain clear documentation for data workflows and optimize data systems.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
• 3–6 years of experience in Data Engineering or related roles.
• Hands‑on experience with big data processing frameworks and data lakes.
• Proficiency in Python, SQL, and PySpark for data manipulation.
• Experience with Databricks and Apache Spark.
• Knowledge of cloud platforms like Azure and AWS.
• Familiarity with ETL tools (Alteryx is a plus).
• Strong understanding of distributed systems and big data technologies.
• Basic understanding of DevOps principles and CI/CD pipelines.
• Hands‑on experience with Git, Jenkins, or Azure DevOps.

Benefits

• Flexible remote working conditions.
• Opportunities for professional growth and training.
• Collaborative and inclusive company culture.
• Access to modern technologies and tools.
• Health and wellness benefits.
• Work‑life balance.
• Participation in innovative projects.
• Dynamic and fast‑paced working environment.

Why Apply Through Jobgether?

We use an AI‑powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top‑fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre‑contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.