Remote Senior Data Engineer - Scalable Big Data Pipelines

Placements24; East London; Hybrid; ZAR 900.000 - 1.500.000; Vollzeit

Benefits dieser Stelle

Remote work

Stock options

Health insurance

Professional development budget

Home office stipend

Zusammenfassung

Placements24 is seeking a Remote Senior Data Engineer for a cutting-edge data analytics company operating with a fully remote workforce. The role focuses on designing, building, and maintaining scalable data pipelines and infrastructure to support advanced analytics and ML initiatives.

You will collaborate with data scientists and analysts, work with cloud platforms (AWS/Azure/GCP), SQL/NoSQL, Spark/Flink/Hadoop, and ETL/ELT processes in a remote, flexible environment.

Qualifikationen

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience as a Data Engineer, with a strong focus on big data technologies.
• Proven experience with cloud platforms such as AWS (S3, Redshift, EMR), Azure (Data Lake, Synapse), or GCP (BigQuery, Dataflow).
• Proficiency in SQL and experience with NoSQL databases.
• Hands-on experience with distributed data processing frameworks like Apache Spark, Hadoop, or Flink.
• Expertise in programming languages such as Python or Scala for data engineering tasks.
• Experience with data warehousing concepts and tools.
• Strong understanding of ETL/ELT processes and data pipeline orchestration tools (e.g., Airflow, Luigi).
• Excellent problem-solving, analytical, and communication skills.
• Ability to work independently and effectively in a remote team environment.

Aufgaben

• Design, construct, install, test, and maintain highly scalable data management systems and data pipelines.
• Develop and implement ETL/ELT processes to ingest, transform, and load data from various sources.
• Build and optimize data architectures and data warehouses for performance and efficiency.
• Work with large datasets, ensuring data quality, integrity, and availability.
• Implement data modeling techniques to support business intelligence and analytical requirements.
• Collaborate with data scientists and analysts to understand their data needs and provide solutions.
• Optimize data query performance and database performance.
• Ensure adherence to data governance, security, and compliance standards.
• Stay current with emerging big data technologies and best practices.
• Troubleshoot and resolve data-related issues in production environments.

Kenntnisse

Big data

SQL

Python

Scala

Communication skills

Independent work

Ausbildung

Bachelor's or Master's degree in Computer Science/Engineering

Tools

AWS

Azure

GCP

Airflow

Luigi

Spark

Hadoop

Flink

Jobbeschreibung

Placements24 is seeking a Remote Senior Data Engineer for a cutting-edge data analytics company operating with a fully remote workforce. The role focuses on designing, building, and maintaining scalable data pipelines and infrastructure to support advanced analytics and ML initiatives.

You will collaborate with data scientists and analysts, work with cloud platforms (AWS/Azure/GCP), SQL/NoSQL, Spark/Flink/Hadoop, and ETL/ELT processes in a remote, flexible environment.