Senior Software Engineer - Data Platform

Placements24; Waukee (IA); Hybrid; USD 110,000 - 170,000; Full time

Benefits offered by this job

Competitive salary

Bonuses

Health insurance

Professional development

Job summary

Placements24 is seeking a Senior Software Engineer specializing in data platforms to design, build, and maintain scalable data infrastructure for analytics, ML, and BI initiatives. You will work with large datasets and cutting-edge tech to create efficient data pipelines and robust data warehousing solutions.

Responsibilities include optimizing storage and query performance, collaborating with data scientists and engineers, and contributing to the data platform's architectural roadmap.

Qualifications

• Bachelor's degree in CS, Eng, or related field.
• 5+ years in software engineering with focus on data engineering.
• Proficiency in Python, Scala, or Java.
• Experience with Spark, Hadoop, Kafka, and cloud data services (AWS EMR, Azure Databricks, GCP Dataflow).
• Strong understanding of SQL and NoSQL databases; data modeling and warehousing concepts.

Responsibilities

• Design, develop, and implement robust and scalable data pipelines and ETL processes.
• Build and maintain data warehousing solutions and data lake architectures.
• Optimize data storage, processing, and querying performance for large datasets.
• Collaborate with data scientists, analysts, and engineers to understand data needs and provide solutions.
• Implement and manage data quality frameworks and ensure data integrity.
• Contribute to architectural decisions and the technical roadmap for the data platform.

Skills

Data engineering

Big data

Python

Scala/Java

ETL

Data modeling

Education

Bachelor's degree in Computer Science, Engineering, or a related quantitative field

Tools

Apache Spark

Hadoop

Kafka

AWS EMR

Azure Databricks

GCP Dataflow

Job description

About the Role

Our client is seeking an experienced Senior Software Engineer specializing in data platforms to join their innovative team in Paarl . In this role, you will be responsible for designing, building, and maintaining scalable and reliable data infrastructure that supports analytics, machine learning, and business intelligence initiatives. You will work with large datasets and cutting-edge technologies to create efficient data pipelines and robust data warehousing solutions. This is an excellent opportunity for a passionate engineer to make a significant impact on the company's data strategy and capabilities.

Key Responsibilities

• Design, develop, and implement robust and scalable data pipelines and ETL processes.
• Build and maintain data warehousing solutions and data lake architectures.
• Optimize data storage, processing, and querying performance for large datasets.
• Collaborate with data scientists, analysts, and other engineers to understand data needs and provide solutions.
• Implement and manage data quality frameworks and ensure data integrity.
• Contribute to the architectural decisions and technical roadmap for the data platform.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in software engineering, with a strong focus on data engineering or data platforms.
• Proficiency in programming languages such as Python, Scala, or Java.
• Experience with big data technologies like Apache Spark, Hadoop, Kafka, and cloud-based data services (e.g., AWS EMR, Azure Databricks, GCP Dataflow).
• Strong understanding of database technologies , both relational (SQL) and NoSQL.
• Experience with data modeling and data warehousing concepts.

Benefits

• A highly competitive annual salary with attractive bonuses.
• Comprehensive health, dental, and vision insurance.
• Opportunities for professional development, including training and conferences.
• A stimulating work environment with a focus on technological innovation.
• Access to state-of-the-art tools and technologies in Paarl.