Senior Data Platform Engineer - Scale Data Pipelines

Placements24; Waukee (IA); Hybrid; USD 110,000 - 170,000; Full time

Benefits offered by this job

Competitive salary

Bonuses

Health insurance

Professional development

Job summary

Placements24 is seeking a Senior Software Engineer specializing in data platforms to design, build, and maintain scalable data infrastructure for analytics, ML, and BI initiatives. You will work with large datasets and cutting-edge tech to create efficient data pipelines and robust data warehousing solutions.

Responsibilities include optimizing storage and query performance, collaborating with data scientists and engineers, and contributing to the data platform's architectural roadmap.

Qualifications

• Bachelor's degree in CS, Eng, or related field.
• 5+ years in software engineering with focus on data engineering.
• Proficiency in Python, Scala, or Java.
• Experience with Spark, Hadoop, Kafka, and cloud data services (AWS EMR, Azure Databricks, GCP Dataflow).
• Strong understanding of SQL and NoSQL databases; data modeling and warehousing concepts.

Responsibilities

• Design, develop, and implement robust and scalable data pipelines and ETL processes.
• Build and maintain data warehousing solutions and data lake architectures.
• Optimize data storage, processing, and querying performance for large datasets.
• Collaborate with data scientists, analysts, and engineers to understand data needs and provide solutions.
• Implement and manage data quality frameworks and ensure data integrity.
• Contribute to architectural decisions and the technical roadmap for the data platform.

Skills

Data engineering

Big data

Python

Scala/Java

ETL

Data modeling

Education

Bachelor's degree in Computer Science, Engineering, or a related quantitative field

Tools

Apache Spark

Hadoop

Kafka

AWS EMR

Azure Databricks

GCP Dataflow

Job description

Placements24 is seeking a Senior Software Engineer specializing in data platforms to design, build, and maintain scalable data infrastructure for analytics, ML, and BI initiatives. You will work with large datasets and cutting-edge tech to create efficient data pipelines and robust data warehousing solutions.

Responsibilities include optimizing storage and query performance, collaborating with data scientists and engineers, and contributing to the data platform's architectural roadmap.