Remote Lead Data Engineer — Big Data & Pipelines

Placements24; United States; Remote; USD 150,000 - 190,000; Full time

Benefits offered by this job

Stock options or equity

Comprehensive health insurance

Full remote with flexible schedule

Professional development opportunities

Job summary

Placements24 is seeking a visionary Lead Data Engineer to architect and scale data pipelines and infrastructure for advanced analytics and ML initiatives. You will lead a distributed team, drive data processing innovation, and ensure reliability and efficiency of the data ecosystem in a fully remote role.

You will mentor engineers, collaborate with data scientists and software engineers, and stay ahead of emerging Big Data technologies and best practices.

Qualifications

• Master's or Bachelor's degree in CS/Engineering or related field.
• 5+ years in data engineering with Big Data focus.
• Experience designing data pipelines with Spark.
• Deep knowledge of Hadoop, Hive, HDFS, Kafka.
• Programming: Python, Scala, or Java.
• Strong SQL and database knowledge (relational/NoSQL).
• Experience with cloud platforms (AWS/Azure/GCP) preferred.
• Excellent leadership and communication, remote collaboration.

Responsibilities

• Lead design and optimization of batch and real-time data pipelines.
• Build scalable, fault-tolerant data infrastructure using Spark, Hadoop, Kafka.
• Develop data warehousing and data lake solutions.
• Implement ETL/ELT processes from multiple sources.
• Ensure data quality, security, and governance across systems.
• Collaborate with data scientists, analysts, and engineers to meet data needs.
• Mentor junior data engineers and promote best practices.
• Automate data processes and monitor system performance.

Skills

Big Data

Data Pipelines

Distributed Systems

Python/Scala/Java

Leadership

Education

Master's or Bachelor's in CS/Engineering

Tools

Spark

Hadoop

Kafka

Hive

HDFS

Job description

Placements24 is seeking a visionary Lead Data Engineer to architect and scale data pipelines and infrastructure for advanced analytics and ML initiatives. You will lead a distributed team, drive data processing innovation, and ensure reliability and efficiency of the data ecosystem in a fully remote role.

You will mentor engineers, collaborate with data scientists and software engineers, and stay ahead of emerging Big Data technologies and best practices.