Remote Staff Data Engineer - Spark Pipelines & Mentorship

MissionWired; United States; On-site; USD 120,000 - 150,000; Full time

Job summary

MissionWired is looking for a full-time Staff Data Engineer to design and implement data pipelines while managing complex data projects in a remote work environment. The role involves solving unique challenges related to data lakes and collaborating with cross-functional teams to support their data infrastructure needs.

The ideal candidate should have 5 years of professional experience, extensive knowledge of Apache Spark, and a passion for mentoring others. This position offers an opportunity to innovate in data management solutions.

Qualifications

• 5 years of professional software engineering experience.
• Hands-on experience building distributed data pipelines using Apache Spark.
• Knowledge of data pipeline optimization and architecture management.

Responsibilities

• Transforming and normalizing varied partner datasets.
• Designing batch-processing pipelines for large datasets.
• Developing processes for data mining and modeling.

Skills

Software engineering experience

Data pipeline optimization

Apache Spark

Mentoring

Data management innovation

Job description

MissionWired is looking for a full-time Staff Data Engineer to design and implement data pipelines while managing complex data projects in a remote work environment. The role involves solving unique challenges related to data lakes and collaborating with cross-functional teams to support their data infrastructure needs.

The ideal candidate should have 5 years of professional experience, extensive knowledge of Apache Spark, and a passion for mentoring others. This position offers an opportunity to innovate in data management solutions.