Staff Data Engineer

MissionWired; United States; On-site; USD 120,000 - 150,000; Full time

Job summary

MissionWired is looking for a full-time Staff Data Engineer to design and implement data pipelines while managing complex data projects in a remote work environment. The role involves solving unique challenges related to data lakes and collaborating with cross-functional teams to support their data infrastructure needs.

The ideal candidate should have 5 years of professional experience, extensive knowledge of Apache Spark, and a passion for mentoring others. This position offers an opportunity to innovate in data management solutions.

Qualifications

• 5 years of professional software engineering experience.
• Hands-on experience building distributed data pipelines using Apache Spark.
• Knowledge of data pipeline optimization and architecture management.

Responsibilities

• Transforming and normalizing varied partner datasets.
• Designing batch-processing pipelines for large datasets.
• Developing processes for data mining and modeling.

Skills

Software engineering experience

Data pipeline optimization

Apache Spark

Mentoring

Data management innovation

Job description

Transforming millions of data points into impactful solutions, the full-time Staff Data Engineer will design and implement data pipelines, manage complex data projects, and collaborate with cross-functional teams in a remote work environment.

Key responsibilities:

• Solving unique data-lake challenges by transforming and normalizing varied partner datasets
• Designing robust batch-processing pipelines for massive datasets from diverse sources
• Developing processes for data mining, modeling, and production while collaborating with teams to support their data infrastructure needs

Required qualifications:

• 5 years of professional software engineering experience
• Extensive hands-on experience building distributed data pipelines using Apache Spark
• Knowledge of data pipeline optimization and architecture management
• Eagerness to mentor and guide engineering teams
• Intellectual curiosity to innovate in data management solutions