Manager Data Engineer at Solomon Page San Francisco, CA

Ellenco Estágios e Treinamentos; San Francisco (CA); On-site; USD 229,232,640 - 257,886,720; Full time

Benefits offered by this job

Medical benefits

Dental benefits

401(k) plan

Direct deposit

Commuter benefits

Job summary

Solomon Page is seeking a Manager, Data Engineering with deep Big Data expertise to design, develop, and maintain scalable data pipelines and analytics solutions. You will partner with cross-functional teams to ensure data quality, availability, and performance while leading and mentoring a team of data engineers.

The role offers a pay range of $80/hr on W2 to $90/hr on W2, with opportunities to drive data-driven decision making across the organization in the San Francisco market.

Qualifications

• 8+ years of experience in data engineering with a focus on Big Data.

Responsibilities

• Design and implement large-scale data processing systems using Hadoop, Spark, Kafka, and Flink.

Skills

Big Data technologies

Hadoop

Spark

Kafka

Flink

Python

Scala

Java

SQL

NoSQL

Data warehousing

Cloud platforms

ETL

Data modeling

Real-time processing

Agile leadership

Tools

AWS

GCP

Azure

Job description

We're looking for a Manager, Data Engineering with deep Big Data expertise to design, develop, and maintain scalable data pipelines and analytics solutions. In this role, you'll partner with cross-functional teams to ensure data quality, availability, and performance — while leading and mentoring a team of data engineers to drive data-driven decision-making across the organization.

Pay range :$80/hr on w2 to $90/hr on w2

Responsibilities:

• Design and implement large-scale data processing systems using Big Data technologies such as Hadoop, Spark, Kafka, and Flink
• Develop and optimize data pipelines, ensuring high performance, reliability, and scalability
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights
• Implement best practices for data governance, security, and compliance
• Automate data workflows and ETL processes to improve efficiency and reduce manual effort
• Troubleshoot and resolve performance issues, ensuring smooth data operations
• Stay updated on emerging Big Data technologies and recommend innovative solutions to enhance data capabilities
• Lead and mentor a team of data engineers, fostering a culture of collaboration and continuous learning

Qualifications

• 8+ years of experience in data engineering, with a focus on Big Data technologies
• Strong expertise in Hadoop, Spark, Kafka, Flink, and related frameworks
• Proficiency in SQL, NoSQL databases, and data warehousing solutions
• Experience with cloud-based data platforms such as AWS, GCP, or Azure
• Strong programming skills in Python, Scala, or Java
• Hands-on experience with data modeling, ETL processes, and real-time data processing
• Knowledge of data governance, security, and compliance best practices
• Proven ability to lead and manage data engineering teams in an Agile environment
• Excellent problem-solving, communication, and stakeholder management skills

Preferred (Set Yourself Apart With):

• Experience with machine learning pipelines and AI-driven data solutions
• Certifications in Big Data technologies (e.g., Cloudera, Databricks, AWS Big Data)
• Knowledge of DevOps practices for data engineering and CI/CD pipelines
• Strong understanding of data architecture and distributed computing

The Solomon Page Distinction

• Solomon Page offers a comprehensive benefit program for hourly employees.
• We pride ourselves on offering medical, dental, 401(k), direct deposit and commuter benefits to our employees, including freelancers - which sets us apart in the industries we serve.

About Solomon Page

Founded in 1990, Solomon Page is a specialty niche provider of staffing and executive search solutions across a wide array of functions and industries. The success of Solomon Page reflects an organic growth strategy supported by a highly entrepreneurial culture. Acting as a strategic partner to our clients and candidates, we focus on providing customized solutions and building long-term relationships based on trust, respect, and the consistent delivery of excellent results.

For more information and additional opportunities, visit: solomonpage.com and connect with us on Facebook, and LinkedIn.

Opportunity Awaits.

#LI-VP2