Engineering Manager, Web Indexing & Scale

Socket.dev; Santa Clara (CA); On-site; USD 200,000 - 280,000; Full time

Job summary

Socket.dev is seeking an Engineering Manager to lead the indexing infrastructure team responsible for scalable web and image search. You will oversee offline batch pipelines and near-real-time indexing, coordinating across distributed computing, data processing, and storage, while partnering with crawling, ranking, ML, and infrastructure groups to shape long-term indexing strategy.

You will own both technical direction and execution for two core systems: offline indexing processing petabytes of

Qualifications

• Significant experience building large-scale distributed systems or data infrastructure.
• Engineering management experience leading software teams.
• Strong grasp of distributed systems, large-scale data processing, and storage.
• Experience with distributed batch processing (e.g., MapReduce-style models).
• Track record leading multi-team technical initiatives and influencing without direct authority.
• Strong communication skills for technical topics with senior leadership.
• BS in CS or related field, or equivalent experience.

Responsibilities

• Own technical direction and execution for core indexing systems: offline and real-time indexing for billions of documents and images.
• Lead engineers across distributed computing, data processing, and storage; collaborate with crawling, ranking, ML, retrieval, and infrastructure teams.
• Drive architecture tradeoffs, scalability, reliability, and efficiency; resolve cross-team dependencies and drive programs to completion.
• Present strategy, risks, and resourcing to senior leadership; act as a liaison for indexing initiatives.

Skills

Distributed systems

Engineering management

Cross-team collaboration

Communication with leadership

MapReduce-style processing

Education

BS in CS or related field

Tools

Spark

Beam

Flink

Kafka

Bigtable

HBase

Cassandra

Job description

Socket.dev is seeking an Engineering Manager to lead the indexing infrastructure team responsible for scalable web and image search. You will oversee offline batch pipelines and near-real-time indexing, coordinating across distributed computing, data processing, and storage, while partnering with crawling, ranking, ML, and infrastructure groups to shape long-term indexing strategy.

You will own both technical direction and execution for two core systems: offline indexing processing petabytes of