Senior Data Engineer: Data Architecture & Platform Lead

Early Warning Services LLC; San Francisco (CA); Hybrid; USD 180,000 - 230,000; Full time

Job summary

Early Warning Services LLC in the United States seeks a senior software leader to drive data strategy, architecture, and production delivery across complex platforms.

You will own features, guide cross‑functional engineering efforts, and collaborate with product managers, designers, and other teams to implement scalable solutions, optimize performance, and ensure reliability at scale.

Qualifications

• Bachelor’s degree in computer science or related technical field.
• 8+ years of software development experience with at least 7 years in complex data platforms, distributed systems, and cloud solutions.
• Experience with data warehousing (Star/Snowflake), Big Data platforms, real-time and batch processing.
• Experience in developing business intelligence solutions and operationalizing AI/ML models.
• Strong knowledge of modern engineering practices (CI/CD, testing, secure coding), SDLC, Agile, Scrum, and DevOps.
• Proficiency with SQL Server or equivalent, Big Data frameworks (HDFS, Spark, PySpark, R), and cloud platforms (GCP, AWS, Azure).
• Experience with event-driven architecture, messaging frameworks (Kafka, RabbitMQ, Pub/Sub).
• Excellent communication skills and ability to influence in a collaborative environment.
• Attention to detail and proven ability to deliver business-critical systems.

Responsibilities

• Build data strategy for broad or complex requirements, providing forward‑looking insights that solve large open‑ended problems.
• Participate in strategic development of methods, techniques, and evaluation criteria for projects and programs.
• Drive technical and data architecture, design, prototyping, and implementation to support product needs and overall technology strategy.
• Lead technical planning, backlog creation, and execution of design and build through to production delivery.
• Represent engineering in cross‑functional teams, presenting thoughtful arguments to influence stakeholders.
• Collaborate with product managers, designers, and other engineering groups to conceptualize and build new features.
• Own features or systems, define long‑term health and continuously improve surrounding systems.
• Assist support and operations teams in identifying and resolving production issues.
• Develop and implement tests to ensure quality, performance, and scalability of applications.
• Continuously improve engineering practices, tooling, and processes.

Skills

Data architecture

Distributed systems

Cloud platforms

Big Data processing

Communication & influence

Education

Bachelor's degree in computer science or related technical field

Tools

SQL Server

HDFS

Spark

PySpark

R

Kafka

Pub/Sub

Job description

Early Warning Services LLC in the United States seeks a senior software leader to drive data strategy, architecture, and production delivery across complex platforms.

You will own features, guide cross‑functional engineering efforts, and collaborate with product managers, designers, and other teams to implement scalable solutions, optimize performance, and ensure reliability at scale.