Senior Data Engineer

Data Co Lab X; United States; Remote; USD 160,000 - 195,000; Full time

Job summary

Socure is hiring a Senior Data Engineer to join its Data Automation team. You will design and build scalable data platforms and pipelines that power Socure’s identity verification products and analytics.

This role is ideal for someone who has a strong passion for solving real business problems with data, and combines hands-on engineering with ownership. You’ll own end-to-end data initiatives, collaborate with Data Science, Product and Engineering, and leverage Python/Scala, SQL, Spark, and AWS

Qualifications

• 5+ years of hands-on data engineering experience building production-grade data platforms and pipelines.
• Proficient in Python or Scala for data processing and SQL for analytics.
• Deep experience with distributed data processing frameworks, notably Apache Spark, with performance tuning.

Responsibilities

• Design and build batch and streaming data pipelines to support automated ingestion, ML feature engineering and analytics.
• Own end-to-end delivery of complex data initiatives, including architecture, implementation, testing, deployment, monitoring and documentation.
• Develop data platform with cloud-native technologies to support large-scale processing.
• Automate data operations (validation, quality checks, alerting, backfills, recovery) to improve reliability.
• Collaborate with Data Science, Product and Engineering to translate requirements into solutions.

Skills

Data Engineering

Apache Spark

AWS

Python

SQL

Data Pipelines

Streaming Data

Data Warehousing

Airflow

CI/CD

Tools

EMR

Lambda

S3

Airflow

Job description

Socure# Senior Data EngineerReview the role, location requirements, compensation details, and application process before deciding whether this opportunity fits your next career move.Apply for this job View companyRemote from: USASalary: USD 160k–195k / yrDepartment: Data Science & AnalyticsEmployment: Full TimeExperience: SeniorPublished: 23 Oct 2026Apply before: 23 Nov 2026Listing views: 811Application actions: 60Application toolkit## Make your next move.Prepare your resume, explore your fit, and draft a cover letter for this opportunity.AI Summary## The role, at a glance.Socure is hiring a Senior Data Engineer for its Data Automation team to build scalable batch and streaming pipelines that support identity verification products, ML feature engineering, and analytics. The role owns ambiguous initiatives end to end, from architecture and implementation through deployment, monitoring, recovery, and documentation. Core requirements include Python or Scala, SQL, Apache Spark, AWS data services, data modeling, and production reliability practices. The engineer will collaborate with Data Science, Product, and Engineering while improving platform cost, performance, and operational automation.## Role DNAA quick view of the complexity, pace, ownership and collaboration implied by the job description.### Job Complexity5/5EasyHard### Pace & Pressure5/5RelaxedFast-paced### Autonomy Level5/5GuidedFull ownership### Communication Load4/5IndependentCollaborative**AI insight**This is a senior, highly autonomous platform role requiring deep distributed-data expertise and ownership of complex production systems. The environment emphasizes rapid execution, ambiguous problem solving, reliability, and cross-functional technical leadership.## Salary analysisEstimated compensation compared with the broader US market for similar roles.Estimated job median (per year)**$177,500**US market range (period not specified)**$150k–$205k****AI insight**Salary comparison is unavailable: the pay periods are unspecified or differ, or salary amounts are unavailable. Market figures are AI estimates. Regenerate the analysis to obtain a market estimate with an explicit period.## Core skillsSkills and capabilities most closely associated with this opportunity.Data EngineeringApache SparkAWSPythonSQLData PipelinesStreaming DataData WarehousingAirflowCI/CD**Sample interview questions**Opportunity details## About this role.### **Why Socure?**Socure is building the identity trust infrastructure for the digital economy — verifying 100% of good identities in real time and stopping fraud before it starts. The mission is big, the problems are complex, and the impact is felt by businesses, governments, and millions of people every day.We hire people who want that level of responsibility. People who move fast, think critically, act like owners, and care deeply about solving customer problems with precision. If you want predictability or narrow scope, this won’t be your place. If you want to help build the future of identity with a team that holds a high bar for itself — keep reading.### About the RoleWe are looking for a Senior Data Engineer to join our Data Automation team. You will play a critical role in designing and building scalable data platforms and pipelines that power Socure’s identity verification products and analytics. This role is ideal for someone who has a strong passion for solving real business problems with data, and combines deep hands-on data engineering expertise with strong ownership.### **What You’ll Do**• Design and build batch and streaming data pipelines to support automated data ingestion, ML feature engineering and analytics across multiple product domains.• Own end-to-end delivery of complex, ambiguous data initiatives, including architecture, implementation, testing, deployment, monitoring, and documentation.• Develop and evolve the data platform to support large-scale data processing using modern cloud-native technologies.• Automate data operations (validation, quality checks, alerting, backfills, and recovery workflows) to reduce manual effort and improve consistency.• Optimize cost, performance, and reliability of data workloads.• Partner closely with cross-functional teams (Data Science, Product, Engineering) to understand requirements, translate them into technical solutions.• Evaluate and adopt new technologies (new processing engines, storage formats, orchestration tools, GenAI-assisted ingestion) to keep the platform modern and efficient.### **What You Bring**• 5+ years of hands-on data engineering experience, building and maintaining production-grade data platforms and pipelines.• Strong programming skills in general-purpose language (such as Python or Scala) for data processing, and SQL for data analytics.• Deep experience with distributed data processing frameworks, such as Apache Spark, including performance tuning and optimization.• Proven experience building data solutions using services on AWS (EMR, Lambda, s3, etc).• Strong understanding of data modeling and data warehousing concepts, including partitioning, schema design for large-scale datasets.• Experience operating and supporting production pipelines, including monitoring, alerting, incident response, and improving reliability over time.• Solid foundation in software engineering practices, including version control, CI/CD, testing strategies, and code review.• Strong communication and collaboration skills, with the ability to work effectively with both technical and non-technical stakeholders.**Preferred Qualifications**• Experience with streaming or near-real-time data processing (Kafka, Kinesis, etc).• Hands-on experience with data orchestration tools (Airflow, Step Functions, etc).• Familiarity with modern data platform patterns such as Data Lakehouse, Data Mesh, and large-scale data sharing across teams.• Experience with prompt engineering using modern GenAI, Large Language Models (LLM).• Experience mentoring other engineers and contributing to engineering-wide standards, best practices.*As a note; Socure cannot provide sponsorship now or in the future for this role.**Socure is an equal opportunity employer that values diversity in all its forms within our company. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. If you need an accommodation during any stage of the application or hiring process—including interview or onboarding support—please reach out to your Socure recruiting partner directly.*