Senior Data Engineer: Build Scalable Data Pipelines

DaParrot Ltd; United States; Remote; USD 140,000 - 180,000; Full time

Job summary

Socure is seeking a Senior Data Engineer to join our Data Automation team. You will design and build scalable data platforms and pipelines powering identity verification products and analytics.

You will own end-to-end data initiatives, collaborate with Data Science, Product and Engineering, and continuously optimize data workloads on cloud-native platforms. You will also automate data operations, ensure data quality, monitor pipelines, and adopt new technologies to stay fast and reliable.

Qualifications

• 5+ years of hands-on data engineering experience building production-grade data platforms and pipelines.
• Deep experience with distributed data processing frameworks (e.g., Apache Spark).
• Proven experience building data solutions using AWS services (EMR, Lambda, S3).
• Strong understanding of data modeling and data warehousing concepts.
• Experience operating production pipelines including monitoring and incident response.
• Solid foundation in software engineering practices (version control, CI/CD, testing, code reviews).
• Strong communication and collaboration skills across technical and non-technical stakeholders.

Responsibilities

• Design and build batch and streaming data pipelines for ingestion, ML feature engineering, and analytics across product domains.
• Own end-to-end delivery of complex data initiatives, including architecture, testing, deployment, monitoring, and documentation.
• Develop and evolve the data platform to support large-scale data processing using modern cloud-native technologies.
• Automate data operations (validation, quality checks, alerting, backfills, recovery workflows).
• Optimize cost, performance, and reliability of data workloads.
• Partner with cross-functional teams (Data Science, Product, Engineering) to translate requirements into technical solutions.
• Evaluate and adopt new technologies to keep the platform modern and efficient.

Skills

Python/Scala

SQL

Apache Spark

Cloud data platforms

Data modeling

Data warehousing

CI/CD

Communication

Tools

AWS (EMR, Lambda, S3)

Airflow

Step Functions

Job description

Socure is seeking a Senior Data Engineer to join our Data Automation team. You will design and build scalable data platforms and pipelines powering identity verification products and analytics.

You will own end-to-end data initiatives, collaborate with Data Science, Product and Engineering, and continuously optimize data workloads on cloud-native platforms. You will also automate data operations, ensure data quality, monitor pipelines, and adopt new technologies to stay fast and reliable.