Data Engineer II: Real-Time Pipelines & Lakehouse (Remote)

Built In Austin Inc.; Austin (TX); Hybrid; USD 104,000 - 135,000; Full time

Benefits offered by this job

401(k) with Employer Contribution

Health, Vision, and Dental Insurance

Paid time off and holidays

Remote-friendly work options

Job summary

SpyCloud in Austin, TX is seeking a Data Engineer II to join our engineering team. You will build scalable data pipelines, leverage Databricks and Spark, and manage data stores including DynamoDB, Elasticsearch, and RDS to serve customers.

You'll own complex data initiatives, work with AWS services (Lambda, S3, ECS/EKS), and collaborate with product, security, and analytics teams to improve performance, reliability, and observability.

Qualifications

• 5+ years of data engineering or related work experience.
• Experience designing and operating large-scale data architectures in AWS.
• Hands-on ETL, data pipelines, and ML/LLM data prep experience.
• Strong Python development and AWS-native data services knowledge.

Responsibilities

• Design, build and improve scalable data systems for performance and reliability.
• Use Databricks and Spark to prepare, transform and serve high-quality data.
• Maintain real-time and batch pipelines with AWS tech and Databricks.
• Own complex data initiatives from design to production support.

Skills

Python

Distributed systems

Data engineering

Communication

Education

Bachelor’s or Master’s in CS/Engineering

Tools

Databricks

Spark

Terraform

DynamoDB

Elasticsearch/OpenSearch

S3

Lambda

ECS

EKS

Job description

SpyCloud in Austin, TX is seeking a Data Engineer II to join our engineering team. You will build scalable data pipelines, leverage Databricks and Spark, and manage data stores including DynamoDB, Elasticsearch, and RDS to serve customers.

You'll own complex data initiatives, work with AWS services (Lambda, S3, ECS/EKS), and collaborate with product, security, and analytics teams to improve performance, reliability, and observability.