Senior Data Engineer

SpyCloud; Austin (TX); On-site; USD 144,000 - 187,000; Full time

Benefits offered by this job

401(k) with Employer Contribution

Health, Vision, and Dental Insurance

HSA with Employer Contribution

Paid time off

16 paid holidays

Remote-friendly work options

Job summary

SpyCloud in Austin, TX seeks a Senior Data Engineer to lead the architectural transformation of our data platform, collaborating with Product Management, SpyCloud Labs, and Engineering teams to modernize data systems using Databricks and serving customers via RDS, Elasticsearch, and DynamoDB.

You will mentor data engineers, drive AI-ready data pipelines, and own long-term data architecture aligned with the company’s AI-driven goals and security-first practices.

Qualifications

• 8+ years of experience in data engineering or closely related disciplines.
• 2+ years in a technical leadership or senior engineering role.
• Experience building and operating Lakehouse, Databricks, or large-scale distributed data lake architectures in AWS.
• Knowledge of distributed systems as it pertains to data storage and computing.
• Experience building and managing large Elasticsearch/Opensearch data stores.
• Hands-on experience building ETL scripts.
• Hands-on experience preparing and managing data for machine learning and LLM workflows.
• Strong development skills in Python, especially in building data-intensive systems.
• Practical experience using DynamoDB and other AWS-native data services at scale.
• Effective communication and collaboration across technical and non-technical stakeholders.
• Proven ability to mentor and grow engineering talent and lead large-scale initiatives.

Responsibilities

• Redesign and modernize data architecture for scalability, performance, and AI-readiness.
• Use Databricks/Spark to prepare, transform, and serve data to customers.
• Build and optimize real-time and batch data pipelines using AWS tools (Lambda, S3, DynamoDB, ECS, EKS, Terraform).
• Design systems to prepare and serve high-quality data for ML models and LLM applications.
• Optimize cost and performance of daily data ingestion, transformation, and storage workflows.
• Work with Product and Engineering teams to ensure data solutions meet product requirements.
• Evaluate and implement modern tooling for data processing, ML data workflows, and observability.
• Guide and mentor data engineers, championing best practices and technical excellence.
• Ensure operational data quality, security, and reliability across systems.
• Lead long-term data architecture planning aligned with company and AI-driven goals.

Skills

Data engineering

Leadership

Python

Databricks

AWS

Elasticsearch

DynamoDB

ETL pipelines

Education

Bachelor's or Master's in Computer Science/Engineering

Tools

Databricks

Spark

AWS

Lambda

S3

DynamoDB

Elasticsearch/OpenSearch

Job description

SpyCloud is on a mission to make the internet a safer place by disrupting the criminal underground. SpyCloud’s solutions thwart cyberattacks and protect more than 4 billion accounts worldwide. Cybersecurity is an exciting, evolving space, and being at the forefront of the fight to disrupt cybercrime makes SpyCloud a special place to work. If you’re driven to align your career with a fantastic mission, look no further!

As a Senior Data Engineer at SpyCloud, you will lead the architectural transformation of our data systems, working closely with Product Management, SpyCloud Labs, and Engineering teams. Your focus will be on modernizing our data platform utilizing Databricks and serving customers via purpose-built data stores (RDS, Elasticsearch, DynamoDB, etc.). This is a hands‑on, strategic leadership role shaping the future of data at SpyCloud.

What You’ll Do

• Redesign and modernize data architecture for scalability, performance, and AI‑readiness
• Use Databricks/Spark to prepare, transform, and serve data to customers
• Build and optimize real‑time and batch data pipelines using AWS tools (e.g., Lambda, S3, DynamoDB, ECS, EKS, Terraform)
• Design systems to prepare and serve high‑quality data for ML models and LLM applications
• Optimize cost and performance of daily data ingestion, transformation, and storage workflows
• Work with Product and Engineering teams to ensure data solutions meet product requirements
• Evaluate and implement modern tooling for data processing, ML data workflows, and observability
• Guide and mentor data engineers, championing best practices and technical excellence
• Ensure operational data quality, security, and reliability across systems
• Lead long‑term data architecture planning aligned with company and AI‑driven goals

Requirements

• 8+ years of experience in data engineering or closely related disciplines
• 2+ years in a technical leadership or senior engineering role
• Experience building and operating Lakehouse, Databricks, or large‑scale distributed data lake architectures in AWS
• Knowledge of distributed systems as it pertains to data storage and computing
• Experience building and managing large Elasticsearch/Opensearch data stores
• Hands‑on experience building ETL scripts
• Hands‑on experience preparing and managing data for machine learning and LLM workflows
• Strong development skills in Python, especially in building data‑intensive systems
• Practical experience using DynamoDB and other AWS‑native data services at scale
• Effective communication and collaboration across technical and non‑technical stakeholders
• Proven ability to mentor and grow engineering talent and lead large‑scale initiatives

Nice to Have

• Familiarity with AI/ML tools such as SageMaker, LangChain, or vector databases
• Understanding of data governance, privacy, and compliance in AI contexts
• Comfort working in fast‑paced environments with evolving product and technical requirements
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related STEM field
• Experience with password cracking tools

Base Salary Range: $144,000 – $187,000

The salary range reflects the expected base compensation for a fully qualified candidate at this level based on experience, qualifications, and market data at the time of posting.

Benefits

At SpyCloud, we are committed to working alongside individuals who are equally passionate about preventing cybercrime, regardless of their department or role. In addition to our engaging workspace in South Austin, flexible and remote‑friendly work options, and competitive salary package, we offer our employees a comprehensive benefits package that includes:

• 401(k) with Employer Contribution
• Health, Vision, and Dental Insurance
  • Health Savings Account (HSA) available with Employer Contribution
• Employer Paid Life, Short‑term, and Long‑term Disability Insurance
• Generous PTO Plan and 16 paid holidays per year

About SpyCloud

SpyCloud transforms recaptured darknet data to disrupt cybercrime. Its automated identity threat protection solutions use advanced analytics and AI to accelerate investigations and protect workforce, consumer, and supplier identities from the threats that matter most: authentication bypass, session hijacking, malicious insiders, account takeover, ransomware, and fraud. Its data from malware‑infected devices, successful phishes, combolists, and third‑party breaches also powers many popular dark web monitoring and identity theft protection offerings. Customers include 7 of the Fortune 10, along with hundreds of global enterprises, mid‑sized companies, and government agencies worldwide. Headquartered in Austin, TX, SpyCloud is home to more than 250 cybersecurity experts whose mission is to protect businesses and consumers from the stolen identity data criminals are using to target them now.

To learn more and see insights on your company’s exposed data, visit spycloud.com.

Our Mission

Our mission is to make the internet a safer place by disrupting the criminal underground. Together with our customers and partners, we aim to end criminals’ ability to profit from stolen information.

Who We Are

SpyCloud is a place for innovative, collaborative, and problem‑solvers to thrive. Individually, we’re amazing, but together, we’re unstoppable. We celebrate diversity and various perspectives and aim to create an inclusive and supportive environment for all. We are proud to be an Equal Employment Opportunity and affirmative action employer of choice. All aspects of employment decisions will be based on merit, performance, and business needs. We do not discriminate on the basis of any status protected under federal, state, or local law. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. Women, minorities, individuals with disabilities, and protected veterans are encouraged to apply. SpyCloud complies with applicable state and local laws governing nondiscrimination in employment. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

SpyCloud expressly prohibits any form of workplace harassment. Improper interference with the ability of SpyCloud's employees to perform their job duties may result in discipline up to and including discharge. SpyCloud shares the right to work and participates in the E‑Verify program in all locations.

If you need assistance or accommodation due to a disability, you may contact us.

Our Culture

Our culture is something really special. We’re all driven to disrupt the cyber‑criminal economy as we keep customer accounts safe from compromise. We support a truly worthy and serious mission, but we have fun doing it together. If you are driven, inventive, and collaborative, you’ll fit right in.

We will never ask an applicant for sensitive or personal financial information during the recruitment process. We advise all applicants seeking employment with SpyCloud to review available information on recruitment fraud. Anyone who suspects that they have been contacted by someone falsely representing SpyCloud should email [e-mail].

At SpyCloud, we believe in transparency and fairness in compensation. We strive to ensure that all employees are fairly compensated for their contributions, and we openly discuss our compensation philosophy and structure. We are committed to providing competitive salaries and benefits packages to attract and retain top talent, and we encourage open dialogue and feedback regarding compensation matters.

SpyCloud is not sponsoring visas at this time.

Equal Employment Opportunity Statement

SpyCloud is a place for innovative, collaborative, and problem‑solvers to thrive. Individuals are encouraged to apply. We affirm our commitment to equal opportunity and do not discriminate on the basis of any status protected under law. All employment decisions will be made on merit, performance, and business needs.