Senior Software Engineer - Data Platforms & ML Pipelines

Popular Tech; Irvine (CA); On-site; USD 134,000 - 181,000; Full time

Job summary

Popular Tech in Irvine, CA is seeking a Software Engineer (full-time) to design scalable data frameworks deployed on Kubernetes and AWS Glue. You will automate infra with CDK, CloudFormation, and YAML, and develop backend forecasting workflows with Java and Spark ETL pipelines connected to dashboards.

Successful candidates will have a master's degree in CS/IS/Engineering and experience in migrating legacy databases to Snowflake/Spark pipelines, plus RESTful APIs with cloud services.

Qualifications

• Master's degree in CS, IS or Eng required.
• Experience with distributed data platforms and ETL pipelines.
• Strong programming skills in Java and Spark workflows.

Responsibilities

• Design scalable data frameworks deployed on Kubernetes and AWS Glue.
• Automate infra deployments with CDK, CloudFormation and YAML.
• Develop backend forecasting workflows and production ML integration.
• Create and maintain metadata catalogs and design docs.
• Build Java + Spark ETL pipelines and connect results to dashboards.
• Migrate legacy Oracle/SQL Server data into Snowflake/Spark pipelines.
• Expose RESTful APIs with Azure AI/ML services and deploy Java microservices.
• Produce technical design docs and support operational excellence.

Skills

Kubernetes orchestration

AWS Glue / Spark

Java programming

CI/CD automation

Education

Master's degree in Computer Science

Master's degree in Information Systems

Master's degree in Engineering

Tools

Kubernetes

AWS Glue

Apache Spark

Snowflake

Azure

CloudFormation

CDK

HTML/JavaScript dashboards

Java

RESTful APIs

Job description

Popular Tech in Irvine, CA is seeking a Software Engineer (full-time) to design scalable data frameworks deployed on Kubernetes and AWS Glue. You will automate infra with CDK, CloudFormation, and YAML, and develop backend forecasting workflows with Java and Spark ETL pipelines connected to dashboards.

Successful candidates will have a master's degree in CS/IS/Engineering and experience in migrating legacy databases to Snowflake/Spark pipelines, plus RESTful APIs with cloud services.