Data Engineer: Scalable Pipelines, Spark & Snowflake

Robotics Technologies; San Jose (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

Robotics Technologies is hiring a Data Engineer for an onsite role in San Jose, CA. You will design and deliver scalable data pipelines and processing solutions across sources and cloud platforms to support analytics and BI needs.

You will collaborate with data analysts, scientists, and stakeholders, building reliable, secure data systems. The work spans ETL/ELT, large-scale processing, warehouse modeling, and production support within Agile/Scrum.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field required.
• Experience building data pipelines and ETL/ELT solutions.
• Strong programming in Python, SQL, and PySpark.
• Experience with cloud data platforms and data warehousing technologies.
• Understanding of data modeling and data integration concepts.
• Excellent analytical, problem-solving, and communication skills.

Responsibilities

• Designed, developed, and maintained scalable data pipelines from multiple sources.
• Built ETL/ELT workflows using Python, SQL, PySpark, and Azure Data Factory.
• Created and optimized data processing solutions with Apache Spark and Databricks.
• Working with structured and unstructured data from relational databases, REST APIs, flat files, and cloud storage.
• Implemented data integration aligned to BI and analytics requirements.
• Developed complex SQL queries, stored procedures, views, and functions.
• Implemented data validation, cleansing, transformation, and data quality checks.
• Built and maintained data warehouses, data marts, and dimensional data models.
• Integrated data from enterprise systems using REST APIs and connectors.
• Monitored pipelines, diagnosed failures, and resolved performance issues.
• Applied incremental loading, partitioning, and optimization techniques.

Skills

Python

SQL

PySpark

Azure Data Factory

Snowflake

Databricks

REST APIs

Git

Azure DevOps

Power BI

Education

Bachelor’s degree in Computer Science, Information Technology, or a related field

Tools

Azure Data Factory

Informatica

SSIS

Snowflake

Databricks

Job description

Robotics Technologies is hiring a Data Engineer for an onsite role in San Jose, CA. You will design and deliver scalable data pipelines and processing solutions across sources and cloud platforms to support analytics and BI needs.

You will collaborate with data analysts, scientists, and stakeholders, building reliable, secure data systems. The work spans ETL/ELT, large-scale processing, warehouse modeling, and production support within Agile/Scrum.