Data Engineer in Sunnyvale CA

IDC Technologies; Santa Clara (CA); On-site; USD 100,000 - 130,000; Full time

Job summary

A technology company in California is seeking experienced Python engineers with a strong background in data engineering. Candidates must be proficient in Python and have knowledge of data structures and algorithms, as well as experience with data platforms like Apache Presto and AWS Athena. The role involves writing data collection scripts and implementing storage technologies. Familiarity with tools such as Docker and Kubernetes is a plus, and candidates will interact with the engineering team during the interview process.

Qualifications

• Strong knowledge of data engineering concepts and practices.
• Excellent problem-solving skills in algorithm development.
• Experience with modern data platforms and workflow tools.

Responsibilities

• Write data collection scripts and aggregation algorithms.
• Implement storage technologies for business intelligence operations.
• Collaborate with existing engineering team during interviews.

Skills

Python

Data Engineering

Data Structures

Algorithms

Tools

Docker

Kubernetes

Apache Airflow

Apache Presto

AWS Athena

Job description

Please focus on spark/Pyspark with data experience.

Must Have Skills : Python , Data Engineering

Nice to have : Docker , Kuebernetes

Looking for experiencedPython engineers with a background in data engineering. Should be familiar with modern data platforms likeApache PrestoorAWS Athena, andworkflow tools like Apache Airflow.

Engineers will write data collection scripts, aggregation algorithms, and implement storage technologies that power our internal business intelligenceoperations.

Candidates are expected to be excellent engineers and will be interviewed by our existing engineering team. Please do not submit candidates who do not have strong knowledge of algorithms and data structures, and a track record of shipping high quality software

Qualifications

Additional Information

All your information will be kept confidential according to EEO guidelines.