Data Engineer - Build Scalable Pipelines & Data Lakes

Air Apps; San Francisco (CA); On-site; USD 105,000 - 145,000; Full time

Benefits offered by this job

Apple hardware ecosystem

Annual Bonus

Medical Insurance

Disability insurance

401k up to 4% contribution

Air Conference

Transportation budget

Free meals

Gym membership

Job summary

A forward-thinking technology company in San Francisco is seeking a skilled Data Engineer to design and optimize data pipelines, ensuring efficient data processing and analytics. The ideal candidate has strong experience in SQL, Python, and cloud-based solutions, along with a passion for tackling large-scale data challenges within a diverse environment. This position includes competitive perks such as medical insurance, gym membership, and an annual bonus.

Qualifications

• 4+ years of experience in data engineering, software engineering, or database management.
• Strong understanding of data modeling and database optimization.
• Experience with big data frameworks (Apache Spark, Hadoop, Kafka) is a plus.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Develop and optimize data warehouses and lakes.
• Collaborate with data engineers and analysts to ensure data accessibility.

Skills

SQL

Python

Data modeling

ETL processes

Cloud-based data solutions

Problem-solving

Tools

AWS Redshift

Apache Airflow

dbt

Talend

Fivetran

Apache Spark

Docker

Kubernetes

Job description

A forward-thinking technology company in San Francisco is seeking a skilled Data Engineer to design and optimize data pipelines, ensuring efficient data processing and analytics. The ideal candidate has strong experience in SQL, Python, and cloud-based solutions, along with a passion for tackling large-scale data challenges within a diverse environment. This position includes competitive perks such as medical insurance, gym membership, and an annual bonus.