Data Engineering Lead for Scalable AI Pipelines (Remote)

Innowhyte Inc; Irvine (CA); Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Flexible work from home

Direct interaction with CXO team

Career growth opportunities

Job summary

A technology company is seeking a skilled Data Engineering Lead/Architect to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in data engineering, with strong skills in Python, cloud platforms like AWS or GCP, and data pipeline frameworks. This role offers the flexibility to work from home and involves collaboration with cross-functional teams to drive impactful data projects. Competitive compensation and opportunities for career growth are included.

Qualifications

• Minimum 5+ years of hands-on experience in data engineering or related roles.
• Proven expertise in handling large-scale data systems.
• Familiarity with Generative AI (GenAI) and AI/ML technologies.

Responsibilities

• Design, develop, and maintain robust data pipelines for analytics.
• Collaborate with teams to implement data-driven solutions.
• Optimize data storage systems for reliability and performance.

Skills

Python programming

Data pipelines

Cloud platforms

Data processing libraries (e.g., Pandas, PySpark)

Version control

Education

Bachelor's or Master’s degree in Computer Science, Engineering

Tools

Apache Airflow

Kafka

Spark

Job description

A technology company is seeking a skilled Data Engineering Lead/Architect to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in data engineering, with strong skills in Python, cloud platforms like AWS or GCP, and data pipeline frameworks. This role offers the flexibility to work from home and involves collaboration with cross-functional teams to drive impactful data projects. Competitive compensation and opportunities for career growth are included.