Data Engineering Lead for Scalable AI Pipelines (Remote)
Innowhyte Inc
14 days+
Application generator
Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.
Get past ATS filters
Benefits offered by this job
Job summary
A technology company is seeking a skilled Data Engineering Lead/Architect to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in data engineering, with strong skills in Python, cloud platforms like AWS or GCP, and data pipeline frameworks. This role offers the flexibility to work from home and involves collaboration with cross-functional teams to drive impactful data projects. Competitive compensation and opportunities for career growth are included.
Qualifications
- Minimum 5+ years of hands-on experience in data engineering or related roles.
- Proven expertise in handling large-scale data systems.
- Familiarity with Generative AI (GenAI) and AI/ML technologies.
Responsibilities
- Design, develop, and maintain robust data pipelines for analytics.
- Collaborate with teams to implement data-driven solutions.
- Optimize data storage systems for reliability and performance.
Skills
Python programming
Data pipelines
Cloud platforms
Data processing libraries (e.g., Pandas, PySpark)
Version control
Education
Bachelor's or Master’s degree in Computer Science, Engineering
Tools
Apache Airflow
Kafka
Spark
Job description
A technology company is seeking a skilled Data Engineering Lead/Architect to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in data engineering, with strong skills in Python, cloud platforms like AWS or GCP, and data pipeline frameworks. This role offers the flexibility to work from home and involves collaboration with cross-functional teams to drive impactful data projects. Competitive compensation and opportunities for career growth are included.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
