Research Engineer - Scalable Data Curation Pipelines
DatologyAI
Stand out for this role — generate a tailored resume and cover letter in about a minute.
Benefits offered by this job
Job summary
DatologyAI is seeking a Research Engineer in San Mateo, CA to drive cutting-edge data curation research and translate it into our core product pipeline. You will collaborate with the technical staff to develop scalable data processing and experimentation infrastructure, accelerating research into production-ready systems.
The role requires 3+ years building ML systems, strong Python and PyTorch, and experience with distributed processing and cloud infrastructure.
Qualifications
- 3+ years building ML systems, data infrastructure, or large-scale distributed applications.
- Strong software engineering fundamentals, Python, and PyTorch.
- Experience with distributed data processing and/or distributed training (Spark, Ray, Dask, Snowflake).
- Comfort operating large-scale compute, including GPU clusters and cloud infrastructure.
- Enough ML depth to collaborate with researchers, not just implement their specs.
- Track record of shipping production infrastructure or open-source tools.
Responsibilities
- Build and scale data processing and curation pipelines for massive datasets.
- Design experimentation infrastructure for rapid, scalable iteration.
- Harden research results into production-grade systems used by customers.
- Profile and optimize large-scale training and data workloads.
Skills
Tools
Job description
DatologyAI is seeking a Research Engineer in San Mateo, CA to drive cutting-edge data curation research and translate it into our core product pipeline. You will collaborate with the technical staff to develop scalable data processing and experimentation infrastructure, accelerating research into production-ready systems.
The role requires 3+ years building ML systems, strong Python and PyTorch, and experience with distributed processing and cloud infrastructure.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
