Job Title: Senior Data Engineer
Location: Remote – Latin America (Must be able to work within U.S. time zones)
Type of Contract: Full-Time | Remote | Contractor
Salary Range: Market Rates
Key Responsibilities
- Build and maintain Snowflake-based evaluation pipelines to measure the accuracy of new datasets independently and in combination with existing data sources.
- Implement statistical evaluation metrics, including correlation and mean absolute error (MAE), to compare estimated company revenue against reported results.
- Optimize Snowflake performance and compute costs through warehouse sizing, clustering, materialization strategies, query optimization, and data pruning.
- Develop automated processes to collect, map, validate, and maintain ground truth company revenue data.
- Implement data quality checks, reconciliation rules, and monitoring systems to identify inconsistencies and maintain reliable downstream reporting.
- Evaluate new datasets, investigate data quality issues, and build pipelines capable of processing large-scale, full transaction-level histories.
- Own the end-to-end data engineering lifecycle, making technical decisions, improving existing prototypes, and adapting the solution to evolving project requirements.
Must-Have Qualifications
- 6+ years of professional experience in Data Engineering, with Snowflake as a primary data platform.
- Proven hands‑on experience optimizing Snowflake warehouses, storage, and query execution for performance and cost efficiency in production environments.
- Strong SQL and Python skills, with the ability to design, build, maintain, and troubleshoot end‑to‑end data pipelines.
- Experience building and optimizing pipelines that process very large datasets, including complete transaction-level histories rather than sampled data.
- Practical experience with data quality engineering, including data validation, reconciliation, monitoring, and ongoing reliability improvements.
- Demonstrated ability to troubleshoot complex data issues, investigate inconsistencies, and deliver reliable, production-ready data solutions.
- Ability to work within U.S. time zones and collaborate effectively with distributed teams.
Preferred Qualifications
- Experience working with financial, market, transaction-level, or time-series data.
- Familiarity with statistical evaluation metrics, including correlation and mean absolute error (MAE), and their application to data accuracy assessments.
- Experience integrating and maintaining third‑party data feeds, including working with data licensing and data‑sharing arrangements.
- Hands‑on experience with dbt or similar data transformation frameworks in Snowflake environments.
- Experience developing ground truth datasets and comparing estimated values against reported or verified results.
- Experience taking existing prototypes or proof‑of‑concept solutions and evolving them into scalable, reliable production systems.