The focus is on executing validated, documented translations not building platform extensions or innovating on tooling. Success = production-ready SQL/Dataiku pipelines handed off to internal teams with clear lineage and zero regression in business logic.
Key Responsibilities:
- 1. Pipeline Translation: Convert R (dplyr/data.table) and Alteryx workflows into modular, optimized SQL (CTEs, window functions, set-based logic) and/or Dataiku visual/SQL recipes prioritizing correctness over elegance.
- 2. Cloud Warehouse Execution: Deploy/test translated logic on one primary cloud platform (Redshift or Snowflake or Athena) no need for multi-cloud expertise.
- 3. Validation & Handoff: Run unit-style validation against source pipelines; document assumptions, lineage, and deployment steps for internal teams.
- 4. Knowledge Transfer: Conduct 2 3 focused sessions (max 1 hr each) walking data science/analytics team members through migrated pipelines and validation reports.
- 5. Documentation: Maintain a living wiki/OneNote page with transformation logic, test results, and known limitations not formal data governance artifacts.
Skills Required Skills:
- 1. Core SQL: Fluency in writing/optimizing queries (JOINs, CTEs, window functions) for cloud warehouses and traditional databases (Redshift/SQL Server).
- 2. Translation Ability: Proven track record converting R/Alteryx logic to SQL or equivalent experiences (KNIME, Informatica, etc).
- 3. Validation Mindset: Comfort building simple row-count/checksum tests to verify migration fidelity.
- 4. Clear Communication: Ability to explain technical steps to non-engineers and document assumptions plainly.
- 5. Self-Starter: Comfort working with minimal daily supervision; flags blockers early.
Skills Preferred Preferred Qualifications (Genuine Bonuses Not Required for Success)
- 1. Familiarity with Dataiku DSS interface (visual recipes, project structure) learnable in < 1 week.
- 2. Exposure to DBT concepts (understands why modular SQL matters for handoff).
- 3. Experience with Git for version control (basic branching/PRs).
Experience Required Experience:
Experience: 2 4 years in data engineering with direct pipeline migration/replatforming experience (e.g., moved Alteryx to Dataiku; converted R to SQL/Python; packaged SQL to DBT, other equivalent experience).