Remote Snowflake Data Engineer for AI/ML Pipelines

Pyramid It Consulting; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Pyramid It Consulting is seeking a Snowflake Data Engineer to design, build, and operate scalable data pipelines in a remote setting. You will work with Snowflake, Databricks, Python, SQL, and Spark to ingest, model, and govern data for analytics, AI/ML, and Generative AI initiatives.

You will partner with Data Science and Analytics teams to create trusted data foundations, implement security controls, RBAC, data masking, and CI/CD, and optimize performance and cost across cloud platforms.

Qualifications

• Hands-on experience with Snowflake and/or Databricks in enterprise environments.
• Proficient in SQL, Python, Spark/PySpark and data warehousing concepts.
• Experience building secure data products with RBAC and data masking.
• Knowledge of AI/ML data lifecycles, GenAI, and MLOps basics.
• Familiarity with cloud platforms (Azure/AWS/GCP) and CI/CD tooling.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using Snowflake and Databricks.
• Build ingestion frameworks for batch, incremental, CDC, APIs, and files.
• Design data warehouse/lakehouse models with star schemas and dimensional modeling.
• Optimize Snowflake/Databricks solutions for performance and cost.
• Create AI/ML-ready datasets and pipelines for analytics and GenAI use cases.
• Partner with Data Science/AI teams for feature engineering and MLOps.
• Implement RBAC, row/column security, data masking, and data protection.
• Enforce data quality, lineage, governance, and monitoring controls.
• Establish Git/CI-CD, automated testing, and production support practices.
• Collaborate with business, analytics, architecture, cybersecurity and governance teams.

Skills

Snowflake

Databricks

SQL

Python

Spark/PySpark

Cloud platforms

RBAC

Data masking

PII protection

AI/ML concepts

CI/CD

Git

Tools

Delta Lake

MLflow

Snowflake Cortex/Snowpark

Databricks Unity Catalog

Data catalogs

Job description

Pyramid It Consulting is seeking a Snowflake Data Engineer to design, build, and operate scalable data pipelines in a remote setting. You will work with Snowflake, Databricks, Python, SQL, and Spark to ingest, model, and govern data for analytics, AI/ML, and Generative AI initiatives.

You will partner with Data Science and Analytics teams to create trusted data foundations, implement security controls, RBAC, data masking, and CI/CD, and optimize performance and cost across cloud platforms.