Snowflake Data Engineer- Remote position

Pyramid It Consulting; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Pyramid It Consulting is seeking a Snowflake Data Engineer to design, build, and operate scalable data pipelines in a remote setting. You will work with Snowflake, Databricks, Python, SQL, and Spark to ingest, model, and govern data for analytics, AI/ML, and Generative AI initiatives.

You will partner with Data Science and Analytics teams to create trusted data foundations, implement security controls, RBAC, data masking, and CI/CD, and optimize performance and cost across cloud platforms.

Qualifications

• Hands-on experience with Snowflake and/or Databricks in enterprise environments.
• Proficient in SQL, Python, Spark/PySpark and data warehousing concepts.
• Experience building secure data products with RBAC and data masking.
• Knowledge of AI/ML data lifecycles, GenAI, and MLOps basics.
• Familiarity with cloud platforms (Azure/AWS/GCP) and CI/CD tooling.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using Snowflake and Databricks.
• Build ingestion frameworks for batch, incremental, CDC, APIs, and files.
• Design data warehouse/lakehouse models with star schemas and dimensional modeling.
• Optimize Snowflake/Databricks solutions for performance and cost.
• Create AI/ML-ready datasets and pipelines for analytics and GenAI use cases.
• Partner with Data Science/AI teams for feature engineering and MLOps.
• Implement RBAC, row/column security, data masking, and data protection.
• Enforce data quality, lineage, governance, and monitoring controls.
• Establish Git/CI-CD, automated testing, and production support practices.
• Collaborate with business, analytics, architecture, cybersecurity and governance teams.

Skills

Snowflake

Databricks

SQL

Python

Spark/PySpark

Cloud platforms

RBAC

Data masking

PII protection

AI/ML concepts

CI/CD

Git

Tools

Delta Lake

MLflow

Snowflake Cortex/Snowpark

Databricks Unity Catalog

Data catalogs

Job description

Role: Snowflake Data engineer

Location : Remote

Shift Timings : 2-11 PM IST

Skills:

We are seeking a Data Engineer to design, build, and support scalable enterprise data solutions using Snowflake and Databricks. The role will focus on data ingestion, data modeling, secure data products, and building trusted data foundations for analytics, AI/ML, and Generative AI use cases.

Key Responsibilities

• Design and develop scalable ETL/ELT data pipelines using Snowflake, Databricks, SQL, Python, Spark/PySpark, and cloud technologies.
• Build ingestion frameworks for batch, incremental, CDC, API, and file-based data sources.
• Design data warehouse/lakehouse models, including fact/dimension models, star schemas, historical data, and curated data products.
• Develop and optimize solutions using Snowflake and Databricks, including performance, scalability, reliability, and cost.
• Build AI/ML-ready datasets and pipelines supporting predictive analytics, forecasting, anomaly detection, Generative AI, RAG, and AI Agents.
• Partner with Data Science/AI teams to support feature engineering, model development, deployment, and MLOps.
• Design and implement RBAC, row-level and column-level security, dynamic data masking, and secure views.
• Protect sensitive and PII data through least-privilege access, classification, encryption, masking, and auditing.
• Implement data quality, reconciliation, metadata, lineage, monitoring, and governance controls.
• Establish Git/CI-CD, automated testing, monitoring, and production support practices.
• Collaborate with business, analytics, architecture, cybersecurity, privacy, and governance teams.

Required Skills

• Strong hands-on experience with Snowflake and/or Databricks.
• Advanced SQL, Python, Spark/PySpark skills.
• Experience with ETL/ELT, APIs, CDC, data warehousing, data lakes, and lakehouse architectures.
• Strong knowledge of dimensional data modeling and enterprise data architecture.
• Experience implementing RBAC, data masking, row/column-level security, and PII protection.
• Understanding of AI/ML, GenAI, RAG, AI Agents, and ML lifecycle concepts.
• Experience with Azure, AWS, or GCP, Git, and CI/CD.
• Strong analytical, troubleshooting, and communication skills.

Preferred

Experience with Snowflake Cortex/Snowpark, Databricks Unity Catalog, Delta Lake, MLflow, data catalogs, lineage, and AI/ML platforms. Snowflake and/or Databricks certifications are a plus.