Senior Data Engineer - Remote India | Databricks & Airflow

Vytwo; Prosper (TX); Remote; USD 100,000 - 130,000; Full time

Job summary

A data solutions firm is seeking a Senior Data Engineer to design and maintain scalable data pipelines using Python and SQL. The ideal candidate will have over five years of experience and hands-on knowledge of Databricks or Snowflake. Responsibilities include optimizing data processing frameworks and collaborating with teams to deliver data solutions. This position offers opportunities for professional growth in a dynamic and innovative environment.

Qualifications

• 5+ years of experience in data engineering or software engineering.
• Hands-on experience with Databricks or Snowflake.
• Experience with orchestration tools like Apache Airflow.
• Advanced SQL skills with experience in OLTP and OLAP data modeling.
• Familiarity with data governance tools, especially Microsoft Purview.

Responsibilities

• Design and maintain scalable data pipelines using Python and PySpark.
• Build and optimize data processing frameworks on Databricks or Snowflake.
• Implement robust data models for analytics and reporting.
• Develop high-quality SQL code with focus on performance tuning.
• Collaborate with cross-functional teams for scalable data solutions.

Skills

Data engineering

Python programming

SQL

OLTP and OLAP data modeling

Cloud ecosystems

Tools

Databricks

Snowflake

Apache Airflow

Microsoft Purview

Job description

A data solutions firm is seeking a Senior Data Engineer to design and maintain scalable data pipelines using Python and SQL. The ideal candidate will have over five years of experience and hands-on knowledge of Databricks or Snowflake. Responsibilities include optimizing data processing frameworks and collaborating with teams to deliver data solutions. This position offers opportunities for professional growth in a dynamic and innovative environment.