Databricks Pyspark ETL Developer_Bangalore/Remote

Vsquare Systems; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Vsquare Systems is seeking a Data Engineer to design and implement robust data pipelines using PySpark, Spark SQL, Python, and Databricks/Snowflake in a modern cloud environment. You will work with data lakes, data warehouses, and both batch and streaming processes to deliver reliable analytics-ready datasets.

The ideal candidate has 4+ years in data engineering or ETL, strong SQL, and a proactive problem-solving mindset.

Qualifications

• 4+ years of experience as a Data Engineer or ETL Developer.
• Hands-on PySpark, Apache Spark, Spark SQL, and Python.
• Expertise in Databricks and/or Snowflake.
• Strong ETL design, data transformation, and data integration.
• Experience with Data Lakes, Data Warehouses, and Big Data technologies.
• Knowledge of distributed computing, parallel processing, and data partitioning concepts.
• Strong SQL skills with experience in performance tuning and query optimization.
• Experience working with batch and streaming data processing.
• Excellent analytical, debugging, and problem-solving skills.
• Strong verbal and written communication skills.

Skills

PySpark

Apache Spark

Spark SQL

Python

Databricks

Snowflake

ETL design

Data Lakes/warehouses

SQL performance tuning

Batch & streaming

Problem solving

Communication

Job description

Required Skills

• 4+ years of experience as a Data Engineer or ETL Developer.
• Strong hands-on experience with PySpark, Apache Spark, Spark SQL, and Python.
• Expertise in Databricks and/or Snowflake.
• Strong understanding of ETL design, data transformation, and data integration.
• Experience with Data Lakes, Data Warehouses, and Big Data technologies.
• Knowledge of distributed computing, parallel processing, and data partitioning concepts.
• Strong SQL skills with experience in performance tuning and query optimization.
• Experience working with batch and streaming data processing.
• Excellent analytical, debugging, and problem-solving skills.
• Strong verbal and written communication skills.

Preferred Skills

• Experience with cloud platforms such as AWS or Azure.
• Knowledge of Hadoop ecosystem and modern data engineering technologies.
• Experience with API integration and data ingestion from multiple data sources.
• Familiarity with CI/CD pipelines and Agile development methodologies.
• Exposure to enterprise-scale data engineering projects.

Why Join Us?

• Opportunity to work on cutting-edge Big Data and Cloud Data Engineering projects.
• Exposure to modern technologies including PySpark, Databricks, Snowflake, and distributed computing.
• Collaborative work environment with strong learning, innovation, and career growth opportunities.