Data Engineer - PySpark, Databricks & ETL (MN)

Pi-Square Technologies LLC; Minneapolis (MN); On-site; USD 90,000 - 120,000; Full time

Job summary

Pi-Square Technologies LLC is seeking a Data Engineer in Minnesota to design, develop, and optimize scalable data pipelines and ETL processes using Python, PySpark, SQL, and Databricks. You will work with large-scale datasets, data warehousing, and cloud-based data platforms.

The role demands hands-on experience with Databricks and Delta Lake, plus knowledge of data modeling and big data concepts. Preference for familiarity with CI/CD and DevOps practices for data engineering.

Qualifications

• Proficient in Python, PySpark, SQL and Databricks.
• Experience with large-scale data pipelines, ETL/ELT processes, and data warehousing.
• Knowledge of Data Modeling, Data Warehousing and Big Data concepts.
• Experience with Azure or AWS cloud platforms.

Responsibilities

• Design, develop and optimize scalable data pipelines and ETL processes.
• Improve performance, reliability and maintainability of data workflows.
• Collaborate with data teams on warehousing and modeling requirements.

Skills

Python

PySpark

SQL

Data Modeling

Data Warehousing

Big Data concepts

Cloud platforms

Tools

Databricks

Delta Lake

Spark Optimization

Workflow orchestration

CI/CD for data engineering

Job description

Pi-Square Technologies LLC is seeking a Data Engineer in Minnesota to design, develop, and optimize scalable data pipelines and ETL processes using Python, PySpark, SQL, and Databricks. You will work with large-scale datasets, data warehousing, and cloud-based data platforms.

The role demands hands-on experience with Databricks and Delta Lake, plus knowledge of data modeling and big data concepts. Preference for familiarity with CI/CD and DevOps practices for data engineering.