Data Engineer

Pi-Square Technologies LLC; Minneapolis (MN); On-site; USD 90,000 - 120,000; Full time

Job summary

Pi-Square Technologies LLC is seeking a Data Engineer in Minnesota to design, develop, and optimize scalable data pipelines and ETL processes using Python, PySpark, SQL, and Databricks. You will work with large-scale datasets, data warehousing, and cloud-based data platforms.

The role demands hands-on experience with Databricks and Delta Lake, plus knowledge of data modeling and big data concepts. Preference for familiarity with CI/CD and DevOps practices for data engineering.

Qualifications

• Proficient in Python, PySpark, SQL and Databricks.
• Experience with large-scale data pipelines, ETL/ELT processes, and data warehousing.
• Knowledge of Data Modeling, Data Warehousing and Big Data concepts.
• Experience with Azure or AWS cloud platforms.

Responsibilities

• Design, develop and optimize scalable data pipelines and ETL processes.
• Improve performance, reliability and maintainability of data workflows.
• Collaborate with data teams on warehousing and modeling requirements.

Skills

Python

PySpark

SQL

Data Modeling

Data Warehousing

Big Data concepts

Cloud platforms

Tools

Databricks

Delta Lake

Spark Optimization

Workflow orchestration

CI/CD for data engineering

Job description

Data Engineer

Location: Minnesota (MN)

Job Description:We are seeking an experienced Data Engineer with strong expertise in Python, PySpark, SQL, and Databricks to design, develop, and optimize scalable data pipelines and ETL processes. The ideal candidate should have hands‑on experience working with large‑scale datasets, data warehousing, and cloud‑based data platforms.

Required Skills:

• Strong experience in Python and PySpark
• Expertise in SQL and database performance tuning
• Hands‑on experience with Databricks
• Experience building and maintaining ETL/ELT pipelines
• Knowledge of Data Modeling, Data Warehousing, and Big Data concepts
• Experience with cloud platforms such as Azure or AWS
• Strong problem‑solving and analytical skills

Preferred Skills:

• Experience with Delta Lake, Spark Optimization, and workflow orchestration tools
• Knowledge of CI/CD and DevOps practices for data engineering

Pi-square technologies is a Michigan (USA) Headquartered Automotive Embedded Engineering Services company, Synergy Partner for major OEMs and Tier 1s and their implementation partners in Automotive Embedded Product Development, Projects, Requirements Analysis, Software Design, Software Implementation, Efficient Build, Release Process, and turnkey software V & V Services. We have more than 20+ years of industry expertise with specialization in the latest cutting‑edge automotive technologies such as Infotainment, connected vehicles, Cyber security, OTA, and Advanced Safety/ Body electronics.