Sr. Data Engineer

Park Place Technologies; Grand Rapids (MI); On-site; USD 120,000 - 180,000; Full time

Job summary

Park Place Technologies is seeking a Senior Data Engineer to design and build data pipelines, turning raw data into actionable insights for data scientists and business analysts. You will mentor junior engineers, implement Azure Synapse pipelines with Spark, Python, SQL and C#, and collaborate with analysts to ensure data quality and governance.

Candidates should have 4+ years in Python and SQL for data engineering, a solid SDLC background, and experience with data warehouse and delta lake

Qualifications

• 4+ years of Python development related to data engineering (spark, pandas, etc.).
• 4+ years of SQL related to data engineering.
• Experience designing and implementing complex data pipelines ensuring data quality & consistency.
• Solid understanding of data warehouse and delta lake design concepts.
• Solid data analytics background.
• Solid understanding of the Software Development Life Cycle.

Responsibilities

• Implementing pipelines to move raw data in Azure Synapse using spark, python, SQL and C# in line with established architectural standards related to Data Warehouse and Data Lakehouse modeling standards.
• Developing machine learning and regression analysis skills in spark-python-pandas, openai and Azure ML.
• Mentoring other members of the Data Engineering team, specifically those in a junior role
• Work closely with Data Analysts and Business Analysts to clarify their requirements and provide clear guidance on the execution process.
• Providing peer review support to work produced by others, confirming use of relevant coding standards.
• Demonstrate mastery of the Software Development Life Cycle.

Skills

Python development

SQL

Data pipelines

Delta Lake

Data warehouse

SDLC

Data analytics

C#

Spark

Azure Synapse

Pandas

Education

Bachelor’s Degree or Relevant Certifications & equivalent years of experience

Tools

Azure Synapse

Spark

Python

SQL

C#

Job description

Senior Data Engineer

The Senior Data Engineer is responsible for collecting, designing, and converting complex data into information that can be interpreted by Data Scientists and Business Analysts. Data accessibility is the ultimate goal, which enables our organization to utilize data for performance evaluation and optimization. As a Senior Data Engineer, one of your primary responsibilities is to guide and mentor junior Data Engineers to ensure they have the necessary skills and knowledge to perform their tasks effectively. This includes setting up guardrails and protocols that help the team achieve their goals efficiently while maintaining the quality of their work. Your role is crucial in ensuring the team's success, as you play a significant part in streamlining their workflow and maximizing their productivity.

What You’ll Be Doing

• Implementing pipelines to move raw data in Azure Synapse using spark, python, SQL and C# in line with established architectural standards related to Data Warehouse and Data Lakehouse modeling standards.
• Developing machine learning and regression analysis skills in spark-python-pandas, openai and Azure ML.
• Mentoring other members of the Data Engineering team, specifically those in a junior role
• Work closely with Data Analysts and Business Analysts to clarify their requirements and provide clear guidance on the execution process.
• Providing peer review support to work produced by others, confirming use of relevant coding standards.
• Demonstrate mastery of the Software Development Life Cycle.

What We’re Looking For

• 4+ years of experience in Python development related to data engineering (spark, pandas, etc.).
• 4+ years of experience in SQL related to data engineering.
• Experience in designing and implementing complex data pipelines ensuring data quality & consistency.
• Solid understanding of data warehouse and delta lake design concepts
• Solid data analytics background
• Solid understanding of the Software Development Life Cycle

Bonus Points

• Microsoft Cloud Certification
• Familiarity with Machine Learning and AI
• Web Development is a plus.

Education

• Bachelor’s Degree or Relevant Certifications & equivalent years of experience