The Data Engineer is responsible for collecting, managing, and converting raw data into information that can be interpreted by Data Scientists and Business Analysts. Data accessibility is the ultimate goal; which enables our organization to utilize data for performance evaluation and optimization.
What You'll Be Doing
- Implement pipelines to move raw data in Azure Synapse using spark, python, SQL and C# in line with well-established architectural standards related to Data Warehouse and Data Lakehouse modeling standards.
- Develop machine learning and regression analysis skills in spark-python-pandas, openai and Azure ML.
- Employ Azure Devops and Git in line with the Software Development Life Cycle best practices.
- Interpret requirements provided by Business and Data Analysts.
- Act as a liaison with Business Analysts and Testing teams to promote smooth development execution.
- Triage and troubleshoot perceived data aberrations submitted by the user community.
- Other duties as assigned.
What We're Looking For
- 2+ years of practical or collegiate experience (or equivalent) in Python related to data engineering (spark, pandas, etc).
- 2+ years of practical or collegiate experience (or equivalent) in SQL related to data engineering (or equivalent collegiate experience / certifications).
- Solid understanding of the Software Development Life Cycle.
- Good data analytics background.
- Motivated individual looking to expand their knowledge in all areas of Data Engineering, Analytics and AI.
Bonus Points
- Microsoft Cloud Certification
- Familiarity with machine Learning and AI
Education
- Bachelor's Degree or Relevant Certifications & equivalent years of experience