An application made for this job — a tailored resume and cover letter that speak straight to the posting.
Peregrine is seeking a Data Engineer to design, build, and maintain scalable data pipelines and cloud-based infrastructure that supports reporting, analytics, and decision-making. This role ensures data is collected, transformed, stored, and accessible from multiple sources while maintaining data quality, reliability, and performance.
Collaborate with cross-functional teams to develop efficient data solutions using Python, SQL, and cloud technologies such as AWS and Databricks.
The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and infrastructure that support business reporting, analytics, and decision-making. This role ensures data is collected, transformed, stored, and made accessible from multiple sources while maintaining data quality, reliability, and performance. The Data Engineer also collaborates with cross-functional teams to develop efficient, cloud-based data solutions and continuously improve data processes.
Design, build, and maintain scalable data pipelines and ETL/ELT processes.
Develop and manage data warehouses, data lakes, and databases.
Integrate data from APIs, cloud platforms, third-party systems, and internal databases.
Optimize data architecture for performance, scalability, and cost efficiency.
Ensure data accuracy, integrity, and reliability through monitoring and validation.
Automate data workflows using Python, SQL, and cloud technologies.
Manage and optimize cloud-based data infrastructure (AWS, Azure, Databricks).
Collaborate with business and technical teams to deliver reliable data solutions.
Troubleshoot data issues and support reporting and data extraction requirements.
Document data pipelines, architecture, and technical processes.
Perform testing and validation before production deployment.
Identify opportunities to improve data quality, automation, and operational efficiency.
Bachelor's degree in Computer Science, Computer Engineering, Data Science, Statistics, Information Technology, or a related field.
3–5 years of experience in Data Engineering, Data Integration, or a similar role.
Experience designing and maintaining data pipelines, ETL/ELT processes, and data warehouses.
Strong proficiency in Python (Apache Spark), SQL, and DAX.
Experience with Databricks, AWS, Azure, GitHub, Linux, and Power BI.
Knowledge of data modeling, APIs, data governance, and cloud-based data platforms.
Familiarity with Agile methodologies (Scrum or Kanban).
Strong analytical, problem-solving, and communication skills.
Experience with Dynamics 365 Business Central, LS Central, Microsoft SQL Server, Tableau, JavaScript, HTML, CSS, or AL.
Experience working with file formats such as Parquet, CSV, JSON, SQL, TXT, and XLSX.