Azure Data Engineer & Architect: Build Scalable Pipelines

Atyeti; Princeton (NJ); On-site; USD 100,000 - 130,000; Full time

Job summary

A data solutions company based in New Jersey is seeking an experienced Azure Data Engineer to assure data optimization and develop solutions using Microsoft Azure services. Candidates should ideally have experience with data pipelines, strong analytic skills with unstructured datasets, and a solid understanding of various Azure technologies. The role involves automating tasks, deploying code, and maintaining data structures within the organization, ensuring high quality and performance in data processes.

Qualifications

• Previous experience as an Azure Data Engineer or similar role.
• Experience building and optimising big data data pipelines.
• Strong analytic skills related to unstructured datasets.
• Ability to design and implement well written code.
• Ability to work to tight deadlines.
• Ability to test data from source to presentation layer.
• Ability to support and troubleshoot data pipelines.
• Confident communication skills, driving alignment and collaboration.

Responsibilities

• Assure that data is cleansed, mapped, and optimised for storage.
• Develop and maintain innovative Azure solutions.
• Solution design using Microsoft Azure services.
• Automate tasks and deploy production standard code.
• Load transformed data into various reporting structures.
• Build data pipelines to collectively bring together data.
• Extract data and maintain the data warehouse.

Skills

Python

SQL

NoSQL

Scala

Spark-SQL

Azure ADLS

Azure Databricks

Stream Analytics

SQL DW

COSMOS DB

Analysis Services

Azure Functions

Serverless Architecture

ARM Templates

Job description

A data solutions company based in New Jersey is seeking an experienced Azure Data Engineer to assure data optimization and develop solutions using Microsoft Azure services. Candidates should ideally have experience with data pipelines, strong analytic skills with unstructured datasets, and a solid understanding of various Azure technologies. The role involves automating tasks, deploying code, and maintaining data structures within the organization, ensuring high quality and performance in data processes.