Azure Data Lead/Architect (Databrick + Modeling)

Visionary Innovative Technology Solutions LLC; Mount Laurel Township (NJ); On-site; USD 83,000 - 124,000; Full time

Job summary

A technology solutions provider located in Mount Laurel, NJ is looking for a Recruitment Consultant to design and implement cloud solutions using Azure and Databricks. This role, requiring 10-15 years of data engineering experience, involves collaborating with stakeholders and leading the implementation of data products. A Bachelor's degree in a related field is essential. The position is onsite 4 days a week and is contract-based.

Qualifications

• 10-15 years of experience in data engineering or a related field.
• Extensive experience with Databricks and Apache Spark.
• Strong knowledge of SQL and experience with relational databases.
• Proficiency in Python and SQL.
• Experience with Azure cloud platform.
• Strong data warehousing knowledge (Delta Lake, Lakehouse).
• Understanding of data governance and security best practices.
• Excellent problem-solving and teamwork skills.

Responsibilities

• Design scalable, secure, and high-performance cloud solutions.
• Lead the implementation of Databricks-based solutions.
• Collaborate with stakeholders to gather requirements.
• Lead Databricks-based solution implementations meeting requirements.
• Lead Data Mesh/Data products architecture in Databricks-based solutions.
• Provide technical leadership throughout project lifecycle.
• Lead Azure-based solutions ensuring best practices and business alignment.
• Gater requirements with stakeholders and translate to tech solutions.
• Design and implement CI/CD pipelines using Azure DevOps.
• Ensure robust security including identity, encryption, and network security.
• Optimize cloud resources for performance, cost, and reliability.
• Stay updated with latest Azure services and industry trends.

Skills

Technical Architecture

Cloud Solutions

Data Engineering

Python

SQL

SQL

Python

Data Warehousing

Delta Lake

Lakehouse

Azure DevOps

Education

Bachelor’s degree in computer science, Engineering, or related field

Tools

Azure

Databricks

Apache Spark

Job description

Overview

Recruitement Consultant at Visionary Innovative Technology Solutions LLC

Location - Mount Laurel, NJ Onsite (4 days a week)

Duration - 6+ Month

Primary and Secondary Skillsets

Primary skillset: Technical Architect / Lead | Azure, Databricks, Apache Spark/PySpark, Data Modeling

Secondary skillset: SQL, Python, Datawarehouse

Job Description

• Design scalable, secure, and high-performance cloud solutions on Microsoft Azure services
• Design large-scale data processing and analytics solutions using Azure Databricks.
• Develop comprehensive architecture blueprints and technical documentation for data solutions.
• Lead the implementation of Databricks-based solutions, ensuring alignment with best practices and business requirements.
• Lead Data Mesh/Data products architecture building in Databricks-based solutions
• Provide technical leadership and guidance throughout the project lifecycle.
• Lead the implementation of Azure-based solutions, ensuring alignment with best practices and business requirements.
• Collaborate with stakeholders to gather requirements and translate them into technical solutions.
• Design and implement CI/CD pipelines using Azure DevOps.
• Ensure robust security measures are in place, including identity management, encryption, and network security.
• Optimize cloud resources for performance, cost, and reliability.
• Stay updated with the latest Azure services, features, and industry trends.

Qualifications

• Bachelor’s degree in computer science, Engineering, or a related field.
• 10-15 years of experience in data engineering or a related field.
• Extensive experience with Databricks and Apache Spark.
• Proficiency in programming languages such as Python
• Strong knowledge of SQL and experience with relational databases.
• Experience with cloud platforms Especially in Azure
• Strong with data warehousing solutions (e.g., Delta Lake, Lakehouse)
• Understanding of data governance and security best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and teamwork skills.

Seniority level

• Associate

Employment type

• Contract

Job function

• Analyst
• Industries: Advertising Services

Referrals increase your chances of interviewing at Visionary Innovative Technology Solutions LLC by 2x

Note: Sign in to set job alerts for “Architect” roles.