Azure Databricks Lead Engineer for Big Data & ML (Atlanta)

Syren; Atlanta (GA); On-site; USD 90,000 - 130,000; Part time

Job summary

A tech company seeks an Azure Data Engineer to design and maintain data infrastructure. The role involves collaborating with teams to meet data needs and requires extensive experience in data modeling and Azure cloud solutions. Candidates should have strong skills in Python and Databricks. This contract position is ideal for individuals with a mid-senior level background in Information Technology, preferably in Software Development.

Qualifications

• 10+ years of hands-on experience with data modeling, database design, data mining, and segmentation techniques.
• Working knowledge and experience with Cloud Architectures (e.g., SaaS, PaaS, IaaS).
• Experience dealing with structured and unstructured data.

Responsibilities

• Design and implement data infrastructure within the organization.
• Analyze structural requirements and ensure efficient database solutions.
• Collaborate with business and IT teams to unlock the full potential of data.

Skills

Migrating from other platform to Databricks

Databricks and Azure Cloud

Data Streaming and Data Modeling

Architecting large-scale big data projects

Data scaling and its complexities

Data Archiving and Purging mechanisms

Python and PySpark

Education

Degree in computer science or equivalent

Job description

A tech company seeks an Azure Data Engineer to design and maintain data infrastructure. The role involves collaborating with teams to meet data needs and requires extensive experience in data modeling and Azure cloud solutions. Candidates should have strong skills in Python and Databricks. This contract position is ideal for individuals with a mid-senior level background in Information Technology, preferably in Software Development.