Technical Architect-Data Analytics

Cloud Analytics Technologies, LLC; Dallas (TX); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Equal opportunity employer

Support for minorities and veterans

Job summary

A technology consulting firm is seeking a Data Engineer specializing in Azure Databricks to oversee big data technologies and cloud computing projects. The candidate will engage with stakeholders to manage requirements and ensure adherence to best practices in data engineering. Candidates must have extensive experience with Azure services and strong leadership skills to mentor junior engineers. This opportunity offers the chance to innovate along with a competitive compensation package.

Qualifications

• Overall 12 years of experience along with 5 years of data analytics project experience.
• Experience with Azure Databricks notebook development and Delta Lake.
• Good understanding of Azure services like Azure Data Lake, Azure Synapse, and Azure Data Factory.

Responsibilities

• Work closely with stakeholders to define the scope of engagements.
• Ensure documentation of architecture processes and compliance with standards.
• Stay updated with the latest developments in Databricks technologies.

Skills

Data engineering

Cloud computing

SQL

Azure Databricks

Problem-solving

Communication

Education

12+ years of IT experience

Experience with Azure Databricks

Tools

Azure Data Factory

Power BI

Delta Lake

Git

Job description

Overview

The ideal candidate will have a good understanding of big data technologies, data engineering and cloud computing DWH projects with a focus on Azure Databricks.

Responsibilities

• Work closely with business stakeholders and other IT teams to understand requirements and define the scope for engagement with a reasonable timeline.
• Ensure proper documentation of architecture processes while ensuring compliance with security and governance standards.
• Ensure best practices are followed by the team in terms of code quality, data security and scalability.
• Stay updated with the latest developments in Databricks and associated technologies to drive innovation.

Qualifications

• Overall 12 years of experience along with 5 years of data analytics project experience.
• Experience with Azure Databricks notebook development and Delta Lake.
• Good understanding of Azure services like Azure Data Lake, Azure Synapse and Azure Data Factory.
• Experience with ETL/ELT processes, data warehousing and building data lakes.
• SQL skills and familiarity with NoSQL databases.
• Experience with CI/CD pipelines and version control systems like Git.
• Experience with Delta tables, Delta Lake and Azure Data Lake Storage Gen2.
• Experience in building and optimizing query layers using Databricks SQL.
• Familiarity with modern CI/CD practices, especially in the context of Databricks and cloud-native solutions.

Soft Skills

• Excellent communication skills with the ability to explain complex technical concepts to non-technical stakeholders.
• Strong problem-solving skills and a proactive approach to identifying and resolving issues.
• Leadership skills with the ability to manage and mentor a team of data engineers.

Nice to have Skills

• Power BI for dashboarding and reporting.
• Microsoft Fabric for analytics and integration tasks.
• Spark Streaming for processing real-time data streams.

Experience

1. Over 12 years of IT experience including 4 years specializing in developing data ingestion and transformation pipelines using Databricks, Synapse notebooks and Azure Data Factory.
2. Good understanding on different domain industries with respect to data analytics project and DWH projects.
3. Should be good in Excel and Power Point.
4. Good understanding and experience with Delta tables, Delta Lake and Azure Data Lake Storage Gen2.
5. Experience in building and optimizing query layers using Databricks SQL.
6. Familiarity with modern CI/CD practices, especially in the context of Databricks and cloud-native solutions.

CLOUD ANALYTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. CLOUD ANALYTICS TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will CLOUD ANALYTICS TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract.

Equal Opportunity Employer

CLOUD ANALYTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. CLOUD ANALYTICS TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will CLOUD ANALYTICS TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract.

Some of our Business Ventures - Knowledge Analytics

Do restrictive necessities, your capability for advanced analytics or your business model need custom-made applications and infrastructure configurations? Opt for our hosted managed services to urge comprehensive analytics solutions supported by Cloud Analytics Technologies, LLC, delivered by the Cloud Analytics Technologies, LLC consultants. Through a mix of with-it technology and dedicated service and support, Cloud Analytics Technologies, LLC hosted managed services will facilitate you.