Technical Architect-Data Analytics

Cloud Analytics Technologies, LLC; Dallas (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

CLOUD ANALYTICS TECHNOLOGIES LLC seeks a senior data engineering professional with deep experience in big data, Azure Databricks, and cloud data platforms. You will drive ingestion, transformation, and analytics pipelines, collaborating with business stakeholders and IT teams to define scope and timelines.

You will document architectures, enforce security/governance standards, and promote best practices in code quality, data security, and scalability, while mentoring a team of data engineers.

Qualifications

• Over 12 years of IT experience with 4 years in data ingestion and transformation pipelines.
• Proficient in Azure Databricks notebooks and Delta Lake.
• Strong knowledge of Azure Data Lake, Synapse, Data Factory and Fabric.
• Experience with ETL/ELT, data warehousing, and building data lakes.
• SQL skills with NoSQL familiarity.
• Experience with CI/CD pipelines and Git.

Responsibilities

• Understand requirements with stakeholders and define scope for engagement with reasonable timelines.
• Document architecture processes while ensuring security and governance compliance.
• Ensure best practices for code quality, data security and scalability are followed.
• Stay updated with Databricks and related technologies to drive innovation.
• Lead and mentor a team of data engineers.
• Manage customer calls and communication with stakeholders.

Skills

Big data concepts

Data engineering

Azure Databricks

SQL

NoSQL

CI/CD pipelines

Git

Leadership

Communication

Cloud computing

Tools

Databricks

Delta Lake

Azure Data Lake Storage Gen2

Azure Synapse

Azure Data Factory

Fabric

Databricks SQL

Git

Excel

Power BI

Job description

1The ideal candidate will have a good understanding of bigdatatechnologiesdataengineering and cloud computing DWH Projects with a focus on AzureDatabricks

2Work closely with business stakeholders and other IT teams to understand requirements and define the scope for engagement with reasonable timeline

3Ensure proper documentation of architecture processes while ensuring compliance with security and governance standards

4Ensure best practices are followed by team in terms of code qualitydatasecurity and scalability

5Stay updated with the latest developments inDatabricksand associated technologies to drive innovation

6Positive attitude and excellent communication skills to manage customer calls Excellent problemsolving skills Good communication Team collaboration

Overall 12 years of experience along with 5 years ofdata Analyticsproject experience

Experience with AzureDatabricksnotebook development and Delta Lake

Good understanding of Azure services like AzureDataLake Azure Synapse and AzureDataFactory Fabric

Experience with ETLELT processesdatawarehousing and buildingdatalakes

SQL skills and familiarity with NoSQL databases

Experience with CICD pipelines and version control systems like Git

Soft Skills

Excellent communication skills with the ability to explain complex technical concepts to nontechnical stakeholders

Strong problemsolving skills and a proactive approach to identifying and resolving issues

Leadership skills with the ability to manage and mentor a team ofdataengineers

Nice to have Skills

Power BI for dashboarding and reporting

Microsoft Fabric foranalyticsand integration tasks

Spark Streaming for processing realtimedatastreams

Experience

1Over 12 years of IT experience including 4 years specializing in developingdataingestion and transformation pipelines using DatabricksSynapse notebooks and AzureDataFactory

2Good understanding on different domainindustries with respect todata Analyticsproject DWH projects

3Should be good in Excel and Power Point

4Good understanding and experience with Delta tables Delta Lake and AzureDataLake Storage Gen2

5Experience in building and optimizing query layers usingDatabricksSQL

6Familiarity with modern CICD practices especially in the context ofDatabricksand cloudnative solutions

CLOUD ANALYTICS TECHNOLOGIES is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. CLOUD ANALYTICS TECHNOLOGIES will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will CLOUD ANALYTICS TECHNOLOGIES require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

Equal Opportunity Employer

CLOUD ANALYTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. CLOUD ANALYTICS TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will CLOUD ANALYTICS TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

Some of our Business Ventures - Knowledge Analytics

Do restrictive necessities, your capability for advanced analytics or your business model need custom-made applications and infrastructure configurations? opt for our hosted managed services to urge comprehensive analytics solutions supported industry-leading Cloud Analytics Technologies, LLC code - delivered by the Cloud Analytics Technologies, LLC consultants UN agency understand these solutions best. Through a mix of with-it technology and dedicated service and support, Cloud Analytics Technologies, LLC hosted managed services will facilitate you: