Cloud Architect (Data Lake/Data Bricks) SME

Cloud Hybrid Technologies, LLC; Dallas (TX); On-site; USD 120,000 - 150,000; Full time

Job summary

Cloud Hybrid Technologies, LLC is seeking a Cloud Architect (Data Lake/Data Bricks) SME in Dallas, Texas, to enhance cloud architecture strategies with a strong focus on Azure technologies.

The successful candidate will leverage over 15 years of IT architecture experience, assisting with complex system deployments, data migration efforts, and providing strategic advice to client management.

Competitive hourly rates based on experience, with a hybrid work arrangement.

Qualifications

• Strong skills in troubleshooting cloud resource problems.
• Ability to automate solutions to repetitive problems.
• Strong communication skills with team members.

Responsibilities

• Assist with deployment and management of Azure Cloud environment.
• Provide written presentations to client management.
• Assist ETL staff with Cloud best practices.

Skills

Cloud Operations support in Azure

Support for large-scale Cloud environments

Databricks or other Spark-based platforms

Scripting languages: Python, Perl, Ruby

Git integration in continuous deployment

DevOps monitoring tools

Education

15 years IT Architecture/Systems experience

Tools

Apache Spark

Tableau

Hadoop

SQL

Machine Learning

Job description

Job Title

Cloud Architect (Data Lake/Data Bricks) SME

Location

Raleigh, NC / Hybrid (4 Days Onsite/1 Day Remote)

Duration

Long Term

Hourly Rate

Depending on Experience (DOE)

Description

Our Client is seeking a resource well skilled in Cloud architecture to support the following technologies:
Delta Lake storage, Big Data and Machine Learning analytics (e.g., Apache Spark)
to help meet organization priorities.
As a technical expert, provides advice and assistance in state-of-the-art software/hardware solutions involving hardware of various capacities, multiple operating environments, database management systems, specialized software, data communications facilities and protocols including Value Added Networks, fourth generation technologies, and complex software tools or packages.
As a business expert, works with senior client officials to identify enterprise improvement goals, assess organizational and process effectiveness, and implement change strategies.

Roles and Responsibilities

• Minimum 15 years IT Architecture/Systems experience
• 10 years experience designing technical and business solutions, mentoring and training client staff, and overseeing implementation
• Highly diverse technical and industry experience related to systems needs, development, process analysis, design, and reengineering
• Possesses skills and experience related to business management, systems engineering, operations research, and management engineering
• Assist with deployment, configuration, and management of Azure Cloud environment
• Assist with migration efforts of existing ETL jobs into Azure/Databricks cloud environment
• Assist ETL staff with Cloud best practices, efficiency optimization, and knowledge sharing
• Assist with operationalizing deployments and Cloud services for ETL Operations, including automation, documentation, and knowledge articles
• Provide written and oral presentation to high-level client CIO management on status of efforts

Basic Qualifications

• Strong skills and experience in Cloud Operations support in Azure
• Strong experience supporting large-scale/enterprise level Cloud environments
• Strong experience supporting cloud services (compute, network, databases, etc.)
• Experience using Databricks or other Spark-based platforms
• Knowledge/experience with Sqoop, Oozie, Flume
• Fluency in scripting languages: Python, Perl, Ruby (or equivalent)
• Ability to troubleshoot cloud resource problems and perform complex system tests
• Ability to automate solutions to repetitive problems/tasks
• Experience with Git integration in continuous deployment
• Experience with DevOps monitoring tools
• Knowledge of best practices and IT operations in always-up/always-available environments
• Documentation skills for internal procedures and services
• Strong communication skills with team members

Significant experience with

• SAS
• Python
• C++
• Hadoop
• SQL (Database/Coding)
• Apache Spark
• Machine Learning
• Natural Language Processing
• Visualization tools (Tableau)
• Demonstrated experience with unstructured data
• Creative thinking and detail orientation

Desired Skills

• Strong understanding of cloud networking at scale
• Ability to break down complex networking concepts and present concisely
• Shell scripting experience
• PowerShell

Data Transfer Requirements

• The selected resource will conduct knowledge-transfer sessions covering monitoring (Infrastructure and Application-specific), troubleshooting, incident alerting and avoidance, dashboard development, settings and configuration, security, testing of platform/applications, preparing audit compliance reports

Equal Opportunity Statement

Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract