Data Architect

Compunnel Inc.; Aliso Viejo (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

Compunnel Inc. seeks a Senior Data Architect to design and implement enterprise-scale data architectures, including ingestion, management, delivery, and consumption. You will lead data integration, warehousing, and lake solutions while enabling analytics via Power BI, Tableau, or D3.

You will design cloud-based big data solutions on AWS/Azure/GCP, define information architectures, ensure data quality, security, and governance, and guide cross-functional teams toward strategic data roadmaps.

Qualifications

• Proficiency in designing, developing, and implementing data architecture for a large enterprise in two areas: Ingestion, Management, Delivery, or Consumption.
• Strong knowledge of data modeling, data governance, and data quality practices.
• Experience with cloud data platforms and big data technologies.
• Ability to lead architecture discussions and create roadmaps for data initiatives.

Responsibilities

• Architect, design, and implement high-performance, large-volume data integration, transformation, warehouse, and data lake solutions.
• Analyze, report, and visualize data from data warehouses using Power BI, Tableau, or D3.
• Design and implement cloud big data solutions on AWS, Azure, GCP, or Hadoop ecosystems.
• Plan information architecture, define backup, recovery, and security requirements.

Skills

Data Ingestion

Data Management

Data Delivery

Data Consumption

Python

Java

Power BI

Tableau

D3

SQL

NoSQL

Unix

Windows

Tools

AWS

Azure

GCP

Hadoop

MapReduce

Hive

Pig

PowerPoint

Visio

Job description

JOB SUMMARY

Design, develop, and implement data architecture for a large enterprise, focusing on two of the following areas: Data Ingestion, Data Management, Data Delivery, Data Consumption.

Key Responsibilities

• Architect, design, and implement high-performance, large-volume data integration, transformation, warehouse, and data lake solutions.
• Analyze, report, and visualize data from data warehouses using tools such as PowerBI, Tableau, or D3.
• Design and implement cloud big data solutions on platforms like AWS, Azure, GCP, or Apache Hadoop.
• Plan information architecture by studying site concepts, strategy, domain, and target audience; design information structure and features, evaluate information representation, and specify backup, recovery, and security.
• Focus on customer engagement to improve service and build solutions collaboratively.
• Provide end-to-end technical guidance and roadmaps for Sales & Marketing.
• Validate team estimates.
• Hold certification in Architect/Big Data specialty in AWS, Azure, or GCP, with experience in architecting Big Data solutions on other cloud and Big Data platforms.
• Develop and deliver long-term strategic goals for data architecture vision and standards.
• Create short-term tactical solutions to achieve long-term objectives and data management roadmaps.
• Establish processes for governing the identification, collection, and use of corporate data assets and metadata, ensuring accuracy and validity.
• Establish methods and procedures for tracking data quality, completeness, redundancy, and improvement.
• Ensure data strategies and architectures meet regulatory compliance requirements.
• Engage external stakeholders, including standards organizations, regulatory bodies, operators, and scientific research communities.
• Ensure business needs for operational data and reporting data are met.
• Establish governance, stewardship, and frameworks for managing data across the organization.
• Develop and promote data management methodologies and standards.
• Select and implement appropriate tools, software, applications, and systems to support data technology goals.
• Collaborate with project managers and business teams on all projects involving enterprise data.
• Address data-related issues with systems integration, compatibility, and multi-platform integration.
• Act as a leader and advocate for data management, including coaching and training.
• Develop and implement key components as needed to create testing criteria to guarantee the fidelity and performance of data architecture.
• Document the data architecture and environment to maintain an accurate view of the larger data picture.
• Identify and develop opportunities for data reuse, migration, or retirement.
• Perform data architecture design reviews.
• Identify opportunities for optimization of cost, time, and asset utilization in complex projects and advise relevant teams.
• Provide advice to teams facing complex technical issues during project delivery.
• Conduct planned and unplanned technical audits for complex projects.
• Define and measure project and program-specific architectural and technology quality metrics.
• Provide inputs for team training.
• Identify training needs and conduct internal sessions.
• Partner with UST Gamma to create curriculum, assessments, training programs, and courseware based on new service offerings and solutions.
• Update collateral in the knowledge management repository.
• Gain and cultivate domain expertise to provide optimized solutions to customers.
• Understand requirements from a larger system/transformation program context.
• Validate cross-application/cross-technology requirements for interoperability and reconciliation of conflicting requirements with customers and stakeholders.
• Provide support to project managers in identifying team training needs.
• Conduct training/certifications and mentoring on technical skills for projects.
• Support technical evaluation of external and internal candidates.
• Perform career guidance and performance management for team members.
• Identify alliance partners based on service offerings and client requirements.
• Identify areas for joint Go-to-Market (GTM) with partners.
• Develop internal capabilities/complementary toolsets to support GTM strategies.
• Maintain relationships with partners.
• Act as the technical POC for specific technology/solution areas.
• Define problem statements for customers.
• Analyze application/technology landscapes, processes, and tools to arrive at suitable solution options.
• Analyze cost vs. benefits of solution options.
• Define technology/architecture roadmaps for clients.
• Articulate cost vs. benefits of options to key stakeholders.
• Participate in external forums.
• Interact and engage with customers/partners on innovative ideas, concepts, assets, and industry trends.
• Participate in beta testing of products and joint lab setups to explore new technologies.
• Identify areas for component/accelerator or design pattern reuse across accounts.
• Create documents, reports, and white papers on research findings.
• Develop collaterals for proposals.
• Compare various designs and propose appropriate technology solutions based on RFP understanding and architect inputs.
• Calculate and present estimates based on high-level designs to management.
• Review estimations and resource plans.
• Review risk and mitigation plans.
• Participate in client presentations and visits.
• Ensure alignment of high-level architecture with client needs and business logic; review designs prepared by architects.
• Ensure appropriate teams are involved in data design.
• Ensure technical interoperability and requirements compliance, especially in multi-group/multi-vendor programs.
• Involve external partners/horizontals as appropriate.
• Provide guidance to the team on data architecture usage and experience in solution implementation, product selection, configuration, migration, and transformations between cloud and hosted solutions.
• Take responsibility for developing cutting-edge wallet applications.
• Ensure architecture principles and Quality of Architecture (QOA) are maintained.
• Analyze trade-offs and provide recommendations on data architecture.
• Identify opportunities for efficiency improvements.
• Understand work streams and technologies necessary for large programs.
• Resolve issues based on industry expertise/partner leverage.
• Provide best-in-class technology and solution options to customers with detailed examples and case studies.
• Guide customers on process and technology improvements for agility and quick results.
• Proactive identification and management of technical risks.
• Build credibility with clients as a technical go-to person.
• Expand professional networks within client organizations.
• Identify potential opportunities for new service offerings.
• Support the development of business cases for investment.
• Work with partners to co-develop joint GTM strategies.
• Develop IP/tools and frameworks to address opportunities technically.
• Lead beta testing/POC as applicable.
• Develop collaterals and guides for GTM.

Required Qualifications

• Proficiency in designing, developing, and implementing data architecture for a large enterprise in two of the following: Data Ingestion, Data Management, Data Delivery, Data Consumption.
• Skill Examples:
• Understanding of technology trends.
• Knowledge of Architecture Concepts and Principles.
• Independent knowledge of Design Patterns, Tools, and Principles.
• Knowledge of Software Development Process Tools & Techniques.
• Knowledge of Project Management & Agile Tools and Techniques.
• Knowledge of Project Metrics.
• Knowledge of Estimation and Resource Planning.
• Knowledge of Knowledge Management Tools & Techniques.
• Knowledge of Technical Standards, Documentation & Templates.
• Knowledge of Requirement Gathering and Analysis.
• Strong proficiencies in understanding data, workflows, and dataflows.
• Attention to detail.
• High Analytical capabilities.
• Creativity in developing solutions.
• Self-learning ability.
• Resilience in solving problems.
• Knowledge Examples:
• Domain knowledge, understanding domain data.
• Applied Mathematics and Statistics.
• Skilled in writing design documents, usage of Power Point, Visio.
• Data visualization, streaming.
• Data migration.
• Data modelling, vector and Graphs.
• RDBMSs (relational database management systems), SQL.
• Databases such as NoSQL and cloud computing.
• Hadoop technologies, like MapReduce, Hive, and Pig.
• Programming languages, especially Python and Java.
• Operating systems, including UNIX and MS Windows.
• Cloud solutions.
• Backup/archival software.
• Understanding of data security.

Preferred Qualifications

• Experience in architecting Big Data solutions on other cloud and Big Data platforms.
• Ability to re-engineer existing architecture solutions under guidance.
• Provide training on best practices in architecture under guidance.
• Evaluate multiple design options and choose appropriate options for best possible trade-offs.
• Conduct knowledge sessions to enhance team's design capabilities.
• Review low and high-level designs for efficiency and maintainability.
• Implement global standards and guidelines relevant to programming and development.
• Come up with 'points of view' and new technological ideas.
• Support, plan, and manage medium-sized projects/programs.
• Take technical responsibility for all stages in the software development process.
• Conduct optimal coding with a clear understanding of memory leakage and its impact.
• Leverage existing material/reusable assets in the knowledge repository.
• Independently create and update knowledge artifacts.
• Create and track project-specific KT plans.
• Provide training to others.
• Write white papers/blogs at an internal level.
• Write technical documents/user understanding documents at the end of the project.
• Create documentation appropriate for the project needs.
• Create documentation appropriate for reusable assets/best practices/case studies.
• Support the creation of requirements documents or user stories and high-level process maps.
• Identify gaps based on business processes and analyze responses to clarification questions.
• Produce design documents.
• Create and review estimates and solutions at the project/program level.
• Create and review design artifacts.
• Update resourcing and schedule based on impacted areas identified.
• Create designs specifically for non-functional requirements.

Certifications

• Architect/Big Data specialty certification in one of AWS, Azure, or GCP.