Data Architect

Nityo Infotech; Plano (TX); On-site; USD 110,000 - 150,000; Full time

Job summary

Nityo Infotech is seeking a data engineering-focused consultant with expertise in technology consulting, enterprise architecture, and the Hadoop ecosystem (Hadoop, Hive, Scala, SPARK, Sqoop, Flume, Kafka, Python, NoSQL). The role requires understanding of distributed architectures, high availability, workload management, and ETL/ELT framework design for large data warehouses and data marts.

Candidates should be proficient in REST APIs, JSON, XML, and microservice architectures, with hands-on

Qualifications

• Experience in technology consulting, enterprise and solutions architecture.
• Experience with Hadoop ecosystem: Hadoop, Hive, Scala, SPARK, Sqoop, Flume, Kafka, Python, NoSQL databases.
• Understanding Hadoop architecture: high availability, workload management, scalability, distributed platform architecture.
• Experience designing and implementing ETL/ELT frameworks for complex warehouses/marts; handling large data sets and performance tuning.

Skills

Technology consulting

Enterprise architecture

Architectural frameworks

Cloudera Hadoop ecosystem

Hadoop components (Hive, Scala, SPARK)

ETL/ELT design and implementation

Big data processing

REST APIs, JSON, XML

Microservice architecture

Parallel data processing

Data flows

NoSQL databases

Education

Bachelor's degree or foreign equivalent

Job description

Required Skill and Experience

• Experience in technology consulting, enterprise and solutions architecture and architectural frameworks
• Experience in Cloudera Hadoop ecosystem, i.e. Hadoop, Hive, Scala, SPARK, Sqoop, Flume, Kafka, Python, NoSQL database technologies
• Understanding and knowledge of Hadoop architecture and various components such as high availability architecture, experience in workload management, scalability and distributed platform architecture
• Experience with design and implementation of ETL/ELT framework for complex warehouses/marts. Knowledge of large data sets and experience with performance tuning and troubleshooting
• Background in all aspects of software engineering with strong skills in parallel data processing, data flows, REST APIs, JSON, XML, and micro service architecture

Preferred Skill and Experience

• Experience in working in any hyperscalers, AWS, Azure, GCP, Databricks and Snowflake
• Experience in data virtualization/data federation for creating data product (e.g. in Starburst) in heterogenous environment (Hadoop, RDBMS, NoSQL etc.)
• Hands-on development mentality, with a willingness to troubleshoot and solve complex problems

Additional Required Qualifications

• Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• This position may require relocation and/or travel to work/project location.