Data Architect – Databricks, Big Data & AI Enablement

Xoriant US Staffing; Edison (NJ); Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Be at the forefront of AI innovation

Work with a team of experts

Influence strategic decisions

Job summary

A leading data solutions firm is seeking an experienced Data Architect in Edison, NJ. You will lead the design and development of modern data platforms that support AI initiatives. Candidates should have over 8 years of relevant experience, strong skills in cloud technologies, and familiarity with big data ecosystems like Databricks and Snowflake. This full-time position requires 2-3 days onsite each week.

Qualifications

• 8+ years of experience in data architecture focused on cloud-native solutions.
• Proven experience with cloud platforms, Databricks, and Snowflake.
• Strong programming skills in Scala or Python.

Responsibilities

• Architect and design end-to-end data platforms on cloud.
• Lead the implementation of data layers including ingestion and processing.
• Provide technical leadership on big data technologies.

Skills

Data architecture

Cloud-native solutions

Big data technologies

Scala programming

Python programming

IAM and data governance

Stakeholder management

Technical presentations

Tools

Databricks

Snowflake

Spark

Delta Lake

Azure

AWS

GCP

Job description

Overview

About the Role

We are seeking a highly experienced Data Architect to lead the design, development, and scaling of modern data platforms that serve as the foundation for enterprise AI and Gen AI initiatives. This role requires deep expertise in cloud technologies, big data ecosystems, and platforms like Databricks and Snowflake. You will act as a strategic technical advisor, helping organizations build robust, secure, and cost-optimized data architectures that drive business outcomes.

Responsibilities

• Architect and design end-to-end data platforms on cloud (Azure, AWS, or GCP) with a focus on scalability, performance, and cost-efficiency.
• Lead the implementation of data layers including ingestion, storage, processing, semantic, and consumption layers.
• Provide technical leadership on big data technologies (Spark, Delta Lake, Kafka, etc.) and modern data platforms (Databricks, Snowflake).
• Develop and optimize data pipelines using Scala or Python.
• Ensure data governance, security, IAM (Identity and Access Management), and compliance are embedded into the architecture from day one.
• Provide deployment support and drive cost optimization strategies across data workloads and cloud services.
• Support handling of unstructured data (e.g., documents, images, audio, video) to enable Gen AI use cases such as retrieval-augmented generation (RAG), document intelligence, and intelligent search.
• Collaborate with business and technical stakeholders to align data strategies with AI and analytics goals.
• Work closely with sales and pre-sales teams to position Data & AI solutions, contribute to proposals, and support client engagements.
• Stay current with emerging technologies and industry trends to continuously improve the data platform strategy.

Required Qualifications

• 8+ years of experience in data architecture, with a strong focus on cloud-native and big data solutions.
• Proven experience with Databricks, Snowflake, and cloud platforms (Azure, AWS, or GCP).
• Strong programming skills in Scala or Python for data engineering.
• Deep understanding of Spark, Delta Lake, and distributed data processing.
• Experience with IAM, data security, governance frameworks, and compliance standards (e.g., GDPR, HIPAA).
• Demonstrated experience working with unstructured data for Gen AI applications.
• Proven ability to support sales cycles, including technical presentations and solutioning.
• Excellent communication and stakeholder management skills.

Preferred Qualifications

• Experience working in consulting or advisory roles with enterprise clients.
• Familiarity with AI/ML pipelines and how data architecture supports model development and deployment.
• Certifications in cloud platforms or data engineering (e.g., Azure Data Engineer, AWS Big Data Specialty).

Why Join Us?

• Be at the forefront of data-driven transformation and AI innovation.
• Work with a team of passionate experts in Data & AI.
• Influence strategic decisions and shape the future of enterprise data platforms.

Location and Employment

Location: Edison, NJ (2-3 days onsite)

Department: Data & AI

Employment Type: Full-time