Data Architect (Freelancer)

Soul Ai; Dadri; Remote; INR 1.800.000 - 2.800.000; Teilzeit

Benefits dieser Stelle

Remote work opportunity

Elite data community access

Zusammenfassung

Soul AI seeks top-tier Data Architects to design and optimize enterprise-scale data platforms, integrating diverse sources and enabling real-time analytics and ML workloads. You will build real-time and batch pipelines, enforce governance, and optimize cloud-based data infrastructure for security, cost, and performance.

Remote/hybrid opportunities with client-site options across India. Ideal candidates have hands-on experience with Kafka, Spark, Hadoop, Flink, and cloud ecosystems

Qualifikationen

• Strong experience in designing scalable, distributed data systems and programming (Python, Scala, Java).
• Expertise with Apache Spark/Hadoop/Flink/Kafka and cloud platforms (AWS/Azure/GCP).
• Proficient in data modeling, governance, and security/compliance (GDPR, HIPAA).
• Hands-on with CI/CD (Terraform, CloudFormation, Airflow, Kubernetes) and data infra optimization.

Aufgaben

• Design and architect enterprise-scale data platforms, integrating diverse data sources and tools.
• Develop real-time and batch data pipelines to support analytics and ML.
• Define and enforce data governance strategies ensuring security, integrity, and cost-efficient cloud pipelines.
• Implement real-time streaming solutions (Kafka, AWS Kinesis, Apache Flink) and DevOps/DataOps best practices.

Kenntnisse

Data architecture design

Programming: Python/Scala/Java

Apache Spark/Hadoop/Flink/Kafka

Cloud platforms AWS/Azure/GCP

Data modeling & governance

CI/CD (Terraform/CloudFormation/Airflow

Kubernetes

Security/compliance (GDPR/HIPAA)

Tools

Snowflake

Redshift

BigQuery

Jobbeschreibung

Step into the world of AI innovation with the Experts Community of Soul AI (By Deccan AI).

We are looking for Indias top 1% Data Architects for a unique job opportunity to work with the industry leaders.

Who can be a part of the community.

We are looking for top-tier Data Architects who are proficient in designing, building and optimizing data pipelines.

If you have experience in this field then this is your chance to collaborate with industry leaders.

Whats in it for you.

Pay above market standards.

The role is going to be contract based with project timelines from 2 12 months, or freelancing.

Be a part of an Elite Community of professionals who can solve complex AI challenges.

Work location could be.

• Remote (Highly likely).
• Onsite on client location.
• Deccan AIs OfficeHyderabad or Bangalore.

Responsibilities.

• Design and architect enterprise-scale data platforms, integrating diverse data sources and tools.
• Develop real-time and batch data pipelines to support analytics and machine learning.
• Define and enforce data governance strategies to ensure security, integrity, and compliance along with optimizing data pipelines for high performance, scalability, and cost efficiency in cloud environments.
• Implement solutions for real-time streaming data (Kafka, AWS Kinesis, Apache Flink) and adopt DevOps/DataOps best practices.

Required

Skills:

• .Strong experience in designing scalable, distributed data systems and programming (Python, Scala, Java) with expertise in Apache Spark, Hadoop, Flink, Kafka, and cloud platforms (AWS, Azure, GCP).
• Proficient in data modeling, governance, warehousing (Snowflake, Redshift, Big Query), and security/compliance standards (GDPR, HIPAA).
• Hands-on experience with CI/CD (Terraform, Cloud Formation, Airflow, Kubernetes) and data infrastructure optimization (Prometheus, Grafana).

Nice to Have.

• Experience with graph databases, machine learning pipeline integration, real-time analytics, and IoT solutions.
• Contributions to open-source data engineering communities.