Data Specialist - R01568669

Brillio; Bengaluru; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

Brillio seeks a Data Specialist to join its data engineering team in Bengaluru. The role focuses on building robust data pipelines and managing data quality across cloud and on‑prem sources, leveraging Spark, SQL, and modern ETL tools.

Candidates should have 5+ years in data engineering, hands‑on experience with Spark, PySpark, Hadoop/Hive, Python/Scala, and Databricks; familiarity with Airflow and API integration; and a strong Unix scripting background. Onsite four days a week in Bengaluru.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering or a similar role.
• Proficiency in Apache Spark, PySpark, and AWS EMR.
• Strong experience with Apache Hadoop, Hive, and SQL (Postgres-SQL).
• Advanced programming skills in Python and Scala.
• Solid understanding of UNIX systems and shell scripting.
• Databricks knowledge and experience.
• Functional understanding of API.
• Experience with data storage and retrieval from S3 and Elasticsearch.
• Knowledge of ETL tools like Airflow and Autosys.
• Familiarity with version control systems (Git, SVN).
• Basic understanding of HTML for web development tasks.
• Strong SQL skills for data querying and manipulation.
• Experience with API development and integration.

Skills

ETL Fundamentals

SQL

BigQuery

Dataproc

Python

Data Catalog

Data Warehousing

Composer

Dataflow

Cloud Storage

Datafusion

Spark

PySpark

PostgreSQL

T-SQL

Stored Procedures

Unix Scripting

Databricks

API

Airflow

Autosys

Git

SVN

HTML Basics

Scala

Education

Bachelor’s or Master’s degree in CS/Engineering

Tools

AWS EMR

Apache Hadoop

Hive

Databricks

Airflow

Job description

Data Specialist

Primary Skills

• ETL Fundamentals, SQL, BigQuery, Dataproc, SQL (Basic + Advanced), Python, Data Catalog, Data Warehousing, Composer, Dataflow, Cloud Trace, Cloud Logging, Cloud Storage, Datafusion, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures

Specialization

• GCP Data Engineering Basic: Senior Lead Data Engineer

Job requirements

• Senior Data Engineer (Data Team) Location: GCC Bnlr At Albertsons-4 days per week onsite) Qualifications: Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. Experience: 5+ years of experience in data engineering or a similar role. Technical Skills: Proficiency in Apache SPARK, pySpark, and AWS EMR. Strong experience with Apache Hadoop, Hive, and SQL (Postgres-SQL). Advanced programming skills in Python and Scala. Solid understanding of UNIX systems and shell scripting. Must have Databricks knowledge and experience Functional understanding of API Experience with data storage and retrieval from S3 and Elasticsearch. Knowledge of ETL tools like Airflow and Autosys. Familiarity with version control systems (Git, SVN). Basic understanding of HTML for web development tasks. Strong SQL skills for data querying and manipulation. Experience with API development and integration.