Senior Associate Data Engineering L2 | Scala and AWS | Data Engineer

Raj Cloud Tech; Bengaluru; On-site; INR 1,200,000 - 1,600,000; Full time

Benefits offered by this job

18 paid holidays

Generous parental leave

Flexible work arrangements

Employee Assistance Programs

Job summary

Raj Cloud Tech is seeking a Senior Associate in Data Engineering based in Bengaluru, India. This role involves translating client requirements into technical designs and implementing data engineering solutions. Candidates should have 6+ years of IT experience and strong expertise in Big Data technologies and AWS.

The successful candidate will work with various programming languages and tools, contributing to data ingestion, integration, and analytics. A flexible work environment and generous benefits are offered.

Qualifications

• 6+ years of IT experience, 5+ years in data-related technologies.
• At least 2 years in Big Data technologies, AWS experience required.
• Hands-on with Hadoop stack and related data services.

Responsibilities

• Translate client requirements into technical design.
• Perform data ingestion, integration, and transformation.
• Prepare analysis reports for management.

Skills

Data integration

Big data design principles

Statistical analysis

Automation

Data governance

SQL

AWS

Tools

Hadoop

Apache Spark

Tableau

NoSQL

Job description

Job Description

The Senior Associate (Senior Associate L2) in Data Engineering will translate client requirements into technical design and implement components for data engineering solutions. Utilizing a deep understanding of data integration and big data design principles, they will create custom solutions or implement package solutions. They will independently drive design discussions to ensure the necessary health of the overall solution.

Your Impact

Data Ingestion, Integration, and Transformation; Data Storage and Computation Frameworks; Performance Optimizations; Analytics & Visualizations; Infrastructure & Cloud Computing; Data Management Platforms. Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time; Build functionality for data analytics, search, and aggregation.

• Using automated tools to extract data from primary and secondary sources
• Removing corrupted data and fixing coding errors and related problems
• Performing analysis to assess quality and meaning of data
• Filter Data by reviewing reports and performance indicators to identify and correct code problems
• Using statistical tools to identify, analyze, and interpret patterns and trends in complex data sets that could be helpful for diagnosis and prediction
• Assigning numerical value to essential business functions so that business performance can be assessed and compared over periods of time, analysing local, national, and global trends that impact both the organization and the industry
• Preparing reports for the management stating trends, patterns, and predictions using relevant data

Working with programmers, engineers, and management heads to identify process improvement opportunities, propose system modifications, and devise data governance strategies, preparing final analysis reports for stakeholders to understand the data‑analysis steps and enable them to take important decisions based on various facts and trends.

Knowledge of programming languages such as SQL, Oracle, R, Python, JavaScript, XML, and ETL frameworks; technical proficiency in database design, development, data models, data mining, and segmentation; experience with Business Objects reporting packages.

• Proficiency in statistics and statistical packages like Excel, SPSS, SAS for dataset analysis
• Adept at using data processing platforms like Hadoop and Apache Spark
• Knowledge of data visualization software like Tableau, Qlik
• Knowledge of how to create and apply the most accurate algorithms to datasets to find solutions
• Data mapping (ACRS, MARSHA) creation & maintenance, tracking open questions, issues, and support on all ongoing epics with data‑related queries

Qualifications

Your Skills & Experience:

• Overall 6+ years of IT experience with 4
• 5+ years in data‑related technologies
• Minimum 2 years of experience in Big Data technologies and working exposure in AWS platform on related data services
• Hands‑on experience with the Hadoop stack HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end‑to‑end data pipelines; strong experience on Spark, Scala and conversant with SQL; hands‑on working knowledge of NoSQL and MPP data platforms like HBase, MongoDB, Cassandra, AWS Redshift, etc.
• Well‑versed and working knowledge with data platform related services on at least one cloud platform, IAM and data security
• Adept at using data processing platforms like Hadoop and CouchD
• Performing analysis to assess quality and meaning of data
• Preparing reports for management stating trends, patterns, and predictions using relevant data
• Knowledge of Spark, Scala and conversant with SQL is must
• Certification on AWS cloud platform or big data technologies; strong analytical and problem‑solving skills; excellent understanding of data technologies landscape/ecosystem

Additional Information

A Tip from the Hiring Manager: Join the team to sharpen your skills and expand your collaborative methods. Make an impact on our clients and their businesses directly through your work.

Gender Neutral Policy

• 18 paid holidays throughout the year
• Generous parental leave and new parent transition program
• Flexible work arrangements
• Employee Assistance Programs to help you in wellness and well‑being