Big Data Engineer (BI-EIABA)

Bounteous; Mumbai, Bengaluru; On-site; INR 2,500,000 - 3,600,000; Full time

Job summary

Bounteous is seeking an experienced data engineer to design and maintain batch data pipelines using Python, Spark, SQL Server, and Hadoop to feed BI and data science use cases.

You will build and populate data marts, produce downstream feeds, and ensure scalable, reliable data solutions across Linux environments.

Collaborating with analytics and engineering teams, you will learn quickly, communicate clearly, and contribute to architectural decisions and data quality improvements.

Qualifications

• 5+ years of relevant work experience.
• Proficiency in Python.
• Batch data engineering with Apache Spark and data marts for BI.
• Strong SQL skills and SQL Server/Hadoop experience.
• Experience with job scheduling tools (Autosys preferred).
• Linux environment experience; Python/Shell scripting.
• Strong data analytics and problem-solving abilities.
• Excellent communication and interpersonal skills.
• Ability to learn quickly and adapt to new tech.
• Experience building data solutions for BI/DS.

Skills

Python

Spark

SQL

SQL Server

Hadoop

Autosys

Linux

Shell scripting

Data analytics

Communication

Interpersonal

Problem solving

Learning ability

BI/DS data solutions

Job description

Skills Required

• 5+ years of relevant work experience
• Strong with programming in Python to perform,
• Batch data engineering on Apache Spark and populate downstream batch data stores (such as data mart) for BI use cases & to generate downstream feeds (ie., flat & wide tables or compressed files) for Data Science use cases
• Strong with SQL Server & Hadoop based implementations
• Strong SQL skills
• Good hands-on experience with at least one of the job scheduling tools like Autosys (Preferred), Control-M etc.,
• Experience of working in a Linux environment and can write Python/Shell scripts
• Strong data analytics skills
• Strong oral and written communication skills
• Excellent interpersonal skills and professional approach
• Strong analytical and problem-solving skills
• Ability to learn quickly and pick up new techniques and/or technologies
• Experience in building & maintaining data solutions for BI & Data Science

Skills Desired

• Experience in data architecture and modeling experience. Especially, in dimensional modeling for data mart design and development to support BI use cases
• Real-time service integration to process business events off Kafka and persist in operational MS SQL/MongoDB and/or Neo4j Graph data stores for fraud investigation
• Near real-time stream processing to derive features for ML model inference.
• Experience in Azure (Databricks, Data Factory, Synapse, Azure Data Lake) and/or AWS (AWS S3, AWS Athena, AWS Glue) Data ecosystem & Snowflake Data Cloud
• Experience in MongoDB and Neo4j Graph databases
• Experience in building virtual data access layer using TIBCO Data Virtualization to support BI & Data Science use cases