Data Engineer

Bounteous; India; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

Bounteous in India seeks a senior data engineer with 5+ years of experience to design and deliver scalable data solutions for fraud detection. You'll work with Pyton, Spark, SQL, and cloud technologies across AWS and Azure, building data pipelines on both on-prem and cloud stacks.

Join an agile team to own end-to-end data infrastructure, collaborate across BI and Data Science stakeholders, and implement real-time and batch processing with Kafka, MongoDB/Neo4j, and data virtualization.

Qualifications

• 5+ years of relevant work experience.
• Strong programming in Python to develop batch data engineering on Apache Spark and populate downstream data stores for BI and Data Science.
• Proficiency in SQL Server and Hadoop based implementations.
• Experience with job scheduling tools like Autosys or Control-M.
• Linux environment experience with Python/Shell scripting.
• Excellent communication and interpersonal skills.
• Strong analytical and problem-solving skills.
• Experience in building data solutions for BI & Data Science.
• Knowledge of data architecture and dimensional modeling for data marts.
• Experience with real-time service integration using Kafka and persisting data in MS SQL/MongoDB/Neo4j.
• Experience with Azure (Databricks, Data Factory, Synapse, Data Lake) and AWS services; Snowflake.
• Experience with MongoDB and Neo4j Graph databases.
• Experience with data virtualization (TIBCO) for BI/Data Science use cases.
• Experience across full SDLC and Agile teams.
• Experience with version control and CI systems.
• Fraud detection and prevention in Financial Services.

Responsibilities

• Deliver high-quality, scalable data solutions for the Fraud business partners.
• Build and maintain batch and real-time data pipelines across on-prem and cloud stacks.
• Collaborate within an Agile team and take ownership of projects.
• Develop data architectures and dimensional models to support BI use cases.
• Integrate with Kafka for real-time event processing and feature derivation for ML models.

Skills

Python

Spark

SQL

Autosys

Shell

BI & Data Science

Azure

AWS

MongoDB

Kafka

Neo4j

Databricks

Data Factory

Snowflake

Tools

Control-M

TIBCO Data Virtualization

Kubernetes

Git

Job description

5 to 9 years of experience
Skills: Python , Spark , SQL, Autosys , Shell , BI & Data Science , Azure, AWS, MongoDB

Role Profile

As a senor data engineer your role will be to create and deliver high quality, resilient data solutions to our Fraud business partners and being a productive member of the development team. You will be working on various existing and new technology stacks which include on-prem relational and big-data technologies & new cloud-based technologies in AWS and Azure. You will be expected to share ownership of our projects and contribute to the active development and maintenance of our applications. You will have the opportunity to be exposed to modern software engineering tools and best practices. You will have the opportunity to be exposed to how a large investment bank like Morgan Stanley detects and prevents fraud. You will work in a dynamic agile team that uses Scrum for its workflow. You will be expected to be involved in the full development lifecycle. You will be expected to collaborate with others in the wider team as well as working on your own initiative.

Skills Required

• 5+ years of relevant work experience
• Strong with programming in Python to perform, o Batch data engineering on Apache Spark and populate downstream batch data stores (such as data mart) for BI use cases & to generate downstream feeds (ie., flat & wide tables or compressed files) for Data Science use cases
• Strong with SQL Server & Hadoop based implementations
• Good hands-on experience with at least one of the job scheduling tools like Autosys (Preferred), Control-M etc.,
• Experience of working in a Linux environment and can write Python/Shell scripts
• Strong oral and written communication skills
• Excellent interpersonal skills and professional approach
• Strong analytical and problem-solving skills
• Ability to learn quickly and pick up new techniques and/or technologies
• Experience in building & maintaining data solutions for BI & Data Science use cases
• Experience in data architecture and modeling experience. Especially, in dimensional modeling for data mart design and development to support BI use cases
• Real-time service integration to process business events off Kafka and persist in operational MS SQL/MongoDB and/or Neo4j Graph data stores for fraud investigation - Near real-time stream processing to derive features for ML model inference.
• Experience in Azure (Databricks, Data Factory, Synapse, Azure Data Lake) and/or AWS (AWS S3, AWS Athena, AWS Glue) Data ecosystem & Snowflake Data Cloud
• Experience in MongoDB and Neo4j Graph databases
• Experience in building virtual data access layer using TIBCO Data Virtualization to support BI & Data Science use cases
• Experience of the full software development life cycle
• Experience of working in an Agile team
• Experience of working with version control systems
• Experience with bash scripting
• Experience of working with Continuous Integration systems
• Experience in Fraud detection and prevention business in Financial Services

We understand technologists. We know what gets them excited. There's plenty of opportunity here and lots of new technology that we're exploring. Over time your interests will change, the things that excite you will change, and the technology will change, but what stays the same for Bounteous is creating growth opportunities for our team and our relentless pursuit to create transformative digital experiences.

By submitting this information, you consent to receiving the communications requested above in accordance with your privacy policy.