Software Developer with ETL and AWS

Bristlecone

Bengaluru

On-site

INR 1,800,000 - 3,600,000

Full time

47 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Bristlecone is seeking a hands-on ETL developer to build and refine ETL solutions, thoroughly understand existing on-prem ETL jobs, and guide the team. The role emphasizes data validation, quality, and adherence to governance rules, with a focus on AWS infrastructure-as-code and production support.

Responsibilities include designing and implementing ETL processes using DataStage/Informatica, Python, and shell scripting, and integrating with Redshift and Aurora PostgreSQL.

Qualifications

  • Hands-on ETL development and data warehousing experience.
  • Strong knowledge of AWS data services and API development.
  • Experience with data validation, data quality, and data governance.

Responsibilities

  • Leverage development experience with DataStage, Informatica, Korn Shell, Python, and Perl on Unix/Linux.
  • Design and implement ETL Glue PySpark processes for AWS data warehouses and data lakes (Redshift, Aurora PostgreSQL).
  • Develop full‑stack applications/APIs when required.
  • Perform data analysis/validation to minimize errors and support decision making.
  • Automate, orchestrate ETL processes, and provide production support.
  • Create comprehensive documentation for data mappings, data flows, APIs, and procedures.

Skills

DataStage
Informatica
Korn Shell
Python
Perl
Unix/Linux
PySpark
AWS Glue
SQL
REST/SOAP
Git
Jenkins
Excel
Tableau
AWS Cloud Services

Education

Bachelor’s degree in Computer Science, Information Technology, or a related field

Tools

AWS Glue
Redshift
Aurora PostgreSQL
Python
Tableau

Job description

Job Description

This position requires a hands-on developer who can build new ETL solutions if necessary, thoroughly understand all existing on-premises ETL jobs, and serve as an expert to guide the team. Key responsibilities include job execution, data validation, ensuring data quality, and adherence to data compliance and business rules. The role also encompasses understanding AWS infrastructure-as-code orchestrating and validating jobs, and providing comprehensive production support. Candidates must possess technical development expertise and a strong background in data analytics.

Job Description

This position requires a hands-on developer who can build new ETL solutions if necessary, thoroughly understand all existing on-premises ETL jobs, and serve as an expert to guide the team. Key responsibilities include job execution, data validation, ensuring data quality, and adherence to data compliance and business rules. The role also encompasses understanding AWS infrastructure-as-code orchestrating and validating jobs, and providing comprehensive production support. Candidates must possess technical development expertise and a strong background in data analytics.

Responsibilities
  • Leverage development experience with DataStage or Informatica, Korn Shell, Python, and Perl scripting on Unix/Linux platforms.
  • Be able to design, develop, and implement ETL Glue PySpark processes to extract, transform, and load data from various sources into AWS cloud-based data warehouses and data lakes, specifically Redshift and Aurora PostgreSQL.
  • Be able to develop scalable and efficient full-stack applications, including both front-end and back-end components or APIs, as required.
  • Conduct business analysis and perform data analysis/ validation to minimize errors and inconsistencies, extract meaningful insights, and support business decision-making throughout the software development lifecycle.
  • Collaborate closely with data analysts, data architects, and other team members to analyze source data, enhance data accuracy and integrity, implement data reporting, and understand data and application requirements to deliver effective solutions.
  • Automate and orchestrate ETL processes, applications, and APIs to optimize performance and scalability across cloud environments.
  • Proactively provide production support, including monitoring, troubleshooting, and resolving issues for ETL processes, configurations, and data integrity.
  • Develop comprehensive documentation covering overall processes, data mappings, data flows, APIs, application code, and support procedures.
  • Perform impact analysis and effectively communicate technical processes and concepts to larger audiences.
  • Ensure data and application security and compliance with all relevant data protection regulations.
  • Participate in code reviews, adhere to best practices, and provide constructive feedback to peers.
  • Stay up to date with the latest industry trends and best practices in the areas of ETL development, full-stack development, data analysis, and cloud technologies.
Qualifications
  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • More than 8 years of experience in ETL development, data warehousing, AWS cloud services, and API development.
  • Comprehensive proficiency in all AWS services with a strong understanding of data integration, transformation, and loading processes.
  • Expertise in scripting languages, including DataStage or Informatica, Shell scripting, Perl, and Python.
  • Experience with API development and frameworks such as REST and SOAP.
  • Advanced skills utilizing the AWS cloud platform and services, including AWS Glue, Step Functions, Airflow DAGS, Lambda, S3, EC2, and others.
  • Proficiency in SQL with both on-premises relational databases (such as DB2 on AIX) and AWS databases (such as Amazon RDS, Amazon Aurora PostgreSQL, and Redshift).
  • Experience with version control tools like Git or Bitbucket.
  • Familiarity with implementing Jenkins pipelines and CI/CD processes.
  • Demonstrated experience in data analysis/ validation, utilizing tools such as Excel, Python, and Tableau.
  • AWS certifications and expertise in AI/ML are advantageous.
  • Familiarity with automotive industry knowledge, data warehousing concepts, and adherence to developer best practices.

Experience working within Agile development methodologies

About Us

Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change.

Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and Digitalization are positioned around key industry pillars and delivered through a comprehensive portfolio of services spanning digital strategy, design and build, and implementation across a range of technology platforms.

Bristlecone is ranked among the top ten leaders in supply chain services by Gartner. We are headquartered in San Jose, California, with locations across North America, Europe and Asia, and over 2,500 consultants. Bristlecone is part of the $19.4 billion Mahindra Group.

Equal Opportunity Employer

Bristlecone is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status .

Information Security Responsibilities
  • Understand and adhere to Information Security policies, guidelines and procedure, practice them for protection of organizational data and Information System.
  • Take part in information security training and act while handling information.
  • Report all suspected security and policy breach to InfoSec team or appropriate authority (CISO).
  • Understand and adhere to the additional information security responsibilities as part of the assigned job role.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Cloud Platform & AI Engineer
Cloud Platform & AI Engineer

Bristlecone • Bengaluru

Hybrid
INR 2,500,000 - 4,200,000
Specialist - Product
Specialist - Product

Bristlecone • Pune City

On-site
USD 6,816 - 13,632
Manager - Data Engineering
Manager - Data Engineering

Bristlecone • Bengaluru

On-site
INR 1,500,000 - 2,500,000
Senior Software Engineer - Integration-
Senior Software Engineer - Integration-

Bristlecone • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Specialist - SAP-SAP IBP
Specialist - SAP-SAP IBP

Bristlecone • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Lead - Cloud & Application Engineering
Lead - Cloud & Application Engineering

Bristlecone • Bengaluru

On-site
INR 1,500,000 - 2,500,000
Specialist - BI-Tableau
Specialist - BI-Tableau

Bristlecone, Ltd. • Pune District

On-site
INR 750,000 - 1,250,000
Sr. Bigdata Engineer
Sr. Bigdata Engineer

UST • Hyderabad

On-site
INR 4,000,000 - 9,000,000
Technical Program Manager
Technical Program Manager

Mployee.me • Bengaluru

On-site
INR 4,500,000 - 7,500,000
Specialist - Cloud & Application Engineering
Specialist - Cloud & Application Engineering

Bristlecone • Bengaluru

On-site
INR 600,000 - 900,000