Python Engineer- INTL India

Insight Global; Atlanta (GA); On-site; USD 5,510 - 9,643; Full time

Job summary

Insight Global is seeking a backend data engineer to build and deploy automated batch data pipelines using Apache Airflow and Python. You will engineer scalable ETL/ELT processes moving data between SFTP, GCP, and Snowflake, and implement SQL queries for high-volume workloads.

You will also help design API layers (REST/GraphQL) and collaborate on backend microservices (Spring Boot where applicable) to ensure data accessibility, reliability, and SLA adherence.

Qualifications

• 1-2 years in backend development building ETL/ELT pipelines.
• Experience with orchestrating data workflows using Apache Airflow.
• Proficiency in Python for automation and data transformation.
• Experience integrating with cloud data platforms (GCP, Snowflake) and relational databases.

Responsibilities

• Build and deploy automated batch data pipelines with Airflow and Python.
• Develop ETL/ELT scripts to move data between SFTP, GCP, and Snowflake.
• Design and optimize API layers (REST/GraphQL) and backend microservices (Spring Boot applicable).
• Monitor pipelines, troubleshoot failures, and ensure data quality and SLA delivery.

Skills

Python

Apache Airflow

SQL

REST APIs

GraphQL

CI/CD

Docker

SFTP

Bitbucket

Spring Boot

Tools

Docker

Bitbucket

Kubernetes

Spring Boot

PostgreSQL

Snowflake

GCP

Job description

Job Description

• Build, and deploy automated batch data pipelines using Apache Airflow and Python based on provided design
• Write clean, scalable scripts to extract, transform, and load (ETL/ELT) datasets between SFTP, GCP, and Snowflake
• Implement SQL queries for high-volume data processing in Snowflake and PostgreSQL
• Build and maintain API integration layers (REST/GraphQL)
• Collaborate on the design of backend microservices (utilizing Spring Boot where applicable) to support data accessibility

Support and Enablement

• Monitor pipeline health, troubleshoot job failures, and ensure data integrity and SLA delivery
• Document system configurations, data contracts, technical design specifications, and test plans

Pay Rate: Up to $7.00 an hour depending on skills and experience

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [e-mail] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

Required Experience

• 1-2 years in Backend Development roles building robust ETL/ELT pipelines
• Exposure on orchestrating data workflows using Apache Airflow
• Experience developing production-grade automation and transformation scripts using Python
• Hands-on experience integrating to cloud data platforms (GCP, Snowflake) and legacy relational databases

Essential skills

• Programming proficiency in Python (specifically for automation, data manipulation, and ETL)
• Exposure in Apache Airflow (DAG development, Custom Operators, Hooks, and XComs)
• Good SQL proficiency across multiple engines (PostgreSQL, MS-SQL, and Snowflake)
• Hands-on experience with Google Cloud Platform (GCP) services (e.g., Cloud Storage, Cloud Run)
• Experience consuming and integrating data via RESTful and GraphQL APIs
• Has knowledge in secure data exchanges using file transfer protocols (SFTP)
• Experience with CI/CD pipelines, version control (Bitbucket), and containerization (Docker)

Desired skills

• Experience with Java and the Spring Boot framework for backend API development
• Exposure to SAP Integrations using Java.
• Exposure to Kubernetes orchestration (GKE) and cloud-native deployments
• Familiarity with event-driven architectures (Kafka or Pub/Sub)
• Knowledge of data governance and security controls around automated data pipelines