Software developer

Compunnel, Inc.; Atlanta (GA); On-site; USD 80,000 - 110,000; Full time

Job summary

A leading technology firm in Atlanta is seeking a Software Developer to build and manage efficient data pipelines. You will utilize technologies like Python, SQL, and Databricks while working closely with clients to support data distribution for large healthcare projects. Your expertise in cloud platforms and data warehousing will be essential in delivering optimized solutions. Experience in this field will provide a competitive advantage.

Qualifications

• Proven experience in building efficient ETL pipelines.
• Familiarity with cloud platforms and data warehousing.
• Strong understanding of data analysis and mapping.

Responsibilities

• Build and manage efficient ETL pipelines using Databricks.
• Optimize performance of data extract scripts.
• Collaborate with clients to understand data distribution requirements.

Skills

Proficient with Python

Proficient with SQL

Experience with Spark SQL

Familiarity with AWS services

Experience with Terraform

Experience with GitLab CI/CD

Query tuning and optimization

Familiarity with data warehousing

Experience with healthcare clients

Education

Master of Technology in Data Science & Engineering

Tools

Databricks

Terraform

GitLab CI/CD

Snowflake

Job description

As a Software Developer, you will be responsible for building and managing efficient data pipelines, working with cloud-based technologies, and supporting data distribution for large healthcare clients. You will collaborate with clients and implementation teams to understand requirements and deliver optimized solutions.

Key Responsibilities

• Build and manage efficient ETL pipelines using Databricks workflows or other orchestration frameworks.
• Work with structured and semi-structured data using PySpark.
• Perform data analysis and mapping to produce client output.
• Build data distribution extracts and scripts.
• Optimize performance of data extract scripts.
• Work with clients and implementation teams to understand data distribution requirements.

Required Qualifications

• Proficient with Python and SQL.
• Experience with Spark SQL.
• Familiarity with AWS services (S3, SQS) or similar cloud platforms.
• Experience with Terraform and GitLab CI/CD.
• Query tuning and performance optimization in SQL and/or SparkSQL.
• Familiarity with data warehousing (Snowflake or similar).
• Experience working for a cloud-based data services provider to large healthcare clients.

Preferred Qualifications

• Experience with procurement software or enterprise resource planning (ERP) systems.
• Familiarity with contract management principles.
• Knowledge of supply chain logistics and inventory management.
• Master of Technology in Data Science & Engineering.