Data Engineer

Agile Resources, Inc.; Atlanta (GA); Remote; USD 120,000 - 160,000; Full time

Job summary

An innovative firm is seeking a Data Engineer to build and scale a modern, cloud-native data platform. In this role, you'll leverage technologies like Databricks and PySpark to design and develop robust data pipelines. You'll work closely with cross-functional teams to meet customer-facing data needs and contribute to the creation of new data models. If you're passionate about data engineering and thrive in a high-autonomy environment, this opportunity offers a chance to make a significant impact in a fast-paced, healthcare-adjacent startup. Join a team that values ownership and innovation!

Benefits

Full healthcare coverage

Short- and Long-Term Disability

HSA & FSA options

Unlimited PTO

Stock Options

401(k)

Qualifications

• 5+ years of experience in data engineering or equivalent production-facing pipeline work.
• Proven ability to build and deploy data pipelines independently.

Responsibilities

• Design and develop scalable, production-ready data pipelines using Databricks and PySpark.
• Deploy and maintain data pipelines on AWS, using S3, EMR, and Glue.

Skills

Python

PySpark

Databricks

SQL

AWS (S3, EMR, Glue)

Job description

Location/Remote: 100% remote within the United States; must be willing to work Eastern Time Zone hours

Compensation: up to $160k base salary (depending on experience)

• Full healthcare coverage for employee + family (medical, dental, vision, life, and supplemental insurances)
• Short- and Long-Term Disability (STD/LTD)
• HSA & FSA options
• Unlimited PTO
• Stock Options
• 401(k)

About the Role

We're hiring a Data Engineer to help build and scale a modern, cloud-native data platform. You'll be hands-on with Databricks, PySpark, and AWS to build, deploy, and manage production-grade pipelines from the ground up.

We’re looking for someone who thrives in a high-autonomy environment, wants to take ownership of their work, and is excited about working in a fast-paced, healthcare-adjacent startup.

What You’ll Do

• Design and develop scalable, production-ready data pipelines using Databricks, PySpark, Python, and SQL
• Deploy and maintain pipelines on AWS, using S3, EMR, and Glue
• Own systems end-to-end — from ingestion and transformation to production deployment
• Contribute to the design of new data models and derived metrics sold to clients
• Collaborate closely with analytics, product, and engineering teams to meet customer-facing data needs
• Review and improve existing pipeline architecture and performance

What We’re Looking For

• 5+ years of experience in data engineering or equivalent production-facing pipeline work
• Strong Python programming and PySpark experience — not just SQL
• Strong experience with Databricks or similar big data platforms
• Proven ability to build and deploy data pipelines independently
• Experience working with AWS data services (e.g., S3, EMR, Glue)
• DBT experience is a bonus
• Background in healthcare data is helpful, but not required — must be open to learning

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Technology, Information and Media

Referrals increase your chances of interviewing at Agile Resources, Inc. by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Disability insurance

Get notified about new Data Engineer jobs in Atlanta, GA.

Software Developer (Remote - United States)

Staff Software Engineer, Backend - Python/Java (Remote)

Atlanta, GA $170,000.00-$190,000.00 6 days ago

Atlanta, GA $170,000.00-$190,000.00 2 weeks ago

Senior Software Engineer-Full Stack Developer

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.