Sr Data Engineer

American Medical Association; Chicago (IL); Hybrid; USD 99,000 - 132,000; Full time

Benefits offered by this job

Incentive plan

Job summary

American Medical Association in Chicago, IL is seeking a Sr Data Engineer (Hybrid) to own data ingestion, transformation, and automation on the Insurance Technology team.

You will build and maintain automation scripts for file extractions, manage Snowflake data, and mentor junior engineers while aligning with architectural direction.

Qualifications

• Bachelor's degree required.
• 5+ years ETL/ELT pipeline development, data integration, and process automation.
• Ability to multi-task and manage multiple projects with minimal supervision.

Responsibilities

• Data preparation and management of high-volume Excel/CSV files.
• Transform and load data into Snowflake; run manual and scheduled Snowflake tasks.
• Develop and maintain PowerShell scripts for automation and file transfers.
• Write and optimize SQL queries; update backend tables and implement data corrections.
• Develop Python scripts for file-based automation and data workflows.
• End-to-end automation of data and file workflows; optimize performance.

Skills

ETL/ELT

Data integration

Snowflake

PowerShell

Python

SQL

Data quality

Automation

Data transformation

Education

Bachelor's degree

Tools

Snowflake

Excel

Job description

Sr Data Engineer (Hybrid)

Chicago, IL

AMA Insurance (AMAI) offers life, health and disability insurance at affordable and exclusive rates to help doctors achieve a healthy and secure financial future. AMAI is part of the American Medical Association (AMA), a nonprofit, and the nation's largest professional Association of physicians. We are a unifying voice and powerful ally for America's physicians, the patients they care for, and the promise of a healthier nation. To be part of the AMA is to be part of our Mission to promote the art and science of medicine and the betterment of public health.

At AMA, our mission to improve the health of the nation starts with our people. We foster an inclusive, people-first culture where every employee is empowered to perform at their best. Together, we advance meaningful change in health care and the communities we serve.

We encourage and support professional development for our employees, and we are dedicated to social responsibility. We invite you to learn more about us and we look forward to getting to know you.

We have an opportunity at our corporate offices in Chicago, IL for a Sr Data Engineer (Hybrid) on our Insurance Technology team. This is a hybrid position reporting into our Chicago, IL office, requiring 3 days a week in the office.

As a Sr Data Engineer, you will be responsible for data ingestion, transformation, automation, and validating file based integrations. This role focuses on building and maintaining automation scripts for file extractions, managing structured and semi structured data files, and supporting reporting needs across the agency. This role serves as a senior technical contributor within the team—providing mentorship to junior engineers and implementing engineering best practices within the data platform function, in alignment with architectural direction set by leadership.

RESPONSIBILITIES

• Data Preparation and Management:
• Process and clean Excel, CSV, and other flat files for various claims and administration related data with high volumes
• Identify and resolve duplicates, inconsistencies, and data quality issues within these files
• Transform files to required schemes and formats for downstream consumption
• Load, stage, update, extract data in Snowflake
• Perform manual and scheduled Snowflake runs
• Prepare and transform rate data across multiple processing stages and generate outbound data files and upload CSV outputs to EXL
• Implement best practice patterns for ingestion, transformation, modeling, and orchestration within a modern lakehouse environment.
• PowerShell Automation:
• Develop and maintain PowerShell scripts from scratch and enhance existing scripts as needed
• Automate file transfers, processing FTP interactions, directory management, and email notifications
• Build automation solutions to improve operational efficiency
• SQL Server Development and Python Scripting:
• Write and optimize SQL queries, including complex joins and transformations
• Responsible for updating backend tables and implementing data corrections
• Prepare reports and datasets and make recommendations for analytics and operational needs
• Responsible for database troubleshooting and data validation activities
• Develop Python scripts for file-based automation, including file movement, copying, editing, and integration tasks
• Responsible for end to end automation of data and file workflows
• Conduct proactive query profiling, tune execution plans, establish efficient indexing strategies, and set appropriate partitioning layers to drastically reduce latency in high-compute workloads.

May include other responsibilities as assigned

REQUIREMENTS

• Education: Bachelor's degree required (P1+/M1+)
• Years of experience: 5+ years of experience in ETL/ELT pipeline development, data integration, and process automation
• Demonstrated ability to multi-task and effectively manage multiple, concurrent projects with minimal supervision.

The American Medical Association is located at 330 N. Wabash Avenue, Chicago, IL 60611 and is convenient to all public transportation in Chicago.

This role is an exempt position, and the salary range for this position is $99,410-$131,637. This is the lowest to highest salary we believe we would pay for this role at the time of this posting. An employee’s pay within the salary range will be determined by a variety of factors including but not limited to business consideration and geographical location, as well as candidate qualifications, such as skills, education, and experience.

Employees are also eligible to participate in an incentive plan. To learn more about the American Medical Association’s benefits offerings, please