Senior AWS Data Engineer

Think Consulting; Baltimore (MD); Remote; USD 120,000 - 150,000; Full time

Job summary

A leading company is seeking a Senior AWS Data Engineer to support large-scale data operations, focusing on designing, building, and managing infrastructure for astronomical data. This remote role requires collaboration with software developers and astronomers to deliver science-ready data products. Ideal candidates will have extensive experience in data engineering, SQL proficiency, and a solid background in cloud databases, particularly AWS.

Qualifications

• 8-15 years of hands-on experience in data engineering and data management.
• Strong background in data modeling and management of large-scale database systems.

Responsibilities

• Design and implement robust data management solutions for astronomical datasets.
• Analyze current data systems; implement scalable, optimized solutions.
• Monitor and optimize database performance and availability.

Skills

Data Modeling

SQL

Python

Database Performance Tuning

Education

Bachelor's degree in Computer Science

Tools

PostgreSQL

SQL Server

Kafka

GraphQL

Job description

Position: Senior AWS Data Engineer

Department: DSB (Data Science Branch)

Location: 100% Remote

No C2C or Sponsorship

Overview:

We are seeking Senior AWS Data Engineers to support large-scale data operations in both cloud and on-premise computing environments. This role involves designing, building, and managing infrastructure to ingest, store, and analyze massive volumes of astronomical data. You'll collaborate closely with software developers and astronomers to deliver science-ready data products via our Data Access APIs.

Key Responsibilities:

• Design and implement robust data management solutions for high-volume, high-variety, and high-veracity astronomical datasets in both cloud and on-premise environments.


• Analyze and assess current data systems; identify performance or functionality issues and implement scalable, optimized solutions.


• Lead or contribute to proof-of-concept and pilot projects for new technologies and system improvements.


• Evaluate data access patterns and SQL queries, recommending and implementing enhancements.


• Design and develop database schemas, indexes, data migration utilities, and stored procedures/functions.


• Support the development and optimization of data APIs for scientific data access.


• Participate in day-to-day database operations, including troubleshooting, debugging, and production issue resolution.


• Monitor and optimize database performance and availability.

Required Skills & Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field.


• 8-15 years of hands-on experience in data engineering and data management (DOE for senior level).


• Strong background in data modeling and management of large-scale database systems.


• Advanced proficiency in SQL, including analytical functions and complex query development.


• Expertise in database performance tuning and optimization of data pipelines.


• Proficient in Python programming.


• Experience with cloud databases, particularly Amazon Web Services (e.g., Amazon RDS).


• Familiarity with cloud data storage architectures and access strategies.


• Hands-on experience with PostgreSQL and SQL Server, including migration between systems.


• Exposure to tools and frameworks such as Kafka and GraphQL.

**This position requires U.S. Citizenship or Permanent Residence (Green Card) in order to meet ITAR requirements to work in these positions. No C2C or Sponsorship available.

Equal Opportunity Employer, including disability and protected veteran status