Data Engineer

Sira Consulting, an Inc 5000 company; United States; Remote; USD 100,000 - 170,000; Full time

Job summary

Sira Consulting seeks a proficient Data Engineer to manage data workflows in a cloud-based Data Lakehouse. The focus is on automation, ETL pipeline implementation using AWS tools, and ensuring data security and compliance. To excel, candidates should possess strong AWS services knowledge, particularly in IAM and LakeFormation, and have experience with data integration and modeling.

Qualifications

• Extensive experience in data integration and management using AWS.
• Practical knowledge of ETL processes and data modeling.
• Familiarity with security protocols and identity management.

Responsibilities

• Automate data workflows and manage ETL processes within a Data Lakehouse.
• Implement and maintain AWS data integration solutions.
• Collaborate with teams to optimize data architecture and consumption.

Skills

AWS Services

Data Lakehouse

SQL Server

IAM

ETL

Tools

HashiCorp Vault

Terraform

Keycloak

Job description

2 days ago Be among the first 25 applicants

Sira Consulting, an Inc 5000 company provided pay range

This range is provided by Sira Consulting, an Inc 5000 company. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$60.00/hr - $60.00/hr

Direct message the job poster from Sira Consulting, an Inc 5000 company

Primary Skills: AWS Services, Data Lakehouse, Lake Formation, SQL Server, IAM

Secondary Skills: EKS, HashiCorp Vault, Terraform, Keycloak

Location: Remote (USA)

Job Description:

We are seeking a highly skilled Data Engineer to support the automation and transformation of data workflows in a cloud-based Data Lakehouse environment. This role focuses on designing, implementing, and maintaining secure, scalable, and efficient data infrastructure using modern AWS services and tools.

Key Responsibilities:

• Automate the creation, transformation, and integration of raw and enriched data models in the Data Lakehouse.
• Implement automated ETL pipelines for seamless data ingestion, transformation, and consumption.
• Design and implement LakeFormation integration across AWS Data Platform accounts.
• Integrate LakeFormation with Keycloak for authentication and access control.
• Build an integrated IAM solution, including EKS service accounts for secure identity and access management.
• Design and integrate HashiCorp Vault with AWS services (e.g., Secrets Manager, Certificate Manager, Keycloak).
• Develop secure integrations between HashiCorp Vault and AWS Data Services such as RDS Aurora PostgreSQL, RDS MSSQL, and other RDS solutions.
• Provision MSSQL servers on AWS using Terraform and deploy read replicas.
• Implement monitoring and logging solutions for MSSQL servers on AWS.
• Transition existing pipelines to the new MSSQL server infrastructure.
• Collaborate with business application owners to review existing data architecture, pipelines, and consumption patterns.
• Design and document target architecture for pipelines, processing, and analytics.
• Identify opportunities for optimization, consolidation, and improved performance.
• Work closely with the data team to decompose business logic and support data transformation initiatives.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Sira Consulting, an Inc 5000 company by 2x

Get notified about new Data Engineer jobs in United States.

United States $170,000.00-$720,000.00 6 days ago

United States $170,000.00-$720,000.00 5 days ago

United States $170,000.00-$720,000.00 1 day ago

San Francisco, CA $126,100.00-$186,800.00 3 days ago

San Francisco, CA $120,000.00-$150,000.00 5 days ago

Irving, TX $80,000.00-$100,000.00 6 days ago

McLean, VA $80,000.00-$100,000.00 6 days ago

United States $100,000.00-$120,000.00 17 hours ago

United States $120,000.00-$130,000.00 4 days ago

United States $114,000.00-$171,000.00 2 weeks ago

North Carolina, United States $125,000.00-$145,000.00 3 weeks ago

Manhattan, NY $110,000.00-$160,000.00 6 days ago

Western, WV $123,000.00-$185,000.00 1 day ago

New York, NY $120,000.00-$132,000.00 2 days ago

New York, NY $139,500.00-$271,566.94 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.