Data Engineer — Real-Time Analytics on AWS

Solvd Inc.; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Solvd Inc. is an AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence.

The team designs, builds, and optimizes data platforms to support risk and compliance workloads while leveraging AWS data services for scalable solutions. The role focuses on end-to-end data engineering—from batch processing to real-time streaming, ETL/ELT workflows, and collaboration with data scientists and analysts to

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a similar field.
• 3+ years of hands-on experience in data engineering or related fields.
• Strong proficiency in SQL and data modeling for analytics and warehousing.
• Experience building ETL or ELT pipelines at scale.
• Experience with Hadoop, Hive, Spark, HBase, or EMR.
• Knowledge of distributed systems and data storage principles.
• Basic scripting skills in Python or Scala.
• Familiarity with machine learning concepts.
• Nice to have: Experience with AWS data services such as Redshift, S3, Glue, EMR, Kinesis, Firehose, and Lambda.
• Experience with non-relational data stores.
• Experience collaborating with cross-functional risk, compliance, or analytics teams.
• Strong understanding of data governance, quality, and security best practices.

Responsibilities

• Design, build, and optimize scalable data infrastructure for risk and compliance workloads.
• Develop batch and streaming pipelines using modern big data technologies.
• Implement robust ETL and ELT workflows across structured and unstructured data sources.
• Work extensively with AWS data services, including EMR, Redshift, S3, Glue, Lambda, and Kinesis.
• Build high-throughput, low-latency systems for real-time or near-real-time decision-making.
• Partner with data scientists, analysts, and engineering teams to deliver reliable and well-documented datasets.
• Translate business requirements into technical specifications and scalable data solutions.
• Mentor team members and contribute to best practices and reusable frameworks.
• Streamline reporting, analytics, and data preparation processes.
• Replace manual workflows with automated, repeatable systems.
• Support performance tuning, monitoring, and platform optimization.

Skills

SQL proficiency

Data modeling

Big data pipelines

Python/Scala scripting

Distributed systems

AWS data services familiarity

Analytics collaboration

Education

Bachelor’s degree in CS/Engineering/Math

Tools

Hadoop

Hive

Spark

HBase

EMR

Redshift

S3

Glue

Kinesis

Job description

Solvd Inc. is an AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence.

The team designs, builds, and optimizes data platforms to support risk and compliance workloads while leveraging AWS data services for scalable solutions. The role focuses on end-to-end data engineering—from batch processing to real-time streaming, ETL/ELT workflows, and collaboration with data scientists and analysts to