Mid-Level Big Data Platform Engineer

Tential Solutions; Rockville (MD); On-site; USD 110,000 - 140,000; Full time

Job summary

Tential Solutions in Rockville, MD, is hiring a Mid-Level Software Engineer for a national financial regulatory organization. You will build a platform ingesting trade data from multiple sources and surface insights through correlation and analysis, with room to grow into broader technical ownership.

You will work independently on complex efforts with general guidance, applying CS fundamentals and growing Big Data experience, including Spark, AWS, and data pipelines, while leveraging AI-assisted

Qualifications

• Bachelor's degree in Computer Science, Information Systems or a related field.
• Experience with Java or Python and RESTful APIs.
• Experience with Big Data frameworks and processing.
• Experience building ETL/ELT pipelines for data ingestion and transformation.
• Knowledge of data lake and data warehouse patterns and SQL tuning.
• Exposure to AWS services and data orchestration tools.
• CI/CD and security best practices.

Responsibilities

• Design, build, test and maintain features ingesting data sources and surfacing insights.
• Own moderately complex components end to end from design through delivery.
• Participate in architecture and design discussions to shape team solutions.
• Identify and resolve technical issues and dependencies to keep work on track.
• Support production systems and improve reliability, performance and maintainability.
• Participate in code reviews and help improve the team's standards and tooling.
• Apply CS fundamentals and data structures to solve business problems with growing Big Data skills.
• Use AI-assisted development tools with good judgment and quality review.

Skills

Java

Python

REST APIs

Microservices

Big Data

ETL/ELT pipelines

AWS

CI/CD

SQL

Data security

Data lake/Warehouse

Education

Bachelor's degree in Computer Science, Information Systems or related field

Tools

Apache Spark

EMR

Presto/Trino

Athena

Airflow

AWS Glue

GitLab CI/CD

Job description

Tential Solutions in Rockville, MD, is hiring a Mid-Level Software Engineer for a national financial regulatory organization. You will build a platform ingesting trade data from multiple sources and surface insights through correlation and analysis, with room to grow into broader technical ownership.

You will work independently on complex efforts with general guidance, applying CS fundamentals and growing Big Data experience, including Spark, AWS, and data pipelines, while leveraging AI-assisted