Intermediate Data Engineer

Boardroom Appointments

United States

Remote

USD 110,000 - 170,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Boardroom Appointments is seeking an Intermediate Data Engineer to help build scalable data infrastructure for real-time data processing and ML inference pipelines. You will develop APIs and data ingestion patterns, supporting multiple business units and new product initiatives.

The role requires a Masters in a related field, 2–3 years of experience, and hands-on experience with AWS/GCP/Azure and distributed systems such as Spark, Kafka, Docker, and Kubernetes.

Qualifications

  • Matric (Grade 12)
  • Masters in Software Engineering, Data Engineering, Computer Science or related field
  • 2-3 years of relevant work experience
  • Strong Scala or Java background
  • Knowledge of AWS, GCP, Azure, or other cloud platform
  • Understanding of data modeling principles
  • Ability to work with complex data models
  • Experience with relational and NoSQL databases (e.g. Postgres, ElasticSearch/OpenSearch, graph databases such as Neptune or neo4j)
  • Experience with technologies that power analytics (Spark, Hadoop, Kafka, Docker, Kubernetes) or other distributed computing systems
  • Knowledge of API development and machine learning deployment

Responsibilities

  • Build and scale data infrastructure that powers real-time data processing of billions of records in a streaming architecture
  • Build scalable data ingestion and machine learning inference pipelines
  • Build general-purpose APIs to deliver data science outputs to multiple business units
  • Scale up production systems to handle increased demand from new products, features, and users
  • Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costs
  • Automate and handle the life-cycle of the systems and platforms that process our data

Skills

Scala/Java
Cloud platforms
Data modeling
Complex data models
APIs for data delivery
ML deployment

Education

Masters in Software Engineering, Data Engineering, Computer Science or related field
Matric (Grade 12)

Tools

Postgres
ElasticSearch/OpenSearch
Neo4j/Neptune
Spark
Hadoop
Kafka
Docker
Kubernetes

Job description

Intermediate Data Engineer
Minimum Requirements:
  • Matric (Grade 12)
  • Masters in Software Engineering, Data Engineering, Computer Science or related field
  • 2-3 years of relevant work experience
  • Strong Scala or Java background
  • Knowledge of AWS, GCP, Azure, or other cloud platform
  • Understanding of data modeling principles
  • Ability to work with complex data models
  • Experience with relational and NoSQL databases (e.g. Postgres, ElasticSearch/OpenSearch, graph databases such as Neptune or neo4j)
  • Experience with technologies that power analytics (Spark, Hadoop, Kafka, Docker, Kubernetes) or other distributed computing systems
  • Knowledge of API development and machine learning deployment
Responsibilities:
  • Build and scale data infrastructure that powers real-time data processing of billions of records in a streaming architecture
  • Build scalable data ingestion and machine learning inference pipelines
  • Build general-purpose APIs to deliver data science outputs to multiple business units
  • Scale up production systems to handle increased demand from new products, features, and users
  • Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costs
  • Automate and handle the life-cycle of the systems and platforms that process our data
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Resolve Tech Solutions • Irving (TX)

On-site
USD 110,000 - 150,000
Data Engineer
Data Engineer

TechDigital Group • Burbank (CA)

On-site
USD 120,000 - 150,000
Big Data Engineer
Big Data Engineer

Good co India • United States

Remote
USD 120,000 - 180,000
Data Engineer
Data Engineer

Aptdata Solutions Inc. • Farmington Hills (MI)

On-site
USD 90,000 - 115,000
Data Engineer
Data Engineer

OP RaaS • Naperville (IL)

On-site
USD 90,000 - 130,000
Data Engineer
Data Engineer

Vein Standard Metals • United States

Remote
USD 110,000 - 160,000
Data Engineer
Data Engineer

Compunnel Inc. • Jersey City (NJ)

On-site
USD 100,000 - 130,000
Bigdata Engineer
Bigdata Engineer

Disys - Oak Brook • Tampa (FL)

On-site
USD 90,000 - 120,000
Senior Data Engineer
Senior Data Engineer

Veriipro • Atlanta (GA)

On-site
USD 140,000 - 180,000
Data Engineer
Data Engineer

Advanced Tech Placement • Atlanta (GA)

On-site
USD 120,000 - 150,000