Data Engineer - Real-Time Pipelines (Kafka, AWS, Databricks)

Bitbybit Solutions; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

Bitbybit Solutions is seeking a data engineer to build and operate scalable data pipelines on AWS/Databricks. You will enable data-driven insights by designing robust batch and real-time workflows and ensuring observability across systems.

You will collaborate with Product, Regulatory, and Legal teams to maintain compliant data platforms while leveraging CI/CD practices and monitoring stacks like Prometheus and Grafana.

Qualifications

• Proficient in building data-intensive applications.
• Experience with distributed data pipelines (batch and streaming).
• Hands-on with cloud platforms and data lakehouse tooling.

Responsibilities

• Build and manage robust data pipelines for insights using AWS/Databricks.
• Design scalable systems with observability, logging, and alerting.
• Monitor system robustness and handle both structured and unstructured data pipelines.
• Collaborate with Product, Regulatory, and Legal teams to ensure compliance.

Skills

Scala

Spark

Kafka

Distributed systems

Batch/real-time pipelines

Tools

AWS

Databricks

Jenkins

GitHub Actions

Prometheus

Grafana

Job description

Bitbybit Solutions is seeking a data engineer to build and operate scalable data pipelines on AWS/Databricks. You will enable data-driven insights by designing robust batch and real-time workflows and ensuring observability across systems.

You will collaborate with Product, Regulatory, and Legal teams to maintain compliant data platforms while leveraging CI/CD practices and monitoring stacks like Prometheus and Grafana.