Sr Data Engineer

Akaasa Technologies; Town of Florida (NY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Akaasa Technologies is seeking a Senior Data Engineer in Davie, FL (Hybrid) to lead and mentor a team of data engineers, ensuring best practices in coding, architecture, and deployment. This role requires hands-on expertise with data lakes/warehouses, real-time streaming, and cloud platforms.

You will design and optimize data pipelines for structured and semi-structured data using Spark, Flink, Kafka, and Delta Lakehouse on Databricks.

Qualifications

• Experience building and maintaining enterprise data lakes/warehouses.
• Design and implementation of data pipelines that handle structured and semi-structured data.
• Deep understanding in at least one cloud platform (AWS/Azure/GCP) and data storage/compute solutions.
• Expertise in real-time streaming pipelines and integration with batch processing frameworks.

Skills

Leadership

Data Engineering

Real-time Data Processing

Cloud Platforms AWS/Azure/GCP

Big Data Frameworks Spark/Flink

Kafka/Streaming

Python/SQL

Delta Lakehouse with Databricks

Job description

Sr Data Engineer

Location: Davie, FL - Hybrid

Work Experience: 7+

Leadership

Ability to lead, mentor, and guide a team of data engineers, ensuring best practices in coding, architecture, and deployment. In addition, high people management skills that encourage professional growth and foster a culture of learning and collaboration.

Data Engineering skills

Experience in building and maintaining an enterprise Data Lakes and\\or Data Warehouses.

Design and implementation of data pipelines that handle both structured and semi-structured data.

Deep understanding in one of the cloud platforms (e.g., AWS, Azure, GCP) and their associated data storage and compute solutions (e.g., Amazon S3, Azure Blob Storage, Databricks, EC2, Lambda). Strong experience in managing cloud resources and scaling them based on workloads.

hands-on experience with big data frameworks like Apache Spark and Flink. Ability to architect and optimize distributed data processing frameworks for high-throughput and low-latency workloads.

Expertise in real-time data processing using technologies such as Apache Kafka, Apache Flink, and low latency Database engines. Able to design and manage real-time streaming pipelines and integration with batch processing frameworks.

Desired Skills

Experience in Building Delta Lakehouse solution using Databricks.

Advanced skills in optimizing Apache Spark for performance at scale, including fine-tuning Spark configurations, caching strategies, partitioning, and debugging slow-running jobs.

Programming Languages

Python, Java (a plus) and SQL. Strong knowledge of data libraries and frameworks (e.g., PySpark .. ) and the ability to implement custom solutions for data transformations, batch jobs, and pipeline automation.