Join to apply for the Software Engineer ID45371 role at AgileEngine.
AgileEngine is a Fortune 500 and Inc. 5000 leader in application development and AI/ML, with multiple Best‑Place‑to‑Work awards.
About the Role
Senior Software Engineer specializing in Data Engineering to develop trade surveillance technology.
What You Will Do
- Design and develop microservices for the data team – Java services running on Kubernetes.
- Scale our data pipeline to process billions of events in real‑time and batch using ClickHouse, Spark, and Kafka.
- Address data duplication, velocity, schema adherence, high availability, governance, and more.
- Maintain the data pipeline written in Java and running on Kubernetes in a micro‑service architecture.
- Plan and communicate integrations with other teams that consume the data.
- Continuously improve data storage, service, and query performance.
- Optimize queries in our data warehouses for completeness and reliability at scale.
Must Haves
- BSc in Computer Science from a top university or equivalent.
- At least 3+ years experience as a Java software engineer.
- Experience in data engineering and pipeline development.
- Proven expertise with relational and non‑relational databases; proficiency in SQL and query optimization, preferably in ClickHouse.
- Experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).
- Strong object‑oriented development foundation.
- Curiosity, proactive problem solving, and self‑starter attitude.
- Excellent verbal and written communication skills in a remote environment.
- Upper‑intermediate English level.
Nice to Haves
- Experience in low‑latency, real‑time systems processing billions of events per day.
- Experience with cloud data‑engineering technologies such as Airflow, Kubernetes, ClickHouse, Snowflake, Redis, Spark, caching technologies, and Kafka.
Perks and Benefits
- Professional growth: Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation: USD‑based compensation with budgets for education, fitness, and team activities.
- Exciting projects: Work with Fortune 500 enterprises and leading product brands.
- Flex‑time: Flexible schedule, remote work, optional office presence.
Job Details
Seniority level: Mid‑Senior level
Employment type: Full‑time
Industry: IT Services and IT Consulting
Referrals increase your chances of interviewing at AgileEngine by 2x.