Senior Backend Engineer - Python

Ellipsis Health; Canada; Remote; USD 80,000 - 200,000; Full time

Job summary

Ellipsis Health is seeking a Lead Machine Learning Scientist & Engineer to develop innovative AI/ML products. The role focuses on enhancing real-time voice processing technology within the healthcare sector, requiring extensive Python experience and knowledge of streaming systems. This position offers remote work flexibility and competitive salary packages aligned with industry standards.

Benefits

401k matching

Health insurance

Vision and dental benefits

Flexible paid time off

Qualifications

• 4+ years in building production back-ends using modern Python.
• Experience with WebRTC, gRPC streaming, and proficiency in asyncio or FastAPI.
• Experience with AWS or GCP container orchestration systems.

Responsibilities

• Design and maintain Python micro-services for the voice pipeline.
• Integrate emerging ASR, TTS, LLM components into existing systems.
• Ensure ultra-low latency performance and implement security measures.

Skills

Real-time streaming systems

Concurrency

Communication

Education

B.S./M.S. in CS, EE, or related fields

Tools

Python

AWS

Redis

PostgreSQL

Job description

1 week ago Be among the first 25 applicants

Direct message the job poster from Ellipsis Health

Lead Machine Learning Scientist & Engineer

Ellipsis Health is developing cutting-edge AI/ML products to address healthcare staffing issues and administrative burdens. The platform employs conversational AI and patented vocal biomarker technology to deliver improved healthcare experiences for clients and patients. The team is headquartered in Silicon Valley and is funded and supported by preeminent venture capital groups and healthcare institutions. The organization is open to remote candidates for this role.

Responsibilities

• Expand and maintain our real-time voice pipeline : design, implement, and maintain Python micro-services for conversational AI orchestration—audio capture, streaming transcription, prompt/LLM logic, synthesis, and playback.
• Integrate new providers & transports : add plug-ins for emerging ASR, TTS, LLM, and memory services; wire up WebRTC, SIP, or phone endpoints; build adapters that allow hot-swapping components without downtime. Build API endpoints.
• Deliver ultra-low latency (<500 ms round-trip): profile async pipelines (asyncio, FastAPI, gRPC), optimize buffering, concurrency, and back-pressure handling.
• Instrument & observe every hop: emit structured traces (OpenTelemetry), metrics, and logs for each pipeline stage; define SLOs for first-token latency, end-to-end latency, and streaming reliability.
• Harden for production : implement graceful retries, idempotent message passing, circuit breakers, and HIPAA-compliant security (encryption in transit, per-tenant isolation, secrets rotation).
• Collaborate cross-functionally with ML, product, data engineering, and client-SDK teams to deliver features such as voice cloning, multimodal hand-offs, and domain-specific memory retrieval.

Qualifications

• 4+ years building production back-ends in modern Python.
• Proven experience with real-time streaming systems —WebRTC, WebSockets, or gRPC streaming—and proficiency with asyncio, FastAPI, or similar async frameworks.
• Deep understanding of concurrency, buffering, audio codecs (Opus, PCM), and distributed tracing.
• Solid understanding of AWS/GCP/Azure, including container orchestration (Kubernetes/EKS/GKE), message queues (Kafka/SQS/Pub/Sub), and IaC (Terraform).
• Solid grasp of relational (PostgreSQL) and in-memory (Redis) data stores; able to model and persist conversational state.
• Excellent communication skills and a bias for measured, observable, and continuously deployable software.

Bonus Points If You Have:

• B.S./M.S. in CS, EE, or related fields.
• Familiarity with voice-agent frameworks,
• Hands-on with telephony (Twilio, Telnyx), SIP, or PSTN integrations.
• Experience integrating multimodal inputs (vision, text chat) into voice agents.
• Familiarity with GPU inference and streaming pipelines.
• Prior work in regulated industries (healthcare, finance) and comfort preparing for SOC 2 / HIPAA audits.

Salary and Benefits

We offer competitive salary and benefits, including 401k matching up to a certain percentage of your salary, health, vision, and dental insurance, and very flexible paid time off. The typical salary range for this role is $80,000 to $200,000 USD. The amount offered will be determined by a variety of factors including but not necessarily limited to your individual skills, qualifications, and past experience relative to the requirements of the role.

As a health technology company, we reserve the right to run a background check on any applicant to which we extend an offer and to re-perform any such check at any time during the course of employment. Please know that there is no set policy on rejecting candidates because of certain background check results, and that we look at a candidate as a whole before making any decisions. We comply with all “ban the box” laws in applicable jurisdictions.

Assistance

If you have a disability or otherwise require any assistance whatsoever in the application or recruitment process, please feel free to submit a request to [e-mail] .

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Technology, Information and Internet

Referrals increase your chances of interviewing at Ellipsis Health by 2x

Get notified about new Back End Developer jobs in United States.

Full Stack Engineer (L5), N-Tech Software Engineering

United States $100,000.00-$900,000.00 2 weeks ago

Full-Stack Software Engineer (New graduates: United States)

United States $70,000.00-$100,000.00 1 week ago

United States $130,000.00-$180,000.00 5 days ago

United States $10,700.00-$120,600.00 23 hours ago

United States $90,000.00-$170,000.00 9 months ago

United States $120,000.00-$170,000.00 1 week ago

Denver, CO $80,000.00-$105,000.00 6 months ago

Nashville, TN $90,000.00-$180,000.00 18 hours ago

Beaverton, OR $90,000.00-$180,000.00 18 hours ago

United States $120,000.00-$170,000.00 2 weeks ago

United States $120,000.00-$150,000.00 1 month ago

United States $160,000.00-$180,000.00 1 week ago

United States $140,000.00-$170,000.00 1 month ago

United States $110,000.00-$133,000.00 3 months ago

Lancaster, PA $90,000.00-$180,000.00 18 hours ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.