Connor Holowachuk | Project dnai-labs-realtime-chat

Project Overview

DNAi's real-time chat feature allows users to chat with a digital version of their service provider, with remarkably low latency. Making use of the LPU and TPU advancements made possible by Groq and SambaNova, I was able to bring latency down to less than 500ms for natural, flowing conversations. User also enjoy real-time chat summaries and topics, all with end-to-end encryption for added security.

Technologies

Explore the technologies I used to build this project

DemoHere is a short demo of how professionals can clone themselves to create a DNAi, and share with their clients/patients.

Features

Realtime chat with DNAi was built to be a fast, secure and interactive experience.

Websocket Streaming

Audio streams of the DNAi's responses are streamed to the user as they are generated, providing a quick, seamless and interactive experience.

Updatable RAG

To present users with the latest infromation, professionals are able to easily update their knowlegde base through a chat with our onboarding assistant.

Sub-500ms Latency

Realism is key to comfortable conversations with a DNAi. Llama 3.1 running on TPUs and LPUs were leveraged for a fast, realistic conversational interaction.

E2E Encryption

End-to-end encryption is a must for any chat application. We use industry standard AES-256 encryption to ensure that the conversations between users and service providers are private.

Real-Time Chat Summaries

Users can view the summaries that are shared with their service provider during the conversation so that they are comfortable with the information being shared.

Topic Summaries

Conversation topics are summarized and presented to the user so that they can quickly view the information that will be shared with their service provider.

Multimodal Inputs

Users can speak and type messages to the DNAi, and supplement their responses with images and videos to be shared with their service provider.

Secured by Authentication

Users are required to login to the application to access the real-time chat feature, ensuring that only authorized users can access the service provider's DNAi.

Similar Projects

Explore other projects similar to this one

Crane Avoidance

Hardware Software Firmware

In-cab display to help crane operators avoid collisions.

Mobile App

Software Startup

Connect with your coach, improve your form, and stay on track to reaching your goals.

Dashboard

Software Startup

An easy-to-use dashboard where professionals can deploy and manage their DNAi.

Realtime Chat