• NVIDIA released a demo version of a chatbot that runs locally on your PC, giving it access to your files and documents.
• The chatbot, called Chat with RTX, can answer queries and create summaries based on personal data fed into it.
• It supports various file formats and can integrate YouTube videos for contextual queries, making it useful for data research and analysis.
The performance on my 3070 was awful, tools like LM Studio work significantly better.
Oh nooo, what an unfortunate turn of events. Guess that just means your GPU is too weak and old. How about upgrading to 40 series?
– Nvidia, probably
On my 4090, the performance is much better than ChatGPT4. The output is way worse though.
Yeah my boss did a screen share with me and it was done instantly, while mine was needing to recompile the embeddings for the 5th time