Nvidia launches their “Chat with RTX” offline AI chatbot for RTX 30/40 users

PC gamers can now chat with their GPUs through the powers of RTX

Nvidia has released “Chat with RTX”, a new offline AI chatbot that RTX 30 and RTX 40 series GPU owners can use on their systems.  This AI chatbot operates locally using the AI power of your graphics card. This offers users the ability to analyse their documents, images, and videos to gather important information. Better still, as an offline tool, none of your data is set onto the internet.

Chat with RTX is a free tool that Nvidia are offering GeForce users as a free tech demo. This gives all users of compatible RTX graphics cards the ability to experiment with AI at home.

To use this tool, users need an RTX 30 or RTX 40 series graphics card with at least 8GB of memory. This means that this tool does no support RTX 20 series graphics cards, and that Nvidia’s recently released RTX 3050 6GB is incompatible. The tool also lists Windows 11 as a system requirement alongside 16GB or more of system memory.

Nvidia’s new RTX offline chatbot is available to download here. The download is around 35GB in size. While this is large for a tech demo, it is small for a versatile AI toolset.

You can join the discussion on Nvidia’s new “Chat with RTX” offline AI chatbot on the OC3D Forums.