We use cookies to enhance your experience, serve personalized ads or content, and analyze our traffic. By clicking "Accept", you consent to our use of cookies. For more information, please see our privacy policy.
    Skip to content
    Local AI (NVidia CUDA 12) logo

    Local AI (NVidia CUDA 12)

    Local AI is an open-source, self-hostable online OpenAI API compatible service with WebUI to chat, generate images and more. Works best with DataCrunch provider and GPU instances.
    OfficialAICudaMachine LearningNVIDIAOpenAIOSS

    About Local AI (NVidia CUDA 12)

    Local AI is an open-source, self-hostable online OpenAI API compatible service with chatbot UI. This template is compatible with server which have NVidia GPU with CUDA 12 configured. We tested it with DataCrunch provider in DollarDeploy, and it works well with GPU instances of type A6000 and better (1€/hr).

    Introduction to Local AI (NVidia CUDA 12)

    DollarDeploy

    About DollarDeploy

    DollarDeploy deploys and manages apps on your own VPS — no SSH, no YAML, no lock-in. Launch Local AI (NVidia CUDA 12) in a few clicks, then get HTTPS, monitoring, logs and backups handled for you.