KoboldAI Guide by Kimaii

The installation of KoboldAI United
Disclaimers:
- This guide will specifically focus on KoboldAI United for JanitorAI, however the same
steps should work for sites such as VenusChub and other, similar AI chatting websites.
- This is the guide for manual installation only.
- I am in no way affiliated with either KoboldAI or JanitorAI, I am just an individual trying to
procrastinate studying for important exams.
- I normally do not make guides, let alone on Reddit, so it might not be optimal.
- I am willing to answer questions in the comments, but my knowledge is limited.
Step 1:
Head to this site: https://github.com/henk717/KoboldAI

Click the green button called “code,” then select Download ZIP.
Step 2:
Follow this step by step. It is also provided on the github site. Do not forget to run
install_requirements as Administrator. It is an essential step, as KoboldAI will need access to
important parts of your system to run.
Do not close the installer until it asks you to press a key, or you will mess up the process.
Step 3:
Select the windowsbatch file “play” and open KoboldAI. Assuming everything went right, it
should look something like this:
Step 4:
A page should have automatically opened on your browser. It is set to “Read Only,” meaning
you can not use it to chat right now. To fix this, we will need to install Pygmalion 6B. This can be
found following these steps:
1. Press AI
2. Chat Models
3. Pygmalion 6B
DO NOT INSTALL PYGMALION 6B YET, CHECK YOUR GPU FIRST, STEP 5

It should look something like this:
Step 5:
This step is equally important. Note the ‘layers’ that you have to allocate. Pygmalion 6B uses
16GB Vram, but my GPU does not have 16GB Vram available. This is how I know I need to
allocate some to my CPU. Never allocate any to your disk, leave it at zero.
If you do not know how to check your Vram, have no fear, neither did I. Follow these steps:
1. On the Windows search bar, type Settings.

2. Click Display.
3. Click Advanced Display.
4. Click Display Adapter Properties for Display 1.
5. Next to Dedicated Video Memory, you'll be told how much VRAM your graphics card
has.
If this does not work for you/you cannot find it, follow these steps instead:
1. On the Windows search bar, type dxdiag.

2. Wait for it to open then click either Display 1 or Display 2 to view your other GPU.
3. Under Display Memory, you'll be able to see how much dedicated VRAM the GPU has.
You should see something like this:
Now mine is Dutch, but you can see the Vram. I have 12129 MB, which is 12 GB, so I therefore
know I do not have enough Vram to put everything on my GPU. That is why I moved some to
my CPU. I put 22 layers on my GPU and 6 on my CPU, and this is what worked for me.
However, you might have to figure out what works for you.
This is definitely not easy to run for your PC, if you do not have a good PC, do not do
this. KoboldAI offers services to ‘rent’ a GPU, or you can ask a friend to run a server.
Step 5:
Assuming you allocated all your layers, wait for Pygmalion 6B to be implemented. This can take
a long time, but your KoboldAI window should show the progress. After you are done waiting,
once again do not close the window before it’s done, the browser’s info should have
changed from Read Only to something like this:
Remember, you need to reload Pygmalion every time you start the server up. Without it,
the characters will not be able to generate a response.
Step 6:
Close down KoboldAI’s window. I personally prefer to keep the browser running to see if
everything is connected and right. It is time to start up the batchfile “remote-play.” This is where
you find the link that you put into JanitorAI.
It should look something like this. Note the green lines, that’s where the link is in. I use UI 1. The
link is randomly generated every time upon start-up.
Step 7:
Type the link into the KoboldAI API URL box, and press save settings.
Step 8:
You should be connected! Have fun typing away, you heathen!
If you appreciated the guide, leave a comment or upvote on reddit so others can find it!

KoboldAI Guide by Kimaii

Uploaded by

Copyright:

Available Formats

KoboldAI Guide by Kimaii

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

KoboldAI Guide by Kimaii

Uploaded by

Copyright:

Available Formats

The installation of KoboldAI United

Head to this site: https://github.com/henk717/KoboldAI

DO NOT INSTALL PYGMALION 6B YET, CHECK YOUR GPU FIRST, STEP 5

1. On the Windows search bar, type Settings.

1. On the Windows search bar, type dxdiag.

You should see something like this:

You should be connected! Have fun typing away, you heathen!

You might also like