How to get llama 2 up and running , in a VM, with no GPU, and limited memory on Ubuntu

Image
OK I decided to write this up after unsuccessfully being able to find all the required info I needed in one place. In this setup we will be using Ubuntu Server 22.04.2 LTS as the OS. I have this running on a home lab ESXi server 8, on a HP Compaq Pro 6300 SFF CPU = Intel Core i7-3770 Installed Memory 16 GB I have some 10K SAS drives installed for the VM's If you have not already, navigate to  Get Ubuntu Server | Download | Ubuntu and download the 22.04.2 LTS ISO Next Lets create our VM that we are going to run this in. *Note Im using ESXi however you can probably do this in Workstation, Fusion, VirtualBox etc The main things to note on the VM creation. Set Ubuntu 64 bit as the guest OS Set your CPU relevant to the physicals CPU, I will be starting with 4 VCPU Set your Memory to as much as you can tolerate, I will be using 12 Disk Space - we are creating a 100G swap file, and the rest of the file can take up some room , so more is better if you can afford it Dont forget to add the U

Configure windows (and MAC) to point to a specific DNS server for Specific domain

 I have probably searched off an on for this solution for about 10 years at this point, and always found some other way to work around the issue.

Well today I was searching for some other DNS settings and found this:


https://docs.microsoft.com/en-us/powershell/module/dnsclient/add-dnsclientnrptrule?view=windowsserver2022-ps


And it actually works!


So here is my example:

Add-DnsClientNrptRule -Namespace ".universe.lab" -NameServers "10.10.1.1"


Ran this as an admin

I want any thing going to 'universe.lab' (dont forget to pre-pend the "." ) to go to 10.10.1.1


And then you can check what you have configured



PS C:\WINDOWS\system32> get-DnsClientNrptRule



Name                             : {2942DF55-16A3-4EED-B71B-7274B18F4FED}

Version                          : 2

Namespace                        : {.universe.lab}

IPsecCARestriction               :

DirectAccessDnsServers           :

DirectAccessEnabled              : False

DirectAccessProxyType            :

DirectAccessProxyName            :

DirectAccessQueryIPsecEncryption :

DirectAccessQueryIPsecRequired   :

NameServers                      : 10.10.1.1

DnsSecEnabled                    : False

DnsSecQueryIPsecEncryption       :

DnsSecQueryIPsecRequired         :

DnsSecValidationRequired         :

NameEncoding                     : Disable

DisplayName                      :

Comment                          :



Fantastic right?!


And just to add in , the command for macOS is below just change the 10.10.1.1 to your DNS server and change universe.lab to your specific domain.


sudo cat 'nameserver 10.10.1.1' > /etc/resolver/universe.lab



Comments

Popular posts from this blog

vSphere 7 - Specify a vmkernel adapter to use for NFS datastores Step By Step \ Walkthrough on a DVS

Horizon View 2-factor Authentication for Free! with Google Authenticator or others

How to get llama 2 up and running , in a VM, with no GPU, and limited memory on Ubuntu