How to get llama 2 up and running , in a VM, with no GPU, and limited memory on Ubuntu

Image
OK I decided to write this up after unsuccessfully being able to find all the required info I needed in one place. In this setup we will be using Ubuntu Server 22.04.2 LTS as the OS. I have this running on a home lab ESXi server 8, on a HP Compaq Pro 6300 SFF CPU = Intel Core i7-3770 Installed Memory 16 GB I have some 10K SAS drives installed for the VM's If you have not already, navigate to  Get Ubuntu Server | Download | Ubuntu and download the 22.04.2 LTS ISO Next Lets create our VM that we are going to run this in. *Note Im using ESXi however you can probably do this in Workstation, Fusion, VirtualBox etc The main things to note on the VM creation. Set Ubuntu 64 bit as the guest OS Set your CPU relevant to the physicals CPU, I will be starting with 4 VCPU Set your Memory to as much as you can tolerate, I will be using 12 Disk Space - we are creating a 100G swap file, and the rest of the file can take up some room , so more is better if you can afford it Dont forget to add the U

VMware View 2-factor authentication with Google Authenticator - Part Two

Installing Ubuntu 16.04
Now that the VM is powered on and you in the console window select English, then Install Ubuntu server.
(some times it appears that its frozen, this is just the client having issues re-drawing, close and reopen the console and your good to go)



Basic stuff here, choose English again

Select your country
don't detect keyboard layout (unless you have a non qwerty keyboard)
Finish selecting your keyboard layouts.
And wait for some stuff to load

You will be prompted to give your server a host name. Put in the FQDN you plan to use.


create a user, this is a local user so nothing fancy, and a password:

For the purpose of this demo I have chosen not to encrypt my home directory.
Select your time zone if the one that comes up is not correct.
Unless you know what your doing just use the defaults for setting up the disk.


Write your changes to the disk
Select Continue
And then Confirm.

Bunch of stuff will install.
You will be prompted for a proxy, if you do not have no say no
Next screen is to install security updates , i choose automatically

When you get to the package selection, the only thing we want is 'Stand system utilities and OpenSSH server

And you will get some more packages installing.
It will prompt you to install GRUB on the boot loader, say yes

The VM will reboot and you will be at the command prompt.
remove the CD rom as we dont need it any more.
now log into the VM.



From the command prompt run the following:
sudo su
enter your password
vi /etc/network/interfaces

Change your network setting to what is required for your network for example:
iface ens160 inet static
    address 192.168.3.3
    netmask 255.255.255.0
    gateway 192.168.3.1
    dns-nameservers 192.168.3.45 192.168.8.10 8.8.8.8

Save your changes

run
cat /etc/hosts
and verify that you see an entry of
127.0.0.1   servername.company.com    servername

if not add it now

then reboot
reboot

once rebooted grab Putty and connect to your server:
accept the new certificate
and you should now be at a command prompt.

Got to Part 3 to Continue.




Comments

Popular posts from this blog

vSphere 7 - Specify a vmkernel adapter to use for NFS datastores Step By Step \ Walkthrough on a DVS

Horizon View 2-factor Authentication for Free! with Google Authenticator or others

Windows 11 Insider Preview Instant Clones Horizon 8 2103 walkthrough - Part 1 Image setup