Difference between revisions of "Cluster der kan alt"
m (→Lab environment on local PC) |
(→Test af head installation på fysisk maskine) |
||
| (5 intermediate revisions by 2 users not shown) | |||
| Line 32: | Line 32: | ||
#[[/Routing NAT and NIS|Configure Routing, NAT and NIS]] | #[[/Routing NAT and NIS|Configure Routing, NAT and NIS]] | ||
#[[/PXE and Kickstart|PXE and Kickstart configuration]] | #[[/PXE and Kickstart|PXE and Kickstart configuration]] | ||
| − | #[[/Configure NFS server, Apt | + | #[[/Configure NFS server, Apt cacher and SSH auto login|Install and configure NFS server, apt-cacher and SSH auto login]] |
#[[/Multi Router Traffic Grapher|Install and configure Multi Router Traffic Grapher - MRTG]] - doesn't work properly | #[[/Multi Router Traffic Grapher|Install and configure Multi Router Traffic Grapher - MRTG]] - doesn't work properly | ||
#[[/DSH and MPI|Install and configure DSH and OpenMPI]] | #[[/DSH and MPI|Install and configure DSH and OpenMPI]] | ||
| Line 61: | Line 61: | ||
#[[/Installation af head node|Installation af head node]] | #[[/Installation af head node|Installation af head node]] | ||
| − | #[[/Installation af CUDA|Installation af CUDA]] | + | #[[/Installation af CUDA|Installation/testing af CUDA]] |
| − | #[http://www.raben.com/content/opencv-installation-ubuntu-1204 Installation | + | #[http://www.raben.com/content/opencv-installation-ubuntu-1204 Installation af OpenCV] |
| + | #[[/makefile script |Makefile]] | ||
== Udvikling fase 2 == | == Udvikling fase 2 == | ||
Latest revision as of 10:52, 4 November 2014
Introduktion
At udvikle et Ubuntu cluster installationsmetode og implementere den fysisk således at programmer kan afvikles.
metode
Installationsmetoden udvikles på ESXi og implementeres på de fysiske servere.
Mål
- En master
- minimum to noder
- automatiseret installation af noder. (Så godt som muligt)
- automatiseret oprettelse af brugere LDAP eller NIS
- MPI
Lab environment on local PC
LAST UPDATE AUTUMN 2014 (pre-course edits) Comments, corrections and additions welcome! :-)
This lab environment is build upon the virtual platform VMware Workstation and Ubuntu-Server 14.04.1 64Bit (ubuntu-14.04.1-server-amd64.iso) as cluster and nodes OS. Ubuntu server can be downloaded here
This guide will guide you though how to build a virtual Linux/Ubuntu cluster lab environment on your local machine. This environment can later be implemented on the real cluster.
Master installation and configuration
- Install master
- Install and configure DHCP server
- Install and configure DNS server
- Configure Routing, NAT and NIS
- PXE and Kickstart configuration
- Install and configure NFS server, apt-cacher and SSH auto login
- Install and configure Multi Router Traffic Grapher - MRTG - doesn't work properly
- Install and configure DSH and OpenMPI
- Install and configure OpenCV
Nodes installation and configuration
Udvikling fase 1
- Installer ESXi
- Installer Ubuntu Master
- Installer og konfigurer DHCP server
- Installer og konfigurer DNS server
- Routening og NAT gennem Master
- LDAP eller NIS til user login på noder
- Tilføjelse af ny klient
- PXE installation af noder
- NFS Server til netværk shares
- apt-cacher installation
- Auto SSH login på noder uden at skrive pass
- Kickstart fil til installation af noder
- Overvågning med MRTG
- Distributed Shell dsh
- Installation af openMPI og MPICH
- Installation af OpenCV
- InfiniBand
Test af head installation på fysisk maskine
Udvikling fase 2
- Tilpasning af SW og konfigurationsfiler til noder
Udvikling fase 3
- Installation af SAN
Udvikling fase 4
- Installation af fysiske maskiner
Netværk
- Qlogic switch
- Telnet eller http: til 172.16.4.11 (username admin password adminpass)
- 3550 Gb switch
- Telnet til 172.16.4.88 password cisco
Hastighed
Infinibands hastighed er 4.38 Gbits/sec
Harddisk partitionering
På det rigtige cluster er partitioneringen lavet som følger:
- /
- ext4 5GB
- /tmp
- ext4 10GB
- /var
- ext4 15GB
- /boot
- ext4 2GB
- /usr
- ext4 50GB
- swap
- swap 2xRAM
- /home
- ext4 resterende plads - 10GB