Difference between revisions of "CoE Cluster november 2011/Dell Cluster installation"

From Teknologisk videncenter
Jump to: navigation, search
m (→‎Hardware)
m
Line 84: Line 84:
 
</source>
 
</source>
  
 +
=Head node=
 
==Routing IPv4==
 
==Routing IPv4==
 
*Add or uncomment the line '''net.ipv4.ip_forward=1''' in '''/etc/sysctl.conf''' to allow Routing after boot
 
*Add or uncomment the line '''net.ipv4.ip_forward=1''' in '''/etc/sysctl.conf''' to allow Routing after boot
 
*Issue the command '''sysctl -w net.ipv4.ip_forward=1''' to allow routing in flight.
 
*Issue the command '''sysctl -w net.ipv4.ip_forward=1''' to allow routing in flight.
  
−
=NAT with iptables=
+
==NAT with iptables==
 
<source lang=cli>
 
<source lang=cli>
 
#!/bin/bash
 
#!/bin/bash
Line 122: Line 123:
 
$FW -t nat -A POSTROUTING -o $EXT_IF -s $INT_NET -j SNAT --to-source $EXT_IP
 
$FW -t nat -A POSTROUTING -o $EXT_IF -s $INT_NET -j SNAT --to-source $EXT_IP
 
</source>
 
</source>
 +
==NFS server==
 +
install NFS package
 +
<source lang=cli>
 +
root@headnode:~# <input>apt-get install nfs-kernel-server</input>
 +
</source>
 +
Add export to '''/etc/export''' (Group 1 net shown)
 +
<source lang=cli>
 +
/home  10.100.1.0/24(rw,sync,no_subtree_check,no_root_squash)
 +
</source>
 +
Restart the NFS-Server
 +
<source lang=cli>
 +
root@headnode:~# <input>/etc/init.d/nfs-kernel-server restart</input>
 +
</source>
 +
=Node clients=
 +
==NFS client==
 +
Install NFS client package
 +
<source lang=cli>
 +
root@node1:~# <input>apt-get install nfs-common</input>
 +
</source>
 +
 
{{Source cli}}
 
{{Source cli}}
 
[[Category:CoE]][[Category:Linux]]
 
[[Category:CoE]][[Category:Linux]]

Revision as of 13:50, 8 November 2011

Hardware

Each group installs Ubuntu 10.10 32 bit on four Dell PowerEdge 1750 bladeserver with 36,5GB harddisk.

Rack

Position in Rack

  1. Group 1 Switch
  2. Group 2 Switch
  3. Group 3 Switch
  4. Head node Group 1
  5. Node 1 Group 1
  6. Node 2 Group 1
  7. Node 3 Group 1
  8. Head node Group 2
  9. Node 1 Group 2
  10. Node 2 Group 2
  11. Node 3 Group 2
  12. Head node Group 3
  13. Node 1 Group 3
  14. Node 2 Group 3
  15. Node 3 Group 3

Filesystem

  • / filesystem 2 GB primary
  • /tmp filesystem 5 GB logical
  • /var filesystem 5 GB primary
  • /usr filesystem 6 GB logical
  • swap filesystem 2 GB logical
  • /home filesystem remaining space

Updating Ubuntu

Update

sudo bash
apt-get update
apt-get upgrade

List installed packages

Number of installed packages

root@newclusterh:~# <input>dpkg --get-selections | wc -l</input>
962

Searching installed packages

root@newclusterh:~#  <input>dpkg --get-selections | grep nfs</input>
libnfsidmap2                                    install
nfs-common                                      install
nfs-kernel-server                               install
root@newclusterh:~# <input>dpkg -L nfs-common</input>
/.
/etc
/etc/init.d
/etc/init
/etc/init/statd.conf
/etc/init/statd-mounting.conf
/etc/init/rpc_pipefs.conf
/etc/init/gssd.conf
<notice>...OUTPUT OMITTED...</notice>

Routing IPv4 and NAT-ing

Configuring additional NIC's

  • Cluster networks between Headnode and Nodes.
    • Group 1: 10.100.1.0/24
    • Group 2: 10.100.2.0/24
    • Group 3: 10.100.3.0/24
  • Headnode public IP address
    • Group 1: 192.168.139.21
    • Group 2: 192.168.139.22
    • Group 3: 192.168.139.23

edit the file /etc/network/interfaces. Example below 

auto eth0
iface eth0 inet static
 address 192.168.139.50
 netmask 255.255.255.0
 gateway 192.168.139.1
 network 192.168.139.0
 broadcast 192.168.139.255

auto eth1
iface eth1 inet static
        address 10.0.0.1
        netmask 255.255.255.0

Head node

Routing IPv4

  • Add or uncomment the line net.ipv4.ip_forward=1 in /etc/sysctl.conf to allow Routing after boot
  • Issue the command sysctl -w net.ipv4.ip_forward=1 to allow routing in flight.

NAT with iptables

#!/bin/bash
#
# Start firewall
#
# Tillader ping indefra og ud.
# Lukker for al anden trafik.
# Diverse erklæringer
FW=iptables
INT_NET="10.0.0.0/24"
EXT_NET="172.16.4.0/24"
EXT_IP="172.16.4.99"
EXT_IF="eth0"

# Fjern alle tidligere regler
$FW -F INPUT
$FW -F OUTPUT
$FW -F FORWARD
$FW -F -t nat


# Sæt default politik til afvisning
$FW -P FORWARD ACCEPT

# Tillad ping indefra
$FW -A FORWARD -s $INT_NET -p icmp --icmp-type echo-request -j ACCEPT

# Tillad pong udefra
$FW -A FORWARD -d $INT_NET -p icmp --icmp-type echo-reply -j ACCEPT

# Source NAT på udgående pakker
$FW -t nat -A POSTROUTING -o $EXT_IF -s $INT_NET -j SNAT --to-source $EXT_IP

NFS server

install NFS package 

 root@headnode:~# <input>apt-get install nfs-kernel-server</input>

Add export to /etc/export (Group 1 net shown) 

/home   10.100.1.0/24(rw,sync,no_subtree_check,no_root_squash)

Restart the NFS-Server 

root@headnode:~# <input>/etc/init.d/nfs-kernel-server restart</input>

Node clients

NFS client

Install NFS client package 

root@node1:~# <input>apt-get install nfs-common</input>
Retrieved from "http://mars.merhot.dk/w/index.php?title=CoE_Cluster_november_2011/Dell_Cluster_installation&oldid=20035"