Networking help

ct_tx

Greetings!

I am trying to get SolusVM working with KVM on a Delimiter machine. I am having trouble with the networking setup and would appreciate any pointers. Here is the setup from Delimiter:

GATEWAY="199.233.247.xxx"
IPADDR="199.233.247.yyy"
NETMASK="255.255.255.192"

I have 4 IP addresses: 199.233.244.aa1 - 199.233.244.aa4

As per instructions provided by the Solus documentation, I setup a bridge in CentOS called br0 and changed my eth0 to reflect this. I get an IP address on br0 and I am able to ssh into the machine and ping outside. The network works as expected.

However, any VPS that is added does not get an IP address. See the outputs of ifconfig below:

br0       Link encap:Ethernet  HWaddr 00:1E:0B:62:A9:3C  
          inet addr:199.233.247.xxx  Bcast:199.233.247.zzz  Mask:255.255.255.192
          inet6 addr: fe80::21e:bff:fe62:a93c/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2515349 errors:0 dropped:0 overruns:0 frame:0
          TX packets:812363 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:3718907607 (3.4 GiB)  TX bytes:57643686 (54.9 MiB)

eth0      Link encap:Ethernet  HWaddr 00:1E:0B:62:A9:3C  
          inet6 addr: fe80::21e:bff:fe62:a93c/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2542690 errors:0 dropped:0 overruns:0 frame:0
          TX packets:813160 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:3766328795 (3.5 GiB)  TX bytes:60952903 (58.1 MiB)

kvm101.0  Link encap:Ethernet  HWaddr FE:16:3C:93:E4:8B  
          inet6 addr: fe80::fc16:3cff:fe93:e48b/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:334 errors:0 dropped:0 overruns:0 frame:0
          TX packets:7294 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500 
          RX bytes:29766 (29.0 KiB)  TX bytes:711024 (694.3 KiB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

virbr0    Link encap:Ethernet  HWaddr 52:54:00:5D:92:AC  
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

Here is my ifcfg-br0:

DEVICE="br0"
TYPE="Bridge"
BOOTPROTO="static"
DNS1="8.8.8.8"
IPADDR="199.233.247.yyy"
NETMASK="255.255.255.192"
ONBOOT="yes"

Here is my ifcfg-eth0:

DEVICE="eth0"
HWADDR="00:1E:0B:62:A9:3C"
ONBOOT="yes"
BRIDGE="br0"

The default gateway is setup under /etc/sysconfig/network:

NETWORKING=yes
HOSTNAME=blahblah.com
GATEWAY=199.233.247.xxx

Thank you very much,

CT

FrankZ

add "kernel.sysrq = 1" to /etc/sysctl.conf

ct_tx

Thank you, FrankZ. I did that and rebooted the server. Still no luck. The VPS is Windows 2008. I tried setting up the networking manually, however, I still can't get in our out of the virtual machine.

CT

Sady

One thing I noticed, what IP block do you have?
199.233.244.aa1 - 199.233.244.aa4 /29 right? You should have 255.255.255.248 as subnet mask not 255.255.255.192

ct_tx

Thanks, Sady. So, I was assigned 4 sequential /32 IP addresses by Delimiter for example, 199.233.244.1/32 to 199.233.244.4.32. I'm not sure why they did that, but that was their email to me. I used Delimiter's client system for installing CentOS and the subnet mask was automatically generated by this process and i haven't changed it.

Also, you may have already noticed that the IP address of the server itself is 199.233.247.yyy and the gateway is 199.233.247.xxx.

FrankZ

Do you have an active firewall on the node?
If so, ensure that forwarding is allowed.

I normally set up /etc/sysctl.conf with the following additions (including IPv6)

net.ipv4.ip_forward = 1
net.ipv6.conf.default.forwarding = 1
net.ipv6.conf.all.forwarding = 1
net.ipv6.conf.all.proxy_ndp = 1
net.ipv4.conf.default.proxy_arp = 0

net.ipv4.conf.all.rp_filter = 1
kernel.sysrq = 1

net.ipv4.conf.default.send_redirects = 1
net.ipv4.conf.all.send_redirects = 0

FYI, No need to reboot, a "sysctl -p" should update the config.

Your IPs are routed and not your own subnet 255.255.255.192 should be correct.

I think you need to add routing for each additional ip (on the node). Try

ip rule add from 199.233.244.aa1/32 table 1504
ip route add throw 199.233.244.aa1/32 table 1504
ip rule add from 199.233.244.aa2/32 table 1504
ip route add throw 199.233.244.aa2/32 table 1504
ip rule add from 199.233.244.aa3/32 table 1504
ip route add throw 199.233.244.aa3/32 table 1504
ip rule add from 199.233.244.aa4/32 table 1504
ip route add throw 199.233.244.aa4/32 table 1504
ip route add default via 199.233.247.xxx table 1504

Do not reboot.

EDIT: I see @MarkTurner replied below. He is really the best one to help you out.

ct_tx

Thanks again, FrankZ. I tried the recommendations, but no luck still. I have messed around quite a bit and probably broke something in the process. I am going to do a clean install and follow your recommendations again. I'll post an update after I do that today.

MarkTurner

@ct_tx - PM the IPs and configs. I'll check them for you.

ct_tx

Just a quick update to the thread: I ended up getting a /29 block. Also, I disabled a virbr0 interface using instructions from here: http://www.cyberciti.biz/faq/linux-kvm-disable-virbr0-nat-interface/. All works well now. Thank you again everyone.