storage traffic not going through Bonded interface

Posted on

storage traffic not going through Bonded interface – Managing your servers can streamline the performance of your team by allowing them to complete complex tasks faster. Plus, it can enable them to detect problems early on before they get out of hand and compromise your business. As a result, the risk of experiencing operational setbacks is drastically lower.

But the only way to make the most of your server management is to perform it correctly. And to help you do so, this article will share nine tips on improving your server management and fix some problem about linux, nfs, linux-networking, bonding, .

hi few days back i have asked a question here

choosing network interface based on network purpose

on my Centos server there are 4 NICs

i bonded first two NICs and created bond0 with an MTU of 8600 and bonded second two interfaces and created bond1

with an intention to use bond0 for storage and bond1 for network traffic.

bond1 is connected to a Linux Bridge – br0

NFS server is at 10.10.10.5 and bond0 has an ip address of 10.10.10.2

bond1 has an ip of 10.10.10.3

two subnets and VLAN are not possible
so what i did was i manually added a route

route add -host 10.10.10.5 dev bond0 

and is visible in

route -n

But for some reason Rx Tx of br0(bond1) is in Gb and that of bond0 is Kb even with lots of data transferred to NFS

Why bond0 is not used for data transfer to NFS
even with this route

Destination   Gateway       Genmask       Flags Metric Ref    Use Iface
10.10.10.5    0.0.0.0         255.255.255.255 UH    0      0        0 bond0

Update:

tcpdump shows Host to NFS server is communicated over IP on bond0 ie 10.10.10.2 but Rx Tx is in KB,and if i bring down IP on bond0 then it uses 10.10.10.3 for NFS communication.

Why is Tx of bond0 not increasing even if uses IP assigned on it to access NFS!!!

Solution :

You can do this by using policy-based routing to hint to Linux to prefer particular interfaces for specific traffic.

However, the setup you’re using here looks very unstable and you’re going to HAVE LOTS OF PAIN in the future.

Leave a Reply

Your email address will not be published. Required fields are marked *