Take the 2-minute tour ×
Unix & Linux Stack Exchange is a question and answer site for users of Linux, FreeBSD and other Un*x-like operating systems.. It's 100% free, no registration required.

I have a bridge set up between eth0 and br0, the bridge works fine, but sometimes, for unknown reasons and circumstances, I keep getting these off vethXXXXXX interfaces added to the bridge. When this happens my LXC instances can't talk to the internet.

When I run brctl delif br0 vethNbUtXk && brctl delif br0 vethYqTf0F, all is well again.

Any idea where these odd looking interfaces are coming from?

root@ubuntuserver:/var/lib/lxc# brctl show
bridge name     bridge id               STP enabled     interfaces
br0             8000.080027ca5f7a       no              eth0
                                                        vethNbUtXk
                                                        vethYqTf0F
lxcbr0          8000.000000000000       no
virbr0          8000.000000000000       yes

Example ifconfig when one of these odd vethXXXXXX adapters got created

vethPBkvAC Link encap:Ethernet  HWaddr fe:14:5c:cb:62:d6
          inet6 addr: fe80::fc14:5cff:fecb:62d6/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:3194 errors:0 dropped:0 overruns:0 frame:0
          TX packets:3214 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:309019 (309.0 KB)  TX bytes:311213 (311.2 KB)
share|improve this question

2 Answers 2

up vote 1 down vote accepted

This might shed some light: Virtual Ethernet device. Might giving you something like this: Sure you do not have some configuration under /var/lib/lxc/ with lxc.network.type = veth ?

grep -r 'veth' /var/lib/lxc/
share|improve this answer
    
Thanks, this was very helpful in pushing me to understand this better. I see now that each lxc container with lxc-network.type=veth is creating its own ethernet device and attaching it to the bridge defined in lxc.network.link=br0|virbr0|lxcbr0 –  David Parks Mar 28 '13 at 11:27
    
@DavidParks: Nice work. –  Zimzalabim Mar 28 '13 at 14:52

For future readers, I wrote this email to some colleagues of mine who are working with me on configuring LXC and figuring out the bridging.


Well, I spent most of the day today fussing with networking in LXC, and now things are a lot clearer, so I thought I’d pass on what I learned.

First is a couple of definitions so we know what we’re looking at (I didn’t really understand the difference between a bridge like br0 or virbr0 and an interface like eth0, and I definitely didn’t know what those interfaces like vethILNaLo were for).

Bridge

A bridge is shown as an interface in ifconfig, but a bridge does nothing but connect 2 OTHER networks, it’s not a network interface its self. You can see and change bridges by using brctl show, and configure them permanently in /etc/networking/interfaces.

A bridge is best thought of like a switch.

Examples of bridges we see:

  • br0
  • lxcbr0
  • virbr0

Network interface

Interfaces are actually assigned to a single host, a single interface can’t be assigned to multiple hosts. The host sends and receives network traffic to an interface. The interface it chooses depends on the routing table, route will show you this.

The reason we need bridging is that eth0 is physically attached to the host OS and cannot also be attached for a container or other virtual machine.

Examples of physical interfaces we see:

  • eth0
  • vethILNaLo

Some notes about that second one: vethILNaLo

  • This is a physical interface that is created for each LXC container that is started, it’s attached to the container and seen inside the container as eth0
  • Each time you define lxc.network.type=veth in the LXC config file it creates another one of these physical interfaces and attaches it in the container, you can use lxc.network.name = eth0 to set the name of the interface inside the container (the default of eth0, eth1, etc generally works)
  • When this interface is created it’s not connected to anything, it’s like it’s not plugged in at all

Connecting vethILNaLo to a network using a bridge

Remember that a bridge is like a software based switch. If you plug two interfaces into it, they’re connected in the same way that a switch connects physical computers.

In /etc/network/interfaces we defined and created br0, we basically defined a switch. In that same file we also connected eth0 to our “switch” br0:

iface br0 inet static
        bridge_ports eth0

In the LXC config file we connected the containers physical interface to that same swtich:

lxc.network.type=veth
lxc.network.link=br0

/etc/network/interfaces is set up when the computer starts (that makes sense, the hosts eth0 interface should always be connected to our “switch”), and LXC takes care of creating the physical port for our LXC container and plugging it into our “switch” named br0 (the difference between a bridge and a switch is very small, so for this purpose it’s ok to think of them as the same, a switch is only a little smarter than a bridge).

What’s lxcbr0 and virbr0?

lxcbr0 and virbr0 are both automatically added by LXC, these are both the same thing (virbr0 is an older version kept for backwards compatability, lxcbr0 is newer, but they do exactly the same thing). These two bridges (aka “switches”) also provide NAT/routing capabilities. So if you connected your virtual machine to these bridges it would be like connecting it to a router.

Since we don’t need another router (all of our LXC containers will have their own IP on the network) I’ve removed both of these un-used bridges from the host OS in the build doc

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.