Unix

2009’s Virtualization Techniques Compared

June 4, 2009 in Computer, Hardware, Network, Security, Software, Unix

Hi folks, before we get started a small explanation of my setup and why I want to replace it.
My small home server runs Xen 3.3 with Ubuntu Intrepid, a Debian Xen kernel and the guests on LVM devices. Guest OSs vary from Debian over Solaris to Windows. I built the server last year, but sadly I’m already running out of HDD space and want to upgrade soon. I also want to re-install the Dom0 because Intrepid doesn’t run very well: USB doesn’t work with all devices, there are some bugs in the start-up scripts and I have trouble with the ttys.
A lot has changed since I last fiddled with virtualization so I used this weeks bad weather to compare the current status of all those virtualization systems.
Because there are so many different needs, there are many specialized solutions for desktop and server virtualization. Open-Source, free or commercial ones.

I use VirtualBox on my workstation because it’s free, fast, easy to use and runs very very well. I’ve used the VMware products earlier on Linux and Windows until they became too feature-rich, slow and sometimes even buggy for me. But this post is not about desktop virtualization, it’s about open-source (or free) server virtualization.

VMware Server, VMware ESXi, Microsoft Hyper-V, VirtualBox, Xen and KVM are the ones I’ve tried. There is also Virtuozzo, OpenVZ, UML and so on, but these are more like chroots on steroids. Continue reading to see what I liked and what I didn’t like about them.

help.ubuntu.com links to my blog

June 1, 2009 in Computer, I'm Bitching, Unix

I was just comparing the current status of KVM, Xen and some other virtualization techniques when I came across the Ubuntu Help for Xen. The page states that Ubuntu still doesn’t provide a Xen Dom0 Kernel in their latest release, but that doesn’t surprise me becaus Xen still didn’t make it into the official Kernel… maybe because everyone loves KVM that much. But they link you to a blog post which shows how to run Xen on Ubuntu anyhow.

Noticed it? Yes that’s my article. I was really surprised to see a link to my actually pretty provocative article on an Ubuntu site. They could have also linked to bderzhavets article.

So… that’s it for now. I’ll continue comparing virtualization techniques with the help of debian-user-german and will hopefully begin with the reinstallation of my xen host.

Linux hates me!

February 25, 2009 in Daily Life, I'm Bitching, Unix

I started using Linux back in 2004 with SuSE Linux 9.0 and I liked it. When I upgraded to 9.1 (or 10.0? don’t know…) I got a bit disappointed, which is why I switched the distro. I installed Debian Stable (Sarge at that time), but I found the KDE version coming with Debian Sarge to be pretty old (or older than the SuSE 9.0 ones…I have versionitis you know), which is why I upgraded to SID. I knew that SID isn’t meant to run on production systems, but I got tired of the dependency problems ‘n stuff pretty soon… I then installed Gentoo on my Desktop and kept Debian Stable on my server which worked very well for more than two years. I mean… first time installation of Gentoo was a pain in the ass on my AMD Athlon XP 1800+ and upgrades (especially KDE upgrades) were annoying, but the system ran well and the rolling-updates were cool. I also learned a lot about the Linux internals like the kernel itself, using command line and editing config files… all the basic stuff which helped me quite a lot with OpenBSD and MacOS later on.

Everything worked well until I got p*ssed off by the compiling times. So I upgraded the hardware to a Quad-Core CPU and 8Gb RAM and installed Gentoo AMD64. Maybe that was a mistake: Flash didn’t work without hacks, Java browser plugin didn’t work, KDE applications crashed more often than on the old installation, GUI applications felt sluggish and the compiling times were not as good as I expected them to be (never figured out why).

Stop reading now if you don’t want to hear me bitching! Read more…

My Backup Strategy

January 3, 2009 in Computer, Software, Unix

Now that a new year is here I really need to finish some points of my To-Do list! Here we go…
As I said few weeks ago, maybe a little bit delayed, here comes how I backup all my stuff. This post is not a how-to. It’s just a configuration example. If you want a howto use this link. Read more…

How-To: Windows Live Messenger and Webcam through OpenBSD and PF

December 31, 2008 in Computer, How-To, Security, Software, Unix, Windows

bsd1 Windows Live Messaging is cool! All the others just suck! – At least that’s what almost everyone I know tells me. I mean… it has nice features, but it uses such a complex protocol that I don’t even want to think about security.

During the Christmas time I visited my family and one evening I wanted to talk to a cousine using MSN and my Dell XPS M1530’s Webcam, but HELL this crappy SoHo router I was connecting through made it impossible to get a picture of her on my screen or to send her mine. Back home we wanted to try again… I know it worked before, but it wasn’t reliable. Sometimes it worked, sometimes not. Mhhh…. I set up my OpenBSD 4.2’s PF “firewall” about a year ago:

rdr on $ext_if proto tcp from any      to ($ext_if) port 5190 10.1.16.11
rdr on $ext_if proto tcp from any      to ($ext_if) port 1863 10.1.16.11
rdr on $ext_if proto tcp from any      to ($ext_if) port 6891:6901 10.1.16.11
rdr on $ext_if proto udp from any      to ($ext_if) port 5190 10.1.16.11
rdr on $ext_if proto udp from any      to ($ext_if) port 1863 10.1.16.11
rdr on $ext_if proto udp from any      to ($ext_if) port 6891:6901 10.1.16.11

Actually I thought that’s it (according to portforward.com), but it seems like it isn’t. I then googled around a bit… found a lot of outdated information and then came across a few newer posts which stated that UPNP is important for the full Live Messenger “experience”.

O.K. another short google: MiniUPNPd. Runs on most BSDs and even supports Linux’s iptables. So I downloaded and installed it according to the INSTALL file included in the tarball. In short, just do: make, make install, add rdr-anchor miniupnpd and anchor miniupnpd to your pf.conf, reload pf.conf, setup miniupnpd.conf or start with miniupnpd -i <yourextif> -a <yourinternalip>. That’s it.

To test if it’s working I found http://www.microsoft.com/windows/using/tools/igd/default.mspx (GRML! requires Windows, Internet Explorer and admin privileges) to be pretty useful. The UPNP test passed successfully. Aaaaand… et voilà she could see me and I could see her.

BUT the price of this is decreased security. Any crappy program could now modify my firewall ruleset!!! I am not going to write about UPNP security (just because I am not very familiarly with it), so if you’re curious read this post. But on the other hand, if you already have malware on your computer that wants to open ports in your firewall… you have other problems.

P.S. i know that’s the FreeBSD devil in the upper left, but I haven’t found anything better……..

How-To: Run Xen in Ubuntu Intrepid without compiling a Kernel by yourself

December 12, 2008 in Computer, How-To, Unix

Update: Also read my Article about current Virtualization Techniques

I got some strange errors when I tried to run OpenSolaris on Hardy as a HVM domain. These errors were fixed in 3.3, but Ubuntu Hardy doesn’t have Xen 3.3 and there were no backports at that time (don’t know if there are ones now) so I upgraded to Ubuntu Intrepid an then noticed that Canonical has dropped Xen Dom0 support. Great! Why the heck did they drop Xen? Because KVM is cooler? Or because they didn’t want to blame themselves by releasing another totally buggy self-patched Dom0 kernel? I mean they didn’t even manage to provide a working one later on so the community had to…and thats a LTS release? WTF?

O.K. well… You want Xen 3.3 with it’s improvements? You don’t want to switch the distro? You don’t want to compile on your own? Here’s how I did it with Ubuntu Intrepid:
I used the Xen 3.3 Hypervisor and Utils coming with Intrepid and then stole a Dom0 kernel from Debian. Debian has linux-image-2.6.26-1-xen-amd64 and linux-modules-2.6.26-1-xen-amd64. I installed both packages and by now everything works great.

O.K. I called this post How-To so here comes how to install the Debian packages on Ubuntu. I will only show you how to install them by hand, you could also add the Debian repos to your sources.list and use pinning.

wget http://ftp.de.debian.org/debian/pool/main/l/linux-2.6/linux-modules-2.6.26-1-xen-amd64_2.6.26-10_amd64.deb
wget http://ftp.de.debian.org/debian/pool/main/l/linux-2.6/linux-image-2.6.26-1-xen-amd64_2.6.26-10_amd64.deb
sudo dpkg -i linux-modules-2.6.26-1-xen-amd64_2.6.26-10_amd64.deb
sudo dpkg -i linux-image-2.6.26-1-xen-amd64_2.6.26-10_amd64.deb
wget http://ftp.de.debian.org/debian/pool/main/l/linux-2.6/linux-modules-2.6.26-1-xen-amd64_2.6.26-12_amd64.deb
wget http://ftp.de.debian.org/debian/pool/main/l/linux-2.6/linux-image-2.6.26-1-xen-amd64_2.6.26-12_amd64.deb
sudo dpkg -i linux-modules-2.6.26-1-xen-amd64_2.6.26-12_amd64.deb
sudo dpkg -i linux-image-2.6.26-1-xen-amd64_2.6.26-12_amd64.deb

Or find the latest using these links: modules kernel
That’s it. There are no other depends. Just reboot. The new kernel should now be the default one. But keep in mind that this is just a workaround.

If I should ever reinstall this Xen-Server: I WILL NOT USE UBUNTU ANYMORE! All these annoying stupid errors… Maybe Debian or CentOS. I mean… I like Ubuntu, it’s a great beginner distro and even lets the nerds control everything they want, but what Canonical delivered the last few months just sucks. All these annoying bugs they added by patching arround: Non-working sound, A buggy KDE4. O.K. you could say that’s all desktop related stuff, but on my server for example I had some very strange XFS errors with the Ubuntu-Server kernel that just disappeared with the (also newer, maybe that’s the point) Debian kernel.

How-To: Encode Videos for iPhone or iPod on any Unix using ffmpeg

November 20, 2008 in Computer, How-To, Mobile, Software, Unix

Imagine what? I’m a big fan of the iPhone/iPod touch for mobile entertainment and since I’m also a big fan of the commandline, I of course want to use ffmpeg for video conversion.
But… I’ve been looking for a working ffmpeg config for serveral months now. There were issues with Medibuntu’s version of ffmpeg for Ubuntu Hardy (or at least I had a lot of issues), there were issues with iTunes’ crazy restrictions, there are dozens of (non) working ffmpeg configs on the web… so I just want to share my config with you. Read more…

How-To: Setup WebDAV and MySQL Authentication using Apache2

November 15, 2008 in Computer, How-To, Software, Unix

FTP is depracted. It’s been designed back in the days when the Internet consisted only of a few Computers. It’s not Firewall friendly (there are some hacks to get it through today’s Firewalls though) and should not be used any longer. Especially because the standard FTP protocol sends your password in clear-text across the net. Read more…

How-To: Backup MySQL using AutoMySQLBackup

November 14, 2008 in Computer, How-To, Unix

Have you ever had a hard disk or server failure and lost important docs? Well… I had.

I’ve been looking for a MySQL backup solution for a few days now, found many scripts, but only one that fits all my needs (Separated daily/weekly backups of all my databases, automatic backup rotation and network support): AutoMySQLBackup. Read more…