Cybolic.me

EVE Online Trinity - in Linux

2007-12-14T13:39:00Z

I've just begun my venture into the world of EVE Online and find it quite intriguing. However, since the "port" to Linux was poorly done by Transgaming I was having quite some problems with parts of the game, namely it's locking of the soundcard and it's often crashing. Here is a (rather hold-in-hand style, sorry to those who find it boring) guide on how to set up EVE in Linux so you can listen to music while playing and run the game in a window so it won't leave your system unusable when the client freezes (and so you can minimise it and switch to other tasks, this is Linux, remember?).

1. Installing the client

Last I downloaded EVE for Linux, it wouldn't even install properly, set wrong permissions and no amount of tweaking would get it running, so I was a bit hesitive this time, but to my surprise Trinity installed without a problem (as a single user install (on Mint (that is based on Ubuntu))). You can download EVE for Linux here: http://www.eve-online.com/download/linux.asp

2. Setting its preferences (for shared audio)

As standard, Transgaming (the company responsible for "porting" EVE to Linux (it's not a port, it's just EVE and Cedega in single package)) has set Trinity to be the only program allowed to use the soundcard - to fix this, open a terminal and type the following:
env CEDEGA_PATH=$HOME/.cedega $HOME/.cedega/.ui/runGUI
to get to the Cedega user interface.
Click on "EVE Online" to your left, and then right click on "Play EVE" on your right and select "Edit Settings for this Shortcut" (the window that pops up is also accessable from the "EVE Online Configuration" launcher in your desktop environments application menu, as "Configure Options", but this method has a few extra possibilites we'll use in a moment).
You should now see this:
Switch to the audio tab, and edit the text fields so it says "default", like so:
Other programs can now also use the soundcard while you're playing EVE. If that was all you wanted to do, you can stop reading now.

3. Setting it to window-mode

Now, Transgaming didn't do a very good job in my oppinion in the "porting", as the client crashes often, and also has the same "inactivity bug" as WoW suffers from in Cedega, being that the program freezes if left untouched for a few minutes (even sometimes just when there's not much action in the game). Since Transgaming haven't bothered giving us the option to run EVE in a window (like it seems the Windows client can), this causes your computer to become unreachable as Cedega also grabs the keyboard focus, so you can't get out of the game if (when) it crashes.
To remedy this, we can force EVE to run in a window, so we can at least kill it when it freezes.
Let's go back to the Cedega window. Right click on "EVE Online" to your left, and select "Add Shortcut":
In the window that appears we need to do a few things. First we have to give the shortcut a name, I suggest you call it "EVE" to make it easier to follow my example. Then, we need to tell Cedega where the EVE executable is. Instead of just giving it the standard EVE executable, we're going to give it the one that the standard EVE executable executes (if we don't we'll end up with two windows instead of one - the EVE window and the EVE splash-window (and no, the splash-window does not go away until you exit the game)).
So, type "/home/YOURUSERNAME/.cedega/EVE Online/c_drive/Program Files/CCP/EVE/bin/ExeFile.exe" (replacing YOURUSERNAME with your username) next to "Path to Program". Also, I suggest you click the "Extract Icon" button, as the Windows icon for EVE is much nicer than the one Transgaming has supplied for Linux - don't ask why.
Set the "Working Directory" to "/home/YOURUSERNAME/.cedega/EVE Online/c_drive/Program Files/CCP/EVE" (again replacing YOURUSERNAME). We also have to pass it some arguments, one to stop it from trying to display a splash screen that won't display, and one to make it start a bit faster, so write "/nosplash /noconsole" next to "Command Line Options:".
Next, select "EVE Online" as the GDDB Profile to make Cedega run the game correctly.
The window should now look much like this:
Before we can go further and edit the settings (to make it run in a window), we need to click the "Ok" button first to make Cedega save this shortcut - so go ahead and click it.
Now, let's make it run in a window.
Much like before, right click on the EVE icon we just created and select "Edit Settings for this Shortcut". I suggest you repeat the steps from before to make Cedega play nicely with other audio programs, so go back to see how we did that.
Back in the "General" tab, simply select your desired window size at "Run in Window" to your right, and uncheck "DXGrab" to make your mouse able to leave the window (you really want that, you really do).
Your window should now look much like this:
Now that we have configured Cedega to be able to run EVE in window mode, we need to configure EVE to run in the window., so let's start her up. With our "EVE" selected in the list to right in the Cedega window, click the play button in the top of the window to start EVE.
When EVE has loaded (you don't need to log in), press the Escape key on the keyboard and a settings window will appear.
Select the same "Adapter Resolution" as you did in the Cedega Settings window and click apply:
EVE is now configured.
Now, our windowed EVE isn't much good if we can't run it, so here's the command to do so:
env CEDEGA_PATH=/home/YOURUSERNAME/.cedega /home/YOURUSERNAME/.cedega/.ui/runGUI -run "EVE Online" "EVE"
(again, replace YOURUSERNAME with your username)
To add this as a shortcut to your panel in Gnome (if that's what you're running), I suggest you locate the original EVE icon under Games, right click on it and select "Add this launcher to panel". Then right click on the newly added icon on your panel, select Properties and replace whatever is in Command with the command above. I'll leave finding our fancy icon from Windows as an exercise for the reader ;)
You now have a nice and easy access to running EVE on Linux without it freezing your system or stealing your soundcard. Enjoy.

EVE Icons

2007-12-14T21:13:00Z

Well, turns out I'm not really a fan of the Windows icons for EVE either, so I set about finding a replacement icon, and what'd'you'know - there aren't really any (please correct me, and direct me, if I'm wrong). So I made my own.

I made two simple versions of the Trinity logo, and I encourage anyone who knows how to flip a pixel to try and make their own - EVE really needs custom icons (IMO anyway).

UPDATE: I found a tool that could extract the high quality icons from the EVE executable, so I've added them here as well. Turns out I was VERY close to the official icon with my 16x16 version... funny.

	Official	Basic	Basic with planet
128px
48px
32px
24/22px
16px

(note: All "Basic" (and "Basic with planet") icons were done from scratch in Inkscape (16x16 in Gimp) - they are not derivative works)

More about EVE (in Wine)

2007-12-19T23:34:00Z

Okay, annoyed with the choppiness of EVE in Cedega (the official "client" on Linux) I set out to get EVE running in Wine.

The instructions for setting it up are on the EVE forum, but the thread is 60 pages long, so I've added it as steps here instead (for Debianish systems (Debian, Ubuntu, Mint, etc)).

Since the install works fine in vanilla Wine, I'll just skip that bit as it is really point and click (check winehq.org if you have doubts about how to install wine - you'll at least need to add their repository).

Open a terminal and let's go! (just copy-paste this stuff line for line)

1. Creating a patched Wine package

First, we need the sourcecode to Wine:

apt-get source wine

Go to the newly created directory containing the sourcecode:

cd wine-0.9.*

Get and apply the patch (developed by aturkin and stefand from #winehackers@FreeNod): This adds support for some advanced network operations that vanilla Wine currently doesn't have and EVE Trinity require.

wget http://stud4.tuwien.ac.at/~e0526822/0001-implement-BindIoCompletionCallback.patch
patch -p1 < 0001-implement-BindIoCompletionCallback.patch

Get the packages required to compile Wine: This might take some time to finish.

sudo apt-get build-dep wine

Change the version number of our Wine-package: This makes it easier to keep of track of what version we have installed.

cp debian/changelog debian/changelog.backup && echo -e 'wine ('$(dpkg-parsechangelog | grep 'Version: ' | cut -d\  -f2-)'eve) '$(dpkg-parsechangelog | grep 'Distribution: ' | cut -d\  -f2-)'; urgency=low\n\n  * Small patch to make EVE work\n\n -- '$( dpkg-parsechangelog | grep 'Maintainer: ' | cut -d\  -f2-)'  '$(dpkg-parsechangelog | grep 'Date: ' | cut -d\  -f2-)'\n\n'"$(cat debian/changelog)" > debian/changelog

Compile Wine and make a package of it: Put on a movie while this command finishes, it's going to take a while.

dpkg-buildpackage -rfakeroot

Now, install the package:

sudo dpkg -B -i ../wine_0.9.*eve*.deb

2. Running EVE

Run:

cd "~/.wine/drive_c/Program Files/CCP/EVE/" && wine eve.exe

(If you get a black screen, or can't get passed the login screen, try pressing Escape and see if you can get further from there)

If you still have problems

You might need to upgrade EVE to Premium by downloading and running the patch located here (in Wine).

The following is made obsolete by the patching above, but included here still in case you have any problems:

Since EVE tries to communicate with a specific server on startup in a way that Wine currently doesn't support, we need to block that server's IP address:

sudo sh -c 'echo "87.237.39.199 localhost" >> /etc/hosts'

Restart the network (is not always necessary):

sudo /etc/init.d/networking restart

Voice chat seems to cause problems with Wine, so you can turn that off too. Open ~/.wine/drive_c/windows/profiles/YOURUSERNAME/Local Settings/Application Data/CCP/EVE/settings/prefs.ini and add the following line:

voiceenabled=0

Also, you might as well set eulaagreed to 1 so you can skip the license agreement.

That's it! If you have any problems with the steps, feel free to leave a comment.

Windows are for breaking

2008-01-05T11:39:00Z

Automated breakage

Yesterday I wanted to boot into my Windows XP Professional partition to see if Perfect World ran better in Windows than in Wine, but what was this? Windows refused to boot. Now, this has happened to me before, and I have read lots and lots of post online about the dreaded Mup.sys problem, but this time - I just could not get it to go away and get into Windows.

It was time for the reinstall.

Reinstall part one

So, I dig out my original Windows XP CD, pop it in the PC and reboot. 5-10 minutes later I'm at the installation program where it tells me that it's not happy about installing over the old XP installation and that I should pick another partition, so I go back, delete the old XP partition and tell it to create a new one. It can't. Sigh.

Reinstall 2: Now with training wheels

Reboot again with an Ubuntu live CD (notice that the adventure would just be over now if it wasn't for Linux). It appears the Windows setup has somehow changed to order of my partitions, and generally corrupted the partition table, but Linux let's me read my data anyhow, and I backup everything important to an external drive and clear the entire disk. As I now don't trust the Windows installer, I create the NTFS partition forehand, so it won't choke on it next time. Reboot.

After many minutes, I'm finally in the installation again, I can select the NTFS partition and start the installation. I lean back and let it do it's "magic" and after some time it reboots, supposedly having copied all required files. After the reboot I get a nice message telling me that it can't find a required file, and won't boot. Sigh again. Reboot.

Third time's a charm - right?

Now, in the setup program I select the same options as before, let it finish copying the files, reboot, and for some reason it works this time - hurray! Now I put on a movie and wait the about 40-50 minutes the Windows install takes.

... The install is finished, and I now have a shiny, newly installed Windows XP! Yay! All should be good from now on, right? Wrong. It doesn't recognise my network card, so I'm left with a VESA display driver and no programs. Luckily I still have the CD that came with my motherboard, so I pop that in and install the network driver. Reboot again.

One driver down, two more to go...

After the reboot I am online and go straight to Nvidia.com, since I have an nForce2 motherboard and would like proper drivers, but to my surprise the driver for it isn't that easy to find. I eventually find it through Google (it's under "Legacy" at Nvidia.com), download it and install it. Reboot again again.

Next boot is starting very, very slowly.... after about 15 minutes, I finally get a desktop, but it freezes after a couple of seconds. What now?

I turn off the computer on the switch, since Ctrl+Alt+Del doesn't work, restart it and start Windows in Safe Mode. ...it stops at Mup.sys... Come on! I let it run for about 20 minutes before I turn it off again.

I try again and can start the desktop, but it still freezes after a couple of seconds.

This is the last straw. After it having corrupted my partition, installed faulty, not having any drivers and then just not working when it gets the only official driver available, I walk away from Windows.

Conclusion

I am writing this post from the Ubuntu Live CD, where it is installing in the background (it's finished now - it started just before I started writing this post), and I'm also downloading an ISO of xubuntu and Sabayon at the same time, so I can try them as well - this all took me about 15 minutes in all, as opposed to my 2 1/2 hours wasted on NOT getting Windows to install (but enjoying 7 wonderful reboots; Microsoft knows how we love those reboots).

XP might be a dated system, but the motherboard is two years older than XP SP2 (which is the version I installed), so there's really no excuse for it working so poorly.

I think I'll try and install Vista at some point, just for the lulz.

Default video player in Linux

2008-01-06T18:26:00Z

Just a quick memo on how to make mplayer the default videoplayer in Linux:

xdg-mime default mplayer.desktop application/vnd.rn-realmedia application/x-extension-mp4 application/x-flash-video application/x-matroska application/x-quicktime-media-link application/x-quicktimeplayer text/google-video-pointer text/x-google-video-pointer video/3gpp video/dv video/fli video/flv video/mp4 video/mp4v-es video/mpeg video/msvideo video/quicktime video/vivo video/vnd.divx video/vnd.rn-realvideo video/vnd.vivo video/x-anim video/x-avi video/x-flc video/x-fli video/x-flic video/x-m4v video/x-matroska video/x-mpeg video/x-ms-asf video/x-msvideo video/x-ms-wm video/x-ms-wmv video/x-ms-wmx video/x-ms-wvx video/x-nsv video/x-ogm+ogg video/x-theora+ogg

This of course depends on your system actually having a desktop file for MPlayer (which the mplayer-nogui package in Ubuntu doesn't), so if your system doesn't have it (check /usr/share/applications/), you can copy the following to .local/share/applications/mplayer.desktop in your home directory:

[Desktop Entry]
Version=1.0
Type=Application
Encoding=UTF-8
Name=MPlayer
Comment=Play multimedia files and media
GenericName=Media Player
Exec=mplayer %U
Icon=mplayer
NoDisplay=true
MimeType=application/vnd.rn-realmedia;application/x-extension-mp4;application/x-flash-video;application/x-matroska;application/x-quicktime-media-link;application/x-quicktimeplayer;text/google-video-pointer;text/x-google-video-pointer;video/3gpp;video/dv;video/fli;video/flv;video/mp4;video/mp4v-es;video/mpeg;video/msvideo;video/quicktime;video/vivo;video/vnd.divx;video/vnd.rn-realvideo;video/vnd.vivo;video/x-anim;video/x-avi;video/x-flc;video/x-fli;video/x-flic;video/x-m4v;video/x-matroska;video/x-mpeg;video/x-ms-asf;video/x-msvideo;video/x-ms-wm;video/x-ms-wmv;video/x-ms-wmx;video/x-ms-wvx;video/x-nsv;video/x-ogm+ogg;video/x-theora+ogg;

Afterwards, you might need to run

update-desktop-database ~/.local/share/applications

and log out and in again.... mimetypes are a bit magic...

The future of Ubuntu and the desktop internet

2008-09-16T04:56:06Z

I've just read Mark Shuttleworths post to the Ubuntu Development mailing-list and I must say it got me a bit excited.

In his post he mentions that the focus of the next release of Ubuntu, the one after Intreprid Ibex, namely 9.04 "Jaunty Jackalope" will, amongst other things, focus on "the blurring of web services and desktop applications" which, if done right, will be extremely cool and also give Ubuntu a real edge over OS X and Vista.

It also got me thinking about projects such as Empathy, Gimmie and Soylent. Just imagine the things these programs can do, implemented properly in an Ubuntu Gnome kind of way... pure bliss.

When I think of this, I immediately also think that we should try to step away from the program analogy and focus on tasks instead.

You shouldn't have to locate F-Spot in the menu, but click "Pictures"; if you prefer something other than F-Spot, change it in the preferences (and yes, this should include a way to "launch" Photobucket, Flickr, etc.). The same with instant messaging, you shouldn't have to start Pidgin, you should have a "People" or "Contacts" entry in the main menubar with all your IM contacts, email contacts, heck, even Facebook contacts listed, each with a submenu giving you the option to contact them in different ways: video, chat, email - like Soylent in a menu.

Ubiquity already implements a lot of what I have in mind, but it's still inside the browser, it should be part of the desktop, also it uses English language to do the task, it should use the desktop interface (though language based operation shouldn't be ignored, it should still be an option - like in GNOME Do, which has a nice graphical way of showing what you are requesting).

Ideas such as this have been posted numerous times, but have yet to be included in any standard desktop - I sincerely hope Jaunty Jackalope will change this.

Linux Mint - Wow!

2008-09-18T01:04:01Z

After having my partitions mangled once again, again, again by Windows, I decided I had to clean up my Linux - and by clean up, I mean reinstall, though I still use the same config files for my program - I love how you can do that in Linux.

But anyway, instead of reinstalling Ubuntu Hardy, which has given me so many problems with my notepad's ATI graphic card, I figured I might as well try Mint again, since it was a very enjoyable ride last time, and it sure still is!

So far I like practically everything about the new Mint! Their funky little menu-ting (though it makes setting preferences slightly slower than the standard Gnome menu, though that's not really an issue since it not something one should have to anyway), their theme (and the excellent included themes), how everything is automated, from video codecs to software installation and checking, and most of all because it let me boot into CompizFusion without any configuration at all - with working video none the less (something I never got working right in Ubuntu).

I don't know how on earth the Mint team has achieved this, since it should function exactly like Ubuntu in regards to drivers, but for some reason Mint just works.

If I gave out stars, Mint would get five out five (or maybe 4.9 because of the redundant, and slighly ugly, welcome setup) - if you haven't already tried Linux Mint, I recommend you give it a go - especially if you've never tried Linux before and want to see what alle the hype is about ;)

GLM Extractor for Tabula Rasa

2008-12-30T19:21:41Z

Now that Tabula Rasa is entering its final death rattle I wanted to make sure I got the soundtrack by Tracy Bush, Curse Mackey and Chris Vrenna with Clint Walsh, so I wrote a small extractor for the GLM format.

Now, as far as I can tell, a GLM file is just a sequence of either Ogg Vorbis or MP3 files put together, so my extractor only looks for those two file formats and splits them up into single files in the sequence it finds them in. There might be more to the format than that, and so I don't guarantee that it works correctly, but at least I've got my soundtrack to listen to.

Anyhow, here it is: http://dl.getdropbox.com/u/278272/TabulaRasaGLMExtractor.py

Just run it in a terminal and it should tell you how to use it.

Linux Memory Management

2009-02-11T13:59:29Z

I have 3gbs of memory in my system and a fast processor, yet my system would start choking when I used too much memory, so I sat out to fix it.

What I learned is that there's a setting in /etc/sysctl.conf called vm.swappiness that controls to what level the Linux kernel should use disk based virtual memory from 1-100.

In Ubuntu, this is set to 60 by default, which roughly translates to 60% of all virtual memory being disk based, and therefore, slow.

To change the value simply edit the file (e.g. gksu gedit /etc/sysctl.conf) and add the line vm.swappiness = 1 (change 1 to what you think is appropriate) - the change will take effect on next reboot.

If you want the effect now, you can run sudo sysctl vm.swappiness=1 in a terminal.

A very welcome effect of this change is that Nautilus is now many, many, many times faster!

Wine integration in Nautilus

2009-10-13T02:46:21Z

As very few people apart from Scott Ritchie probably know, I've been working on integrating Wine more closely with Gnome for a few months now, and though I've had a break from the development for some time, I managed to finally create a little more for the project today.

More specifically, I made the first version of the integration of Wine's preferences into Nautilus.

So far, this is what's possible:

Now, Wine also has options for setting some options for DirectSound emulation and library (DLL) overrides for a specific program, and while I intend to add support for library overrides, I don't think I'll include the options for setting DirectSound emulation levels. The reasons for this are that, first of all, the options would take up a lot of space visually and make the usually small properties dialog huge, but more importantly, I've never seen any howto, guide or anything where a program would work better after toggling DirectSound emulation or changing the bit depth of the audio, so I'm assuming that those options are pretty safe to exclude.

If you want this on your own system, this is what you have to do (this will be much easier soon as Scott is in the process of packaging this stuff up for Ubuntu):

We'll be needing two things: My Wine library for Python and the properties file for Nautilus and we'll be getting both from bzr, so if you don't have bzr installed you should do a sudo aptitude install bzr (if you are on Ubuntu or another Debian based system) before doing the next steps.

First, let's get all the files from the bzr project: bzr branch lp:~ubuntu-wine/+junk/wine-helper

Next, we'll install the Wine library for Python (UPDATE: There's a debian package further down the page, if you prefer that route): sudo cp -R wine-helper/wine /usr/lib/python2.6/wine

And finally we'll install the Wine properties page for Nautilus: sudo cp wine-helper/wine-property-page.py /usr/lib/nautilus/extensions-2.0/python/

Now everything is installed and you can either log out and in again or restart Nautilus by pressing Alt+F2 and typing nautilus -q for the changes to have effect.

Let me know how things went :)

UPDATE: For those of you that prefer not to "hack" your system, say by copying files directly into the directory of a specific Python version, I've made a deb package of the Wine library. It's available here.

Launchpad and PPA - here we go!

2009-10-13T17:12:42Z

So, after having build a debian package of python-wine, I thought it would be an easy thing to set up a PPA and start actually distributing my work on the Wine/Gnome integration... Well, turns out it was a bit trickier than I thought and I consequently had to rebuild the python-wine package from scratch, but at least it should now follow the Ubuntu/Debian Packaging Guidelines! :D (though lintian still complains about stuff the guideline says is correct... hmm...)

Anywho! The PPA is set up and the first package is being build so now you should be able to add my PPA and have automatic updates to python-wine, and hopefully the rest of my work in the near future.

While I'm on the subject I have to comment on how annoying the documentation is for building packages. I'm sure it's just dandy if you are building a package from someone else's work and it's coded in a compiled language, but it only gives an example on how build a package of a python application, no word on how a module or extension would work, or how something like a Nautilus extension or other single-file-or-small-script-package would have to be build. I'm sure I'll figure this stuff out eventually, but it's going to be by trial and error and by looking at other people's packages, not by reading documentation, which is sad. I hear good things about Ubuntu's Quickly project, but so far it seems a bit too "magical" for me since there's very little documentation on what it actually does behind the scenes to make me trust that it won't make a mess of things for me instead. Of course, I could stop complaining and publish some documentation instead, but to be honest I don't fee I know enough of the subject yet to do so... maybe in the future.

Anyway, enough rambling! Here's my PPA.

More tools for Wine management

2009-10-14T03:35:03Z

Okay, this is actually fairly exciting... I've packaged and uploaded nautilus-wine and wine-preferences to my PPA, so now you can install both the Nautilus Wine properties page I showed two posts ago, and my fancy "new" (it's been in ubuntu-wine's bzr forever) graphical configuration tool for Wine directly from your package manager (if you're running Ubuntu).

Yes, this is the so called gtk-port of winecfg that so many have been dreaming about for the last couple of years, only this one also throws in bottle support (though you have to launch it with "--enable-bottles" to use that the first time, after you've created a bottle it figures you might want to use the functionality again by default), running and uninstalling installed Windows programs and a few commonly used "tricks" like setting how much video card ram you have or how offscreen images should be rendered (FBO, PixelBuffer or BackBuffer) all nicely wrapped in a Gnome System Tools -like program.

Next on the packaging schedule are the helper tools that offer to install Wine the first time you try to open a Windows executable without Wine installed, scans the file for virus and offer to set the executable bit for you, oh and also does this for Java and .desktop files, more Nautilus integration in the form of the "Run in new Wine configuration" right click option you may have noticed earlier and the command line version of wine-preferences which should come very handy for you script makers out there.

On the development front I think I still need to figure out a clever way of exposing the bottle structure to Nautilus. As it is now, bottles are saved as fake home directory in ~/.winebottles/$BOTTLENAME - why the fake home directory you ask? Since I discovered that Windows programs just love to put stuff in My Documents, which defaults to the users home, so this is to avoid programs spamming your home folder, unfortunately it also means that if you open ~/.winebottles/$BOTTLENAME in Nautilus you won't see anything since everything is in hidden directories. I'm thinking some kind of symlinking could make this accessible, but I still have to work out the details.

So, now I'm off to bed (finally) so I'm ready for helping my beautiful Greek fiancee move into her new flat here in Denmark tomorrow :D - which is bad news for the rest of you since this means no time for coding or packaging the next couple of days ;)

Cheerios!

EDIT: Oh, almost forgot, in case you missed my last post, my PPA is here.

Vineyard update

2009-10-23T00:00:00Z

Sorry for the lack of updates lately, lot's of stuff to take care of lately, but at least Vineyard is shaping up nicely! It took a bit longer than I expected to rewrite Vineyard, most of it was due to the code redesigning but the porting from Glade to code definitely also took longer than anticipated. What you can expect from the next version is much, much, much faster start up time, "lazy loading" of pages and better error handling. So far the only pages that need work are Drives and Programs - the last one needs some more redesign on the python-wine end as well, so it'll take a little while, but it should prove much faster when done (it already is). I've reorganised the pages a bit, to hopefully make it easier to navigate.

Christmas release!

2009-12-24T17:21:15Z

This is just a quick post to tell you all that I've updated wine-preferences in my PPA. There are lots of new goodies and a nice graphical overhaul. More details later, now for the eating!

Remember, you can install all the Vineyard packages (wine-preferences, nautilus-wine and python-wine) by running the following commands:

sudo add-apt-repository ppa:cybolic/ppa
sudo aptitude update && sudo aptitude install wine-preferences nautilus-wine

Just a quick note about network connections

2010-03-14T19:15:29Z

I've been working on some new functionality for Vineyard and I needed to test if the user is connected to the internet or not. After some Google scouting I didn't come up with anything that did what I needed so I ended up writing this little function and thought it might be useful for others.

def test_internet_connection():
	info = subprocess.Popen(['ifconfig', '-a'], stdout=subprocess.PIPE).communicate()[0]
	for interface in info.split('nn'):
		if 'UP BROADCAST RUNNING' in interface and 'inet addr:' in interface:
			return True
	return False

Internet connection... Vineyard... what could I be up to? Any guesses (or requests)?

Vineyard: What's going on?

2010-03-19T21:24:23Z

After the hinting I did in my last post and the lack of any new features being released for Vineyard, I though I'd let you people know what's actually going on with the development.

As some may have noticed, the last release had the Programs-page split into a separate file loaded as a plugin/module. This was done since the code for it is the largest piece of related code in Vineyard and it made sense to separate it, but also because I've been wanting to make Vineyard more modular. The result of starting to split out the different pages into modules (and stumbling on to Jono Bacon's recent post) however left me wishing that I had structured Vineyard differently from the start, so I sat down, did some thinking and decided to reprogram vinyard-preferences from scratch. Yup, that's right, from scratch.

I know this means that you'll have to wait somewhat longer for the next version, but fear not, I will still release bug fixes when necessary for the 1.4 series. What this also means is that the next version (the one brewing on my harddrive) loads completely asynchronously (in less than a second on my computer right now), has every page split into modules/plugins that load on demand, supports loading parts of the interface into other programs as widgets (!), supports theming Wine (including installing themes from archive files), has rudimentary support for colour-settings, and.... you guessed it Luke... basic AppDB integration. It also means that maintaining and extending Vineyard should be a lot easier in the future, good news for me.

So, sorry to keep you waiting, but I promise I'm cooking up something good ;) Oh, and feel free to keep requesting functionality!

Before I sign out I'll leave you with a quick screenshot of the new (possible) layout of some of the options:

Thoughts on The Piracy Logic Problem

2010-03-25T20:13:08Z

I just thought of something that I can't get to make sense...

DISCLAIMER: I am in no way a lawyer, just a confused consumer.

It is (in Denmark at least, and I assume in most other countries) legal to make a safety copy of a legally purchased movie or album for yourself. I presume it is also legal to get a friend to make the copy for you, provided they don't make one for themself as well (quite likely to happen given the time and computing power it takes to make a digital copy / transcoding) But, it is not legal for me to download a "safety copy" of a movie or album I have legally purchased.

How exactly is that different from getting a friend to make the copy, and how is it supposed to be proven that it was actually downloaded? And what about if I make backups of all my movies and albums on my home computer and my physical collection then get stolen or my house burns down? Will it be assumed that everything was downloaded illegally and if not, am I even entitled to keep my backups - and if not, why allow me to make backups in the first place?

Furthermore, even if it is proven that my collection was downloaded off the internet, how can it be proven that the copy I downloaded was not ripped from my own original (in the case that your backup-friend lives far away and sending the file is quicker than getting it physically - and, for the sake of argument, that your physical collection is nearer to your friend)?

Also, in the case of someone downloading something off BitTorrent, Rapidshare or another service - how can it be proven that the "leaked" copy didn't originate from, but wasn't spread by, the person downloading it? Isn't that still a personal backup, even though others "stole" copies of it?

I'm having a great deal of trouble seeing how it's possible to separate legal from non-legal copies (except for the case of watermarks, but even then you have the possible after-market sale to deal with) and how you can prove that any downloading/ripping/transcoding is illegal, provided that backups are legal - and I strongly believe they should keep being legal! I don't want to lose my copy of Ghostbusters to scratches on the disc :(.

What are your thoughts on the subject?

"Fixing" a Banshee music database

2010-04-21T00:00:00Z

NOTE: This is a bit verbose in the description, but maybe you can learn something from the process. If you just want to know how to fix the Banshee database after changing user-name or moving your library to a different location, scroll down.

I recently reinstalled Ubuntu and in the process changed my user-name to my more commonly used 'cybolic', however after copying the ~/.config/banshee-1 directory to my new home-dir, I realised that Banshee had all my music indexed by absolute path, meaning that it was looking for my old home-dir and so couldn't play any tracks.

To fix it I assumed I would have to do a search and replace on its database, but I needed the filetype, so a quick file ~/.config/banshee-1/banshee.db later I now knew that it was in SQLite 3.x format.

Now on to a tool to do the search and replace on the database...

Ubuntu has a tool in its repos called sqlitebrowser, that sounded about right, so I installed it and yes, it allowed me to browse the database and perform SQL queries - just what I needed.

So, long story short, to change the location of your music files in the Banshee database, here's what you do (close Banshee first):

sudo aptitude install sqlitebrowser
sqlitebrowser ~/.config/banshee-1/banshee.db

Now change to the tab labelled "Execute SQL" and write something like the following:

update CoreTracks set Uri = replace(Uri, '/home/<olduser>', '/home/<newuser>');
update PodcastEnclosures set LocalPath = replace(LocalPath, '/home/<olduser>', '/home/<newuser>');

You are now done and can start Banshee again :)

A quiet little game

2010-04-29T17:38:57Z

Normally I blog about Wine and Vineyard, but while the meaning behind these two projects are getting an existing Windows program running on Linux, thankfully this is not always necessary.

Now, I'm not much of a gamer, when I actually play something it's usually not for more than an hour, at most. I tend to launch a game, play it for about 10 minutes and then get back to something else, so most of the Hollywood fps-shooter/rpg/mmo-hybrids that are released these days never really get the attention they need from me for their mood and storyline to really grab me, luckily I stumbled upon another type of game a while back - for Windows.

You may have heard of or tried the initial stages of Spore or the simple fun of Flow and the game I'm talking about is very much in the same category as these, but in my opinion, a much more capturing and relaxing experience. The good news is that even though this was previously very possible to run through Wine, there is now a dedicated, very-well-ported, Linux version!

The game is, if you haven't guessed it: Osmos.

In Osmos you play a small blob (or mote) that has to eat smaller blobs in order to grow and become the largest in the "blobiverse" and while this idea in itself isn't new, the half-cosmos, half-biology visuals and the great galaxy inspired physics certainly are and give the game a great twist, placing it both in the tranquil, meditative genre and at the same time, due to the physics, the other intelligent blobs and depending on how you play, in the same kind of hectic, tilt-your-entire-body-to-move-your-avatar frenzy that is usually associated with action games. Another point worth mentioning is that Osmos contains music by several artists, with the name of the artist and the track printed at the bottom of the screen at all times. This is a great move by Hemisphere Games and is a welcome show of respect towards musicians that is seldom seen in the game world.

All in all, while getting Windows-only games to run on Linux is great, supporting properly ported games and programs (and trust me, this is a fantastic port) is extremely important if Linux is to be taken seriously on the desktop and helps prove to companies that Linux is worth supporting.

If you haven't done so already, hurry up and download the Osmos demo and if you like what you see, purchase a copy and support a company that has done a great job at porting a great game to a great platform.

Osmos website is here.

UPDATE: I forgot to link to the article that actually introduced me to Osmos. It's a good read, so don't be afraid of the length.

Facebook chat flaw?

2010-06-03T08:29:21Z

I just received a chat message from someone on Facebook whom I am not friends with, and went to investigate... Though I couldn't find anything online, and I'm not going to test it by spamming random people, it seems that if you add a buddy/friend in your desktop chat client with a username such as -PROFILEID@chat.facebook.com (and profileids can be read from any profile) you'll be able to chat to that person, even if you are not friends!

This might only work if the person you are chatting up also uses a desktop client, since Facebook did not store the message I received, but it's still a flaw - especially considering that adding a person from UNIQUENAME@chat.facebook.com clearly claims that you are not authorised, so they do have some security in place.

sigh ...when will Google free up Buzz from GMail so we can start migrating?

How to get sound in Shadowgrounds in Ubuntu Maverick x64

2010-10-01T23:55:39Z

Yeah, so here we go, my third issue with the Linux port of Shadowgrounds... anyway, it turned out to not be that difficult to fix.

Shadowgrounds only really plays well with OSS, so you should run it through aoss, but that won't work in 64 bit. So here's the solution:

First, install alsa-oss (sudo apt-get install alsa-oss), then download this archive, extract it your game directory and run shadowgrounds-x64 from now on - easy as that. Download me

If you prefer to do this by hand, first download the alsa-oss package for i386 (from here), extract it (dpkg --extract alsa-oss_1.0.17-4_i386.deb alsa-oss) and copy the files in usr/lib/ to /usr/lib32/ (sudo cp alsa-oss/usr/lib/* /usr/lib32/). Now when you want to run the game, you should run it as:

LD_PRELOAD="/usr/lib32/libaoss.so" aoss ./shadowgrounds-bin

Switch to bottom pane plugin for GEdit

2010-12-09T19:19:00Z

So, I've been reconsidering GEdit as a quick development environment, but I was really missing a way to switch to the bottom pane and back (for using the embedded terminal).

I couldn't find an existing plugin to do this, so I took a look at Elia Sarti's TabSwitch plugin - that uses Ctrl+Tab to switch tabs - and edited it to switch back and forth between the bottom pane and the editor view and I must say that GEdit has a rather comfortable work flow now :)

Plugin is here for Gedit 2 and here for Gedit 3.

Find the 32bit deb package from your 64bit system

2011-01-13T14:46:46Z

I'm sure I'm not the only one that has had to install a 32bit version of some package to get a game or other program not designed for 64bit to work in 64bit Linux/Ubuntu/Debian and I'm sure others will nod in agreement at how difficult it can be to find the 32bit version, especially if you need a bunch and don't really have the time to wade through packages.ubuntu.com (or packages.debian.org for that matter), so I've cooked up a little Python script to find the URL for the 32bit version of a package for you.

It's here.

You just run it with the name of the package you want to find as the first argument, like so:

$ ./apt-get-i386-package.py libpulse0
http://ppa.launchpad.net/ubuntu-audio-dev/ppa/ubuntu/pool/main/p/pulseaudio/libpulse0_0.9.22-0ubuntu1_i386.deb

See? Easy.

Also note that it found it in a PPA - it uses your package database, so everything you can theoretically install can be found in a 32bit version.

GStreamer, MIDI (and Ubuntu)

2011-04-26T02:41:57Z

So, you have all your old MIDI files lying around and you decide to play them through Totem or another GStreamer based player. What happens? They sound... flat.

Ah, no problem you think, I'll just set up Timidity to use the neat soundfont I have lying around that sounds like my old SoundBlaster card and everything will be peachy, but no, GStreamer doesn't support soundfonts cause it doesn't use timidity but wildmidi - what to do?

Or: How to convert soundfonts to GUS patches for use in wildmidi/gstreamer.

There's a neat little tool called Unsf included in Greg Lee's gt - a stripped down version of Timidity - that can convert a soundfont to a GUS patch usable by wildmidi and therefore GStreamer, so let's get started with the conversion!

First, go to where you want the GUS patch (and its files) - this path shouldn't contain spaces - then download the latest version of gt (I hear there's a version 1.0, but 0.4 is the latest I can find):

cd /where/you/want/the/GUS/files
wget ftp://ling.lll.hawaii.edu/pub/greg/gt-0.4.tar.gz

Now, let's extract it somewhere and build it:

tar -xzf gt-0.4.tar.gz
cd gt-0.4
./configure
cd utils
make

Now, let's convert the soundfont to a GUS patch (remember to replace /path/to/your/soundfont.sf2 with the actual path to your soundfont):

cd ../../GUS
../utils/unsf -F /path/to/your/soundfont.sf2

Now we need to fix the config file that unsf wrote to include the path to where your GUS patch is:

echo -e "dir $PWDn" & wildmidi; cat *.cfg >> wildmidi

Now let's "install" that config file:

sudo cp wildmidi /etc/wildmidi.cfg

There! You're done!

For a nice athentic old school midi sound, I recommend the following soundfont (you need to register to download though): http://www.sf2midi.com/soundfonts/file-detail/roland-sc-55-sf2-3033.html

Howto: Deus Ex: Human Revolution in Ubuntu/Linux

2012-01-07T00:09:43Z

I just bought Deus Ex: Human Revolution, and if you did too, or are contemplating it, don't let the bad rating on WineHQ scare you off - it runs near perfectly. Now, the in-game tutorials are a bit wonky, but if you can live without those (I know I didn't have much of a problem without them), here's how you can install and run DE:HR in Ubuntu/Linux.

You are going to need Vineyard, so install that first if you haven't already, also we are going to use the terminal a bit, but don't worry, it's not scary, just quicker.

First off, let's install the game.

Do whatever you would normally do; run the installer from the DVD or download it from Steam - just make sure you do it in a new prefix in Vineyard.

Secondly, install a custom version of Wine (with rawinput2 patch).

We're going to use one provided by PlayOnLinux, so if you have PlayOnLinux installed, just install Wine 1.3.34 rawinput2 from there, otherwise, either go to http://www.playonlinux.com/wine/binaries/linux-x86/, download the one called PlayOnLinux-wine-1.3.34-rawinput2-linux-x86.pol, rename it to have a .tar.bz2 ending and then extract from it the folder called "wineversion/1.3.34-rawinput2" to $HOME/.local/share/wineversions/1.3.34-rawinput2 - or run the following command:

mkdir $HOME/.local/share/wineversions && \
  wget -q -O - 'http://www.playonlinux.com/wine/binaries/linux-x86/PlayOnLinux-wine-1.3.34-rawinput2-linux-x86.pol' | \
  tar --wildcards --transform 's/wineversion///' --bzip2 -xvf - -C $HOME/.local/share/wineversions/ 'wineversion/*'

Setup Vineyard to use it

Now we need to edit the prefix configuration so Vineyard knows to run this version of Wine, so if you know where that directory is, just go and open the file wrapper.cfg, otherwise open Vineyard Preferences, select the prefix and under "Tools", click "Open Main Drive" and then navigate one directory up, there's your wrapper.cfg.

Add the following lines to this file:

ww_wine="$HOME/.local/share/wineversions/1.3.34-rawinput2/bin/wine"
ww_wineloader="$HOME/.local/share/wineversions/1.3.34-rawinput2/bin/wine"
ww_wineserver="$HOME/.local/share/wineversions/1.3.34-rawinput2/bin/wineserver"
ww_winedllpath="$HOME/.local/share/wineversions/1.3.34-rawinput2/lib/wine"`

Or, if you installed the Wine version through PlayOnLinux:

ww_wine="$HOME/.PlayOnLinux/wine/linux-x86/1.3.34-rawinput2/bin/wine"
ww_wineloader="$HOME/.PlayOnLinux/wine/linux-x86/1.3.34-rawinput2/bin/wine"
ww_wineserver="$HOME/.PlayOnLinux/wine/linux-x86/1.3.34-rawinput2/bin/wineserver"
ww_winedllpath="$HOME/.PlayOnLinux/wine/linux-x86/1.3.34-rawinput2/lib/wine"

Done! (or do you have sound?)

Now you actually might be able to run Deus Ex: Human Revolution just fine! For me though, I needed to go to Vineyard Preferences again and make sure the Deus Ex: Human Revolution launcher had "Disable PulseAudio whilst running" checked on, and then it was smooth sailing.

Hope this little guide was helpful, comments are very welcome.

I've moved!

2012-03-19T01:08:56Z

This blog has moved!

The new url is http://cybolic.me.

All comments are now transferred and while the new site still has a few issues, it works well enough for now.

Everyone update your bookmarks, feed sources, rolodexes and fridge magnet spell-outs!

Mail Mirror on NAS

2021-04-17T12:08:56Z

The problem

In the past, I used to mirror my email accounts locally and use Notmuch with the alot email client. Every email was tagged appropriately, I would only see the tags I wanted in alot and it was generally a pretty smooth system that got me very, very close to inbox zero.

The problem was that this was only the case on my desktop PC. Every time I was out of the house or wanted to try out a new distro, the email I would see anywhere else was still a cluttered mess as the tagging was only local to that one machine.

The solution

Move from Notmuch tags to folders
Move the email mirroring off my main PC
(bonus) Get Notmuch back, but not locally

My NAS is by definition always on and - should I want - I can access it from anywhere in the world (though the setup I chose doesn't depend on this at all). This also provides me with a place to keep backups of email that I might need in the future, but serve no purpose taking up space on my email provider's drive.

So, with a solution planned, let's get started.

Part 1: Move from Notmuch tags to folders

Tags are great, but we want every client to have access to organised email, so IMAP folders are the way to go here. IMAPFilter is a pretty well-established tool for moving email around on IMAP servers; it provides a good amount of filter options for selecting those emails and the fact that its configuration is done in Lua allows us to customise the procedure anyway we like.

Installing IMAPFilter

Since this is going to run on my NAS, a Docker container is the obvious way to go.

I've prepared a Docker image for IMAPFilter. Normally, I would use Alpine Linux as a base, but IMAPFilter is not yet in a stable release of Alpine (it's in edge, so it should happen eventually), because of this, the Docker image uses Debian as a base. This doesn't affect its use, but is good to know.

This image is set up to be able to run IMAPFilter on a schedule. Now, IMAPFilter can stay connected to all defined IMAP accounts and listen for either RECENT or EXISTS events, which normally indicate that new mail has arrived. In theory, this would be the ideal way to run as we wouldn't have to keep polling the email server(s) and could just run our filters when needed. Unfortunately, many email providers only send these events once and only to one connected client, meaning IMAPFilter wouldn't get the notification if, for example, my email client on Android also happened to be connected at the time.

Instead, I'm using Supercronic to schedule IMAPFilter to be run every few minutes. I also set flags on messages that have already been seen by IMAPFilter so we don't have to check all mail in the inbox every time, but that's a setup detail for later.

I'm using the following crontab setup. You may chose to run less often, if you get less promotional email than I do:

# Run every 2 minutes, starting from 0
0/2 * * * * /workdir/sync.sh imapfilter

The /workdir/sync.sh script can just be export IMAPFILTER_HOME=/workdir/.imapfilter; imapfilter -c /workdir/.imapfilter/config.lua, but we'll return to that later.

Just create two bind mounts for Docker, mounting the crontab to /etc/crontab and your configuration directory to /workdir/.imapfilter:

docker run -d \
  --name mail-imapfilter \
  --mount type=bind,source="/path/to/your/confs/crontab",target=/etc/crontab,readonly \
  --mount type=bind,source="/path/to/your/confs/imapfilter",target=/workdir/.imapfilter,readonly \
  cybolic/imapfilter-isync:latest

This command is just to test and give a quick overview. Ideally you wouldn't run the docker command like this, but use a docker-compose.yml file or something like Portainer instead.

Setting up IMAPFilter's filters

IMAPFilter filters are usually written directly in Lua, but I like to keep my data separate from my code and filter definitions definitely fall under data for me. Instead, I wrote a small module that lets me write filters as Lua tables instead of code. This allows me to write some things more succinctly and also opens up the possibility to write an exporter for the filter rules, should I move away from IMAPFilter down the line.

Here's the module and here's an example of how I use it:

messages = messages - rulesrunner.run_rules(messages, {
  -- PayPal Subscription receipts
  { subscription_paypal = {
    { match_subject = 'receipt.*to Dropbox' },
    { match_subject = 'receipt.*to Humble Bundle', contain_body = "Humble Choice" }
  }, from = { contain_from = '@paypal' }, move_to = 'Official/Receipts/Subscription' },
  -- Google Play Subscription receipts
  { subscription_googleplay = {
    { contain_subject = 'receipt' },
    { contain_body = 'subscription' }
  }, from = { contain_from = 'Google Play', contain_subject = 'Your Google Play' }, move_to = 'Official/Receipts/Subscription' },
  -- Game purchases
  { purchase_games = {
    { contain_from = "@steampowered.com", contain_subject = { "Steam purchase", "thank you" } }
  }, move_to = 'Official/Purchase/Games' },
  -- Crowdfunding direct messages
  { crowdfunding_messages = {
    { contain_from = '@kickstarter.com', match_utf8_field = { 'subject', 'response needed|sent you a message|new message' } }
  }, flag = true }
}, accounts.posteo)

Each rule in the main table passed to run_rules is run in order and given the messages table with any results from previous rules subtracted.
Each filter (e.g. match_subject) is logically ANDed with the rest in the rule.
Multiple filters of the same type can be defined by providing their values in a table (e.g. contain_subject = { "Hello", "World" }) and are ANDed.
Filters that take more than one argument (like match_field and match_utf8_field) have their arguments defined in a table.
Two custom matchers, match_utf8_field and match_utf8_body decode Base64-encoded UTF8 text before matching (necessary for a lot of modern email).
The move_to key triggers moving the matches to the given destination (the account to move to is given in the final argument to run_rules). delete and flag are also supported.
The returned value is a table of all matches so I can subtract them from messages so the next run_rules block skips them.

If you want to do the same filtering without my module, this would be the code for just the PayPal example above:

local results
local subresults
-- PayPal Subscription receipts
local _messages = messages:contain_from('@paypal')
-- for Dropbox
subresults = _messages:match_subject('receipt.*to Dropbox')
_messages = _messages - subresults
results = Set(subresults)
-- for Humble Choice
subresults = _messages:match_subject('receipt.*to Humble Bundle') * _messages:contain_body("Humble Choice")
_messages = _messages - subresults
results = results + subresults
results:move_messages(accounts.posteo['Official/Receipts/Subscription'])

Personally, I find the table version easier to read.

At the end of the filtering, I add a filtered flag to all messages that were matched so they aren't processed next time IMAPFilter runs:

results:add_flags({ 'Filtered' })

And I get the initial list of messages to process as so (messages from the last 24 hours that haven't been processed):

local messages = (accounts.posteo.INBOX:is_newer(1) + accounts.gmail.INBOX:is_newer(1)):has_unkeyword('Filtered')

You can find my full setup and rules here. Do note that this is the first time I've written anything in Lua, so this setup is not necessarily production quality, but it works for my use. The files in that repo are also not the exact ones I use on my NAS; these are my local dotfiles for my main PC, so consider it more of a staging area.

Part 2: Move the email mirroring off my main PC (setting up isync / mbsync)

The Docker image used above also has isync (also known as mbsync) installed, so we can just throw a config file in there and add it to the crontab.

I've set this up to do the synchronisation in stages:

Every 2 minutes: The inbox gets synced
Every 7 minutes: Sync mail sorted by IMAPFilter into folders that I care about every
Every 15 minutes: A full sync of all email

You'll see that IMAPFilter runs every two minutes (:00, :02, etc.) and isync runs every 2 + 1 minutes (:01, :03, etc.). This gives IMAPFilter time to sort the email before isync fetches it.

mbsyncrc:

# Generic defaults

Create Slave
SyncState *
CopyArrivalDate yes


# Accounts

IMAPAccount posteo
CertificateFile /etc/ssl/certs/ca-certificates.crt
SSLType IMAPS
Host posteo.de
User username@posteo.net
PassCmd /workdir/get_passwd.sh posteo

IMAPStore posteo-remote
Account posteo

MaildirStore posteo-local
# The trailing "/" is important
Path /workdir/data/posteo-account/
Inbox /workdir/data/posteo-account/inbox
Subfolders Verbatim


# Channels

Channel posteo-inbox
Master :posteo-remote:INBOX
Slave :posteo-local:inbox
Sync All

Channel posteo-sorted
Master :posteo-remote:
Slave :posteo-local:
Patterns * !archived !drafts !sent !trash !Inbox !"Unimportant*" !"Official/Backups*" !"Promotional*"
Sync All

Channel posteo-non-urgent
Master :posteo-remote:
Slave :posteo-local:
Patterns "Unimportant*" "Official/Backups*" "Promotional*"
Sync All

Channel posteo-archived
Master :posteo-remote:Archived
Slave :posteo-local:archived
Sync All

Channel posteo-sent
Master :posteo-remote:Sent
Slave :posteo-local:sent
Sync All

Channel posteo-drafts
Master :posteo-remote:Drafts
Slave :posteo-local:drafts
Sync All

Channel posteo-trash
Master :posteo-remote:Trash
Slave :posteo-local:trash
Sync All


# Groups

Group inbox
Channel posteo-inbox

Group sorted
Channel posteo-inbox
Channel posteo-sorted

Group full-without-inbox
Channel posteo-non-urgent
Channel posteo-drafts
Channel posteo-sent
Channel posteo-trash
Channel posteo-archived

crontab:

# Run every 2 minutes, starting from 0
0/2 * * * * /workdir/sync.sh imapfilter
# Run every 2 minutes, starting from 1
1/2 * * * * /workdir/sync.sh isync inbox

# Run every 7 minutes
*/7 * * * * /workdir/sync.sh isync sorted

# Run every 15 minutes
*/15 * * * * /workdir/sync.sh isync full-without-inbox

sync.sh:

#!/usr/bin/env bash

if [[ "$1" = "isync" ]]; then
  mbsync --config /workdir/.mbsyncrc $2
elif [[ "$1" = "imapfilter" ]]; then
  export IMAPFILTER_HOME=/workdir/.imapfilter
  imapfilter -c /workdir/.imapfilter/config.lua
fi

Our Docker setup should now look something like this:

docker run -d \
  --name mail-imapfilter \
  --mount type=bind,source="/path/to/your/confs/crontab",target=/etc/crontab,readonly \
  --mount type=bind,source="/path/to/your/confs/imapfilter",target=/workdir/.imapfilter,readonly \
  --mount type=bind,source="/path/to/your/confs/mbsyncrc",target=/workdir/.mbsyncrc,readonly \
  --mount type=bind,source="/path/to/your/email/storage",target=/workdir/data \
  cybolic/imapfilter-isync:latest

Part 3: Get Notmuch back, but not locally

Even though I'm no longer using Notmuch to sort my email, that doesn't mean it's not still a great program for very quickly searching one's email. Since Notmuch reads through all the email files, it's not really something you'd want reading the files over a networked connection to your NAS. Instead, it's much faster to run an instance of Notmuch on your NAS, let that create it's database and then let your local Notmuch instance just use that database.

For that, I've created another Docker image, cybolic/notmuch. Just like the previous one, it uses Supercronic, so you can set it up to run Notmuch every 30 minutes or so, depending on how fresh you want your search results.

Dockerfile:

docker run -d \
  --name mail-imapfilter \
  --mount type=bind,source="/path/to/your/confs/crontab",target=/etc/crontab,readonly \
  --mount type=bind,source="/path/to/your/confs/notmuch",target=/workdir/notmuch-config,readonly \
  --mount type=bind,source="/path/to/your/email/storage",target=/workdir/data \
  cybolic/notmuch:latest

crontab:

# 15 and 45 past
15/30 * * * * notmuch new

notmuch-config:

[database]
path=/workdir/data

[user]
name=Christian Dannie Storgaard
primary_email=address@host.com
other_email=semicolon@separated.com;list@of.com;other@addresses.com

[new]
tags=new
ignore=/[.]*.(off|old|bak)$/;/[.]*.json$/;.lock;/.*[.]mbsyncstate.*$/;.uidvalidity

[search]
exclude_tags=deleted;spam;trash;

[maildir]
synchronize_flags=true

[index]
headers.List=List-Id

Everything will just work as long as your local Notmuch config file's path variable points to the same files as your NAS instance uses. My email storage is mounted using NFS, so is set to /mnt/nas-mail in the local Notmuch config.

That's it! Your email is now sorted, backed up, searchable and available from your NAS.

Installing Arch for my use

2022-04-06T19:09:50Z

...or, how I learned to re-install without thinking

I recently wanted to re-install my Arch Linux setup due to a couple of hard-to-debug issues that had cropped up after switching from NVIDIA to AMD for my GPU. What I really didn't want, however, was to spend hours getting back to the setup I had previously, so this time, I dove into the new official installer, arch-install.

Now, the arch-install part of this whole thing is actually pretty simple. arch-install lets you set up configuration files from within your existing installation, so you don't have to make hard choices while you're in the bare environment of the installer image.

To do this, install arch-install using your prefered method - the package name is archinstall - and then just run the following and go through the options:

sudo archinstall --dry-run

You'll end up with three configuration files that you can edit to your preference and put on a separate partition of your install media (e.g. USB stick) to pass to arch-install when you're ready to install. This takes care of the basics of partitioning your drive, installing a bootloader, setting up your network, sound and graphics drivers, and installing the base packages for your choice of system (minimal Xorg, KDE, Gnome, etc.).

For my use, I let arch-install pick its default partition layout and then tweaked the file afterwards so it didn't use the entirety of my 1TB NVMe drive for the root system.

What follows is the general setup of the system. This will vary based on what you need for your system, but for me, it boils down to the following list, which I've created scripts for:

setup-system.sh

Update the pipewire install to use wireplumber (not needed on archinstall > 2.3.2)
Set up sudo for my user (example config file in repo)
Add my NAS to /etc/hosts (example config file in repo)
Add my NAS mounts to /etc/fstab (example config file in repo)

setup-amdgpu.sh

Add the Vulkan packages for my AMD GPU

setup-ecryptfs.sh

Set up an encrypted directory in my home directory

setup-packages.sh

Install the paru pacman helper and various packages I use

If you need any of the above functionality, feel free to take a look at these scripts (the full repo is here) and adapt them how you see fit. For me - together with my stow setup for configuration files - all this means I can have a working re-install, with no need to think or remember commands, set up in no time.

With the repo - plus my config files - on a flash drive, a re-install is just:

cd /run/media/*/flash_drive
./install.sh
./setup.sh

P.S. If you want to quickly get a list of the packages you've manually installed on your own system, here's a convoluted one-liner for just that:

pacman -Qi -ett | grep -E '^(Name|Description)' | sed ':a;N;$!ba;s/\nDescription *: / # /g;s/Name *: //g' | column -t -s '#' -o '#' | grep -vE '^('"$(pacman -Qq -g base -g base-devel 2>/dev/null | sed ':a;N;$!ba;s/\n/ |/g')"')' | sort

Kitty with Nerd Font icons thanks to Nix

2025-07-14T01:10:54Z

Kitty has a nice way of showing Nerd Font characters, even if your current font hasn't been patched with them. Normally though, the recommended way of setting this up, is to go to the Nerd Fonts wiki, copy one column from the table of codepoints at the bottom of the page and then adjust the formatting to fit Kitty's options for the symbol_map configuration option.

Now, you have to remember to do this every time Nerd Fonts updates this table, which isn't really announced, so you'll just have to check manually once in a while. Honestly, this isn't ideal and after doing it again recently, I thought this shouldn't really be necessary at all; I'm running NixOS - surely there must be a way for this to be auto-generated?

My first thought was to parse the wiki page from within my Nix config, but considering that Nix is very much a functional language, the codepoints really should come from the input, not an external source that may be out of date (as the git log shows that the wiki has occasionally been). Instead, what if we could get the list of codepoints from the font file itself, format it to fit what Kitty expects and have it be a part of our configuration build?

Luckily, nixpkgs already contains a build of Nerd Fonts that only includes the symbols, so we have everything we need ready to go and fontconfig provides tools that can extract the codepoints.

So, with all the preamble out of the way, I present a Nerd Font configuration for Kitty that will always stay in sync with the version of Nerd Font that's actually installed:

  programs.kitty = {
    extraConfig = let
      fontFile = "${pkgs.nerd-fonts.symbols-only}/share/fonts/truetype/NerdFonts/Symbols/SymbolsNerdFontMono-Regular.ttf";
      codepoints = builtins.readFile (pkgs.runCommandLocal "get-nerdfont-codepoints" {} ''
        ${pkgs.fontconfig}/bin/fc-query --format='%{charset}' ${fontFile} \
        | ${pkgs.gnused}/bin/sed 's/\b\([0-9a-f]\+\)\b/U+\U\1/g' \
        | ${pkgs.coreutils}/bin/tr ' ' ',' \
        > $out
      '');
      fontName = builtins.readFile (pkgs.runCommandLocal "get-nerdfont-name" {} ''
        ${pkgs.fontconfig}/bin/fc-query --format='%{fullname}' ${fontFile} > $out
      '');
    in ''
      # Use additional nerd symbols
      # https://sw.kovidgoyal.net/kitty/faq/#kitty-is-not-able-to-use-my-favorite-font
      symbol_map ${codepoints} ${fontName}
    '';

  home.packages = [ pkgs.nerd-fonts.symbols-only ];

Another lovely example of Nix allowing me to stop worrying about yet another thing.

NOTE: I know this blog hasn't been updated in a while, and the last post mentions Arch Linux, but in the meantime Nix has slowly but surely taken over most of my tech, and it's been lovely.