MusicRainbow Demo

I finally finished the video for the MusicRainbow demo. It's only 3'20'' long but it took almost 5 years to make it (including at least 7 years waiting for the program to encode the different video formats). At least I learned a lot about codecs and which ones are not suitable for this kind of video. I'll post it to Information Aesthetics as suggested by Paul (thanks for the suggestion!) :-)

I built the interface with Processing. It's a wonderful tool to quickly develop ideas and one of the many great suggestions Masataka has given me in the last 7 months. Currently I'm working on another user interface using Processing... which I think will be much better, because it takes user preferences into account such as "I like this artist" and allows exploration within different dimensions... and first results seem great too :-)

BTW, Masataka is a master in creating demonstration videos. You might be interested in some of them. For example, in one of his demonstration videos he shows how we will scan through songs in the future (SmartMusicKIOSK). Another futuristic tool with nice videos is Musicream which can be used to generate playlists and explore music.

Yokohama

Yesterday Ninomiya house organized a bus trip to Yokohama China town and Zoorasia. I learned that Kangaroo means “I don’t know” in the Aborigine language. On his first visit to Australia Captain Cook was once again pointing at something and his hosts (who had gotten a bit tired of his fascination of their everyday environment) just said “I don’t know”. After that he wrote down in his book that the animals were called Kangaroos. I also learned that Orangutan means “people from the forest” in Malaysia.

Japanese Culture

I’m constantly learning…

So far I’ve often ordered more or less randomly from the menu in restaurants. I’ve learned not to do that anymore, because the person sitting on the next table was served a dish that was still moving. And the animal (I think it was an octopus or something like that) was not just moving a bit, but it was moving a lot! And it kept on moving for a long time. I need to remember what the Japanese word is for food that is still moving…

Another thing I learned is to wait until after lunch (or dinner) to ask for the names of foods (and only order food with names I know). Otherwise I might lose my appetite again… the dish was called “Parent and Child”. It was chicken with egg.

Gradually I’m also deepening my understanding of the cultural differences of the attitude towards work. Gwen told me that in Japan part-time jobs are called “arbeit”. (Which means “job” in German.) I guess a long time ago, when the first Austrians came to Japan and talked about their (full time) jobs back home, the Japanese understood that those are only part-time jobs.

The Beer Machine!

Check this out! Put your glass in the machine. Push the button. The machine tilts the glass, fills it about 2/3, stops, straightens it again, continues filling it, and adds the foam doing so! The glasses are filled until the rim, every time! I conducted a small test with myself as test person to see if it really gets it right all the time… and it did! :-)

Watch the video here.

CrestMuse & SIGMUS

On Thursday we had a CrestMuse project presentation in Osaka. (That’s the project I’m working on.) Several partners are involved who work on a wide range of very interesting projects related to music. Somehow they managed to get over 100 people to attend (and I was told that they didn’t do much advertisement). They even had to reject a large number of students because they ran out of seats in the lecture room.

The meeting took place on the 14th floor of a stylish skyscraper. I would have never guessed that we were actually in university offices. The location was great (right in the city center). The view of the city was great too. However, the strangest thing was that the university was sharing a building with a hotel (which looked really nice), and a fancy restaurant. (And probably a number of companies.) Masataka told me that he thinks “normal” students don’t study there, but he wasn’t sure what kind of students actually do.

View of Osaka from one of the rooms where the demonstrations were given.



The project presentation consisted of lots of demonstrations (including stuff I’ve been working on), some overview talks, and a panel discussion. I couldn’t understand the Japanese presentations, but the demonstrations were great, and the best part was to meet many colleagues I had already met in summer. I was also told that the main purpose of such meetings was to get drunk :-)

After going out for some drinks, I spent most of the remaining night writing slides and restructuring them for my invited talk for the next morning… The next day a SIGMUS meeting took place in the same rooms. SIGMUS is the Japanese special interest group for music. They have several meetings a year in different locations in Japan, the next one (which will be even bigger) is in December in Tokyo. I was impressed how large and how well organized the music research community is in Japan. It seems like a parallel world to the “international community”. Unfortunately many papers never get translated into English. The language barrier is definitely a problem… but the situation seems to be improving. Anyway, the demonstrations were great. Unfortunately, the schedule was very tight and there were lots of people… so I didn’t get to play with the demonstrations as much as I wanted to. I can’t wait until such music interfaces will be available to everyone :-)

This pictures was taken in one of the rooms were the demonstrations were given. There was music from all directions :-)



In the front of the next picture you can see Yoshii's Drumix demonstration. I really enjoyed playing with it! You can put any audio CD into the system, it automatically analyzes the bass and snare drum parts, lets you replace them with other samples, lets you change the rhythm patterns, ...
In the background you can see Hamanaka who also demonstrated his work at ISMIR. Unfortunately the speakers he used at ISMIR didn't make it possible to really understand what his demonstration was about. Anyway, I got another chance to try it out (with headphones) and it was really fun... it takes a bit to get used to how to control the system, but it's fun to play with. Standing in the middle of the demonstration room I could hear different music from all directions. Moving my hand towards my ear I could focus on the music coming from in front of me.



There were lots of other cool demonstrations which I don't have pictures of. I especially liked Ito's work on remixing a piece of music. It was fun to control the loudness of each individual instrument. I think it's a great way for untrained listeners to understand how each instrument contributes to the whole. Ito explaining his system:



I also liked the demonstration by Kitahara who found a clever way to compute similarity on the instrumentation level. I think his approach could help overcome limitations the techniques have which I'm currently working with.

Tommie's demonstration on the evaluation of singing skills was lots of fun, too. Unfortunately his system only gave me 30 out of 100 points... it thought I didn't get my pitch intervals right. I think he still needs to improve it.

There were many more interesting demonstrations. For example, Ohishi demonstrated a nice query-by-humming and speech interface, and Prof. Katayose's team also had a number of very interesting demonstrations which were fun to try out. I also had the opportunity to have interesting conversations with many people, including Keiji Hirata.

Random Pictures

I recently tried out Karate. Some of the Katas they showed us didn’t seem to have many fighting elements; instead they were all about balance, precision, and focus of energy. I really like it and I think I’ll start taking Karate lessons :-)



This picture shows the entrance to my cubicle. On the left side is Masataka’s cubicle, on the right side is mine.



This picture was taken at Akihabara station (in Tokyo). Somehow I find those ticket machines fascinating. (Especially when there are crowds of people and there is always some beeping going on.)



Here is a sketch I made thinking about a metaphor I could use in my invited talk in Osaka... at the end I decided not to. The idea was that there is lots of music out there, but we can only access a small part easily (the pieces which are hanging very low). Even if we had a ladder (like the Internet) to reach all of the music, it would still be difficult to make choices. In addition I wanted to add many more "music trees" to create a forest of music. If every tree could fit 1000 pieces I would have needed a forest with many thousands of trees (only to reflect the more than 3.5 million pieces available on iTunes) :-)

Victoria

Last week I was at a conference on music information retrieval in Victoria (Canada). It's an annual conference which takes place in a different country every year. I've been attending it since 2002 and it's by far my favorite conference (and the only one I'm attending this year). Next year the conference will be held in Vienna! :-)

I got to see lots of interesting demonstrations, heard interesting talks on the newest developments, and had a chance to talk to many people working on similar topics as I am. I learned a lot. It was a great week!

Unfortunately, I didn't have much time to do sightseeing. But anyway, here are two pictures I took of the sea. The water was actually quite warm! :-)
(Special thanks to Michael who recommended me to rent a bike and cycle to the beach!)





At the conference one of the things I was presenting was work I did together with Masataka. Here is an excerpt of the screenshot from the MusicRainbow. (I plan to put a demonstration online soon.)



MusicRainbow is a very simple interface to help find interesting artists in large music collections. I got lots of helpful feedback on the interface. Overall it seems that it is usable. (Special thanks to David for the advice on how to make it more obvious in which direction the rainbow is turning.)

Most of the time at the conference we spent listening to talks.



One night, some researchers spontaneously turned the conference room into a concert room :-)



Personally I enjoyed the poster presentations and demonstrations even more than the talks. This demonstration by Ajay was particularly unusual :-)
(Picture taken by Paul.)



And this is one of the "unofficial" demonstrations I really enjoyed. Here Paul is demonstrating his "search inside the music" system to Oscar (who also had some nice demonstrations to show). Another really nice demonstration was the work Peter and his colleagues have been working on (an enhanced 3-dimensional version of Islands of Music with a number of very cool features).



And most important of all were the discussions we had in the restaurants and bars every night :-)
(Picture taken by Paul.)



A strange thing I noticed (after coming back to Tsukuba) is that I was missing the Japanese food! Especially natto :-)