IRC logs of #shogun for Wednesday, 2011-03-30

--- Log opened Wed Mar 30 00:00:36 2011
-!- aifargonos [~aifargono@46.18.27.35] has quit [Ping timeout: 260 seconds]00:30
-!- jabbok [8d550074@gateway/web/freenode/ip.141.85.0.116] has quit [Quit: Page closed]00:52
-!- Occam_ [8182c749@gateway/web/freenode/ip.129.130.199.73] has joined #shogun01:00
-!- Occam_ [8182c749@gateway/web/freenode/ip.129.130.199.73] has quit [Client Quit]01:00
-!- shelhamer [~shelhamer@AMontsouris-152-1-50-9.w83-202.abo.wanadoo.fr] has quit [Quit: Get MacIrssi - http://www.sysctl.co.uk/projects/macirssi/]01:23
-!- epps [~epps@unaffiliated/epps] has quit [Ping timeout: 246 seconds]02:50
-!- alesis-novik [~alesis@188.74.87.84] has joined #shogun05:11
-!- Ryaether [~Ryaether@50-80-170-245.client.mchsi.com] has joined #shogun05:15
-!- Ryaether [~Ryaether@50-80-170-245.client.mchsi.com] has quit [Client Quit]05:16
-!- Ryaether [~Ryaether@50-80-170-245.client.mchsi.com] has joined #shogun05:16
-!- aifargonos [~aifargono@46.18.27.35] has joined #shogun07:51
-!- Tanmoy [75d35896@gateway/web/freenode/ip.117.211.88.150] has joined #shogun07:59
-!- siddharth__ [~siddharth@117.211.88.150] has joined #shogun08:18
-!- siddharth_ [~siddharth@117.211.88.150] has quit [Ping timeout: 252 seconds]08:20
-!- aifargonos [~aifargono@46.18.27.35] has quit [Ping timeout: 240 seconds]08:34
-!- meanerelk [~meanerelk@cpe-75-187-51-178.columbus.res.rr.com] has quit [Ping timeout: 240 seconds]08:39
-!- aifargonos [~aifargono@193.206.186.107] has joined #shogun08:45
-!- aifargonos [~aifargono@193.206.186.107] has left #shogun []08:52
-!- siddharth_ [~siddharth@117.211.88.150] has joined #shogun09:00
-!- aifargonos [~aifargono@193.206.186.107] has joined #shogun09:01
-!- siddharth__ [~siddharth@117.211.88.150] has quit [Ping timeout: 264 seconds]09:03
-!- siddharth__ [~siddharth@117.211.88.150] has joined #shogun09:07
-!- siddharth_ [~siddharth@117.211.88.150] has quit [Ping timeout: 246 seconds]09:10
-!- Ryaether [~Ryaether@50-80-170-245.client.mchsi.com] has left #shogun []09:11
-!- jabbok [56220ef5@gateway/web/freenode/ip.86.34.14.245] has joined #shogun09:31
-!- aifargonos [~aifargono@193.206.186.107] has quit [Quit: aifargonos]09:45
-!- aifargonos [~aifargono@193.206.186.107] has joined #shogun09:46
-!- blackburn [~qdrgsm@188.168.4.226] has joined #shogun10:01
-!- blackburn [~qdrgsm@188.168.4.226] has quit [Ping timeout: 252 seconds]10:11
-!- blackburn [~qdrgsm@188.168.4.148] has joined #shogun10:11
-!- aifargonos [~aifargono@193.206.186.107] has quit [Ping timeout: 250 seconds]10:12
-!- siddharth__ [~siddharth@117.211.88.150] has quit [Ping timeout: 240 seconds]10:20
-!- aifargonos [~aifargono@46.18.27.4] has joined #shogun10:37
-!- blackburn [~qdrgsm@188.168.4.148] has quit [Quit: Leaving.]10:45
-!- epps [~epps@unaffiliated/epps] has joined #shogun12:14
-!- yin [~chatzilla@207.46.92.18] has quit [Read error: Connection reset by peer]12:27
-!- aifargonos [~aifargono@46.18.27.4] has quit [Ping timeout: 276 seconds]12:28
-!- epps [~epps@unaffiliated/epps] has quit [Quit: Leaving]13:07
-!- siddharth__ [~siddharth@117.211.88.150] has joined #shogun13:10
-!- aifargonos [~aifargono@46.18.27.35] has joined #shogun13:17
-!- CIA-30 [~CIA@208.69.182.149] has joined #shogun13:46
sonney2kCIA finally arrived :D13:46
sonney2kall hail our chatty bot :)13:46
-!- shelhamer [~shelhamer@gut75-5-82-247-9-141.fbx.proxad.net] has joined #shogun13:47
CIA-30shogun: Soeren Sonnenburg master * rf9421d3 / .gitignore : update gitignore to exclude looking for ui symlink - http://bit.ly/eweRGm13:48
CIA-30shogun: Soeren Sonnenburg master * re4450d2 / src/configure :13:48
CIA-30shogun: add flags to support lua,ruby and java via13:48
CIA-30shogun: ./configure --interfaces=libshogun,ruby_modular,lua_modular,java_modular13:48
CIA-30shogun: basic autodetection should work for java and ruby paths. Autodetection13:48
CIA-30shogun: for lua should be perfect. - http://bit.ly/fMbsF813:48
CIA-30shogun: Soeren Sonnenburg master * r1ed9e90 / (12 files): update modular interface files to discard SWIG_fail for java and doxygen includes for ruby - http://bit.ly/hyBoNs13:48
-!- shelhamer [~shelhamer@gut75-5-82-247-9-141.fbx.proxad.net] has quit [Client Quit]13:49
-!- shelhamer [~shelhamer@gut75-5-82-247-9-141.fbx.proxad.net] has joined #shogun13:49
aifargonosnice13:49
sonney2kaifargonos, github just rocks...13:50
aifargonosI just wonder why I did not switch to git muuuuuch earlier ..13:51
sonney2kaifargonos, well I do so too... it is so nice to just register with github and then 'fork a project' and auto track it...13:55
shelhamergit+github is about as convenient as distributed coding can get. I'm happy to see the code move over from svn13:59
shelhamersonney2k, I am a potential GSoC student but I have a concern about another commitment I have in the summer, and wanted to ask about it now (assuming this is the appropriate forum for it–if not, I can email you)14:00
sonney2kshoot14:05
shelhamerI am an AI-concentration CS undergrad in the US (I'll be in my senior year in the fall) and this summer I will be working for the computer vision lab, as I have done in past summers14:06
shelhamerthis means that I would have about 20 hours a week for shogun, were I to apply as GSoC14:07
shelhamerdo you believe that would be enough, or would it be insufficient?14:07
shelhamerI understand completely if that does not meet the time commitment you expect, but wanted to ask as I have some machine learning background and solid mathematical foundations from vision14:07
sonney2kshelhamer, double commitments are tough. google suggests that this is a no-go http://google-opensource.blogspot.com/2011/03/dos-and-donts-of-google-summer-of-code.html14:09
shelhameryes, I had read that, but feel that I may be on the borderline as last summer I worked for the lab and my own programming business through the summer with success; I have in fact paid for my schooling by programming on the side all along14:10
shelhamerbut at the same time, I know 20 != 4014:10
sonney2kshelhamer, I have put similarly high workload on myself (it usually does not stay at 20 for each of your jobs) and it can ruin the fun14:10
shelhamerthis is true, I've had similar experiences myself, with one job at 40 and another at 10-20, and don't want to repeat it, but found the prospect of GSoC exciting14:11
shelhamerwith your saying that though, I suppose I should wait until next year14:11
sonney2kAs much as I am positive about it (due to your background) I would really want to warn you...14:12
shelhamerall the same, I'll plan on getting to know some of the shogun code this summer, just unofficially, and maybe I'll be able to help out in some way14:12
shelhamerI appreciate your warning, and thank you for your advice! as you say, I don't want to have it turn out miserably from over-committing14:12
sonney2kthat would definitely turn you into a strong candidate next year ...14:13
shelhamerwell, that's the way forward then-thank you for helping me decide. I'll be graduating next spring, so should have more freedom that summer to participate in something like this14:14
shelhamerthanks again14:14
sonney2kshelhamer, you are welcome and thanks for your interest! all feedback is welcome.14:15
-!- heiko [~strathman@neckar.uni-duisburg.de] has joined #shogun14:19
-!- bla_ [c07c1afa@gateway/web/freenode/ip.192.124.26.250] has joined #shogun14:53
-!- bla_ [c07c1afa@gateway/web/freenode/ip.192.124.26.250] has quit [Client Quit]14:54
@knrrrdhi dudes15:09
sonney2kohh the return of the ueberdude15:10
@knrrrdHehe. I am Bonn HBF waiting for next connection15:11
sonney2khail to the german trains, hail the deutsche bahn :-(15:11
-!- mode/#shogun [+o sonney2k] by ChanServ15:12
@knrrrdmobile IRC is really entertaining15:13
@sonney2kso that is from your iphone?15:14
@knrrrdYep15:14
@sonney2kI guess bci controlled.15:14
@knrrrdAlmost15:15
@sonney2kthat cap will attract extra attention15:15
@knrrrdNext stop15:15
@knrrrdCologne15:15
aifargonossonney2k: thanks for email reply ...15:20
@sonney2kaifargonos, you are welcome...15:21
aifargonosI guess I'll apply for this hdf5 idea ...15:21
aifargonoshdf5 looks like coor format ...15:21
aifargonoswhat functionality is already implemented ??15:21
@sonney2kthere is lots of things to do...15:22
@sonney2khave a look at CHDF5File.{cpp,h}15:22
aifargonos(I've just opened it :-) )15:22
@sonney2kwe can read/write vectors/matrices of any type, strings is missing, symlinks are missing and it would be great to be able to read newer matlab files (they are hdf5 based)15:23
@sonney2kand also pytables based files15:23
@sonney2kI guess also some custom functions like create a group / change into that group / list the file content...15:24
aifargonoswhere can I find doc for this matlab and py stuff ??15:24
aifargonosor I'll just google it ...15:24
@sonney2kaifargonos, pytables you can probably find, matlab - I guess we will have to supply some samples15:25
@sonney2k(it is not documented)15:25
aifargonos:-(15:25
@sonney2kclosed source at its best15:25
aifargonos.. so you want just general functions for file manipulation ??15:26
aifargonosI thought it was meant to be a form of serialization ...15:26
@sonney2kaifargonos, serialization is already there15:26
@sonney2keven xml, ascii, hdf5 and json based15:26
aifargonosok ..: I'll have look at it ...15:27
@sonney2kI'd like to simply be able to load lots of the hdf5 based formats15:27
@sonney2kI mean hdf5 is just a container format...15:27
@sonney2kbtw, mldata.org format support too...15:27
aifargonosheh .. ok, so you want handles for a manipulation of different data formats .. yes ??15:29
aifargonosor even extending serialisation ??15:29
aifargonosor I don't need to care about serialization ??15:29
@sonney2kaifargonos, you don't need to care about serialization ... I care about being able to read these different hdf5 based data formats and to be able to write all of shogun's features in hdf515:32
-!- seviyor [c1e20418@gateway/web/freenode/ip.193.226.4.24] has quit [Quit: Page closed]15:35
aifargonosok .: so then, what about some common interface for manipulating whatever format will be supported ... some kind of abstraction layer ..: you use same calls for work with different formats, where concrete format depends on some setting / your choice .. ??15:36
@sonney2kaifargonos, Heh - that is what we have in CFile.h :)15:39
@sonney2kbut yes there is a lot of work that can be done here... better .csv support, etc...15:40
aifargonoscool .. ok so I'll go through the code tonight to get better idea about it ...15:40
-!- blackburn [~qdrgsm@188.168.4.243] has joined #shogun16:09
-!- shelhamer [~shelhamer@gut75-5-82-247-9-141.fbx.proxad.net] has quit [Quit: Computer has gone to sleep]16:23
-!- aifargonos [~aifargono@46.18.27.35] has quit [Ping timeout: 260 seconds]16:55
-!- seviyor [c1e20418@gateway/web/freenode/ip.193.226.4.24] has joined #shogun16:56
-!- blackburn [~qdrgsm@188.168.4.243] has quit [Ping timeout: 276 seconds]16:59
-!- blackburn [~qdrgsm@188.168.2.29] has joined #shogun17:00
-!- sploving [~root@124.16.139.196] has quit [Ping timeout: 240 seconds]17:01
-!- sploving [~root@124.16.139.196] has joined #shogun17:01
-!- aifargonos [~aifargono@193.206.186.107] has joined #shogun17:24
jabbok@sonney2k, I have a question regarding COFFIN, in the 2010 ICML paper you say that in the first example you used features with 141 attributes and in the second (gender estimation) you use 2827 attributes, all equal to one in a 723,712 vector, the rest being zero17:44
jabbok@sonney2k, have you tried COFFIN on other features, with higher dimensionalities, such as Histogram of Gradients or something like that with ~2000 attributes, non-spare, all real ?17:46
@sonney2kjabbok, no I didn't17:49
@sonney2kI don't think that this would be particularly fast though17:49
jabbokthe DOT and ADD operations were overwritten in liblinear original code?17:51
jabbokor the principles from liblinear were reimplemented in COFFIN?17:52
-!- dadkins [~kvirc@cpe-174-102-36-192.woh.res.rr.com] has joined #shogun17:53
@sonney2kjabbok overwritten in liblinear, SGD, ocas ...17:54
jabbokI've setup the shogun environment on a ubuntu 10.10 from the git repository; now cmdline, octave and matlab both static and modular work17:56
jabbokbut I couldn't find any liblinear after a "find . -name liblinear" command, cout you please give me a hint where they might be, in case they are in the git repository ?17:57
@sonney2kfind . -iname '*liblinear*'17:57
@sonney2kIIRC LibLinear.h17:58
jabboksorry, my bad, online doxygen was not case sensitive also18:00
dadkinsI have some short gsoc-related questions: any takers?18:03
@sonney2kshoot18:03
dadkinsI was able to get the latest trunk and got everything building easily enough. For my project I plan to integrate C5.0 and kPCA: does this seem like a good course of action for a proposal?18:05
dadkinslet me be more clear about "integrate C5.0 and kPCA"...18:06
@sonney2kdadkins, there are quite a number of takers for C5.0 and kPCA is basically implemented but only needs some polishing18:06
@sonney2kso it would be better to think of an alternative18:07
dadkinsany suggestions?18:07
@sonney2kI would recommend to integrate some algorithm (for which an implementation exists) and to implement something that is not there. but what exactly depends on what you would be interested in.18:08
@sonney2ksomething that you might want to use yourself for example...18:08
blackburnbut not of dimensionality reduction :)18:09
blackburn*joke*18:09
-!- aifargonos [~aifargono@193.206.186.107] has quit [Ping timeout: 250 seconds]18:09
-!- heiko [~strathman@neckar.uni-duisburg.de] has left #shogun []18:09
jabbok@sonney2k, all that's in shogun for liblinear are contended in LibLinear.h and LibLinear.cpp, right ?18:10
jabbokand COFFIN is fully integrated in shogun without any other standalone sources?18:11
@sonney2kjabbok, I think there is also some other files like Tron.{cpp,h} but for e.g. the linear L1-loss SVM yes18:11
@sonney2kjabbok, well the dotfeatures provide the needed functions18:11
@sonney2kso I only had to replace things like: add alpha * x to a dense vector with the appropriate function18:12
-!- aifargonos [~aifargono@46.18.27.4] has joined #shogun18:12
jabbokok. thanks18:12
blackburnsonney2k: seems like number of applicants doubles rough estimation of slots number :)18:12
@sonney2kdadkins, you could for example think of doing clustering algorithms...18:13
blackburnfor example graph clustering18:13
dadkinslike a k-means or isodata?18:14
blackburnk-means is already implemented18:14
@sonney2kbut look what is there already!18:14
* sonney2k is off to food18:14
dadkinsjust drawing a parallel to make sure i understood18:15
blackburndadkins: isodata isn't in shogun yet18:16
dadkinsiirc isodata is just k-means with a variable value for the number of clusters which grows and expands...that seems like a useful tool18:16
dadkinsI also noticed that there is no self-organizing map available -- would this be useful?18:19
jabbokis there any way of debugging shogun besides SG_PRINT, something like building with debug symbols and afterwards using gdb ?18:20
jabbokI haven't seen anything in the tutorials18:21
blackburndadkins: seems like there is no artificial neural networks in shogun, so SOM isn't there too18:21
dadkinsmight be best to start with a basic bpnn and go from there then...18:22
blackburndadkins: don't know, try to wait for Sören, he could say his opinion on that18:23
dadkinsblackburn: Thanks for the thoughts. The closest I could find was CPerceptron, which inherits CLinearClassifier, so my guess (without reading code) is that it won't do anything with multiple layer sigmoids...*grin*18:24
-!- sploving [~root@124.16.139.196] has quit [Read error: Operation timed out]18:30
-!- sploving [~root@124.16.139.196] has joined #shogun18:30
-!- dadkins [~kvirc@cpe-174-102-36-192.woh.res.rr.com] has quit [Quit: KVIrc 4.0.4 Insomnia http://www.kvirc.net/]19:08
-!- aifargonos [~aifargono@46.18.27.4] has quit [Ping timeout: 252 seconds]20:02
-!- Tanmoy [75d35896@gateway/web/freenode/ip.117.211.88.150] has quit [Ping timeout: 252 seconds]20:28
-!- serialhex [~quassel@99-101-149-136.lightspeed.wepbfl.sbcglobal.net] has joined #shogun20:41
CIA-30shogun: Soeren Sonnenburg master * rf7f3e1d / (src/ChangeLog src/.authors): remove dirks email address from changelog - http://bit.ly/g1acX820:47
@sonney2kjabbok, --enable-debug ... but shogun is always compiled with debug symbols20:47
@sonney2khowever it helps to disable optimization...20:47
@sonney2kalso to reduce compile times it drastically helps to use ccache20:48
-!- alesis-novik [~alesis@188.74.87.84] has quit [Quit: I'll be back]20:49
-!- aifargonos [~aifargono@46.18.27.35] has joined #shogun20:54
@knrrrdThe KFA task is also related to dim. reduction20:55
-!- sonney2k [~sonney2k@g225143240.adsl.alicedsl.de] has quit [Ping timeout: 246 seconds]21:41
-!- sonney2k [~sonney2k@g225138211.adsl.alicedsl.de] has joined #shogun21:41
-!- Tanmoy [75d35896@gateway/web/freenode/ip.117.211.88.150] has joined #shogun21:51
-!- seviyor [c1e20418@gateway/web/freenode/ip.193.226.4.24] has quit [Ping timeout: 252 seconds]22:21
-!- serialhex [~quassel@99-101-149-136.lightspeed.wepbfl.sbcglobal.net] has quit [Remote host closed the connection]22:21
-!- serialhex [~quassel@99-101-149-136.lightspeed.wepbfl.sbcglobal.net] has joined #shogun23:03
CIA-30shogun: Soeren Sonnenburg master * r3f6962a / (3 files in 2 dirs):23:05
CIA-30shogun: Implement snappy compression support (http://code.google.com/p/snappy/).23:05
CIA-30shogun: This code is still experimental and pending benchmarks. - http://bit.ly/e0oZwr23:05
-!- blackburn [~qdrgsm@188.168.2.29] has left #shogun []23:28
-!- nicococo [~nicococo@d75-157-184-31.bchsia.telus.net] has joined #shogun23:31
--- Log closed Thu Mar 31 00:00:36 2011

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!