IRC logs of #shogun for Monday, 2012-04-30

--- Log opened Mon Apr 30 00:00:37 2012
-!- PhilTillet [~Philippe@npasserelle10.minet.net] has quit [Ping timeout: 276 seconds]00:04
-!- PhilTillet [~Philippe@2001:660:3203:402:3545:6e43:ea02:c6b7] has joined #shogun00:13
-!- blackburn [~qdrgsm@85.114.185.217] has joined #shogun01:17
-!- wiking_ [~wiking@78-23-189-112.access.telenet.be] has joined #shogun02:04
-!- wiking_ [~wiking@78-23-189-112.access.telenet.be] has quit [Changing host]02:04
-!- wiking_ [~wiking@huwico/staff/wiking] has joined #shogun02:04
-!- blackburn [~qdrgsm@85.114.185.217] has quit [Quit: Leaving.]02:06
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 256 seconds]02:08
-!- wiking_ is now known as wiking02:08
-!- emrecelikten1 [~emrecelik@92.44.126.141] has joined #shogun02:13
-!- emrecelikten [~emrecelik@92.44.124.86] has quit [Ping timeout: 245 seconds]02:14
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]02:20
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun02:20
-!- av3ngr [av3ngr@nat/redhat/x-ripnmxahspswstqh] has joined #shogun02:34
-!- Cheng [80fa500f@gateway/web/freenode/ip.128.250.80.15] has joined #shogun03:56
-!- PhilTillet [~Philippe@2001:660:3203:402:3545:6e43:ea02:c6b7] has quit [Ping timeout: 260 seconds]04:05
-!- Cheng [80fa500f@gateway/web/freenode/ip.128.250.80.15] has quit [Ping timeout: 245 seconds]04:40
-!- wiking_ [~wiking@78-23-189-112.access.telenet.be] has joined #shogun05:47
-!- wiking_ [~wiking@78-23-189-112.access.telenet.be] has quit [Changing host]05:47
-!- wiking_ [~wiking@huwico/staff/wiking] has joined #shogun05:47
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 250 seconds]05:51
-!- wiking_ is now known as wiking05:51
-!- gsomix [~gsomix@95.67.182.154] has joined #shogun06:04
-!- gsomix [~gsomix@95.67.182.154] has quit [Client Quit]06:04
-!- gsomix [~gsomix@95.67.182.154] has joined #shogun06:05
-!- gsomix [~gsomix@95.67.182.154] has quit [Ping timeout: 252 seconds]07:53
-!- n4nd0 [02893bbe@gateway/web/freenode/ip.2.137.59.190] has joined #shogun09:01
-!- n4nd0 [02893bbe@gateway/web/freenode/ip.2.137.59.190] has quit [Quit: Page closed]09:18
-!- blackburn [~qdrgsm@85.114.185.217] has joined #shogun09:49
blackburnthat's nice to have holidays on monday10:01
-!- av3ngr [av3ngr@nat/redhat/x-ripnmxahspswstqh] has quit [Quit: That's all folks!]10:07
-!- wiking [~wiking@huwico/staff/wiking] has quit [Quit: wiking]10:11
-!- wiking [~wiking@78-23-189-112.access.telenet.be] has joined #shogun10:17
-!- wiking [~wiking@78-23-189-112.access.telenet.be] has quit [Changing host]10:17
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun10:17
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has joined #shogun10:27
blackburnn4nd0: oops I forgot to merge your PR10:38
CIA-64shogun: iglesias master * r6e84b8e / (3 files in 2 dirs): * documentation JLCoverTree warnings fix - http://git.io/ZVgpUw10:38
CIA-64shogun: Sergey Lisitsyn master * ra11462d / (3 files in 2 dirs): Merge branch 'ct-warningfix' of git://github.com/iglesias/shogun - http://git.io/EvNH-A10:38
shogun-buildbotbuild #799 of libshogun is complete: Failure [failed compile]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/libshogun/builds/799  blamelist: fernando.iglesiasg@gmail.com10:44
blackburnoops?10:46
blackburnhow can that be :D10:46
blackburnI fixed it other day10:47
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has quit [Ping timeout: 246 seconds]10:47
shogun-buildbotbuild #800 of libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/libshogun/builds/80010:48
-!- cheng [80fa500f@gateway/web/freenode/ip.128.250.80.15] has joined #shogun10:53
blackburncheng: surprise to see you there ;)10:55
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has joined #shogun11:00
blackburnn4nd0: ping11:03
chengHi blackburn! Just logging on to see what the fuss is all about. ;-)11:09
n4nd0blackburn, hey11:09
blackburncheng: oh it would take a few days to check logs :D11:09
blackburnah logging on sorry11:09
blackburnn4nd0: I merged your pr (forgot to do yesterday)11:10
blackburncheng: btw it would be nice to discuss multiclass idea11:10
n4nd0blackburn, yeah I saw it, thank you :)11:11
chengYes, for sure. The idea would be to have a toolbox for converting binary classifiers into multiclass classifiers.11:12
blackburncheng: yeah but probably pluskid will be really fast in it so some more complex stuff should be here too11:13
chengI agree. I just haven't had too much time to discuss with pluskid yet.11:14
blackburncheng: do you have expertise in multiclass tree learning?11:14
chengI was traveling last week, and was offline (hence missing the first meeting).11:14
blackburncheng: (offtop) I wanted to ask you whether JMLR re-submission has some implicit deadline11:15
chengblackburn: unfortunately, I don't really have expertise (in pretty much anything).11:15
chengre-JMLR, not really, but if you wait too long, the reviewers tend to be more demanding. I'd say 2 months max if you can manage.11:16
blackburnprobably 2 months elapsed already :(11:16
blackburnhmm no, rather 1.511:18
chengI mean 2 months from now.11:19
blackburnah11:19
chengre ecoc: John Langford's stuff on conditional trees seem to scale well.11:19
chengOne thing I just learned about last week was estimating some sort of "confidence interval"11:20
chengThis is called "conformal predictions", and there is a nice tutorial on JMLR.11:20
blackburncheng: you said you have no expertise?11:21
blackburn:D11:21
chengWell, I know of work, but I don't yet know on how to implement the work.11:22
blackburncheng: not a problem - implementation is rather our part11:23
chengAbout conformal predictions, it seems to take any multiclass classifier and give back the "argmax" and another few predictions, which are in the "confidence interval"11:24
blackburncheng: that should be interesting11:25
chengIt could also be an interesting research project in the structured prediction setting, but I think it is too much research for GSoC.11:25
blackburncheng: I actually thought of some kind of SO setting11:26
blackburncheng: do you think it would be reasonable to learn ECOCs?11:26
chengFor plain multiclass however, it would be quite neat. Unfortunately, I don't yet know what other requirements the method needs.11:26
chengTo learn ECOCs, Gunnar had an old paper "adaptive codes and polychotomies" or something like that.11:27
blackburnreally? I should check11:27
chengI had suggested that to pluskid (unfortunately in a private mail).11:27
cheng2002 or so,11:27
chengbooks.nips.cc/papers/files/nips15/AA04.pdf11:28
blackburncheng: sounds like great unimplemented idea..11:29
chengGunnar will be happy.11:29
-!- gsomix [~gsomix@95.67.153.157] has joined #shogun11:31
gsomixhi all11:31
chengIt is also somehow related to cutting plane methods, which there are a few implementations of in shogun.11:31
blackburncheng: ideal case would be it is possible with libocas (with some patching)11:32
chengHi gsomix11:32
blackburngsomix: hi11:32
chengblackburn: hopefully possible. I don't know.11:33
blackburncheng: however some students would work on libqp this year so it can be used too11:33
chengblackburn: I don't know enough about the implementation, but in principle you need a cutting plane method, and a QP solver, as you said. :-)11:35
-!- karlnapf [~heiko@host86-183-72-191.range86-183.btcentralplus.com] has joined #shogun11:36
-!- cheng [80fa500f@gateway/web/freenode/ip.128.250.80.15] has quit [Ping timeout: 245 seconds]11:40
wikingfuuuuucking hell i've did the resubmission \o/11:52
wikingno sleep for the last 24 hours11:52
blackburnwiking: ah! so what did you change?11:52
wikingblackburn: ehhehe after i woke up11:53
wikingi'll tell u11:53
blackburnsure11:53
wikingi think i'm gonna crash now11:53
blackburnhave a long sleep now :D11:53
-!- blackburn [~qdrgsm@85.114.185.217] has quit [Quit: Leaving.]11:55
n4nd0yeah, have a good rest wiking11:55
shogun-buildbotbuild #516 of ruby_modular is complete: Failure [failed test_1]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/ruby_modular/builds/516  blamelist: blackburn91@gmail.com12:14
-!- blackburn [~qdrgsm@85.114.185.217] has joined #shogun13:07
-!- blackburn [~qdrgsm@85.114.185.217] has quit [Quit: Leaving.]13:15
-!- emrecelikten1 [~emrecelik@92.44.126.141] has quit [Ping timeout: 252 seconds]13:46
-!- cheng [73406f11@gateway/web/freenode/ip.115.64.111.17] has joined #shogun14:16
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has quit [Ping timeout: 246 seconds]14:27
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has joined #shogun14:27
-!- karlnapf1 [~heiko@host86-176-4-122.range86-176.btcentralplus.com] has joined #shogun14:28
-!- karlnapf [~heiko@host86-183-72-191.range86-183.btcentralplus.com] has quit [Ping timeout: 276 seconds]14:29
-!- cheng [73406f11@gateway/web/freenode/ip.115.64.111.17] has quit [Quit: Page closed]14:38
-!- PhilTillet [~Philippe@157.159.47.10] has joined #shogun15:42
-!- karlnapf1 [~heiko@host86-176-4-122.range86-176.btcentralplus.com] has quit [Quit: Leaving.]16:31
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has quit [Ping timeout: 246 seconds]16:47
-!- blackburn [~qdrgsm@85.114.185.217] has joined #shogun16:59
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has joined #shogun17:00
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has quit [Quit: Ex-Chat]17:13
CIA-64shogun: Chiyuan Zhang master * ra5e054b / (2 files in 2 dirs): a better fix for the SWIG problem. - http://git.io/g5FM2Q17:15
CIA-64shogun: Chiyuan Zhang master * r2b13d07 / (10 files): ECOC Random Dense/Sparse Coding. - http://git.io/Ee9E3A17:15
blackburnunstoppable pluskid17:15
-!- Priyans [~Priyans@115.248.130.148] has joined #shogun19:58
-!- Priyans [~Priyans@115.248.130.148] has quit [Quit: Leaving]20:04
CIA-64shogun: Sergey Lisitsyn master * r40c2582 / src/shogun/lib/external/shogun_liblinear.cpp : Significant performance improvement for multiclass liblinear - http://git.io/63encw20:17
blackburnsonney2k: yay20:17
blackburnat least 3x faster20:17
wikingblackburn: "Congratulations on having your paper accepted to the Workshop on Medical Computer Vision at CVPR 2012"20:18
wiking!!!20:18
blackburnwiking: congrats :)20:18
blackburnI guess you did great job there20:18
blackburnwiking: btw could you please do regression test of liblinear?20:18
blackburnjust run and check if results are still the same20:19
blackburnbtw it should be much faster now20:21
-!- PhilTillet [~Philippe@157.159.47.10] has quit [Remote host closed the connection]20:38
wikingblackburn: eheheh i've just got back21:15
wikingi had a little bit of FUCKYEAH moment :)21:15
blackburnwiking: for a hour :D21:16
wikingwell yeah it happens :)21:16
wikingok21:17
wikingwe need a kernel21:17
wikinglaplacian21:17
wikingwhich is almost like a gaussian21:17
wikingthat's what i've realized yesterday around 4am21:17
wiking:>21:17
blackburnwiking: ExponentialKernel?21:18
blackburnCExponentialKernel21:18
wikinghttp://crsouza.blogspot.com/2010/03/kernel-functions-for-machine-learning.html#laplacian21:18
wikingis that it?21:18
wikingalmost21:18
wikingsee the difference on the page21:19
wikingbut i wonder what's the implementation in shogun21:19
blackburnwiking: ah these differencies make no sense to me21:19
blackburnaccording sigmas will make it equal21:20
shogun-buildbotbuild #224 of nightly_all is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_all/builds/22421:22
blackburnit's been a long w/o success :D21:24
@sonney2kblackburn, regarding learning ECOC - I was a young student sitting in the room when gunnar wrote that paper. he in the end said that there is very little gain if at all21:35
blackburnsonney2k: great news :D21:35
@sonney2kand couldn't really produce some example that was convincing21:35
@sonney2kso I guess you can save some time :)21:35
blackburnsonney2k: you weren't so young these days I think ;)21:36
@sonney2kblackburn, what? 9 years ago is like inf time21:37
blackburnsonney2k: you were older than me still21:37
@sonney2kgsomix, did you manage to get things to compile with the new sgvector?21:37
blackburn5 years or so :D21:37
@sonney2kblackburn, no 2002!21:39
blackburnsonney2k: I mean you still were 5 years older than me21:39
gsomixsonney2k, nope. I'm working on this now.21:39
blackburnsonney2k: to not be surprised with gsomix patch I suggested it21:40
blackburn(feature titles namely)21:40
@sonney2kblackburn, I will always be older :)21:42
@sonney2kblackburn, from gunnars paper " So far, we could only show a proof of concept and more experimental work is necessary.21:42
@sonney2kIt is in particular interesting to find practical examples, where a non-trivial choice of the21:42
@sonney2kcode (via optimization) helps simplifying the embedding and finally leads to additional21:42
@sonney2kimprovements. Such problems often appear in Computer Vision, where there are strong relationships between classes. Preliminary results indicate that one can achieve considerable21:42
@sonney2kimprovements when adapting codes and embeddings [3]."21:42
@sonney2khaha :))21:42
blackburnsonney2k: yes twice21:42
blackburnsonney2k: are you familiar with this paper?21:43
blackburnwhat do they do in particular?21:43
blackburnlearn codes or learn classifier using structured output framework and codes as outputs?21:43
@sonney2kblackburn, I just had a brief look - they learn ECOC and gunnar (as usual) uses column generation which is kind of cutting plane technique21:43
@sonney2kthey learn the 'optimal' code21:44
@sonney2kbut it didn't gain anything21:44
blackburnnahh I don't want to do it21:44
blackburnand never did21:44
blackburnI want to learn classifiers with ECOC outputs21:44
blackburnin SO fashion21:44
@sonney2kblackburn, still it is intersting if one can learn the *optimal* coding21:44
@sonney2kmaybe it can help wikings vision problems or so21:45
@sonney2kblackburn, good job on liblinear :)21:45
@sonney2kthat is for multiclass only right?21:45
blackburnsonney2k: yes sure21:45
blackburnI am not interested in binary21:45
@sonney2kor did you do it for L1 regul too?21:45
blackburnhmmm is it needed? I have never checked the code21:46
@sonney2kblackburn, I guess just grep for the feature iterator stuff is best21:47
blackburnsonney2k: L1 makes no use of iterator so far21:47
@sonney2kblackburn, what did you suggest to gsomix ?21:47
@sonney2kgsomix, ok np21:47
blackburnsonney2k: names/titles of features21:47
blackburnlike 1st feature is 'weight'21:47
blackburnand 99th is 'hair color' :D21:48
blackburnsonney2k: yes liblinear needs similar stuff21:49
blackburnL1 as you said21:49
blackburnL1LR21:49
blackburnterrible21:50
blackburna lot of21:50
@sonney2kblackburn, you really want to maximize overhead don't you?21:53
blackburnsonney2k: overhead of cfeatures??21:53
blackburnyou must be kidding21:54
@sonney2kblackburn, I thought we are talking about sgvector?21:54
blackburnsonney2k: cfeatures21:54
@sonney2kyou didn't say so21:54
blackburnwas implicit :D21:54
blackburnsonney2k: no I do not want any overhead in sgvector21:54
blackburnhowever I do not care about overhead of sgobjects21:55
blackburnwe have giant parameters map and other stuff21:55
blackburnthis already makes sgobjects not so lightweight but hey who cares21:55
blackburnI wouldn't say typical shogun based program would use more than 100 objects21:56
gsomixsonney2k, what about ref() in copy constructor and unref() in destructor? can I add it? or do we prefer manually control?21:56
@sonney2kblackburn, sure. agreed.22:02
@sonney2kgsomix, yes ref in copy constructor / unref in destructor22:02
gsomix\o/22:03
blackburnsonney2k: patching L1 stuff..22:04
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has joined #shogun22:05
-!- emrecelikten [~emrecelik@92.44.126.141] has joined #shogun22:08
* wiking is in workmoooode 22:17
* gsomix tired today22:18
* blackburn drinks moar vodka and keep patching22:19
gsomixsonney2k, it seems, I need a sleep.22:19
gsomixblackburn, I'll come in Samara tomorrow, wait for me. leave vodka :)22:20
blackburngsomix: I am not in samara22:21
gsomixblackburn, ah. =___=22:21
blackburnand you said you prefer not to drink :P22:21
blackburngsomix: actually you should let us know you had a bday22:21
blackburn:D22:21
blackburnwiking: n4nd0: sonney2k: this guy gsomix have a bday today and keep it in secret :D22:22
n4nd0wow22:22
n4nd0happy birthday gsomix!22:23
wikinggsomix: !!!!!!!!!22:23
n4nd0felicidades!22:23
n4nd0grattis pÄ födelsedagen!22:23
wikinggsomix: sretan rodjendan22:23
blackburnlol22:24
wikingi wonder if it's similar to russian :P22:24
blackburnwiking: s dnem rojdenia22:24
gsomixn4nd0, thanks22:24
wiking:>>22:24
blackburnwiking: sounds a little similar22:24
gsomixwiking, spasibo :]22:24
wikinggsomix: :)22:25
gsomixyou guys are cool22:27
gsomixunfortunately I need a sleep22:27
gsomixgood night :)22:27
n4nd0good night!22:28
blackburnthat L1 and transposed features is something I do not like..22:30
blackburnsonney2k: can you motivate this transposition?22:33
blackburnis it to use feature iterator as iterator on one feature of different vectors?22:35
-!- karlnapf [~heiko@host86-176-4-122.range86-176.btcentralplus.com] has joined #shogun22:37
-!- gsomix [~gsomix@95.67.153.157] has quit [Ping timeout: 252 seconds]22:43
-!- PhilTillet [~Philippe@2001:660:3203:402:1d2a:c7fe:1fff:9fdb] has joined #shogun22:46
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has quit [Ping timeout: 246 seconds]22:47
-!- PhilTillet [~Philippe@2001:660:3203:402:1d2a:c7fe:1fff:9fdb] has quit [Ping timeout: 245 seconds]22:51
-!- PhilTillet [~Philippe@157.159.42.154] has joined #shogun22:58
-!- n4nd0 [~n4nd0@190.Red-2-137-59.dynamicIP.rima-tde.net] has joined #shogun23:01
-!- wiking [~wiking@huwico/staff/wiking] has quit [Quit: wiking]23:23
-!- blackburn [~qdrgsm@85.114.185.217] has quit [Quit: Leaving.]23:25
-!- wiking [~wiking@78-23-189-112.access.telenet.be] has joined #shogun23:25
-!- wiking [~wiking@78-23-189-112.access.telenet.be] has quit [Changing host]23:25
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun23:25
-!- blackburn [~qdrgsm@85.114.185.217] has joined #shogun23:25
-!- blackburn [~qdrgsm@85.114.185.217] has quit [Quit: Leaving.]23:31
-!- blackburn [~qdrgsm@85.114.185.217] has joined #shogun23:33
-!- emrecelikten [~emrecelik@92.44.126.141] has quit [Read error: Operation timed out]23:33
blackburnoh nice I started to receive strange characters instead of russian words in icq :D23:33
-!- blackburn [~qdrgsm@85.114.185.217] has quit [Quit: Leaving.]23:43
-!- blackburn [~qdrgsm@85.114.185.217] has joined #shogun23:51
--- Log closed Tue May 01 00:00:37 2012

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!