IRC logs of #shogun for Tuesday, 2012-06-26

--- Log opened Tue Jun 26 00:00:07 2012
-!- heiko [~heiko@host86-180-159-222.range86-180.btcentralplus.com] has joined #shogun00:34
-!- ckwidmer [8ca3fe9d@gateway/web/freenode/ip.140.163.254.157] has quit [Ping timeout: 245 seconds]01:27
-!- heiko [~heiko@host86-180-159-222.range86-180.btcentralplus.com] has quit [Ping timeout: 272 seconds]01:28
-!- shogun-toolbox [~shogun@7nn.de] has quit [Ping timeout: 240 seconds]01:32
--- Log closed Tue Jun 26 01:32:38 2012
--- Log opened Tue Jun 26 01:32:48 2012
-!- shogun-toolbox [~shogun@7nn.de] has joined #shogun01:32
-!- Irssi: #shogun: Total of 7 nicks [1 ops, 0 halfops, 0 voices, 6 normal]01:32
-!- Irssi: Join to #shogun was synced in 6 secs01:32
-!- romi_ [~mizobe@187.66.121.115] has joined #shogun02:40
-!- av3ngr [av3ngr@nat/redhat/x-fpfmjewzpoauxtlb] has joined #shogun03:03
-!- av3ngr [av3ngr@nat/redhat/x-fpfmjewzpoauxtlb] has quit [Client Quit]03:03
-!- cheng [80fa500f@gateway/web/freenode/ip.128.250.80.15] has joined #shogun03:07
CIA-18shogun: Sergey Lisitsyn master * ra937587 / (5 files in 2 dirs): Updated multitask logistic regression - http://git.io/oEeUnA03:08
CIA-18shogun: Sergey Lisitsyn master * r3ee917a / (2 files in 2 dirs): Fixed a bunch of bugs in multitask logistic regression - http://git.io/02T5NQ03:08
-!- blackburn [~blackburn@31.28.43.76] has quit [Ping timeout: 240 seconds]03:13
-!- Cheng2 [~cheng@211.29.182.146] has joined #shogun03:27
-!- Cheng2 [~cheng@211.29.182.146] has quit [Client Quit]03:27
-!- pluskid [~pluskid@202.130.113.141] has joined #shogun03:53
pluskidhi cheng03:54
pluskidjust get up from bed :D03:54
chengHi. Are we in the same timezone?03:56
pluskidnot sure, I'm in GMT+8, what about you?03:56
chengI think I'm GMT+1003:56
chengIt's almost lunchtime for me... :-)03:56
pluskidhmm, you are a little ahead of me :)03:57
chengJust means that I can wake up later.03:57
pluskidhaha, but you also have to sleep later03:57
pluskidshall we talk about our mid-term? or are you planing to have lunch now?03:57
chengLooking at the IRC logs, it looks like you're having productive discussions with blackburn and sonney2k03:58
pluskidhmm, I just finished the ShareBoost the last week03:58
pluskidfailed to send the weekly report last night03:58
pluskidjust sent it a minute ago03:58
chengSo, you did figure out the convex optimization problem?03:59
pluskidyeah03:59
pluskidFinally i used lbfgs to solve it03:59
pluskida by-product is that now I integrated lib-lbfgs in shogun03:59
pluskidanyone else can also use that if needed03:59
chenglbfgs is not bad.03:59
chengliblibfgs from Nocedal?03:59
pluskidI'm not sure, I'll check the page04:00
pluskidit's a C library04:00
chengDoesn't that use fortran or something?04:00
pluskidno04:00
pluskidit is ported from fortran, but not machine-translation04:00
chengAh, from chokkan.04:00
pluskidhttp://www.chokkan.org/software/liblbfgs/04:00
pluskidthis one04:00
pluskidah, yeah04:00
chengGood library.04:01
chengNice.04:01
pluskidsonney2k said it is not maintained for 1 year (so that we don't have to worry about future upgrade), so I modified it heavily to make it more integrated with shogun04:01
chengDid you contact the author?04:02
pluskidno04:02
chengHe may be interested in your updates.04:02
pluskidmaybe I should inform him04:02
chengIt is nice for authors to know that someone modifies their code.04:02
pluskidmy updates are concerned with shogun04:02
pluskide.g. use shogun's SGVector for vector computing04:02
pluskidbut I didn't modify the algorithm04:02
pluskidhowever, I think you are right, I still should inform him04:03
pluskidthat his great lib is being integrated in shogun :D04:03
chengLet him know that you've added it to shogun.04:03
pluskidyeah, OK04:03
chengSo, shareboost finished?04:03
pluskidnot completely04:04
pluskidI'm still working on to provide the python-modular interface04:04
pluskidafter that, it will be finished04:04
pluskidor I might try to test it on some none-toy dataset04:04
chengDepends what you mean by non-toy04:04
pluskidI mean not those in shogun's data/toy directory :D04:05
pluskide.g. MNIST or USPS?04:05
chengSounds good.04:05
pluskidhowever, I'm currently having some problem with the python modular interface04:05
chengSWIG?04:06
pluskidthe SWIG compiler segfault when I tried to compile04:06
pluskidI tried to trace the git history04:06
pluskidit seems to be related to a commit from SO Learning04:06
pluskidbut that commit looks very ordinary, nothing dangerous04:06
pluskidI'll have to dig deeper to debug this out04:07
pluskidhope I can figure this out today or tomorrow04:07
pluskidso back to our mid-term04:07
chengI just looked at the GSoC calendar. http://www.google-melange.com/gsoc/events/google/gsoc201204:08
chengThe mid term is due on 9 July.04:08
pluskidhmm04:08
pluskidI looked at my original proposal04:08
chengAfter mid term, there are 6 more weeks of work.04:09
pluskidaround the time by mid-term, I planed to implement ECOC, ShareBoost, Fast Label Tree and a preliminary draft of survey04:09
pluskidit looks our progress are not bad04:09
pluskidI haven't implemented Fast Label Tree yet04:09
pluskidbut I implemented conditional prob tree instead04:10
chengI thought that the original proposal was quite ambitious.04:10
pluskidyeah, my original proposal was also very vague about the work during Jun. 21 and Aug. 10 :D04:10
pluskidso we have (a bit less than) 2 weeks before the mid-term04:11
chengSo, what's left from the orignal list? 1. survey draft 2. fast label tree04:12
pluskidhmm, survey draft is already there (really a draft only :p), but there's large space for improvement, coz many entries are only titles without content04:13
pluskidand yeah, fast label tree04:13
chengwhere's the draft?04:13
pluskidI sent it in one of the weekly report earlier04:13
pluskidshall I send a copy to you again?04:14
pluskiddid you get that?04:14
chengHad a look again at my email, and didn't see any attachments.04:16
pluskidOK, I'll send you a copy now04:16
chengI'm just thinking that it would be convenient to have it in the repository too.04:17
pluskidhmm, not sure where to put it04:17
pluskidI can discuss that with sonney2k and blackburn later04:18
pluskidjust sent04:18
chengOne of the "usability improvements" could be such a survey of all algorithms implemented in shogun.04:19
chengSo, what do you want to do until 9 July?04:19
chengBTW, just in case it wasn't clear, I think you're doing fantastically well.04:20
pluskidI think basically two options: fast label tree or make the survey more complete04:20
pluskidcheng: thanks!04:20
pluskidcheng: how about we decide what's for the work due 9 July after I (completely) finish ShareBoost?04:21
pluskidIf the time is enough04:21
pluskidI'll go with fast label tree04:22
pluskidif not, I'd prefer make the survey complete04:22
pluskid(and I'm usually helping sonney2k or blackburn to improve some basic things (like refactoring) in shogun during writing surveys) :D04:22
chengI'd say we say work on survey document. Even if you have lots of time. Because it would be important for you to figure out what else you want to do for the last 6 weeks.04:23
pluskidyeah! that's what wondering me, too04:23
chengSo, move fast label tree to 2 weeks away, move survey to the front.04:24
pluskidyeah04:24
pluskidso we can't decided what to do during the second half of GSoC, yet?04:24
cheng1. Fast label tree :-)04:25
pluskidaccording to my previous progress, it seems that I can implement an algorithm within 2~3 weeks if things don't go wrong04:25
chengHow about this old paper about learning the ECOC?04:25
pluskidso if as you said, there will be 6 weeks, we might be able to implement 2~3 important algorithms04:25
pluskidwhich old paper?04:26
chenghttp://books.nips.cc/papers/files/nips15/AA04.pdf04:27
pluskidha, it's from "Gun"04:28
chengThere are some more recent papers ICML2011 I think related to this, but I cannot remember them at the moment. Perhaps a task for you. ;-)04:28
pluskidOK, I'll write that down04:28
pluskidbut maybe we could also discuss with sonney2k04:28
chengYes, this paper is ahead of its time, and has a terrible title.04:28
pluskidhe seems to be not very interested in ECOC related stuff04:29
pluskidahead of its time? what's that mean?04:29
chengI think it would be nice for shogun (soeren probably too) to have really many classes multiclass.04:29
chengI mean that nobody in 2002 thought about learning the relationship between classes. Today, it is more popular.04:29
chengI'm open to suggestions.04:30
pluskidhmm04:31
chengHere's another simple algorithm. http://research.microsoft.com/en-us/um/people/ohadsh/2010_AISTATS_DekelSham.pdf04:31
pluskidmore class than examples, interesting04:32
pluskidso some of the classes won't even has training examples04:33
-!- romi_ [~mizobe@187.66.121.115] has quit [Ping timeout: 245 seconds]04:34
chengIt is two stage. There's some assumption about how the classes are related. Something like what blackburn is doing with multitask.04:34
pluskidhmm, that would make sense04:35
pluskidor else no information can be obtained for those classes (without training samples)04:35
chengMore john langford stuff: http://hunch.net/~beygel/tournament.pdf04:36
chengHe calls it a "Filter Tree".04:37
pluskidah, this one was in my reading list, but to be frank I haven't read it yet04:37
chengIt may be superceeded by the conditional probability tree. I don't know.04:38
pluskidthey also got a paper named "multiclass classification with filter-trees"04:39
pluskidnot sure that is the same as this one04:39
chengI think it is the same paper, but please check. I'm often wrong.04:40
pluskidmaybe the same, I found that paper from the references of another one, and it was said to be a "preprint", maybe they changed title when publishing04:40
pluskidanyway, I'll check it04:40
chengI think with 4 potential ideas, you should be fine. sonney2k probably has some other thoughts.04:41
pluskidah, yeah!04:41
chengWhile writing your survey, you can choose 2-3 of the 4. Basically rank them04:41
pluskidOK, I'll try04:41
pluskidI'll ask your suggestions when I'm more familiar with those algorithms04:42
-!- romi_ [~mizobe@187.66.121.115] has joined #shogun04:42
chengDifferent topic: did anything happen with the datasets idea?04:42
pluskidunfortunately, no04:42
pluskideveryone is super busy04:42
pluskideven the doc-shogun project proposed long before by soeren and blackburn is postponed04:43
chengFor your large number of classes methods, it would be nice to have some non-toy data.04:43
chengOh well, cannot be helped.04:44
pluskidhaha04:44
pluskidI think I can try during my surveying04:44
chengHope you are learning lots while working on GSoC.04:45
pluskidyeah, definitely :)04:45
pluskidbut I hope I can dig more deep into the theory of those algorithms I implemented04:45
chengWell, you have a PhD in front of you.04:45
pluskidhmm, you are right04:46
pluskida long way to go04:46
chengWho's going to be your potential supervisors?04:46
pluskidthey haven't told me yet04:46
chengNormal for US universities.04:46
pluskidwhy?04:47
pluskidbecause they are too lazy to work? :p04:47
chengJust curious. You can probably then choose supervisors that can teach you some theory.04:47
pluskidhmm, yeah, they said supervisor can be changed easily when you arrive if you really think the one is not suitable with you04:48
chengThere are plenty of good courses at MIT, e.g. game theory, stochastic optimization, etc.04:48
pluskidyeah, I'm looking forward for those :D04:49
pluskidsad thing would be you only have 24 hours a day04:49
chengYes, I'm a bit jealous that I don't really have too much time to code.04:50
pluskidhaha04:50
chengIt is getting better. I just moved this year, so I'm kind of doing 2 jobs.04:50
pluskiddoing 2 jobs would be super busy!04:51
chengThe irritating thing is that my previous job was in Europe, so I do a lot of night time meetings/discussions.04:51
chengAll very fun and interesting though...04:52
pluskidhaha04:52
pluskidCS people usually do not have regular sleeps04:52
chengKeep up the good work.04:52
pluskidthat's nog good04:52
chengI'll go for lunch soon...04:53
pluskidOK04:53
pluskidbtw: the link is broken? http://www.ong-home.my/04:53
chengYes, Soeren is hosting for me, and just moved the nameserver.04:53
pluskidfirst time of me heard of some .my domain name :D04:54
chengCool heh?04:54
pluskidhave a nice meal04:54
pluskidcool!04:54
-!- cheng [80fa500f@gateway/web/freenode/ip.128.250.80.15] has quit [Quit: Page closed]04:56
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has joined #shogun06:48
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has quit [Client Quit]06:52
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has joined #shogun06:55
-!- pluskid [~pluskid@202.130.113.141] has quit [Quit: Leaving]07:11
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has quit [Quit: leaving]08:43
-!- uricamic [~uricamic@2001:718:2:1634:3d67:c999:8cc9:d056] has joined #shogun08:52
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Remote host closed the connection]09:01
--- Log opened Tue Jun 26 09:02:26 2012
-!- shogun-toolbox [~shogun@7nn.de] has joined #shogun09:02
-!- Irssi: #shogun: Total of 6 nicks [0 ops, 0 halfops, 0 voices, 6 normal]09:02
-!- Irssi: Join to #shogun was synced in 6 secs09:02
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun09:02
-!- sonney2k [~shogun@7nn.de] has joined #shogun09:02
-!- mode/#shogun [+o sonney2k] by ChanServ09:03
-!- assistance [9320543b@gateway/web/freenode/ip.147.32.84.59] has joined #shogun09:10
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun09:23
-!- ipondering [~iponderin@58.194.224.104] has joined #shogun09:35
-!- gsomix [~gsomix@95.67.169.72] has joined #shogun09:57
gsomixhi09:57
-!- heiko [~heiko@host86-180-159-222.range86-180.btcentralplus.com] has joined #shogun09:59
-!- gsomix_ [~gsomix@95.67.191.81] has joined #shogun10:06
-!- gsomix [~gsomix@95.67.169.72] has quit [Ping timeout: 252 seconds]10:09
-!- gsomix_ is now known as gsomix10:42
-!- nicococo_ [5e8b1a4f@gateway/web/freenode/ip.94.139.26.79] has joined #shogun11:01
-!- naywhayare [~ryan@spoon.lugatgt.org] has quit [Ping timeout: 272 seconds]11:04
-!- naywhayare [~ryan@spoon.lugatgt.org] has joined #shogun11:05
-!- pluskid [~pluskid@111.120.64.13] has joined #shogun11:21
pluskidaway11:34
-!- ipondering [~iponderin@58.194.224.104] has quit [Quit: ipondering]11:37
-!- ipondering [~iponderin@2001:da8:203:1823:4919:ecd1:c3d5:4242] has joined #shogun12:25
-!- Cheng [~cheng@58.108.31.213] has joined #shogun12:32
-!- pluskid [~pluskid@111.120.64.13] has quit [Ping timeout: 248 seconds]12:40
-!- pluskid [~pluskid@202.130.113.141] has joined #shogun12:41
ChengHi again pluskid12:47
pluskidCheng: hi12:47
@sonney2kCheng, did you manage to get your domain name pointed to the right IP address now?12:47
-!- cheng_ [73406f11@gateway/web/freenode/ip.115.64.111.17] has joined #shogun12:50
-!- Cheng [~cheng@58.108.31.213] has quit [Ping timeout: 248 seconds]12:51
cheng_Pointed nameserver already, but website still broken. Dunno why.12:54
@sonney2kcheng_, when did you do it?12:54
cheng_ssh works. I'm guessing there is something strange about primary and secondary name servers.12:55
@sonney2kcheng_, ahh!12:55
@sonney2kI am your NS right?12:55
@sonney2kin this case I have to do it12:55
@sonney2ksrc12:55
@sonney2ksry12:55
cheng_I see.12:55
@sonney2kthen please don't do anything...12:55
@sonney2kor undo whatever I said :D12:55
cheng_I should change the name server back?12:55
cheng_I see.12:56
@sonney2ktotally forgot that I am doing this12:56
cheng_Do you guys have any tips for detecting OSX veclib?12:58
-!- cwidmer [~chris@cpe-69-201-177-140.nyc.res.rr.com] has joined #shogun12:58
cheng_configure fails for shogun.12:58
@sonney2kcheng_, updated the dns entry12:59
-!- puffin444 [62e3926e@gateway/web/freenode/ip.98.227.146.110] has joined #shogun12:59
@sonney2kcheng_, now it needs some time to propagate...12:59
cheng_I've pointed the registry back to the old name server.13:00
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has joined #shogun13:01
cheng_I guess I don't need blas lapack for the toy problems I have.13:01
cheng_I still wish I understood the whole linking thing under osx.13:01
uricamichi13:02
@sonney2knicococo_, around?13:02
nicococo_hi13:03
@sonney2knicococo_, do you know where alex is?13:04
nicococo_i don't know, sorry13:04
@sonney2kuricamic, is vojtech around?13:04
assistanceyes, hi13:04
@sonney2knicococo_, can you check?13:04
@sonney2kassistance == vojtech?13:04
@sonney2kok13:04
assistancesorry, I'll log again13:04
-!- assistance [9320543b@gateway/web/freenode/ip.147.32.84.59] has quit [Quit: Page closed]13:04
-!- vojtech [9320543b@gateway/web/freenode/ip.147.32.84.59] has joined #shogun13:05
nicococo_sonney: can't check, i'm at home13:05
@sonney2kok13:05
@sonney2kipondering, you are not alex right?13:06
@sonney2kso who is missing?13:06
n4nd0blackburn?13:06
@sonney2kalex and blackburn13:06
@sonney2kanyone else?13:06
@sonney2kgsomix, can you ping blackburn?13:07
heikosonney2k, unfortunately, I havent heard anything from arthur since yesterday, but I will probably meet him this week to update in case he wont make it13:07
@sonney2kheiko, I guess arthur won't join right?13:07
gsomixsonney2k, just a moment13:07
@sonney2kheiko, ok13:07
-!- blackburn [d5578b92@gateway/web/freenode/ip.213.87.139.146] has joined #shogun13:09
blackburnhey there sorry13:09
cwidmerhi13:09
@sonney2kblackburn, hope you did shower already13:09
@sonney2kso only alex is missing... then lets start13:09
blackburnshower?13:09
@sonney2kWelcome everyone to our third meeting. This is our last meeting before the midterm evaluations are due.13:09
blackburnI just ran into room :D13:09
gsomixblackburn, hey, got sms?13:09
@sonney2kSo mentors please listen up - starting from July 9 you will be able to submit midterm evaluations.13:10
blackburngsomix: yes but it was late - I was connecting already13:10
@sonney2kThese are crucial to students - they won't get paid if you don't evaluate them.13:10
@sonney2kYou can pass or fail a student, though hopefully the latter is not necessary.13:10
@sonney2kStudents, you know you are on track when you are halfway done and plenty of code has already been merged into shogun - in that case there is nothing to worry about!13:10
@sonney2kSome comments: Please students stay in #shogun during normal working ours.13:11
@sonney2kRecall GSoC is a full time job/commitment so that really shouldn't be too hard.13:11
blackburnI'd like to say it is ok to bias to night a little still (I do that this way ;)13:12
@sonney2kPlease do not forget about your weekly reports and send them on time. These are really important to track progress not only for your mentors.13:13
@sonney2kblackburn, yes sure13:13
@sonney2kwhatever timezone you want to live is is fine :D13:13
blackburnamount of hours you devote matters13:13
@sonney2kso samoa time or anything13:13
@sonney2kDo many small pull requests if possible instead of one big hard to review PR.13:14
@sonney2keven if it is not yet working!13:14
-!- alexlovesdata [82955843@gateway/web/freenode/ip.130.149.88.67] has joined #shogun13:14
@sonney2kargh13:14
@sonney2kdorbell13:14
cwidmerpizza time13:15
heikoI would like to add: The not-working code shouldnt be a big problem since most of the stuff is new and nothing depends on it.13:15
-!- os252 [c07c1afb@gateway/web/freenode/ip.192.124.26.251] has joined #shogun13:16
@sonney2kheiko, yes exacly13:18
@sonney2kalexlovesdata, os252 you missed one important sentence:  So mentors please listen up - starting from July 9 you will be able to submit midterm evaluations.13:19
wikingsonney2k: but mine is currently breaks some api if i rebase it to the HEAD. i.e. did some changes in some qp solvers13:19
os252sonney2k: ok, thanks for the headsup (and sorry for being late).13:20
@sonney2kso mentors, by end of july 10 I expect everyone to have the evaluations submitted13:20
alexlovesdatasonney2k: until when we have to deliver the miodterm evalutions? You said: from 9.7. on13:20
alexlovesdataaha13:20
@sonney2kit is a 10 minute effort (click through from on gsoc website)13:20
blackburnwiking: I would really like to merge it asap13:20
nicococo_ales loves data? from star strek?13:20
n4nd0alexlovesdata: July 13th is the deadline http://google-melange.appspot.com/gsoc/events/google/gsoc201213:21
@sonney2kwiking, maybe you stay a little longer after the meeting - we then figure out what has to be done13:21
wikingsonney2k: ok13:21
@sonney2kwiking, but we really really need your code merged ASAP13:21
@sonney2kFinally, if you cannot be online in #shogun or are unavailable please notify your mentor *beforehand*.13:21
@sonney2kso any further questions to that?13:22
alexlovesdataye13:23
@sonney2kAlright then as usual, please every mentor/student team - give us a status update, telling us what you did since the last meeting, whether you are behind or on schedule and what has already been merged into shogun.13:23
alexlovesdataanything which I cna read how to do the midterm evaluation ^^?13:23
@sonney2kalexlovesdata, I will send and email then13:23
n4nd0sonney2k: do the students have to prepare something for the midterm evaluation?13:23
@sonney2kwith further instructions13:23
@sonney2kblackburn, please say what you had to do last year13:23
alexlovesdatasonney2k: Thank!13:24
blackburnsonney2k: had to do with midterm?13:24
blackburnwell there was some form to fill in13:24
@sonney2kblackburn, that's it right?13:24
blackburnyeah13:25
blackburnonly one form13:25
@sonney2kalexlovesdata, same for mentors13:25
@sonney2kreally fast job13:25
heikoits was just a few click questions and some form fields with comments: number of hours, satisfied?, etc13:25
@sonney2kso back to the updates13:25
@sonney2kFrom my side - we now have some dedicated server hosting shogun-toolbox.org that does the webservice, irc bot/logging, buildbot. I13:25
@sonney2kIt is some core 2 quad 2.4GHz, with 4 G of memory and 1TB harddrive. So we can host some example data sets and lots of other stuff there. So everyone here succeeding GSoC can get a myname@shogun-toolbox.org forward to his address :D If someone has other ideas - notify me13:25
@sonney2kcomments/questions to that?13:26
n4nd0nice!13:26
@sonney2kif not gsomix - can you begin?13:26
heikonice :)13:26
@sonney2kyeah thanks to google giving us $500 / student we can rent one now :D13:26
gsomixsonney2k, ok.13:26
@sonney2k(maybe you all take the time to prepare just now)13:28
gsomixWill be brief. I have passed all exams and now I can work on my gsoc project. I and sonney2k plan to implement this director classes: "sparse features, string features, multiclass machines, preprocessors, structured output machines, converters, loss, labels". Before midterm and with examples, of course.13:28
@sonney2k(next then vojtech/uricamic)13:28
vojtechok13:28
@sonney2kthe good news is13:28
vojtechMichal implemented the BMRM algorithm of Teo et al. ( = Joachims' StructSVM) to the SO framework of Shogun.13:28
@sonney2kthat directors are really working13:29
@sonney2kvojtech, wait wait13:29
@sonney2kafter gsomix is done13:29
@sonney2kso one can currently implement ones own kernel in python13:29
@sonney2kand use it from within any SVM of shogun :D13:29
gsomixSince the last meeting we (I and sonney2k) did director machines and dot features. And polymorphic return for features.13:29
gsomixsonney2k, it seems, that's all.13:30
@sonney2k...all of it is merged13:30
@sonney2kso any comments?13:30
gsomixyep13:31
@sonney2kfrom my side only - future will be python buffer protocol13:31
@sonney2kthat stuff will enable things like X+=113:31
@sonney2kwhere X is some shogun DenseFeatures13:31
@sonney2k(inplace)13:31
@sonney2kand X*Y with Y being a numpy matrix13:32
blackburnI'd like to have [] -> CList, CSet and CDynArray typemaps13:32
@sonney2kblackburn, file a bug report and assign gsomix :D13:32
blackburnI actually tried that and failed :(13:32
@sonney2k(though it doesn't make sense for list/set - but lets discuss that later)13:32
@sonney2kvojtech, your turn13:32
gsomixI also remember that n4nd0 wanted to use some director stuff.13:33
n4nd0yeah, for the StructuredModel13:33
@sonney2kyeah notify us when you want to be able to overload some specific functions...13:33
vojtechok, can I start?13:33
@sonney2k(after that n4nd0/nico)13:33
@sonney2kvojtech, yes please13:34
vojtechMichal implemented the BMRM algorithm of Teo et al. ( = Joachims' StructSVM) to the SO framework of Shogun.13:34
vojtechAs the core QP solver the BMRM solver uses my LIBQP which was also imported to Shogun.13:34
vojtechMichal wrote C example which uses the BMRM for learning linear multi-class SVM.13:34
vojtechHe crosschecked the Shogun implementation with out many-times-verified Matlab code.13:34
vojtechThe code is submitted to Shogun.13:34
vojtechThe next plan is to implement the i) Bundle method and ii) use it for one real-life problem.13:34
vojtechMy suggestion is to select one of the standard SO benchmarks which appear in 90% of SO papers.13:35
@sonney2kvojtech, any particular one?13:35
vojtechYes, there are approximately 4 standard benchmarks13:35
vojtechtexline OCR and problems from NLP13:36
vojtechlile name entity recognition13:36
@sonney2kok13:36
vojtechHaving such benchmark in shogun would increase its value of the scientific community a ,ot13:36
vojtecha lot13:36
blackburnsounds like advertisement :)13:36
vojtechi.e. not just the base-line algorithms but also ready to use benchmark sets13:37
vojtechthis is what everyone who publishes on SO needs to do anyway13:37
vojtechwhy not to do it once and carrefuly13:37
alexlovesdataI can offer kernels from Pascal VOC2009 and ImageCLEF2010, ImageCLEF2011 for MKL testing13:37
alexlovesdataPlosone paper is published13:37
@sonney2kvojtech, will there be time to do the libqp extensions once the speeded up BMRM is done?13:37
vojtechnot in one month13:38
@sonney2kvojtech, we intend to release shogun 2.0 September 1st13:38
@sonney2kso > 2 months :D13:39
vojtechif I find someone who will program it then I'm not against :)13:39
@sonney2kanyway vojtech, uricamic - thanks for your work13:39
@sonney2kvojtech, can uricamic do it?13:39
vojtechtheoretically yes13:40
@sonney2kbut?13:40
vojtechIf he has time13:40
@sonney2kok13:40
vojtechI cannot tell it now13:40
@sonney2kwell then thanks13:40
nicococo_our turn now?13:40
@sonney2kn4nd0, nicococo_ yes13:40
nicococo_a primal structured output svm with a mosek solver is implemented and tested on a simple multi-class example. now, we move on to an hidden markov so-svm. hence, we are half way now, i would guess.  in addition, we started to write down everything concerning hmsvm implementation.13:40
@sonney2k(next is wiking / alexlovesdata)13:41
alexlovesdatawiking?13:41
@sonney2kactually cool that you document these things13:41
wikingalexlovesdata: yes?13:41
nicococo_with neat pictures ;)13:41
@sonney2kso we can put them in the to-be-created-doc13:41
alexlovesdatayou like to tell?13:41
wikingalexlovesdata: they are still talking i believe...13:42
alexlovesdatanoo13:42
@sonney2kwiking, yes stay tuned13:42
alexlovesdataour turn now ;)13:42
@sonney2kalexlovesdata, wait13:42
wikingalexlovesdata: ^ sonney2k13:42
@sonney2kn4nd0, nicococo_ so you finally get the exact same solution as (what did you compare with?)13:42
n4nd0I have carried out some tests comparing with the results of SVM-struct13:43
n4nd0but just based on accuracy so far13:43
@sonney2kn4nd0, nicococo_ what else is on the roadmap - 'only' HMSVM with mosek or something else?13:43
n4nd0I know that this is not good ...13:43
cheng_nicococo_: It seems that for multiclass, we could compare with stuff that pluskid has implemented.13:43
@sonney2kcheng_, and uricamic's stuff too13:44
n4nd0but the objectives of the other problems are not the same maybe13:44
@sonney2knicococo_, why not just compute the unconstrained objective?13:44
nicococo_i think, n4and0 tried that already and without bias it was pretty much the same, right?13:44
vojtechn4nd0, it might be useful to compare the primal SO solver with the BMRM both should d othe same13:44
cheng_@sonney2k: perhaps it is worth having some multiclass benchmarks (in mldata.org?)13:45
@sonney2kI mean some function that computes objective based on the set of w's13:45
n4nd0vojtech: ok thank you, but I think sonney2k told me that the BMRM problem is unconstrained13:45
nicococo_i think, it is okay to have a bundle solver AND a mosek implementation13:45
@sonney2kvojtech, do you have a function like that already?13:45
n4nd0or that I shouldn't take into account the constraints, I am not sure right now13:45
@sonney2kn4nd0, it is easier to compare unconstrained objective13:45
n4nd0sonney2k: but I am not sure if I understand that properly13:46
n4nd0if we don't take into account the constraints, then the problem is completely different13:46
vojtechn4nd0, I think you can also solve unconstrained problems right?13:46
nicococo_sonney: we can approach another solver after hmsvm is implemented, is that okay?13:47
vojtechn4nd0, can I look at the formulation?13:47
n4nd0vojtech: sure, here http://iglesiashogun.wordpress.com/2012/06/04/second-weekly-report-gsoc-2012/13:47
@sonney2kvojtech, nicococo_, n4nd0, uricamic maybe you quickly discuss after the meeting13:47
nicococo_sure13:47
n4nd0vojtech: found it?13:47
blackburnyes please (I have to leave very very soon :D)13:47
@sonney2kso please wiking continue13:48
wikingI couldn't participate the last meeting, thus i reckon the best is to start from GSoC beginning: before the last meeting i've started13:48
wikingimplementing the framework of latent svm (both normal and structural). The P. Felzenszwalb based latent svm has been implemented to work13:48
wikingwith the given mammal dataset (finding mammals within a given picture based on HoG features). In the meanwhile (from where i've13:48
wikinggot that latent dataset) i've started to check the implementation of the structural latent svm (both by Chun-Nam and M. Pawan Kumar)13:48
wikingand the entropy based latent svm (by M. Pawan Kumar). As Fernando had to go with Mosek implementation of the structural SVM (that's13:48
wikingused by Joachim's struct SVM), i've went first with the implementation of CCCP based latent structural SVM (see Chun-Nam). While i had13:48
wikingsome troubles of testing (not having a data set that i could use to compare my results) i went on with the implementation of M3E by13:48
wikingM. Pawan Kumar that is a Renyi entropy based latent svm solver. and since i've already in the beginning proposed that my intention was13:48
vojtechn4nd0, yes I have it. But the formulation can be solved as an unconstrained problem as well13:48
wikingbasically to try to extend the way that entropy is measured, i went on and tried out Tsallis-entorpy based one and experimented13:48
wikingwith using Jensen-Shannon Divergence based measure (see paper of M. Pawan Kumar for details). Last week Chun-nam got back to me finally13:48
wikingwith a data set that he used in his paper and he could share it with me in order that i can compare with the results of mine.13:48
wikingCurrently it's nowhere near to the 'original' implementation, which i cannot understand yet13:48
wiking because it's CCCP is based on Mosek solver as well just like Fernando's.13:48
n4nd0vojtech: aham, let's talk about it later then13:48
wiking(hope it's not flooded to anybody)13:48
alexlovesdatawiking: we will talk after that meeting about that13:49
vojtechn4nd0, let's talk after the meeting13:49
wikingok so it hasn't flooded..13:49
@sonney2kwiking, so from what I see you make good progress - but you really really need to get this merged into shogun13:49
wikingsonney2k: yes talk now or after meeting about PR13:50
wiking?13:50
@sonney2kwiking, there is no way a student can pass midterm without PRs being merged13:50
@sonney2kyes13:50
wikingyes now or after?13:50
@sonney2kafter meeting yes13:50
wikingok13:50
@sonney2kwiking, so what is next on the plan?13:50
@sonney2k(except for the PR)13:51
wikingwell alexlovesdata pointed me out to go and try SO solver of vojtech/uricamic see how that works concerning accuracy13:51
@sonney2kalexlovesdata, and others - further comments?13:51
alexlovesdatawhat is PR ??? I just have presse release on my mind. Do you mean code merge?13:52
@sonney2kpull request13:52
blackburnhah pull request13:52
alexlovesdataok13:52
blackburnpress release should be nice too13:52
wikingalexlovesdata: pull request (putting code into shogun HEAD)13:52
alexlovesdataok, got that13:52
heikopress realease :D13:52
alexlovesdatasoory, I am not used to chat acronyms, guys13:52
@sonney2kso cwidmer/blackburn - want to continue?13:52
cwidmersure13:52
blackburnyeah please13:52
cwidmerbackburn made quite some progress in implementing Multitask algorithms from the SLEP toolbox, the framework is now there, so it should be easier to bring in additional algos. Also, he helped in merging some of the code for Marius, Nico and mine ECML paper into shogun, which implements a LibLinear Style solver for graph-regularized MTL. Next steps are finishing up (some) stuff from SLEP, but also try what's already been ported on real data.13:53
cwidmer 13:53
cwidmerblackburn, feel free to add things13:53
blackburnokay after some struggles I get first algo proved to be correct (assuming SLEP is correct)13:53
blackburnwhat I need to stress is now I have no foreign affairs (like bachelor thesis)13:54
blackburnso I am going to continue with good pace13:54
@sonney2kwhich reminds me - is everyone `free' now?13:54
blackburnnext after SLEP should be Ando/Zhang framework (for logit regression I think)13:54
@sonney2kas in no more exams?13:54
uricamicI am having an exam in 5 minutes, and then 2 more to come later, but still don't know when, unfortunately13:55
blackburnsonney2k: I am sorry I have to leave now - professor is waiting for me unexpectedly - I'll check logs13:55
@sonney2kuricamic, good luck then!13:55
uricamicthanks13:55
@sonney2kuricamic, and thanks for attending nevertheless...13:55
uricamicno problem13:55
cwidmerblackburn, alright, see you!13:55
@sonney2kso I assume no comments to blackburn/cwidmer13:56
blackburnso see you guys I will be online once I get to another city again13:56
@sonney2kthen heiko - your turn - tell us about your vacations in poland ;-)13:56
nicococo_nice ecml paper :)13:56
cwidmerhehehe13:56
uricamicok, I also have to go now, see you13:56
heikowell yes, I was sitting in a little house in the woods in the middle of nowhere and did quite some work :)13:56
heikoI finished all MMD based two-sample tests (Quadratic time and linear time) - these are already committed.13:56
heikoAll tests assert the results against these of the MATLAB implementation.13:57
-!- blackburn [d5578b92@gateway/web/freenode/ip.213.87.139.146] has quit [Quit: Page closed]13:57
heikoMost work since last meething went into the approximations of null-distrubutions (Eigenspectrum, Gamma moment matching, Gaussian approximation, bootstrapping)13:57
heikoFor that I added some new pdf/cdf functions for Gamma, Normal, errorfunction etc. from ALGLIB13:57
heikoThe framework works well after extending the first draft a bit here and there -- and its pretty easy to use all tests now.13:57
heikoThis was about the first half of work from my proposal so I am in time.13:57
heikoNext step are independence tests (HSIC) and kernel choice for large scale two-sample tests13:57
heiko(based on linear MMD, I will need the qp solver for that)13:57
heikoAlso, there was this idea of creating a LaTeX document on the new methods which I want to start with soon.13:57
heikoA word on SHOGUN 2.0. I would like to mention that there are many things which are not part of GSoC projects that should be finished before13:57
heiko(serialisation, testing, documentation, etc) So I think it might be a bit early.13:57
@sonney2kheiko, might be - we will have to see then. it is still > 2 months aways13:58
heikosonney2k, true, just that there are so many things. but youre right, lets see13:59
@sonney2kand last release was ages ago so we have to release at least something (alpha or so)13:59
heikoI mean13:59
heikowhen you release a 2.0 , people expect everythign to work13:59
heikothats just my point13:59
@sonney2kwell yes - it should work otherwise we cannot release14:00
@sonney2kany questions to heiko?14:00
heikoThis year, we got gsomix to do all the usability stuff :)14:00
@sonney2kif not os252/ puffin444 want to continue?14:00
puffin444sure14:00
os252sure -14:00
@sonney2kheiko, yeah.. :D14:01
puffin444The whole GP framework is implemented in shogun.14:01
cheng_puffin444: "whole" == gpml in matlab?14:01
puffin444The model selection framework has been expanded to include14:01
puffin444gradient search14:01
puffin444as in the general infrastructure supports arbitrary inference methods, likelihood models, etc.14:02
@sonney2kheiko, puffin444 btw please file bugs using the bugtracker on github whenever you notice some!14:02
heikosonney2k, yes good idea14:02
-!- ipondering [~iponderin@2001:da8:203:1823:4919:ecd1:c3d5:4242] has left #shogun []14:02
puffin444New inference methods, approx. methods, etc. are simply a matter of adding an extra class14:02
puffin444will do.14:03
puffin444The model selection part is just one memory leak bug away from a pull request.14:03
-!- ipondering [~iponderin@2001:da8:203:1823:4919:ecd1:c3d5:4242] has joined #shogun14:04
heikoI really like puffin444's extensions to the model selection framework. Its very flexible and modular :)14:04
-!- ipondering [~iponderin@2001:da8:203:1823:4919:ecd1:c3d5:4242] has left #shogun []14:04
puffin444This week I will add on/cleanup  some of the details of the framework to make sure its ready for general use.14:04
-!- ipondering [~iponderin@58.194.224.114] has joined #shogun14:05
-!- ipondering [~iponderin@58.194.224.114] has left #shogun []14:05
puffin444Add caching for GPs, add some more kernel derivatives, add some demos, etc.14:06
os252Perhaps relevant for cheng's question: after this is done, shogun will pretty much mirror the state where GPLML is for the standard regression stuff (not logistic regression and non-standard likelihoods).14:06
heikopuffin444, Id like to push the ARD thing again :)14:06
@sonney2kpuffin444, os252 so you are on schedule?14:06
@sonney2kit sounds like14:07
os252I'd say pretty much. Depending on how long this takes things may lack behind by a few days but Puffin444 really pushed this through up to this point!14:07
@sonney2kvery nice!14:08
os252heiko: ARd is merely a different kernle.14:08
puffin444I think technically the model selection should have been merged yesterday, but roughly yes.14:08
os252Agree the we should add that kernel though. Let's do this once we have the standard shogun kernels (lin,pol, gauss) ported.14:08
@sonney2kfurther comments?14:08
@sonney2kif not ... nice work!14:08
@sonney2kand  last one is cheng_/pluskid14:09
@sonney2kplease continue!14:09
pluskidcheng_: you will do it or I do?14:09
cheng_pluskid: you go.14:09
pluskidok14:09
pluskidBasically, I wrote a draft survey on multiclass learning, implemented two multiclass learning algorithms: Conditional Probability Tree and ShareBoost, ported liblbfgs (not remember correctly the date of the last meeting, so not sure any of the stuff here were already reported in the last meeting :p).14:09
pluskidbrief and no flooding :D14:09
@sonney2kpluskid, cool - the survey is something we can use for doc again14:10
@sonney2kpluskid, 25th of may so no14:10
pluskidsonney2k: yeah, I discussed with cheng_ this morning about that14:10
@sonney2kso at least MC / SO will have some doc14:10
cheng_@sonney2k: On that note, shogun badly needs a doco section about the methods.14:10
@sonney2kI fully agree14:11
pluskidbut not sure yet where in shogun do we have a good place to put PDF( or LaTeX) docs14:11
@sonney2kpluskid, well we have an extra repository shogun-doc14:11
@sonney2kand blackburn wanted to put his stuff there14:11
pluskidah, cool14:11
pluskidI'll check that14:11
@sonney2kwe should ask him to start taht now14:11
@sonney2kthat14:11
@sonney2kotherwise we will never have a doc14:11
pluskidand btw: a word for n4nd0, I think I just fixed the SWIG segfault right now14:12
n4nd0pluskid: good, what was it?14:12
@sonney2kpluskid, what was it?14:12
cheng_Aim high... http://www.cs.waikato.ac.nz/ml/weka/book.html14:12
@sonney2kI was betting on bad memory14:12
pluskidsome header file not being included14:12
pluskidsonney2k, n4nd0: we can discuss about that after the meeting, I do have some questions about SWIG14:13
@sonney2kok14:13
pluskidI wrote some in the pull request I sent just now14:13
@sonney2kany further comments?14:13
@sonney2kpluskid, what will you do next 6 weeks :D14:14
pluskidsonney2k: I had a discussion about that this morning with cheng_14:14
pluskidI suggest that I go back to complete the survey before the midterm14:14
pluskidand choose 2~3 algorithms out of those he suggested me14:14
pluskidfor the upcoming 6 weeks after mid-term14:15
@sonney2kI vote for other massively multiclass stuff14:15
pluskidbtw, sonney2k do you hate ECOC related stuff? :p14:15
@sonney2kall the other one-vs-rest is still very competitive14:15
@sonney2kno14:15
@sonney2kwhy should I?14:15
@sonney2konly MKL :D14:15
@sonney2kalright14:15
pluskidI mean you said they do not perform very well (IIRC)?14:16
@sonney2kone if there is nothing else14:16
@sonney2kMentors/Students please think about some nice, fancy graphical applications of your methods - some kind of eye candy we can use to advertise the great work you all were doing once GSoC is over that can also be used as examples.14:16
cheng_For multiclass, there is image-net.14:16
@sonney2kcheng_, the book idea is nice - but it would require someone with lots of time :D14:18
@sonney2kbut in principle we got asked a couple of times...14:18
@sonney2kand we have many mentors / students that could contribute chapters14:18
@sonney2kanyway14:18
n4nd0sonney2k: I think we can do it together if we organize it good14:18
@sonney2klets end this14:18
@sonney2kFinally when do we meet again? Is 3rd of August 11 UTC OK for everyone?14:18
cwidmerfine with me14:19
@sonney2kn4nd0, it is a 1-2 years project though14:19
os2523rd is good, yes.14:19
alexlovesdatafine with me14:19
vojtechok for me14:19
n4nd0for me too14:19
pluskidI might be on trip that day14:19
nicococo_i'm on vacation until 11th of august14:19
cheng_Ok for me14:20
puffin444yep14:20
@sonney2kheiko, ?14:20
heikoyes ok14:20
@sonney2kalright then we have one for each student /mentor combo o14:21
@sonney2kwiking, will you be there?14:21
alexlovesdatahe is eating now14:21
alexlovesdatawill be back in 2014:21
alexlovesdataI can join anyway14:21
alexlovesdataon 3rd august14:22
@sonney2kalright14:22
@sonney2kthen thanks all for attending the meeting - let the submeetings start now14:22
@sonney2k(and sorry that it was our longest one)14:22
cheng_Night guys!14:22
pluskidI'm wondering, is it 3rd Aug. or 11th Aug. ?14:22
@sonney2k3rd14:22
pluskid11 UTC14:22
os252night cheng14:22
pluskidI'm fool14:22
pluskidthen I'll be there, too14:22
@sonney2kvery good14:22
-!- cheng_ [73406f11@gateway/web/freenode/ip.115.64.111.17] has quit [Quit: Page closed]14:23
@sonney2kmaybe we should use 11th at 11 o'clock always :D14:23
nicococo_i'm there :)14:23
cwidmerok, thanks sonney2k14:23
cwidmerbye guys14:23
nicococo_bye chris14:23
n4nd0see you cwidmer14:23
-!- cwidmer [~chris@cpe-69-201-177-140.nyc.res.rr.com] has left #shogun ["Konversation terminated!"]14:24
nicococo_thx to soeren14:24
@sonney2kso vojtech / n4nd0 - isn't the unconstrained / constrained problem equivalent - I mean if you just compute unconstrained objectives f(W) for both - aren't you good?14:24
vojtechn4nd0, I looked at the formulation in http://iglesiashogun.wordpress.com/2012/06/04/second-weekly-report-gsoc-2012/ and this can be easily expressed as an unconstrained problem hence BMRM can solve it14:24
nicococo_it is equivalent, but cannot solved with qp solver , right?14:24
vojtechnicococo_, I don't understand it. You can solve both formulations using cutting planes14:25
n4nd0vojtech: is it expressing it as unsconstrained the same as using the dual formulation?14:25
vojtechn4nd0, no14:25
n4nd0I am still a beginner with optimization :S14:26
vojtechn4nd0, no problem. I can write a short draft explaining the realation14:26
nicococo_vojtech: i mean with a qp formulatation it is not solvable but bundle methods, subgradient descent do the job, right14:26
nicococo_?14:27
vojtechnicococo_, I'm not sure what you mean14:27
n4nd0vojtech: that would be great, if it doesn't take much time for you of course14:27
nicococo_vojtech: i cannot use quadprog to solve the unconstraint version14:27
vojtechn4nd0, no problem I'll do it14:27
alexlovesdataI think what you talk guys is also valuable for us14:28
vojtechnicococo_, you cannot up to toy examples14:28
alexlovesdatasince we have in mind to try the BMRM solver14:28
alexlovesdatavojtech: you means replace \xi_i = max(0, \Delta - \delta\Psi ) right?14:29
vojtechyes14:29
nicococo_so we have a cutting plane solver and a nice bmrm, i think it is a good idea to have both14:30
nicococo_and they are interchangeable (more or less)14:30
nicococo_nice for comparisons :)14:30
vojtechnicococo_, BMRM is a cutting plane solver in fact14:30
nicococo_oh yes, sorry :)14:31
vojtechn4nd0, In my view both algorithms should solve the same problems and thus they can be easily compared14:32
vojtechn4nd0, the only difference is the computational time14:33
n4nd0ok14:33
n4nd0it is a very good new that they should give the same results14:34
vojtechn4nd0, BTW: additional linear constraints on W can be also easily added to BMRM14:34
nicococo_vojtech: i have first results concering slack-rescaled hmsvm we were talking about the last meeting14:34
vojtechn4nd0, but then we will need to use Mosek QP14:34
n4nd0vojtech: aham I think those were interesting for an application nicococo_ said14:34
vojtechnicococo_, I'm eager to see them if possible14:35
vojtechn4nd0, we also use constrained BMRM when learning submodular MRF for image segmentation14:36
-!- cheng [~Adium@115-64-111-17.tpgi.com.au] has joined #shogun14:36
nicococo_vojtech: just a number on toy data.. but let me tell you that it is really disappointing :(  performance drops heavily and the OP takes much longer14:36
n4nd0nicococo_: you are talking about our method, or?14:36
n4nd0well, haha "our" :P14:37
n4nd0the method in PrimalMosekSOSVM14:37
nicococo_n4nd0: hehe.. no WE ;) do the margin rescaling.. but we recently tested slack rescaling14:37
-!- cheng [~Adium@115-64-111-17.tpgi.com.au] has left #shogun []14:38
n4nd0WE?14:38
nicococo_you and me :)14:38
n4nd0ah, ok14:38
vojtechnicococo_, what exactly did you test? I think slack-rescaling and margin rescaling are are equivalent for multi-class classification14:38
vojtechor did you consider some SO problem ?14:39
nicococo_i tested on sequences14:39
vojtechI see14:39
nicococo_any idea?14:39
vojtechhow do you evaluate slack-rescaling loss on sequences ?14:39
nicococo_you mean the argmax?14:39
vojtechthe slack-rescaling loss is not tractable, namely, loss augmented classification problem14:40
nicococo_well it is in quadratic time.. it is the work of one of our master students14:41
nicococo_but it is not an easy problem and its a pitty that there is no gain...14:42
vojtechslack-recaling requires solving argmax_y L(y,y')(1-w,psi(x,y)+w,psi(x,y')) , how can you solve it is y is a sequence?14:43
vojtechdo you solve it exactly or use a kind of approximation?14:44
nicococo_its still a dynamic program14:44
nicococo_we have both14:44
vojtechwhat kind of loss do you use ?14:44
nicococo_i was talking about exact inference14:44
nicococo_we compared to brute force method14:45
nicococo_0-1 hamming loss14:45
vojtechdoes brute force mean trying all Y^n sequences ?14:46
vojtechI don't see how this can be solved by DP14:46
nicococo_yes :) well, at some point you have to compare if the implementation works14:46
nicococo_as soon as the student finishs the master thesis i can send it to you14:47
vojtechok, I'm looking forward14:47
nicococo_(may take some more month :) )14:47
vojtechlast question, you really mean the slack-rescaling loss: max_y L(y,y')(1+<w,psi(x,y')-psi(x,y)>)  where y is from Y^N ?14:48
vojtechand L(y,y') Hamming distance14:49
nicococo_yes, i really mean that.. the loss is no longer decompasable as in margin rescaling14:49
vojtechok, very good14:49
nicococo_no it isn't, thats the prob :)14:50
nicococo_i thought slack rescaling would be superior, but the results show the opposite14:51
vojtechthis is also interesting negative results14:52
vojtechok, I need to go.14:52
vojtechn4nd0, I'll send you the draft14:52
nicococo_ok, ciao14:52
vojtechCU14:52
n4nd0vojtech: thank you, bye!14:52
-!- vojtech [9320543b@gateway/web/freenode/ip.147.32.84.59] has quit [Quit: Page closed]14:53
nicococo_n4nd0: in the first pdf i sent around, all so formulation are unconstraint14:53
nicococo_n4nd0: did you had a look at the new doc i sent you yesterday?14:54
n4nd0do you mena in this one https://dl.dropbox.com/u/11020840/shogun/so.pdf?14:54
n4nd0nicococo_: yeah sure, I have been thinking of the design for the hmsvm14:55
n4nd0nicococo_: I have a couple of questions about it, as usual :)14:55
nicococo_n4nd0: cool :) .. (and yes so.pdf e.g. Eqn.1 is unconstraint..  if you disregard the general ax<=b  aso)14:58
n4nd0nicococo_: ok I see14:58
n4nd0nicococo_: what I don't have so clear is what kind of solver one needs to use there since the argument of minimize (w) is affected by the loss function in the sum term14:58
nicococo_yes, you can't use anymore mosek if you want to solve it like that14:59
n4nd0I guess that the solver uricamic has used solves that15:00
nicococo_correct ;) it is an advanced solver that is likely to need less iterations than ours..15:01
n4nd0but the results, the solution for w, doesn't need to be the same right?15:01
n4nd0or is there some kind of equivalence in the problem representation?15:01
nicococo_theoretically yes, in practice one would not optimize ad infinitum15:02
n4nd0does theoretically yes mean yes into our problem?15:02
n4nd0I mean I solve what we currently have15:02
n4nd0minimize_w,xi 0.5 w'*C*w + sum xi_i15:03
n4nd0s.t. dPsi_i(y) >= Delta(y_i, y) - xi_i for all i and y in Y \ y_i15:03
nicococo_n4nd0: practically they are not exactly same but within an epsilon region (user can set this eps)15:03
n4nd0where is the epsilon in these formulations?15:04
nicococo_so if your objective is 2845 there might be 2844.9915:04
n4nd0ok, I could try to do that15:05
n4nd0interesting15:05
n4nd0in any case, let's talk about hmsvm that is what we are concerned about now15:05
n4nd0ok?15:05
nicococo_yes, but is good to have both algorithm15:05
nicococo_okay15:05
n4nd0so one thing I found a bit new from what I expected is in the data representation15:06
n4nd0I have noted that each *feature* is a sequence itself15:06
n4nd0not each training example15:06
n4nd0I mean a training example, an x_i15:06
nicococo_a single training example is a matrix now15:07
n4nd0can be formed of several features, e.g. 10 features is the number they use in the hmsvm toolbox15:07
n4nd0ok, I understand15:07
n4nd0I am not quite sure how this is going to affect the use of a CFeatures shogun type15:08
n4nd0I think that we shouldn't use a CDotFeatures for this then15:08
n4nd0do you know what I mean?15:08
nicococo_you have free hands on that15:09
n4nd0I think I should do something new that inherits from CFeatures for that15:10
nicococo_of course one could reshape matrices into vector form15:10
nicococo_but that would be a hack (to reshpae)15:10
n4nd0yeah ... but still, it won't be a good idea to use something like DotFeatures or DenseFeatures for that, after reshaping15:10
n4nd0just because of the semantics of the operations15:11
n4nd0we would have something like get_feature_vector or the like15:11
n4nd0that would return something that it is not a feature vector actually15:11
n4nd0do you understand what I mean?15:11
nicococo_i understand its not a good idea, so any solution yet?15:12
n4nd0yes, to create a new type :)15:13
n4nd0but before I do that, I'd like to know what operations do we want to do with this type15:13
n4nd0as I understand right now, we would need something like creating a combined feature vector right?15:14
nicococo_perfect, do we talk about Cstructureddata again :)15:14
-!- puffin444 [62e3926e@gateway/web/freenode/ip.98.227.146.110] has quit [Quit: Page closed]15:14
n4nd0mmm not exactly15:14
n4nd0this won't be a CStructuredData but a sub-type of CFeatures15:15
nicococo_something like a block-feature15:15
n4nd0what do you mean with that?15:15
nicococo_i guess, it is the same as your combined feature vector15:16
n4nd0I don't think so15:16
n4nd0because the combined feature vector is a "well-defined" vector15:16
n4nd0but we have just said that each training example is a matrix right?15:17
nicococo_go on15:18
n4nd0ok...15:18
n4nd0so what do we need to do with the features (I am talking about the x)?15:18
n4nd0just to compute joint features from them?15:19
nicococo_i don't understand: x is a matrix and the joint feature vectors are computed in CStructuredModel given x15:20
n4nd0ok, let's see15:20
n4nd0x (each of the training examples) is a matrix15:20
n4nd0ok?15:20
nicococo_check15:20
n4nd0I need to have all the training examples in a data type15:21
n4nd0something that inherits from CFeatures15:21
n4nd0ok?15:21
nicococo_ok15:21
n4nd0let's call it, mmm .... CHMSVMFeatures for example15:21
n4nd0let's define the operations we need to do with CHMSVMFeatures15:22
nicococo_ok15:22
n4nd0I just see one operation15:22
n4nd0take one feature in CHMSVMFeatures and on label (also a sequence) an create a Psi15:22
nicococo_stop15:23
nicococo_do you mean something like a psi=get_jfv_from(example id)  in CHMSVMFeatures15:24
nicococo_?15:24
n4nd0I am not thinking yet where it should be15:25
n4nd0I am just thinking what do we want to do with them15:25
nicococo_but what we want to do is decoupled from the CHMSVMFeature, so the above function should be in CStructModel15:26
nicococo_i only see a  matrix=get_example(int i)  for CHMSVMfeatures15:26
n4nd0yes15:26
n4nd0my point was that at the current level of asking what do we want to do with CHMSVMFeatures it is not relevant where the code for the operation is, that should come later I think15:27
n4nd0anyway15:27
n4nd0I think we are both thinking of the same so it is ok15:27
n4nd0just note that probably, in order to be able to support coffin, this is something that should probably change15:27
n4nd0but I don't think we are concerned with that yet15:28
n4nd0are we ok so far?15:29
nicococo_okay, we could still use coffin afterwards.. yes, we are ok15:29
n4nd0there is something that I don't know what role plays in all of this15:30
n4nd0that is the state15:31
n4nd0as I undestand it15:31
n4nd0a state is an element of the label sequence15:31
nicococo_yes.. if the label sequence is 0 1 2 3 1 2 3 the numbers correspond to the state15:32
n4nd0BUT 0 is an state, 1 another, 2 another15:32
n4nd0and so on15:32
n4nd0right?15:32
nicococo_yes15:32
n4nd0ok15:32
n4nd0then there is no need to have an object itself for each state15:33
n4nd0?15:33
nicococo_no, i don't think thats necessary15:33
n4nd0all right15:34
nicococo_but... mmmhh15:34
n4nd0tell me15:34
nicococo_i mean for our example it would be overkill..15:34
nicococo_no, its okay.. we don't use classes for each state15:35
n4nd0ok15:35
n4nd0so for the moment I don't know exactly how the argmax should work15:36
n4nd0I have read about the Viterbi algorithm but not especifically for this application15:37
nicococo_i will write that in the dcoument.. i also have a c-code viterbi15:37
n4nd0ok15:37
n4nd0I was planning to look into the hmsvm toolbox15:37
nicococo_hopefully by tomorrow afternoon i will sent it to you15:37
n4nd0but I think that would be even greater15:37
n4nd0sure, no problem15:37
n4nd0I can start sketching the classes15:38
n4nd0and after that working out the psi comptuation15:38
nicococo_you can also start to think/implement a toy example generator15:38
n4nd0I think I have not more doubts ...15:38
n4nd0would the simulate_data in hmsvm toolbox be enough for that?15:38
n4nd0I have read it this morning, it is quite straightforward in my opinion15:39
nicococo_yep, totally :)15:39
nicococo_it could be even simplier.15:39
n4nd0I think it is simple enough ;)15:39
n4nd0there is a thing that kind of bugs me though ...15:40
nicococo_..and i will have a look for real data.15:40
nicococo_tell me15:40
n4nd0right now I have a better idea of the hmsvm than I had a couple of weeks ago15:40
n4nd0when I told you that I thought it was just to implement a psi function, an argmax and a loss15:40
n4nd0you answered that it was much more than that15:40
n4nd0but still, currently I see no more than that :)15:41
nicococo_well, the hmsvm toolbox has more than 3 files, right ;)15:41
nicococo_but we agreed to have another setting15:41
n4nd0yes... but that's kind of ambiguous15:42
n4nd0I meant the the thing of the 3 files15:42
nicococo_which is easier to implement and thx to coffin (later) we have something powerfull15:42
n4nd0there are also other things that are already done, like the optimization algo15:42
nicococo_still, if you have a look a the state model directory there are 7 files or so.. and this is only the state model15:43
n4nd0mmm15:43
n4nd0so we still don't use that or?15:43
nicococo_we start simple.. but i already have some nice additions in mind :)15:44
n4nd0cool, I like the idea15:45
n4nd0then let me do some work today and let's talk tomorrow again?15:45
nicococo_okay, so, i guess i will have to write a really nice midterm evaluation ;)15:46
n4nd0:)15:46
n4nd0when is it good for you to meet tomorrow?15:46
nicococo_see you tomorrwo and bye  ..15:46
n4nd0is 16h ok?15:46
nicococo_ok15:46
n4nd0cool15:47
-!- nicococo_ [5e8b1a4f@gateway/web/freenode/ip.94.139.26.79] has quit [Quit: Page closed]15:47
n4nd0tty tomorrow then15:47
n4nd0thanks for the help!15:47
n4nd0sonney2k: around?15:49
@sonney2kn4nd0, back16:14
@sonney2kwiking, alexlovesdata are you back?16:14
wikingsonney2k: me yes16:14
wikingalexlovesdata: is going to eat16:15
@sonney2kwiking, so what hinders the merge?16:15
wikingso i had 2 branches16:15
wikingbranch a) was started before any gsoc project16:15
wikingthat never got rebased, and then i hadn't rebased for a long time16:16
wikingand e.g. labels, machines had been changed16:16
wikingso now when i've tried rebasing it breaks apart16:16
@sonney2ksure16:16
@sonney2kok and now?16:16
wikingand with branch b) i have a cherrypicked SO branch of fernando16:17
wikingplus that 'broken' a)16:17
@sonney2kwiking, which files did you touch?16:17
wikingi mean it's forked from a) applied some of fernando's so development16:17
@sonney2kI understand16:17
@sonney2kso which files did you add / modify?16:18
wikingso i've touched some minors in example.. then the whole label system and svmocas and machine as well16:18
wikingso now i need to rebase this stuff16:18
wikingsomehow16:18
wikingi can merge by hand16:18
wikingi've started to do that16:19
@sonney2kif it really is that far away now - you probably have no other option than merge everything by hand (either checkout HEAD and cherry pick patches and merge or copy stuff over manually)16:19
@sonney2kfor example using meld16:19
wikingmeld?16:19
@sonney2kmeld16:19
wikingjust a sec16:19
wikingit's like a visual merger?16:19
@sonney2knice program to compare two dirs16:19
@sonney2kyes16:19
wikingah ok16:19
@sonney2kvisual diff16:19
@sonney2kvery convenient for big changes16:20
wikingok16:20
wikinglemme install16:20
n4nd0sonney2k: I don't know if you read something from my conversation with Nico; anyway, the case is that for the hmsvm I need to use a special kind of features since each training example is a matrix itself (each of the features are sequences of integers), that's all right for me, I thought of doing a new CHMSVMFeatures (or so) that inherits from CFeatures. However, I wonder if there's something already in shogun for this purpose since I believe tha16:20
@sonney2kwiking, in any case - this really is the top priority for you now16:20
wikingOMFG (starts with installing perl...)16:20
wikingaparently i didn't have perl16:20
@sonney2kwiking, get the merge done this week16:20
n4nd0sonney2k: sorry for the big message, I didn't want to interfere with your conver with wiking16:20
wikingsonney2k: ok!16:20
@sonney2kwiking, we really cannot let you pass w/o this being in shogun main/head/master!16:21
wikingsonney2k: thursday midnight,ok16:21
wiking?16:21
wikingjust to set something in stone16:21
@sonney2ksure, the earlier the better16:21
wikingi'll try my best16:21
wikingbut i want to say that i can arrive to that moment for sure16:21
wikingon thursday midnight16:21
@sonney2kwiking, then do it16:21
wikingok16:21
wikingsonney2k: if there's something that u want to talk about with alexlovesdata and me then we'll have a meeting around 19:3016:22
@sonney2kwiking, that really is my main concern16:24
@sonney2kwiking, so basically only you16:24
wikingsonney2k: ok, i'm just saying16:24
@sonney2kwiking, one suggestion16:24
@sonney2kmerge small pieces16:24
@sonney2kif you can do PR's for each of them16:24
wikingsonney2k: ok... i'll try by concept16:24
wikingbut maybe it'll be by file...16:24
@sonney2kso if you did extensions to stuff that is already there, merge these first16:25
@sonney2kand PR16:25
@sonney2kand btw it seems like thursday is the euro 2012 game germany vs italy16:26
@sonney2kso I will be awake :D16:26
@sonney2kwiking, n4nd0 - regarding n4nd0 Q above - that seems a bit like image features ...16:29
n4nd0interesting match ... I won't say who I am supporting :D16:29
@sonney2kn4nd0, one thing that would work is use StringFeatures16:29
@sonney2kn4nd0, spain I guess :D16:30
n4nd0yeah, but I meant in Germany vs Italy ;)16:30
@sonney2kn4nd0, you don't want italy to be in the final with spain don't you?16:30
n4nd0sonney2k: but I think that the sequences are of the same length so maybe StringFeatures are not really the case16:31
n4nd0sonney2k: I have not yet decided if I want Italy or Germany16:31
n4nd0sonney2k: Germany is pretty strong this eurocup, although it was in the last one and in the worlcup ...16:31
n4nd0but first, let's see what happens against Portugal :O16:32
@sonney2kn4nd0, it was always before meeting spain :D16:32
@sonney2kand italy for that matter16:32
@sonney2kn4nd0, well the germans did beat portugal16:32
@sonney2kso it shouldn't be too difficult16:32
CIA-18shogun: Chiyuan Zhang master * rd3bb757 / (2 files): fix SO modular compile segfault. - http://git.io/nQoqIQ16:33
CIA-18shogun: Soeren Sonnenburg master * r7c20b8c / (2 files): Merge pull request #602 from pluskid/fix-swig-segfault - http://git.io/JTH3kw16:33
n4nd0sonney2k: so is it ok for you if I do this CHMSVMFeatures or do you think it is unnecessary?16:35
n4nd0I'd rather do them since I think that to think of them as StringFeatures might lead to confussion16:35
@sonney2kn4nd0, then rather do CMatrixFeatures16:36
n4nd0good idea :)16:36
@sonney2kn4nd0, you should check if you can derive from DenseFeatures for that16:37
@sonney2khmmhh maybe not16:37
@sonney2kwell yes16:37
@sonney2kyou can16:37
@sonney2kif matrices are all of same shape16:37
@sonney2kthen you derive from DenseFeatures and add num_rows / num_cols16:38
n4nd0mmm I was thinking of having an SGNDArray instead of an SGMatrix16:38
n4nd0for the example I have seen in the hmsvm toolbox, all the matrices were of the same shape16:39
n4nd0I don't know if that is always the case though, I should ask Nico about that16:39
shogun-buildbotbuild #1115 of libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/libshogun/builds/111516:39
@sonney2kn4nd0, well or you copy everything from DenseFeatures and just replace SGMatrix with SGNDArray16:39
@sonney2kshogun-buildbot, finally!16:39
shogun-buildbotWhat you say!16:39
@sonney2kand SGVector with SGMatirx16:39
n4nd0all right, thank you16:45
n4nd0I have to go now, bye16:46
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has quit [Quit: leaving]16:46
-!- pluskid [~pluskid@202.130.113.141] has quit [Quit: Leaving]17:09
-!- os252 [c07c1afb@gateway/web/freenode/ip.192.124.26.251] has quit [Quit: Page closed]17:25
-!- uricamic [~uricamic@2001:718:2:1634:3d67:c999:8cc9:d056] has quit [Quit: Leaving.]17:32
-!- blackburn [~blackburn@31.28.43.76] has joined #shogun18:05
@sonney2kthe black burn blackburn is back18:50
blackburnsonney2k: yeah back19:00
blackburnsonney2k: enjoying my new ssd powered book19:00
heikoah, the joys of ssd :)19:01
blackburnfull reboot - 20s19:01
-!- alexlovesdata [82955843@gateway/web/freenode/ip.130.149.88.67] has quit [Ping timeout: 245 seconds]19:01
heikoyeh same here :)19:01
blackburnhowever time to remove shindows19:01
heikoI didnt even install it on my new computer :;)19:02
blackburnwas installed already19:02
heikooh, cant you buy without?19:02
blackburnI can return money after I buy it19:03
blackburnbut it is just 18$ and takes 6 or 7 days19:03
heikooh, well then :)19:03
blackburnI'd rather just remove it19:03
blackburnhuh i5 is a warm guy19:04
heikowhat?19:04
blackburnI have intel core i5 here19:04
heikosame here19:04
blackburnin 13.3" pretty small notebook19:04
blackburnmakes my legs warm :D19:04
heikooh19:04
heikommh well depends on electronics in there19:05
heikomy thinkpad rather gets warm in programming use19:05
heikobut does get *really* warm when I start 4 matlab jobs :D19:05
blackburnok time to choose linux distribution!19:05
heikooh, thats a pain, there are so many :)19:05
heikoI currently use Ubuntu because its so easy to install19:06
heikobut regulary have problems with it since they change things all the time19:06
blackburnI tend to ubuntu too heh19:06
@sonney2kblackburn, heiko I need some feedback - what should the new buildbot do?19:06
heikowell its nice and robust, some minor problems but these are not too bad19:06
@sonney2kslave that is19:06
blackburnsonney2k: popcorn, cocacolar19:06
blackburn:D19:06
blackburncocacola*19:06
@sonney2koptions are: we have 2 buildslaves19:06
heikowhat? :)19:06
@sonney2kboth doing the same thing19:06
@sonney2kor alternatively one is building on debian - unstable all the time19:07
@sonney2kthe other on stable19:07
blackburnlatter19:07
@sonney2kor one is building every few hours19:07
@sonney2kand potentially updating the documentation19:07
@sonney2ksuch that we have the latest one under /doc/latest19:07
blackburnsonney2k: what is version of gnome-shell in your debian (sid?)19:07
heikosonney2k, I dont get the problem19:08
@sonney2kblackburn, 3.4.1-819:08
blackburnthanks19:08
@sonney2kheiko, we have a buildmaster to trigger stuff19:08
@sonney2kheiko, then we have a buildslave hosted at TU19:08
@sonney2k(the current one)19:09
@sonney2know we have new resources and could either just use 2 build slaves19:09
@sonney2kdoing the same thing19:09
@sonney2k(so if someone pushes a lot all the commits are quickly rebuild one by one)19:09
@sonney2kor it can do other shogun stuff19:09
heikommh19:10
heikois it that urgent that everything is rebuilt so quickly?19:11
@sonney2kI dont' think so19:11
heikoand what would be the other stuff you mentioned?19:11
@sonney2kI am also no longer sure we really need a build for each interface19:11
@sonney2kwhy not just build it once19:11
@sonney2kfor everything19:11
@sonney2kif it fails19:11
@sonney2kit fails19:12
heikolol :)19:12
@sonney2khttp://shogun-toolbox.org/buildbot/waterfall19:12
heikoyeah seems a bit weird, there are not bug differences in the interfaces, right? if one fails and the other one doesnt, its likely to be a minor mistake19:12
@sonney2kI mean this picture could be reduced to 3 columns19:12
heikooh yes that would be nice19:12
heikoI tend to not really look because its so messy19:13
heikook, then I am for that19:13
heikoreduce it to one19:13
heikouse the other computer for different stuff19:13
@sonney2kheiko, I think I will do it the following way:19:14
@sonney2k1) build libshogun (this is quick)19:14
@sonney2k2) build static interfaces (if libshogun was OK)19:14
@sonney2k3) build modular interfaces (if libshogun was OK)19:15
@sonney2kso 3 columns19:15
heikosounds good !19:15
@sonney2kheiko, yeah but this is currently only built for debian stable19:16
@sonney2kmaybe we should build it for some other architecture too19:16
heikoand you want to add mac/win?19:16
heikoyes that would be a good idea19:16
@sonney2kmac is tough to get it seems :/19:16
heikoso many people use macs nowadays, would be good if the max port would always run19:16
@sonney2kwindows -> cygwin yes19:16
blackburnf ck win19:16
heikoand windows also, my old professor in germany only had windows machines19:17
blackburnI have no idea how to use cygwin19:17
heikoI had to include a live debian with shogun installed for my bachelor thesis19:17
blackburnmost inconvenient shit ever19:17
heikostill widely used, blackburn19:17
heiko(Most scientists here in London have macs)19:18
@sonney2kyeah many have19:18
blackburnmacs are cool but supporting win is pain19:18
heikoactually ALL ML lecturers had macs :D19:18
@sonney2kheiko, problem really is that one can not easily get a mac as build machine19:18
heikonot that I think of it19:18
heikommh19:18
@sonney2kor if not a mac emulate one to have it19:19
heikoyeah what about that?19:19
@sonney2kand I don't like the idea of buying some mac from gsoc money just for that19:19
heikowith a VM perhaps?19:19
heikoI understand19:19
@sonney2kheiko, is not so easy19:19
heikono dont do that19:19
heikodont many people have that problem? I mean many software developers?19:20
@sonney2kthat new server is just 26 EUR/month19:20
blackburnbetter buy pro with retina for yourself19:20
-!- alexlovesdata_ [82955843@gateway/web/freenode/ip.130.149.88.67] has joined #shogun19:20
heikowhat about renting a mac server?19:20
blackburnyou deserved it :)19:20
@sonney2kblackburn, you know *I* don't get the money right?19:20
heikoi dont know if thats possible19:20
blackburnsonney2k: who will?19:20
@sonney2kI put it on some extra bank account - 'shogun toolbox foundation'19:21
@sonney2kno idea though how to turn us into some official non profit organization19:21
@sonney2kso the money is sitting there and is used only for the benefit of shogun19:21
blackburnwell I am pretty sure you may do what you want19:22
blackburnwhy?19:22
@sonney2khardware, servers, and maybe for a meeting19:22
heikomeeting would be cool :)19:22
@sonney2kit is not a lot though right19:22
@sonney2k$ 500 / student19:22
heiko I dont need money to get to Berlin, or to stay there.19:22
@sonney2kand I have no idea what german tax will do with it19:22
@sonney2kcan very well be that they just halve the money as they consider it income19:23
@sonney2k(my income)19:23
blackburnI have one month to come with some paper for ICPRAM @ Barcelona19:23
heikoPerhaps we should find out how to register shogun as non-profit orga to avoid this?19:23
@sonney2kI am actually a bit afraid of that - google paid attendence for GSoC meeting last year19:23
blackburnI want to visit barcelona!19:23
blackburn:D19:23
heikosonney2k, I dont have any income currently and wouldnt have to pay taxes if that is a problem19:24
@sonney2konly because you two don't want to be mentors you cannot get invited19:24
blackburnsonney2k: send your money to some cyprus bank account :D all russians do that19:24
heikoaah19:24
@sonney2khehe19:24
@sonney2kheiko, I will do my tax declaration for last year soon19:25
heikosonney2k, dont worry, I will be mentor next year, this year was a bit hard money wise19:25
@sonney2kand if someone complaints we do it your way :D19:25
heikook :)19:25
@sonney2kthere is always an if we get in and if we survive this one :D19:25
@sonney2kno but it is actually looking good19:25
@sonney2kI was pretty pleased with the lots and lots of progress today19:26
heikoyeah for sure, if all conditions are met I mean19:26
heikoand if I dont get a heart-attack from all the stress here :D19:26
blackburnhey do you know log sum exp trick?19:26
heikosonney2k, I think its awesome whats currently happening to SHOGUN19:26
@sonney2kblackburn, you mean the one in shogun?19:27
blackburnno generally19:27
heikoblackburn, yes :) was in one of my exams last month19:27
blackburnI didn't know about that19:27
@sonney2kblackburn, CMath::log_sum ?19:27
@sonney2kmaybe I don't19:27
@sonney2kwhat is it?19:27
@sonney2k(if not the CMath:: one)19:27
blackburnsonney2k: in slep I encountered the following code19:27
heikono its to avoid numerical problems when evaluating a log of a special form19:27
blackburndouble aa = ...;19:27
blackburndouble bb = CMath::max(aa,0);19:28
@sonney2kheiko, sounds like the one in CMath19:28
heikomight be19:28
blackburnfun_x += CMath::log(CMath::exp(bb) + CMath::exp(aa-bb)) + bb19:28
blackburnI had no idea what is it19:28
heikoits used a lot in all these graphical models19:28
blackburnencountered that in logistic regression19:29
@sonney2klog( exp(a) + exp(b)) = a + log (1 + exp (b-a)) where a = max(p,q) and b min(p,q).19:29
blackburnright19:29
heikoyeah19:29
@sonney2kthat is the one I implemented (documented in Cmath)19:29
blackburncool19:29
@sonney2kback in the last century19:29
@sonney2kfor HMMs19:29
@sonney2kheiko, yes HMMs... :D19:29
heikoindeed :)19:30
@sonney2kheiko, blackburn so what other architectures do we want?19:30
@sonney2kmaybe latest ubuntu?19:30
blackburnsonney2k: archs like? mac, win?19:31
blackburnah19:31
@sonney2kand redhat?19:31
heikoso far only debian stable?19:31
@sonney2kI would say latest debian - stable19:31
@sonney2kfor sure19:31
blackburnredhat??19:31
@sonney2kno idea19:31
blackburnI'd rather choose suse19:31
heikoperhaps the most popular one19:31
heikothat would be ubuntu or mint19:31
gsomixandroid, hehe19:31
blackburnubuntu is debian19:31
blackburnwhat is different?19:31
heikotrue but sometimes they change the packet structure a bit19:31
heikoalso its debian unstable19:32
@sonney2kgsomix, btw heiko complained about some errors in CMap ...19:32
@sonney2kheiko, difference might be minor19:32
heikoI did not complain, just saw some, already corrected, will submit them soon19:32
@sonney2kwe could of course create .deb's automagically19:32
heikothat would be a great thing to have19:32
blackburnand set up a ppa19:32
heikomany people dont like compiling19:33
@sonney2kblackburn, what is a ppa?19:33
blackburnpersonal package archive19:33
blackburnubuntu stuff19:33
blackburnsonney2k: you add a ppa to your sources and it gets updated daily19:33
gsomixheiko, thanks. .___.19:33
@sonney2kblackburn, so just something one can put in apt/sources.lst19:33
@sonney2k?19:33
blackburnyes19:33
@sonney2kwell we can have daily snapshots19:34
heikothat would be a cool thing19:34
@sonney2k(only if the buildbot is happy of course)19:35
@sonney2kblackburn, which distributions are popular? is there a ranking somewhere?19:35
blackburnyes19:36
blackburndistrowatch19:36
@sonney2kI would say debian, ubuntu, ... what else?19:36
blackburnhttp://distrowatch.com/19:36
blackburnsonney2k: mint19:36
blackburnfedora, suse19:36
blackburnand probably arch19:36
heikomint is also debian based19:36
heikosuse would be rpm based so probably a good idea19:36
heikobut I think the most important thing would be mac19:37
heikoisnt there some way?19:37
blackburnwe have no mac developer19:37
blackburn:(19:37
blackburnwait19:37
blackburnwiking is19:37
blackburn:D19:37
@sonney2kwiking, yes19:37
heikooh, poor guy ;)19:37
@sonney2kisn't mint just ubuntu?19:38
blackburnsonney2k: yes but they rebased to debian IIRC19:38
blackburnbut still19:39
blackburnnothing is changed in mint19:39
blackburnit is more about codecs and other media stuff19:39
heikoI think mint is only popular because its ubuntu-new gnome shell therefore its popular19:40
heikohoops double popular19:40
heikoI read an article some time ago that many ubuntu users switched to mint since its not different but doesnt have this new side-bar thingi19:40
@sonney2kyeah so we do ubuntu, debian, fedora, suse19:40
@sonney2kmac and cygwin19:41
heikosounds good19:41
@sonney2kthat is quite a bit though19:41
@sonney2kfor each we need libshogun, static and modular interfaces19:42
@sonney2kand then I still want to see the doc19:42
@sonney2kahh maybe we do it in this nightly thing on debian stable19:42
@sonney2knightly default/ nightly_none / nightly_all19:43
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has joined #shogun19:43
@sonney2kso nightly_default would create a .deb and update the doc19:44
@sonney2kheiko, blackburn, n4nd0 btw did you ever get an email from the buildbot about failed builds?19:44
heikosonney2k, no19:44
n4nd0sonney2k: me neither19:44
blackburn??19:45
blackburnNo19:45
@sonney2khmmhh only the irc messages then right?19:45
blackburnyes19:45
@sonney2kthen I guess I still have a mistake in the config19:45
@sonney2kit is *really complex*19:45
@sonney2kI will have to investigate19:46
@sonney2kheiko, blackburn - final thing: I do no longer like our website19:46
@sonney2kI think we need something with tabs19:46
blackburnhah19:46
heikoagreed19:46
@sonney2klike documentation19:46
@sonney2kfaq19:46
heikoand not so messy :)19:47
@sonney2kcontact19:47
@sonney2kwhatever19:47
heikowhats your plan about that?19:47
heikoshould we think of a nice design?19:48
heikomake a draft?19:48
-!- gsomix [~gsomix@95.67.191.81] has quit [Remote host closed the connection]19:49
@sonney2kheiko, I would love to have some nice design from some free template19:49
@sonney2khttp://www.nuviotemplates.com/19:49
@sonney2klike these19:49
heikoyeah these look nice, you took them for your page right?19:50
@sonney2kthe first one yes19:51
@sonney2kanother one for mldata.org19:51
@sonney2kthat one is also OK: http://www.freetemplatesonline.com/templates/Free-Software-Templates-Free-Internet-Templates-2.html19:52
heikoyeah, why not, not too much difference19:52
heikoI think the main thing is structure19:53
heikoand usability19:53
@sonney2kthis one is cool http://www.nuviotemplates.com/preview.php?template=gr8-01 :)19:54
heikoyes thats a good thing with the images :)19:54
@sonney2kI really like it a lot19:55
@sonney2kblackburn, n4nd0 any comments?19:55
@sonney2kI wish pluskid was here - he is certainly deep into graphics19:56
n4nd0I think it is a good idea19:56
heikoI always like minimalistic approaches, but I also like that one19:56
@sonney2kheiko, the good news is that we have enough resources on the server to dynamically generate the content19:57
heikothats indeed good news :)19:57
@sonney2kso I can give you editing capabilities19:58
@sonney2krights I mean19:58
@sonney2kI only need to program the website :D19:58
@sonney2kdjango/python that is19:58
heikoI read about that in your blog some time ago, sounds nice19:58
heikoand its good that more than one person can update stuff19:58
n4nd0we could add tutorials like these! http://docs.opencv.org/doc/tutorials/ml/table_of_content_ml/table_of_content_ml.html20:00
heikon4nd0 hey i didnt know you worked for openCV before :)20:02
heikonice!20:02
n4nd0well "worked" haha20:02
n4nd0I have used opencv a bit and I just wrote those tutorials ;)20:03
@sonney2klots of work...20:03
@sonney2kblackburn, have you read logs about documentation?20:03
@sonney2kwhat's the state about your doc project?20:03
@sonney2kI think it is about time to create it now such that n4nd0 and pluskid can put their stuff in20:04
n4nd0sonney2k: when would you like to have the new page working? I know someone who can be interested in helping with it or something, if you like the idea of another working on it of course20:06
@sonney2kn4nd0, I don't have a schedule or anything20:07
n4nd0sonney2k: and do you like the idea of someone working on it?20:08
@sonney2kyes but depends on the person of course :)20:10
n4nd0ok ;)20:11
@sonney2kn4nd0, what can he/she do?20:12
@sonney2kI think I would just take the template and create some dummy page around it and put it somewhere20:12
n4nd0he has some experience with django20:13
n4nd0and not much to do during July :)20:13
@sonney2ksounds good20:13
n4nd0yeah I have just told him that20:13
@sonney2kn4nd0, well I have the source code for my homepage somewhere in svn or git or so20:13
@sonney2kand it should be easy to modify for that purpose20:14
n4nd0if he's interested, he'll prepare something20:14
@sonney2kn4nd0, shouldn't we discuss first?20:16
@sonney2kor what do you mean with prepare?20:16
n4nd0sonney2k: I was just thinking about changing a bit a template of the one you pasted the links of20:16
@sonney2kn4nd0, you mean to make it look shogun like?20:17
@sonney2k*ARGH*20:17
n4nd0yeah20:17
@sonney2kwe have a u'\ufeff' unicode character somewhere in the source code20:17
@sonney2kbreaking the build20:17
@sonney2khow can one search for it?!20:18
n4nd0where have you seen that?20:18
n4nd0I just see failed test in the buildbot20:18
n4nd0some failed configure too20:19
@sonney2kpython ../..//.doxy2swig.py --quiet --no-function-definition \20:19
@sonney2kmodshogun/doxygen_xml/index.xml modshogun_doxygen.i20:19
@sonney2kTraceback (most recent call last):20:19
@sonney2k  File "../..//.doxy2swig.py", line 450, in <module>20:19
@sonney2k    main()20:19
@sonney2k  File "../..//.doxy2swig.py", line 446, in main20:19
@sonney2k    convert(args[0], args[1], not options.func_def, options.quiet)20:19
@sonney2k  File "../..//.doxy2swig.py", line 426, in convert20:19
@sonney2k    p.write(output)20:19
@sonney2k  File "../..//.doxy2swig.py", line 382, in write20:19
@sonney2k    o.write("".join(self.pieces))20:19
@sonney2kUnicodeEncodeError: 'ascii' codec can't encode character u'\ufeff' in position 422884: ordinal not in range(128)20:19
@sonney2kn4nd0, I am building locally20:19
blackburnsonney2k: yeah i have read, time to start20:19
@sonney2kdoes anyone know how to create this unicode character to actually grep the file?20:20
blackburnhah no20:21
@sonney2kit is a zero space character20:22
@sonney2kso not even visible - wtf!?20:22
@sonney2kn4nd0, how long will it take your friend to come up with something?20:22
@sonney2kor in other words when do we know he is interested :D20:23
n4nd0about a week, he has told me20:25
@sonney2kok so lets say next wednesday - then I will try to get the build bots in shape first20:27
n4nd0cool20:28
@sonney2kblackburn, these build errors are on you - http://shogun-toolbox.org/buildbot/builders/cmdline_static/builds/996/steps/test_1/logs/stdio21:09
@sonney2kplease fix the examples21:09
blackburnmeaow21:30
CIA-18shogun: Sergey Lisitsyn master * r3eb7bcd / (3 files): Got examples back to work - http://git.io/UeYsyw21:38
@sonney2kthx21:51
@sonney2kheiko, you did it!21:58
@sonney2kyou inserted an invisible utf8 code21:58
@sonney2kgrep  shogun -r21:58
@sonney2kshogun/statistics/QuadraticTimeMMD.h: * Gretton, A., Borgwardt, K. M., Rasch, M. J., Sch?lkopf, B., & Smola, A. (2012).21:58
@sonney2kshogun/statistics/LinearTimeMMD.h: * Gretton, A., Borgwardt, K. M., Rasch, M. J., Sch?lkopf, B., & Smola, A. (2012).21:58
alexlovesdata_@sonney2k: LOL21:59
@sonney2kit is a zero width space21:59
@sonney2kinvisible on the console but causing errors21:59
@sonney2kgreat work!21:59
CIA-18shogun: Soeren Sonnenburg master * rb501667 / (2 files): remove zero width space causing errors - http://git.io/Uf1maQ22:00
@sonney2kso the patch looks like this :)22:01
@sonney2kdiff --git a/src/shogun/statistics/LinearTimeMMD.h b/src/shogun/statistics/LinearTimeMMD.h22:01
@sonney2kindex fe5cdb8..9714c60 10064422:01
@sonney2k--- a/src/shogun/statistics/LinearTimeMMD.h22:01
@sonney2k+++ b/src/shogun/statistics/LinearTimeMMD.h22:01
@sonney2k@@ -20,7 +20,7 @@ class CFeatures;22:01
@sonney2k 22:01
@sonney2k /** @brief This class implements the linear time Maximum Mean Statistic as22:01
@sonney2k  * described in22:01
@sonney2k- * Gretton, A., Borgwardt, K. M., Rasch, M. J., Sch?lkopf, B., & Smola, A. (2012).22:01
@sonney2k+ * Gretton, A., Borgwardt, K. M., Rasch, M. J., Schölkopf, B., & Smola, A. (2012).22:01
@sonney2k  * A Kernel Two-Sample Test. Journal of Machine Learning Research, 13, 671-721.22:01
@sonney2k  *22:01
@sonney2k  * Along with the statistic comes a method to compute a p-value based on a22:01
@sonney2kcrazy world22:01
n4nd0:D22:01
heikosonney2k, wow22:04
heikoHow did I do that?22:04
@sonney2kheiko, copy paste from some website?22:04
@sonney2ktotally impossible to detect22:04
heikobut I told eclipse to use utf822:04
heikoman22:04
heikosorry for that :(22:04
@sonney2kcause this space is 0 length22:04
heikojust saw all the stress you had with that22:04
@sonney2kso absolutely invisible22:04
@sonney2kwell use ascii encoding only22:05
heikoyeah Ill change that22:05
@sonney2kheiko, blackburn there is one example related to subsets from sparse features still failing: http://shogun-toolbox.org/buildbot/builders/cmdline_static/builds/997/steps/test_1/logs/stdio22:06
heikolol, oh guys, sorry again, but somehow funny these errors ;)22:07
@sonney2kthen libshogun is back to normal22:07
alexlovesdata_invisible utf8 having zero length ... this should enter a blog!22:07
@sonney2kyeah lots of fun22:07
heikoblackburn, its a segfault? Any idea?22:08
alexlovesdata_once you solved it is is fun :|22:08
heikohappens when the transpose is checked, did you change anything there?22:08
heikoI didnt22:08
blackburnyeah but let me fix it later22:09
blackburnwe changed a lot22:09
blackburnI changed22:09
-!- blackburn [~blackburn@31.28.43.76] has quit [Ping timeout: 240 seconds]22:36
CIA-18shogun: Heiko Strathmann master * r8023b21 / (5 files in 2 dirs): -fixed a problem where combinations of a model selection parameter tree - http://git.io/IdKm7w22:59
CIA-18shogun: Heiko Strathmann master * re53fe46 / src/shogun/lib/Set.h : corrected a wrongly named field - http://git.io/Fdy-Eg22:59
CIA-18shogun: Heiko Strathmann master * r062bc5f / (6 files in 3 dirs): Merge pull request #604 from karlnapf/master - http://git.io/MsyCeA22:59
-!- heiko [~heiko@host86-180-159-222.range86-180.btcentralplus.com] has quit [Ping timeout: 264 seconds]23:11
-!- alexlovesdata_ [82955843@gateway/web/freenode/ip.130.149.88.67] has left #shogun []23:33
--- Log closed Wed Jun 27 00:00:17 2012

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!