IRC logs of #shogun for Tuesday, 2012-07-24

--- Log opened Tue Jul 24 00:00:17 2012
gsomixgood night guys00:07
gsomixshogun-buildbot, good work!00:07
shogun-buildbotWhat you say!00:07
-!- gsomix [~gsomix@95.67.188.241] has quit [Ping timeout: 260 seconds]00:12
shogun-buildbotbuild #203 of deb3 - modular_interfaces is complete: Failure [failed compile ruby_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/203  blamelist: Evgeniy Andreev <gsomix@gmail.com>, Soeren Sonnenburg <sonne@debian.org>00:20
CIA-18shogun: Sergey Lisitsyn master * ree6b9c2 / src/shogun/lib/malsar/malsar_clustered.cpp : A few fixes for malsar clustered multitask solver - http://git.io/kzyX_w00:23
-!- heiko1 [~heiko@host86-177-114-238.range86-177.btcentralplus.com] has joined #shogun00:29
shogun-buildbotbuild #204 of deb3 - modular_interfaces is complete: Failure [failed compile ruby_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/204  blamelist: Sergey Lisitsyn <lisitsyn.s.o@gmail.com>00:31
-!- needsch [~user@ip-176-198-229-75.unitymediagroup.de] has quit [Ping timeout: 255 seconds]00:47
emreceliktenGood night all00:57
-!- heiko1 [~heiko@host86-177-114-238.range86-177.btcentralplus.com] has quit [Quit: Leaving.]01:00
-!- emrecelikten [~emre@212.253.72.103] has quit [Ping timeout: 240 seconds]01:02
-!- blackburn [~blackburn@109.226.92.17] has quit [Quit: Leaving.]01:27
wikingsonney2k: eeeey!!!01:38
wikingsonney2k: just realised why submodule will be really bad for unit testing01:38
wikingsonney2k: it's gonna be way too complicated to keep the unit testing in synch with shogun itself01:39
wikingsonney2k: say you want change some classes in shogun, you push it01:39
wikingthen you have to push separately in the submodule01:39
wikingsince if you not, and most of the developers won't as they will not be able to put in 1 PR the new code + the unit tests for it01:40
wikingthe unit testing will keep on failing...01:40
wikingthis my 2 cents ;P01:45
-!- ckwidmer [8ca3fe9d@gateway/web/freenode/ip.140.163.254.157] has quit [Ping timeout: 245 seconds]02:32
shogun-buildbotbuild #32 of nightly_none is complete: Failure [failed compile]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_none/builds/3203:01
shogun-buildbotbuild #38 of nightly_default is complete: Failure [failed compile]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_default/builds/3803:04
shogun-buildbotbuild #28 of nightly_all is complete: Failure [failed compile]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_all/builds/2803:08
-!- romi_ [~mizobe@189-18-41-111.dsl.telesp.net.br] has joined #shogun03:45
-!- romi_ [~mizobe@189-18-41-111.dsl.telesp.net.br] has quit [Ping timeout: 264 seconds]04:07
-!- romi_ [~mizobe@189-18-41-111.dsl.telesp.net.br] has joined #shogun04:07
-!- Cheng [80fa500f@gateway/web/freenode/ip.128.250.80.15] has joined #shogun05:36
-!- Cheng [80fa500f@gateway/web/freenode/ip.128.250.80.15] has quit [Client Quit]05:40
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has joined #shogun06:20
n4nd0wiking: around?06:21
-!- gsomix [~gsomix@95.67.188.241] has joined #shogun07:26
-!- uricamic [~uricamic@2001:718:2:1634:4c95:e117:3805:c6f] has joined #shogun07:30
-!- gsomix [~gsomix@95.67.188.241] has quit [Client Quit]07:31
-!- gsomix [~gsomix@95.67.188.241] has joined #shogun07:31
-!- romi_ [~mizobe@189-18-41-111.dsl.telesp.net.br] has quit [Quit: Leaving]07:50
-!- pluskid [~pluskid@1.204.108.138] has joined #shogun08:24
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has quit [Ping timeout: 245 seconds]08:39
-!- gsomix [~gsomix@95.67.188.241] has quit [Remote host closed the connection]09:12
-!- pluskid [~pluskid@1.204.108.138] has quit [Ping timeout: 248 seconds]09:23
-!- pluskid [~pluskid@li314-49.members.linode.com] has joined #shogun09:24
-!- pluskid [~pluskid@li314-49.members.linode.com] has quit [Ping timeout: 264 seconds]10:12
-!- pluskid [~pluskid@1.204.108.138] has joined #shogun10:32
-!- heiko [~heiko@host86-181-80-246.range86-181.btcentralplus.com] has joined #shogun11:29
-!- needsch [~user@ip-176-198-229-75.unitymediagroup.de] has joined #shogun11:42
-!- blackburn [~blackburn@109.226.92.17] has joined #shogun11:45
-!- pluskid [~pluskid@1.204.108.138] has quit [Ping timeout: 252 seconds]11:49
-!- pluskid [~pluskid@202.130.113.141] has joined #shogun11:49
-!- zxtx [~zv@cpe-75-83-151-252.socal.res.rr.com] has joined #shogun12:12
-!- needsch175 [~user@ip-176-198-229-75.unitymediagroup.de] has joined #shogun12:25
-!- needsch [~user@ip-176-198-229-75.unitymediagroup.de] has quit [Ping timeout: 255 seconds]12:26
-!- heiko [~heiko@host86-181-80-246.range86-181.btcentralplus.com] has quit [Quit: Leaving.]12:28
wikingn4nd0 yes12:42
wikingblackburn: ping?12:55
blackburnpong12:55
wikingblackburn: would u consider using this lib: http://code.entropywave.com/orc/12:56
blackburnwhat for?12:56
wikingblackburn: well behind SGVector12:57
wikingand SGMatrix12:57
blackburnwell we have eigen3 for that I think12:57
wikingblackburn: mmm that's not replacement :)12:57
blackburnwiking: I don't understand what is it then :)12:58
wikingblackburn: fuckshit i'm wrong12:58
blackburnso if we optimize inner loops with SIMD12:58
wikingi mean half12:59
wikingwrong12:59
blackburneigen3 does the same via any available SSE12:59
wikingso orc is runtime optimizer12:59
blackburnrun-time? oh12:59
wikingblackburn: does eigen do it runtime? afaik it's compile time no?12:59
blackburnwell12:59
blackburnfor variable size arrays it does splitting to 128 bits long parts13:00
wikingmmm that makes me wonder13:07
wikingwhere's the -DHAVE_EIGEN3 flag13:07
wikingwhen i compile :S13:07
blackburnwiking: was it detected on configure?13:08
-!- uricamic1 [~uricamic@2001:718:2:1634:b07b:e85b:8940:fa6f] has joined #shogun13:08
wikingblackburn: fuck it's not detected13:08
wikingblackburn: i'll fix the configure script :P13:08
blackburnwiking: config script is ok I think13:08
wikingblackburn: one flag is missing :S13:09
blackburnwhich one?13:09
wiking-I13:09
wikinginclude flag ismissing there13:09
blackburnhmm13:09
blackburnokay13:09
wikingblackburn: btw why dont u detect it via13:09
wikingpkg-config ?13:09
-!- uricamic [~uricamic@2001:718:2:1634:4c95:e117:3805:c6f] has quit [Ping timeout: 245 seconds]13:10
wikingblackburn: as eigen3 supplies pkg-config files13:10
blackburnwell it is something common to do that this way in our configure13:10
blackburnI don't know13:10
wikingblackburn: configure script checks for pkg-config13:10
wikingindeed13:11
wiking 522     die "pkg-config not detected (required)"13:11
wikingblackburn: mmm13:17
wikingblackburn: where do u include eigen3 apart from Math.h?13:19
blackburnwiking: only in math13:19
blackburnit should be included only once to support preprocessor directives13:19
wikingok13:19
wikingblackburn: eigen headers should be included only by Eigen/...13:20
wikingblackburn: i've just checked the docs13:20
wikingof eigne13:20
blackburnyeah I think so too13:20
blackburn:)13:20
wikingok13:20
wikingdone13:20
wikingit works now13:20
blackburnwell probably there is a need to add proper include13:21
-!- pluskid [~pluskid@202.130.113.141] has quit [Ping timeout: 264 seconds]13:23
wikingblackburn: https://github.com/shogun-toolbox/shogun/pull/67013:26
blackburncool13:26
CIA-18shogun: Viktor Gal master * ref423ad / (src/configure src/shogun/mathematics/Math.h): Use the supplied pkg-config script to detect eigen3 - http://git.io/AlBqlg13:27
CIA-18shogun: Sergey Lisitsyn master * re37e6fe / (src/configure src/shogun/mathematics/Math.h): Merge pull request #670 from vigsterkr/master - http://git.io/1w1INQ13:27
blackburnI like it more13:27
blackburnthan the other way13:27
wikingthis way it's detected on my system as well13:27
-!- blackburn [~blackburn@109.226.92.17] has quit [Quit: Leaving.]13:29
-!- heiko [~heiko@host86-181-80-246.range86-181.btcentralplus.com] has joined #shogun13:35
shogun-buildbotbuild #205 of deb3 - modular_interfaces is complete: Failure [failed compile ruby_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/205  blamelist: Viktor Gal <viktor.gal@maeth.com>13:37
-!- heiko [~heiko@host86-181-80-246.range86-181.btcentralplus.com] has left #shogun []13:37
wikingdoh13:40
wiking:D13:40
wikingblackburn!!!13:41
-!- pluskid [~pluskid@1.204.108.138] has joined #shogun13:43
shogun-buildbotbuild #206 of deb3 - modular_interfaces is complete: Failure [failed compile ruby_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/206  blamelist: Sergey Lisitsyn <lisitsyn.s.o@gmail.com>13:48
-!- gsomix [~gsomix@188.168.4.255] has joined #shogun14:36
gsomixgood day14:46
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has joined #shogun15:27
n4nd0wiking: I wanted to comment something about the PR for the testing unit15:28
n4nd0wiking: but let me first to read the last comments in the PR15:28
wikingn4nd0: just a sec i'm on skype15:29
wikingi'll be back in 1015:29
n4nd0ok15:29
n4nd0ok, heiko and you have already been talking about my concern15:31
n4nd0I think the best option is to use another branch, as you suggested in the PR15:32
wikingn4nd0: ok sorry i was awway15:43
wikingbut now back15:44
wikingyeah just put there your opinion as well about submodule vs having it in the main repo15:44
wikingn4nd0: i have a question related to PrimalMosekSVM15:45
wikingi'll dig it out now just a sec15:45
n4nd0wiking: ok15:45
n4nd0wiking: I am updating that class right now by the way15:45
wikingn4nd0: ok let me know how15:45
wikingmy concern is about argmax in StruturalModel15:46
n4nd0there was something that is required for the HMSVM but was not regarded at the beginning15:46
n4nd0ok, tell me about it first15:46
wikingis that the function for you that finds \hat{y} for you?15:46
wikingif i'm not clear what i'm talking about here. just a sec to dig out the equation15:47
n4nd0yes, it is15:47
n4nd0you can think of it too as the function you use to make predictions (the common apply we have in other machines)15:48
n4nd0CLinearStructuredOutputMachine::apply_structured is simply calling this argmax15:49
wikingn4nd0: but when you do the learning15:50
wikingi mean training15:50
wikingit's called as well afaik15:50
n4nd0yes15:50
n4nd0since it is a cutting plane algorithm15:51
wikingyep15:51
wikingcool15:51
wikingthen we'll only need to do a new EnumType for strutural learners :P15:51
n4nd0yeah why not15:52
wikingi'll need it in LatentSOSVM15:53
wikingso that user can choose between solvers15:53
n4nd0aham15:53
n4nd0the LatentSOSVM inherits from?15:54
wikingi thought first about relying on user to supply the so solver15:54
wikingbut then i thought that it's going to be too complicated.. and just go with simply setting the solver type15:54
wikingand i'll do internally everything for the 2 different solvers15:54
wikingit's inherited from LinearLatentMachine15:54
wikingso has nothing to do in a way with StructuredOutputMachine15:55
n4nd0ok15:55
wikingit'll just contain a CLinearStructuredOutputMachine15:55
wikingbut that's going to created runtime15:55
n4nd0aham, no instantiation of it in the constructor you mean?15:56
wikingyes15:56
wikingindeed15:56
wikingit'll be created in the train_machine function15:56
n4nd0ok15:56
-!- pluskid [~pluskid@1.204.108.138] has quit [Quit: Leaving]16:39
-!- yoo [2eda6d52@gateway/web/freenode/ip.46.218.109.82] has joined #shogun16:45
yoohi all16:45
n4nd0hi yo16:50
n4nd0yoo, sorry :)16:51
yoo=)17:00
-!- puffin444 [62e3926e@gateway/web/freenode/ip.98.227.146.110] has joined #shogun17:22
-!- uricamic1 [~uricamic@2001:718:2:1634:b07b:e85b:8940:fa6f] has quit [Quit: Leaving.]17:32
-!- heiko [~heiko@dhcp-184-16.internal.eduroam.ucl.ac.uk] has joined #shogun17:40
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has quit [Read error: Operation timed out]17:46
-!- yoo [2eda6d52@gateway/web/freenode/ip.46.218.109.82] has quit [Quit: Page closed]17:55
-!- blackburn [~blackburn@109.226.92.17] has joined #shogun18:05
blackburnwiking: I am now having a lot of shadow warnings18:37
CIA-18shogun: Evgeniy Andreev master * r8879634 / (3 files in 3 dirs): fixed compilation error - http://git.io/sKVEfw18:45
CIA-18shogun: Sergey Lisitsyn master * rdf82997 / (3 files in 3 dirs): Merge pull request #671 from gsomix/buffer_protocol - http://git.io/o_RPDg18:45
CIA-18shogun: Heiko Strathmann master * rc908469 / (src/shogun/lib/SGMatrix.cpp src/shogun/lib/SGMatrix.h): added new helper method to get an allocated matrix - http://git.io/wPTOHg18:56
CIA-18shogun: Heiko Strathmann master * ra3cbd47 / (4 files in 2 dirs): make data generator use new matrix allocation method - http://git.io/Y9RgMw18:56
CIA-18shogun: Heiko Strathmann master * r497cd01 / (6 files in 3 dirs): Merge pull request #672 from karlnapf/master - http://git.io/QlhGtw18:56
-!- Netsplit *.net <-> *.split quits: shogun-buildbot19:00
-!- Netsplit over, joins: shogun-buildbot19:02
shogun-buildbotbuild #207 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/207  blamelist: Evgeniy Andreev <gsomix@gmail.com>19:16
CIA-18shogun: Evgeniy Andreev master * rd0a0875 / examples/undocumented/python_modular/features_dense_buffer_protocol_modular.py : fixed example for old version numpy - http://git.io/BBBsGw19:26
CIA-18shogun: Sergey Lisitsyn master * r9458ec7 / examples/undocumented/python_modular/features_dense_buffer_protocol_modular.py : Merge pull request #673 from gsomix/buffer_protocol - http://git.io/fW0cuA19:26
-!- alexlovesdata [~binder@gwlan56.first.fraunhofer.de] has joined #shogun19:33
-!- heiko [~heiko@dhcp-184-16.internal.eduroam.ucl.ac.uk] has left #shogun []19:38
shogun-buildbotbuild #208 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/208  blamelist: Sergey Lisitsyn <lisitsyn.s.o@gmail.com>19:45
-!- romi_ [~mizobe@189-18-41-111.dsl.telesp.net.br] has joined #shogun19:48
shogun-buildbotbuild #209 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/209  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>20:21
wikingblackburn: what should we do with the header?20:41
blackburnwiking: which header?20:41
blackburnargh I think I need eigen3 include to some other file20:41
wikingblackburn: eigen320:42
wikingas sonney2k told that it's not good that it's included in Math.h20:42
blackburnit is being included in every file20:43
blackburnwiking: but where did he say it?20:44
wikingblackburn: https://github.com/shogun-toolbox/shogun/pull/670#issuecomment-720464020:49
blackburnooh yeah and actually he is right20:51
shogun-buildbotbuild #210 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/21020:51
blackburnwiking: I am now confused where to put it in20:53
wikingblackburn: :)20:54
wikingblackburn: solve it :)20:54
blackburnwiking: well straightforward solution is to put it into math/eigen.h20:55
blackburnbut it may be a little silly20:55
blackburnwhoops20:55
-!- alexlovesdata [~binder@gwlan56.first.fraunhofer.de] has left #shogun []20:59
CIA-18shogun: Sergey Lisitsyn master * r50f8b64 / src/shogun/converter/LocallyLinearEmbedding.cpp : Made LLE thread-safe - http://git.io/PSCCsw21:04
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has joined #shogun21:44
-!- test [cf60c47a@gateway/web/freenode/ip.207.96.196.122] has joined #shogun22:09
-!- gsomix [~gsomix@188.168.4.255] has quit [Ping timeout: 240 seconds]22:09
-!- test [cf60c47a@gateway/web/freenode/ip.207.96.196.122] has left #shogun []22:10
-!- puffin444 [62e3926e@gateway/web/freenode/ip.98.227.146.110] has quit [Ping timeout: 245 seconds]22:19
-!- gsomix [~gsomix@37.61.181.111] has joined #shogun22:21
-!- alexlovesdata [~binder@e178022176.adsl.alicedsl.de] has joined #shogun22:22
n4nd0good night guys22:47
n4nd0tomorrow I'll be testing the hm-svm22:47
n4nd0and I need a new day to face all the errors that are to come :D22:47
CIA-18shogun: Sergey Lisitsyn master * r629ccb8 / (6 files in 3 dirs): Get eigen3 out of math.h - http://git.io/aHk2kw22:48
blackburnn4nd0: night!22:48
blackburnn4nd0: didn't you test it before?22:49
blackburnit could become a nightmare I have been in a weeks already - comparing outputs step by step :)22:49
n4nd0blackburn: I did some tests yet ... but the specification was wrong22:49
n4nd0there were some errors + things missing in the theory22:50
blackburnI see22:51
-!- gsomix [~gsomix@37.61.181.111] has quit [Ping timeout: 276 seconds]22:52
n4nd0I had to introduce changes on top of the SO framework22:53
n4nd0not just in the hm-svm part22:53
n4nd0I am going to call it the so patch 1.0 :)22:53
n4nd0well not really on top to tell the truth, in the so-svm22:54
n4nd0anyhow, good night!22:57
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has quit [Quit: leaving]22:57
wikingblackburn: yooouuuu motherfucker :)23:31
wikinghttp://git.io/aHk2kw :>23:31
wikingyou went with eigen3.h23:31
wiking!!23:31
blackburnwiking: why not?23:31
wiking:D23:31
wikingwell it's putting the shit on another shelf23:31
wikingbut yeah i couldn't solve it better23:31
wikingi'm just pulling your leg23:31
wiking:P23:31
blackburnheh23:32
wikingthere you go23:32
wikingblackburn: http://media.photobucket.com/image/brute+force+/bjkhawkeye/BruteForce.jpg23:32
blackburnwell  actually I don't think it is so brute23:32
* wiking runs away in shame :S23:34
wikingi mean it's just that it was said that 'no lapack and such in .h'23:34
blackburnwhat's the other way?23:35
wikingstraight into .cpp23:35
wikingno?23:35
blackburnto each cpp?23:36
wikingwell yep23:37
wikingif we strictly speaking about this 'no lapack and such ifdefs'23:37
wikingthen yeah23:37
wikingeach time u use it somewhere23:37
wikinginclude it23:37
blackburnproblem is that in case of some cross-dependency or so23:38
blackburnand custom options23:38
wikingyep23:38
blackburnit won't work23:38
wikingi see that of course23:38
blackburnI am now trying to test blas vs loops vs eigen323:38
blackburnon dot23:39
wikingfor the order of the ifdefs ? ;)23:39
wikingbut yeah23:39
wikinggreat idea23:39
blackburnyeah23:39
blackburnactually I do a standalone example23:39
blackburnwiking: I am confused how to link with blas :D23:39
wikingjsut take into the consideration23:39
wikingcaching23:39
wikingsince it's really fucking killer23:39
wikingwhen i did some benchmarking about vectors ;)23:40
wikingthe cache in the cpu is really fucking good actually ;P23:40
blackburnyeah I noticed that when element-by-element kernel matrix computation was 2 times faster than jumps from one side of diagonal to the other one23:41
-!- yoo [575b08cb@gateway/web/freenode/ip.87.91.8.203] has joined #shogun23:54
yoogood evening all23:54
blackburnhey23:54
yoocould someone give me plz a small example for iterate over CFeatures or print CFeatures.23:55
yooI have seen get_next_feature and get_feature_iterator but ..23:56
yoo(c++)23:56
yooI try something like :23:57
yoovoid *iterator; float64_t val; int32_t j;             wdfeats->get_feature_iterator(j);             while (wdfeats->get_next_feature(j, val, iterator)){                std::cout << val << std::endl;             }             wdfeats->free_feature_iterator(iterator);23:58
yooouch sorry for that23:58
yoomore like that : http://pastebin.com/uYMQr8TW23:58
blackburnyoo: well iterators are pretty crappy way here23:59
blackburnthey are here just for some compatibility23:59
blackburnwhat exactly do you need?23:59
yooyes thats why I ask :p23:59
yoojust iterate and print features23:59
blackburndense?23:59
--- Log closed Wed Jul 25 00:00:05 2012

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!