IRC logs of #shogun for Wednesday, 2012-07-25

--- Log opened Wed Jul 25 00:00:05 2012
--- Day changed Wed Jul 25 2012
yoodense, string, any ..00:00
blackburnwell in case of dense00:00
blackburnfeatures->get_feature_matrix().display_matrix("feature_matrix");00:00
yooallright00:00
yoothanks00:00
yooI have my own function then for printing string features00:00
blackburnstring is a little more complex - you iterate from 0 to features->get_num_vectors() and get and print strings inside00:01
yooyes I have that00:01
yoojust wanna to understand to way iterator works but I loosing my french in that00:01
yooby the way .. can you explain me the purpose of CMulticlassMultipleOutput ?00:03
blackburnyoo: heh00:03
blackburnyes00:03
blackburnto support top k outputs00:03
blackburni.e. if you have 50 classes and you want to store top 5 predictions00:04
yooallright00:04
yooI am suffering of the lack of c++ example towards to python modular ^^00:04
blackburnyoo: feel free to contribute ;)00:04
blackburnyoo: it is much easier to use shogun from python00:05
yoosure I did a little  bit with mkl and cross valid example :p00:05
yooblackburn: yes but lots of little modification have to be made on c++00:05
blackburnI am open for good ideas00:06
yooblackburn: for example in crossvalid and multiclass: cannot get the average confusion matrix after many crossvalid runs ..00:06
yooI tried to add this but thats not trivial to consider multiclasslabels for base crossvalidation object00:07
yoosee what I mean ?00:07
blackburnyeah00:07
yoosorry its late my english is going down ..00:07
blackburnisn't it native for you?00:07
yoono00:08
blackburnI thought it is :)00:08
yooI would like to ass more evaluation for multiclass00:08
yoo-ss +dd :p00:08
blackburnyeah we can ass some00:08
yoo=)00:09
blackburnas for confusion matrix00:09
yooconfusion matrix after Xvalidation and EER for intra class could be fun )?00:09
blackburnI think one way is to extend it using msoutput00:09
blackburnwhat is EER?00:09
yooequal error rate00:09
-!- blackburn [~blackburn@109.226.92.17] has left #shogun []00:10
yoofor each class in multiclass evaluation00:10
-!- blackburn [~blackburn@109.226.92.17] has joined #shogun00:10
blackburnoops00:10
blackburnyoo: how to compute it?00:11
-!- needsch175 [~user@ip-176-198-229-75.unitymediagroup.de] has quit [Ping timeout: 245 seconds]00:11
yoothe same way you compute ROC curve00:13
blackburnso ROC one vs rest?00:13
yooyep00:13
blackburnI wanted to add that too00:14
yoo=)00:14
yoonice00:14
yooI ll be back tommorow to discuss this if you want some help00:14
yoomsoutput should be the right way00:15
blackburnit is pretty easy actually00:15
blackburnI think00:15
blackburnI'll do that a little later00:15
blackburnahhh00:15
yooI will follow this to better understand shougunlib00:15
blackburnone problem is here though00:15
blackburnlet me check00:15
yoobtw I never succeed in passing msoutput in evaluate function without strange outputs ...00:16
yooand seg fault but maybe I mentioned it already before00:16
blackburndo you have that example still?00:16
yoowhich one ?00:16
blackburnsegfaulting one00:16
yooah00:17
yoolet me check00:17
yooI just use this one http://pastebin.com/c7wKje0H00:18
yooand add msoutput object in evaluate00:18
yoothink to change the inputs00:18
blackburnyoo: hmm it works here00:22
blackburnahh00:22
blackburnokay my bad probably00:27
blackburnyoo: will commit a fix in a few mins00:29
yoo)00:29
yoogood night then, see you tomorrow00:29
blackburnyoo: what is you are applying shogun for?00:30
yoomachine learning =)00:30
blackburnheh00:30
blackburnokay good night00:30
yooschool project in action recognition00:30
yooapply to face expression mostly00:30
blackburnschool like high school?00:30
blackburn:)00:31
yooyes I am 13 y old00:31
blackburnno way00:31
yoocoded my first neural nets at 1100:31
yoo=)00:31
yoosee ya, good night00:31
blackburnhard to believe but you would become youngest shogun user ever :D00:32
yoojust joking00:32
yoo+00:32
blackburnexactly00:32
-!- yoo [575b08cb@gateway/web/freenode/ip.87.91.8.203] has quit [Quit: Page closed]00:32
wikingblackburn: :DDDD00:34
CIA-18shogun: Sergey Lisitsyn master * r8e7d14c / src/shogun/modelselection/ModelSelectionOutput.cpp : Added support of other than linear machines in modelselectionoutput - http://git.io/Wjbm7A00:40
-!- blackburn [~blackburn@109.226.92.17] has quit [Quit: Leaving.]00:41
-!- romi_ [~mizobe@189-18-41-111.dsl.telesp.net.br] has quit [Quit: Leaving]01:15
-!- alexlovesdata [~binder@e178022176.adsl.alicedsl.de] has left #shogun []01:47
shogun-buildbotbuild #33 of nightly_none is complete: Failure [failed compile]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_none/builds/3303:02
shogun-buildbotbuild #39 of nightly_default is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_default/builds/3903:46
shogun-buildbotbuild #29 of nightly_all is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_all/builds/2904:17
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has joined #shogun07:00
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has quit [Quit: leaving]08:35
-!- uricamic [~uricamic@2001:718:2:1634:3de0:9a42:a489:6401] has joined #shogun08:46
-!- pluskid [~pluskid@li411-226.members.linode.com] has joined #shogun09:06
-!- uricamic1 [~uricamic@cmpgw-27.felk.cvut.cz] has joined #shogun09:36
-!- uricamic [~uricamic@2001:718:2:1634:3de0:9a42:a489:6401] has quit [Quit: Leaving.]09:36
-!- uricamic1 [~uricamic@cmpgw-27.felk.cvut.cz] has quit [Quit: Leaving.]10:01
-!- uricamic [~uricamic@2001:718:2:1634:3de0:9a42:a489:6401] has joined #shogun10:04
-!- needsch [~user@ip-176-198-229-75.unitymediagroup.de] has joined #shogun10:34
-!- bern4rd [53368e31@gateway/web/freenode/ip.83.54.142.49] has joined #shogun10:46
-!- bern4rd [53368e31@gateway/web/freenode/ip.83.54.142.49] has quit [Quit: Page closed]11:16
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has joined #shogun11:18
n4nd0someone available to help me out?11:28
koen-shogunthe question would be... with what?11:29
n4nd0koen-shogun: no idea about why this seg fault happens http://pastebin.com/t6vPxi9T11:31
pluskidn4nd0: it might be caused by some memory error, wild pointers or anything terrible... maybe run with valgrind might give some hint?11:35
n4nd0pluskid: it doesn't seg fault with valgrind11:36
n4nd0pluskid: do you think that reading valgrind's trace can give me a clue about it in any case?11:36
pluskiddoes valgrind report any memory leak or something?11:36
pluskidif valgrind says some pointers are used before initialized, or some memory are written out of bound, etc. it might be the cause of the problem11:37
n4nd0I have some Conditional jump or move depends on uninitialised value(s) and Invalid write of size ...11:38
n4nd0I am going to investigate11:38
pluskidn4nd0: good luck then, I'll be right back (for supper :))11:38
n4nd0pluskid: thank you! I don't have the habit to use valgrind to check seg faults, but to look for memory leaks11:39
-!- needsch [~user@ip-176-198-229-75.unitymediagroup.de] has quit [Ping timeout: 250 seconds]11:51
n4nd0pluskid: problem detected and solved :)11:54
droopycool :^)11:54
n4nd0a couple of errors doing arithmetic with indices11:54
n4nd0pluskid: thank you again!11:54
pluskidn4nd0: cool!11:55
koen-shogunwhat you can do to find uninitialized memory: during compilation define -DMALLOC_PERTURB_=6911:59
koen-shogunthis will initialize all memory allocated using malloc with 69, instead of being uninitialized12:00
koen-shoguncan shake out some memory bugs quite easily12:00
n4nd0koen-shogun: thank you for that12:07
n4nd0this one was a problem related to writing out of bounds though12:07
n4nd0I will be back later, bye!12:08
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has quit [Read error: Operation timed out]12:12
wikingblackburn https://github.com/shogun-toolbox/shogun/commit/8e7d14c92c4be9e6eea5170847861e8acf539b97#commitcomment-162691812:45
wikingoh you are not here12:45
-!- gsomix [~gsomix@188.168.128.107] has joined #shogun13:34
gsomixgood day13:34
gsomixsonney2k, around?13:34
wikingheiko ?13:48
wiking!seen heiko13:48
droopyheiko (heiko@dhcp-184-16.internal.eduroam.ucl.ac.uk) was last seen parting #shogun 18 hours, 9 minutes ago stating "{}".13:48
wikingmmm13:48
wikingthnx droopy13:48
droopykk13:49
-!- yoo [575b08cb@gateway/web/freenode/ip.87.91.8.203] has joined #shogun14:09
yoohi all14:09
droopyhiho14:09
gsomixdroopy, mimimi.14:10
droopygsomix: http://www.beer-club.info/beer-brands/german-beer-brands.html14:10
gsomixcool!14:11
-!- needsch [~user@ip-176-198-229-75.unitymediagroup.de] has joined #shogun15:29
-!- gsomix [~gsomix@188.168.128.107] has quit [Read error: Operation timed out]15:33
-!- bern4rd [53368e31@gateway/web/freenode/ip.83.54.142.49] has joined #shogun15:41
-!- heiko1 [~heiko@host86-183-73-3.range86-183.btcentralplus.com] has joined #shogun15:54
-!- yoo [575b08cb@gateway/web/freenode/ip.87.91.8.203] has quit [Quit: Page closed]16:06
-!- pluskid [~pluskid@li411-226.members.linode.com] has quit [Quit: Leaving]16:40
-!- uricamic [~uricamic@2001:718:2:1634:3de0:9a42:a489:6401] has quit [Quit: Leaving.]16:41
CIA-18shogun: Heiko Strathmann master * rd8d1158 / (16 files in 3 dirs): changed class structure a bit to avoid redundancy and allowing easier - http://git.io/hI6vgg17:00
CIA-18shogun: Heiko Strathmann master * rfac0f66 / examples/undocumented/python_modular/statistics_quadratic_time_mmd.py : comment changes - http://git.io/jirHuQ17:00
CIA-18shogun: Heiko Strathmann master * rf3b1c98 / (17 files in 4 dirs): Merge pull request #674 from karlnapf/master - http://git.io/Cy9D0Q17:00
CIA-18shogun: Heiko Strathmann master * rfa25275 / examples/undocumented/python_modular/statistics_hsic.py : initial commit - http://git.io/3P-1Aw17:08
CIA-18shogun: Heiko Strathmann master * ra88feed / examples/undocumented/python_modular/statistics_hsic.py : Merge pull request #675 from karlnapf/master - http://git.io/Zp9clw17:08
-!- bern4rd [53368e31@gateway/web/freenode/ip.83.54.142.49] has quit [Quit: Page closed]17:13
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has joined #shogun17:34
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has quit [Client Quit]17:34
-!- blackburn [~blackburn@109.226.92.17] has joined #shogun17:44
-!- tiger_eye [~tiger_eye@rrcs-24-106-116-254.central.biz.rr.com] has joined #shogun17:55
CIA-18shogun: Heiko Strathmann master * rb427525 / (2 files): added inverse gamma cdf - http://git.io/bgzYeg17:56
CIA-18shogun: Heiko Strathmann master * r8f57540 / examples/undocumented/libshogun/statistics.cpp : added test for inverse gamma cdf - http://git.io/GO5_QA17:56
CIA-18shogun: Heiko Strathmann master * radc555a / (4 files): added threshold computation in a better way - http://git.io/TeMaFg17:56
CIA-18shogun: Heiko Strathmann master * r0f8b2a9 / (7 files in 3 dirs): Merge pull request #677 from karlnapf/master - http://git.io/ycTGkQ17:56
-!- heiko1 [~heiko@host86-183-73-3.range86-183.btcentralplus.com] has left #shogun []17:58
-!- yoo [575b08cb@gateway/web/freenode/ip.87.91.8.203] has joined #shogun18:03
-!- yoo [575b08cb@gateway/web/freenode/ip.87.91.8.203] has quit [Ping timeout: 245 seconds]18:10
CIA-18shogun: Heiko Strathmann master * r6ef226b / (2 files): renamed inverse_normal_distribution to inverse_normal_cdf - http://git.io/T-D-9A18:21
CIA-18shogun: Heiko Strathmann master * ra32c81b / src/shogun/statistics/HSIC.cpp : added comments - http://git.io/8GKh_g18:21
CIA-18shogun: Heiko Strathmann master * r83f385e / src/shogun/statistics/LinearTimeMMD.cpp : minor checks and enabling threshold computations - http://git.io/bSHV-A18:21
CIA-18shogun: Heiko Strathmann master * r5b3d566 / (4 files in 2 dirs): Merge pull request #678 from karlnapf/master - http://git.io/4oExmw18:21
blackburnwiking: ping18:42
blackburnI just compared asm outputs of eigen3, loop and blas18:50
blackburntotally crazy18:50
blackburneigen3 one in particular18:50
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Ping timeout: 255 seconds]18:53
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun18:53
shogun-buildbotbuild #179 of deb2 - static_interfaces is complete: Failure [failed test octave_static]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb2%20-%20static_interfaces/builds/179  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>19:38
wikingvl19:52
wikingblackburn: resutl19:52
wiking?19:52
blackburnwiking: I compared on vectors of length 1 000 00019:53
blackburncomputed average or 20000 runs19:53
blackburnblas takes 2251 clock in average here19:53
blackburnbasic loop 223419:54
blackburneigen takes 193419:54
blackburnI run it a few times and results are similar so I expect eigen is really faster20:00
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has joined #shogun20:41
n4nd0I found this article interesting: http://www.cccblog.org/2012/07/20/first-graphlab-workshop-on-large-scale-machine-learning/20:49
CIA-18shogun: Sergey Lisitsyn master * r086ee0a / (3 files in 2 dirs): Added custom evaluations support for model selection output - http://git.io/JAS3QA21:08
shogun-buildbotbuild #180 of deb2 - static_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb2%20-%20static_interfaces/builds/18021:16
-!- needsch [~user@ip-176-198-229-75.unitymediagroup.de] has quit [Ping timeout: 244 seconds]21:58
-!- needsch175 [~user@ip-176-198-229-75.unitymediagroup.de] has joined #shogun22:00
-!- heiko [~heiko@host86-174-151-17.range86-174.btcentralplus.com] has joined #shogun22:01
-!- heiko [~heiko@host86-174-151-17.range86-174.btcentralplus.com] has left #shogun []22:01
-!- zxtx [~zv@cpe-75-83-151-252.socal.res.rr.com] has quit [Ping timeout: 264 seconds]22:32
wikingblackburn: why wouldn't it throw23:00
wikingit throws :)23:00
blackburnwiking: well at least it works ;)23:01
@sonney2kblackburn, did you run your blas benchmark on optimized blas?23:01
blackburnsonney2k: atlas23:01
@sonney2kor just the crap that gets installed?23:01
@sonney2kwell atlas selfcompiled?23:02
blackburnsonney2k: installed atlas23:02
@sonney2kor the standard atlas23:02
@sonney2kok then23:02
@sonney2kthen it is the same as basic loop23:02
blackburnsonney2k: let me share code23:02
@sonney2kyou need to compile blas23:02
@sonney2kyes let me try this23:02
blackburnfurthermore may be you will fix something in test that can be unfair23:03
@sonney2kwhat did you compute btw?23:03
blackburnsonney2k: dot23:03
blackburnhttps://gist.github.com/317866423:03
blackburnsonney2k: first one is to power up my cpu :D :D23:05
blackburnwe have no step back actually - I already told eigen team we use they stuff :D23:10
blackburn#define EIGEN_YES_I_KNOW_SPARSE_MODULE_IS_NOT_STABLE_YET23:14
blackburnlol23:14
@sonney2kblackburn, arg I recently updated atlas and don't will have to compile it again...23:19
@sonney2kthat can take ages23:19
@sonney2kblackburn, current output23:19
@sonney2k elapsed 2973.500000 clocks23:19
@sonney2kblas elapsed 3006.500000 clocks23:19
@sonney2kloop elapsed 3031.500000 clocks23:19
@sonney2keigen elapsed 3006.000000 clocks23:19
blackburnwell pretty same23:19
blackburnthey all are23:19
@sonney2kyeah no difference23:20
@sonney2kI think dot is not the best op23:20
blackburnsonney2k: I measured it because we heavy rely on it23:20
@sonney2ksth like matrix matrix mul or vector woudl be better23:20
@sonney2kblackburn, but measuring time diff with clock() is also not so good23:20
blackburnmatrix matrix is rare here in shogun23:20
blackburnsonney2k: gettimeofday?23:20
@sonney2ktrue23:21
blackburnI failed to recall the best way23:21
@sonney2kyes23:21
@sonney2kahh I totally forgot about renameing Ctime functions23:21
blackburnsonney2k: after we add -I/usr/include/eigen3 I have a lot of warnings23:22
blackburnany idea why they haven't been there before?23:22
-!- n4nd0 [~nando@h121n3-ksg-a11.ias.bredband.telia.com] has quit [Quit: leaving]23:47
--- Log closed Thu Jul 26 00:00:17 2012

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!