IRC logs of #shogun for Thursday, 2012-07-05

--- Log opened Thu Jul 05 00:00:17 2012
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Remote host closed the connection]00:02
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun00:02
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Remote host closed the connection]00:11
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun00:12
shogun-buildbotbuild #9 of nightly_none started, including []00:14
shogun-buildbotbuild #9 of nightly_none is complete: Exception [exception interrupted]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_none/builds/900:14
shogun-buildbotbuild #10 of nightly_none started, including []00:16
gsomixsonney2k, I see00:18
gsomixgood night guys00:18
n4nd0good night gsomix00:23
-!- gsomix [~gsomix@109.169.225.254] has quit [Ping timeout: 246 seconds]00:26
shogun-buildbotbuild #10 of nightly_none is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_none/builds/1000:28
shogun-buildbotbuild #65 of deb3 - modular_interfaces started, including []00:28
shogun-buildbotbuild #65 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/6500:57
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has quit [Quit: leaving]01:30
alexlovesdataI am the last active here :)02:02
shogun-buildbotbuild #13 of nightly_default started, including []03:00
shogun-buildbotbuild #13 of nightly_default is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_default/builds/1303:40
shogun-buildbotbuild #8 of nightly_all started, including []03:40
-!- alexlovesdata [55b20f06@gateway/web/freenode/ip.85.178.15.6] has quit [Quit: Page closed]03:59
shogun-buildbotbuild #8 of nightly_all is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_all/builds/804:06
shogun-buildbotbuild #11 of nightly_none started, including []04:06
shogun-buildbotbuild #11 of nightly_none is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/nightly_none/builds/1104:11
-!- uricamic [~uricamic@89.13.broadband14.iol.cz] has joined #shogun08:09
-!- gsomix [~gsomix@109.169.246.7] has joined #shogun08:19
-!- gsomix [~gsomix@109.169.246.7] has quit [Client Quit]08:23
-!- uricamic [~uricamic@89.13.broadband14.iol.cz] has quit [Read error: Operation timed out]08:57
-!- gsomix [~gsomix@109.169.246.7] has joined #shogun10:00
gsomixgood morning10:00
-!- uricamic [~uricamic@89.13.broadband14.iol.cz] has joined #shogun10:09
gsomixsonney2k, ok, you are right. documentation for python is not good.10:27
gsomixheaders are better :)10:38
-!- blackburn [~blackburn@81.28.187.0] has joined #shogun10:50
@sonney2kgsomix, heh11:11
@sonney2kgsomix, btw I hope we didn't have a misunderstanding yesterday - matplotlib is not essential for shogun11:12
@sonney2kgsomix, however numpy is11:12
@sonney2kand numpy supports python311:12
gsomixsonney2k, but is essential for users I think11:13
@sonney2kif they need gfx output yes11:14
gsomixsonney2k, it's strange that there are not references to new buffer protocol in python2.7 docs.11:18
gsomixexcept new C API functions. like GetBuffer()11:20
-!- blackburn [~blackburn@81.28.187.0] has quit [Quit: Leaving.]11:25
-!- blackburn [~blackburn@81.28.187.0] has joined #shogun12:07
@sonney2kgsomix, yeah it is not well documented12:13
@sonney2kgsomix, however I know that numpy implements it and also in python 3 the arrays12:13
gsomixsonney2k, I just downloaded their code.12:30
-!- nietpiet [52ad81c6@gateway/web/freenode/ip.82.173.129.198] has joined #shogun12:39
nietpietI'm sorry to bother anyone, but i tried to send my MKL issue to the mailing list, but my subscription email bounced, and thus i cannot post there.12:42
blackburnnietpiet: bounced? why?12:44
blackburnnietpiet: is you Jan? if so we have received your mail12:45
nietpietAh!12:45
nietpietSorry to be so impatient :)12:45
blackburnheh no problem12:46
nietpietI sent it last night and got a delayed till 4 days mail :)12:46
blackburnnietpiet: okay one question before - did you try latest shogun?12:46
nietpietyes.. downloaded it for the first time on tuesday12:46
nietpiet(it is very nice!)12:46
blackburnnietpiet: I actually can't remember whether we fixed something about MKL after 1.1.0 but it is worth to try12:49
nietpietTrue. I can make the kernel and labels of my post available for reproducability of course.12:49
nietpietBut maybe i should just step away from the keyboard and patiently wait till the message hits the email list :)12:50
blackburnnietpiet: there are two messages of you in the mailing list now12:51
nietpietai.. they are probably the same. (Although I do not see any of them on the list)12:52
blackburnhmm12:52
blackburnstrange12:53
nietpietThe latest post I see is " GSoC weekly report - Latent SVM" from 2012-06-26 10:29:0312:53
blackburnyeah I see12:53
blackburnnietpiet: could you please try the same with latest git of shogun?12:54
nietpietOK, i will try that.12:55
blackburnnietpiet: feel free to ask anything12:55
nietpietAbout the list, maybe it is because of: "Delivery is delayed to these recipients or groups: shogun-list-subscribe@shogun-toolbox.org (shogun-list-subscribe@shogun-toolbox.org) Subject: This message hasn't been delivered yet. Delivery will continue to be attempted. The server will keep trying to deliver this message for the next 3 days, 19 hours and 59 minutes. You'll be notified if the message can't be delivered by that time."12:55
blackburnhuh12:55
nietpietWell.. about the MKL, i was thinking that maybe i made a silly mistake somewhere.12:57
nietpietAlso, i'm not sure if libSVM will also use the kernel weights that are learned by the MKL, (and probably put in the CombinedKernel?)12:58
blackburnrandom results look strange for me12:58
blackburnyes it will use any kernel that you provide12:58
blackburnmkl training modifies CombinedKernel with setting learned weights12:59
nietpietAh.. i thought so. But in the example i posted i only use 1 kernel. Perhaps that is a problem for MKL?12:59
blackburnahh only one13:00
blackburnbut why only one?13:00
nietpietCause the others take long to load from disk :)13:00
nietpietI did try with multiple kernels, but strangely results got worse..13:01
blackburnnietpiet: did you compare weights itself?13:01
blackburnlearned kernel weights I mean13:01
nietpietYes, they were very low.13:01
blackburnsomething e-19?13:02
nietpietah.. no.. For one kernel like e-5, and the other two e-113:02
nietpietI will try the latest git first, but will prob. lose this connection, since i have to start a vpn.13:05
nietpietSo thank you very much for your time!13:06
* wiking brb13:07
-!- wiking [~wiking@huwico/staff/wiking] has quit [Quit: leaving]13:07
-!- wiking [~wiking@mobile-out-229-70.siminn.is] has joined #shogun13:07
-!- wiking [~wiking@mobile-out-229-70.siminn.is] has quit [Changing host]13:07
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun13:07
blackburnnietpiet: sure - let me know if it become better or worse13:09
-!- nietpiet [52ad81c6@gateway/web/freenode/ip.82.173.129.198] has quit [Ping timeout: 245 seconds]13:10
gsomixsonney2k, wow! it works.13:18
-!- wiking [~wiking@huwico/staff/wiking] has quit [Quit: wiking]13:20
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun13:21
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has joined #shogun13:37
-!- wiking [~wiking@huwico/staff/wiking] has quit [Quit: wiking]13:42
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun13:42
-!- blackburn [~blackburn@81.28.187.0] has quit [Quit: Leaving.]13:45
-!- blackburn [~blackburn@81.28.187.0] has joined #shogun13:47
-!- blackburn [~blackburn@81.28.187.0] has quit [Quit: Leaving.]14:13
-!- blackburn [~blackburn@81.28.187.0] has joined #shogun14:15
@sonney2kwiking, ACTION???15:00
@sonney2kgsomix, now with --verbose please - what works?15:01
gsomixhuh :) I have enabled buffer and sequence protocol for my vector3d class - works. memoryview may look a buffer, and vector3d+numpy.array also works15:03
gsomixsonney2k, http://pastebin.com/E3pZXmQE my draft15:08
gsomixsonney2k, http://pastebin.com/h5kjg8W1 output15:11
@sonney2kgsomix, coool!15:15
@sonney2kexcellent work15:16
blackburnsonney2k: can you git pull?15:17
@sonney2kgsomix, so the next step would be to use swig to overload these slots - I would again attempt this on some toy data not shogun15:17
@sonney2kblackburn, I cannot visit this page -> hang15:17
@sonney2kgsomix, err not toy data - I meant toy example15:17
blackburnsonney2k: could you please git pull google && [git push to all 3 .gits]?15:18
gsomixsonney2k, I see15:18
blackburnsonney2k: both github and shogun-toolbox repo deny me to push15:20
@sonney2kgsomix, in the example will a+=b work?15:20
@sonney2kb+=a would surely15:20
@sonney2kor?15:20
@sonney2kblackburn, ?15:20
gsomixsonney2k, b+=a works, but a+=b returns numpy.array as result.15:21
@sonney2kdid you pull / rebase15:21
blackburnsonney2k: argh sorry15:21
blackburnI was setting up HW params and was root :D15:21
blackburnhmm still15:22
blackburnPermission denied (publickey).15:22
blackburnfatal: The remote end hung up unexpectedly15:22
@sonney2kblackburn, what does not work15:22
@sonney2kpull?15:22
blackburnsonney2k: both15:22
gsomixsonney2k, I think I need to overload += and + for vector. right? hmmm, will look in the numpy code15:23
@sonney2kblackburn, pull works fine here15:23
@sonney2kgsomix, I am not so sure15:23
@sonney2kgsomix, but most important for now is that a + b works15:23
@sonney2kbut maybe you should initialize a[0]=115:23
@sonney2ka[1]=215:23
@sonney2ka[2]=215:23
@sonney2ka[2]=315:24
@sonney2kin your example15:24
@sonney2kotherwise it is not 100% clear if it really works :D15:24
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has quit [Ping timeout: 265 seconds]15:24
gsomixsonney2k, http://pastebin.com/0tDLWjS215:27
@sonney2kgsomix, perfect15:27
@sonney2kgsomix, do you know where to look in swig docs for overloading tp_ * stuff?15:28
gsomixsonney2k, --builtin?15:28
@sonney2kgsomix, uhh look at this http://www.swig.org/Doc2.0/SWIGDocumentation.html#Python_nn7515:29
CIA-18shogun: Sergey Lisitsyn master * ra75088e / (28 files in 5 dirs): Moved task structures out of multitask submodule - http://git.io/jRJFvA15:29
CIA-18shogun: Sergey Lisitsyn master * reea1b33 / (64 files in 19 dirs): Merge remote-tracking branch 'upstream/master' into slep - http://git.io/CbTqQA15:29
@sonney2kgsomix, yes -builtin15:31
@sonney2klike %feature("python:slot", "tp_hash", functype="hashfunc") Cheese::cheeseHashFunc;15:31
blackburnargh lame merge15:31
blackburnof me15:32
gsomixsonney2k, thanks!15:32
shogun-buildbotbuild #56 of deb1 - libshogun started, including [a75088e961e4e1cd8e6515a1653b0f852da6cfca]15:32
shogun-buildbotbuild #57 of deb1 - libshogun started, including [eea1b33dde2297ed53d2c35ab4f46183bd761fd8]15:32
@sonney2kuhh now two of them build at the same time!15:32
shogun-buildbotbuild #57 of deb1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb1%20-%20libshogun/builds/5715:33
shogun-buildbotbuild #66 of deb3 - modular_interfaces started, including [eea1b33dde2297ed53d2c35ab4f46183bd761fd8]15:33
@sonney2kgsomix, what I would do is define the type again, wrap it with swig and override all the needed slots15:34
@sonney2kgsomix, then check in the generated source code if these are really set15:34
@sonney2kand try your numpy example again :)15:34
gsomixok, it's clear15:35
* sonney2k is pretty excited to see if this works15:36
gsomixsonney2k, I should to water my plants in garden.15:37
gsomixsee you later, ok?15:37
@sonney2kgsomix, sure - and good work!15:38
gsomixtnx15:38
shogun-buildbotbuild #56 of deb1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb1%20-%20libshogun/builds/5615:38
shogun-buildbotbuild #67 of deb2 - static_interfaces started, including [eea1b33dde2297ed53d2c35ab4f46183bd761fd8]15:38
shogun-buildbotbuild #67 of deb2 - static_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb2%20-%20static_interfaces/builds/6715:47
shogun-buildbotbuild #67 of deb3 - modular_interfaces started, including [a75088e961e4e1cd8e6515a1653b0f852da6cfca]15:47
shogun-buildbotbuild #67 of deb3 - modular_interfaces is complete: Failure [failed configure]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/67  blamelist: Sergey Lisitsyn <lisitsyn.s.o@gmail.com>15:49
shogun-buildbotbuild #68 of deb2 - static_interfaces started, including [a75088e961e4e1cd8e6515a1653b0f852da6cfca]15:49
shogun-buildbotbuild #68 of deb2 - static_interfaces is complete: Failure [failed configure]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb2%20-%20static_interfaces/builds/68  blamelist: Sergey Lisitsyn <lisitsyn.s.o@gmail.com>15:49
shogun-buildbotbuild #66 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/6616:11
CIA-18shogun: Sergey Lisitsyn master * r9c4e1d8 / (4 files in 2 dirs): Added FeatureBlockLogisticRegression - http://git.io/7R4MpQ16:54
shogun-buildbotbuild #58 of deb1 - libshogun started, including [9c4e1d826fa8fb2b193f4ce344d6116c1b3a8b00]16:57
shogun-buildbotbuild #58 of deb1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb1%20-%20libshogun/builds/5816:58
shogun-buildbotbuild #68 of deb3 - modular_interfaces started, including [9c4e1d826fa8fb2b193f4ce344d6116c1b3a8b00]16:58
shogun-buildbotbuild #69 of deb2 - static_interfaces started, including [9c4e1d826fa8fb2b193f4ce344d6116c1b3a8b00]16:58
-!- alexlovesdata_ [82955843@gateway/web/freenode/ip.130.149.88.67] has joined #shogun17:02
shogun-buildbotbuild #69 of deb2 - static_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb2%20-%20static_interfaces/builds/6917:06
-!- heiko [~heiko@host86-174-148-28.range86-174.btcentralplus.com] has joined #shogun17:07
CIA-18shogun: Heiko Strathmann master * r7418b63 / examples/undocumented/libshogun/statistics_quadratic_time_mmd.cpp : removed forgotten asserts to prevent fails - http://git.io/BHbzZw17:19
CIA-18shogun: Heiko Strathmann master * r50f3d0e / examples/undocumented/libshogun/statistics_quadratic_time_mmd.cpp : Merge pull request #624 from karlnapf/master - http://git.io/ZYWKXg17:19
-!- nietpiet [92329062@gateway/web/freenode/ip.146.50.144.98] has joined #shogun17:22
shogun-buildbotbuild #59 of deb1 - libshogun started, including [7418b6368ba7e6bb369c108a2c96c07cd686da7d]17:22
shogun-buildbotbuild #59 of deb1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb1%20-%20libshogun/builds/5917:27
shogun-buildbotbuild #60 of deb1 - libshogun started, including [50f3d0ed93148e5b957d8a1a14d8bfb014aa50b7]17:27
nietpietHi Blackburn: I tried the latest git, but now i get a: " terminate called after throwing an instance of 'shogun::ShogunException', and a dumped core. ". At the .apply() step of the MKL, but the same for the .apply() step for libSVM.. I had to change my code a bit to include BinaryLabel. The mkl_binary documented example still works though.. strange.. maybe my beforehand and hand-created test kernel is fishy.. Although in the prev. v17:30
shogun-buildbotbuild #60 of deb1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb1%20-%20libshogun/builds/6017:31
shogun-buildbotbuild #69 of deb3 - modular_interfaces started, including [7418b6368ba7e6bb369c108a2c96c07cd686da7d]17:31
blackburnnietpiet: it means there are some internal error - could you please try to do svm.io.set_loglevel(MSG_DEBUG) and paste the output somewhere?17:33
nietpietum.. sorry.. do i have to import something from the shogun package to be able to run that command?17:35
blackburnnietpiet: to ease imports just do 'from modshogun import *'17:35
shogun-buildbotbuild #68 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/6817:36
shogun-buildbotbuild #70 of deb2 - static_interfaces started, including [7418b6368ba7e6bb369c108a2c96c07cd686da7d, 50f3d0ed93148e5b957d8a1a14d8bfb014aa50b7]17:36
nietpietblackburn: um.. i did that import, but still: "NameError: name 'svm' is not defined"17:37
blackburnnietpiet: [svm] is any shogun object you use17:38
blackburnmkl classifier or anything else17:38
nietpietblackburn: i'm further, but still: AttributeError: 'getset_descriptor' object has no attribute 'set_loglevel'17:39
nietpietwith MKLClassification.io.set_loglevel(MSG_DEBUG)17:39
blackburnnietpiet: why mklclassification?17:40
blackburnmkl itself17:40
-!- puffin444 [62e3926e@gateway/web/freenode/ip.98.227.146.110] has joined #shogun17:41
shogun-buildbotbuild #70 of deb2 - static_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb2%20-%20static_interfaces/builds/7017:41
shogun-buildbotbuild #70 of deb3 - modular_interfaces started, including [50f3d0ed93148e5b957d8a1a14d8bfb014aa50b7]17:41
nietpietblackburn: Sorry.. i'm a new to this. Still no go:  MKL.io.set_loglevel(MSG_DEBUG) AttributeError: 'getset_descriptor' object has no attribute 'set_loglevel' with doing MKL.io.set_loglevel(MSG_DEBUG)17:42
blackburnnietpiet: MKL should be an object17:42
blackburnnot a class17:42
nietpietahaaaa.. let me try that.17:42
blackburnin your example before you were using mkl so try that17:42
nietpietBlackburn: shall i just paste it here? (risk of polluting the log?)17:44
blackburnnietpiet: no please rather use pastebin.com or so17:44
nietpietBlackburn: nice, never used that before: http://pastebin.com/jJMZqbUk17:46
blackburnnietpiet: can you paste the code as well?17:47
blackburnnietpiet: what I can say is weight seems to be correct - 1.017:49
nietpietBlackburn: Haha, yes, with one kernel. I can also try with 3 if you like. But libSVM also crashed with this single kernel. This is (a bit more) of the code: http://pastebin.com/mkQQ10wS17:50
nietpietBlackburn: One thing i had to do, is to transpose my test kernel, cause i had the training samples as the columns, wheras Shogun seems to see the training samples as the rows.17:53
nietpiet(i think i used libSVM format for the precomputed kernel)17:53
blackburnstrange error is not being displayed17:53
nietpietBlackburn: and also strange that the mkl_binary example works, but this does not.17:56
blackburnnietpiet: okay I think I know17:57
nietpietGreat!!17:59
blackburnnietpiet: are you able to recompile it now?17:59
nietpietyes.17:59
blackburnnietpiet: could you please try to comment out /*  ... */  lines 257-266 of src/shogun/machine/KernelMachine.cpp18:00
blackburnthen reinstall it and try your example again18:00
blackburnbasically problem is that you use no features18:00
blackburnand it checks for features18:00
nietpietAha.. yes, i did not store the features.18:01
nietpietThank you!18:01
nietpietI will try that now.18:01
blackburnif it works I will commit some quickfix18:04
nietpietYes! it worked! I can apply it now. But, still a small error in the evaluation, so i can't yet tell if the random output problem is solved. (     evaluatorAP.evaluate( BinaryLabels(predSVM), labelsTE) NameError: global name 'evaluatorAP' is not defined  ) will try and fix that now.18:05
shogun-buildbotbuild #70 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/7018:10
nietpietBlackburn: hmm.. My problem is still there. And now it seems the performance is really bad (close to random?)18:18
nietpietAverage Precision MKL:  run 1: 0.0385349355437, run 2: 0.0401661553578; libSVM: run 1: 0.03731640282, run 2: 0.03799959952718:18
blackburnnietpiet: is kernel weight still 1?18:19
nietpietYes,18:19
nietpietMaybe something i do with the labels is wrong? Now it seems like random noise18:20
shogun-buildbotbuild #69 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/69  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>18:20
heikoehm18:21
heikowtf?18:21
heikocommand timed out: 1200 seconds without output, attempting to kill18:21
heikorunning modelselection_grid_search_krr_modular.py ..18:21
blackburnheiko: he fell asleep18:21
blackburnnietpiet: yeah that looks strange18:22
heikoblackburn, does this happen at your machine?18:23
blackburnheiko: no I don't think so18:23
heikoany idea why the bot does this?18:23
heikotoo slow computer18:23
heiko?18:23
blackburnheiko: I would like to know too :D18:23
blackburnno it is not slow I think18:23
heikommh18:25
heikoruns here in <2secs18:25
heikoIll just pretend the buildbot has gone crazy :D18:25
nietpietBlackburn: if I run the exact same problem 2x, then the nr of predicted +1 labels of mkl.apply().get_labels() with np.sum(predLabels==1) for the first run is 2102 and the 2nd run is 1176.. this seems close to random. With the prev. version of Shogun I got around 96% accuracy. quite strange..18:37
blackburnis apply random??18:40
nietpietwell.. haha. i hope not :). I will do the same test for the documented mkl_binary example now.18:41
blackburnthanks18:43
nietpietfor the mkl example it is constantly 73.18:44
puffin444Hey heiko, can I ask something about parameter hashing?18:45
heikohej puffin444, sure18:45
puffin444Instead of writing a new wrapper in CHash, do you think it makes sense just to use the full MurmurHash2() function.18:46
puffin444And use the hashed value of previous parameters as the seed for the next parameters to be hashed.18:47
heikodont know, Ill check the function18:48
blackburnnietpiet: could you please check alphas? get_alphas()18:48
heikommh when you look at the functions, it seems to be something different18:48
heikoIf the result is the same, sure18:49
heikobut the operations are not the same, are they?18:49
puffin444Yes they are slightly different. It looks like the full function takes chunks of 4 bytes at a time.18:49
heikoAlso, there is something menioned about that data has to be aligned18:49
heikoI think a new wrapper would be better then18:50
heikoput "bytewise" in the name :)18:50
puffin444Oh now I see that.18:50
puffin444yeah I think a wrapper makes sense.18:50
heikoyes, will make the code even easier to understand, and faster18:50
heikommh18:51
heikoI mean, the chunk wise thing is of course faster since fewer iterations .....18:51
puffin444Yes but things could get really messy if there needs to be alignment18:52
nietpietBlackburn: Maybe something with precomputed kernels? If i do apply().get_labels() on the Training set, the nr of positives for 3 runs is: 14, 67, 70. Alphas for 2 runs are: http://pastebin.com/UuKthgWm18:53
heikoyes, I actually dont know what that exactly means :D18:53
heikodo you?18:53
heikothe modulo is handled in the full hash method18:54
heikoso perhaps it might be ok to use it18:54
puffin444I have a vague recollection from my comp. architecture class. It means that the memory has to divisible by four I think18:54
blackburnnietpiet: I do not understand why alphas are changed :D18:54
heikommh, same here, thats some time ago :)18:55
heikoPerhaps you could compare the speed of the chunk wise hashing with the byte wise hashing for a reasonable matrix size?18:55
heikosay 1000x100018:55
heikoof float64_t18:55
heikoand if there is a significant difference, we can think of it some more, maybe ask s?ren or whoever wrote the hashing code18:55
heikoand if not, just use byte-wise18:56
heiko(but for bytewise the loop has to be inside the function, otherwise it will definately loose)18:56
puffin444Who is Austin Appleby18:58
puffin444he wrote the murmur code18:58
heikopuffin444, lol :) never heard that name :)19:01
puffin444Looks like this was code not directly written by someone with shogun.19:02
heikoyes, its MIT license also, we usually dont do that19:02
puffin444Apparently Austin Appleby is the author of the murmur algorithm.19:02
heikolol really? :)19:02
heikowell, then it proabably works correctly :)19:03
heikoI would say just compare runtimes and then well decide (also compare if results are the same)19:03
nietpietBlackburn: here is the debug output for 3 runs.. http://pastebin.com/t02kUD8v maybe it is helpful.19:03
nietpietBlackburn: I can also make the Train and Test kernel available if that is helpful?19:05
blackburnnietpiet: I can see objective values are very different19:05
puffin444heiko, things are a little more complicated. I don't think the IncrementalMurmurHash2 is a "real" implementation of the true murmur has function.19:09
heikopuffin444, oh, thats bad, ...or wait: is it still a hashing function? thats the only thing that matters19:10
puffin444I don't know. I googled the name of the function and the only thing that comes  up is Shogun.19:10
puffin444someone in shogun might have written that function.19:11
heikowe can check on github, wait19:11
heikopuffin444,19:12
heikohttps://github.com/shogun-toolbox/shogun/commit/022b47a562d8675f0db447ef2c1bc87bccc2602619:12
heikoit was ?ren :)19:12
heikos?ren19:12
heikoyou can ask him why he did that19:13
puffin444"Murmur-like"19:13
heikobut the function should in my eyes do exactly do the same as the real hash19:13
heikoonly that you can bytewise pass data19:13
puffin444hey sonney2k, what's the purpose of IncrementalMurmurHash2() ?19:13
puffin444heiko, take a look at this: http://pyfasthash.googlecode.com/svn-history/r19/trunk/src/MurmurHash/MurmurHash2A.cpp19:14
puffin444This is a variant by the author which he claims is better for incremental hashes19:14
heikommh19:15
heikolooks good19:15
heikoI dont know :)19:15
puffin444hey heiko what do you mean when you say "mmh"?19:15
heikoit is an expression of thinking :D19:15
heikomy fingers do their own stuff if the brain is busy with something else ;)19:16
puffin444It looks like the author has written a third version that is optimized for 64 bit architectures19:16
puffin444I was thinking you were always saying "meet me halfway"19:16
heikowe could add all of this and check architecture before19:16
heikomeet me halfway? :)19:16
heikono did not even know that one19:16
puffin444yes I was confused19:17
blackburnpuffin444: I tend to say hmm - would you think I say hidden markov model? ;)19:17
puffin444depends on the context19:17
heikofunny :)19:17
puffin444I was asking about solutions to an ML problem and you responded with hmm....19:18
puffin444Then maybe yes :)19:18
heikohehe ;)19:18
puffin444Another issue I see is that the murmur hashing function is non-cryptographic19:20
puffin444Although I don't know how important that is for parameter hashing or not. Technically I think murmur could create the same hash for two different param combinations.19:21
puffin444Although this would be exceedingly rare19:21
-!- uricamic [~uricamic@89.13.broadband14.iol.cz] has left #shogun []19:23
heikopuffin444, that is not important19:24
puffin444okay19:24
heikoany hashing function does that btw.19:24
heikothere is no bijective map between the set of all hashs of a finite length and say all real numbers19:24
puffin444Yes but I would think that something like MD5 would be stronger, but it may be overkill for this situation.19:24
heikoI think most important here is speed19:24
heikosince you will call that a few times19:25
CIA-18shogun: Heiko Strathmann master * r7e96849 / (8 files in 2 dirs): Merge pull request #625 from karlnapf/master (+6 more commits...) - http://git.io/S2OhSA19:26
heikoguys, I will head off now, bye bye19:26
puffin444Okay see you heiko.19:27
heikosee you! :)19:27
shogun-buildbotbuild #61 of deb1 - libshogun started, including [ff91003d710f377a8707f41c1ec4c52ef814c4b0]19:27
shogun-buildbotbuild #62 of deb1 - libshogun started, including [2bb5cdfb3043a3dcaa7c4378098850a42cf06db6, 4832dd40d53836b660bbd266566028b701552c97]19:27
shogun-buildbotbuild #61 of deb1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb1%20-%20libshogun/builds/6119:28
shogun-buildbotbuild #63 of deb1 - libshogun started, including [6d9ce338d5bf1be8bce90a5a12324086294789a8, 1b7374b4ec518307aad3c837a7e752fc3a40b6a3, e913b8ade1cad5654fd1c77470891ba45381f501, 7e9684929e8506d4f4fab6b7969c6edc8c7ce5eb]19:28
-!- heiko [~heiko@host86-174-148-28.range86-174.btcentralplus.com] has left #shogun []19:28
shogun-buildbotbuild #63 of deb1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb1%20-%20libshogun/builds/6319:29
shogun-buildbotbuild #71 of deb3 - modular_interfaces started, including [ff91003d710f377a8707f41c1ec4c52ef814c4b0]19:29
shogun-buildbotbuild #62 of deb1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb1%20-%20libshogun/builds/6219:32
shogun-buildbotbuild #71 of deb2 - static_interfaces started, including [ff91003d710f377a8707f41c1ec4c52ef814c4b0, 6d9ce338d5bf1be8bce90a5a12324086294789a8, 1b7374b4ec518307aad3c837a7e752fc3a40b6a3, e913b8ade1cad5654fd1c77470891ba45381f501, 7e9684929e8506d4f4fab6b7969c6edc8c7ce5eb]19:32
@sonney2kpuffin444, whats wrong with the incremental murmurhash2?19:40
shogun-buildbotbuild #71 of deb2 - static_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb2%20-%20static_interfaces/builds/7119:40
shogun-buildbotbuild #72 of deb3 - modular_interfaces started, including [6d9ce338d5bf1be8bce90a5a12324086294789a8, 1b7374b4ec518307aad3c837a7e752fc3a40b6a3, e913b8ade1cad5654fd1c77470891ba45381f501, 7e9684929e8506d4f4fab6b7969c6edc8c7ce5eb, 2bb5cdfb3043a3dcaa7c4378098850a42cf06db6, 4832dd40d53836b660bbd266566028b701552c97]19:40
puffin444Is it a true implementation of murmur hash?19:40
puffin444Because the author notes on his website that the murmur hash function is not incremental without special modifications.19:41
@sonney2kpuffin444, even though I wrote this code I don't remember exactly but I *think* that it will give the exact same result as murmurhash19:43
@sonney2k219:43
@sonney2kpuffin444, you of course need to pass the old seed - but I guess that is clear19:44
puffin444yes19:44
@sonney2kpuffin444, but maybe you just try on some small example (some string of length 10000 or so)19:44
puffin444I'll go and try that really quickly19:47
CIA-18shogun: Soeren Sonnenburg master * rb20223c / src/shogun/statistics/TwoSampleTestStatistic.cpp : fix typo -> distribution - http://git.io/8FToUQ19:47
puffin444Is library_hash supposed to yield the same result?19:49
CIA-18shogun: Sergey Lisitsyn master * r2cf3002 / (11 files in 5 dirs): Fixed FeatureBlockLogisticRegression solver and added Task and TaskTree - http://git.io/SurCuQ19:50
blackburnwhoa19:50
puffin444sonney2k, library_hash gives different results for murmur and incremental murmur hash. Is this supposed to happen?19:52
@sonney2kpuffin444, what is library_hash?19:52
puffin444in the examples folder for libshogun19:53
shogun-buildbotbuild #71 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/7119:57
shogun-buildbotbuild #72 of deb2 - static_interfaces started, including [2bb5cdfb3043a3dcaa7c4378098850a42cf06db6, 4832dd40d53836b660bbd266566028b701552c97]19:57
puffin444sonney2k, if you are comfortable with it I found an updated version of murmur hash on the author's repro that does not require alignment and supports incremental processing.19:58
puffin444I could use this instead.19:59
puffin444http://smhasher.googlecode.com/svn/trunk/PMurHash.c19:59
nietpietBlackburn: Although i've not been able to use shogun yet, and i hope i can post to the list sometime soon too. But i'd like to thank you very much for your help. I'm gonna eat something now, and the VPN connection may time out in a while.20:02
blackburnnietpiet: post what? :)20:02
blackburnnietpiet: I'll check MKL example a little later20:02
shogun-buildbotbuild #72 of deb2 - static_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb2%20-%20static_interfaces/builds/7220:03
shogun-buildbotbuild #64 of deb1 - libshogun started, including [b20223ce963c643fe7c47edb2fd6596db65d7fb8, 2cf3002942ef891c9993959a8861878654018fae]20:03
nietpietoh i noticed that my question is still not online here http://news.gmane.org/gmane.comp.ai.machine-learning.shogun20:03
blackburnthat's strange20:03
shogun-buildbotbuild #64 of deb1 - libshogun is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb1%20-%20libshogun/builds/6420:04
shogun-buildbotbuild #73 of deb2 - static_interfaces started, including [b20223ce963c643fe7c47edb2fd6596db65d7fb8]20:04
nietpietSo i guess the list is still waiting for my subscription email that i sent last night :)20:04
blackburnnietpiet: IIRC it usually works without subscription20:05
nietpietBlackburn: I first got this: You have sent a message to be posted on the gmane.comp.ai.machine-learning.shogun newsgroup.   This is a non-public mailing list, which means that you have to subscribe to the list to post to it.  If you're already subscribed to the list, Gmane can forward the message you sent to the list if you respond  to this message.  If not, you should sign up to the mailing list first, and then respond to this mess20:06
nietpietSo i sent an email to subscribe20:06
blackburnright20:06
nietpietto here: shogun-list-subscribe@shogun-toolbox.org20:06
nietpietBut that one gave: Delivery is delayed to these recipients or groups: shogun-list-subscribe@shogun-toolbox.org (shogun-list-subscribe@shogun-toolbox.org) Subject: This message hasn't been delivered yet. Delivery will continue to be attempted. The server will keep trying to deliver this message for the next 3 days, 19 hours and 59 minutes. You'll be notified if the message can't be delivered by that time.20:07
@sonney2kpuffin444, really? is this from the original author or somebody else20:07
nietpietSo i guess it is still waiting :)20:07
puffin444This is technically not from the original author, but it is on the original author's repro.20:07
puffin444This particular version has been written to be platform independent, incrementable, and easily integrable into other projects.20:09
nietpietBlackburn: If ur interested, the kernels are here: http://staff.science.uva.nl/~jvgemert/shogun/ and thanks again for your help so far!20:09
shogun-buildbotbuild #73 of deb2 - static_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb2%20-%20static_interfaces/builds/7320:09
shogun-buildbotbuild #73 of deb3 - modular_interfaces started, including [b20223ce963c643fe7c47edb2fd6596db65d7fb8, 2cf3002942ef891c9993959a8861878654018fae]20:09
blackburnpretty big heh20:09
nietpietHaha.. yes.. and i have a few more that i'd like to combine :)20:10
nietpietoh.. i set all 0 labels to -1, but that is not that important. (those are the "hard" examples, i guess i can leave them out)20:15
blackburnnietpiet: all labels should be either -1 or +120:16
-!- gsomix [~gsomix@109.169.246.7] has quit [Remote host closed the connection]20:19
nietpietBlackburn: yeah, that is why i set the 0 labels beforehand to -1 :)20:19
@sonney2kblackburn, nietpiet strange with gmane - I am asking the administor maybe it is related to the change of shogun servers20:21
@sonney2kpuffin444, well sounds good then20:21
puffin444sonney2k, I am going to test this out now20:22
@sonney2kpuffin444, there might be very few applications that potentially depend on this function but I don't expect too many so go ahead.20:23
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has joined #shogun20:29
shogun-buildbotbuild #72 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/72  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>20:30
shogun-buildbotbuild #74 of deb2 - static_interfaces started, including [2cf3002942ef891c9993959a8861878654018fae]20:30
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has quit [Client Quit]20:33
shogun-buildbotbuild #74 of deb2 - static_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb2%20-%20static_interfaces/builds/7420:38
shogun-buildbotbuild #74 of deb3 - modular_interfaces started, including []20:47
shogun-buildbotbuild #73 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/7320:47
@sonney2kit is thunderstorm time!20:49
-!- alexlovesdata_ [82955843@gateway/web/freenode/ip.130.149.88.67] has quit [Quit: Page closed]21:27
shogun-buildbotbuild #74 of deb3 - modular_interfaces is complete: Failure [failed test python_modular]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/7421:36
-!- nietpiet [92329062@gateway/web/freenode/ip.146.50.144.98] has quit [Ping timeout: 245 seconds]21:37
-!- gsomix [~gsomix@109.169.246.7] has joined #shogun21:55
@sonney2kgsomix, the recent thunderstorm really killed my power supply22:06
@sonney2kunit22:06
@sonney2know I have ~50 EUR less and a new one but things are working22:07
@sonney2kand surprise new thunderstorm!22:07
gsomixtoo many thunderstorm in Germany22:07
gsomix*s22:08
gsomixrandom pic http://piccy.info/view3/3225244/0c55735400d993a9ebeb0ba46756c81d/22:15
gsomixgood night guys22:31
-!- gsomix [~gsomix@109.169.246.7] has quit [Quit: Ex-Chat]22:31
@sonney2kgsomix ??? black hole?22:36
-!- emrecelikten [~emre@213.153.222.106] has joined #shogun22:39
-!- n4nd0 [~nando@s83-179-44-135.cust.tele2.se] has joined #shogun22:55
-!- nietpiet [9232901a@gateway/web/freenode/ip.146.50.144.26] has joined #shogun23:01
nietpietBlackburn, @sonney2k, Thanks for your help with the list. It seems to be a stupid exchance server thing at my end at work. I just tried with my private gmail and subscription went like a charm. Sorry to bother you.. Thanks, Jan.23:02
blackburnnietpiet: no problem you are welcome23:02
nietpietI'll try and send my MKL thing to the list, maybe others have also experienced this.23:03
blackburnnietpiet: which one?23:03
nietpietWell, both of them :) The one with the small random output from the stable source, and the one with the completely random results with the git version.23:04
blackburnah ok23:04
blackburnstrange it is random23:05
nietpietyeah.. you've seen those alpha scores :)23:05
blackburnbrb23:06
-!- blackburn [~blackburn@81.28.187.0] has quit [Remote host closed the connection]23:07
-!- blackburn [~blackburn@81.28.187.0] has joined #shogun23:09
shogun-buildbotbuild #75 of deb3 - modular_interfaces started, including []23:11
@sonney2kblackburn, nietpiet what?23:33
@sonney2kdid I understand this correctly - totally random outputs with libsvm?23:34
nietpiet@sonney2k, just thanking you for your help. The mailing list problem was a mistake on my end.23:34
nietpietOh.. random, yes.. but only in my code :) The documented examples still work nicely.23:34
@sonney2knietpiet, no something is still fishy with the gmane archive...23:34
@sonney2knietpiet, where is your code23:35
@sonney2ka) did you try to use a single thread only?23:35
@sonney2kb) did you try to run the example under valgrind and see if there are uninited memory accesses23:35
nietpiet@sonney2k, the code is here: http://pastebin.com/mkQQ10wS23:36
nietpiet@sonney2k: I've never used valgrind with python before (only with c++). Yes! I can try to find out how i can turn off multi-threading23:37
@sonney2knietpiet, on your first created shogun object do  obj.parallel.set_num_threads(1)23:39
nietpiet@sonney2k, background info in the log from today: http://www.shogun-toolbox.org/irclogs/%23shogun.2012-07-05.log.html Blackburn was already very helpful.23:39
nietpietI will do that now.23:40
@sonney2knote that due to parallel stuff the output is not deterministic(!)23:40
shogun-buildbotbuild #75 of deb3 - modular_interfaces is complete: Success [build successful]  Build details are at http://www.shogun-toolbox.org/buildbot/builders/deb3%20-%20modular_interfaces/builds/7523:40
@sonney2knietpiet, and please lets try to get this to work with libsvm first...23:40
@sonney2knietpiet, could you please get the real valued outputs of the svm too23:41
@sonney2kyou can do this via outputlabels.get_confidences()23:41
nietpiet@sonney2k: Ok.. libSMV it is. The first shogun object is a combined kernel, shall i put the obj.parallel.set_num_threads(1) on that? Or on the libSVM object?23:42
@sonney2knietpiet, btw you don't need to do mkl.apply() twice23:44
@sonney2kpredLabels = mkl.apply() once is sufficient23:44
@sonney2kand then predLabels.get_labels() to get the +1/-1 predictions23:44
@sonney2kand predLabels.get_confidences() to get the real valued outputs23:44
@sonney2knietpiet, it doesn't matter23:45
@sonney2kso put it on the first possible :)23:45
nietpiet@sonney2k: yes.. i only did apply twice because i had a core dump somewhere there, and i wanted every statement to be on it's own line :)23:46
@sonney2kk23:46
@sonney2kthough that already shouldn't happen23:46
nietpietBlackburn helped me around the core dump by commenting out some C++ lines.23:46
nietpietThe kernel was checking for features, and i do not have any features anymore, only precomputed kernels..23:47
blackburnsonney2k: problem is that if you use only custom kernels and assign no features - kernel machine fails to apply23:47
@sonney2kblackburn, I wonder why23:48
n4nd0sonney2k: btw, what is the trick that allows us to have templated classes separated in header and cpp files?23:48
blackburnsonney2k: kernelmachine checks lhs23:48
n4nd0I thought that was not possible23:48
blackburnn4nd0: why not?23:49
@sonney2kblackburn, it should use has_lhs() and IIRC that is overloaded in customkernel to return true23:49
n4nd0blackburn: I think thatit is defined like that in the standard23:49
blackburnsonney2k: KernelMachine 283 or so23:49
n4nd0blackburn: there are workarounds, but not recommended AFAIK23:49
@sonney2kn4nd0, you have to explicitly name the types you want in the .cpp file23:49
@sonney2kall others will not work23:49
n4nd0blackburn: but here it works fine, the only "weird" thing I see is ...23:50
n4nd0yeah exactly that23:50
@sonney2k(or your will have to include the .cpp file!)23:50
n4nd0yes23:50
n4nd0that is how I managed to get it to work once23:50
n4nd0including the .cpp from the .h23:50
n4nd0I didn't know the one of the types though23:51
n4nd0nor the forums I read about a year ago to find a solution for this :D23:51
@sonney2kblackburn, that code is totally b0rken23:51
blackburnsonney2k: could you please take care of this? I am stucked with adjacency matrix -> tree shity conversion23:52
n4nd0blackburn: there was actually a sensible reason why, but I am afraid I do not remember23:52
blackburnn4nd0: just like inline hehe23:52
n4nd0inline + virtual you mean?23:53
blackburnn4nd0: no, inline in .cpp doesn't work too23:53
n4nd0aham, all right23:53
n4nd0I didn't know about that23:54
n4nd0funny details23:54
blackburnactually that means something is wrong with C++ :D23:54
n4nd0too big to keep everything right maybe23:55
blackburnit is not that cool to know that hammer you used to clinch nails with tends to kill people by mistake23:55
nietpiet@sonney2k, blackburn, output of 5 single threaded runs here http://pastebin.com/heSyQLhP23:56
blackburnnietpiet: I see confidences are equal23:56
blackburnnearly23:56
nietpietNr +1 is number of +1 labels predicted. ACC = accuracy, AVP = avg Precision.23:56
@sonney2kblackburn, actually I understand now - we removed the apply() function - actually we merged apply() and apply(CFeatures* data) into one23:57
blackburnsonney2k: yeah23:57
n4nd0blackburn: dafuq is wrong with your hammer!?23:57
blackburnn4nd0: C++ is that hammer23:57
@sonney2kso it now needs extra treatment to work23:57
blackburnsurgery23:58
n4nd0blackburn: I should read more poesy so I can get the metaphors better ;)23:58
@sonney2knietpiet, is that with a single thread already?23:59
@sonney2kbecause I see fluctuations... so something is not deterministic...23:59
nietpiet@sonney2k: Yes, i put  kernelTR = CombinedKernel()    and then  kernelTR.parallel.set_num_threads(1)23:59
--- Log closed Fri Jul 06 00:00:17 2012

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!