IRC logs of #shogun for Monday, 2011-04-11

--- Log opened Mon Apr 11 00:00:19 2011
--- Day changed Mon Apr 11 2011
@sonney2kserialhex, you should at least test this - e.g. sample 100k times and then plot a histogram00:00
@sonney2kif it looks gaussian well then it is good00:00
serialhexsonney2k: ok... sounds good00:00
* serialhex looks into how to do that :-/00:01
blackburnI think there is no problem with it, it will produce a gaussian random value00:03
@sonney2kserialhex, easy: generate the numbers and then use octave or python + matplotlib and do hist(numbers)00:10
@sonney2kpotentially with 100 bins00:10
serialhexsonney2k: ok, sounds good00:10
serialhexis there anyway to just make the Math.h file? or do i have to re- ./configure; make; make install  ???00:14
blackburnwhy do get_feature_vector(..) returns matrix?! oh my00:15
-!- Mengyun [~dorothyk@S0106001a803d4363.vc.shawcable.net] has quit [Quit: Leaving]00:17
@sonney2kblackburn, it shouldn't00:24
blackburnsonney2k: it seems that doc isn't very good00:25
blackburn /** get a copy of the feature matrix (in feature space)00:25
blackburn * num_feat,num_vectors are returned by reference00:25
@sonney2kserialhex, almost all modules use math - so you have to redo them all00:25
@sonney2kfor get_feature_matrix right?00:25
blackburniit is for virtual void get_feature_vector(float64_t** dst, int32_t* len, int32_t num);00:25
serialhexok... i was compiling them all anyway and DistanceKernel.h gave me an error:00:26
serialhexIn file included from base/class_list.cpp:23:00:26
serialhex./kernel/DistanceKernel.h:115: error: ‘virtual void shogun::CDistanceKernel::set_width(float64_t)’ cannot be overloaded00:26
serialhex./kernel/DistanceKernel.h:96: error: with ‘virtual void shogun::CDistanceKernel::set_width(float64_t)’00:26
serialhex./kernel/DistanceKernel.h:124: error: ‘virtual float64_t shogun::CDistanceKernel::get_width() const’ cannot be overloaded00:26
serialhex./kernel/DistanceKernel.h:105: error: with ‘virtual float64_t shogun::CDistanceKernel::get_width() const’00:26
serialhexIn file included from ./kernel/StringKernel.h:15,00:26
serialhex                 from ./kernel/MatchWordStringKernel.h:15,00:26
serialhex                 from base/class_list.cpp:24:00:26
blackburnsonney2k: oh, I see now, doc for both get_feature_matrix() and get_feature_vector() is identical00:26
blackburnit is in DotFeatures.h00:26
serialhex...i'm taking a look now, it might be from someone elses commit cause i've picked up other ppl's commits somehow :-/00:27
@sonney2kblackburn, copy&paste bug00:27
@sonney2kserialhex, weird. compiles here00:28
* sonney2k does a make distclean00:28
blackburnI haven't any problems with upstream master00:28
serialhexi see what happened (i think)00:28
serialhexthe same functions: get & set width, were being created twice... :-/00:29
blackburnthey not00:29
blackburnhttps://github.com/SergeyLisitsyn/shogun/blob/master/src/libshogun/kernel/DistanceKernel.h00:30
serialhexidfk how that happened...00:30
dvevrei think theres a problem with serialhex's copy only00:30
serialhexyeah, probably00:30
blackburnserialhex: do 'git reset HEAD libshogun/kernel/DistanceKernel.h00:30
blackburnserialhex: sudo do .. :)00:31
@sonney2kalright - off to bed - cu tomorrow00:33
serialhex...i think i might have to figure out whats going on... i seem to get a BUNCH of other peoples commits into my fork somehow... i'm nto sure what i'm doing wrong00:33
dvevresonney2k: see ya00:33
serialhexalright, nite... hopefully i'll have that histogram for ya tomorrow!00:33
@bettyboobye00:33
blackburnserialhex: git remote add upstream https://github.com/shogun-toolbox/shogun.git00:34
serialhexi already have that... and that's the only thing i really pull from00:35
blackburngit fetch upstream00:35
blackburngit merge upstream/master00:35
blackburngit push00:36
blackburngit make money00:36
blackburngit get car00:36
dvevrewe wish!00:36
serialhex:P  i wish for that last one!!00:36
@bettyboohihi!?! serialhex00:36
serialhexhihi! bettyboo!!!00:36
@bettybooserialhex: and in turn this is like a mentor's duty to his institution type thing00:37
@bettybooserialhex, yeah00:37
blackburnserialhex: unfortunately you have to do only first 300:37
blackburngit get car is unimplemented yet :(00:37
serialhexi think bettyboo loves me :P00:38
@bettybooserialhex: i was thinking of doing that anyways, but got us involved in a totally different direction :P00:38
@bettyboohe00:38
serialhexyeah, and git make money00:38
blackburnnow will 'git go sleep' for a while :)00:40
serialhexnite blackburn00:44
blackburnsee you00:44
dvevreg.nite00:45
-!- blackburn [~qdrgsm@188.122.237.148] has quit [Quit: Leaving.]00:45
-!- Gagan [~brocolli@nat-fw.cs.ualberta.ca] has joined #shogun00:55
-!- alesis-novik [~alesis@188.74.87.84] has joined #shogun03:22
-!- siddharth [~siddharth@117.211.88.150] has joined #shogun05:29
-!- Stephen [dbea5187@gateway/web/freenode/ip.219.234.81.135] has joined #shogun06:22
-!- Stephen is now known as Guest9857006:23
Guest98570I wonder can I still participate in the projects posed on the GSoC after the deadline, which I mean not be parts of the GSoC program.06:25
-!- warpy [~warpy@bzq-79-182-10-204.red.bezeqint.net] has joined #shogun06:58
warpyanyone here ?06:59
serialhexnot really...07:04
serialhexwhats up?07:05
warpywas going over shogun just now, need to consult with someone07:06
warpyi need to figure out what needs to be done in order to add a wrapper /interface for c#07:07
serialhexafaik... swig07:07
serialhexswig is what they use for all of their modular interfaces, and it works with c#07:08
warpyouch what is swig07:08
serialhexyou can check out the code by looking at the swig_typemaps.i files in the src/*_modular dirs07:09
serialhexswig.org it's pretty simple actually, just grab the headers, write some specialized C and you're done (for the most part, then comes the debugging :D )07:10
@bettyboo;>07:10
serialhexhey bettyboo, how are you?07:10
@bettybooserialhex: hey, how are you?07:10
serialhexi'm good thank you, and yourself bettyboo??07:10
@bettybooserialhex: why are you repeating yourself over and over?07:10
serialhexbecause i like to bettyboo!07:11
@bettybooserialhex: aint one hir?07:11
serialhexno one is here bettyboo07:11
@bettybooserialhex: it's because I'm novice in git07:11
warpymake the bot shutup :)07:11
serialhexok... i'll stop talking to her07:11
warpyshould i use a specific swig download07:14
warpyor just grab the latest ?07:14
Guest98570anyone can answer my question just now?07:16
Guest98570I wonder can I still participate in the projects posed on the GSoC after the deadline, which I mean not be parts of the GSoC program.07:17
warpydoesnt sound like it07:18
serialhexthe latest warpy07:19
serialhex...i think if you simply want to contribute code you can, though you wont be getting anything except good vibes from the shogun guys if you do that.  so it's not a total loss :D07:20
@bettyboo;> serialhex07:20
Guest98570I mean can I get help from mentors as the students joint in the GSOC program?07:31
Guest98570............nobody here?07:34
-!- Guest98570 [dbea5187@gateway/web/freenode/ip.219.234.81.135] has quit [Ping timeout: 252 seconds]07:47
-!- Stephen [dbea5187@gateway/web/freenode/ip.219.234.81.135] has joined #shogun08:44
-!- Stephen is now known as Guest3085108:44
-!- Guest30851 [dbea5187@gateway/web/freenode/ip.219.234.81.135] has left #shogun []08:47
-!- yayo3 [~jakub@ip-78-45-113-245.net.upcbroadband.cz] has joined #shogun09:00
-!- sploving [~root@124.16.139.196] has joined #shogun09:02
splovinghello sonney2k, I tested it. and it worked well!09:03
splovingI want to give a patch. I use "git add swig_typemaps.i", "git commit", and tried to use "git push" but failed09:06
splovingI think I do not have the permmission to git push.09:07
-!- ameerkat [~ameerkat@184-98-140-155.phnx.qwest.net] has quit [Ping timeout: 260 seconds]09:08
@sonney2ksploving, you need to fork shogun on github09:12
@sonney2kthen commit to your forked project09:12
@sonney2kand then send a git push request09:12
@sonney2ksploving, I sent an HOWTO to the ml09:13
@sonney2ksploving, I forgot *great job*!!!09:13
splovingI saw your email09:13
splovingi clone it before09:13
splovingif i use github, i need clone it again09:14
splovingwhich waste a lot of time09:14
splovingi mean first i need fork it, then clone09:14
warpyhey sonney2k, i understand that i need to download the swig library. i am looking at lib/csharp/09:15
@sonney2ksploving, yes but where is the problem?09:15
@bettyboohi09:15
@sonney2kwarpy, for c# (like any other lang) you need to write typemaps (file swig_typemaps.i) and point me to an example of how to get c# to compile - then I add this to configure09:16
warpysonney2k, what i dont get if i should just use typemaps.i or actually gather some more code from the other .i files in there09:16
warpyi need to know where to start, which is what i am asking09:17
warpyso many files, just need to figure out what to do at the beginning09:17
splovingsonney2k, it shows the following error: Permission denied . fatal: the remote end hung up unexpectedly09:17
@sonney2kwarpy, if you intend to work on c# I can provide you with a ./configure --interfaces=csharp09:18
splovingi use git clone git@github:com:sploving/shogun.git09:18
@sonney2kwarpy, then all you need to do is write the typemap09:18
@sonney2ksploving, did you upload your ssh pub key?09:18
warpywhere do you use ./configure --interface=csharp ?09:19
splovingnot yet. I just set github token09:19
splovingand use git config --global github.token ...09:19
splovingwarpy, ./configure --interfaces=csharp, is used when configure our shogun09:20
warpygotcha, okay so i am a litttle newbish to swig so i am hoping to understand a few things09:22
@sonney2kwarpy, well I would add this feature if you intend to do the wrappers09:24
@sonney2kbut I need some pointer on how to do csharp extension09:25
@sonney2ks09:25
warpyone of my students will do that in the next few weeks09:25
splovingsonney2k, as my patch is a new file, not to change other file. could you test and update it for me if the patch works well09:26
@sonney2kwarpy, well then I can prepare the infrastructure in the same way as I did for sploving for lua/ruby/java09:27
warpyokay.09:27
@sonney2ksploving, just upload your ssh public key09:28
warpyi still need a few more clues to where to start.09:28
warpyi have looked in lib/csharp/09:28
warpyshould i take one of those files as a template ?09:28
@sonney2ksploving, here is a troubleshooting guide http://help.github.com/troubleshooting-ssh/09:28
@sonney2kwarpy, all you have to do is write a file called swig_typemaps.i in (the upcoming) csharp directory of shogun09:29
@sonney2kthese typemaps are needed to translate e.g. matrices to doulbe* x, int d1, int d209:29
@sonney2kto become accessible from C/C++09:30
@sonney2kthat is all09:30
warpyjust matrices to double* ?09:30
warpybut i looked at the python_modular/swig_typemaps.i and it seems like there is a whole world of things going on in there09:30
warpyso to make things short, if there is a list of things to do inorder to make a complete type map that would be a help.09:38
splovingwarpy,python_modular/swig_typemaps.i mainly deal with matrix09:39
splovinglike other modular09:40
@sonney2kwarpy, vectors, matrices, sparse matrices, strings09:41
warpyof any type i assume09:42
warpyis there a small doc/tutorial about this that relates to shogun. something that i can read09:43
-!- blackburn [~qdrgsm@188.122.237.148] has joined #shogun09:43
@sonney2ksploving, did you finally manage to get access to github?09:44
blackburnhi there09:44
splovingI am working it09:44
blackburnyew! 18 forks09:48
splovinghello blckburn, what does that mean?09:48
@bettyboohiho09:48
splovingblackburn, does that mean 18 students clone the project?09:49
blackburnsploving: I guess it is ~12 students' forks09:49
warpysonney2k, so basically i need to do vec/mat/sparse/strings and for each make sure there is functionality for byte/char/int/float/double etc ?09:49
yayo3so there are already more people with forks than can be accepted?09:51
blackburnoh, I think I really get wrong09:52
blackburnall forks exclude ameerkat is students'09:52
blackburnso seems that 17 students forked so far09:52
blackburnyayo3: of course, <=10 will be accepted09:52
@sonney2kwarpy, yes09:53
@sonney2kwarpy, of course if sth is not supported by the language then just some features in shogun are unavailble09:53
yayo3now ain't that fun09:53
warpysth ?09:54
blackburnsth=something09:54
warpyoh right09:54
splovingwarpy, for example, if a lange A does not support char, then you donot need wrap it when binding to A09:55
-!- skydiver [4deac315@gateway/web/freenode/ip.77.234.195.21] has joined #shogun09:55
splovingwhen I clone it is so slow09:56
warpyokay but how do i know if shogun has uspport for all of these variable types for each data type09:56
splovingof course they do09:56
splovingas it is written in C++09:57
warpyi see, so from what i understand swig is connected to that part of shogun that does all the data manipulation. can you guys tell me which files has those, just to make sure that i have all the reference i need.09:59
splovingall the .i files10:00
warpydirectory ?10:01
splovingsome base .i file which is generic to all module is in src/modular10:01
splovingthe specific .i file is in every modular10:02
-!- yayo3 [~jakub@ip-78-45-113-245.net.upcbroadband.cz] has left #shogun []10:02
-!- sploving [~root@124.16.139.196] has left #shogun []10:03
blackburnsonney2k: one performance issue: is get_feature_vector a 'slow' operation and should I work with feature matrix?10:04
warpyhow come matlab doesnt have a .i file ?10:06
@sonney2kblackburn, it is as fast as accessign feature matrix if it is there10:13
blackburnsonney2k: I mean I have to get each feature vector, is it bad to do it N times?10:14
@sonney2kwarpy, matlab is closed source - so has no swig support10:14
@sonney2kblackburn, not at all10:14
@sonney2kjust transverse the vecotrs in order10:14
blackburnwhat do you mean?10:15
@sonney2kwarpy, all in modular/ .... all classes are wrapped btw10:15
@sonney2kblackburn, calling get_feature_vector is as cheap as getting a ptr10:15
@sonney2k(if the matrix is there)10:15
blackburnsonney2k: yeap it is CDotFeatures10:16
@sonney2k(there can be computes like preproc on top of it though)10:16
blackburnsonney2k: in that case, will get_feature_vector return initial vector with no preproc?10:17
blackburnsonney2k: shortly, will I have any problems with it? :)10:18
@sonney2kno always the preproc'd one10:18
@sonney2kjust use it :)10:18
@bettyboorahaha!?!10:18
blackburnokay10:18
blackburnsonney2k: and last one question, may I ask you?10:19
@sonney2kdont ask to ask - ask!10:19
blackburnsonney2k: so, in CKNN there are min_class and max_class10:19
blackburnfor example, if labels are -9 -4 4 910:19
blackburnmin_class will be -9, max_class will be 910:20
blackburnand num_classes 410:20
CIA-31shogun: Siddharth Kherada master * r9c534b9 / (15 files in 3 dirs): Merge commit 'upstream/master' - http://bit.ly/h6R8LM10:20
CIA-31shogun: Soeren Sonnenburg master * r412d643 / src/libshogun/kernel/DotKernel.h : whitespace fix - http://bit.ly/e7NBYv10:20
@sonney2kwell we assume mc labels to start with 0...10:20
@sonney2kfor binary case we assume -1/+110:21
blackburnah10:21
blackburnand can I sure it will not be 0 9 18 27 ...?10:21
skydiversonney2k: do i correctly understand that preproc now can't do dimension reduction?10:22
@sonney2kskydiver, they can but they cannot change feature type10:22
@sonney2kskydiver, look at e.g. PCACut10:23
skydiversonney2k: ok ,thanks10:23
* blackburn gets tangled with that labels numbering :D10:24
blackburnsonney2k: look, in CKNN we use 'output->set_label(i, out_idx+min_label);' but if we have '1 4 5 7' there will be a problem10:25
blackburnmin_label for that case is 1, so then out_idx will be, for example, 2, 2+1=3 and there is no '3' label10:26
@sonney2kblackburn, argh - I only ever used this with labels 0...(nr_classes-1) - never ever with such cases10:27
@sonney2kI agree that this is a problem then10:28
blackburnso, may I do it just like in CKNN?10:28
blackburnor better to check labels?10:28
warpysonney2k, what is the closest typemap example to a higher level language that i use as reference10:29
@sonney2kwarpy, ?10:30
@sonney2kandy in *_modular/swig_typemaps.i can be used as examples10:30
warpyif i had a java typemap i could easily convert it to csharp10:30
warpyi am just asking which one of those typemaps would you suggest as the closest most readable example to use as a base10:31
warpyif i dont want to rewrite everyline from scratch10:31
@sonney2kwarpy, how so? Is java jni so similar to csharps native interface10:31
warpyyeah i always go back and forth with java and c#10:32
@bettyboomorning10:32
warpyvery similar10:32
@sonney2kwarpy, look at octave_modular then...10:32
-!- yayo3 [~jakub@ip-78-45-113-245.net.upcbroadband.cz] has joined #shogun10:35
warpyso r,octave,python have a typemap. matlab is closed and it doesnt. then how do you interface with it?10:37
yayo3so there's a log of black magic know as linear algebra in shogun, right?10:38
yayo3it might be interesting project to make interface to some GPGPU linear algebra libraries10:39
yayo3so anyway if I have a application update (new info that wasn't there last week), can I use the "comment" on melange, or do I need to send an email or something?10:41
@sonney2kwarpy, not using any of the cooler modular interfaces (see static interfaces in the doc)10:43
@sonney2kyayo3, yes use the comment box10:43
@sonney2kyayo3, shogun is not really a linear algebra library - we are only using atlas for such cases10:44
@sonney2kyayo3, there are many such libraries though (just now don't recall any :-[10:45
@sonney2kbut gpu based speedups for the functions that we have in there would be cool - but I think it is more the whole algorithm that needs porting10:46
@sonney2k(features need to be in GPU mem etc)10:46
warpysite down ?10:48
blackburnwhen porting to vector processors we could better delete shogun and write a new one :D10:48
@bettyboohe ;D10:48
@sonney2kwarpy, which?10:48
warpyshogun-toolbox10:48
yayo3sonney2k: sure, I know shogun is not a LA library :) but it uses a lot of it, right?10:48
@sonney2kwarpy, works here10:48
@sonney2kyayo3, not that much admittedly10:48
@sonney2kthese string related algorithms / svms / kernels very often cannot gain anything from them10:49
yayo3I see. nevermin then10:49
serialhexwow... alot has been going on while i wasnt paying attention!! :D10:50
@bettyboo:>10:50
yayo3hmm, I can't find Regression interface. I'm I looking wrong, or should regression methods just extend Classifier?10:57
yayo3KRR is Classifier, SVR is Classifier. I guess that answers that10:58
@sonney2kyayo3, they currently do10:58
@sonney2kyes... classify is a stupid name for applying them though10:58
@sonney2kI guess at some point we have to do add another layer: SupervisedMethod  / UnsuperVisedMethod or so and then call the classify() function apply() or so10:59
@sonney2kwarpy, ok, doing c# in configure seems easy. I will try to do it on my train ride to work.11:00
@sonney2kI am off now11:00
@sonney2kl8r11:00
yayo3see ya11:00
-!- yayo3 [~jakub@ip-78-45-113-245.net.upcbroadband.cz] has quit [Quit: Lost terminal]11:01
CIA-31shogun: Soeren Sonnenburg master * r9985a76 / (4 files in 3 dirs): Add csharp support (for mono) - http://bit.ly/idHHyh11:51
CIA-31shogun: Soeren Sonnenburg master * r549dde2 / src/lua_modular/swig_typemaps.i : Merge branch 'master' of https://github.com/sploving/shogun - http://bit.ly/gHojmc11:53
@sonney2kwarpy, now I am back11:53
warpyhey, i saw that you added for mono11:53
@sonney2kso csharp interfaces seem to be generated11:53
warpyi am using vs.net11:54
@sonney2kwarpy, shouldnt that be the same thing then?11:54
warpyi dont think so11:54
@sonney2ksomeone has to try out if the generated .cs files work11:54
warpyi looked at the swig site i think i saw csharp for non mono11:54
@sonney2kyou?11:54
@sonney2kwarpy, it says c++ -> csharp11:54
@sonney2kso I suspect it will work with any csharp11:55
warpyhttp://www.swig.org/compat.html#SupportedLanguages11:55
warpylook at the site11:55
warpythey distinct 2 language11:55
warpyi mean compilers11:55
@sonney2kwarpy, but these are just links to mono and dotnet11:56
warpyah alright11:56
warpymy mistake11:56
CIA-31shogun: Soeren Sonnenburg master * r4b3721d / (2 files): Merge branch 'master' of https://github.com/karlnapf/shogun - http://bit.ly/eDQtHq11:58
CIA-31shogun: Soeren Sonnenburg master * rf981d87 / (2 files):12:06
CIA-31shogun: remove SG_UNSTABLE & whitespace cleanup12:06
CIA-31shogun: Serialization support is now there SG_UNSTABLE is no longer necessary.12:06
CIA-31shogun: In addition remove trailing whitespaces. - http://bit.ly/fjla8012:06
* serialhex finally goes to sleep! and will catch up on whats been going on later!!!12:20
blackburnsonney2k: why do CDotFeatures re-order vectors? :)12:21
blackburnoh, may be my fault12:24
@sonney2kblackburn, it doesn't12:29
blackburnsonney2k: my fault, load_numbers from examples read file in a strange way12:30
@sonney2kblackburn, not really anything near optimzied12:30
blackburnfor some reason, if I give it, for example12:30
blackburn1 212:30
blackburn2 312:30
blackburnit will produce vectors (1 2) , (2 3)12:31
@sonney2kyes one by column12:31
blackburnthought that one string is one vector12:31
@sonney2kblackburn, there is this confusion we have no solution for: matlab, octave, R matrices are column major so one column== one vector12:32
blackburnso, if I want to test it on 5 vectors12:32
@sonney2kin ascii formats it is supposedly the opposite but - no idea to make this cleanly12:32
blackburni should do sth like12:32
blackburn1 2 3 4 512:33
blackburn1 2 3 4 512:33
blackburnfor (1,1) , ... (5,5)12:33
blackburnright?12:33
blackburnin file, I mean12:33
@sonney2kmeh12:33
@sonney2kI don't know (I mix this up myself).12:33
blackburnI'm confused with it pretty much :)12:33
warpyi am trying to understand the difference between static and modular,  statis is basically adding a wrapper function for every shogun function and modular you already have the infrastructure, but you just add support for moving the data in and out of it. and swig talks to shogun and does everything for you?12:34
blackburnmay be Chris would help, but he is not answering at all :)12:34
@bettyboo:>12:34
blackburnseems that he is working on examples, if I understand it right12:34
@sonney2kblackburn, some people have to do the work they are paid for12:35
@sonney2k:D12:35
blackburnsonney2k: what do you mean?12:35
@sonney2kblackburn, well we are paid for doing research ... shogun is 'just' a side project :D12:36
blackburnI know12:36
@sonney2kblackburn, so it is very difficult to do research and answer questions all the time.12:36
@sonney2kthat is why12:36
blackburnsonney2k: ah, I mean he is not answering in irc :)12:37
blackburnat least during last week12:37
blackburnbut answering mail12:37
@sonney2kwarpy, the static interface is what we had there in the beginning: one global variable for e.g. a classifier and some ascii like control functions12:37
@sonney2kthey work with almost all languages12:38
blackburnI did12:38
blackburn1 1 2 2 3 312:38
blackburn4 4 5 5 6 612:38
blackburnand it produced (1,4) , (1,4) , (2,5), (2,5), (3,6), (3,6)12:38
@sonney2kbut you cannot have e.g. multiple classifiers interacting etc12:38
blackburnso, seems to be right12:38
warpycan you elaborate a little more sonney2k12:38
@sonney2klooks like12:38
@sonney2kwarpy, I don't know in which way - have a look at the examples for static / modular then you see the difference12:39
warpyi actually did look12:39
@sonney2kwarpy, modular interfaces are just the C++ classes with some functions removed/renamed/parameter translated12:39
blackburnseems that my GNB is training now, hooray12:41
-!- sploving [~sploving@124.16.139.196] has joined #shogun12:41
blackburnhave to play on balalayka now12:41
splovinghello sonney2k. I saw you email. thx. I still have a question.12:42
@bettyboohey12:42
@sonney2ksploving, ask...12:42
@sonney2kblackburn, heh :)12:42
@bettybooHA12:42
splovingevery time we need require("Kernel"), require("Feartures"), are there way we just require("shogun")12:43
@sonney2kblackburn, try to beat an SVM ;-)12:43
@bettyboosonney2k, HA :>12:43
blackburnsonney2k: with gaussian naive bayes? oh, no way12:43
@sonney2ksploving, I mean we could have a simple shogun.lua or so that loads all the modules.12:43
splovingThat is a good idea.12:44
splovingLet me have a try12:44
@sonney2k(like the init_shogun script I generate for octave)12:45
splovingI have not notice it. I will take a look at it12:45
blackburnsonney2k: should set_features() in classifiers set _test_ features or _train_ features?12:46
blackburnor may be I should make "set_test_features()" and "set_train_features()"?12:47
blackburnhttps://github.com/shogun-toolbox/shogun/network is impressive :D12:49
@sonney2kblackburn, we only have one set of features12:50
blackburnsonney2k: so, what should set_features() set? features to be classified, or train ones?12:50
@sonney2kwell both12:51
blackburnboth?!12:52
@sonney2kwell these objects have just one feature set12:52
@sonney2kwhen you clall train() they train on this12:52
@sonney2kand if you call test then it will test on them12:53
@sonney2kerr classify()12:53
blackburnoh12:53
blackburnI see now, thank you12:53
blackburnit's a miracle! it's working!12:55
blackburnhehehe12:56
blackburnnow will have fun with nuclear missles and drink vodka12:56
-!- Tanmoy [75d35896@gateway/web/freenode/ip.117.211.88.150] has joined #shogun13:02
blackburnsonney2k: I'll make a pull request for your comments on CGNB, okay?13:12
-!- sploving [~sploving@124.16.139.196] has quit []13:19
-!- sploving [~root@124.16.139.196] has joined #shogun13:23
-!- blackburn [~qdrgsm@188.122.237.148] has quit [Read error: Operation timed out]13:53
-!- blackburn [~qdrgsm@188.122.237.148] has joined #shogun13:55
splovinghello sonney2k13:56
splovingi had a try. it works13:57
splovingI define a file shogun.lua, and write all the require.13:58
splovingI aso use "Labels = Features.Labels", so that we just need call "x = Labels()", not need call "x = Features.Labels()"13:59
-!- josip [~josip@unaffiliated/josip] has joined #shogun14:11
-!- skydiver [4deac315@gateway/web/freenode/ip.77.234.195.21] has quit [Ping timeout: 252 seconds]14:21
@sonney2ksploving, great14:57
splovingthere are a lot of subkernel in kernel file. I need rename them all14:58
splovingDotKernel = Kenel.DotKernel14:58
splovingcould we use the swig to rename?14:58
blackburnsonney2k: GNB is here, if you will have time, please take a look on it14:59
-!- blackburn [~qdrgsm@188.122.237.148] has quit [Quit: Leaving.]15:35
-!- siddharth [~siddharth@117.211.88.150] has quit [Remote host closed the connection]15:44
-!- siddharth [~siddharth@117.211.88.150] has joined #shogun15:47
-!- sploving [~root@124.16.139.196] has quit [Ping timeout: 246 seconds]16:06
-!- sploving [~root@124.16.139.196] has joined #shogun16:07
-!- sploving [~root@124.16.139.196] has left #shogun []16:10
CIA-31shogun: Baozeng Ding master * rd03da92 / src/lua_modular/shogun.lua : init shogun in lua - http://bit.ly/fChGQS16:15
CIA-31shogun: Soeren Sonnenburg master * r85fa746 / src/lua_modular/shogun.lua : Merge branch 'master' of https://github.com/sploving/shogun - http://bit.ly/e7J1i616:15
CIA-31shogun: Soeren Sonnenburg master * r6a817ec / (5 files in 3 dirs): Merge branch 'master' of https://github.com/SergeyLisitsyn/shogun - http://bit.ly/h9nCOR16:17
-!- yayo3 [c371f1a6@gateway/web/freenode/ip.195.113.241.166] has joined #shogun16:24
CIA-31shogun: Soeren Sonnenburg master * r4dd2b60 / (3 files): Merge branch 'master' of https://github.com/Bautista/shogun - http://bit.ly/fYoGlH16:46
CIA-31shogun: Konrad Rieck master * r4f69e19 / README : fixed typos in README - http://bit.ly/dPWSY416:51
-!- yayo3 [c371f1a6@gateway/web/freenode/ip.195.113.241.166] has quit [Quit: Page closed]17:00
CIA-31shogun: Soeren Sonnenburg master * rfcc7455 / (9 files in 2 dirs): Merge branch 'master' of https://github.com/ahmaurya/shogun - http://bit.ly/dTuYlt17:04
@knrrrdbaaaack.17:09
@knrrrdbettyboo: did you record all the conversations? so that you have something to keep in mind ;)17:10
@bettybooknrrrd: I have implemented a fast nearest neighbor classification (in case of k=1) in CKNN class. what should I do after cleaning and commenting to get it commited?17:10
@knrrrdbettyboo: nearest neightbor is similar to remembering stuff, but I was just asking if you kept stuff in mind17:11
@bettybooknrrrd: i am just asking which one of those typemaps would you suggest as the closest most readable example to use as a base17:11
-!- akhilvij [75d35896@gateway/web/freenode/ip.117.211.88.150] has joined #shogun17:13
@knrrrdbettboo: i am confused17:13
@knrrrdi mean "bettyboo"17:13
@bettybooknrrrd: I mean should I do this?17:13
@knrrrdyes, you should ;)17:14
@bettybooyeah!?!17:14
-!- alesis-novik [~alesis@188.74.87.84] has quit [Quit: I'll be Bach]17:17
-!- knrrrd is now known as mlsec17:18
-!- mlsec [~knrrrd@bane.ml.tu-berlin.de] has quit [Quit: ZNC - http://znc.sourceforge.net]17:19
-!- mlsec [~mlsec@bane.ml.tu-berlin.de] has joined #shogun17:20
-!- mode/#shogun [+o mlsec] by ChanServ17:20
@mlsecwe received almost 70 applications!17:24
@mlsecthat's incredible.17:24
@mlsecthanks for your support17:24
-!- akhilvij [75d35896@gateway/web/freenode/ip.117.211.88.150] has quit [Ping timeout: 252 seconds]17:28
CIA-31shogun: Soeren Sonnenburg master * r3bb5ffe / (2 files): minor coding style changes in gaussiankernel - http://bit.ly/fLSeQB17:50
CIA-31shogun: Soeren Sonnenburg master * r7ba79c1 / .gitignore : ignore generated *.cs in c# interface - http://bit.ly/eV09zs17:50
dvevrehey sonney2k. how useful do you think it will be to have a standard serialization format (like google's protocol buffers) for shogun?18:29
@bettyboomorning18:29
dvevrebettyboo: g'morning to ya!18:29
@bettyboodvevre: in kpca, you have a set of vectors and your learn a new basis in the kernel-induced feature space.18:29
dvevrebecause i'm going to work on that for vw18:29
dvevreso i thought why not try getting that into shogun as well18:29
-!- blackburn [~qdrgsm@188.168.14.95] has joined #shogun19:11
-!- blackburn [~qdrgsm@188.168.14.95] has quit [Quit: Leaving.]19:44
-!- akhil_ [75d35896@gateway/web/freenode/ip.117.211.88.150] has joined #shogun19:45
-!- ameerkat [~ameerkat@184-98-140-155.phnx.qwest.net] has joined #shogun19:50
@sonney2kdvevre, I don't even know googles protocol buffers20:16
dvevresonney2k: its google's way of serializing data.. and is becoming industry standard, apparently20:17
dvevrethey say it's optimized for storing large datasets too20:17
dvevrethe vw team is planning to replace their custom cache format with this.. and i was suggested to look into it20:18
@sonney2kdvevre, so you propose to do this for C++ objects too20:18
@sonney2k?20:18
dvevrehttp://code.google.com/apis/protocolbuffers/docs/cpptutorial.html20:18
@sonney2kor just for data20:18
dvevreyeah20:18
dvevrefor shogun features objects20:18
@sonney2ksorry have to leave20:19
@sonney2kwill be back in 1-2hrs20:19
@bettyboomorning20:19
dvevrebye20:19
@bettyboonite20:19
-!- akhil_ [75d35896@gateway/web/freenode/ip.117.211.88.150] has quit [Quit: Page closed]20:21
-!- blackburn [~qdrgsm@188.168.14.95] has joined #shogun20:34
blackburnhttps://github.com/shogun-toolbox/shogun/network looks like underground scheme :D20:39
@bettybooyeah20:39
-!- warpy [~warpy@bzq-79-182-10-204.red.bezeqint.net] has quit [Quit: Try HydraIRC -> http://www.hydrairc.com <-]20:43
-!- Tanmoy_ [75d35896@gateway/web/freenode/ip.117.211.88.150] has joined #shogun20:52
-!- blackburn1 [~qdrgsm@188.168.5.156] has joined #shogun21:08
-!- blackburn [~qdrgsm@188.168.14.95] has quit [Ping timeout: 240 seconds]21:09
-!- blackburn1 is now known as blackburn21:09
-!- dvevre [b49531e3@gateway/web/freenode/ip.180.149.49.227] has quit [Ping timeout: 252 seconds]21:09
CIA-31shogun: Rafał Surowiecki master * r47bc5b4 / (3 files in 2 dirs): SparsePolyFeatures and RationalQuadraticKernel post-review fixes - http://bit.ly/dSfERr21:45
CIA-31shogun: Rafał Surowiecki master * r520f75c / (14 files in 4 dirs): Merge - http://bit.ly/gaAPvz21:45
CIA-31shogun: Heiko Strathmann master * r7f0b001 / (3 files): Added implementation of the 'Distant Segments'-string-kernel - http://bit.ly/hwY3zs21:45
CIA-31shogun: Heiko Strathmann master * r34b078e / src/libshogun/kernel/GaussianKernel.h : renamed member variable compact to m_compact. fixes a compile error - http://bit.ly/hlKmAc21:45
CIA-31shogun: Soeren Sonnenburg master * rdd3033b / (5 files in 3 dirs): Merge branch 'master' of https://github.com/vzxzcz/shogun into klaus - http://bit.ly/h8mZNN21:45
blackburnsonney2k: one more pull for CGNB, forgot some type check21:46
blackburnreally forgot it :)21:51
@bettyboolol ;D21:51
CIA-31shogun: Soeren Sonnenburg master * rabe1f10 / (2 files): Merge branch 'master' of https://github.com/SergeyLisitsyn/shogun - http://bit.ly/ijMPSn21:51
blackburnthank you21:52
@sonney2kserialhex, OK now I believe you finally :)21:54
@sonney2kblackburn, thanks for the patch21:54
@sonney2kreally hard to find problems in you patch now - so good that you critically revised it on your own :)21:55
@bettyboo;>21:55
-!- blackburn [~qdrgsm@188.168.5.156] has quit [Ping timeout: 246 seconds]21:56
-!- blackburn [~qdrgsm@188.168.4.84] has joined #shogun21:57
blackburndamn cable!21:57
@sonney2k<sonney2k> serialhex, OK now I believe you finally :)21:57
@sonney2k<sonney2k> blackburn, thanks for the patch21:57
@sonney2k<sonney2k> really hard to find problems in you patch now - so good that you critically revised it on your own :)21:57
@bettyboo;D21:57
blackburnsorry for getting disconnected often21:58
blackburnsonney2k: so, is it okay? glad to hear it! :)21:59
serialhexsonney2k: no problem!  i'm going to work on getting the float64_t version workin in swig tonight22:01
@sonney2kserialhex, what is the problem with it?22:02
blackburnI'm lost with what to do next :D22:02
@bettybooblackburn, rahaha22:02
serialhexi can't remember _exatly_ the exception that it threw, but it was something to the extent of: "i dont know which version to use float32 or 64, clarify or i'll just sit here and do nothing"22:03
serialhexthat's WAY paraphrasing, but you get the idea, if you want to see it uncomment the float64 version & compile... you'll see it22:04
-!- ameerkat [~ameerkat@184-98-140-155.phnx.qwest.net] has quit [Ping timeout: 240 seconds]22:04
@sonney2kblackburn, russian doc :-)22:04
@bettyboosonney2k, he22:05
@sonney2kserialhex, hmmhh tthat could be22:05
blackburnsonney2k: oh, I could get myself 'behind' with not writing code :)22:06
@bettyboo;>22:06
blackburnif I will start translating22:06
@sonney2kheh22:06
blackburnas you see, I hope to get into GSoC with shogun :))22:06
blackburnanyway I really don't know what to do next and will translate it a little22:07
@sonney2kblackburn, if you want you can have a look at PCACut.h ...22:09
@sonney2kthat is a preproc that does pca and then removes dimensions if the eigenvalues are below some threshhold22:10
blackburn:) are you kidding? I know what is PCA :)22:10
@bettyboohihi22:10
blackburnI'm applying to dim.reduction idea!22:11
blackburn:)22:11
@bettyboo 22:11
@sonney2kblackburn, no kidding - I don't know if you know shogun's preproc framework22:11
blackburnah, you mind shogun-specific ;)22:12
@bettybooblackburn, ;D22:12
@sonney2kyou could extend PCACut to either reduce to a fixed number of dimensions or to eigenvalue<eps22:12
blackburnsonney2k: I don't know, seems that people who will realize KPCA during GSoC will fix it up22:13
blackburnif that idea will take place22:13
@sonney2kblackburn, if you want to do more advanced stuff - same for KPCACut.22:13
blackburnsonney2k: anyway, thank you for 'idea', I'll look it a bit later :)22:14
@sonney2kblackburn, well you could of course write python examples for all the new kernels if you like22:14
blackburnsonney2k: btw, that is the matter with it? I mean there is no graphics or etc, how could one realize that classifier works?22:15
blackburnwhat*, sorry22:15
@sonney2kI don't understand22:16
blackburnsorry :)22:16
@bettyboolol ;D22:16
blackburnI wrote a test in python for CGNB and it doing almost nothing22:16
blackburnand don't representing itself's results22:16
blackburnsame thing with other classifiers22:16
@sonney2kblackburn, CGNB was multiclass classifier but needs linearly separable data?22:18
blackburnsonney2k: it don't22:18
@sonney2kI mean visualize the multiclass data22:19
@sonney2kyou will see it is a few gauss blobs22:19
blackburnyeap, but there is no that visualization, that's it22:19
@sonney2kblackburn, well it has a train / test data set and NB should perfom not too bad on this...22:20
blackburnsorry for bad english :) trying to translate intro and switching languages in my mind22:20
blackburnsonney2k: I'm sure it will, but when we launch that test we see nothing, it classifies something and then exit22:21
blackburnoh, translating machine learning text is difficult :D understand it right but thinking about proper words in russian verrrrry slow22:25
blackburnsonney2k: oh, it seems that i will have troubles with some terms22:33
@sonney2kblackburn, just read the chinese docuemntation then 8-)22:33
blackburnmay I jump from a window first? :)22:33
@bettyboorahaha ;D22:33
blackburnsonney2k: for example, there is no russian term for 'multiple kernel learning'22:35
@sonney2kblackburn, I can imagine22:35
blackburnwill write множественное ядровое обучение :D22:35
@bettyboofunny22:35
blackburnI have same troubles when lecturing machine learning at my university22:36
blackburnsometimes used english terms22:36
blackburnthere is no machine learning teachers so I tried to be one :D22:38
@bettyboo;D22:38
blackburnsonney2k: is linear programming machine = machine of linear programming (looks ugly, but will help to translate)22:42
@sonney2kblackburn, it is a svm with l1-regularization22:42
blackburnso, SVM is машины опорных векторов :) it could be машины линейного программирования22:43
@bettyboo;D22:43
blackburnthere is an inversed order, I think you know, so have to do some separation22:44
blackburnsonney2k: pre-pre-beta of introduction http://pastebin.com/DUtXyYLF :)22:51
@sonney2kblackburn, I can even reas some things: what does обучения mean?22:52
blackburnlearning :)22:52
@sonney2kheh22:53
@sonney2kvery nice22:53
CIA-31shogun: Soeren Sonnenburg master * r979e303 / src/Makefile.template : fix make doc / make install targets for csharp,lua,... - http://bit.ly/g1QPBi22:54
blackburnsonney2k: will make it more 'smoothly', now it looks like translation22:54
@sonney2kwell you can use google translate :)22:54
blackburnit will make some terrible thing22:55
@sonney2kheh22:55
siddharthsonney2k, what should we do next to get to know shogun?...have been busy lately with my research paper22:56
siddharthjust want to start with the basics...so where should I look first?22:57
@sonney2kblackburn, I have some comment for your CGNB - maybe you rename it to Naive Bayes ... and btw, there is CMath::sq(x) that you can use instead of pow(x,2)22:57
blackburnsonney2k: there is a difference between GNB and NB (with no G)..22:58
blackburnas for sq, will do it now22:58
@sonney2kblackburn, then GaussianNaiveBayes - more readable22:58
blackburnah, I see now22:58
@sonney2kblackburn, we already have too many abbrv's in shogun that even I forget what they stand for, GMNPSVM, etc22:59
blackburn:) okay, no problem22:59
@bettybooyeah22:59
siddharthsonney2k, any comments?22:59
@sonney2ksiddharth, anything related to your project or enjoy doing. if you are desperately looking for something to work on - well look for SG_NOTIMPLEMENTED or SG_UNSTABLE and fix serialization or implement some (simple algorithm)23:00
siddharthsonney2k, I was thinking of introducing conceptual learning..23:01
siddharthcandidate elimination algorithm23:02
* sonney2k does not know what this does / is23:03
blackburncandidate elimination could be good algorithm for you now, sonney2k :)23:03
@bettyboo:>23:03
blackburnwith these 60 candidates :D23:03
@bettybooyep23:04
@sonney2k:)23:04
-!- Tanmoy [75d35896@gateway/web/freenode/ip.117.211.88.150] has quit [Ping timeout: 252 seconds]23:05
siddharthsonney2k, Its basically learning from examples23:07
siddharthhttp://www.google.co.in/url?sa=t&source=web&cd=3&ved=0CCIQFjAC&url=http%3A%2F%2Fwww.site.uottawa.ca%2F~nat%2FCourses%2FCSI5387%2FML_Lecture_2.ppt&ei=Hm2jTfSQMszHrQfgjYGNAw&usg=AFQjCNE9h6daJchjGXhSbhiYjj6V9cWBAA&sig2=IsbBHRdR9lbv-XR0LPXcTA23:07
siddharthhere is a ppt23:07
blackburnthat link is damn awful :)23:07
siddharth:P23:08
siddharthor I can start with my SVM work23:09
blackburnsonney2k:23:09
@sonney2ksiddharth, I see - when does one use this nowadays?23:09
blackburn./kernel/GaussianKernel.h:118: error: ‘m_compact’ was not declared in this scope23:09
@sonney2kblackburn, git pull I hope23:09
@sonney2k(my bad)23:10
blackburnah23:10
blackburnokay )23:10
siddharthsonney2k, dont know for sure...btw did you read my application23:10
blackburnnow working, thanks23:11
blackburnforgot to merge with upstream :)23:11
@bettyboo:>23:11
-!- dvevre [b49531e3@gateway/web/freenode/ip.180.149.49.227] has joined #shogun23:16
siddharthsonney2k, whenever you read my application,can you write some comments/suggestions so that I can work on that?23:17
blackburnsonney2k: pull request created23:21
blackburnsonney2k: renamed and tested it23:21
blackburnhave to leave now, see you later23:22
@sonney2ksiddharth, I read both of them - it is very hard for me to ask specific questions that are not a lot of work23:22
-!- blackburn [~qdrgsm@188.168.4.84] has quit [Quit: Leaving.]23:23
@sonney2ksiddharth, I mean if you could e.g. show that you can wrap sgd-qn or newton svm already you would certainly be in - but that is a lot to ask for and I really don't see anything in between *sigh*23:24
siddharthsonney2k, hmm I see...well then I will start working on this and give you update23:25
@sonney2ksiddharth, I think integrating SGD-QN should be very easy23:26
@sonney2kso I would start with that23:26
siddharthsonney2k, ok I will look into that...thanks for the help23:26
siddharth:)23:26
CIA-31shogun: Sergey Lisitsyn master * re5fa152 / (8 files in 3 dirs): Renamed GNB to GaussianNaiveBayes - http://bit.ly/dLX7ca23:27
siddharthsonney2k,  one more question...shogun does not have kernel k means right?23:28
@sonney2ksiddharth, you probably have had a look at http://www-etud.iro.umontreal.ca/~bordesa/mywiki/doku.php?id=sgdqn already23:29
siddharthyes23:29
@sonney2kthe file svmsgd2.cpp in there is what shogun's sgd is based on (I just converted it to use the operations from CDotFeatures - hopefully correclty)23:29
@sonney2kso svmsgdqn.cpp is the one to translate ...23:34
siddharthI was not clear about the calibrate function in SVMSGD....I will again have a look at it23:34
@sonney2ksiddharth, me neither - I just tried to translate what was there23:34
siddharthok then I will start working upon it23:34
@sonney2ksiddharth, no guarantees that I haven't made a mistake though....23:34
@sonney2ksiddharth, no we don't have kernel k-means23:34
siddharthsonney2k, I will let you know if I find any...also will see about the kernel k means23:34
@sonney2ksiddharth, ok thanks!23:35
siddharththank u too :)23:36
@bettyboorahaha ;> siddharth23:36
siddharthhmm hi bettyboo..long time23:37
@bettyboosiddharth: then you can mess around in your git and push to your repository when you are ready23:37
@bettyboosiddharth, hiho23:37
siddharth as u say bettyboo23:37
@bettyboosiddharth: (features need to be in GPU mem etc)23:37
siddharthok i wil do that bettyboo23:38
@bettyboosiddharth: I see, will do a fix in a minute23:38
@sonney2kgood night23:41
dvevregood night. see you in 2 days23:42
-!- Tanmoy_ [75d35896@gateway/web/freenode/ip.117.211.88.150] has quit [Ping timeout: 252 seconds]23:57
--- Log closed Tue Apr 12 00:00:36 2011

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!