IRC logs of #shogun for Tuesday, 2013-05-21

--- Log opened Tue May 21 00:00:11 2013
-!- zxtx [~zv@ool-ae2cb78a.dyn.optonline.net] has joined #shogun00:16
-!- zxtx [~zv@ool-ae2cb78a.dyn.optonline.net] has quit [Ping timeout: 256 seconds]00:24
-!- van51 [~van51@athedsl-320452.home.otenet.gr] has left #shogun ["QUIT :Leaving."]00:29
hushellsonney2k, are you still here?01:38
hushellsonney2k, how do I update the documentation? It's my bad forgetting the change of comment.01:39
-!- zxtx [~zv@ool-457e751d.dyn.optonline.net] has joined #shogun01:50
-!- nube [~rho@49.244.76.69] has joined #shogun03:04
-!- nube [~rho@49.244.76.69] has quit [Ping timeout: 248 seconds]03:34
-!- nube [~rho@36.252.251.34] has joined #shogun03:36
-!- pickle27 [~kevin@rcv3-lab-pc.ee.queensu.ca] has quit [Quit: Leaving]03:40
-!- nube [~rho@36.252.251.34] has quit [Ping timeout: 256 seconds]03:44
-!- nube [~rho@49.244.67.77] has joined #shogun03:54
-!- nube [~rho@49.244.67.77] has quit [Ping timeout: 252 seconds]04:12
-!- foulwall [~foulwall@2001:da8:215:503:4172:782d:f853:e6d6] has joined #shogun04:56
-!- nube [~rho@116.90.239.3] has joined #shogun05:44
-!- nube [~rho@116.90.239.3] has quit [Quit: Leaving.]06:18
-!- nube [~rho@116.90.239.3] has joined #shogun06:19
-!- lambday [3ba2174c@gateway/web/cgi-irc/kiwiirc.com/ip.59.162.23.76] has joined #shogun06:55
-!- nube [~rho@116.90.239.3] has quit [Ping timeout: 264 seconds]07:43
-!- nube [~rho@116.90.239.3] has joined #shogun07:47
-!- hushell [~hushell@8-92.ptpg.oregonstate.edu] has quit [Ping timeout: 248 seconds]08:12
-!- hushell [~hushell@c-67-189-100-116.hsd1.or.comcast.net] has joined #shogun08:29
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun08:35
shogun-notifier-shogun: Soeren Sonnenburg :develop * 6acfcf4 / tests/unit/mathematics/Random_unittest.cc: https://github.com/shogun-toolbox/shogun/commit/6acfcf44b9a3750530111202c11c3c8e9ec4e60f08:35
shogun-notifier-shogun: add unit tests for some CMath::random functions08:35
@sonney2khushell, the documentation is just the doxygen stuff in every .h file!08:35
@sonney2kgtg08:35
@sonney2kbrb08:35
-!- lisitsyn [~lisitsin@mxs.kg.ru] has joined #shogun08:50
-!- mode/#shogun [+o lisitsyn] by ChanServ08:50
-!- iglesiasg [c1934d18@gateway/web/freenode/ip.193.147.77.24] has joined #shogun09:10
-!- iglesiasg [c1934d18@gateway/web/freenode/ip.193.147.77.24] has quit [Ping timeout: 250 seconds]09:14
-!- sonne|work [~sonnenbu@sams-office-nat.tomtomgroup.com] has joined #shogun09:15
-!- iglesias [c1934d18@gateway/web/freenode/ip.193.147.77.24] has joined #shogun09:16
-!- iglesias is now known as iglesiasg09:17
-!- mode/#shogun [+o iglesiasg] by ChanServ09:17
-!- nube [~rho@116.90.239.3] has quit [Read error: Connection reset by peer]09:18
-!- nube [~rho@116.90.239.3] has joined #shogun09:18
-!- iglesiasg [c1934d18@gateway/web/freenode/ip.193.147.77.24] has quit [Ping timeout: 250 seconds]09:25
foulwallmorrning sonne|work09:37
sonne|workfoulwall: good morning!09:37
foulwallsonne|work: I've no idea of which data I use in the demo.09:39
foulwall'/toy/label_train_regression.dat'09:40
sonne|workfoulwall: what I have in mind is that the user gets a listing with available data sets (e.g files in data/toy/*)09:40
sonne|workand then can select the one09:41
sonne|workfoulwall: yes we have to standardize the format / filename otherwise it is a mess09:41
foulwallsonne|work: all right.09:43
sonne|workfoulwall: it is kind of difficult to make a decision here since there are tons of data formats09:50
foulwallsonne|work: I'll standardize them at first.09:51
sonne|workfoulwall: I *think* the best way forward would be only support toy/*.h5 for now09:53
sonne|workand then use h5py to read in the data09:53
sonne|workfoulwall: this is how you can read it http://mldata.org/about/hdf5/example/09:54
@lisitsynsonne|work: eine wuenderschoenen guten morgen09:55
@lisitsyn:D09:55
foulwallsonne|work: ok09:55
sonne|worklisitsyn: yeah weather cooled down09:56
@lisitsynsonne|work: was ist das wetter da?09:57
foulwallsonne|work: I've got a bad headache, progress might not be  so fast today...09:57
@lisitsynwe have cooled to +15 or +20 here09:57
sonne|worklisitsyn: yeah 14 C here too10:10
sonne|workfoulwall: then get some sleep!10:10
foulwallsonne|work: :)  thanks10:11
foulwallsonne|work: I slept too much and get the headache.10:12
lambdayhi sonne|work:, lisitsyn:... good morning :)10:12
sonne|workfoulwall: I wish I could say that10:12
sonne|worklambday: morning!10:12
lambdaysonne|work: if we use an external library (arprec in this case), what changes shall I make so that shogun configures for it?10:14
-!- foulwall [~foulwall@2001:da8:215:503:4172:782d:f853:e6d6] has left #shogun []10:15
-!- foulwall [~foulwall@2001:da8:215:503:4172:782d:f853:e6d6] has joined #shogun10:15
sonne|worklambday: for now I would just say you do a #ifdef HAVE_ARPREC ... #endif in your code and manually change the .config file to contain the appropriate compiler/link flags10:16
@lisitsynlambday: what is arprec?10:16
sonne|worklambday: if using arprec turns out to be useful we add some small code snippet to shogun10:16
sonne|worklisitsyn: lmgify10:16
@lisitsynsonne|work: what?10:16
lambdaysonne|work: manually change the configure file - okay I'm checking10:17
@lisitsynI can add10:17
@lisitsynthat thing10:17
@lisitsynlambday:10:17
sonne|worklisitsyn:  http://lmgtfy.com/?q=arprec10:17
lambdaylisitsyn: arprec is for arbitrary precision10:17
lambdayfor higher precision10:17
@lisitsynsonne|work: I can do that ;)10:17
lambdaylisitsyn: thanks..10:18
@lisitsynlambday: but tonight10:18
@lisitsynlambday: just do the thing that evil sonne|work suggests10:18
lambdayactually very high precision is needed for this - 1E-19, and std math functions show differences than the arprec version10:18
sonne|worklambday: could you perhaps work in log-space?10:19
sonne|workI did so when I had thousands of  products of small probabilities10:19
lambdaysonne|work: nice idea! let me check10:19
sonne|worklambday: the other trick is to scale the data (e.g. carray some multiplier with it)10:20
sonne|workcarry10:20
lambdaysonne|work: hmm... actually we need to use math functions - sin, cos, sinh, tanh etc.. would the carry thing work in that?10:22
lambdaylisitsyn: lol@evil sonne|work: :D10:22
sonne|worklambday: lisitsyn needs his morning vodka to get his brain started *eg*10:23
lambdaylol... :D10:23
lambdaylisitsyn: I'll also have some :D10:23
@lisitsynI see no package for arprec in debian10:24
sonne|worklambday: you have to think it through... it might make things more complex / might not work for all needed operations10:24
lambdaysonne|work: okay... let me check... may be arprec thing would be easy10:24
@lisitsynlambday: can we stick to GNU MP?10:24
sonne|worklambday: if it is not in debian - then almost no one will have this installed10:25
@lisitsynit is maintained10:25
sonne|workso a different solution would be much perferred10:25
lambdaysonne|work: ummm... yes you're right10:25
lambdaylisitsyn: I haven't worked in mp, I'll check today then... sounds better10:26
@lisitsynsonne|work: what about you, have you already got your beer and sausages? :D10:26
sonne|worklisitsyn: no but I wear my lederhosen as usal10:28
sonne|workusual10:28
lambdayits 32 C here and we're burning :(10:30
@lisitsynlambday: just go to votjakovr's place you are going to like it10:31
lambdayhe's also from russia right?10:31
@lisitsynlambday: yes barnaul, north-east from you10:32
lambdaylisitsyn: lol I'll drop by his place in the eve then, have some beer and vodka :D10:35
sonne|worklambday: but watch the polar bears!10:37
@lisitsynsonne|work: they are *polar*10:37
@lisitsynnot like phi rho10:37
@lisitsynI mean they are much northern :D10:37
lambdaywhoa!10:38
lambdayawesome!10:38
lambdaylisitsyn: does gmp support complex numbers?10:38
@lisitsynlambday: I don't know I just guessed something more maintained :)10:38
lambdaylisitsyn: okay I'm checking10:38
sonne|worklambday: and long double is not enough?10:41
sonne|work... floatmax_t in shogun10:41
sonne|workcan be anything from 96 bits to 128bits10:41
lambdaysonne|work: oh.. I haven't checked with that... I used float64_t... let me try10:42
lambdaynope - this is what I get using arprec (m=0.00186744273288133783884890082305219038971699774265289306640625), and this is using long double (m=0.00186744273288133848937020431435485079418867826461791992187500)10:46
sonne|worklambday: but seriously best would be you could work in logspace or so - that doeasn't seem right...10:47
@lisitsynhahah precise guy10:47
lambdaysonne|work: hmmm... yes.. I'll think about it10:48
lambdaylisitsyn: I really want to get the difference below 1E-19 :(10:48
@lisitsynlambday: what's that? an inverse of $ GSoC student receives in the welcome package?10:49
lambdaylisitsyn: LOL I think that's 0.0002 :P10:50
@lisitsynlambday: want whole money in the welcome package?10:51
@lisitsyn:D10:51
lambdaylisitsyn: oh I overlooked "welcome" lol10:51
@lisitsyn500 - 2250 - 225010:51
lambdaythat makes it 0.00210:51
lambdaylol10:51
-!- iglesiasg [~iglesias@193.147.49.60] has joined #shogun11:00
-!- mode/#shogun [+o iglesiasg] by ChanServ11:00
@lisitsynbom dia iglesiasg11:00
gsomixgood morning11:00
@iglesiasglisitsyn, hola!11:01
@lisitsyniglesiasg: como estas?11:02
@iglesiasglisitsyn, bien, y tú?11:04
@iglesiasglearning some Spanish?11:04
@lisitsyniglesiasg: no :D11:04
@lisitsyniglesiasg: I am at dos cervezas por favor level in both spanish/portuguese11:05
@lisitsynwith no progress :D11:05
@iglesiasghaha11:06
@iglesiasgfair enough11:06
@lisitsyniglesiasg: for some reason I remember11:09
@lisitsynacento agudo acento grave11:10
@lisitsynacento circumflexo11:10
@lisitsyn:D11:10
@iglesiasglisitsyn, wow that's something funny to remember probably11:12
@iglesiasglisitsyn, but that's French I think11:12
-!- van51 [~van51@195.251.235.71] has joined #shogun11:13
@lisitsyniglesiasg: portuguese!11:13
@lisitsyna` a' a~ a^11:13
@iglesiasgaham11:13
@lisitsyniglesiasg: are there such things in spanish?11:14
@iglesiasgiglesiasg, I didn't know they have ^ in Portuguese11:14
@lisitsynha!11:14
@iglesiasgtalking to me again11:14
@iglesiasganyway11:14
@iglesiasglisitsyn, we have this one á11:15
@iglesiasgfor every vowel11:15
@lisitsyniglesiasg: I see '?'11:15
@lisitsyn:)11:15
@lisitsynwhat about ~?11:15
@iglesiasgno11:15
@iglesiasgjust over the n hehe11:15
@iglesiasgñ11:15
@lisitsynlike in sa~o paulo11:15
@lisitsynespan~a11:15
@lisitsynI have t-shirt11:16
@lisitsynespan~a11:16
@lisitsyniglesiasg: so it sounds espanha?11:17
@iglesiasglisitsyn, sort of11:17
@lisitsynlike sanh paulu11:17
lambdayespanya?11:17
-!- vgorbati_ [5b8ea25a@gateway/web/freenode/ip.91.142.162.90] has joined #shogun11:18
@lisitsyniglesiasg: what about the first part?11:18
@lisitsynlike t[ea] or [e]nd?11:19
-!- vgorbati [c3ee5cb1@gateway/web/freenode/ip.195.238.92.177] has quit [Quit: Page closed]11:19
@iglesiasglisitsyn, end11:19
@lisitsyniglesiasg: got it11:20
@iglesiasgpretty much like Spain :P11:20
@lisitsyniglesiasg: but that [e] is here still?11:20
hushellsonney2k, you mean I send a PR for the documentation?11:20
@iglesiasgyes11:20
@lisitsyniglesiasg: well russia is not russia but ro:ssiya11:21
@lisitsyn:D11:21
@lisitsynso sometimes it differs11:22
vgorbati_lisitsyn: hi, I looked through more kernels, and it looks like only string kernels and dot kernels share this pattern. I don't like the idea of subclassing both of them from some parent, instead I want to implement it this way: http://pastebin.com/PBZWmrU8. What do you think?11:22
@lisitsyniglesiasg: like Austria and Oesterreich11:22
@lisitsynvgorbati_: but what generality it offers?11:23
-!- iglesiasg [~iglesias@193.147.49.60] has quit [Quit: Saliendo]11:24
vgorbati_lisitsyn: it will work for both string kernels and dot kernels11:24
vgorbati_lisitsyn: for string kernels the call will look like11:24
@lisitsynvgorbati_: but string kernels are using SGString right?11:24
@lisitsynnot SGVector I mean11:24
vgorbati_lisitsyn: https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/kernel/string/LocalityImprovedStringKernel.cpp#L6611:25
-!- iglesiasg [~iglesias@193.147.49.92] has joined #shogun11:26
-!- mode/#shogun [+o iglesiasg] by ChanServ11:26
vgorbati_lisitsyn: they use char*, or uint16_t*, or uint32_t*11:26
@lisitsynah alright11:26
vgorbati_lisitsyn: so we can use SGVector of char, uint_16 or uint_3211:26
@lisitsynyeah sounds like a way11:26
@lisitsynvgorbati_: just to avoid one template parameter here11:27
vgorbati_lisitsyn: we can use template template arguments?11:28
@lisitsynvgorbati_: you may try to add a typedef11:28
@lisitsynto templated features11:28
@lisitsynlike typedef ST ElementType;11:28
@lisitsynthen you can get it back in that function11:28
@lisitsynwith FeatureType::ElementType11:28
vgorbati_lisitsyn: thanks, great idea11:29
-!- lambday [3ba2174c@gateway/web/cgi-irc/kiwiirc.com/ip.59.162.23.76] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]11:32
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]11:35
vgorbati_lisitsyn: then I will do it this way. I am also curious, why do StringFeatures (https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/features/StringFeatures.cpp#L222) return a copy of feature vector, while DenseFeatures (https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/features/DenseFeatures.cpp#L170) return the vector without copying?11:36
@lisitsynvgorbati_: I don't remember if there is a particular reason to do that11:38
@lisitsynmay be due to legacy (TM)11:38
vgorbati_lisitsyn: who may remember it?:)11:39
-!- nube1 [~rho@116.90.239.3] has joined #shogun11:39
-!- nube [~rho@116.90.239.3] has quit [Read error: No route to host]11:39
@lisitsynvgorbati_: sonne|work may be11:39
sonne|workvgorbati_: lisitsyn went berserk when trying to fix that11:47
-!- vgorbati_ [5b8ea25a@gateway/web/freenode/ip.91.142.162.90] has quit [Ping timeout: 250 seconds]11:48
sonne|workvgorbati_: yes we intend to never copy ...11:48
hushellHey guys, should I send a PR for a minor change of documentation?11:50
@lisitsynhushell: of course11:54
@lisitsynvery welcome11:54
hushellThat seems overkill, but also the only way ...12:01
hushellThanks for making sure this12:01
@lisitsynhushell: what seems?12:04
@lisitsynahh PR?12:04
@lisitsynyes but that's the only way so far12:04
hushellI got an error when make unit-tests ../src/shogun/mathematics/Math.h:458: undefined reference to `shogun::CMath::rand_state'12:47
hushellany idea how to fix it?12:47
hushellIt's strange after fetching the upstream the unit-tests don't compile, but make tests are okay12:57
hushell./classifier/svm/SVMOcas_unittest.cc.o: In function `shogun::CMath::init_random(unsigned int)':12:57
hushell/home/hushell/working/git-dir/shogun-test/tests/unit/../../src/shogun/mathematics/Math.h:458: undefined reference to `shogun::CMath::rand_state'12:58
@iglesiasghushell, not sure if a make clean might help there13:00
hushellhaha you made it13:02
hushellthe Make can detect new changes ... :(13:02
hushellcannot13:02
hushellThanks iglesiasg13:03
@iglesiasghushell, ;)13:03
hushellokay, I finish the PR, now I can go to sleep :) Hope you have a nice day!13:07
-!- hushell [~hushell@c-67-189-100-116.hsd1.or.comcast.net] has quit [Quit: WeeChat 0.3.7]13:07
-!- iglesiasg [~iglesias@193.147.49.92] has quit [Quit: Saliendo]13:15
-!- sijin [~smuxi@144.214.222.109] has joined #shogun14:01
-!- lambday [3ba2174c@gateway/web/cgi-irc/kiwiirc.com/ip.59.162.23.76] has joined #shogun14:04
-!- nube1 [~rho@116.90.239.3] has quit [Quit: Leaving.]14:11
-!- iglesiasg [~iglesias@193.147.49.92] has joined #shogun14:21
-!- mode/#shogun [+o iglesiasg] by ChanServ14:21
-!- zxtx [~zv@ool-457e751d.dyn.optonline.net] has quit [Ping timeout: 256 seconds]14:26
-!- vgorbati [4d2f8427@gateway/web/freenode/ip.77.47.132.39] has joined #shogun14:28
vgorbatilisitsyn: here?14:50
@lisitsynvgorbati: yes14:50
vgorbatilisitsyn: what if we go even further and also add a typedef for a used features type inside the kernel, then we will have only one template parameter?14:51
@lisitsynvgorbati: why not14:51
vgorbatilisitsyn: I am also wondering where to put this function. Is 'Kernel.h' a suitable place?14:52
@lisitsynvgorbati: as it is template it has to go to the header14:54
-!- thoralf [~thoralf@enki.zib.de] has joined #shogun14:55
thoralfHey.14:55
vgorbatilisitsyn: you mean I should create a new header file, or could I just use 'Kernel.h'?14:56
sonne|workthoralf: hey15:03
sonne|workvgorbati, lisitsyn what are you talking about?15:05
-!- vgorbati_ [4d2f8427@gateway/web/freenode/ip.77.47.132.39] has joined #shogun15:06
-!- vgorbati_ [4d2f8427@gateway/web/freenode/ip.77.47.132.39] has quit [Client Quit]15:06
-!- vgorbati_ [4d2f8427@gateway/web/freenode/ip.77.47.132.39] has joined #shogun15:06
-!- vgorbati [4d2f8427@gateway/web/freenode/ip.77.47.132.39] has quit [Ping timeout: 250 seconds]15:06
-!- vgorbati_ is now known as vgorbati15:08
-!- nube [~rho@36.252.225.240] has joined #shogun15:16
-!- lambday [3ba2174c@gateway/web/cgi-irc/kiwiirc.com/ip.59.162.23.76] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]15:18
-!- nube1 [~rho@49.244.29.35] has joined #shogun15:38
-!- vgorbati [4d2f8427@gateway/web/freenode/ip.77.47.132.39] has quit [Ping timeout: 250 seconds]15:40
-!- nube [~rho@36.252.225.240] has quit [Ping timeout: 256 seconds]15:41
gsomixsonney2k, sonne|work: hi. are you there? how are you?15:42
-!- van51 [~van51@195.251.235.71] has quit [Quit: Leaving.]15:43
-!- HeikoS [~heiko@nat-163-207.internal.eduroam.ucl.ac.uk] has joined #shogun16:09
-!- mode/#shogun [+o HeikoS] by ChanServ16:09
-!- pickle27 [~kevin@75.98.19.132] has joined #shogun16:41
pickle27hey everyone16:41
pickle27really like the new wrapped output from the makefile btw!16:41
pickle27iglesiasg, did you see the merged MCLDA with eigen3?16:42
-!- votjakovr [~votjakovr@host-46-241-3-209.bbcustomer.zsttk.net] has joined #shogun16:50
-!- lambday [3ba2174e@gateway/web/cgi-irc/kiwiirc.com/ip.59.162.23.78] has joined #shogun17:00
-!- sumit [75e247a5@gateway/web/freenode/ip.117.226.71.165] has joined #shogun17:00
lambdayHeikoS: hi17:01
@HeikoSlambday: hi!17:01
@HeikoShow is it going?17:01
lambdaywithout using high precision thing, we cannot achieve that much high precision it seems17:02
lambdaylike arprec or so17:02
@HeikoSlambday: I saw17:02
@iglesiasgpickle27, I have just taken a look17:02
@HeikoSso whats this other library?17:02
lambdayHeikoS: locally I configured shogun with arprec17:03
lambdaylog-scale thing is tough it seems17:03
lambdayusing gmc is another option17:03
@HeikoSlambday anything speaks against arpec?17:04
@HeikoSacprec17:04
@HeikoSlisitsyn: what do you think? you know all these libs17:04
lambdaywell, its not in debian...17:04
lambdayHeikoS: I was thinking - if we could have methods which uses arprec when its there otherwise just uses shogun's float, it should be fine, right?17:04
lambdaythat's what I'm trying to do17:05
@HeikoSlambday: yes, that would be a good way, but maybe a lot of work to code up17:05
@HeikoSwe could also just say, install lib to use the log-det samplers17:05
@HeikoSdo you think you can manage to do this quickly?17:05
lambdayHeikoS: we need it just for these two methods - won't take long17:05
@lisitsynHeikoS: what speaks against arprec17:05
@lisitsynis its absence in debian17:05
lambdaywe don't need ellPJC for real datatype anyway - just the complex version is fine17:06
@lisitsynno package no honey17:06
@lisitsyn:D17:06
pickle27ah got to go, later!17:06
-!- pickle27 [~kevin@75.98.19.132] has quit [Quit: Leaving]17:06
lambdaylisitsyn: may be, those who want to use these two particular methods better use arprec :D17:06
@HeikoSlambday: okay then17:07
@lisitsynlambday: lets chat about it a little bit later if you are online17:07
@HeikoSand what about http://gmplib.org/?17:07
@lisitsynI am moving out from job17:07
lambdaylisitsyn: sure..17:07
@lisitsynto my great 12m2 residence17:07
@lisitsyn:D17:07
@lisitsynsee you17:07
-!- lisitsyn [~lisitsin@mxs.kg.ru] has quit [Quit: Leaving.]17:07
lambday:)17:08
lambdayHeikoS: gmp has gmc for complex datatypes17:08
lambdaybut its in C, which makes the work terrible17:08
@HeikoSlambday: woulnt that be better than?17:08
@HeikoSah17:08
@HeikoSI see17:08
lambdayin arprec, most of the operators are overloaded17:08
lambdayso, spares a lot of hard work17:08
lambdaywe could use same code for most of the places as of shogun's datatype and arprec's datatypes17:09
@HeikoSlambday: okay then, arprec and fallback seems to be the best option17:09
lambdayHeikoS: alright then :)17:09
lambdayHeikoS: by the way, I added a check_arprec() in configure script for arprec, locally though17:10
lambdayand it works it seems17:10
lambdayshall I include that too in the PR?17:10
@HeikoSlambday: cool, that very good17:10
@HeikoSyes please17:10
@HeikoSso I need to install it right? ;)17:10
lambdayHeikoS: okay...17:10
lambdayHeikoS: lol.. yes, probably17:10
lambdayHeikoS: I'm rewriting the methods as needed and then sending the PR17:11
@HeikoSokay nice17:11
@HeikoSyou were quite fast with this17:11
@HeikoSreally looking forward to the framework draft17:11
lambdayHeikoS: yes, I'll come up with a class diagram for that as soon as I'm done with this17:12
@HeikoSlambday: good, try to keep it quite general (and clean)17:12
@HeikoSnot talk about pre/post CG calls for now17:13
@HeikoSfirst version should be very big picture17:13
@HeikoSand then well start with dense matrices etc for a simple check17:13
lambdayHeikoS: okay17:13
lambdayI'll finish this stuff by tonight/tomorrow at the latest I'm hoping... will have get into the real work as soon as I can17:15
lambdayHeikoS: by the way, how was the climbing? :)17:16
@HeikoScool!17:16
@HeikoSclimbing was nice17:16
@HeikoSunfortunately bad whether17:16
lambdayah!17:16
@HeikoSso we ended up staying in Germany, not going to Italy17:16
@HeikoSbut we were on a pretty wall one day17:17
@HeikoSand two days climbing inside17:17
@HeikoSwhich is also awesome in munic17:17
@HeikoS30m building17:17
@HeikoShundreds of routers17:17
lambdaywow!17:17
@HeikoSyeah very nice, if you are ever in munic, try it :)17:18
@HeikoSmunich17:18
lambdayHeikoS: ah, dying to go to europe once17:18
lambdayI haven't been anywhere outside of india ever17:18
@HeikoSlambday: maybe after this gsoc, you can go to Norway to the stats guys :)17:19
@HeikoSthey are desperately searching for phds :)17:19
lambdayHeikoS: lol.. will think about it :)17:19
@sonney2khey HeikoS !17:21
@sonney2kback in town?17:21
@HeikoSsonney2k: yes, hi!17:21
@HeikoShow are things?17:22
@sonney2kHeikoS, we have a green build - including travis :D17:22
@HeikoSsonney2k: yeah! :)17:22
@HeikoSequals is not yet being used right?17:22
@sonney2kHeikoS, btw today evening we wanted to discuss with sergey right?17:23
@sonney2kHeikoS, nope17:23
@HeikoSsonney2k:  is there a list of things that I need to fix apart from the sum?17:23
@sonney2kbut it would be the real fix17:23
@sonney2kHeikoS, sum and product17:23
@sonney2kHeikoS, but it should be the same thing17:23
gsomixsonney2k, guck-guck :)17:25
@sonney2kgsomix, hey! any news on the line reader?17:27
gsomixsonney2k, yep, workin' on csv reader. I have some questions about IO in shogun.17:28
@sonney2kgsomix, well a line reader would already be a big step and worth a PR17:29
gsomixsonney2k, hm, ok. I don't really understood where my getline should be situated.17:30
@HeikoSsonney2k: I just discussed with Sergey a little17:30
gsomixIn CFile? or in AsciiFile?17:31
gsomixbtw there is implementation of getline into CAsciiFile, but it's not used in shogun code anywhere.17:32
-!- sumit [75e247a5@gateway/web/freenode/ip.117.226.71.165] has quit [Ping timeout: 250 seconds]17:33
-!- iglesiasg [~iglesias@193.147.49.92] has quit [Quit: Saliendo]18:01
lambdayI am getting weird errors in make unit-tests after I did git pull --rebase upstream... in existing unit-test for MCLDA_unittest.cc :-/18:07
lambday"error: ‘CMCLDA’ was not declared in this scope", ...and so on!18:08
@HeikoSlambday: try make clean before18:12
lambdayHeikoS: I did... also did git clean -fdx, didn't help :(18:13
-!- gsomix_ [~gsomix@37.61.180.77] has joined #shogun18:13
-!- gsomix [~gsomix@37.61.179.131] has quit [Disconnected by services]18:13
-!- gsomix_ is now known as gsomix18:13
@HeikoSin the unit test folder?18:13
lambdayno in the src18:13
-!- van51 [~van51@athedsl-320452.home.otenet.gr] has joined #shogun18:18
-!- lambday [3ba2174e@gateway/web/cgi-irc/kiwiirc.com/ip.59.162.23.78] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]18:23
-!- sijin_ [~smuxi@144.214.222.109] has joined #shogun18:23
-!- sijin [~smuxi@144.214.222.109] has quit [Ping timeout: 264 seconds]18:26
-!- lambday [e8b6149@gateway/web/cgi-irc/kiwiirc.com/x-qycumxkxgmepyzsx] has joined #shogun18:40
thoralfmkl.set_interleaved_optimization_enabled(true); produces an endless loop?18:41
thoralfInfinitly printing [DEBUG] entering CCombinedKernel::get_subkernel_weights(), [DEBUG] not appending kernel weights18:41
thoralfIs it a known bug or should it be working?18:42
-!- lisitsyn [~blackburn@37.61.180.77] has joined #shogun18:42
-!- mode/#shogun [+o lisitsyn] by ChanServ18:42
thoralfsetting interleaved optimization to "false" works as expected.18:43
lambdayHeikoS: may be I'm doing something wrong.. but unit-tests not working :(18:43
lambdayHeikoS: just for testing, I cloned from shogun-toolbox/shogun into a separate directory and it gives same error18:45
lambdayHeikoS: oh I see... that unit-test doesn't check if Eigen3 exists, I configured without Eigen3 for making current things fast and it was giving the error18:50
lambdayHeikoS: I think unit tests should check if Eigen3 exists too, no?18:51
@HeikoSyes!18:52
@HeikoScould you do that?18:52
@HeikoS:)18:52
lambdayHeikoS: yes :)18:52
lambdayI'll check if any other unit-test fails in absense of Eigen318:52
@lisitsynHeikoS: lambday: so what did you decide?19:03
lambdaylisitsyn: to use arprec when its there, else fallback to shogun's datatypes19:04
@lisitsynI want to warn you ~ nobody is going to use that19:04
@lisitsynpeople don't like that19:04
@HeikoSlisitsyn:  maybe you are right, lambday, how much effort to use gmp? would it be possible to use that? dont really know whats best here19:05
@HeikoSgotta go now, will be back tomorrow (full day then)19:06
@HeikoSbye19:06
@lisitsynbye19:06
lambdayHeikoS: okay19:06
lambdayHeikoS: bye19:06
lambdaylisitsyn: you are right - but I was thinking, since its just for two methods, and its in C++ and the operators are overloaded.. for complex number gmp provides gmc... which is in C19:07
lambdayHeikoS: I'll check it then19:07
-!- hushell [~hushell@c-67-189-100-116.hsd1.or.comcast.net] has joined #shogun19:14
lambdaylisitsyn: is it okay to work with arprec for now (cause high precision is really needed for this)... and later may be, replace it with gmp/gmc? (just for two methods, won't take too much work later)19:15
@lisitsynlambday: yes sure19:15
lambdaylisitsyn: okay then19:15
lambday:)19:15
@lisitsynlambday: it is just a matter of your will to deliver the software19:16
@lisitsynI mean if it is easier to get it to work it is usually better19:16
lambdaylisitsyn: arprec is easier to work with in c++, gmc - I need to check out19:18
-!- lambday [e8b6149@gateway/web/cgi-irc/kiwiirc.com/x-qycumxkxgmepyzsx] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]19:19
@sonney2kHeikoS, sorry had to leave train19:26
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun19:27
shogun-notifier-shogun: hushell :develop * b0b6b6b / src/shogun/multiclass/MulticlassStrategy.h: https://github.com/shogun-toolbox/shogun/commit/b0b6b6b7c2000b1fdb145c4a4f14de5e4d9ea10f19:27
shogun-notifier-shogun: update doc of rescale_outputs19:27
shogun-notifier-shogun: hushell :develop * ae06fc1 / src/shogun/multiclass/MulticlassStrategy.h: https://github.com/shogun-toolbox/shogun/commit/ae06fc14f643d80269d107249244b0a34edf46ff19:27
shogun-notifier-shogun: fix indent issues19:27
shogun-notifier-shogun: Soeren Sonnenburg :develop * efbbbc4 / src/shogun/multiclass/MulticlassStrategy.h: https://github.com/shogun-toolbox/shogun/commit/efbbbc48e2ad9c8b136855a501e7ce6cb149149219:27
shogun-notifier-shogun: Merge pull request #1118 from hushell/develop19:27
shogun-notifier-shogun:19:27
shogun-notifier-shogun: fix a wrong documentation of CMulticlassStrategy::rescale_outputs19:27
-!- lambday [3ba2174d@gateway/web/cgi-irc/kiwiirc.com/ip.59.162.23.77] has joined #shogun19:34
-!- lambday [3ba2174d@gateway/web/cgi-irc/kiwiirc.com/ip.59.162.23.77] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]19:39
@sonney2kgsomix, in CAsciiFile a static function19:54
@sonney2kwiking, hey there prng hero19:55
@sonney2kwiking, I am going to rewrite all the prng functions19:56
gsomixsonney2k, yep, got it. I think I should change get_string_list functions and make them work with my getline. right?19:58
@lisitsynsonney2k: just for fun oder?20:01
@sonney2klisitsyn, what?20:08
@lisitsynsonney2k: why to rewrite all prng?20:08
@sonney2kgsomix, *any* line reading stuff will benefit from that20:09
@sonney2kgsomix, but first we need a fast line reader20:09
@sonney2klisitsyn, now that we have mersenne the PRNG doesn't have to use higher order bits20:10
@sonney2kso we can use lower order bits and stuff like rand_64() % 10 will work *very* nicely20:10
-!- votjakovr [~votjakovr@host-46-241-3-209.bbcustomer.zsttk.net] has quit [Quit: Leaving]20:10
@sonney2klisitsyn, with the rand_64() % n; way of generating prn's we are like twice as fast20:26
@lisitsynsonney2k: what is the way with higher order bits you are talkign about?20:26
@sonney2kthe old rand() was less random in its lower bits20:27
@sonney2kso doing rand() % n is not a good idea20:27
@lisitsyngot it20:29
@sonney2klisitsyn, ooh look20:31
@sonney2kthe situation is already better at least with newer libc's20:31
@sonney2kNOTES20:32
@sonney2k       The versions of rand() and srand() in the Linux C Library use the same random number generator as random(3) and srandom(3), so the lower-order bits should be as random as the higher-order bits.  However, on older rand() implementations, and on current imple‐20:32
@sonney2k       mentations on different systems, the lower-order bits are much less random than the higher-order bits.  Do not use this function in applications intended to be portable when good randomness is needed.  (Use random(3) instead.)20:32
@lisitsynhaha20:32
@lisitsynnot enough entropy20:32
@sonney2kwe did use random btw20:32
@lisitsynsonney2k: the importance of reading TFM?20:33
@lisitsynTFM from RTFM I mean20:34
@sonney2klisitsyn, what do you mean?20:34
@lisitsynsonney2k: I didn't know that20:34
@sonney2kwell it is obsolete knowledge20:35
@sonney2kit is like std::vector not being guaranteed to be contiguous memory20:35
@sonney2kno longer true20:35
@lisitsynhaha20:35
@lisitsynsonney2k: good you believe that now20:35
@sonney2klisitsyn, I didn't doubt that since I read the standard20:36
@lisitsynsonney2k: furthermore in C++11 vector doesn't copy things twice20:36
@sonney2kbut it was not like this when I started20:36
@lisitsynsonney2k: bad design decision20:36
@sonney2klisitsyn, in 10 years you will face the same things(tm)20:36
@lisitsynsonney2k: vector<bool>20:37
@lisitsynsonney2k: I am trying to be modern :P20:37
@sonney2klisitsyn, yeah I have no idea why they didn't require things to contiguous in the first place20:37
@lisitsynsonney2k: I understand the motivation beneath20:37
@sonney2klisitsyn, like us 14 years ago :P20:37
@sonney2klook when we started people were screaming templates - hahaha!20:38
@sonney2kyou won't get that compiled20:38
@lisitsynsonney2k: haha20:38
@lisitsynand now template MPL is usual thing20:38
@sonney2kand indeed compilers had *lots* of issues back then with templates20:38
@lisitsynsonney2k: http://html9responsiveboilerstrapjs.com/20:38
@lisitsynsonney2k: Just attackclone the grit repo pushmerge, then rubygem the lymphnode js shawarma module – and presto!20:39
@lisitsynthat's the future20:39
@lisitsyn:D20:39
@sonney2kalright back to rand & friends20:41
@lisitsynsonney2k: have you ever seen notation 'R^{++}'20:46
@lisitsyn?20:46
@sonney2kmaybe x \in R but with x >0 ?20:57
@lisitsynsonney2k: yes that's R+20:57
@lisitsynbut R++20:57
@lisitsynI guess a typo20:57
@sonney2kwell for some R^+ might include 020:57
@lisitsynahh20:57
@sonney2ksome also write R^+_020:57
-!- iglesiasg [d58f329d@gateway/web/freenode/ip.213.143.50.157] has joined #shogun21:21
-!- mode/#shogun [+o iglesiasg] by ChanServ21:21
gsomixsonney2k, done. PR was sent.21:52
@sonney2kgsomix, that is super slow22:08
@sonney2kyou do getc there22:08
@sonney2kso reading character by character22:09
@sonney2kwe should rather read big blocks (say 1MB in size) and then return a line22:10
gsomixsonney2k, ok! so, should I use something like fread for reading blocks?22:12
@sonney2kgsomix, yes and then some ptr/cache for the buffer22:14
gsomixsonney2k, ok, I'll do it. tnx for fast review.22:15
@sonney2klisitsyn, any chance that you use in shogun's tapkee the random functions?22:19
@wikingmurmur22:24
@sonney2kwiking, hey there22:25
@sonney2ksec22:25
@wikingyo22:25
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]22:27
@sonney2kwiking, I am switching to using your rand_64() % n to generate 0...n-1'prn's22:28
@sonney2kwiking, that really is like 2 times faster than what we had before22:29
@sonney2kand I've written some tests that check if stuff is still uniform22:29
@sonney2kand yes all good22:29
@wiking\o/22:30
@sonney2kthis will kill all our tests though22:30
@wikingyou mean integration tests?22:30
@sonney2kyes22:30
@sonney2ksince random numbers are no longer comparable22:30
@wikingbtw: the CMath::random(...) were using rand_64 already22:30
@sonney2kwiking, but not the way I am using them now22:31
@wikingmmmm how are u using them now?22:31
@wikingi mean what's the diff ? :)22:31
@sonney2kwiking, how do I upload the feature branch?22:31
@sonney2kjust git push?22:32
@wikingwelll22:32
@wikingyeah git push origin feature/FEATURENAME22:32
@wikingorigin = upstream22:32
@wikingor whatever you named the shogun.git22:33
@wikingi mean shogun-toolbox/shogun.git22:33
@wikingof course you can do the fancy22:33
@sonney2khttps://github.com/shogun-toolbox/shogun/tree/feature/prng_lower_order_bits22:33
@wikinggit flow feature publish <feature>22:33
@wikingbut that'll be published on your own repo22:33
@sonney2kwiking, I've moved the content of the CMath:random* functions into CRandom22:34
@sonney2konly calling the random stuff22:34
@sonney2kfrom CMath22:34
@wikingmmm22:35
@wikingi see the unittests :)22:35
@wikingwhich commit should i check?22:36
@sonney2koops forgot to commit22:40
@sonney2ksec22:40
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun22:41
shogun-notifier-shogun: Soeren Sonnenburg :feature/prng_lower_order_bits * 32fbfc8 / / (5 files): https://github.com/shogun-toolbox/shogun/commit/32fbfc8e7410c86968ab57e2e235d33bb90782c322:41
shogun-notifier-shogun: use lower order bits in prng22:41
shogun-notifier-shogun:22:41
shogun-notifier-shogun: - This is about 2 times faster compared to the previous rng.22:41
shogun-notifier-shogun: - Add unit tests to ensure things are correct22:41
@sonney2kwiking, this commit22:41
@sonney2kwiking, would be good if you could give some feedback22:42
@sonney2kwiking, btw the closed interval rng [0,1] never really returned 0 nor 1 for me22:42
@sonney2kit is like very close but not exactly 0 nor 122:43
@sonney2k(like 1e-6 or 1-1e-6)22:43
@wikingsonney2k: #define RAND_MAX_3222:43
@wikingwhere did this go?22:43
@wikingbtw22:44
@wikingrandom_close22:44
@wikingis slow22:44
@wikingi highly suggest to use [0,1) or (0,1] functions for float random22:44
@wikingthey are even faster22:45
-!- dvalcarce [5b757556@gateway/web/freenode/ip.91.117.117.86] has joined #shogun22:46
@wikingso either random_open or random_half_open22:46
@wikingas it's using dsfmt22:47
@wikingand not sfmt22:47
dvalcarcehi all22:47
@wikingwhich is exactly designed for float numbers... while sfmt is designed for integer number generation22:47
@sonney2kwiking, I think for us the integer based floats need to be fastest22:48
@sonney2kwiking, e.g. liblinear uses them to select the next variable22:48
@sonney2kdvalcarce, hey22:48
dvalcarcesonney2k, hi22:49
@wikingsonney2k: yeah right but still22:49
@wikingsonney2k: currently this way dsfmt is not used ever22:49
@wikingsonney2k: or barely ever... so it's useless then to have it in the repo22:50
@sonney2kwiking, well feel free to add random_open functions22:51
@sonney2kwiking, I most of the time needed to generate say initial probabilites so 0...1 (closed intervals)22:52
@sonney2kdvalcarce, how is it going?22:52
@sonney2kdvalcarce, exams on the way bakufo progressing?22:52
dvalcarcesonney2k, I had my first final today22:53
dvalcarceso this night is bakufu's night :)22:54
@sonney2kheh22:56
@sonney2kwiking, alright please give feedback by tomorrow22:56
@sonney2kI need to sleep now...22:56
@sonney2kn8 everyone22:56
@iglesiasggood night sonney2k22:57
gsomixsonney2k, nite22:58
dvalcarcesonney2k, nite22:58
-!- hushell [~hushell@c-67-189-100-116.hsd1.or.comcast.net] has quit [Ping timeout: 252 seconds]22:59
gsomixso, good night, guys23:01
@iglesiasgnight23:02
-!- travis-ci [~travis-ci@ec2-23-23-66-69.compute-1.amazonaws.com] has joined #shogun23:07
travis-ci[travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/737117023:07
-!- travis-ci [~travis-ci@ec2-23-23-66-69.compute-1.amazonaws.com] has left #shogun []23:07
-!- hushell [~hushell@8-92.ptpg.oregonstate.edu] has joined #shogun23:12
--- Log closed Wed May 22 00:00:05 2013

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!