IRC logs of #shogun for Saturday, 2014-10-25

--- Log opened Sat Oct 25 00:00:39 2014
-!- HeikoS [~heiko@50-76-45-78-ip-static.hfc.comcastbusiness.net] has joined #shogun00:40
-!- mode/#shogun [+o HeikoS] by ChanServ00:40
@HeikoSwiking: ping?00:55
-!- iglesiasg [~iglesias@50-76-45-78-ip-static.hfc.comcastbusiness.net] has joined #shogun00:55
@HeikoSiglesiasg: hello :)00:55
-!- jiaolong [5c15c2a6@gateway/web/freenode/ip.92.21.194.166] has joined #shogun01:35
-!- HeikoS [~heiko@50-76-45-78-ip-static.hfc.comcastbusiness.net] has quit [Quit: Leaving.]01:49
-!- HeikoS [~heiko@50-76-45-78-ip-static.hfc.comcastbusiness.net] has joined #shogun02:00
-!- mode/#shogun [+o HeikoS] by ChanServ02:00
-!- jiaolong [5c15c2a6@gateway/web/freenode/ip.92.21.194.166] has quit [Quit: Page closed]02:11
-!- HeikoS [~heiko@50-76-45-78-ip-static.hfc.comcastbusiness.net] has quit [Ping timeout: 265 seconds]02:17
-!- HeikoS [~heiko@50-76-45-78-ip-static.hfc.comcastbusiness.net] has joined #shogun02:21
-!- mode/#shogun [+o HeikoS] by ChanServ02:21
-!- HeikoS [~heiko@50-76-45-78-ip-static.hfc.comcastbusiness.net] has quit [Ping timeout: 265 seconds]02:33
-!- HeikoS [~heiko@50-76-45-78-ip-static.hfc.comcastbusiness.net] has joined #shogun02:38
-!- mode/#shogun [+o HeikoS] by ChanServ02:38
-!- iglesiasg [~iglesias@50-76-45-78-ip-static.hfc.comcastbusiness.net] has quit [Quit: leaving]02:38
-!- HeikoS [~heiko@50-76-45-78-ip-static.hfc.comcastbusiness.net] has quit [Ping timeout: 255 seconds]02:43
shogun-buildbotbuild #907 of nightly_default is complete: Failure [failed notebooks]  Build details are at http://buildbot.shogun-toolbox.org/builders/nightly_default/builds/907  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>, Fernando Iglesias <fernando.iglesiasg@gmail.com>, Wu Lin <yorker.lin@gmail.com>, tklein23 <tklein23@users.noreply.github.com>, Thoralf Klein04:35
shogun-buildbot<thoralf@fischlustig.de>04:35
-!- HeikoS [~heiko@107.17.164.143] has joined #shogun08:26
-!- mode/#shogun [+o HeikoS] by ChanServ08:26
-!- iglesiasg [~iglesias@12.104.145.5] has joined #shogun08:37
-!- mode/#shogun [+o iglesiasg] by ChanServ08:37
@iglesiasgGentlemen08:37
@HeikoSiglesiasg: good evening08:42
@wiking:)08:49
@HeikoSwiking: heya08:49
@wikingwhere r u guys? :)08:49
@HeikoSwiking: san jose08:49
@HeikoSiglesiasg, https://github.com/shogun-toolbox/shogun/wiki/SWIG-issues08:49
@wikingah ok thatswhy it's good evening08:49
@wikingit's 3pm here08:49
@wikingHeikoS: for swig issues we shoulg go with d-poiinters08:51
@HeikoSwiking: 3pm nice08:51
@HeikoSwiking: yeah we thought about that too08:51
@HeikoSwiking: what about writing some things down08:51
@HeikoSwiking: so that its not just all in our heads08:51
@HeikoSand maybe we can make some entrance tasks from this08:53
@HeikoSwiking: could you explain the d-pointer stuff a bit?08:53
@wikingmmm not now08:53
@wikingstill working here :)08:53
@wikingbut here's a good article about it08:54
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun08:54
shogun-notifier-shogun: jiaolong :develop * 05ce392 / src/shogun/structure/GraphCut.h: https://github.com/shogun-toolbox/shogun/commit/05ce392abb1871c8c73c217914812ee88562675d08:54
shogun-notifier-shogun: removed buildbot warnings from GraphCut.h08:54
shogun-notifier-shogun: Heiko Strathmann :develop * ef2a460 / src/shogun/structure/GraphCut.h: https://github.com/shogun-toolbox/shogun/commit/ef2a460b6121ce358266f2cca71ce4d443592c6b08:54
shogun-notifier-shogun: Merge pull request #2554 from Jiaolong/rm_warnings08:54
shogun-notifier-shogun:08:54
shogun-notifier-shogun: removed buildbot warnings from GraphCut.h08:54
@wikinghttp://qt-project.org/wiki/Dpointer08:54
@wikinghttp://zchydem.enume.net/2010/01/19/qt-howto-private-classes-and-d-pointers/08:54
@HeikoSwiking: thanks08:54
shogun-buildbotbuild #81 of trusty - libshogun - viennacl is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/trusty%20-%20libshogun%20-%20viennacl/builds/8108:58
shogun-buildbotbuild #845 of precise - libshogun is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/precise%20-%20libshogun/builds/845  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>, jiaolong <jiaolongxu@gmail.com>09:01
-!- travis-ci [~travis-ci@ec2-23-22-26-147.compute-1.amazonaws.com] has joined #shogun09:06
travis-ciit's Heiko Strathmann's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/3899736709:06
-!- travis-ci [~travis-ci@ec2-23-22-26-147.compute-1.amazonaws.com] has left #shogun []09:06
shogun-buildbotbuild #873 of FCRH - libshogun is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/FCRH%20-%20libshogun/builds/873  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>, jiaolong <jiaolongxu@gmail.com>09:20
shogun-notifier-shogun: Heiko Strathmann :develop * 096de32 / src/shogun/preprocessor/PCA.h: https://github.com/shogun-toolbox/shogun/commit/096de322b6f23d231a9db5408698cf78c44bda8110:13
shogun-notifier-shogun: little doc correction10:13
shogun-notifier-shogun: Heiko Strathmann :develop * 3f26225 / src/shogun/mathematics/linalg/dotproduct/VectorDotProduct.h: https://github.com/shogun-toolbox/shogun/commit/3f262258baf70ecb03f241685c9c5dc23124544b10:13
shogun-notifier-shogun: fixed doxygen math10:13
shogun-notifier-shogun: Heiko Strathmann :develop * cd805c7 / src/shogun/clustering/ (2 files): https://github.com/shogun-toolbox/shogun/commit/cd805c75f0b6266dde13d19df4995026a62ab0ab10:13
shogun-notifier-shogun: removed stdio from header and add documentation string10:13
shogun-notifier-shogun: Heiko Strathmann :develop * cb4672f / src/shogun/clustering/KMeans.h: https://github.com/shogun-toolbox/shogun/commit/cb4672f442556425d20edcd99f385ec11e019a7a10:13
shogun-notifier-shogun: added some mini updates to doc10:13
shogun-notifier-shogun: Heiko Strathmann :develop * 907b8da / src/shogun/distributions/KernelDensity.h: https://github.com/shogun-toolbox/shogun/commit/907b8da70ad2267d0b35906214cec0c9d93b295f10:13
shogun-notifier-shogun: doc string10:13
shogun-notifier-shogun: Heiko Strathmann :develop * d1384f9 / src/shogun/structure/libbmrm.h: https://github.com/shogun-toolbox/shogun/commit/d1384f9b7e19fb106480bb96cbfadc91e60b842e10:13
shogun-notifier-shogun: doc string10:13
shogun-notifier-shogun: Heiko Strathmann :develop * 24bbcc5 / src/shogun/distributions/EMBase.h: https://github.com/shogun-toolbox/shogun/commit/24bbcc52b7ff73c7b2a5d6e1bd4d146f38da6e8510:13
shogun-notifier-shogun: doc strings10:14
shogun-notifier-shogun: Heiko Strathmann :develop * 104a258 / src/shogun/distributions/EMBase.h,src/shogun/distributions/EMMixtureModel.h: https://github.com/shogun-toolbox/shogun/commit/104a25851abc69bbf2be457c0bfc9847a085107810:14
shogun-notifier-shogun: docstrings10:14
shogun-notifier-shogun: Heiko Strathmann :develop * 90d1a6f / src/shogun/labels/MultilabelLabels.h: https://github.com/shogun-toolbox/shogun/commit/90d1a6f5cb5a0523beda10bd21cf774b47d75ee410:14
shogun-notifier-shogun: docstrings10:14
-!- witness___ [uid10044@gateway/web/irccloud.com/x-rbwdfoufhxjylbfe] has quit [Quit: Connection closed for inactivity]10:20
shogun-buildbotbuild #78 of osx2 - modular_interfaces is complete: Failure [failed csharp modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20modular_interfaces/builds/78  blamelist: jiaolong <jiaolongxu@gmail.com>10:28
-!- Phawx [~Phawx@178.19.210.162] has joined #shogun10:32
shogun-buildbotbuild #79 of osx2 - modular_interfaces is complete: Failure [failed csharp modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20modular_interfaces/builds/79  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>10:40
-!- HeikoS [~heiko@107.17.164.143] has quit [Quit: Leaving.]11:01
-!- lambday [67157f4f@gateway/web/freenode/ip.103.21.127.79] has joined #shogun11:13
-!- Phawx [~Phawx@178.19.210.162] has quit [Quit: Leaving]11:39
@lisitsyniglesiasg: you and heiko should answer my super question ;)12:02
@lisitsynthink about it!12:02
@lisitsynwhat's next after deep learning and how can we jump on this train12:02
@wikinghahaha12:08
-!- travis-ci [~travis-ci@ec2-23-22-26-147.compute-1.amazonaws.com] has joined #shogun12:50
travis-ciit's Heiko Strathmann's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/3899953612:50
-!- travis-ci [~travis-ci@ec2-23-22-26-147.compute-1.amazonaws.com] has left #shogun []12:50
shogun-buildbotbuild #443 of debian wheezy - memcheck is complete: Failure [failed memory check]  Build details are at http://buildbot.shogun-toolbox.org/builders/debian%20wheezy%20-%20memcheck/builds/443  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>, jiaolong <jiaolongxu@gmail.com>12:57
shogun-buildbotbuild #846 of precise - libshogun is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/precise%20-%20libshogun/builds/846  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>13:02
shogun-buildbotbuild #847 of precise - libshogun is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/precise%20-%20libshogun/builds/847  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>13:02
shogun-buildbotbuild #874 of FCRH - libshogun is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/FCRH%20-%20libshogun/builds/874  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>13:06
@iglesiasgshit, I fell asleep while compiling13:08
@wikinglol13:08
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]13:14
shogun-buildbotbuild #80 of osx2 - modular_interfaces is complete: Failure [failed csharp modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20modular_interfaces/builds/80  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>13:34
shogun-buildbotbuild #81 of osx2 - modular_interfaces is complete: Failure [failed csharp modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20modular_interfaces/builds/81  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>13:59
@iglesiasgwhen we build PythonModular with Eigen support we get some Eigen__MatrixXt stuff in modshogunPYTHON_wrap.cxx14:06
@iglesiasgthis is not there when building w/o Eigen14:07
@wikingiglesiasg: mmm then that means that eigen is being imported in a header14:11
@wikingsomewhere...14:11
@iglesiasgwiking: I checked that with grep and didn't find it, so at least no direct include14:12
@iglesiasggrep -R eigen */*.h -- that's how I checked it14:12
@wikinggit grep eigen -- '*.h'14:13
@iglesiasg-Ri actually, anyway14:13
@wikingin src/shogun14:13
@wikingand you'll see quite some14:13
@wikinggit grep eigen3.h -- '*.h14:13
@wikingmachine/gp/SingleLaplacianInferenceMethodWithLBFGS.h:#include <shogun/mathematics/eigen3.h>14:14
@wikingmathematics/linalg/dotproduct/DenseEigen3DotProduct.h:#include <shogun/mathematics/eigen3.h>14:14
@wikingmathematics/linalg/internal/implementation/Add.h:#include <shogun/mathematics/eigen3.h>14:14
@iglesiasgyep14:14
@wikingmathematics/linalg/internal/implementation/Dot.h:#include <shogun/mathematics/eigen3.h>14:14
@wikingmathematics/linalg/internal/implementation/ElementwiseProduct.h:#include <shogun/mathematics/eigen3.h>14:14
@wikingmathematics/linalg/internal/implementation/ElementwiseSquare.h:#include <shogun/mathematics/eigen3.h>14:14
@wikingmathematics/linalg/internal/implementation/MatrixProduct.h:#include <shogun/mathematics/eigen3.h>14:14
@wikingmathematics/linalg/internal/implementation/Max.h:#include <shogun/mathematics/eigen3.h>14:14
@wikingmathematics/linalg/internal/implementation/Scale.h:#include <shogun/mathematics/eigen3.h>14:14
@wikingmathematics/linalg/internal/implementation/SetRowsConst.h:#include <shogun/mathematics/eigen3.h>14:14
@wikingmathematics/linalg/internal/implementation/SpecialPurpose.h:#include <shogun/mathemat14:14
@wikingthe linalg shouldn't matter14:14
@wikingat least not the internal one14:14
@wikingi reckon you can throw it out from machine/gp/SingleLaplacianInferenceMethodWithLBFGS.h14:14
@iglesiasglet me try that14:15
@wikingit's a common mistake done by Wu Lin14:15
@wikinghe always did this regardless how many times i told not to do this14:15
@wikingah now14:15
@wiking*no14:16
@wikinghe fucked it up14:16
@wiking/* compute the gradient given the current alpha*/14:16
@wikingvoid get_gradient_wrt_alpha(Eigen::Map<Eigen::VectorXd>* alpha,14:16
@wikingEigen::Map<Eigen::VectorXd>* gradient);14:16
@wiking/* compute the function value given the current alpha*/14:16
@wikingvoid get_psi_wrt_alpha(Eigen::Map<Eigen::VectorXd>* alpha,14:16
@wikingfloat64_t* psi);14:16
@iglesiasgarrrrgh14:16
@wikingthis is a private function in the header14:16
@iglesiasgthat is not nice in the header14:16
@wikingbut i reckon you can hide this14:16
@wikingmmm14:17
@wikingwell i worst case what can be done14:17
@wikingis to make this into a static function14:17
@wikingwhere u pass all the variables of the class14:17
@wikingget_psi_wrt_alpha uses some of the object variables14:17
@wikingsame goes for get_gradient_wrt_alpha14:18
@wikingok now14:18
@wikingthis should be fairly easy to fix14:19
@wikingEigen::Map<Eigen::VectorXd> eigen_alpha(alpha_cast, dim);14:19
@wikingfloat64_t psi = 0.0;14:19
@wikingobj_prt->get_psi_wrt_alpha(&eigen_alpha, &psi);14:19
@wikingEigen::Map<Eigen::VectorXd> eigen_gradient(gradient, dim);14:19
@wikingobj_prt->get_gradient_wrt_alpha(&eigen_alpha, &eigen_gradient);14:19
@wikingas these are all maps of some very standard arrays14:19
@wikingso just do the mapping within those functions :P14:19
lambdaywiking: iglesiasg: I just removed this one - mathematics/linalg/dotproduct/DenseEigen3DotProduct.h14:20
lambdaythis one is deprecated and is no longer needed14:20
@wikinglambday: commited?14:20
@wikingif so then just push it14:20
lambdaywiking: didn't push yet - still fixing some doxygen bugs14:20
lambdayalright14:20
lambdaypushing whatever I have till now14:20
@wikingand once iglesiasg fixes that then swig wont generate eigen mappings :P14:20
@iglesiasgwiking: why the linalg ones shouldn't matter though? They're just skipped by swig, I am guessing14:21
@wikingiglesiasg: because those headers are used internally in the linalg part of shgun14:21
@wikingi.e. we don't do mappings over that14:21
@wikingiglesiasg: so it's almost like d-pointers14:21
@iglesiasgallright14:22
@wikinglambday: how about mathematics/linalg/linsolver/IterativeSolverIterator.h14:22
@wiking?14:22
lambdaywiking: that one includes eigen3 in the header?14:23
@wikingbut i reckon we don't do mappings of that either or?14:23
lambdaywiking: let me check14:23
@wikingmathematics/linalg/linsolver/IterativeSolverIterator.h:#include <shogun/mathematics/eigen3.h>14:23
@wikingno we are good14:23
lambdaywiking: should be avoided... when i did that I didn't know much14:23
lambdaywill fix14:23
@wikingcool14:24
@wikingiglesiasg: although i wonder about SingleLaplacianInferenceMethodWithLBFGS as well....14:24
lambdaywiking: but iirc then iterative solver iterator is used internally14:24
lambdayI mean, its not exposed14:24
@wikingoh nothing...14:24
@wikingiglesiasg:14:24
@wikinginterfaces/modular/GaussianProcess.i:%rename(SingleLaplacianInferenceMethodWithLBFGS) CSingleLaplacianInferenceMethodWithLBFGS;14:24
@wikinginterfaces/modular/GaussianProcess.i:%include <shogun/machine/gp/SingleLaplacianInferenceMethodWithLBFGS.h>14:24
@wikinginterfaces/modular/GaussianProcess_includes.i: #include <shogun/machine/gp/SingleLaplacianInferenceMethodWithLBFGS.h>14:24
@wikingthis is why eigen is actually in the modshogun_PYTHON.cxx14:25
@wikinggit grep IterativeSolverIterator -- '*.i'14:25
@wikingis an empty set14:25
lambdaywiking: yeah that's what I thought - shouldn't matter14:25
@wikingindeed14:26
@wikingso maybe once iglesiasg fixes that shit in SingleLaplacianInferenceMethodWithLBFGS we'll have travis working again :)14:26
@wiking\o/14:26
lambdaywiking: btw about khaled's random matrix/vector patch14:31
lambdaywiking: as of now I think its better to keep it within linalg14:32
lambdaywiking: Heiko suggested something - that we maybe want to put it alongside Random.h14:32
lambdaybut this thing heavily uses viennacl and then we'll have viennacl code in many places apart from linalg14:33
lambdaywiking: btw I just noticed in some of the linalg functions khaled has kept generic implementation as Eigen3 specialization... maybe I'll change those14:33
lambdaySpecialPurpose.h.. Core.h etc14:34
lambdayiglesiasg: wiking: for eigen mapping stuff, we can use SGMatrix's map operator and Eigen constructor.. its neater14:40
@iglesiasglambday: I am following the style how Wu did it in other parts of that file and just pass the float* and the dimension around14:41
@iglesiasglambday: but I agree with you, it's better that other way14:42
lambdayiglesiasg: yeah maybe for next tasks we can.14:43
@iglesiasgin any case, this code has really weird things...14:44
@iglesiasgI don't really see the point of passing around Eigen::VectorXd* alpha and do the math operations as *alpha14:44
lambdayiglesiasg: I guess eigen3 does deep copy.. maybe use reference?14:50
@iglesiasglambday: I'd guess that it doesn't do deep copy, but I am not sure14:51
lambdayiglesiasg: let me check14:51
@wikingmap is not a deep copy14:51
@wikingjust a wrapping14:51
@iglesiasglambday: anyhow, since I am passing the float* together with the dimension, I don't need to be aware of that just yet14:51
lambdayiglesiasg: I remember khaled saying this once14:51
lambdaynah map is not14:52
@iglesiasgis not deep copy?14:52
lambdaymap is not deep copy..14:52
@wikingEigen::Map<Eigen::VectorXd>14:52
@iglesiasgright14:52
@wikingit's a simple wrapping14:52
@wikingnothing else14:52
lambdaybut VectorXd vec1 = vec2 does deep copy14:52
@iglesiasgI hope this SingleLaplacianInferenceMethodWithLBFGS is unit tested14:53
@iglesiasgotherwise this refactoring might end up biting me14:53
@iglesiasgyeah, it seems to have proper tests, awesome14:56
lambdayiglesiasg: it does deep copy when you pass Eigen::Matrix as param.. just checked14:56
@iglesiasglambday: will try to keep that in mind from now on, thanks!14:57
lambdayiglesiasg: I don't understand why should one pass *float with the dimension? :(14:58
@iglesiasgbtw, they brought Linus and Peter Norvig yesterday15:00
@iglesiasglambday: yeah.. I agree with you. It's not the proper way of doing it15:00
@iglesiasglambday: what does rows() return for an Eigen::Map<Eigen::VectorXd>?15:03
@iglesiasglambday: just the vector dimension, right?15:04
lambdayiglesiasg: yes15:04
@iglesiasgcool, thanks15:04
lambdayiglesiasg: I guess the easiest way would be to change the function params to SG.. even if you pass Eigen matrix due to the eigen constructor in SG it should do the conversion automatically... then inside the function we can use map from SG15:05
lambdayoh but it uses eigen map instead.. that won't work then15:07
lambdaysorry about the confusion15:07
@wikingi'm totally puzzled by this issues15:09
@wikinghttps://github.com/shogun-toolbox/shogun/issues/253815:09
@wikingiglesiasg: still here?15:13
@iglesiasgyep15:13
@iglesiasgthe Eigen__MatrixXt thingies still appear in the modshogunPYTHON*15:14
@iglesiasgI am double checking it though..15:15
@wikingiglesiasg: do you know why SGString doesn't have a destructor?15:15
@iglesiasgamazing15:15
@iglesiasgwiking: destroy_string() xD15:16
@wikingiglesiasg: ok yeah but like a real dtor15:16
@wiking~SGString()15:16
@wikingok i'll make one :)15:17
@iglesiasgwiking: yeah, I got you. I found it funny that there's this destroy_string that is called from nowhere haha15:17
@wikingiglesiasg: mmm maybe i should just drop then destroy_string and free_string15:18
@wikingmmm ok no15:18
@wikingi'll just remove destroy_string15:18
@wikinglambday: how do i force to turn off viennacl?15:30
@wiking-DVIENNACL_FOUND=OFF doesn't work15:30
lambdaywiking: checking15:31
lambdaywiking: HAVE_VIENNACL is the macro...15:32
lambdaywiking: I'm afraid current it's not done15:34
lambdaywiking: if the package is not found only then it will say viennacl missing15:34
lambdayCMakeLists.txt:65115:35
lambdaywiking: maybe define another variable for this? if that's turned off then we'll find the viennacl pkg15:36
@iglesiasgwiking: so it was not only this thing in SingleLaplacianInferenceMethodWithLBFGS15:42
@iglesiasgeigen is leaking into swig somewhere else too15:43
@wiking:<15:43
@wikingfuck15:43
@wikingiglesiasg: have u compiled the thing from scratch15:43
@wikingrm -rf build15:43
@iglesiasgrm -rf build15:43
@iglesiasgyes15:43
@iglesiasgbut it is so nuts this thing of the memory comsumption w/ and w/o eigen15:44
@iglesiasg2GB and ~0.5GB15:44
@wikingfuck15:44
@wikingmmm is it really 0.5GB15:44
@wikingi never seen swig requiring oonly 0.5 :P15:44
@iglesiasgwiking: compile PythonModular w/o Eigen :-)15:45
@lisitsynhah15:45
@lisitsynreally?15:45
@iglesiasgI wanted to double check this though in case I missed something yesterday15:45
@lisitsynswig + eigen = 2gb of ram?15:45
@iglesiasglet me do it now15:45
@lisitsynand w/o just 0.5?15:45
@iglesiasglisitsyn: let me double check, I might be saying just bullshit15:46
@lisitsyniglesiasg: I wish it is true as it sounds awesome15:46
@lisitsyniglesiasg: what if we remove std? :D15:46
@lisitsyn0.1gb? ;)15:46
@wikingi mean the thing is that afaik modular interface packages are not being generated for ubuntu15:46
@wikingbecause it uses 4G+ ram15:46
shogun-buildbotbuild #444 of debian wheezy - memcheck is complete: Failure [failed memory check]  Build details are at http://buildbot.shogun-toolbox.org/builders/debian%20wheezy%20-%20memcheck/builds/444  blamelist: Heiko Strathmann <heiko.strathmann@gmail.com>16:21
@iglesiasgwiking: lisitsyn: mistery solved16:35
@iglesiasgit was ccache..16:35
@wikingiglesiasg: lol16:37
@wikingiglesiasg: ok push the fix then16:37
@wikinglet's see how travis reacts16:37
@iglesiasgwiking: all right16:37
@wikingas usually the modular jobs were dying because of insufficient mem16:37
@iglesiasgwiking: not very strict measure probably, but it reduced it about 100mb16:38
@iglesiasgI mean the refactoring16:38
@iglesiasgwiking: but I think it is worth to investigate this thing of Eigen__MatrixXt in modshogunPYTHON_wrap.cxx. I don't see any reason why there should any Eigen related thing in there16:39
@iglesiasgwiking: what do you think?16:39
@wikingmmm16:40
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun16:40
shogun-notifier-shogun: lambday :develop * f918c77 / src/shogun/mathematics/linalg/dotproduct/ (4 files): https://github.com/shogun-toolbox/shogun/commit/f918c774359cde3fa811ba3f31ef83d68de6b1ac16:40
shogun-notifier-shogun: Removed deprecated dot-product from linalg16:40
shogun-notifier-shogun: lambday :develop * e223ec7 / src/shogun/lib/ (4 files): https://github.com/shogun-toolbox/shogun/commit/e223ec7e374e2f8468d334c339d2eeb732cac61e16:40
shogun-notifier-shogun: minor documentation fix in SG/GPU-Matrix/Vector classes16:40
shogun-notifier-shogun: lambday :develop * b73e2f0 / src/shogun/machine/BaggingMachine.h: https://github.com/shogun-toolbox/shogun/commit/b73e2f093fd3df2dbb66537e7320c012c4abde5b16:40
shogun-notifier-shogun: removed doxygen warnings16:40
shogun-notifier-shogun: lambday :develop * f56294f / src/shogun/mathematics/linalg/ratapprox/logdet/LogDetEstimator.h: https://github.com/shogun-toolbox/shogun/commit/f56294f88af504f48b147d4c0105ccf518d952ee16:40
shogun-notifier-shogun: removed doxygen warnings from log-det estimator16:40
shogun-notifier-shogun: Soumyajit De :develop * d82150a / src/shogun/ (10 files): https://github.com/shogun-toolbox/shogun/commit/d82150a9d69f5dd04f415d9064d273012cf1911816:40
shogun-notifier-shogun: Merge pull request #2561 from lambday/develop16:40
shogun-notifier-shogun:16:40
shogun-notifier-shogun: Minor doxy fixes+removed deprecated DotProduct impl from linalg16:40
lambdayiglesiasg: what did you configure shogun with? I cannot see Eigen__MatrixXt in my modshogunPYTHON_wrap.cxx16:43
@iglesiasglambday: cmake -DPythonModular=ON -DCMAKE_BUILD_TYPE=Debug -DBUNDLE_EIGEN=ON -DENABLE_TESTING=OFF -DBUILD_EXAMPLES=OFF ..16:45
@iglesiasglambday: there was a type, sorry16:46
@iglesiasglambday: Eigen__MatrixT16:46
@iglesiasgtypo*16:46
@iglesiasgsaying there's a typo with a typo \o/16:46
lambdayiglesiasg: haha :D16:47
-!- travis-ci [~travis-ci@ec2-54-80-122-236.compute-1.amazonaws.com] has joined #shogun16:50
travis-ciit's Soumyajit De's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/3901467216:50
-!- travis-ci [~travis-ci@ec2-54-80-122-236.compute-1.amazonaws.com] has left #shogun []16:50
@iglesiasglambday: you got that one in modshogunPYTHON_wrap, right?16:50
lambdayiglesiasg: yep...16:50
@iglesiasgbtw, it is king of annoying that enable_testing=on build c++ examples even if build_examples=off16:52
@iglesiasglol king of annoying, I am pushing my boundaries today16:52
lambdayhaha.. you're right actually... its the king of all annoying things out there :D16:56
@iglesiasgwiking: do you think we can get a quick fix for that? pleaseee :)16:56
shogun-buildbotbuild #848 of precise - libshogun is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/precise%20-%20libshogun/builds/848  blamelist: lambday <heavensdevil6909@gmail.com>16:59
shogun-buildbotbuild #849 of precise - libshogun is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/precise%20-%20libshogun/builds/849  blamelist: lambday <heavensdevil6909@gmail.com>, Soumyajit De <heavensdevil6909@gmail.com>17:02
lambdayiglesiasg: https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/lib/GPUMatrix.h#L11517:06
lambdayiglesiasg: this is not SWIG guarded17:06
lambdayiglesiasg: and here https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/lib/GPUVector.h#L11017:07
lambdayiglesiasg: could you please try ifndefing it once?17:08
@iglesiasglambday: yes, I can do that17:11
lambdayiglesiasg: these might be the culprit here..17:12
@iglesiasglambday: we were discussing about this kind of thing yesterday, this is not really the best way of handling this issue, right?17:12
@iglesiasglambday: I mean, these classes that need eigen or other dependencies should just not be part of an interface17:13
@iglesiasgno matter whether this interface is going to be visible for swig or for users17:13
@iglesiasglambday: what do you think?17:13
lambdayiglesiasg: well, this stuff should really not be exposed to swig - its used internally in linalg and which makes it actually possible to work with different types of matrices in Eigen and ViennaCL17:13
@iglesiasglambday: exactly17:14
@iglesiasglambday: dumb question coming.. why is it exposed to swig, then? :)17:14
shogun-buildbotbuild #62 of CentOS7 - libshogun is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/CentOS7%20-%20libshogun/builds/62  blamelist: lambday <heavensdevil6909@gmail.com>17:15
shogun-buildbotbuild #875 of FCRH - libshogun is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/FCRH%20-%20libshogun/builds/875  blamelist: lambday <heavensdevil6909@gmail.com>17:15
lambdayiglesiasg: my bad... when khaled sent this PR I didn't notice this..17:16
lambdayiglesiasg: he handled it correctly for SGMatrix and SGVector17:16
lambdaywhich has similar things17:16
lambdayvia #ifndef SWIG17:16
lambdayiglesiasg: gotta go for now.. brb after dinner17:17
shogun-buildbotbuild #63 of CentOS7 - libshogun is complete: Success [build successful]  Build details are at http://buildbot.shogun-toolbox.org/builders/CentOS7%20-%20libshogun/builds/6317:20
shogun-buildbotbuild #876 of FCRH - libshogun is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/FCRH%20-%20libshogun/builds/876  blamelist: lambday <heavensdevil6909@gmail.com>, Soumyajit De <heavensdevil6909@gmail.com>17:20
shogun-notifier-shogun: Fernando Iglesias :develop * 82202b7 / src/shogun/machine/gp/ (2 files): https://github.com/shogun-toolbox/shogun/commit/82202b75c5cda105eec83a9f518bcf1d892227a017:20
shogun-notifier-shogun: Refactor part of Laplacian LBFGS to remove eigen3 include in header.17:20
@iglesiasglambday: enjoy your meal17:20
@iglesiasglambday: but then we can just remove these classes from the .i files if they shouldn't be exposed in interfaces17:21
@iglesiasgwiking: patch is in, let's see what travis thinks17:21
@iglesiasglambday: they are indeed not in the .i files. Still, it might be the cause of Eigen__MatrixT in swig if they are included in another header that swig has to look at. I will test it and get back later17:26
-!- travis-ci [~travis-ci@ec2-54-162-62-69.compute-1.amazonaws.com] has joined #shogun17:36
travis-ciit's Fernando Iglesias's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/3901694117:36
-!- travis-ci [~travis-ci@ec2-54-162-62-69.compute-1.amazonaws.com] has left #shogun []17:36
@iglesiasgwiking: no luck yet17:40
shogun-buildbotbuild #82 of osx2 - modular_interfaces is complete: Failure [failed csharp modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20modular_interfaces/builds/82  blamelist: lambday <heavensdevil6909@gmail.com>18:27
-!- iglesiasg [~iglesias@12.104.145.5] has quit [Ping timeout: 240 seconds]18:39
shogun-buildbotbuild #83 of osx2 - modular_interfaces is complete: Failure [failed csharp modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20modular_interfaces/builds/83  blamelist: lambday <heavensdevil6909@gmail.com>, Soumyajit De <heavensdevil6909@gmail.com>18:50
shogun-buildbotbuild #850 of precise - libshogun is complete: Failure [failed compile]  Build details are at http://buildbot.shogun-toolbox.org/builders/precise%20-%20libshogun/builds/850  blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com>19:13
shogun-buildbotbuild #877 of FCRH - libshogun is complete: Failure [failed test]  Build details are at http://buildbot.shogun-toolbox.org/builders/FCRH%20-%20libshogun/builds/877  blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com>19:14
-!- iglesiasg [~iglesias@12.104.145.5] has joined #shogun19:16
shogun-buildbotbuild #84 of osx2 - modular_interfaces is complete: Failure [failed csharp modular]  Build details are at http://buildbot.shogun-toolbox.org/builders/osx2%20-%20modular_interfaces/builds/84  blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com>19:53
-!- HeikoS [~heiko@12.104.145.5] has joined #shogun19:58
-!- mode/#shogun [+o HeikoS] by ChanServ19:58
-!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout]20:20
@lisitsynHeikoS: iglesiasg: https://github.com/shogun-toolbox/shogun/issues/256421:29
iglesiasglisitsyn: why would it compile swig faster?21:39
shogun-buildbotbuild #445 of debian wheezy - memcheck is complete: Failure [failed memory check]  Build details are at http://buildbot.shogun-toolbox.org/builders/debian%20wheezy%20-%20memcheck/builds/445  blamelist: lambday <heavensdevil6909@gmail.com>, Soumyajit De <heavensdevil6909@gmail.com>21:39
@lisitsyniglesiasg: less visible member variables I think21:39
iglesiasglisitsyn: what I am wondering is if it has some impact on swig the attributes21:40
iglesiasgthe public members definitely do21:40
@lisitsyniglesiasg: I think it handles whatever he sees21:41
iglesiasgbut the attributes are "always" private21:41
@lisitsyniglesiasg: plus21:41
@lisitsynwe can't have any method implementations in headers this way21:41
@lisitsynI mean for getters21:41
@lisitsynyou just don't see the class outside of .cpp21:41
-!- HeikoS [~heiko@12.104.145.5] has quit [Quit: Leaving.]21:42
iglesiasglisitsyn: so I think the problem with swig is the length of this modshogunPYTHON_wrap.cxx21:42
@lisitsyniglesiasg: yeah sure21:42
iglesiasgwhen we have to compile that file we need a few gb of ram21:43
iglesiasgdoes that file include info about the private members?21:43
iglesiasgeven if they appear in the header21:43
iglesiasgI think it doesn't21:43
@lisitsyniglesiasg: no21:43
@lisitsyniglesiasg: I am curious whether we can use C but not C++ for wrapper as well21:44
@lisitsynprobably no21:44
iglesiasglunch time :)21:45
-!- shaochuan [~shaochuan@c-50-184-81-180.hsd1.ca.comcast.net] has joined #shogun21:47
-!- shaochuan [~shaochuan@c-50-184-81-180.hsd1.ca.comcast.net] has quit [Client Quit]21:48
-!- shaochuan [~shaochuan@c-50-184-81-180.hsd1.ca.comcast.net] has joined #shogun21:48
-!- iglesiasg [~iglesias@12.104.145.5] has quit [Ping timeout: 255 seconds]21:49
-!- iglesiasg [~iglesias@12.104.145.5] has joined #shogun22:03
-!- HeikoS [~heiko@12.104.145.5] has joined #shogun22:22
-!- mode/#shogun [+o HeikoS] by ChanServ22:22
-!- wiking_ [~wiking@info2k1.hu] has joined #shogun23:00
-!- wiking [~wiking@huwico/staff/wiking] has quit [Read error: Connection reset by peer]23:00
-!- wiking_ [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]23:00
@HeikoSlisitsyn: https://github.com/shogun-toolbox/shogun/wiki/SWIG-issues23:01
@HeikoSlisitsyn: d-pointers will not solve the swig issues23:01
iglesiasgHeikoS: awesome documentation23:02
@HeikoSiglesiasg: thanks, feel free to clarify things23:02
@HeikoSiglesiasg: currently producing an example23:02
@HeikoSiglesiasg: found a relatively nice way23:02
@HeikoSiglesiasg: i tried it forlibsvmfil23:04
@HeikoSiglesiasg: and it saves 20k lines of code in the swig output23:04
@HeikoS!!!23:04
iglesiasgfuck, that sounds great23:04
-!- shogun-notifier- [~irker@7nn.de] has joined #shogun23:05
shogun-notifier-shogun: Thoralf Klein :develop * 15209a2 / src/shogun/base/SGObject.cpp: https://github.com/shogun-toolbox/shogun/commit/15209a2c5e584a2044238f11a664c8cf1a8bfcc123:05
shogun-notifier-shogun: Don't include "class_list" from same directory.23:05
shogun-notifier-shogun: Thoralf Klein :develop * 7e15762 / examples/undocumented/libshogun/CMakeLists.txt: https://github.com/shogun-toolbox/shogun/commit/7e15762c72828fbcb89cf7d4c18beaf057fff23723:05
shogun-notifier-shogun: Don't hardcode list of libshogun examples (instead use file glob feature of cmake).23:05
-!- wiking [~wiking@info2k1.hu] has joined #shogun23:05
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]23:06
shogun-notifier-shogun: Thoralf Klein :develop * a62e924 / examples/undocumented/libshogun/CMakeLists.txt: https://github.com/shogun-toolbox/shogun/commit/a62e92456bc4f6852d49f85f025d8edb61403b2e23:09
shogun-notifier-shogun: Revert "Don't hardcode list of libshogun examples (instead use file glob feature of cmake)."23:09
shogun-notifier-shogun:23:09
shogun-notifier-shogun: This reverts commit 7e15762c72828fbcb89cf7d4c18beaf057fff237.23:09
shogun-notifier-shogun: Thoralf Klein :develop * d13b386 / src/shogun/base/SGObject.cpp: https://github.com/shogun-toolbox/shogun/commit/d13b386b9594d371b4a710fe61b46e06641211e123:09
shogun-notifier-shogun: Revert "Don't include "class_list" from same directory."23:09
shogun-notifier-shogun:23:09
shogun-notifier-shogun: This reverts commit 15209a2c5e584a2044238f11a664c8cf1a8bfcc1.23:09
@HeikoSiglesiasg: check again23:12
@HeikoShttps://github.com/shogun-toolbox/shogun/wiki/SWIG-issues23:12
-!- travis-ci [~travis-ci@ec2-54-80-122-236.compute-1.amazonaws.com] has joined #shogun23:15
travis-ciit's Thoralf Klein's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/3903811723:15
-!- travis-ci [~travis-ci@ec2-54-80-122-236.compute-1.amazonaws.com] has left #shogun []23:15
-!- wiking [~wiking@info2k1.hu] has joined #shogun23:16
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]23:16
iglesiasgHeikoS: just added to that wiki page the RealFeatures(CSVFile) example to clarify the idea23:16
@HeikoSiglesiasg: go for it23:17
@HeikoSiglesiasg: yeah why extra interface classes wont help23:17
iglesiasgHeikoS: I think I got the idea why it won't work23:17
iglesiasgcheck it if you have a second and delete if I got it wrong ;D23:18
-!- shaochuan [~shaochuan@c-50-184-81-180.hsd1.ca.comcast.net] has quit [Remote host closed the connection]23:19
-!- shaochuan [~shaochuan@c-50-184-81-180.hsd1.ca.comcast.net] has joined #shogun23:20
-!- wiking [~wiking@info2k1.hu] has joined #shogun23:21
@lisitsynHeikoS: ok :)23:26
@HeikoSiglesiasg: I am now checking SGVector23:26
-!- wiking_ [~wiking@info2k1.hu] has joined #shogun23:27
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]23:27
@HeikoSiglesiasg, lisitsyn. soon pushing these single example for everyone to look/discuss23:27
@HeikoSand then if this is good, we should go through thoralfs hit list23:27
-!- wiking_ [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]23:27
@lisitsynHeikoS: well what d-pointers help is hiding more methods23:27
@HeikoSlisitsyn: yeah23:27
@HeikoSlisitsyn: and I love it23:27
@HeikoSlisitsyn: but not helping for swig, at least we think23:28
@lisitsynHeikoS: yeah sure I don't say it is for swig23:28
@HeikoSlisitsyn: but I would love to have this23:28
@HeikoSlisitsyn: then we can get more flexible with methods having non shogun parmaeters etc23:28
@HeikoSlisitsyn: but for now want to fix travis, which fails most times23:29
@HeikoSlisitsyn: could you fix some warnings?23:29
@HeikoSlisitsyn: for release?23:29
@lisitsynHeikoS: yes I'll try tomorrow23:29
@HeikoSlisitsyn: btw23:29
@HeikoSlisitsyn: we talked a lot about refactoring shoguns internals and do proper software engineering23:29
@HeikoSlisitsyn: separate algorihtms and core framework23:29
@HeikoSlisitsyn: maybe dropping parameter interface23:30
@HeikoSlisitsyn: etc23:30
@HeikoSlisitsyn: well write it down soon23:30
@HeikoSlisitsyn: aer is also cool23:30
@lisitsynHeikoS: ok cool23:30
@HeikoSlisitsyn: but thoralf suggested to drop parameters maybe completely, we should definitely talk about this23:30
@HeikoSlisitsyn: I am sure we can get shogun pretty light weight using this23:30
@lisitsynHeikoS: if we can drop parameters at all it could be cool23:30
@lisitsynbut how?23:30
@HeikoSlisitsyn: thoralf also currently builds a script that allow to only compile a certain number of classes23:30
@HeikoSlisitsyn: we loose serialisation, model-selection (might drop anyway), clone and equals23:31
@HeikoSlisitsyn: alternative: do it properly without all this overhead in the base classes23:31
@HeikoSlisitsyn: it really blows up compile time I think, but we would have to  investigate that23:31
@lisitsynHeikoS: ehmm we have say svm's C23:31
-!- wiking [~wiking@info2k1.hu] has joined #shogun23:32
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]23:32
@lisitsynwhere to put that?23:32
@HeikoSlisitsyn: keep x-validation23:32
@HeikoSthen users have to write a loop23:32
@lisitsynno I mean23:32
@lisitsynyou have some parameters anyway23:32
@lisitsynahh you mean SG_ADD thing23:32
@lisitsynnot state at all23:32
@HeikoSfor c in Cs:23:32
@HeikoS   svm.set_c(c)23:32
@HeikoS    xval.eval(svm)23:32
-!- lambday [67157f4f@gateway/web/freenode/ip.103.21.127.79] has quit [Ping timeout: 246 seconds]23:33
@HeikoSlisitsyn: yeah drop that maybe23:33
@lisitsynHeikoS: haha what if we drop state at all :D23:33
@HeikoSlisitsyn: rather support fast data IO23:33
@HeikoSso that people can store output23:33
@HeikoSbut dont know yet23:33
@HeikoSalso drop integration tests23:33
@HeikoSand all un-tested classes (or write unit tests)23:33
@lisitsynwhy?23:33
@HeikoSlisitsyn: just overhead23:34
@HeikoSlisitsyn: not a lot of use,23:34
@HeikoSlisitsyn: but thats for later23:34
@lisitsynwell23:34
@HeikoSlisitsyn: for now: release and swig23:34
@lisitsynthey are helpful sometimes23:34
@HeikoSlisitsyn: cant remember a single case where they helped anyone actually23:34
@HeikoSlisitsyn: but later23:34
@lisitsynyeah ok23:34
-!- wiking [~wiking@info2k1.hu] has joined #shogun23:37
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]23:37
-!- wiking [~wiking@info2k1.hu] has joined #shogun23:42
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]23:42
-!- wiking [~wiking@info2k1.hu] has joined #shogun23:47
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]23:47
-!- wiking [~wiking@info2k1.hu] has joined #shogun23:57
-!- wiking [~wiking@info2k1.hu] has quit [Read error: Connection reset by peer]23:57
--- Log closed Sun Oct 26 00:00:40 2014

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!