IRC logs of #shogun for Friday, 2017-07-07

« Thursday, 2017-07-06 Index Saturday, 2017-07-08 »
--- Log opened Fri Jul 07 00:00:44 2017
-!- sukey [~nodebot@ks312251.kimsufi.com] has quit [Remote host closed the connection]00:29
-!- sukey1 [~nodebot@ks312251.kimsufi.com] has joined #shogun00:29
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3908 merged by vigsterkr02:11
sukey1[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/41129f8ecb3955d37ed9dbba9643abca5495a493 by vigsterkr02:11
-!- mikeling [uid89706@gateway/web/irccloud.com/x-eiulobmjkkcvxlcr] has joined #shogun03:47
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3906 synchronized by MikeLing05:03
@wikingmikeling, here?07:26
mikelingwiking: yes, I'm checking your email :)07:27
mikelingthank you07:27
@wikingok cool07:27
@wikingok i have some questions regarding the random story07:27
mikelingok07:27
@wikingas on travis i'm getting weird errors07:27
@wikingthe integration tests for you locally07:27
@wikingall of them fail?07:27
mikelingnot all, some of them failed07:28
@wikingok07:28
@wikingi suspect the story there the same07:28
@wikingi.e. fails due to different randoms07:28
mikelingThe following tests FAILED:07:28
mikeling212 - unit-NeuralLinearLayer (Failed)07:28
mikeling246 - unit-QuadraticTimeMMD (Failed)07:28
mikeling247 - unit-TwoDistributionTest (Failed)07:28
mikeling278 - integration_meta_cpp-clustering-gmm (Failed)07:28
mikeling282 - integration_meta_cpp-distance-cosine (Failed)07:28
mikeling299 - integration_meta_cpp-multiclass_classifier-random_forest (Failed)07:28
mikeling303 - integration_meta_cpp-neural_nets-feedforward_net_classification (Failed)07:28
mikeling304 - integration_meta_cpp-neural_nets-feedforward_net_regression (Failed)07:28
mikelingthat's all07:28
@wikingmmmhmm07:28
@wikingcan you pastebin me the integration_meta_cpp-multiclass_classifier-random_forest output07:28
@wikingctest -R integration_meta_cpp-multiclass_classifier-random_forest -VV07:28
mikelingsure, just a second07:29
mikelingwiking: here https://pastebin.mozilla.org/902648007:29
@wikingmmm07:31
@wikingcould you do the following07:31
@wikingcd /Users/mikeling/shogun/build/examples/meta/cpp/multiclass_classifier07:32
@wikingand copy paste the output of ls07:32
mikelingwiking: https://pastebin.mozilla.org/902648107:33
@wikingok cool07:33
@wikingdo you have something like07:33
@wikingrandom_forest.dat in ../data ?07:34
mikelinglet me see..07:34
@wikingor do a find ~/shogun/data -name 'random_forest.data'07:35
@wikingor do a find ~/shogun/data -name 'random_forest.dat'07:35
mikelingwiking: yes, https://pastebin.mozilla.org/902648207:35
mikelingit's in '/Users/mikeling/shogun/data/testsuite/meta/multiclass_classifier/random_forest.dat' I guess07:36
@wikingthat's the only location?07:36
@wikingaaah no07:36
@wikingok yesh07:36
mikelingyes07:36
@wikingso what you would need now is07:36
@wikingpastebin07:36
@wikingdiff -uN /Users/mikeling/shogun/data/testsuite/meta/multiclass_classifier/random_forest.dat random_forest.dat07:36
mikelinghttps://pastebin.mozilla.org/902648507:37
@wikingwhat's in random_forest.dat07:38
@wiking?07:38
mikelinghttps://pastebin.mozilla.org/902648607:39
mikelinghere is the content of random_forest.dat I think07:39
@wikingmmmm07:39
@wikingok it's totally different07:40
mikelingso, it means I mess something up in random_forest during work on the random?07:41
@wikingmmmm07:49
@wikingyeah there's definitely something different07:49
@wikingi'm wondering07:49
@wikingcan you pastebin the random_forest.cpp07:49
@wikingmikeling, ^07:51
mikelingsure, just a second07:51
mikelinghttps://pastebin.mozilla.org/902648907:52
@wikingnono07:52
@wikingin the meta example07:52
@wikingthere should be a random_forest.cpp07:52
@wikingmikeling, in cd /Users/mikeling/shogun/build/examples/meta/cpp/multiclass_classifier07:53
mikelinghttps://pastebin.mozilla.org/9026490 here07:53
@wikingoh ok07:53
@wikingso this one had a seed 107:53
@wikingmmm07:54
@wikingcan you try to run it07:54
@wikingthe test07:54
@wikinglike07:54
@wikingSHOGUN_NUM_THREADS=1 ctest -R integration_meta_cpp-multiclass_classifier-random_forest07:55
mikelingmmmm still failed07:55
mikelinghttps://pastebin.mozilla.org/902649107:56
mikelinghere is the result07:56
@wikingSHOGUN_NUM_THREADS=3 ?07:56
@wikingalthough i guess you are on osx07:56
@wikingso it doesn't matter :d07:56
mikelingno, still not pass07:56
@wikingok nvermind07:57
@wikingmikeling, can you ping heiko and lambday about the other unit tests failing07:57
@wikingin the PR07:57
mikelingok, I will do that right away07:57
@wikingand now we should talk about how to do the change to c++11 random07:58
mikelingwiking: ok, I just make a description for these failed test and @Heikos and lambday in there08:06
mikelinghope I describe it clear enough08:07
@wikingcool08:09
@wikingdunno if mater lisitsyn is here ?08:09
-!- rcurtin [~ryan@knife.lugatgt.org] has quit [Ping timeout: 240 seconds]08:41
-!- rcurtin [~ryan@knife.lugatgt.org] has joined #shogun08:42
-!- geektoni [~geektoni@93-34-128-38.ip49.fastwebnet.it] has joined #shogun09:09
lisitsynwiking: hey10:10
@wikinglisitsyn, ho10:10
@iglesiasgI am tired of using technology10:22
@wiking:D10:24
@wikingiglesiasg, wood and stone10:24
@wikinggo!10:24
@wikinglisitsyn, ok so here's another question10:24
@wikinglisitsyn, i'm thiknig about dropping the whole CRandom object and just add some macros for lambdas to generate random10:25
@wikingas the problem is the following10:25
@wikingimagine we take the planned c++11 random engine10:25
@iglesiasgwiking: the10:25
lisitsyna set of lambdas sounds like a class10:25
lisitsyn:P10:25
@iglesiasgwiking: the "hey ho" reminded me of the ayo in that song :P10:26
@wikingbut listen10:26
lisitsynyes10:26
@wikinglisitsyn, so check here http://en.cppreference.com/w/cpp/numeric/random10:26
@wikingyou have like 10+ different distribution10:26
@wikingdo we really wanna wrap those in CRandom?10:26
lisitsynyes10:26
lisitsynahh10:26
lisitsynok agree just provide seed10:26
lisitsynand let people sample10:27
lisitsynLET MY PEOPLE SAMPLE!10:27
@wiking:D10:27
@wikingbut yeah i mean the thing is for lambda10:27
lisitsynwhat this lambda is for?10:28
@wikingnothing10:28
@wikingi mean10:28
@wikingwe could have it for case yo uneed a simple random10:29
@wikingso that you dont need to do this10:29
lisitsynmake using random hard again10:29
@wiking std::mt19937 prng(global_seed);10:29
@wikingbecause if somebody10:30
lisitsynyeah but such lambda would produce the same thing all the time as we don't change the seed10:30
@wikingi meant only the ctor of the prng :)10:31
@wikingeverything else (see distribuation  etc) is up to the implementation10:31
@wikingthe only thing if we dont have an interface10:31
lisitsyngenerator<std::mt19937>()10:31
@wikingor like a macro10:31
lisitsynI like it10:31
@wikingto generate the prrng10:31
lisitsyntemplate function10:31
@wikingthen users might mistakenly10:31
@wikingnot provide the seed for the engine10:31
@wikingand then we are fucked10:32
@wikinglisitsyn, get_prng() ?10:32
@wikingand you can pass various PRNG engines?10:32
@wikingi mean the problem with generator is that what the fuck it does generate? :)10:33
@wikingand each time you ctor a new engine?10:33
lisitsynyes10:34
lisitsynbut that's what you wanted no?10:34
@wikingno what i wanted is just to get a prng set with the global seed :)10:34
@wikingso i would like to have some thing10:34
lisitsynyes10:34
lisitsynget_prng<std::mt19937>();10:35
@wikingauto prng = get_prng(); //10:35
@wiking std::normal_distribution<> normal_dist(mean, 2);10:35
@wikingnormal_dist(prng)10:35
@wikingright?10:35
lisitsynah there are also parametric10:35
lisitsynI'd avoid macro at all cost10:35
lisitsynthey infect scope10:36
@wikingyeah10:36
@wikingwe can then have a10:36
lisitsynbut if possible with templates sounds good to me10:36
@wikingtemplate<typename T = std::mt19937> shogun::get_prng() {return T(global_seed);}10:37
lisitsynexactly10:37
@wikingk10:37
lisitsynbut parameters of normal10:37
lisitsyndon't know how to provided that10:37
@wikingwhat do you mean?10:38
lisitsynnormal_distribution(mean, std)10:39
lisitsynwe need to fix seed but not everything else10:39
@wikingthat is up to the user10:39
@wikingthis you'll have to write in the code yourself10:39
@wikingwe dont provide you a helper method to create a distribution over the prng10:40
@wikingbecause actually there's a lot10:40
@wikingand we dont want to provide wrappers for all those things10:40
@wikingok?10:40
@wikingmikeling, ok so 2 things for the c++11 switch: you need to add the following global function to init.cpp: template<typename T = std::mt19937> shogun::get_prng() {return T(sg_random_seed);}10:42
@wikingand replace uint32_t sg_random_seed = generate_seed();10:44
@wiking 10:44
@wikingbgw10:44
@wikingok10:44
@wikingso the btw10:44
@wikingnevemering10:45
@wiking*10:45
@wikingi'll comment10:45
@wikingmikeling, check my comments...10:49
@wikinglisitsyn, https://github.com/shogun-toolbox/shogun/pull/3902 merge?10:52
lisitsynwiking: yeah probably10:54
lisitsynwiking: it wants me to change codestyle10:54
lisitsynbut better not10:54
@wikingyeyey leave it as is10:56
@wikingmerge it!10:56
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3751 synchronized by micmn10:58
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3877 synchronized by geektoni11:06
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3902 merged by lisitsyn11:18
sukey1[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/a9235abd19af360880a3d2761826d2af6428a6b8 by lisitsyn11:18
@wikingyey11:20
mikelingwiking: oh hey! Sorry for the late reply.11:25
mikelingthank you for your comment, I will address them asap11:26
@wikingkk11:27
@wikingthnx11:27
-!- iglesiasg [~iglesiasg@217.119.234.214] has quit [Quit: leaving]11:51
micmnwiking: when you have a minute please check the updated pr, ci pass should be ok12:08
@wikingwhich one?12:08
micmnTrained models tests12:09
@wikingkk12:15
@wikingchecking12:15
@wikingsrry12:15
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3877 synchronized by geektoni12:18
@wikingmicmn, this is great!12:40
@wikingmerging12:40
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3751 merged by vigsterkr12:41
sukey1[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/370a66b3473b492cbcdc942179290414a7dc938a by vigsterkr12:41
micmnCool thx!12:41
-!- dougal [56adb86b@gateway/web/freenode/ip.86.173.184.107] has joined #shogun12:45
-shogun-buildbot:#shogun- Build bsd1 - libshogun #60 is complete: Failure [failed test (failure)] - http://buildbot.shogun-toolbox.org:8080/#builders/31/builds/6012:46
-shogun-buildbot:#shogun- Build osx1 - libshogun #60 is complete: Failure [failed test (failure)] - http://buildbot.shogun-toolbox.org:8080/#builders/25/builds/6012:46
dougalHey, anyone knowledgeable about shogun build system around? I'm trying to add shogun to conda-forge, which builds Anaconda packages that would make it far easier+faster, at least for me, to get a release version of shogun installed. Partially working  recipe: https://github.com/conda-forge/staged-recipes/pull/323712:48
dougalThings that don't work yet:12:48
dougal- How do I configure it to link against OpenBLAS (or MKL) instead of the system BLAS, especially getting Eigen to use them?12:48
dougal- Is it possible to take a built libshogun.so / etc and then build the python interface separately? Re-building the full library for each python/numpy combination is super-wasteful (and times out on the conda-forge infrastructure), but conda's build system doesn't easily allow you to use partial build artifacts. A base shogun package plus a python interface package that builds based on libshogun.so / whatever else the base package wo12:50
dougal- My Windows builds aren't working, though I pretty closely followed https://github.com/shogun-toolbox/shogun/blob/develop/appveyor.yml (which btw is different from the website instructions for building on windows, which also didn't work...). Any suggestions?12:51
dougalSpecifically, the VC 9 builds for python 2.7 are complaining that "Project file does not exist.", while the higher versions of VC for python 3.5/3.6 are warning about exception semantics not being turned on and also giving errors like:   error C2039: 'max': is not a member of 'std'   (???). Logs here: https://ci.appveyor.com/project/conda-forge/staged-recipes/build/1.0.1482312:54
dougalOh actually, maybe https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/classifier/mkl/MKLMulticlassGLPK.cpp needs to #include <algorithm> on Windows to use std::min / std::max? Not sure why it would build on your version then, though13:01
dougalAlso getting: fatal error C1128: number of sections exceeded object file format limit: compile with /bigobj13:01
@wikingdougal, hello hello13:06
@wikinglemme read thisi one13:06
@wikingas this is rather long13:06
dougalyep!13:06
@wikingbut i need to finish something quickly13:06
@wikingis it ok if i get back to you in 1013:06
@wiking?13:06
dougalsure, no problem13:06
-!- dougal [56adb86b@gateway/web/freenode/ip.86.173.184.107] has quit [Quit: Page closed]13:17
-!- dougal [56adb86b@gateway/web/freenode/ip.86.173.184.107] has joined #shogun13:17
@wikinggeektoni, here/13:53
@wiking?13:53
geektoniwiking: yes13:53
@wikinggeektoni, https://github.com/shogun-toolbox/tflogger13:58
@wikingviola13:58
@wikingsorry for the delay13:58
geektoniwiking: \o/ np13:58
@wikingthere's gonna be several pushes so that i get travis working13:58
geektoniwiking: kk, btw, can we add tflogger to the docker image? so that I can finally test on Travis the cod I wrote :P14:00
@wikingyes14:00
@wikingdo you wanna add a pr for that?14:00
geektoniwiking: sure14:02
geektoniwiking: the `make install` command fails because when you set TFLOGGER_HEADER into the CMakeLists file you still use tensorflow_logger.h instead of event_logger.h.14:12
@wikingah i havent tested that14:12
@wikingidiot me14:12
@wikingsorry14:12
@wikingok i'm fixing + trying to get protobufv3 for the stupid travis image14:13
@wikingso the CI works14:13
geektoniwiking: np, when refactoring+renaming there are almost 1000 things which slip through ;)14:15
@wikinggeektoni, HEAD has the fix14:19
geektoniwiking: cool14:20
@wikinggeektoni, ok look i did a change14:26
@wikinggeektoni, can you test a full cycle with 554aad3353fc4d36f6943334f98bb3424f28e4e314:26
@wiking?14:26
@wikinggeektoni, so basically make sure that  you use that and then run it with any example... and see if you can load it in into TB14:26
@wikingplz14:26
@wikingmuch appreciated!14:27
@wikingif that works we'll make a 0.1.0 release14:27
geektoniok14:27
geektonigive me some minutes14:27
@wikingkk thnx heaps14:29
@wikingdougal, ok lemme read now your questions :)14:38
@wikingdougal, ok so about being able to compile libshogun and interface separatelu14:42
@wikingyes it's possible14:42
@wikingby default libshogun.so building is turned on14:42
@wikingdougal, the LIBSHOGUN cmake parameter controls whether to turn on or off libshogun.so build14:43
@wikingnamely if you do cmake -DLIBSHOGUN=OFF -DPythonModular=On ..14:43
@wikingthen it'll try to find on your system the installed libshogun and create an interface against that14:44
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3906 synchronized by MikeLing14:46
dougal@wiking aha! thanks, will try14:52
dougalwiking: any thoughts on the windows build issues?14:52
@wikingdougal, regarding MKL/Openblas14:54
@wikingis there a special thingy with eigen + openblas ? i know about MKL but not about openblas. if you have info regarding this could you link it to me plz14:54
dougali don't think there's anything special about it, should be the same as MKL14:55
@wikingmmmm14:55
dougal(as far as i know)14:55
@wikingnono14:55
@wikingi mean MKL has some special things with14:55
@wikingEigen14:55
@wikingopenblas is just openblas afaik14:55
@wikingbut can you give me the runtime env14:55
@wikingor how i can reproduce14:55
@wikingon which/where should detect the custom location14:55
@wikingof the openblas?14:55
@wikingeither i can help you with giving you the right cmake flags14:55
@wikingor simply fix the cmake of shogun14:55
@wikingMKL is a different story... there some extra env vars needs to be set14:56
dougalhttps://eigen.tuxfamily.org/dox/TopicUsingBlasLapack.html says it works with openblas, as long as you set those macros14:56
@wikingin order that eigen starts using that given MKL14:56
@wikingdougal, ok i'll check into it14:56
@wikingah ok14:56
dougali haven't fiddled with pointing cmake at it directly yet because i thought that would be an issue too14:56
@wikingthis assume 3.3.x eigen14:56
dougalbut will try14:56
dougaldoes shogun use blas directly outside of eigen also?14:56
@wikingyes14:57
@wikingless and less14:57
@wikingbut still it does in some places14:57
dougalokay, so i'll try fiddling with the cmake variables there, shouldn't be har14:57
dougald14:57
@wikingk14:57
@wikinghow do you acquire eigen?14:57
@wikingdo you make shogun to use it's own eigen?14:57
@wikingor you have some system eigne?14:57
@wiking*eigen14:57
dougalbeen using conda's eigen14:57
@wikingmmm can you help me understand what is the env14:58
dougalwhich is 3.3.314:58
@wikingthat you have14:58
@wikingthat has blas etc14:58
dougalinstalling everything via conda14:58
@wikingso i could locally reproduce some stuff?14:58
@wikinglike a set of command will do for me14:58
dougalare you familiar with conda stuff?14:58
@wikingvery brief14:59
@wikingit'd be very helpful for me if you just give the set of commands14:59
dougalyep14:59
dougalso14:59
@wikingthat you have for your conda env14:59
@wikingand then i can start experimenting14:59
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3906 synchronized by MikeLing14:59
dougal1 - install conda (https://conda.io/miniconda.html)14:59
dougal2 - conda config --prepend channels conda-forge15:00
@wikingregarding windows: you've seen our appveyor? there's only Visual Studio 14 2015 and older support for shogun15:00
dougal3 - conda install conda-build15:00
@wikingi meant to say newer15:00
@wikingas older visual studios does not have a c++11 compiler15:00
@wikingafaik15:00
@wikingok testing15:00
@wikingdougal, python3 or 2?15:00
dougaleither15:01
dougal4 - git clone https://github.com/dougalsutherland/staged-recipes/ -b shogun15:01
dougalcd staged-recipes/recipes/shogun15:01
dougalconda build . --python 2.7 --numpy 1.1315:01
dougalthat will build the recipe15:01
dougalif you want to fiddle with it in there, easiest thing is to edit build.sh to add a "bash" call or whatever15:02
dougalor whatever equivalent with bld.bat on windows15:02
@wikingk lemme try15:02
dougalre: windows: does the python interface for that actually work? my impression was that the ABI is not compatible across visual studio versions, and you need to use same version as python is compiled with15:03
dougalpython 2.7 is compiled with VC 915:03
@wikingi've honestly actually never tried15:04
@wikingSWIG + windows :)15:04
@wikingthere's a ticket for it15:04
@wikingbut nobody did that yet15:04
dougalheh okay15:04
@wikingbut again15:04
@wikingVC 915:04
@wikingi'm not so sure if that's gonna fly15:04
dougalokay, i think that means that python interface to shogun is not possible with windows + python 2.715:05
dougalunless i'm misunderstanding and it actually works for some reason15:05
dougalpython >= 3.5 uses VC 14, which is still giving me compile errors15:06
sukey1[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/3909 opened by romainviard15:07
@wikinggeektoni, so we release? :)15:08
geektoniwiking: mmm Tensorboard works but shouts this error: WARNING:tensorflow:Invalid event.proto file_version. Defaulting to use of out-of-order event.step logic for purging expired events.15:11
@wikingyep yep15:11
@wikingthat's what i suspected15:11
@wikingfucker15:11
@wikinggeektoni, if you step one commit back c88805798127bcf0420f7c3cad8331d1052358a515:12
@wikingthat should not have this error i suspect15:12
geektonilet me check15:12
geektoniyeah, with the previous commit, the error disappears.15:18
geektoniwiking: ^15:18
@wikingmmm15:18
@wikingi dont understand the fucking ostringstream :)15:18
@wikingok15:20
@wikingi think i have a soltuon15:20
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3877 synchronized by geektoni15:22
dougalwiking: building interface separately seems to be working, thanks. :)15:49
@wikingdougal, nw15:49
dougalre openblas: it looks like the problem is this section, https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/CMakeLists.txt#L27815:49
dougalhttps://github.com/Kitware/CMake/blob/master/Modules/FindLAPACK.cmake will find openblas15:49
dougalbut since it's not accelerate or mkl, this code then looks for atlas or cblas15:50
dougaland openblas provides a cblas interface but not libcblas.so.3, so it uses system blas15:50
@wikinggeektoni, so good?15:53
@wikingbecause then i release 0.1.0 and then we can add that to the Docker15:53
geektoniwiking: building takes some time on my machine. Give my 5 minutes.15:54
@wiking:)))))))15:54
@wikingbuild what? tflogger?15:54
@wikingyou use ccache right?15:54
geektoniwiking: yes yes, of course.15:56
@wikinggeektoni, mmm are you using -G"Ninja"16:01
@wiking?16:01
@wikingfor cmake16:01
geektoniwiking: mmh nope16:02
@wikinghooo16:03
@wikingtry it16:03
geektonibtw, now the file generated by TFLogger are empty :/16:03
@wikingmicmn, have you seen this: http://buildbot.shogun-toolbox.org:8080/#/builders/25/builds/60/steps/6/logs/stdio16:03
@wikinggeektoni, what? :D16:04
@wikinggeektoni, the test generates files :DDD16:04
@wiking(unit test)16:04
@wikingmicmn, same with bsd http://buildbot.shogun-toolbox.org:8080/#/builders/31/builds/60/steps/6/logs/stdio16:04
geektoniwiking: nono, after the TFLogger update, the output file generated for TB are empty :/ there are no data inside.16:05
@wikinggeektoni, try this locally16:05
@wikingfor tflogger16:06
@wikingcmake -DBUILD_TESTS=ON ..16:06
@wikingmake16:06
@wikingand then16:06
@wiking./test/tfloggerTest16:06
@wikingtensorboard --logdir .16:06
@wikingthe test will generate a file16:07
@wikingoh nice16:07
@wikingwtf happened now16:07
@wiking:DDDDDDDDD16:07
@wikingok no16:08
@wikingit worksforme16:08
@wikinggeektoni, u?16:08
@wikingmmmm16:08
@wikingactually weird stuff is happening16:08
geektonimmh just a sec16:08
@wikingon the first run16:08
@wiking(the first file) will not be valid16:09
@wikingcannot even read it16:09
@wikingany consecutive test run that generates a file16:09
@wikingseems to be ok16:09
geektoni?? lol16:09
sukey1[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/3910 opened by dougalsutherland16:09
@wikingyeah pretty much lol16:09
dougal(^ that issue was me, about openblas)16:10
@wikingyep yep16:10
@wikinggeektoni, idk16:10
@wikingfucking string concatenation man :DDDD16:10
sukey1[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/391016:10
geektoniwiking: ahahah16:11
micmnwiking: yeah, dont know wtf is going on I guess different random training data16:12
@wikingmicmn, fixed seed?16:14
@wikinggeektoni, mmm this is sooooo weird16:14
micmnAre those builders easily replicabile locally?16:14
@wikingmicmn, one is osx the other is freebsd16:15
@wikingmicmn, i can test on osx16:16
@wikinggeektoni, works for u16:17
@wiking?16:17
micmnSo they are not virtualized16:17
@wikingnoup16:17
geektoniwiking: mmh, for me works16:18
@wikingso wtf16:19
@wiking:)))16:19
geektoniwiking: mmh I'm checking16:21
@wiking  REQUIRE_THAT( actual.file_version(), Catch::Equals(getCurrentFileVersion()) )16:23
@wikingwith expansion:16:23
@wiking  "brain.Event:2" equals: "brain.Event:2"16:23
@wikingarg16:23
@wikingi guess there's a \0 somewhere16:23
geektoniwiking: lol16:24
geektoniwiking: I think it is a problem on the Shogun-side16:32
@wikinggeektoni,mmm16:33
geektoniwiking: I mean, a problem of my code16:33
@wikingmaok16:37
@wikinglets see16:37
@wikingbecause i cannot reproduce any bad things with the last commit16:37
geektoniwiking: I'm an idiot16:39
geektoniI figured out the problem16:39
@wikinghehhe what was it?16:39
@wikinggeektoni, so it works?16:40
geektoniIf a class doesn't emit any object, of course the Event file will be empty.16:40
geektoniyes yes16:40
@wikingehhe ok16:40
@wikingi release it then16:40
geektoniyou can finally mark tflogger as 0.1.016:40
geektoni;)16:40
@wikinghttps://github.com/shogun-toolbox/tflogger/archive/v0.1.0.tar.gz16:41
@wikingthis needs to go into shogun-dev docker16:41
@wikingand finally then your PR will be testable :)16:42
@wikinggeektoni, you want me to do the Dockerfile?16:42
geektoniwiking: nono, I've already done it16:43
geektonithanks anyway :D16:43
@wikinggeektoni, where's the dockerfile16:44
@wikingi dont see it16:44
geektoniupdating it with the new link16:44
@wikingkk16:45
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3911 opened by geektoni16:46
geektoniwiking: ^16:46
@wikingok16:46
@wikingmerging16:46
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3911 merged by vigsterkr16:47
sukey1[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/78e5ef5d62fb36b14af09121c2838a6e0dadcf24 by vigsterkr16:47
@wikingok it's in queue https://hub.docker.com/r/shogun/shogun-dev/builds/by6wfedsnztxkzqdjdtdjpj/16:48
geektonicool16:49
@wikingonce ready i'll restart the travis build for this pr https://github.com/shogun-toolbox/shogun/pull/387716:49
geektoniwiking: thanks!16:49
@wikingand then if that's green i'll merge it into the feature brnach16:49
@wikingdo we miss something ?:)16:49
@wikingor this feature branch can land in develop i guess? :)16:50
geektoniwiking: mmh, new files still need a license, I guess16:50
@wikingwhich new files?16:50
geektonibut yeah, I think it can land in develop ;)16:50
geektoniParameterObserver*16:51
@wikingah yeah16:51
@wikingadd BSD license plz16:51
@wikingah wait16:51
@wikingwe have a lot of the TODOs16:51
@wikingwe need to add the new signal handler16:52
@wikingright?16:52
@wikingwe'll ask mike's collaboration for that16:52
-shogun-buildbot:#shogun- Build osx1 - libshogun #61 is complete: Success [build successful] - http://buildbot.shogun-toolbox.org:8080/#builders/25/builds/6116:52
geektoniwiking: some TODOs are placed in classes which do not derive directly from CMachine16:53
@wikingohooooooooooo16:53
@wikingi see this16:53
@wikinghttps://github.com/shogun-toolbox/shogun/pull/3877/files#diff-3ea04b3b4f57c2582e62770948450c74R3916:53
geektoniso we'll need to plan carefully what to do16:53
@wikinggeektoni, cant we actually make this templated?16:53
geektonimmmh it is not actual templates, because we are dealing with Any16:54
geektonigoogle test offers utilities only for template16:54
@wikinggeektoni, https://github.com/shogun-toolbox/shogun/blob/develop/tests/unit/classifier/LDA_unittest.cc#L9516:54
@wikingmmm16:55
@wikingmicmn, lemme test locally what's happening with that unit test16:56
micmnOk thx16:57
-!- dougal [56adb86b@gateway/web/freenode/ip.86.173.184.107] has quit [Quit: Page closed]17:04
@wikinggeektoni, error :D17:08
geektoniwiking: docker?17:08
@wikinggeektoni, yep17:09
@wikingmissing dependency17:09
@wiking Could NOT find Protobuf (missing: PROTOBUF_LIBRARY PROTOBUF_INCLUDE_DIR)17:09
@wikinggeektoni, yeah you need to add it to the apt17:09
geektoniahh crap17:10
geektoniok, time for a new PR!17:10
@wikingprotobuf-compiler libprotobuf-dev17:10
@wikingthese 217:10
geektonithnx17:11
@wikingmicmn, uhoh unit-TrainedModelSerializationTest ... passed on my machine17:12
micmnlol17:12
@wikingmicmn, interestingly... even on buildbot that's the case17:12
@wikingbsd still failing17:12
@wikinglemme check it there17:13
@wiking:)17:13
@wikingmikeling, here?17:15
mikelingwiking: yes17:16
@wikingok so have you seen our next approach?17:16
@wikingfor the global17:16
mikelingseen? you mean the global seed, right? or the get_prng()?17:17
@wikingget_prng17:17
@wikingmikeling, but dont push that into this pr17:18
@wikingyet17:18
mikelingyeah, and it to the pr https://github.com/shogun-toolbox/shogun/pull/3906/commits/48aa9bcb21c35fd03a223ee5bb91a41bd688942f17:18
mikelingoh17:18
@wikingaaah17:18
@wikingi see17:18
@wikingcool17:18
@wikingit's there17:18
@wikingokok17:18
mikelingsorry,17:18
@wikingit's good17:18
@wikingnono17:18
@wikingit's fine17:18
@wikingit's there but we dont use it yet17:18
mikelingok17:19
@wikingmikeling, lets see if we get an answer from the people17:19
@wikingfor failures17:20
mikelingwiking: and I' checking the the sg_io things, so I found the spdlog already have info, error, debug in its logger17:20
mikelingdo we need to replace it with sg_io or io?17:20
mikelingSo we don't need SGIO anymore?17:21
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3912 opened by geektoni17:22
@wikingmikeling, well the idea is that we just put the spdlog17:22
@wikinginto SGIO class17:22
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3912 merged by vigsterkr17:23
sukey1[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/4ac8bfaab6259c94df4282c0c260d5e7e9a44d78 by vigsterkr17:23
-!- OXPHOS [92bd305b@gateway/web/freenode/ip.146.189.48.91] has joined #shogun17:24
-shogun-buildbot:#shogun- Build osx1 - libshogun #62 is complete: Failure [failed test (failure)] - http://buildbot.shogun-toolbox.org:8080/#builders/25/builds/6217:28
-!- dougal [56adb86b@gateway/web/freenode/ip.86.173.184.107] has joined #shogun17:41
@wikinggeektoni, sad days17:48
geektoniwiking: docker still fails :/ summary.proto:1:10: Unrecognized syntax identifier "proto3".  This parser only recognizes "proto2".17:48
@wikingyes17:48
geektoniyes, sad days.17:49
sukey1[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/6344c7496484b83241a43b6f828023f59082ee80 by vigsterkr17:51
@wikinghopefully this'll fix it17:51
geektonicool!17:52
dougalstill getting windows errors, using VC14 on x64 (I think same environment as shogun's appveyor build...): lots of warnings about wanting /EHsc, a few errors in MKLMulticlassGLPK about std::min, std::max, and a fatal error asking for /bigobj17:52
dougalhttps://ci.appveyor.com/project/conda-forge/staged-recipes/build/1.0.14839/job/vcnqd6krwqenb7d617:52
dougal:|17:53
dougallinux/mac are working though, except for the openblas problems (and no openmp on mac because of compiler issues)17:55
@wikingdougal, checking17:56
@wikingdougal, openmp on osx only possible if u would have gcc17:56
dougalyeah i know17:56
dougal(or homebrew version of clang)17:56
-shogun-buildbot:#shogun- Build osx1 - libshogun #63 is complete: Success [build successful] - http://buildbot.shogun-toolbox.org:8080/#builders/25/builds/6317:57
dougal(conda packages gcc, but the version is too old; some comments about that at https://github.com/conda-forge/staged-recipes/pull/3237)17:57
sukey1[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/8bf4aed8252e1c3772d249eb8b854de3286dc2e0 by vigsterkr18:03
@wikingdougal, ^ this should fix the problem of max/min18:03
dougalcool, yeah18:03
dougallooking at your appveyor builds, e.g. https://ci.appveyor.com/project/vigsterkr/shogun/build/1014: it seems like you don't have GLPK installed there, so that's why not getting the error18:03
dougaland they're also spitting out the same /EHsc warnings18:04
@wikingyes18:04
@wikingthat warning is 'fine'18:04
@wikingi'm just wondering what's the difference of LDA18:04
@wikingi guess eigen18:04
dougalyeah18:04
@wikingverison18:04
dougal(for reference, which maybe you know: your appveyor builds download eigen 3.2.8, mine is using system 3.3.3)18:09
@wikingprobably that's the story18:10
dougali'll try using system 3.2.818:11
dougalsee if that works18:11
dougalokay, builds queued, i'm heading out for a while18:13
dougallet me know on the github PR or whatever if you happen to figure anything else out :)18:13
-!- dougal [56adb86b@gateway/web/freenode/ip.86.173.184.107] has quit [Quit: Page closed]18:13
sukey1[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/72cfeb15639d4b39565d61700dce11c0d839c4da by vigsterkr18:14
-shogun-buildbot:#shogun- Build osx1 - libshogun #64 is complete: Failure [test (failure)] - http://buildbot.shogun-toolbox.org:8080/#builders/25/builds/6418:16
-shogun-buildbot:#shogun- Build osx1 - libshogun #65 is complete: Success [build successful] - http://buildbot.shogun-toolbox.org:8080/#builders/25/builds/6518:42
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3877 synchronized by geektoni18:50
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3877 synchronized by geektoni20:06
-!- geektoni [~geektoni@93-34-128-38.ip49.fastwebnet.it] has quit [Quit: Leaving.]20:35
-!- mikeling [uid89706@gateway/web/irccloud.com/x-eiulobmjkkcvxlcr] has quit [Quit: Connection closed for inactivity]20:35
sukey1[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3877 synchronized by geektoni21:51
-!- dougal [56adb86b@gateway/web/freenode/ip.86.173.184.107] has joined #shogun22:42
dougalwiking: FYI, still getting the same error with eigen 3.2.8, so i guess that's not it...22:42
-!- dougal [56adb86b@gateway/web/freenode/ip.86.173.184.107] has quit [Ping timeout: 260 seconds]22:49
sukey1[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/3913 opened by MaximilianLomardo23:52
--- Log closed Sat Jul 08 00:00:46 2017
« Thursday, 2017-07-06 Index Saturday, 2017-07-08 »

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!