IRC logs of #shogun for Monday, 2017-07-03

« Sunday, 2017-07-02 Index Tuesday, 2017-07-04 »
--- Log opened Mon Jul 03 00:00:39 2017
-!- witness_ [uid10044@gateway/web/irccloud.com/x-opyfsdnrigffhhmq] has joined #shogun01:37
-!- mikeling [uid89706@gateway/web/irccloud.com/x-fzbrljofmyykqzsh] has joined #shogun03:27
mikelingHei wiking , could we trigger the specific build https://travis-ci.org/shogun-toolbox/shogun/jobs/249362590, it looks like the jobs exceeded on the travis side.03:32
mikelingThank you03:32
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3888 synchronized by MikeLing05:28
-!- slayerjain [uid117577@gateway/web/irccloud.com/x-wjmaozubecnuflnv] has joined #shogun05:33
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3888 synchronized by MikeLing05:40
@wikingmikeling, ping?06:51
mikelingwiking: pong06:52
@wikingok so i see06:52
@wikingall the CIs are green06:52
@wikingso i'll merge this one now06:52
@wikinginto the feature branch06:52
@wikingok?06:52
mikelingSo we don't wait the feedback from Heikos?06:53
@wikingit's ok06:53
@wikingit's a feature branch06:53
mikelingOk06:53
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3888 merged by vigsterkr06:53
@sukey[https://github.com/shogun-toolbox/shogun] vigsterkr pushed 2 commits:06:53
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/764ebab7312cf49193e163c741a0e0d5be84db3306:53
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/7a465c45c3b129512e3503bad95626abdf9c70e206:53
mikelingThank you06:53
@wikingmikeling the next step would be to get rid of CMath::06:53
@wikingrandom stuff06:53
mikelingOk I see06:54
@wikingbecause that's still static there right?06:54
mikelingYes06:54
@wikingyeah we dont want static prng anywhere06:54
@wikingso yeah that should be the next immediate step06:55
@wikingCMath::random* removal06:55
mikelingwiking: ok, but how to deal with the macros  like https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/lib/tapkee/tapkee_shogun.cpp#L1406:58
mikelinga lambda function?06:58
@wikingok so this is easy06:58
@wikinga lambda function is elegant yes :)))06:58
@wikingor you can add static functions to CRandom06:59
@wikingthat will basically be the same as the lambda function06:59
mikelingok, got it.06:59
@wikingbut i like the lambda function06:59
@wikingis there any other places you need this?06:59
@wikingbut yeah both is fine07:00
@wiking*are fine07:00
mikelingok, I see. I will commit a pr asap07:00
mikelingthank you07:00
-!- travis-ci [~travis-ci@ec2-50-19-181-204.compute-1.amazonaws.com] has joined #shogun08:14
travis-ciit's MikeLing's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/24949600608:14
-!- travis-ci [~travis-ci@ec2-50-19-181-204.compute-1.amazonaws.com] has left #shogun []08:14
-!- slayerjain [uid117577@gateway/web/irccloud.com/x-wjmaozubecnuflnv] has quit [Quit: Connection closed for inactivity]09:03
-!- geektoni [~geektoni@93-34-128-38.ip49.fastwebnet.it] has joined #shogun09:20
@wikinggeektoni, ok so09:21
@wikingi owe you a repo09:21
@wiking:D09:21
geektoniwiking: ahah yeah ;) that's true ;)09:22
geektoniwiking: did you finish refactoring tflogger?09:25
@wikingyeah actually i did09:25
@wikingit's scary though09:25
geektoni\o/09:25
@wikingbecause it's not supporting fucking swig atm09:25
@wiking:(09:25
@wikingso either it'll take another refector09:26
@wikingbut i dont care09:26
@wiking:D09:26
geektonimmmh09:26
geektonilol09:26
@wikingmy problem is this09:26
@wikingTensorFlowRecordReader(std::istream& input);09:26
@wikingbasically std::istream09:26
@wikingi dont know how i can SWIG that09:26
geektoniwiking: mmh I found this for python https://stackoverflow.com/a/18932980/795117109:30
geektonibut for other languages I have no idea actually :P09:30
@wikingyeah but for the rest?09:30
@wikingbut i dont know what other portable interface i could put there09:31
@wikingvoid*09:31
@wiking?09:31
@wiking:D09:31
geektoniWe could offer also something like TensorFlowRecordReader(std::string& filename), which manages automatically the stream, for the time being.09:34
geektonibecause I imagine that  TensorFlowRecordReader(std::istream& input) will need a custom SWIG solution for each languages Shogun supports.09:34
@wikingnono09:40
@wikingi mean the record reader09:40
@wikingis just a wrapper09:40
@wikingaround09:40
@wikingi mean tool to be used09:40
@wikingfor you09:40
@wikingwith TFObserver09:40
@wikingas you would manage your own file object09:40
@wikingsee what i mean?09:40
@wikingbut tflogger would still have a TensorflowLogger09:41
@wikingthat would acecpt a filename09:41
@wikinglisitsyn, pingu09:41
geektoniwiking: yeah, understood, my bad :P09:46
@wikingi just wanted to give a simple class09:47
@wikingthat decouples the writing09:47
@wikinginto a file09:47
@wikingand you could read/write from a stream09:47
@wikingregardless whether that is a network stream09:47
@wikingor an actual file strema09:47
geektonibut then SWIG arrived :/09:48
-!- iglesiasg [~iglesiasg@217.119.234.214] has joined #shogun09:52
-!- mode/#shogun [+o iglesiasg] by ChanServ09:52
-!- witness_ [uid10044@gateway/web/irccloud.com/x-opyfsdnrigffhhmq] has quit [Quit: Connection closed for inactivity]10:43
lisitsyniglesiasg: what do you think about the "modshogun" name? ;)11:10
@wikinglisitsyn, everybody hates it11:12
@wikinglisitsyn, ping11:12
lisitsynwiking: hey11:13
@wikinglisitsyn, ok so ideas about swig compatible input stream ?:)11:13
lisitsynwhat is the role of this istream?11:14
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/3897 opened by karlnapf11:14
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/3897 karlnapf added label: "SWIG"11:14
@wikinglisitsyn, read from it :)11:14
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/3897 karlnapf added label: "cmake"11:14
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/3897 karlnapf added label: "testing"11:14
lisitsynread what?11:14
@wikinglisitsyn, void*11:15
@wikingor char*11:15
lisitsynuhm why is it exposed to swig then?11:15
@sukey[https://github.com/shogun-toolbox/shogun] Issue https://github.com/shogun-toolbox/shogun/issues/389711:15
@wikinglisitsyn, so that you can do that from any interfaee11:15
@wikingso you can write from python ruby etc.11:16
lisitsynit is about tflogger right?11:17
lisitsynI am missing the thing that happens in swig11:17
lisitsynI thought it is happening inside shogun11:18
lisitsynno?11:18
@wikinglisitsyn, well i wanna be able to expose tflogger11:18
@wikingto any swig interface11:19
@wikingnot only c++11:19
lisitsynhttps://github.com/shogun-toolbox/tflogger11:19
lisitsynit is empty!11:19
lisitsyn:D11:19
lisitsynwiking: you want to do what from swig?11:19
lisitsynsending some data?11:20
@wikingit's empty as i'm refactoring11:20
@wikingno need to send out the -1 version11:20
@wikinglisitsyn, why not ?11:20
@wikingthis lib could be used by anybody11:20
lisitsynI am just trying to understand what exactly11:20
lisitsyn:)11:20
@wikingto send data11:20
lisitsynso there is some instance11:20
@wikingin TFrecord format11:20
lisitsynsay tflogger()11:20
@wikingon a stream11:20
@wikingwith open("asdf.txt") as f:11:21
@wiking          f.write(tflogger.encode("event"))11:21
@wiking...11:21
lisitsynahh ok11:21
@wikingand vice versa11:21
@wikingwith open("asdf.txt") as f:11:21
@wiking      tflogger.decode(f.write())11:22
@wiking*sorry11:22
lisitsynok then wrap it? :)11:22
lisitsynstd::string as std::istream11:22
@wiking      tflogger.decode(f)11:22
@wikingi wanna be able to pass something11:22
@wikingthat later u can decode11:22
@wikinglisitsyn, the problem in case of std::string11:22
@wikingthat assumes11:22
@wikingthat you read the whole input into memory11:23
lisitsynwiking: or you can pass a callback11:23
lisitsynbut this requires directors11:23
@wiking:)11:23
@wikingyeah i hate this  :D11:23
lisitsynor you can create a stateful decoder11:23
lisitsynlike nextBytes nextBytes11:24
lisitsynnextBytes11:24
lisitsyndone11:24
@wikingso basically u fill up a stack11:24
@wikinguntil the data is not enough11:24
lisitsynyeah but I would not call this the most beautiful code ever11:24
lisitsyn:D11:24
@wikingindeed11:24
@iglesiasglisitsyn: about modshogun, `import shogun` would be a bit nicer. It is a small thing anyway11:24
lisitsynare you sure reading into memory is so bad?11:25
lisitsyniglesiasg: yeah I am on it11:25
@wikingiglesiasg, `import shogun as sg`11:25
@wikingis even better:)11:25
lisitsynwiking: and we may get funding from the government of sg then?11:28
lisitsynohhh btw what about showing an ad once you load shogun?!11:29
lisitsyn:D11:29
@wikinglol no11:29
lisitsynwe would be pioneers in that11:29
Trixislol11:30
Trixismight as well install the ask.com toolbar along with shogun ;)11:30
lisitsynTrixis: !!!!!!!11:31
lisitsynyes and yandex.bar please11:32
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3877 synchronized by geektoni11:35
Trixishttps://pastebin.com/7MKRn8Qi im getting the following exception, what's the likely cause?12:07
Trixissorry, the last line is already reference to my method, forgot to delete it12:08
-!- aqw [8d2c6250@gateway/web/freenode/ip.141.44.98.80] has joined #shogun12:30
aqwI am getting a 403 forbidden from shogun's debian repo. Is this a known issue?12:31
aqwI'm following the instructions from here: http://shogun-toolbox.org/install#debian12:31
aqwI have also tried stretch (rather than jessie) as the release, and "nightly" rather than "main". All are forbidden when I attempt to get the "Packages" file.12:32
@wikingaqw, mmm12:37
@wikingapt.shogun.ml?12:37
@wikinglemme look into it12:38
aqwyep12:40
aqwThanks :-)12:40
@wikingaqw, try now12:54
aqwI love you :-D12:57
aqwworks12:57
aqwthank you very much12:57
@wikingnw12:58
@wikinghave fun12:58
@wikinghope it helps u with your problems12:58
aqwthanks12:59
aqwFYI... http://apt.shogun.ml/dists/jessie/main/binary-amd64/Packages  is empty. but http://apt.shogun.ml/dists/jessie/nightly/binary-amd64/Packages does have entires13:00
aqw*entries13:00
@wikingmmm13:00
@wikingyeah we are having some troubles with stable releases :D13:01
aqwAhh. np13:01
@wikinguse nightly13:01
aqwI can deploy the nightlies13:01
@wikingit's always better13:01
aqwAre they reasonably stable?13:01
@wikingyesy es13:01
@wikingactually more stable13:01
@wikingthan any release :D13:02
aqwHaha. Excellent13:02
aqwthanks again for fixing this13:02
@wikingnw13:02
@wikingaqw, can u share your usecase?13:02
aqwWell, I personally don't use shogun, but I admin a computational cluster for psychologists/neuroscientists and some of our users use shogun13:03
@wiking:DD13:03
@wikinglooooooooool13:03
@wikinggreat13:03
@wikingcan they share their usecase?13:03
aqwJust upgraded from jessie to stretch, noticed shogun was no longer in stretch, found your repo, etc13:03
aqwI can ask 'em real quick13:03
@wikingaqw, i can release13:03
@wikingnightlies for stretch13:03
aqwthat would be great (re stretch nightlies)13:04
@wikingif u want13:06
@wikingand would be great if you could share what you miss13:06
@wikingfrom us13:06
@wikingas a cluster admin13:06
@wikingand of course if u can share their usecase that'd be cool as well :)13:06
@wikingsukey, flip13:06
@sukey(╯°□°）╯︵ ┻━┻13:06
aqwNot a problem.13:07
aqwAs an admin, mostly what I care is package availability and quality. I prefer packages that are in the main Debian repos because they assure both. Out of necessity, I do add packages from other repos (such as this case), but yeah: main Debian (or NeuroDebian) is preferred.13:09
aqwAs for the user's use case (which I imagine you're more interested in), I've written her an email and I expect she'll get back to me soon.13:10
@wikingcool thnx13:10
@wikinglet's see if we could get back13:10
@wikingthings into debian13:11
@wikingbut i'm not sure if it's gonna be easy13:11
@wiking:13:11
@wiking)13:11
aqwYeah. It is a process. They have a lot of hoops to jump through, but /usually/ with good reason. ;-)13:13
aqwIf you guys are seriously considering it, but feel you need help, shoot me an email at alex@waite.eu. I'm way too busy right now to help out, but maybe I'll have some time when you guys start taking a look at it again.13:16
aqwI have some experience with debian packaging, but I'm not a debian developer myself, so there'd be no fast track.13:17
@wiking\o/13:18
@wikingcool13:18
@wikingthnx heaps13:18
aqwnp :-)13:18
aqwYup, looks like I'll need those stretch packages. The jessie ones aren't installable on stretch13:24
@wikingaqw, lemme look at it :)13:30
@wikingi've created the base image for stretch13:30
@wikingfor rebuildd13:30
@wikingaqw, btw xenial is not usuable for u?13:30
@wikingjust for the time being13:30
@wikingaqw, they are using shogun c++ api directly13:30
@wikingor python?13:30
aqwI can check if the builds work. Last time ubuntu and debian were in sync was back w/ lucid and stretch13:31
aqwSo I usually don't chekc ubuntu builds anymore13:31
aqwYeah, we're using it via python13:31
aqwBTW, got an answer from the researcher13:31
aqw"To be honest, I never heard of shogun before this morning and don't know what it does by itself. It seems to be called when loading HDF5 data with h5load from the PyMVPA package. The data are fMRI parameter estimates, put into a structure compatible with PyMVPA. I use them to do a basic classification analysis (LSVM) between two conditions. "13:31
aqwpymvpa is a popular python module written by my boss and a few others. it's used for multivariate pattern analysis.13:32
@wiking:D13:32
@wikinghahahah13:33
@wikingok13:33
@wikingi know13:33
aqw:-)13:33
@wikinglemme look into it13:34
@wikingbut i cannot promise a deadline13:35
@wikingi.e. it could take me 24h to get this fixed13:35
@wikingaqw, i can drop u a mail once its done13:35
@wikingmicmn, how's it going?13:35
@wikingin the meanwhile check xenial packages13:36
aqwAwesome. Thanks. And 24 hours is no problem.13:36
@wikingkk13:39
@wikinggeektoni, plan for this week?13:39
TrixisStill getting this error on runtime "java.lang.UnsatisfiedLinkError: org.shogun.modshogunJNI.init_shogun__SWIG_4()V" upon calling modshogun.init_shogun()13:55
Trixistried reinstalling shogun, adding everything to path etc13:56
-!- aqw [8d2c6250@gateway/web/freenode/ip.141.44.98.80] has quit [Quit: Page closed]14:11
-!- aqw [8d2c6250@gateway/web/freenode/ip.141.44.98.80] has joined #shogun14:12
@wikingTrixis, thats weird :<14:13
Trixisyeah, unfortunately there's no other message14:13
Trixisdoesnt seem to be isolated to the init_shogun method either :/ "java.lang.UnsatisfiedLinkError: org.shogun.modshogunJNI.new_CombinedFeatures__SWIG_0()J" is what i get upon trying to instantiate combined features (also the first call to shogun in that code)14:18
@wikingmmm14:19
@wikingcan u share how u compile the whole thing?14:19
Trixisye14:20
Trixisactually14:20
Trixisi tried one thing and tests just finished running14:20
Trixisfailed again14:20
Trixishm14:20
Trixiswiking: any idea what exactly is the error trying to tell me?14:29
@wikingTrixis, good question14:30
@wikingjust send me the whole compile & runtime parameters14:30
@wikingthen i can maybe help :)14:30
Trixisaight, ill try14:31
Trixisits built using maven14:31
Trixisso that doesnt help whenit comes to this, lol14:31
@wikingah14:36
@wikinghow do you build it with maven?14:36
Trixiswiking: i added shogun.jar to local repository using the mvn install command14:37
@wikingoh ok14:37
@wikingi see14:37
@wikingbut you dont build shogun.jar14:37
@wikingusing maven14:37
@wikingor/14:37
Trixisoh no, definitely not14:38
Trixiswiking: hence as i said, compile is via maven, with shogun set as compile dependency, run time VM args are "-ea -Xmx1024m  -Djava.library.path=/usr/local/Cellar/shogun/6.0.0/share/java/shogun.jar"14:54
@wikingmmmm14:55
@wikingas i can figure14:55
@wikingyou use osx14:55
@wikingright?14:55
Trixisyep14:55
TrixisDYLD_LIBRARY_PATH is set as well14:55
@wikingok i'll try to get you a jar that is working on an osx14:55
@wikingto see if that works for you14:55
@wiking:)14:55
Trixisthx14:55
@wikingwooooooooooooooooohoooooooooooooooooo15:16
-!- wiking_mob [~Mutter@14.100.136.111] has joined #shogun15:46
wiking_mobNetwork down :))))15:46
wiking_mobItsback15:47
-!- wiking_mob [~Mutter@14.100.136.111] has quit [Client Quit]15:47
@wiking:P15:47
Trixislol15:48
@wikingTrixis, ok sorry16:26
@wikingtook a while to get our osx builder back on its feet :)16:27
Trixisnp16:27
@wikingTrixis, you are using develop of git right/16:27
@wiking?16:27
Trixiswiking: what do you mean?16:27
@wikingwhich version of shogun are you using16:28
@wikingthe one from ggithub16:28
@wikingor a release?16:28
Trixisoh, right16:28
Trixisi installed shogun using homebrew16:28
@wikingooho ok16:28
Trixislet me see where it's pulling the sources from16:28
@wikingso that's 6.0.016:28
@wikingi know that16:28
@wikingi wrote that16:28
@wiking:)16:28
@wikingbut you are using the java inteface as well16:28
@wikingof that?16:28
Trixishaha, sorry16:28
Trixisyeah16:28
@wikingor you compiled yourself the java interface16:29
@wikingaaaah ok16:29
@wikinglemme try to test that16:29
@wikingbecause i reckon that there's something there wrong16:29
Trixiswiking: i did pass --build-from-source though16:30
Trixisso i'd assume it was compiled locally on my machine16:30
@wikingyeah16:30
-!- stefan_ [25c907f2@gateway/web/freenode/ip.37.201.7.242] has joined #shogun17:03
@wikingTrixis, sorry man the day became longer than i thouht18:13
Trixisit's ok, let me know if you find something out.18:16
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3877 synchronized by geektoni18:35
-!- mikeling [uid89706@gateway/web/irccloud.com/x-fzbrljofmyykqzsh] has quit [Quit: Connection closed for inactivity]19:07
-!- geektoni [~geektoni@93-34-128-38.ip49.fastwebnet.it] has quit [Remote host closed the connection]20:11
-!- stefan_ [25c907f2@gateway/web/freenode/ip.37.201.7.242] has quit [Quit: Page closed]20:22
-!- utkarshrai [2f080d30@gateway/web/freenode/ip.47.8.13.48] has joined #shogun20:33
-!- utkarshrai [2f080d30@gateway/web/freenode/ip.47.8.13.48] has quit [Ping timeout: 260 seconds]20:56
-!- iglesias [~iglesias@wlan078130.mobiel.utwente.nl] has joined #shogun22:48
-!- iglesias [~iglesias@wlan078130.mobiel.utwente.nl] has quit [Quit: leaving]23:36
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/3898 opened by lisitsyn23:37
--- Log closed Tue Jul 04 00:00:40 2017
« Sunday, 2017-07-02 Index Tuesday, 2017-07-04 »

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!