IRC logs of #shogun for Monday, 2019-04-29

--- Log opened Mon Apr 29 00:00:53 2019
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Remote host closed the connection]01:48
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun01:51
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Remote host closed the connection]06:51
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun06:55
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Ping timeout: 245 seconds]07:00
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun07:00
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Remote host closed the connection]07:03
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun07:03
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Ping timeout: 246 seconds]07:08
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun07:45
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Remote host closed the connection]08:22
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun08:24
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Ping timeout: 246 seconds]08:30
-!- gf712 [c13cdcfd@gateway/web/freenode/ip.193.60.220.253] has joined #shogun09:51
-!- sighingnow [~sighingno@2001:da8:203:81:381f:7109:7db8:1e97] has joined #shogun11:08
-!- sighingnow [~sighingno@2001:da8:203:81:381f:7109:7db8:1e97] has left #shogun []11:08
-!- HeikoS [~heiko@52.pool85-48-187.static.orange.es] has joined #shogun14:27
-!- mode/#shogun [+o HeikoS] by ChanServ14:27
@HeikoSgf712:  yo!14:27
gf712HeikoS: hey15:08
@HeikoShey15:09
gf712viktor says he'll be there in a sec15:09
-!- wiking_ [~wiking@193.60.220.253] has joined #shogun15:09
@HeikoSah here we go :)15:09
@HeikoSso I think we are in pretty good shape proposal wise15:09
wiking_ok15:09
wiking_here15:09
@HeikoSwiking_: hey15:09
gf712cool, need to reread a bit15:09
wiking_ok so whatsapp15:10
wiking_with natalie15:10
wiking_i told her that we might talk15:10
wiking_imo that 2 weeks is too little15:10
@HeikoSyeah sure15:10
@HeikoS4 weeks is better15:10
wiking_once it's settled with the numbers15:10
@HeikoSI just wanted to discuss with you: whose name to put on her proposal15:10
@HeikoSand the numbers15:10
wiking_look15:10
wiking_since atm15:10
wiking_i have the least amount of nunmbers15:10
wiking_from the 3 of us15:10
wiking_in the other proposal15:10
wiking_i dont care15:11
wiking_but from ATI perspecitve15:11
wiking_like if we add Gil then they'll be ??15:11
wiking_i guess15:11
wiking_see what i'm heading too?15:11
@HeikoSyes15:11
wiking_*to15:11
@HeikoSeven though Gil should be involved in meetings/workshops15:11
@HeikoSwiking_: no I dont see yet15:11
wiking_ok so then continuing15:11
wiking_if we add Gil who's currently 75%15:12
wiking_then 4 weeks15:12
wiking_FTE15:12
wiking_= 20 weeks with 20%15:12
wiking_right?15:12
wiking_or 16 weeks 25%15:12
wiking_we cannot go higher15:12
wiking_as in the other application there's already 75% allocated on him15:12
wiking_so if both applications gets accepted15:13
wiking_then there's a race condition on the resource15:13
@HeikoSbut this is one -off15:13
@HeikoS4 weeks15:13
wiking_yes15:13
wiking_but that is still some amount of FTE15:13
@HeikoSokok15:13
wiking_as part of a project15:13
@HeikoSso what do you suggest?15:13
wiking_or package15:13
wiking_so to avoid these sort of concerns15:13
wiking_(resource allocation and overallocation)15:14
wiking_i would say add me15:14
@HeikoScool with me15:14
wiking_if somebody needs the$15:14
@HeikoSso let's do that then15:14
wiking_i'm happy to give transfer it to that person15:14
@HeikoSno I am happy for you to be15:14
wiking_as funding wise i dont care15:14
@HeikoSthink this is more the names on the proposals, that is the more important thing15:15
@HeikoSgenerates momentum15:15
wiking_k lets see what natalie says15:15
@HeikoSok I have an email ready15:15
@HeikoSoh no actually I sent it15:15
@HeikoS:)15:15
@HeikoSbut no numbers yes15:15
@HeikoSwiking_:  Ill send her 4 weeks of your time then?15:16
wiking_lets wait15:17
wiking_for Natalie15:17
@HeikoSok15:17
@HeikoSIll leave it to you then to send the $$$15:17
wiking_yep i just wanna see15:18
wiking_that she is ok with more than 2 weeks15:18
wiking_as that can do it15:18
wiking_but it's very very optimistic15:18
wiking_HeikoS: we've just went through the todo with gf712 till end of may15:19
wiking_i need to get deadbeef merged15:19
wiking_as we need tagging based xml serialization15:19
wiking_for openml15:19
wiking_he is working on ARFF format15:19
@HeikoSgreat15:19
wiking_i'll come end of may again15:20
@HeikoSwiking_: I wanted to fix some bugs15:20
wiking_but i. mean15:20
wiking_currently15:20
@HeikoSas there is some issues with labels15:20
wiking_XVAl15:20
wiking_is LEAKYING like nothing15:20
wiking_:DDD15:20
@HeikoSah yes15:20
wiking_so that's another one15:20
wiking_but lisitsyn is on las palmas15:20
wiking_and i dont know what to do with15:20
wiking_make_any(shared_ptr<>)15:20
wiking_ideae?15:21
@HeikoSah yes15:21
wiking_*ideas?15:21
@HeikoSnot really15:21
@HeikoSbut what I know15:21
@HeikoSis that a lot of stuff inside any.h15:21
@HeikoSis based on raw pointers15:21
@HeikoSas we needed to make it compatible with old arrays15:21
@HeikoSah all that fuck15:21
@HeikoSbtw15:21
@HeikoSsaw the gsod stuff?15:22
wiking_yes15:22
@HeikoSI like that quite a bit as well15:22
@HeikoSbut maybe it is too much15:22
@HeikoSnot sure15:22
@HeikoSwiking_, gf712 I will submit the proposal later today then15:23
@HeikoSafter we heard back from natalie15:23
@HeikoSand then I think it is done15:23
@HeikoSI copy it into the form, shorten (max words etc), and do a final polish15:23
@HeikoSbut I think it looks good15:23
wiking_w815:24
@HeikoSand it is great to have 3 collaborators on board as well ... so lets see15:24
wiking_ah yeah nothing15:24
wiking_yeah we can get natalie on board there15:24
wiking_imo15:24
@HeikoSyes15:24
@HeikoSi added her as 0.02 FTE15:24
@HeikoS3 hrs/ month15:24
@HeikoSmeetings15:24
@HeikoSshe can tell us what is needed15:24
@HeikoSand this way we get some idea of user perspective15:24
@HeikoSand also have another colab15:24
@HeikoSwin-win15:24
@HeikoSgf712: wiking_ alright I'll leave you two to it. Will keep an eye open on my emails15:29
gf712HeikoS: ok, I'll be finising up the openml stuff15:30
gf712we concluded that it might be best to write our own stuff with shogun15:30
@HeikoSgf712: cool, can I help with anything regarding blog-post/ write-up15:30
gf712so that we can expose openml via swig15:30
@HeikoSgf712: can you explain?15:30
gf712so right now we use openml-python15:31
gf712but that means it is only accessible via the openml library for python15:31
gf712but if you use shogun with another language it won't work15:31
gf712so we are our own thing to convert shogun to the required stuff for openml15:31
gf712we have all the things required15:32
@HeikoSah I see15:32
@HeikoSyeah that is nice15:32
gf712just need to write the ARFF parser15:32
@HeikoSthen one can export to openml from Java bindings15:32
gf712which is pretty straight forward15:32
gf712yes15:32
@HeikoSgreat idea!15:32
@HeikoSlike it15:32
gf712I was going to do it for the next project15:32
@HeikoShehe15:32
gf712but then the thing openml happened15:32
gf712where they changed a bunch of stuff15:32
gf712so since I have to refactor15:33
gf712I might as well do it in our end15:33
@HeikoSI see15:33
gf712and then no need to worry anymore15:33
gf712Viktor will sort out the rest api stuff15:33
gf712so just need to serialise to xml and arff15:33
gf712and then can send that to the server!15:34
@HeikoSsweet15:34
gf712and the people who wanted to use R and shogun from that proposal can use openml15:34
@HeikoSwiking_: natalie replied (to me only), can you chat now, or at 13:45, or at 14:00?15:36
lisitsynwiking_: hey15:39
wiking_ho15:40
lisitsynis it better to chat here? :)15:40
wiking_HeikoS: anytime15:40
wiking_just tell me when15:40
wiking_lisitsyn: yes15:40
@HeikoSwiking_: ok I suggested 14:00, will ping you15:40
wiking_lisitsyn: so basically with the current way15:40
wiking_if i pass &(shared_ptr<T> ) to param framework15:40
wiking_then in case of clone15:40
wiking_the copy-ctor is being called15:41
wiking_and that's not good15:41
wiking_:)15:41
lisitsynwhy?15:41
wiking_coz then underlying pointer is not cloned15:41
lisitsynahh ok15:41
wiking_its just another shared_ptr15:41
@HeikoSI think that is easy to add actually15:41
wiking_over the same ptr15:41
lisitsyneasy then15:41
wiking_ok i'm listening15:41
wiking_:D15:42
lisitsynlet me point15:42
lisitsynwiking_: see how that's done for ArrayReference https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/lib/any.h#L32115:42
wiking_yep15:43
wiking_template <class T>15:47
wiking_inline auto clone(void** storage, const std::shared_ptr<T>& value)15:47
wiking_{15:47
wiking_auto existing = mutable_value_of<std::shared_ptr<T>>(storage);15:47
wiking_return std::shared_ptr<T>(clone(existing));15:47
wiking_}15:47
wiking_?15:47
lisitsynyes15:48
wiking_and then the clone of existing will create the clone of sgo?15:48
lisitsynI guess so15:48
wiking_kk15:48
wiking_btw15:48
wiking_actually15:48
wiking_currently SGO::clone in that branch15:48
wiking_returns a shared_ptr :P15:48
wiking_u mind?15:48
wiking_so not SGO* anymore15:49
wiking_because of the ref story15:49
wiking_but semantically its a bit shitty15:49
lisitsynwhile it works I am fine :)15:50
wiking_ok lemme try to add this to any15:50
wiking_and see how it blows up15:50
wiking_:D15:50
wiking_lisitsyn: https://pastebin.com/Pb2Jn6bc15:57
wiking_i think i know why15:58
lisitsynwiking_: there is no clone so you should call it explicitly16:14
lisitsynI mean the clone in any is like a function with a side-effect16:14
lisitsynI guess you just need ->clone()16:14
wiking_yes16:16
wiking_just doing that16:16
wiking_:)16:16
wiking_compiling16:16
wiking_...16:16
wiking_:D16:16
wiking_lisitsyn: we have a tiny problem16:41
wiking_say we have LinearMachine16:41
lisitsynyes16:42
wiking_that has std::shared_ptr<CDotFeatures> features;16:42
wiking_but we wanna register it as std::shared_ptr<CFeatures>16:42
wiking_because of put/get16:42
wiking_right?16:42
wiking_but because it's a linear machine16:42
wiking_we wanna have a CDotFeatures16:42
wiking_so if i do this right16:43
wiking_watch_param("features", &(std::static_pointer_cast<CFeatures>(features)));16:43
wiking_then of course the compiler is gonna bitch16:43
wiking_ /Users/wiking/shogun/src/shogun/machine/LinearMachine.cpp:40:25: error: taking the address of a temporary object of type 'std::shared_ptr<CFeatures>' [-Waddress-of-temporary]16:43
wiking_but if i dont cast16:43
wiking_then its not a base param16:44
wiking_(explicit cast doesn't work :P16:44
wiking_since its shared_ptr right :)16:44
wiking_buuut ok lets forget this16:48
wiking_basically there's another problem16:48
wiking_auto existing = mutable_value_of<std::shared_ptr<T>>(storage);16:48
wiking_storage is non null16:48
wiking_but the casting above returns a null ptr16:48
wiking_(lldb) p existing16:49
wiking_(std::__1::shared_ptr<shogun::CLabels>) $0 = nullptr {16:49
wiking_  __ptr_ = 0x000000000000000016:49
wiking_}16:49
wiking_(lldb) p storage16:49
wiking_(void **) $1 = 0x00007ffeefbfec4816:49
wiking_lisitsyn: ^16:49
lisitsynuh16:50
wiking_ah no16:50
wiking_this is not good :)16:50
wiking_something is wrong with this... as value is not being used at all16:50
wiking_template <class T>16:50
wiking_inline auto clone(void** storage, const std::shared_ptr<T>& value)16:50
wiking_{16:50
wiking_auto existing = mutable_value_of<std::shared_ptr<T>>(storage);16:50
wiking_return existing->clone();16:51
wiking_}16:51
wiking_what storage should hold in this case?16:51
wiking_or that is the "new" storage16:52
lisitsynI think it is fine for storage to hold an empty thing16:52
lisitsynyeah16:52
wiking_aaah ok16:52
wiking_so storage.reset(value->clone())16:52
wiking_no?16:52
lisitsynyes I think so16:52
lisitsynuhmm yes16:52
lisitsynshould work16:52
lisitsynas for the first problem it is getting tricky16:53
-!- HeikoS1 [~heiko@200.pool85-48-187.static.orange.es] has joined #shogun17:13
-!- HeikoS [~heiko@52.pool85-48-187.static.orange.es] has quit [Ping timeout: 246 seconds]17:14
-!- HeikoS1 [~heiko@200.pool85-48-187.static.orange.es] has quit [Quit: Leaving.]17:18
-!- gf712 [c13cdcfd@gateway/web/freenode/ip.193.60.220.253] has quit [Ping timeout: 256 seconds]18:24
wiking_lisitsyn: can we have rvalue for make_any_ref and then use other policy than non-owninng?18:46
wiking_:)18:46
wiking_lisitsyn: that case i think this casting should be solved18:46
wiking_as then we would take the temp object as rvalue (as it is rvalue)18:46
wiking_and anyways the underlying thingy is shared between the original shared_ptr and the casted one18:46
wiking_see what i mean?18:47
wiking_so the other case (no casting) clone works with std::shared_ptr now \o/18:50
-!- wiking_ [~wiking@193.60.220.253] has quit [Remote host closed the connection]18:56
-!- HeikoS [~heiko@228.pool85-48-187.static.orange.es] has joined #shogun19:03
-!- mode/#shogun [+o HeikoS] by ChanServ19:03
-!- HeikoS [~heiko@228.pool85-48-187.static.orange.es] has quit [Ping timeout: 250 seconds]19:29
-!- HeikoS [~heiko@58.pool85-48-187.static.orange.es] has joined #shogun19:30
-!- mode/#shogun [+o HeikoS] by ChanServ19:30
-!- HeikoS [~heiko@58.pool85-48-187.static.orange.es] has quit [Ping timeout: 268 seconds]19:40
-!- HeikoS [~heiko@153.pool85-48-187.static.orange.es] has joined #shogun19:42
-!- mode/#shogun [+o HeikoS] by ChanServ19:42
-!- HeikoS [~heiko@153.pool85-48-187.static.orange.es] has quit [Client Quit]19:44
-!- rsdel2007 [75dc70b6@gateway/web/freenode/ip.117.220.112.182] has joined #shogun22:29
-!- rsdel2007 [75dc70b6@gateway/web/freenode/ip.117.220.112.182] has quit [Client Quit]22:30
--- Log closed Tue Apr 30 00:00:55 2019

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!