IRC logs of #shogun for Wednesday, 2019-04-10

--- Log opened Wed Apr 10 00:00:29 2019
-!- Moatman [~Moatman@pool-96-255-151-151.washdc.fios.verizon.net] has joined #shogun01:41
-!- TheMoatman [~Moatman@pool-96-255-151-151.washdc.fios.verizon.net] has joined #shogun02:05
-!- Moatman [~Moatman@pool-96-255-151-151.washdc.fios.verizon.net] has quit [Read error: Connection reset by peer]02:05
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun04:21
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host]04:21
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun04:21
-!- mode/#shogun [+o wiking] by ChanServ04:21
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 246 seconds]04:25
-!- Moatman [~Moatman@pool-96-255-151-151.washdc.fios.verizon.net] has joined #shogun05:02
-!- TheMoatman [~Moatman@pool-96-255-151-151.washdc.fios.verizon.net] has quit [Read error: Connection reset by peer]05:02
-!- Moatman [~Moatman@pool-96-255-151-151.washdc.fios.verizon.net] has quit [Remote host closed the connection]05:16
-!- Moatman [~Moatman@pool-96-255-151-151.washdc.fios.verizon.net] has joined #shogun06:16
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun07:17
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host]07:17
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun07:17
-!- mode/#shogun [+o wiking] by ChanServ07:18
-!- Moatman [~Moatman@pool-96-255-151-151.washdc.fios.verizon.net] has quit [Remote host closed the connection]07:19
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]07:38
-!- wiking_ [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun08:13
-!- wiking_ [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Remote host closed the connection]08:29
-!- wiking_ [~wiking@2001:67c:10ec:5784:8000::3ff] has joined #shogun08:54
-!- wiking_ [~wiking@2001:67c:10ec:5784:8000::3ff] has quit [Ping timeout: 250 seconds]08:58
-!- wiking_ [~wiking@2001:67c:10ec:5784:8000::3ff] has joined #shogun09:12
-!- wiking_ is now known as wiking09:19
-!- wiking [~wiking@2001:67c:10ec:5784:8000::3ff] has quit [Changing host]09:19
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun09:19
-!- mode/#shogun [+o wiking] by ChanServ09:19
-!- geektoni [c1cdd24a@gateway/web/freenode/ip.193.205.210.74] has joined #shogun09:44
geektoniping wiking09:45
@wikingpongi09:45
@wikingok so i was just wondering about this09:45
@wikinglemme dig out09:45
@wikingok so it's all about this crazy stuff https://github.com/shogun-toolbox/shogun/pull/4557/files#diff-1689b0bd3ceb28355cc3c05ed7ffe4f0R113509:47
@wikingi mean that dispatch code :)09:47
@wikingi've talked a bit about this Gil and i told him the same that this feels just wrong :)09:47
@wikingi mean that if else story09:47
@wikingespecially that we have visitors for any :)09:48
@wikingso i was wondering whether we could actually change this into a base interface visitor09:48
@wikingif u see what i mean09:48
geektoniI see I see09:49
geektonimmh so09:49
geektonilet me look a bit into it09:49
@wikingk09:50
-!- gf712 [90520840@gateway/web/freenode/ip.144.82.8.64] has joined #shogun09:54
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]10:16
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun10:41
-!- mode/#shogun [+o wiking] by ChanServ10:41
@wikinggf712: https://github.com/shogun-toolbox/shogun/pull/4594 simplified11:01
-!- gf712_ [90520840@gateway/web/freenode/ip.144.82.8.64] has joined #shogun11:12
gf712_wiking: cool having a look at the pr now11:12
gf712_wiking: why do you use std::list?11:12
@wikingwhy not?11:12
@wiking:)11:12
gf712_instead of unordered map?11:12
@wikingthis is the only usecase for that struct atm11:12
gf712_I guess, you don't need to look up11:13
@wikingand that will always have iterate through all elements11:13
@wiking:)11:13
gf712_aight I see11:13
-!- gf712 [90520840@gateway/web/freenode/ip.144.82.8.64] has quit [Ping timeout: 256 seconds]11:13
-!- gf712_ is now known as gf71211:13
@wikingreturn sgo_details::get_by_tag(this, name, std::move(sgo_details::GetByName()));11:16
@wikingdoes that std::move really needed?11:16
gf712no11:16
gf712it is bothering me11:16
@wikingme too11:16
@wikingi think that bs11:16
@wikingwhy was that actually added there?11:16
gf712should be trivially copyable11:16
@wikingyes11:17
gf712you need to ask Heiko11:17
@wikingand its a temp obj11:17
gf712talking about move11:17
@wikingyes11:18
gf712wiking: do you think it is good design to have a function that takes a r val ref of a type and one for pointers?11:18
@wikingmotherfucker11:18
@wikingmmmm11:18
gf712r val wouldn't copy11:18
@wikingi was wondering a lot about this11:18
gf712and pointer would11:18
@wikingi mean copying a pointer11:18
@wikingis not a big deal right ?:)11:18
gf712unless you don't need it anymore in that scope11:19
@wikingi mean it's just a 64 bit basetype11:19
gf712and want to transfer ownership11:19
gf712rather than copy it again11:19
gf712this is for the grid search stuff11:19
gf712I want an internal method that attaches a new node and copies it11:19
gf712i.e. it comes from an interface11:19
gf712and another one that just puts the node in the container without copy, because it is used from cpp11:20
gf712I just don't know if it will be confusing for a future dev11:20
@wikingpushed a fix into develop11:20
@wiking:D11:20
gf712nutter11:20
gf712:D11:20
gf712wiking: non virtual functions don't have to be any order in classes afaik11:27
@wikingi've got a compiler error11:28
@wiking:)11:28
@wikingnot a warning11:28
@wiking:>11:28
gf712so weird11:28
gf712what compiler?11:28
@wikingdefault clang on osx11:29
@wikingApple LLVM version 10.0.1 (clang-1001.0.46.3)11:29
gf712weird that CI didn't complain11:29
@wikingindeed11:29
gf712I don't see why order matters though11:30
gf712but oh well11:30
@wikingi'm trying to finish deadbeef11:30
@wikingdid a rebase11:30
@wikingand boom11:30
@wikingsuddenly DynamicObjArray is like WTF11:30
gf712ah cool, you putting js aside then?11:30
@wikingjust for today11:31
@wikingi wanna finish this stuff11:31
gf712yea11:31
@wikingas there's a lot of hanging prs11:31
gf712btw can merge the to_string11:31
gf712just commented on the includes11:31
@wikinglets see what CI says11:31
gf712but don't matter11:31
@wikingi've fixed those11:31
@wiking:)11:31
gf712ah ok!11:31
@wikingalready pushed thnx for the comment11:31
gf712need more more jobs on CI :D11:32
@wikingha11:32
@wikingSG_FORCED_INLINE auto get_element_safe(size_t index) const11:32
@wikingthis is why i think i had trouble11:32
@wiking:)11:32
gf712what is causing the issue?11:34
gf712not declared?11:34
@wikingauto?11:34
gf712why is that an issue? should be able to deduce the type11:35
@wikingshould be11:35
@wikingotherwise i have no clue11:35
@wikingwhy it failed11:35
gf712is it working now then?11:36
@wikingwith changing order yes11:37
@wiking:D11:37
@wikingman the fucking windows pr needs to be fixed as well11:37
@wiking:)))11:37
@wikingbut yeah that depends on deadbeef11:37
gf712oh the thing the export?11:38
@wikingyes11:38
@wikingso that actually there is a working dll on windows11:38
gf712lol11:38
gf712yea11:38
gf712I actually now notice how few projects actually put the export11:38
gf712and claim to work on windows11:38
gf712wiking: were you still having issues with the deserialisation on windows for the tests?11:39
@wikingyeah windozer needs it11:39
@wikingyes11:39
@wikingthat's why i revived the deadbeef pr11:39
@wikingfrom trash11:39
@wiking:D11:39
@wikingbecause i've got tired11:39
@wikingthat i'm not seeing what the fuck is happening11:40
@wikingand didn't want to patch the old shit11:40
@wikingthis way i should get a proper error why that fucking file is missing11:40
@wiking:D11:40
@wikingor that it fails11:40
gf712haha11:41
@wikingneed to figure out11:41
@wikingwhat utility function shoudl i add11:42
@wikingfor serialization in SWIG11:42
@wikingas none of the fs stuff is SGobject11:42
@wikingand i would like to keep it like that11:42
@wikingand i have a branch locally11:44
@wikingthat drops the fucking init.h story11:44
@wikingbuuuuuut11:44
@wikingthat actually is blocked by SGIO crazyness11:44
@wikingthe MACROS are just crazy11:44
@wikingimo we should do something with SGIO11:44
@wikingi mean the whole story of formatting etc11:45
@wikingit's just craaazy11:45
@wikingi'm for spdlog-ing everything11:45
@wikingits nicely extensible with various sinks etc11:46
@wikinghehehe11:47
@wikingsuper!11:47
@wiking197: [ RUN      ] SparseFeaturesTest.serialization11:47
@wiking197: unknown file: Failure11:47
@wiking197: C++ exception with description "Out of memory error, tried to allocate -8270522240 bytes using malloc." thrown in the test body.11:47
gf712wtf?11:48
gf712makes no sense...11:48
gf712spdlog-ing?11:48
@wikinggf712: https://github.com/gabime/spdlog11:49
gf712ah looks cool11:50
gf712so you can choose the output buffer?11:51
@wikingyes11:52
@wikingand of course you can write your own output buffer11:55
@wikingi once wrote a sink for slack11:55
@wikingwas working nicely11:55
@wikingok should be done... although its ugly11:58
@wikingpushing deadbeef11:58
@wikingunit tests should pass11:58
gf712noiiccceeee11:58
gf712who's reviewing it? :D11:58
@wikingnobody it seems11:58
@wiking:D11:58
@wikingbut meta integration data should be still updated11:59
@wikingand swig story is still missing11:59
@wikingso still not mergable11:59
gf712I tried but there's so much :D12:00
gf712yea, I guess can discuss with Heiko?12:00
gf712he said he would be around today12:00
@wikingyeah he told me the same as i cannot access gsoc dashboard12:01
@wikingand we should now have all the applications in12:01
gf712oh damn, machine evaluation is leaking so much12:01
@wikinganyhow i'm off for lunch12:01
gf712aight12:01
gf712btw GSoC application deadline was extended12:01
@wikingreally?12:02
gf712yea, because of spring break12:02
gf712pretty sure12:02
@wikinghttps://developers.google.com/open-source/gsoc/timeline12:02
@wikingApril 9 18:00 UTC Student application deadline12:02
@wikingi've seen some mails about this12:02
-!- HeikoS [~heiko@82-132-215-5.dab.02.net] has joined #shogun12:02
-!- mode/#shogun [+o HeikoS] by ChanServ12:02
@wikingi followed it till the moment when gsoc admin wrote that it was working till now12:03
@wikingso why change12:03
@wikingD12:03
@wiking:12:03
@wiking:>12:03
gf712ah sorry12:03
gf712I thought they did12:03
@wikingi mean they have a point12:03
gf712but was just someone complaining12:03
@wikingit was like this since forever12:03
@wikingyeah you always have a newcomer12:03
@wiking:D12:03
@wikingok i'm out for 30ish12:03
@wikingttyl12:03
gf712ttyl12:04
@HeikoSyo!12:20
gf712HeikoS: hey12:20
gf712I am going through the emails you just sent12:21
@HeikoScool12:21
gf712wiking should be back soon12:21
@HeikoSgood to put some thoughts into that12:21
@HeikoSdistributed multi-language model selection might fly12:21
gf712yea, I think it could be good12:21
gf712and get something more long term and more deliverables12:21
gf712and more people..12:22
gf712its a shame about the cohort though12:22
gf712it would've been cool collaborating with other devs and exchange ideas12:22
@HeikoSyes we could do multiple work packages12:33
@HeikoSwell you saw the email, that they want individual projects send proposals12:33
gf712HeikoS: btw about the grid search, I have something more or less working12:55
gf712just some odd refcounting going on I think12:55
@HeikoSgf712: cool13:00
@HeikoSwhat shall I look at?13:00
@HeikoSAbout to go for lunch, but will come back to pr reviews later13:02
-!- HeikoS [~heiko@82-132-215-5.dab.02.net] has quit [Quit: Leaving.]13:03
-!- gf712 [90520840@gateway/web/freenode/ip.144.82.8.64] has quit [Ping timeout: 256 seconds]13:09
-!- gf712 [90520840@gateway/web/freenode/ip.144.82.8.64] has joined #shogun13:10
@wikinguff13:18
@wiking10 proposals :<13:19
@wikingrcurtin: how is your proposal count ? :)13:19
@wikinggf712: ping?13:20
@wikingdo you get what is wrattler? :D13:20
gf712wiking: i am not sure, might be confusing with something else, but I thinks its a notebook that support multiple languages13:24
gf712so you write a cell in python, another in R13:24
@wikingyes13:24
gf712and types get converted in between13:24
@wikingok i've already wrote my 2p about it13:24
@wikingwe coudl do something there for sure13:25
gf712I have never tried it13:26
gf712so I am not sure how it works13:26
gf712or if it's stabble13:26
gf712but can give it a go13:26
@wikingdunno why do they wanna distinguish themselves from iodide.io13:26
@wikingor not why but how13:27
@wiking:)13:27
gf712I guess it has more languages?13:28
gf712not that it really matters tbh13:28
@wikingbtw gf712 4594 is merged13:28
@wikinggf712: iodide has py :)13:29
gf712yup, just saw13:29
gf712I'll rebase my code13:29
gf712thanks!13:29
gf712wiking: btw do all meta examples leak?13:29
@wikinghehehe could be :)13:30
@wikingif so we should fixor13:30
gf712because valgrind aint happy13:30
@wikingyeah13:30
@wikingi remember we had this once13:30
@wikingi mean discussion about why and how13:30
@wikingthings leak there13:30
@wikingbut dunno what was the consensus13:30
gf712and I am having a hard time distinguishing what is baseline leak13:30
gf712and what is my code13:30
@wikinghehehe i think something around some is happening in a weird way :(13:30
gf712the issue is that nothing is unrefed in the end13:31
@wikingok now i have to run again13:31
@wikinggf712: yeah but one would hope that things are wrapped in some13:31
@wikingso that should be auto released13:31
gf712valgrind says that the stuff allocated in factories is not getting delted13:31
gf712deleted13:31
gf712wiking: factory increments the counter13:42
gf712and then so does wrap13:42
gf712so I think one of them has to go no?13:42
gf712because at the end unref is called only once by ~Some13:43
gf712wiking: removing one of the ref increments solves memory issues13:55
@wikinghere14:04
@wikingsorry14:04
@wikinggf712: ok so14:05
@wikingi mean the story is that factory should ideally return a some wrapped obj14:05
@wikinggf712: and actually we should have somes passed around in the codebase14:06
@wikingbuuuut14:06
@wikingthat has some swig problematics14:06
@wiking:)14:06
@wikingso for the time being14:06
@wikingfactory shoudl return a ptr14:06
@wikingbut yeah you are right14:06
@wikingin my opinion i would not have the SG_REF within the factory14:06
@wikingdunno how that will effect SWIG14:06
@wikingbut it should be fine imo14:07
@wikingwe shouldn't change the wrap behaviour of some imo14:07
@wikingor?14:07
gf712but surely some should take ownership no?14:08
@wikingyes14:08
gf712like a smart pointer14:08
@wikingyep but it currently does no?14:08
@wikingor you mean you wanna move the ptr ? :)14:08
gf712well it does14:08
gf712but that should reset the counter14:08
gf712to 114:08
@wikingmmm14:08
gf712rather than increment14:08
@wikingwell that's a different type of smart pointer14:08
@wikingsome is invasive :)14:08
gf712but isn't that what a smart pointer does?14:09
@wikingi mean if currently14:09
@wikingno not necessarily14:09
gf712it assumes it is the only owner14:09
@wikingno14:09
@wikingit can be anything14:09
@wiking:D14:09
gf712and deletes when the refcount is 014:09
@wikingliek now we do it14:09
@wiking:>14:09
@wikingit is ANYTHING14:09
@wiking:)14:09
gf712but then you leak14:09
@wikingnono14:09
@wikingi mean now some14:09
@wikingis there but since we have native poiinters in the codebase14:10
@wikingif we would start reseting ctr to 114:10
@wikingthen things would totally crash14:10
@wikingjust do a git grep SG_UNREF14:10
@wikingand u get what i mean14:10
@wikingsince there's many places where we do manual sg_ref/unref14:10
@wikingbut then sometimes we mix some in14:10
@wikingin this scenario14:10
@wikingif some resets the ctr to 114:11
@wikingthen we are going to crash after every 2 calls :)14:11
gf712hmmm ok14:11
@wikingwhat you are saying is true14:11
@wikingfor a shared_ptr14:11
gf712it's just confusing14:11
@wikingbut some is an invasive smart ptr14:11
gf712what about wrap does a move?14:11
gf712and resets?14:11
@wikingand for the time being we have to live with this14:12
gf712but some constructor doesn't14:12
@wikinguntil we get rid of native potiners14:12
@wiking*pointers14:12
@wikingyeah its a valid way to look at things but then again14:12
@wikinggit grep wrap14:12
@wiking:)14:12
@wikingyou'll see what i mean14:12
gf712yup just did :(14:12
@wikingso i would just say14:13
gf712BUT14:13
@wikingremove SG_REF from factories14:13
gf712it's usually fine14:13
gf712just need to change a couple of things14:13
gf712hmmm ok14:13
@wikingand that should get thing rolling14:13
@wikingas anyways14:13
@wikingthe output of factories14:13
@wikingwill be taken by something14:13
@wikingright?14:13
gf712yea, I guess so?14:13
@wikingso then14:13
@wikingthey'll either do SG_REF14:14
@wikingor they'll do wrap14:14
@wiking:)14:14
gf712true14:14
@wikingfactory will just get you the obj14:14
@wikingand then you see what to do with it14:14
@wikingand where and how14:14
gf712I just don't like the limbo of you have control or you don't and it alternates14:14
@wikingwell14:14
gf712it's like python API14:14
@wikingwelcome to hell14:14
@wiking:>14:14
gf712new stuff is refcounted14:14
@wikingbut yeah i mean invasive smart ptr14:14
gf712old stuff you have to do it14:14
@wikingis not our invention ;)14:15
gf712yea I guess14:15
gf712so one day there will be just smart pointers?14:15
@wikingfor example embind (webassembly, has even a typedef for this)14:15
@wikinggf712: yeah i mean it woudl be great not to have those SG_REF/UNREF pairs14:15
@wikingin the codebase14:15
@wiking:)14:15
@wikingcurrently we have it because of SWIG14:16
@wikingwe could totally switch to shared/unique_ptr or some/unique14:16
gf712wiking: btw heap allocated objects without some in meta examples14:16
gf712how do you think it should be done?14:16
gf712objects that aren't sgobject14:16
@wikingmmm14:16
@wikingsmart ptr14:16
@wikingif it's c++14:16
@wiking:)14:16
@wikingif something else14:16
@wikingthen we are having a problem14:17
gf712shared_ptr14:17
@wiking:)))14:17
gf712unique?14:17
@wikingwhatever works14:17
@wikingbut see my point14:17
@wikingthat in swig14:17
@wikingthis will be a problem14:17
gf712yup14:17
@wikingdoesn't matter if its smartptr or not14:17
@wikingthat's why we have SG_REF/UNREF in the first place14:17
@wikingas in swig we define14:17
@wikingthat ref() unref() is the thing to maintain reference count14:17
gf712btw how does it work with %newobject?14:18
@wikinghttps://github.com/shogun-toolbox/shogun/blob/develop/src/interfaces/swig/SGBase.i#L1214:18
@wikinggf712: that hasn't been figured out imo14:18
gf712because I am using it14:18
gf712with gridsearch14:18
gf712but haven't figured out if python for example is leaking14:18
@wikingyeah14:19
gf712I don't even know how to check it..?14:19
@wiking"If the user doesn't specify the "ref/unref" feature for a type, SWIG will produce code equivalent to defining these features:"14:20
@wikingbut that's the problem14:20
@wikingcurrently we do define it14:20
@wikingright? :)14:20
@wikingthis is the default14:20
@wiking%feature("ref")   ""14:20
@wiking%feature("unref") "delete $this;"14:20
@wikingwhich would solve your problem right? :)14:20
gf712ah for a type14:20
gf712ok, makes sense14:21
@wikingbut i dont know14:21
@wikingif you can specify this14:21
@wikingtype wise14:21
@wiking:)14:21
@wikingor this is for the whole module14:21
@wikingimo module14:21
@wikingthen you should look into definining a separate swig module14:21
@wikinggf712: read this section14:21
@wikinghttp://www.swig.org/Doc3.0/SWIGPlus.html#SWIGPlus_ref_unref14:21
@wikingso14:22
@wikinggf712:14:22
@wiking The %newobject feature is designed to indicate to the target language that it should take ownership of the returned object. When used in conjunction with a type that has the "ref" feature associated with it, it additionally emits the code in the "ref" feature into the C++ wrapper. Consider wrapping the following factory function in addition to the above:14:22
@wikingi think based on this14:22
@wikingi'm pretty sure that we dont need SG_REF within the factory code right? :)14:22
@wikingok lemme try14:22
gf712hmmm I guess so?14:23
gf712how do you test for mem leak in a interface language?14:23
@wikingjust a sec14:27
gf712started a pr to see what ci says :p14:28
@wikingwhere?14:29
@wikinghahah14:29
@wikingw814:29
@wikingi'm getting you a much tricker pr14:29
@wiking;)14:29
gf712ah ok14:30
gf712cancel the build if you want then14:30
@wikinggithjub is craaazy14:33
@wiking:D14:33
gf712what do you mean?14:34
@wikingok something weird happend14:34
@wikingbut here https://github.com/shogun-toolbox/shogun/pull/460414:34
@wikingok i gotta run now14:35
@wikingbut this should work14:35
@wikingapart from the c++ part maybe14:35
gf712ah good!14:35
@wikingon swig level this should be the correct way14:35
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]14:35
gf712let's see14:35
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun14:36
-!- mode/#shogun [+o wiking] by ChanServ14:36
@wikingbased on swig docs14:36
@wikingas newobj shoudl take care of calling ref()14:36
@wikingand i c++ we do anyways wrap14:36
@wikingbut now i really gotta run14:37
@wikingttyl14:37
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]14:37
-!- wiking [~wiking@178.197.225.168] has joined #shogun14:53
-!- wiking [~wiking@178.197.225.168] has quit [Changing host]14:53
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun14:53
-!- mode/#shogun [+o wiking] by ChanServ14:53
@wikinggf712: sorry mate to close your pr14:56
@wiking:)14:56
gf712haha14:56
gf712cancel the build too14:56
@wikingdone14:57
gf712coolio15:03
gf712so how do you check mem leaks in interface languages?15:04
gf712I just use cpp and hope that is is representative...15:04
-!- HeikoS [~heiko@82-132-215-5.dab.02.net] has joined #shogun15:05
-!- mode/#shogun [+o HeikoS] by ChanServ15:05
@wikingHeikoS: yo15:05
@HeikoSyo15:11
@HeikoSw15:11
@HeikoSwiking:15:11
@wikingho15:11
@HeikoSsaw the bunch of emails re turing=?15:11
@wikingso i wrote some things about the wrattler story15:11
@HeikoSah cool15:12
@wikingwe should meet them15:12
@HeikoSI am not too sure about this15:12
@HeikoSwrattler in general, but might be worth a shot15:12
@wikingdo we know about the proposal deadline?15:12
@HeikoSyes end of april something15:12
@HeikoSsoon15:12
@wikingif there's such thing15:12
@wikingok15:12
@wikingso15:12
@wikingthen let's meet wrattler15:12
@wikingimo that's the best15:12
@HeikoSill forward15:12
@wikingasap15:12
@HeikoSthe thing is that the colab stuff15:12
@wikingso either this week still15:12
@wikingor early next week15:12
@wikingbefore easter15:12
@HeikoSon the ws they said that it shouldnt be between tools15:12
@wikinghehhe ok seems now its shifted15:13
@HeikoSbut rather between tools and other projects15:13
@wikinglet's adapt :D15:13
@HeikoSso you see15:13
@HeikoSthis is why they sent the name list15:13
@HeikoSbest would be to get someones name on the proposal15:13
@wikingi mean do we have another idea with whom we could work with?15:13
@HeikoSfrom another project15:13
@wikingah ok15:13
@HeikoSi know a few of those names15:13
@HeikoSbut also maybe you have an idea15:13
@HeikoShow to phrase stuff15:13
@wikinganybody from here15:14
@wikingJan Lowe    AI for Science  Munro - Investigating the value of machine15:14
@wikinglearning in predicting gene function15:14
@wiking?15:14
@HeikoSyeah thought that15:14
@HeikoSbecause we have string kernels15:14
@HeikoSand citations15:14
@wikingMark Birkin Digital Twins - Urban   A Machine learning approach to15:14
@wikingunderstanding the disease trajectories of atrial fibrillation15:14
@HeikoSI want to prepare an intro email to a few names, suggesting what we do and then whether they would be keen to co-plan15:14
@HeikoSas note15:14
@wikingSpiros Denaxas    Health  Interpretable disease prediction models15:14
@wikingusing supervised learning15:14
@HeikoSjames said that other projects should be involved in the planning of the projects ... so I think if we have a name and some intention that should be enough for now15:15
@wikingthese things could be something15:15
@wikingre: wrattler: my biggest concern is that seems like a redundant project of iodide15:16
@wikingbut whatever15:16
@wikinglets try to talk15:16
@wikinganyhow any of the above mentioned we coudl work with15:16
@HeikoSyep I agree on wrattler15:18
@HeikoSseems like reinventing things15:18
@wikinganyhow... lets get this rollinng15:18
@HeikoSbut we dont care about that as long as it helps us15:18
@wikingman n is stuck on my laptop15:18
@wiking:D15:18
@HeikoSlol15:18
@wikingthis macbook is a piece of junk i must say15:18
@wikingthinkning about switching to x1 carbon15:19
@HeikoSthinkpad <315:19
@HeikoSI really like mine15:19
@wikingyeah.... i had a t4215:19
@wikingbut that was still ibm era15:19
@HeikoSdidnt like that last few ts, but the x1 is quite nice15:19
@wikingu have a x1 carbon?15:19
@HeikoSyes15:19
@wikingcool... hdr and all? :D15:19
@HeikoSfor 2-3 years now15:19
@HeikoSand cant really complain15:19
@HeikoSonly about ubuntu15:19
@wikingtouch part works under linux?15:19
@HeikoSthe new one is good15:20
@wikingi mean it has a touch screen function right?15:20
@HeikoSthe old one (also in the t) was shit15:20
@HeikoSno i have without15:20
@HeikoSoptional15:20
@wikingaah ok15:20
@HeikoSand I use this battery hack15:20
@HeikoSonly charge to 70%15:20
@wikingy?15:20
@HeikoSbecause on my old one the battery was bad quite quickly15:20
@wikingah ok15:20
@HeikoSI only charge full on demand before flight15:20
@wikingi thought lithium likes to be more fully charged end15:21
@HeikoSi think they like 30-70 mist15:21
@HeikoSmost15:21
@HeikoSthere is a whole kernel module thingi for this stuff15:21
@HeikoShttps://linrunner.de/en/tlp/docs/tlp-linux-advanced-power-management.html15:21
@wikingman not the cheapest laptop15:22
@wiking:)15:22
@wikingor soemthing is weird15:23
@wiking Lenovo ThinkPad X1 Carbon 6th Gen (14", Full HD, Intel Core i7-8550U, 16GB, SSD, 4G)15:24
@HeikoSso re the turing15:24
@wiking2.3k uSD :D15:24
@wikinglolo15:24
@HeikoSLet me write this intro email15:24
@HeikoSyeah it is pricey15:24
@wikingok gdoc it15:25
@HeikoSwill do15:25
@wikingand lets take it from there15:25
rcurtinwiking: 89 :-\15:26
@wikingrcurtin: lololo15:26
@wikingrcurtin: we are clearly doing something wronng :D15:26
rcurtinwell, maybe not15:26
rcurtinwere you applications good?15:27
rcurtinwe had an onslaught of extremely low quality students this year15:27
@wikinghaven't had time to look into it15:27
rcurtinlike, people who are not able to operate a mailing list15:27
rcurtinpeople who check out the code then ask for help because they can't find where the code i15:27
@wikinghhehe15:27
rcurtinis15:27
rcurtinpeople who ask if they can write Python for the project (...for the C++ library...)15:27
@wikingah ok15:27
@wikingso crazy stuff15:27
rcurtinyeah, I mean, it happens every year but it was worse than usual it seemed15:27
@wikingHeikoS: when do we release?15:28
rcurtinwe did get some great students to apply for sure, just, lots of noise15:28
@wikingthe list is getting thiner and thiner on project list15:28
@HeikoSwiking: just forward the call for proposal15:28
@wikingHeikoS: i would say i wanna merge the new serialization and the windows dll fix (two enormous prs)15:28
@HeikoS29 april15:28
@HeikoSwiking: yes merge those15:29
@HeikoSand then we can remove parameter stuff15:29
@wikingi guess gf712 wanna add the grid part on?15:29
@wiking*no?15:29
@HeikoSgil is almost done with that as well15:29
@HeikoSyes defo15:29
@wikingok15:29
@HeikoSbecause then a lot of stuff can go15:29
@HeikoSbut there is some refactoring work for the gradient stuff needed after15:29
@wikinggeektoni: how likely u r done like around easter?15:29
@HeikoSalthough I think gf712 will be able to do that really quiclk15:29
@HeikoSgiovannis project is 3 mar, apr, may15:29
@wikingyeye i know15:30
@wikingbut the question is how much of that thing could go in15:30
@wikingwithin a week or so15:30
@wikingor do we wanna actually have anything of that in?15:30
@HeikoSI think that can be next release15:30
@wikingmmm how much change of api is that?15:30
@HeikoSI mean what is done can be in15:30
@HeikoSnot much15:30
@HeikoSmmh15:30
@HeikoSwell15:30
@wikingcoz if abi changes then we need to 8.x it15:30
@wiking:)15:30
@HeikoSyeah ok15:30
geektoniwiking: if the factory PR goes in like today I could add the observer stuff to some methods in the next days15:31
@HeikoSwould be good to have the first part in15:31
geektonibut surely not much15:31
@wikingk15:31
@HeikoSit would be good to have that as it fixes the api more or less15:31
@wikingso maybe then we aim for 1st of may or somethinng15:31
@HeikoSand then integrating it further can be done in subrelease15:31
@wikinginstead of easter15:31
@HeikoShopefully before gsoc :D15:31
@wikingyeah as always15:31
@wiking:D15:31
@HeikoSoh btw15:31
@HeikoShow can i make a room?15:32
@wikingok anyhow would be good to get it done (release)15:32
@HeikoSfor geektoni and wiking ?15:32
@wikingHeikoS: mkdir room15:32
@HeikoSneed to discuss something15:32
@HeikoSmkdir room15:32
@wiking:D15:32
@wikingi mean just /j #whateveruwant15:32
@wikingand invite us15:32
@HeikoSjoin #mkdirroom15:32
@HeikoSpls come15:32
geektonimmh does it work from the web interface also?15:33
@wikinggeektoni: should15:33
@HeikoSyes15:33
@wikingjust /joinn15:33
gf712wiking: not sure yet if there will be errors with machine eval15:42
gf712but I am having issues locally15:43
gf712when I removed refcount from some15:43
gf712so lets see15:43
@wikingwhat sorts of issues?15:43
gf712labels is deleted is machine eval15:43
gf712I am guessing ref count issue15:43
@wikingmiju15:43
@wikingok i'll look into it15:44
@wikingi was doing almost like a regexp15:44
@wikingfor removing those things :)15:44
gf712haha15:44
gf712can you not do some fancy lib tooling?15:44
gf712wiking: I might be wrong15:44
@wikingyou can always do that15:44
@wiking:)))15:44
gf712well see15:44
@wikingso far things are fine on osx15:44
@wikingbut that's only c++ stuff15:45
@wikingso let's see swig soonish15:45
gf712but osx doesn't test meta right?15:45
@HeikoS"Multi-language distributed high-performance model selection with Shogun.ML"15:45
@wikinggf712: only c++ afaik15:45
@wikingor maybe not even that?15:45
gf712only unitest there15:46
gf712I think15:46
@wikinggf712: damn shame :)15:46
gf712and gcc does meta15:46
gf712well linux15:46
gf712wiking: seems to be all good15:47
gf712I'll look into it locally15:48
gf712not sure what happened15:48
@wikinggcc is still compiling15:48
@HeikoSgf712, wiking btw we should also do some kind of wrap up for the coreml/openml project15:50
@HeikoSwith a page that contains the abstract, a demo15:50
@wikingHeikoS: yes15:50
@HeikoSto send around to peeps15:50
@wikingHeikoS: working on the react app15:50
@wiking:))15:50
@wikingthat's the ultimate demo15:50
@HeikoSnot so technical, but rather temo15:50
@HeikoSah cool15:50
@wikingyou have a web browser15:51
@wikingyou click shit around15:51
@HeikoSwell it needs to be accessilble to academics15:51
@wikingu get a model15:51
@wikingand then u export15:51
@wikingto coreml or openml15:51
@HeikoSthat is good15:51
@wikingHeikoS: https://js.shogun.ml good? :)15:51
@wikingu put that into the browser and that's it15:51
@HeikoS++15:51
@HeikoSok let me know once that goes15:51
@HeikoSI will think about text etc15:51
@wikinggf712: ok gcc passed15:51
@wikinggf712: lets see the swigs15:52
@wikinggf712: i'll merge this regardless what's in valgrind :P15:52
@wikingif ci passes15:52
gf712yea, it will be def better15:52
@wikingcoz this is more correct than the current develop approach15:52
gf712it shouldn't leak as much15:52
@wikingas in case of factory15:52
@wikingsemantically sg-refing meanign that factory takes ref to that shit15:52
@wikingright?15:52
@wikingwhich indeed is wrong15:53
@wikingfactory should not hold ref to the created object15:53
gf712yea, I guess so!15:53
@wikingthe consumer shoudl decide where and who holds the ref15:53
@wikingdont gess15:53
gf712true15:53
@wiking*guess15:53
@wiking:D15:53
@wikingDO15:53
@wikingok gotta run again for 20 mins15:53
@wikingttyl15:53
gf712aight15:53
gf712ttyl15:53
@HeikoSsee you later15:55
@HeikoSalso need to go15:55
-!- wiking [~wiking@huwico/staff/wiking] has quit [Read error: Connection reset by peer]15:55
@HeikoSwill check in back later as well15:55
@HeikoSgf712: how is the grid stuff going?15:55
gf712HeikoS: just fixing some minor stuff15:56
gf712api is the same/similar to the old one15:56
gf712but need to rethink what the base class should be15:56
gf712right now I use multiple inheritance15:56
@HeikoSmixins maybe?15:57
@HeikoSthat works with swig15:57
gf712yea, I think so15:57
@HeikoScompile time might blow up though15:57
gf712because there are two seperate abstractions15:57
@HeikoSbut there are not that many classes which use these abstractions or?15:57
gf712the parameter combination and the execution engine15:57
gf712no15:57
gf712but the parameter combination would be cool to use15:58
gf712for serialising to openml15:58
gf712for example15:58
@HeikoSyes15:59
gf712basically I need to have a container that is similar to sgobject15:59
@HeikoSit would be great to re-use that stuff15:59
@HeikoShttps://github.com/shogun-toolbox/shogun/pull/459815:59
gf712but not quite15:59
@HeikoSthis is the pr right?15:59
gf712yes15:59
@HeikoSok15:59
@HeikoSi will read a bit15:59
gf712ParameterNode represent a combination15:59
gf712and then GridParameters represents the space16:00
gf712from which you can generate ParameterNode16:00
@HeikoSah ok cool16:01
@HeikoSso then you can have different way to generate params16:01
gf712yea, so GridParameters has vectors16:01
@HeikoSsome strategies will require some additional information16:01
gf712instead of scalar values16:01
@HeikoSlike grid-serach requires a search space bounds or values16:01
@HeikoSgradient search requires a diff-able function16:01
@HeikoSetc16:01
gf712yup, which you can just add16:01
gf712I had to add iterator pointers for example16:01
gf712which don't make sense in ParameterNode16:02
@HeikoSi see16:02
gf712but are required in GridParameters16:02
@HeikoSyes16:02
@HeikoSthat was awkward in the old design16:02
gf712so then the attach methods are virtual16:02
@HeikoSi need to read to understand16:03
gf712so that the use can't add a scalar to GridParametrs16:03
gf712OK!16:03
@HeikoSI am just pointing on the gradient stuff all the time so we can put that under this new hood as well16:03
@HeikoSthe whole GP optimization framework16:03
gf712yea, it should be fine16:04
gf712at least I think so16:04
gf712I would have to work on that to understand it better16:04
gf712but the base class is not too restrictive16:05
@HeikoSthe main change is that16:05
@HeikoSa) there are no provided boundaries or values, but rather just parameter names and maybe starting values16:05
@HeikoSb) it doesnt use cross-validation to check but something else, the marginal likelihood which is implemented somewhere in the gp framework, needs to be bridged api wise16:06
@HeikoSc) there is no loop over different parameter combinations that are know a-priori, but rather only once you have evaluated one parameter combination you can generate a new one16:06
gf712a) that is fine16:07
gf712b) right now that is something that the engine decides so that can be changed easily16:07
gf712b) the train method is pure virtual so has to be rewritten for each type of model selection16:07
gf712c) I guess that kinda goes with b)16:08
@HeikoSgf712: I have one more thing. Check out the IterativeMachine mixin. This implements a stoppable training method. It would be very cool if the new modelselection was also stoppable, then then the yet-best-parameters would be extractable. But can discuss that later16:08
@HeikoSI gotta run now. Talk in a bit16:08
gf712OK! should be doable16:09
gf712ttyl16:09
-!- HeikoS [~heiko@82-132-215-5.dab.02.net] has quit [Remote host closed the connection]16:10
-!- gf712 [90520840@gateway/web/freenode/ip.144.82.8.64] has quit [Ping timeout: 256 seconds]16:36
-!- geektoni [c1cdd24a@gateway/web/freenode/ip.193.205.210.74] has quit [Quit: Page closed]16:53
-!- wiking [~wiking@178.197.237.54] has joined #shogun16:59
-!- wiking [~wiking@178.197.237.54] has quit [Changing host]16:59
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun16:59
-!- mode/#shogun [+o wiking] by ChanServ16:59
-!- gf712 [1f0ef8ff@gateway/web/freenode/ip.31.14.248.255] has joined #shogun17:21
gf712wiking: why doesn't [skip ci] work?17:23
@wikingask m$17:23
@wikingnon idea17:23
gf712hmm17:23
@wikingand my n is still stuck17:23
@wiking:D17:23
gf712your what?17:24
@wikingkey n17:24
@wikingon my laptop17:24
gf712oh right haha17:24
@wikingthis new macbook keyboard is a joke17:25
gf712do yo have pre?17:25
gf712pro17:25
@wikingye17:25
gf712hmm, can't complain with mine17:26
gf712at least hardware17:26
@wikinghow old?17:26
gf712the Touch Bar is pretty useless though17:26
gf7125 months17:26
@wikingyeah that's for show17:26
@wikingok17:26
@wikingso wait another 8-10 months17:26
@wikingand you'll see what i17:26
@wikingi'm talking about17:27
gf712its the ATI's so all good :D17:27
@wiking:>>>>>17:27
@wikingyeah i mean this is not mine either17:27
@wikingbut in order to get this resolved17:27
@wikingi would need to bring it to apple and have them fix it17:27
@wikingthat takes 5 days17:27
@wikingor so17:27
@wikingwhich makes me look at the wall17:27
@wiking:)17:27
gf712do you not have a desktop?17:27
@wikingnojp17:28
@wikingi only have this and a 40 inch 4k monitor :D17:28
gf712haha17:28
gf712get the ATI to buy you one17:28
@wikinglol17:28
gf712not sure they'll ship it there though :p17:28
@wikingyeah breeeexit017:29
gf712what?17:30
@wikingwell17:31
@wikingfirst of all17:31
@wiking.ch is not eu17:31
@wikingand neither uk now i guess17:31
@wikingso shipping a computer would be like crazy taxes17:31
@wiking:D17:31
gf712oh to ship it17:31
gf712yea but you can pick it up and then sail back with it17:31
@wikingahhahahah17:32
@wikinggf712: ok17:35
@wikingi have a q17:35
@wikinghow do you think i should newobject these ones17:36
@wiking%template(features) shogun::features<float64_t>;17:36
@wiking:D17:36
@wikingor probably %newobject shogun::features<float64_t>;17:37
@wikinglet's see17:37
gf712%newobject shogun::features<float64_t>;17:40
@wikingyeah trying17:40
gf712hmm17:40
@wikingnot really hekping :))17:41
gf712actually17:41
gf712why?17:41
gf712you already have %newobject shogun::features17:41
gf712no>17:41
gf712?17:41
@wikingyeah but for different function17:41
@wikingit's not the same shit17:41
@wikingi have17:41
@wiking%newobject shogun::features(CFile*, EPrimitiveType primitive_type);17:41
@wiking%newobject shogun::features(const std::string& name);17:41
@wikingthat does not cover feature<>lalal17:42
@wikingok be right back17:42
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]17:42
-!- gf712 [1f0ef8ff@gateway/web/freenode/ip.31.14.248.255] has quit [Ping timeout: 256 seconds]18:29
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun21:30
-!- mode/#shogun [+o wiking] by ChanServ21:30
--- Log closed Thu Apr 11 00:00:31 2019

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!