IRC logs of #shogun for Wednesday, 2019-02-13

--- Log opened Wed Feb 13 00:00:09 2019
-!- feriglegarc [3ea305ab@gateway/web/freenode/ip.62.163.5.171] has quit [Ping timeout: 256 seconds]00:11
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]00:28
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun02:29
-!- mode/#shogun [+o wiking] by ChanServ02:29
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 246 seconds]02:33
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun08:21
-!- mode/#shogun [+o wiking] by ChanServ08:21
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]08:57
-!- gf712 [90520825@gateway/web/freenode/ip.144.82.8.37] has joined #shogun08:59
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun09:09
-!- mode/#shogun [+o wiking] by ChanServ09:09
-!- wiking_ [~wiking@2001:67c:10ec:5784:8000::3ff] has joined #shogun09:11
-!- wiking [~wiking@huwico/staff/wiking] has quit [Read error: Connection reset by peer]09:11
-!- wiking_ is now known as wiking09:20
-!- wiking [~wiking@2001:67c:10ec:5784:8000::3ff] has quit [Changing host]09:20
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun09:20
-!- mode/#shogun [+o wiking] by ChanServ09:20
gf712wiking just reading the sklearn docs for svm and they're changing gamma to 1 / (n_features * X.std()). maybe can do the same?10:19
@wikingmmmm10:23
@wikingyeah10:25
@wikingbut we need to check for feature type then10:25
@wikingas streaming ones cannot provide that10:25
gf712ah true.. well shouldn't be too difficult!10:27
@wikingdyncast :)10:28
@wikingi mean you can actually get an enum for this10:28
@wikingimo10:28
gf712yes exactly10:28
gf712check enum10:28
gf712and then do 1/ n_features if is streaming?10:29
@wikingyeah10:29
gf712cool10:29
gf712thanks!10:29
@wikingnw10:29
@wikingthank u!10:29
@wikingbtw this is10:29
@wikingthe change is in some pr?10:29
@wikingi mean the X.std()10:29
@wikingbtw i'm probably gonna import this project into shogun https://github.com/martinmoene/string-view-lite/releases10:30
gf712no, it's in the docs10:32
gf712https://scikit-learn.org/stable/modules/generated/sklearn.svm.SVC.html10:32
gf712it says the current will deprecate in favour of scale10:32
gf712ah cool, that would be quite useful10:33
gf712c++17 would be great in general10:33
gf712and this https://github.com/fmtlib/fmt :D10:33
gf712which should be in c++2010:34
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]10:41
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun10:51
-!- mode/#shogun [+o wiking] by ChanServ10:51
@wikinggf712: we need to fix the c++17 branch10:53
gf712wiking what is missing?10:54
@wikingi think merging lisitsyn's fix for tapkee10:55
@wikingi'll check on it now10:55
@wikinglemme force push a thing to windows stuff10:55
lisitsynwiking: ah sorry I forgot to update that10:55
lisitsynwiking: I basically need to update testing data10:55
lisitsyndiffusion maps act a bit different now10:55
@wikinglisitsyn: do u do it or shall i just pick your changes10:55
@wikingand regen the data10:55
lisitsynoh if you can it would be nice10:55
lisitsynbecause I don't remember how to do that10:56
lisitsyn:D10:56
@wikinglemme see10:56
@wikinggit remote adding10:56
@wikinglisitsyn: the runtime init can go right?10:56
@wikingi mean merge10:56
lisitsynwiking: eh?10:57
lisitsynahh10:57
@wikinglisitsyn: the lambda that gf712 did for auto stuff10:57
lisitsynyeah I think10:57
lisitsynalthough I am a bit worried with all these this captures10:57
lisitsynbut that's fixable later10:57
@wikingk11:03
@wikinggf712: ping me when u r done with that std() change11:03
@wikinglisitsyn: do u think having arrow as a hard dependency would be a no go?11:04
@wikinglisitsyn: i'm just thikning about our input readers....11:04
lisitsynwiking: I don't know11:04
lisitsynis it going well with arrow?11:04
@wikingwell there's some shit with it of course11:04
@wiking:D11:04
lisitsynI mean I heard they have some troubles but I don't remember exactly11:04
@wikingi mean its column oriented the whole thing11:05
@wikingso DenseFeatures11:05
@wikingis crazy11:05
@wikingif u see what i mean11:05
@wikingbecause there's no such thing as a full matrix11:05
@wikingfrom arrow11:05
lisitsynnono I mean they have some org-wise troubles ;)11:05
lisitsynlike no maintainers or something11:06
@wikingmmm eh?? really11:06
@wikingi mean there's a lot of traffic11:06
@wikingon the mailing list11:06
@wikingas well as Wes is doing it no?11:06
@wikinglisitsyn: the diffusion map data changed quite a bit11:09
@wikingexpected?11:09
lisitsynwiking: yeah11:09
lisitsynwiking: maybe I am mistaken about arrow11:09
lisitsynidk11:09
@wikinglisitsyn: https://pastebin.com/Hjn7NS4T11:09
lisitsynwiking:I think I changed how I treat some parameter or something11:10
lisitsynlet me check11:10
@wikinglemme know11:10
@wikingif its ok i'll add the new integration file to data11:10
lisitsynwiking: https://github.com/lisitsyn/tapkee/commit/6b14803e6f601ab5fcb23e165d8708c25eeab358#diff-b54baa132e800678899ccd135ef7705b11:11
lisitsynwiking: oh it was plain wrong lol11:11
lisitsynwiking: shit happens11:11
lisitsynso yeah it is worth updating11:11
lisitsynthanks!11:11
@wikingok11:12
@wikinglisitsyn: ok done.... lets see if ci is liking it11:18
@wikingif so then i merge11:18
-!- feriglegarc [50fe9a43@gateway/web/freenode/ip.80.254.154.67] has joined #shogun11:18
gf712wiking doing the std() thing now, what is the easiest way to calculate std from a CFeature?11:20
gf712need to get the matrix and then use the function in CStatistics?11:20
@wikingmmmm11:20
@wikingi think CDenseF has std11:20
@wikingmmm no that one has mean11:21
@wikingand cov11:21
gf712yea...11:21
@wikingi mean you can add to dotfeatures11:22
@wikingthere's already get_mean11:22
@wiking:)11:22
gf712sure!11:22
@wikingand actually11:24
gf712wiking why is get_mean virtual?11:24
@wikingDenseFeatures::mean should go imo11:24
@wikingor at least11:24
@wikingit shoudl be11:24
@wikingDenseFeatures::get_mean override11:24
@wikingcoz in dense u can calculate that faster11:25
@wikingimo11:25
@wikingthat was the idea11:25
@wiking:)11:25
@wikingbut then it's not the same function11:25
@wiking:>11:25
gf712yea haha11:25
@wikingso that should be fixed imo11:26
@wikingif you are already touching this11:26
@wiking:)11:26
gf712I'm guessing it's the same with get_cov/cov?11:28
@wikingi guess so :)))11:29
gf712ah I think I know why it wasn't done/.11:34
gf712wiking in DenseFeatures is templated11:34
gf712but DotFeatures uses just float64_t11:34
@wikingmmm11:34
gf712so you can't override the DotFeatures get_mean because it is only defined for float64_t11:34
gf712right?11:35
@wikingi mean DenseFeatures<int32>::mean value is likely to be float11:35
@wikingno?11:35
@wiking;)11:35
@wikingor you would expect a floored int32_t as a result?11:35
@wikingagree that DenseFeatures<complex> is tricky11:36
@wiking:>11:36
gf712yes I was going to say11:36
@wikingbut that's another story :)11:36
gf712but does anyone use complex? :D11:36
@wikingindeed11:36
@wikingbut i mean11:36
@wikingit should be fine11:37
@wikingfor the time being11:37
@wikingno?11:37
@wikingi would return float64_t11:37
gf712yup, should be fine11:37
gf712I'll run tests and see what happens11:37
gf712wiking so many things that could/should be const11:41
@wikingyep11:42
@wikinghav efun :)11:42
-!- besser82 [~besser82@fedora/besser82] has quit [Quit: Freedom, Friends, Features, First [fedoraproject.org]]11:42
-!- besser82 [~besser82@fedora/besser82] has joined #shogun11:47
-!- mode/#shogun [+o besser82] by ChanServ11:47
feriglegarc?Hola! ?Anybody faced this one before?11:51
feriglegarcTarget "XXX" requires the language dialect "CXX14" , but CMake does not   know the compile flags to use to enable it.11:52
feriglegarcI tried adding these flags in cmake -DCMAKE_CXX_FLAGS=-std=c++14 -DCMAKE_CXX_FLAGS_RELEASE=-std=c++1411:52
gf712I think that is when your Cmake is too old and doesn't know c++1411:53
gf712I think support for CXX14 only started in Cmake 3.8 or so?11:53
feriglegarcI am doing cmake 3.8.011:54
feriglegarcgf712: it sounds sensible that it should still be possible to force the compiler flag as long as it supports, no?11:54
gf712ah never mind that was with c++1711:55
gf712hmmm11:55
feriglegarcall right11:56
gf712so set(CMAKE_CXX_STANDARD 14) doesn't work?11:58
gf712wiking turns out forcing get_mean to only return float64_t type is a bit more difficult than I thought12:00
gf712maybe that can be a separate PR? :D12:00
@wikingsure12:01
gf712basically I don't think I can't mix types in the linalg stuff12:01
gf712can*12:01
gf712and then would have to be able to cast all SGVector from any type to float64_t12:02
gf712which I you can't right?12:02
-shogun-buildbot:#shogun- Build deb3 - interfaces #415 is complete: Success [build successful] - http://buildbot.shogun-toolbox.org:8080/#builders/37/builds/41512:17
@wikinggf712: xcode9-macos10.13 has no std::variant12:19
@wiking:(12:19
@wikinglets see if i can change the ci12:25
-!- Lefteris [~lefteris@2a05:b400:100:100:d198:bb2f:6d88:6db] has joined #shogun12:25
gf712wiking is there no Xcode10?12:25
@wikingapparently ther eis12:25
@wikingjust trying to figure out how to activate that12:26
@wikingto be detected by cmake12:26
gf712ah ok12:26
gf712so annoying how it takes so long to get everything to the newest standard...12:26
gf712they should slow down the releases..12:26
gf712wiking what is the best method to square a sgvector?12:34
@wikingeigen ?:)12:38
@wiking.sqrt()12:38
@wikingmat1.cwiseSqrt()12:39
@wikingor array.sqrt()12:40
gf712OK!12:40
@wikingbtw it's weird that cmake is not screaming that c++17 feature for xcode9 is not working12:41
@wikingone would hope that requiring cpp17 standard12:41
@wikingwould result into an error when running cmake12:41
@wiking:(12:41
gf712but I think Xcode9 supports c++1712:42
gf712just not std::variant12:42
gf712it might be in experimental header12:42
@wikingyeah but that's not c++17 then12:42
@wikingor? :)12:42
@wikingstd::variant is c++1712:42
@wikingor should be12:42
gf712yes, but it might still be experimental12:43
gf712for older versions12:43
gf712what if you try -stdlib=libc++?12:44
@wikingok12:45
@wikingthis doesn't work12:45
@wikingeven if you use xcode10 std::visit is not available12:46
@wikingas that's only macos 10.1412:46
@wiking\o/12:46
@wikingand azure only has 10.1312:47
@wikingso yeah switching to c++17 is a pain atm12:47
@wikingi mean i can keep the variant replacement in12:48
@wikingbut then .... i mean it's the same as we stick to c++1412:48
gf712well c++17 has more features12:48
gf712like constexpr if12:48
gf712string views12:48
gf712I'm guessing that works?12:49
@wikingdunno12:49
@wikingi mean that's the thing12:49
@wikingit's halfbacked12:49
@wikingand only latest os support it12:49
@wikingwith very latest compiler12:49
@wikingand filesystem most of the places are still experimental12:49
gf712hmm ok, I guess just have to put a reminder for in a years time...12:50
@wikinghahaha yeah12:50
gf712just put it on repeat12:50
gf712:(12:50
@wikinghahaha12:50
@wiking     8>c:\users\vssadministrator\.conda\envs\shogun\library\include\rxcpp\rx-util.hpp(686): error C2039: 'unexpected': is not a member of 'std' [D:\a\1\s\build\src\shogun\libshogun.vcxproj]12:50
@wiking         C:\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\VC\Tools\MSVC\14.16.27023\include\unordered_set(19): note: see declaration of 'std'12:50
@wikingso more shhit12:50
gf712ah so rxcpp is also falling behind..12:51
@wikingbut that's only on msvc12:52
gf712I thought Rx was ms? shouldn't they maintain their stuff a bit better?12:52
gf712oh well :(12:52
@wikinghehe12:54
@wikingseems something is wrong with clcache :(12:55
feriglegarcgf712: "so set(CMAKE_CXX_STANDARD 14) doesn't work?" It does work, it is in the CMakeLists.txt already13:04
feriglegarcfor the moment I am concluding it as cmake 3.8.0 is not supported13:07
feriglegarclet me know if that's wrong, maybe you know some automatic job using that version (or even older), or someone using it13:08
-!- Lefteris [~lefteris@2a05:b400:100:100:d198:bb2f:6d88:6db] has quit [Quit: Leaving]13:20
gf712wiking why is there an implementation of mean in Eigen/linalg and then it isn't used by features?14:09
@wiking:shrug:14:09
gf712might be worth start using more stuff that is linalg no? just seems to be easier to write stuff with Eigen than reimplementing some stuff...14:11
gf712having a bit of a nightmare finding a way of just doing (X_i-X_mean)^2 :P14:11
feriglegarcvariance? ^_^14:20
gf712yes14:22
gf712just filled a matrix with -mean added X to that14:23
feriglegarcgf712: meant it in the sense of using a library method for it, e.g. https://github.com/shogun-toolbox/shogun/blob/develop/src/shogun/mathematics/Statistics.h#L5514:23
gf712hmm but that is for a vector14:24
gf712I guess I can just do for each feature14:24
gf712basically NumPy still std() is what I want14:24
gf712but then the mean per column so doesn't really work right?14:27
gf712rather than the mean of the matrix14:27
feriglegarcI don't know how you've access to your columns, etc14:30
feriglegarcbut for instance maybe you can call that method per column, wrapping each one on a SGVector (without copying the data, of course)14:31
feriglegarcbut to me it sounds reasonable that there could already be a method around there in Shogun doing what you want14:31
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]14:37
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun14:38
-!- mode/#shogun [+o wiking] by ChanServ14:38
@wikinggf712: colwise.sqrt()15:04
@wiking:)15:04
@wikingsince it's column oriented anyways15:04
gf712OK!15:25
gf712wiking btw when do we use dense features and when is it dot features?15:25
@wikingwell basically15:26
@wikingall the kernels could use SparseFeatures and DenseFeatures15:26
@wikingthat's why there's dot feature (one reason)15:26
@wikingand libsvmfile format is sparseFeatures15:26
@wikingso densefeatures = csv15:26
@wiking:)15:26
@wikingbut actually mostly we should use dotfeatures15:27
@wikingif possible15:27
@wikingbut many many algos15:27
@wikingstatic cast CFeatures15:27
@wikingto DenseFeatureS<float64>15:27
@wikingwhich is super bad15:27
@wikingbut yeah15:27
@wiking...15:27
gf712but why is it bad?15:28
gf712it seems to me like dense is much easier to work with15:28
@wikingyeah15:28
@wikingthat's why everybody casts it15:29
gf712mostly because I can access the raw data15:29
@wikingbut the problem is15:29
gf712and use linalg15:29
@wikingthat this way you completely disregard the option of useing sparse vector space15:29
@wikingor like15:29
@wikingDenseFeatures<float32> or DenseFeatures<int>15:29
@wiking;)15:29
gf712hmm I am still confused why dense features exists then?15:31
gf712shouldn't dot features be more complete in that case?15:31
@wikingdensefeatures is still an entity15:31
@wikingbut yeah we should work on things15:31
@wikingon a higher level15:31
@wikingif possible15:31
@wikingsee for example the rpobelm of DenseFeature being a template15:31
@wikingto start with15:32
@wikingso typecasting is shitty15:32
@wikingproperly15:32
@wikingCFeatures -> DenseFeature<WHAT>15:32
@wikingcoz all the algos15:32
@wikingare getting for fit/train CFeatures*15:32
@wikingbut check the doxy15:33
@wikinghttp://shogun.ml/api/latest/classshogun_1_1CDotFeatures.html15:33
@wikingyou could handle all those inherited classees as the same15:34
@wikingway15:34
gf712hmmm I'll have a better look15:38
-!- Lefteris [~lefteris@2a05:b400:100:100:d198:bb2f:6d88:6db] has joined #shogun15:40
-!- gf712 [90520825@gateway/web/freenode/ip.144.82.8.37] has quit [Ping timeout: 256 seconds]16:03
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]16:09
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun16:18
-!- mode/#shogun [+o wiking] by ChanServ16:18
-!- gf712 [c13d11fa@gateway/web/freenode/ip.193.61.17.250] has joined #shogun16:40
-!- Lefteris [~lefteris@2a05:b400:100:100:d198:bb2f:6d88:6db] has quit [Quit: Leaving]16:51
gf712wiking is it ok if in this one situation with the polykernel I cast to densefeatures because I wrote the std function with Eigen...16:53
gf712now gamma does the same as the new sklearn16:53
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]16:55
-!- wiking [~wiking@inf-ise-etx-dock-1-111.ethz.ch] has joined #shogun16:55
-!- wiking [~wiking@inf-ise-etx-dock-1-111.ethz.ch] has quit [Changing host]16:55
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun16:55
-!- mode/#shogun [+o wiking] by ChanServ16:55
@wikinggf712: push it16:56
@wiking:)16:56
gf712cool!16:57
-!- besser82 [~besser82@fedora/besser82] has quit [Quit: Freedom, Friends, Features, First [fedoraproject.org]]17:00
-!- besser82 [~besser82@fedora/besser82] has joined #shogun17:01
-!- mode/#shogun [+o besser82] by ChanServ17:01
@wikingfuuuuck17:10
@wikinghttp://gernotklingler.com/blog/creating-using-shared-libraries-different-compilers-different-operating-systems/17:11
@wikingtime to use libtooling17:11
@wikingto add to our classes SHOGUN_EXPORT17:11
@wikingok taking a break and writing that libtooling hack17:13
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]17:13
-!- feriglegarc [50fe9a43@gateway/web/freenode/ip.80.254.154.67] has quit [Quit: Page closed]17:25
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun17:43
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host]17:43
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun17:43
-!- mode/#shogun [+o wiking] by ChanServ17:43
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 246 seconds]17:48
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun17:55
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host]17:55
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun17:55
-!- mode/#shogun [+o wiking] by ChanServ17:55
-!- gf712 [c13d11fa@gateway/web/freenode/ip.193.61.17.250] has quit [Ping timeout: 256 seconds]18:06
-!- gf712 [90520825@gateway/web/freenode/ip.144.82.8.37] has joined #shogun18:12
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]19:29
-!- gf712 [90520825@gateway/web/freenode/ip.144.82.8.37] has quit [Ping timeout: 256 seconds]19:38
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun19:44
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host]19:44
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun19:44
-!- mode/#shogun [+o wiking] by ChanServ19:44
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]22:29
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun22:32
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host]22:32
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun22:32
-!- mode/#shogun [+o wiking] by ChanServ22:32
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection]22:42
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun22:45
-!- mode/#shogun [+o wiking] by ChanServ22:45
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 246 seconds]22:49
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun22:50
-!- mode/#shogun [+o wiking] by ChanServ22:50
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 272 seconds]22:54
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun23:19
-!- mode/#shogun [+o wiking] by ChanServ23:19
--- Log closed Thu Feb 14 00:00:10 2019

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!