IRC logs of #shogun for Tuesday, 2018-03-06

--- Log opened Tue Mar 06 00:00:29 2018
-!- witness [uid10044@gateway/web/irccloud.com/x-gjetrqovtjkhhfoy] has quit [Quit: Connection closed for inactivity]01:26
@wikingwill_, your X_train is column oriented right?04:17
-!- witness [uid10044@gateway/web/irccloud.com/x-rgmcgjjevyxnumdy] has joined #shogun06:56
@wikinglisitsyn, zdrast08:03
@wikingr u here? :)08:03
@wikingmmm08:04
@wikingmy client dieed :)08:04
@wikingmmm08:05
@wikingok not the best08:05
@wiking:)08:05
@wikingsukey, fli[08:05
@wikingsukey, flip08:05
@sukey(._.) ~ ? ???08:05
@sukey[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/d8914da3230178119077c9d801c7bbbb76f872f9 by vigsterkr08:54
@sukey[https://github.com/shogun-toolbox/shogun] New branch clcache created08:54
@sukey[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/b59a21e6e61e5d7a40716f0859347613d5e5b705 by vigsterkr09:18
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun09:45
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34969343909:45
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun []09:45
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun09:59
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34969343909:59
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun []09:59
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun10:08
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34970043210:08
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun []10:08
@sukey[https://github.com/shogun-toolbox/shogun] vigsterkr pushed 3 commits:10:17
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/9c80c6366064196a713fbf0ac8ac458718dbd0e110:17
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/94116ff082e498a3ae111b5b160cc21ee921c60110:17
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/8365a9f172d259303d97ddcd9e34ebd0138e6b5710:17
will_sorry to ask again, but can someone take a look at this? https://stackoverflow.com/questions/49119857/when-using-stochastic-gradient-descent-with-shogun-neuralnetwork-everything-cla10:20
@wikingwill_, i've messaged a bit earlier yesterday :)10:23
@wikingdo you provide the data as a column oriented matrix10:23
@wikingand would it be possible to provide a full example10:23
@wiking?10:23
will_oh my bad10:23
will_ #parse X, y     X_train = np.array(train_df.drop(train_df.columns[-1], 1))10:24
will_y_train = np.array(train_df[train_df.columns[-1]])10:24
will_X_test = np.array(test_df.drop(test_df.columns[-1], 1))10:25
@wikingyou know that we use column oriented structure10:25
will_no10:25
@wikingso if train_df = pandas dataframe10:25
@wikingthen you will need to transpose10:25
@wikingthe matrix10:25
will_yes10:25
will_i then do10:25
will_X_train = RealFeatures(X_train.T)10:25
@wikingok but the best would be that you provide the10:25
will_ X_test = RealFeatures(X_test.T)10:25
@wikingfull working example10:25
@wikingin an github issue10:26
will_ok10:26
@wikingthat way i can easily reproduce it on my machine10:26
@wikingand look at it10:26
will_the dataset im using however10:26
will_how would you like me to provide it10:26
@wikingmmmm10:26
will_can I attach the csv?10:26
@wikingi mean a random noise is good as well10:26
@wikingbut if you can attach a dataaset10:26
@wikingas it's not a 'secret'10:27
@wikingthen just put it on github10:27
@wikingi meant dropbox10:27
@wikingor something10:27
will_ok10:27
@wikingand provide the link for it10:27
@wikingin the issue10:27
will_well if i remove column names and labels10:27
will_should be ok right?10:27
@wikingmmm10:27
will_its all scaled 0-110:27
@wikingi hope it's not some company secret10:27
@wiking:()10:27
@wiking:D10:27
will_nah its not haha10:27
will_basically its for a university project, i acquired the dataset from another university10:28
@wikingkk10:28
@wikingjust provide as much as possible10:28
will_so I am slightly apprehensive of posting complete code though10:28
@wikingthen just mail it to me10:28
will_because dont want to get flagged for plagiarism of my own work haha10:28
@wikingwiking (at) maeth (dot) com10:28
will_ok10:29
will_maeth10:29
will_is a ipynb file ok?10:30
@wikingyeye10:30
@wikingsure10:30
@wikingbtw what made you think to use shogun ? :)10:32
lisitsynwiking: hey10:33
@wikinglisitsyn, ho10:33
@wikinglisitsyn, i have no clue what i wanted10:33
lisitsynno worries :)10:33
@wikingah yeah std::visitor and std::variant10:33
@wikingwhat awha thwat10:33
@wiking:)10:33
lisitsynvariant? what for?10:34
@wikingany10:34
@wiking:)10:34
lisitsynwell just as before I don't think compilers would like it10:34
@wikingwe could try :P10:34
lisitsynit should be very slow to compile and at some point we will hit the limit of template parameters10:34
lisitsynwhat is the problem variant would solve?10:35
@wikingvisitor pattern is then right away included10:35
@wikingi mean now we have our own cooking10:36
@wikingwhich is aagain a bit10:36
@wikingasdf10:36
@wikingnot ttoo much10:36
@wikingjust a bit10:36
@wikinganyhow10:36
@wikingthat was just a thought10:36
@wikingeverythinbg else i've sent in an email now :)10:37
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has joined #shogun10:44
-!- mode/#shogun [+o HeikoS] by ChanServ10:44
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has quit [Ping timeout: 256 seconds]10:48
will_pinged you an email now wiking :)10:49
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun10:49
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34970043210:49
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun []10:49
@wikingwill_, lemme check10:49
@wikingwill_, i guess it got greylisted... will ping u in 1h if i didn't receiv it10:50
@wiking*receive10:50
@wikingwill_, got it10:50
will_literally only just sent it - its from my university address so should get through10:50
will_cool10:50
@wikingwill_, ok so if you need some benchmark numbers10:50
@wikingyou should check out this project10:50
@wikinghttp://github.com/mlpack/benchmarks/10:50
will_thanks!10:51
@wikinghttp://mlpack.org/benchmark.html10:51
@wikingdunno when was this the last time updated10:52
will_I have mentioned these results in my lit review and may run the benchmarks myself for cross validation10:52
will_will you still be around in an hour or so? have to step away from my computer for a little bit10:53
@wikingyes10:53
will_cool, thanks a lot for your help btw10:53
@wikingmnw10:58
@wiking*nw10:58
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun11:07
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34971974711:07
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun []11:07
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has joined #shogun11:16
-!- mode/#shogun [+o HeikoS] by ChanServ11:16
@sukey[https://github.com/shogun-toolbox/shogun] vigsterkr pushed 3 commits:11:21
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/0157b28f42ddccb03be1bbad5fa0c5ce1e5c598311:22
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/20e001acb547beb7c5baac6622d0eb7070f1de5011:22
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/1539b6eb9b75d0e4d7607903662951604f11e81811:22
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has joined #shogun11:24
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34971974711:24
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has left #shogun []11:24
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has quit [Quit: Leaving.]11:25
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has joined #shogun11:25
-!- mode/#shogun [+o HeikoS] by ChanServ11:25
-!- witness [uid10044@gateway/web/irccloud.com/x-rgmcgjjevyxnumdy] has quit [Quit: Connection closed for inactivity]11:25
will_back now11:27
will_any luck wiking11:27
@wikingsorry have to work on other stuff11:31
@wikingbut i'll get back asap11:31
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has quit [Ping timeout: 256 seconds]11:34
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has joined #shogun11:43
-!- mode/#shogun [+o HeikoS] by ChanServ11:43
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun12:12
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34974271912:12
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun []12:12
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has joined #shogun12:23
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34974271912:23
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has left #shogun []12:23
@sukey[https://github.com/shogun-toolbox/shogun] vigsterkr pushed 3 commits:12:26
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/62877ed117ae3b6084df2a7587904318bf43d9f612:26
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/859d8ebb37cbb36af6e9152aade8fbdff8aeae5b12:26
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/c4c971a33d43c4e418c623bdd234d53e4cbd86db12:26
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has quit [Ping timeout: 245 seconds]13:14
-!- travis-ci [~travis-ci@ec2-54-227-87-168.compute-1.amazonaws.com] has joined #shogun13:16
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34976672913:16
-!- travis-ci [~travis-ci@ec2-54-227-87-168.compute-1.amazonaws.com] has left #shogun []13:16
@wikinganybody knows whether ntfs is case sensitive?13:35
@sukey[https://github.com/shogun-toolbox/shogun] vigsterkr pushed 3 commits:13:46
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/3af21674db408a2d31a68c63002ab9a083eb4ab813:46
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/4999692c2384cc31214035af76d1087c9bf688d713:46
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/6bdb1ec07d8b06e5eadf64777cd1aa8cbefc54aa13:46
@wikingasdf for appveyor13:46
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4168 synchronized by syashakash13:49
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun14:36
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34979661514:36
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun []14:36
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun14:45
travis-ciit's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34979661514:45
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun []14:45
@sukey[https://github.com/shogun-toolbox/shogun] vigsterkr pushed 4 commits:14:47
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/727819c422fa646393ee2a9f5a1c6fdbf5e998eb14:47
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/e61dea2ba8b86a52eb51bcd6efd2a2f946580e7514:47
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/fb916d6230569f48abded05ecdcdc34a1c81717614:47
@sukeyhttps://github.com/shogun-toolbox/shogun/commit/e56963bbfa782f87c5cd799bda43add1cb56f41c14:47
will_wiking any update?14:49
@sukey[https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/86e33f0bb4d28781d75c819d29c583698e216d7f by vigsterkr14:49
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has joined #shogun14:58
travis-ciit's syashakash's turn to pay the next round of drinks for the massacre he caused in syashakash/shogun: https://travis-ci.org/syashakash/shogun/builds/34979755114:58
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has left #shogun []14:58
@wikinglisitsyn, http://danmux.com/posts/bazel_fawlty/15:18
will_wiking15:18
@wikingwill_, sorry man have to prioritize things15:18
@wikingwill get back asap15:18
will_np15:19
will_how long you think15:19
lisitsynwiking: ha15:19
will_is there anything that comes to mind - e.g. a line i might need to add?15:19
@wikingwill_, cant give you a deadline15:19
@wikingwill_, i mean you can check here how the GD being used15:19
@wikingwill_, http://shogun.ml/notebook/latest/autoencoders.html15:19
will_thank you15:20
@wikingwill_, your epoch is very small15:26
@wiking    MLP.set_max_num_epochs(5)15:26
@wikingis nothing15:26
@wiking    MLP.set_max_num_epochs(500)15:26
@wikingshould be doing something15:26
@wikingor rather15:28
@wikingset_gd_mini_batch_size is way too big15:29
-!- travis-ci [~travis-ci@ec2-54-227-87-168.compute-1.amazonaws.com] has joined #shogun15:29
travis-ciit's syashakash's turn to pay the next round of drinks for the massacre he caused in syashakash/shogun: https://travis-ci.org/syashakash/shogun/builds/34979755115:29
-!- travis-ci [~travis-ci@ec2-54-227-87-168.compute-1.amazonaws.com] has left #shogun []15:29
@wikingso for example with set_gd_mini_batch_size(20) and set_max_num_epochs(250)15:29
@wikingthe confusion matrix is getting better15:30
@wiking('Accuracy Score: ', 0.9027266028002948)15:30
will_oh yeah it was 200 originally15:31
will_i changed it to 5 to see if that made a difference15:31
will_ok i reduced mini batch size and it worked for me as well15:33
@wikingk15:33
@wikingplz upvote and accept the answer at SO15:33
@wikinghttps://stackoverflow.com/questions/49119857/when-using-stochastic-gradient-descent-with-shogun-neuralnetwork-everything-cla/49133260#4913326015:33
@wikingthnx15:33
@wiking:>15:33
will_thank you15:34
will_but i have a question15:34
@wikingshoot15:35
will_so the reason i left that set at 200 is because in scikit-learn the default is min(200, sample_size)15:35
will_so i manually set it to 200 in scikit-learn and did not get that error15:35
will_but the data is exactly the same as is the other configurations15:35
@wikingbut the algo isn't15:36
@wikingi mean it's not the same SGD15:36
@wikingis it the same MLP?15:36
will_yeh15:36
@wikingwhich one did u use?15:36
will_i think its just me being stupid tbh15:36
will_lol15:36
will_MLPClassifier15:36
@wikingkk15:36
will_thanks for assisting with that15:36
@wikingi'll try to check what's the thing with it15:36
@wikingi'll mail you if i found something15:37
will_ok15:37
will_thanks15:37
will_sorry for bothering you haha sometimes its just good to have a second set of eyes15:37
will_i was staring at it thinking, what am i doing wrong? lol15:37
will_glad to have it resolved15:37
will_cheers mate15:37
@wikingk15:38
-!- will_ [5862c914@gateway/web/freenode/ip.88.98.201.20] has quit [Quit: Page closed]15:41
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has joined #shogun16:00
travis-ciit's Heiko Strathmann's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/34866970816:00
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has left #shogun []16:00
-!- HeikoS [~heiko@untrust-out.swc.ucl.ac.uk] has joined #shogun16:55
-!- mode/#shogun [+o HeikoS] by ChanServ16:55
@HeikoSlisitsyn:  jojo18:18
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4198 synchronized by karlnapf18:46
@sukey[https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4198 synchronized by karlnapf19:14
-!- HeikoS [~heiko@untrust-out.swc.ucl.ac.uk] has quit [Ping timeout: 260 seconds]19:18
--- Log closed Wed Mar 07 00:00:30 2018

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!