--- Log opened Tue Mar 06 00:00:29 2018 | ||
-!- witness [uid10044@gateway/web/irccloud.com/x-gjetrqovtjkhhfoy] has quit [Quit: Connection closed for inactivity] | 01:26 | |
@wiking | will_, your X_train is column oriented right? | 04:17 |
---|---|---|
-!- witness [uid10044@gateway/web/irccloud.com/x-rgmcgjjevyxnumdy] has joined #shogun | 06:56 | |
@wiking | lisitsyn, zdrast | 08:03 |
@wiking | r u here? :) | 08:03 |
@wiking | mmm | 08:04 |
@wiking | my client dieed :) | 08:04 |
@wiking | mmm | 08:05 |
@wiking | ok not the best | 08:05 |
@wiking | :) | 08:05 |
@wiking | sukey, fli[ | 08:05 |
@wiking | sukey, flip | 08:05 |
@sukey | (._.) ~ ? ??? | 08:05 |
@sukey | [https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/d8914da3230178119077c9d801c7bbbb76f872f9 by vigsterkr | 08:54 |
@sukey | [https://github.com/shogun-toolbox/shogun] New branch clcache created | 08:54 |
@sukey | [https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/b59a21e6e61e5d7a40716f0859347613d5e5b705 by vigsterkr | 09:18 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun | 09:45 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349693439 | 09:45 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun [] | 09:45 | |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun | 09:59 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349693439 | 09:59 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun [] | 09:59 | |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun | 10:08 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349700432 | 10:08 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun [] | 10:08 | |
@sukey | [https://github.com/shogun-toolbox/shogun] vigsterkr pushed 3 commits: | 10:17 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/9c80c6366064196a713fbf0ac8ac458718dbd0e1 | 10:17 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/94116ff082e498a3ae111b5b160cc21ee921c601 | 10:17 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/8365a9f172d259303d97ddcd9e34ebd0138e6b57 | 10:17 |
will_ | sorry to ask again, but can someone take a look at this? https://stackoverflow.com/questions/49119857/when-using-stochastic-gradient-descent-with-shogun-neuralnetwork-everything-cla | 10:20 |
@wiking | will_, i've messaged a bit earlier yesterday :) | 10:23 |
@wiking | do you provide the data as a column oriented matrix | 10:23 |
@wiking | and would it be possible to provide a full example | 10:23 |
@wiking | ? | 10:23 |
will_ | oh my bad | 10:23 |
will_ | #parse X, y X_train = np.array(train_df.drop(train_df.columns[-1], 1)) | 10:24 |
will_ | y_train = np.array(train_df[train_df.columns[-1]]) | 10:24 |
will_ | X_test = np.array(test_df.drop(test_df.columns[-1], 1)) | 10:25 |
@wiking | you know that we use column oriented structure | 10:25 |
will_ | no | 10:25 |
@wiking | so if train_df = pandas dataframe | 10:25 |
@wiking | then you will need to transpose | 10:25 |
@wiking | the matrix | 10:25 |
will_ | yes | 10:25 |
will_ | i then do | 10:25 |
will_ | X_train = RealFeatures(X_train.T) | 10:25 |
@wiking | ok but the best would be that you provide the | 10:25 |
will_ | X_test = RealFeatures(X_test.T) | 10:25 |
@wiking | full working example | 10:25 |
@wiking | in an github issue | 10:26 |
will_ | ok | 10:26 |
@wiking | that way i can easily reproduce it on my machine | 10:26 |
@wiking | and look at it | 10:26 |
will_ | the dataset im using however | 10:26 |
will_ | how would you like me to provide it | 10:26 |
@wiking | mmmm | 10:26 |
will_ | can I attach the csv? | 10:26 |
@wiking | i mean a random noise is good as well | 10:26 |
@wiking | but if you can attach a dataaset | 10:26 |
@wiking | as it's not a 'secret' | 10:27 |
@wiking | then just put it on github | 10:27 |
@wiking | i meant dropbox | 10:27 |
@wiking | or something | 10:27 |
will_ | ok | 10:27 |
@wiking | and provide the link for it | 10:27 |
@wiking | in the issue | 10:27 |
will_ | well if i remove column names and labels | 10:27 |
will_ | should be ok right? | 10:27 |
@wiking | mmm | 10:27 |
will_ | its all scaled 0-1 | 10:27 |
@wiking | i hope it's not some company secret | 10:27 |
@wiking | :() | 10:27 |
@wiking | :D | 10:27 |
will_ | nah its not haha | 10:27 |
will_ | basically its for a university project, i acquired the dataset from another university | 10:28 |
@wiking | kk | 10:28 |
@wiking | just provide as much as possible | 10:28 |
will_ | so I am slightly apprehensive of posting complete code though | 10:28 |
@wiking | then just mail it to me | 10:28 |
will_ | because dont want to get flagged for plagiarism of my own work haha | 10:28 |
@wiking | wiking (at) maeth (dot) com | 10:28 |
will_ | ok | 10:29 |
will_ | maeth | 10:29 |
will_ | is a ipynb file ok? | 10:30 |
@wiking | yeye | 10:30 |
@wiking | sure | 10:30 |
@wiking | btw what made you think to use shogun ? :) | 10:32 |
lisitsyn | wiking: hey | 10:33 |
@wiking | lisitsyn, ho | 10:33 |
@wiking | lisitsyn, i have no clue what i wanted | 10:33 |
lisitsyn | no worries :) | 10:33 |
@wiking | ah yeah std::visitor and std::variant | 10:33 |
@wiking | what awha thwat | 10:33 |
@wiking | :) | 10:33 |
lisitsyn | variant? what for? | 10:34 |
@wiking | any | 10:34 |
@wiking | :) | 10:34 |
lisitsyn | well just as before I don't think compilers would like it | 10:34 |
@wiking | we could try :P | 10:34 |
lisitsyn | it should be very slow to compile and at some point we will hit the limit of template parameters | 10:34 |
lisitsyn | what is the problem variant would solve? | 10:35 |
@wiking | visitor pattern is then right away included | 10:35 |
@wiking | i mean now we have our own cooking | 10:36 |
@wiking | which is aagain a bit | 10:36 |
@wiking | asdf | 10:36 |
@wiking | not ttoo much | 10:36 |
@wiking | just a bit | 10:36 |
@wiking | anyhow | 10:36 |
@wiking | that was just a thought | 10:36 |
@wiking | everythinbg else i've sent in an email now :) | 10:37 |
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has joined #shogun | 10:44 | |
-!- mode/#shogun [+o HeikoS] by ChanServ | 10:44 | |
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has quit [Ping timeout: 256 seconds] | 10:48 | |
will_ | pinged you an email now wiking :) | 10:49 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun | 10:49 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349700432 | 10:49 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun [] | 10:49 | |
@wiking | will_, lemme check | 10:49 |
@wiking | will_, i guess it got greylisted... will ping u in 1h if i didn't receiv it | 10:50 |
@wiking | *receive | 10:50 |
@wiking | will_, got it | 10:50 |
will_ | literally only just sent it - its from my university address so should get through | 10:50 |
will_ | cool | 10:50 |
@wiking | will_, ok so if you need some benchmark numbers | 10:50 |
@wiking | you should check out this project | 10:50 |
@wiking | http://github.com/mlpack/benchmarks/ | 10:50 |
will_ | thanks! | 10:51 |
@wiking | http://mlpack.org/benchmark.html | 10:51 |
@wiking | dunno when was this the last time updated | 10:52 |
will_ | I have mentioned these results in my lit review and may run the benchmarks myself for cross validation | 10:52 |
will_ | will you still be around in an hour or so? have to step away from my computer for a little bit | 10:53 |
@wiking | yes | 10:53 |
will_ | cool, thanks a lot for your help btw | 10:53 |
@wiking | mnw | 10:58 |
@wiking | *nw | 10:58 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun | 11:07 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349719747 | 11:07 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun [] | 11:07 | |
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has joined #shogun | 11:16 | |
-!- mode/#shogun [+o HeikoS] by ChanServ | 11:16 | |
@sukey | [https://github.com/shogun-toolbox/shogun] vigsterkr pushed 3 commits: | 11:21 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/0157b28f42ddccb03be1bbad5fa0c5ce1e5c5983 | 11:22 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/20e001acb547beb7c5baac6622d0eb7070f1de50 | 11:22 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/1539b6eb9b75d0e4d7607903662951604f11e818 | 11:22 |
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has joined #shogun | 11:24 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349719747 | 11:24 |
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has left #shogun [] | 11:24 | |
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has quit [Quit: Leaving.] | 11:25 | |
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has joined #shogun | 11:25 | |
-!- mode/#shogun [+o HeikoS] by ChanServ | 11:25 | |
-!- witness [uid10044@gateway/web/irccloud.com/x-rgmcgjjevyxnumdy] has quit [Quit: Connection closed for inactivity] | 11:25 | |
will_ | back now | 11:27 |
will_ | any luck wiking | 11:27 |
@wiking | sorry have to work on other stuff | 11:31 |
@wiking | but i'll get back asap | 11:31 |
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has quit [Ping timeout: 256 seconds] | 11:34 | |
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has joined #shogun | 11:43 | |
-!- mode/#shogun [+o HeikoS] by ChanServ | 11:43 | |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun | 12:12 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349742719 | 12:12 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun [] | 12:12 | |
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has joined #shogun | 12:23 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349742719 | 12:23 |
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has left #shogun [] | 12:23 | |
@sukey | [https://github.com/shogun-toolbox/shogun] vigsterkr pushed 3 commits: | 12:26 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/62877ed117ae3b6084df2a7587904318bf43d9f6 | 12:26 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/859d8ebb37cbb36af6e9152aade8fbdff8aeae5b | 12:26 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/c4c971a33d43c4e418c623bdd234d53e4cbd86db | 12:26 |
-!- HeikoS [~heiko@host86-132-201-109.range86-132.btcentralplus.com] has quit [Ping timeout: 245 seconds] | 13:14 | |
-!- travis-ci [~travis-ci@ec2-54-227-87-168.compute-1.amazonaws.com] has joined #shogun | 13:16 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349766729 | 13:16 |
-!- travis-ci [~travis-ci@ec2-54-227-87-168.compute-1.amazonaws.com] has left #shogun [] | 13:16 | |
@wiking | anybody knows whether ntfs is case sensitive? | 13:35 |
@sukey | [https://github.com/shogun-toolbox/shogun] vigsterkr pushed 3 commits: | 13:46 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/3af21674db408a2d31a68c63002ab9a083eb4ab8 | 13:46 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/4999692c2384cc31214035af76d1087c9bf688d7 | 13:46 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/6bdb1ec07d8b06e5eadf64777cd1aa8cbefc54aa | 13:46 |
@wiking | asdf for appveyor | 13:46 |
@sukey | [https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4168 synchronized by syashakash | 13:49 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun | 14:36 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349796615 | 14:36 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun [] | 14:36 | |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #shogun | 14:45 | |
travis-ci | it's Viktor Gal's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/349796615 | 14:45 |
-!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #shogun [] | 14:45 | |
@sukey | [https://github.com/shogun-toolbox/shogun] vigsterkr pushed 4 commits: | 14:47 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/727819c422fa646393ee2a9f5a1c6fdbf5e998eb | 14:47 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/e61dea2ba8b86a52eb51bcd6efd2a2f946580e75 | 14:47 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/fb916d6230569f48abded05ecdcdc34a1c817176 | 14:47 |
@sukey | https://github.com/shogun-toolbox/shogun/commit/e56963bbfa782f87c5cd799bda43add1cb56f41c | 14:47 |
will_ | wiking any update? | 14:49 |
@sukey | [https://github.com/shogun-toolbox/shogun] New commit https://github.com/shogun-toolbox/shogun/commit/86e33f0bb4d28781d75c819d29c583698e216d7f by vigsterkr | 14:49 |
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has joined #shogun | 14:58 | |
travis-ci | it's syashakash's turn to pay the next round of drinks for the massacre he caused in syashakash/shogun: https://travis-ci.org/syashakash/shogun/builds/349797551 | 14:58 |
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has left #shogun [] | 14:58 | |
@wiking | lisitsyn, http://danmux.com/posts/bazel_fawlty/ | 15:18 |
will_ | wiking | 15:18 |
@wiking | will_, sorry man have to prioritize things | 15:18 |
@wiking | will get back asap | 15:18 |
will_ | np | 15:19 |
will_ | how long you think | 15:19 |
lisitsyn | wiking: ha | 15:19 |
will_ | is there anything that comes to mind - e.g. a line i might need to add? | 15:19 |
@wiking | will_, cant give you a deadline | 15:19 |
@wiking | will_, i mean you can check here how the GD being used | 15:19 |
@wiking | will_, http://shogun.ml/notebook/latest/autoencoders.html | 15:19 |
will_ | thank you | 15:20 |
@wiking | will_, your epoch is very small | 15:26 |
@wiking | MLP.set_max_num_epochs(5) | 15:26 |
@wiking | is nothing | 15:26 |
@wiking | MLP.set_max_num_epochs(500) | 15:26 |
@wiking | should be doing something | 15:26 |
@wiking | or rather | 15:28 |
@wiking | set_gd_mini_batch_size is way too big | 15:29 |
-!- travis-ci [~travis-ci@ec2-54-227-87-168.compute-1.amazonaws.com] has joined #shogun | 15:29 | |
travis-ci | it's syashakash's turn to pay the next round of drinks for the massacre he caused in syashakash/shogun: https://travis-ci.org/syashakash/shogun/builds/349797551 | 15:29 |
-!- travis-ci [~travis-ci@ec2-54-227-87-168.compute-1.amazonaws.com] has left #shogun [] | 15:29 | |
@wiking | so for example with set_gd_mini_batch_size(20) and set_max_num_epochs(250) | 15:29 |
@wiking | the confusion matrix is getting better | 15:30 |
@wiking | ('Accuracy Score: ', 0.9027266028002948) | 15:30 |
will_ | oh yeah it was 200 originally | 15:31 |
will_ | i changed it to 5 to see if that made a difference | 15:31 |
will_ | ok i reduced mini batch size and it worked for me as well | 15:33 |
@wiking | k | 15:33 |
@wiking | plz upvote and accept the answer at SO | 15:33 |
@wiking | https://stackoverflow.com/questions/49119857/when-using-stochastic-gradient-descent-with-shogun-neuralnetwork-everything-cla/49133260#49133260 | 15:33 |
@wiking | thnx | 15:33 |
@wiking | :> | 15:33 |
will_ | thank you | 15:34 |
will_ | but i have a question | 15:34 |
@wiking | shoot | 15:35 |
will_ | so the reason i left that set at 200 is because in scikit-learn the default is min(200, sample_size) | 15:35 |
will_ | so i manually set it to 200 in scikit-learn and did not get that error | 15:35 |
will_ | but the data is exactly the same as is the other configurations | 15:35 |
@wiking | but the algo isn't | 15:36 |
@wiking | i mean it's not the same SGD | 15:36 |
@wiking | is it the same MLP? | 15:36 |
will_ | yeh | 15:36 |
@wiking | which one did u use? | 15:36 |
will_ | i think its just me being stupid tbh | 15:36 |
will_ | lol | 15:36 |
will_ | MLPClassifier | 15:36 |
@wiking | kk | 15:36 |
will_ | thanks for assisting with that | 15:36 |
@wiking | i'll try to check what's the thing with it | 15:36 |
@wiking | i'll mail you if i found something | 15:37 |
will_ | ok | 15:37 |
will_ | thanks | 15:37 |
will_ | sorry for bothering you haha sometimes its just good to have a second set of eyes | 15:37 |
will_ | i was staring at it thinking, what am i doing wrong? lol | 15:37 |
will_ | glad to have it resolved | 15:37 |
will_ | cheers mate | 15:37 |
@wiking | k | 15:38 |
-!- will_ [5862c914@gateway/web/freenode/ip.88.98.201.20] has quit [Quit: Page closed] | 15:41 | |
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has joined #shogun | 16:00 | |
travis-ci | it's Heiko Strathmann's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: https://travis-ci.org/shogun-toolbox/shogun/builds/348669708 | 16:00 |
-!- travis-ci [~travis-ci@ec2-54-224-23-145.compute-1.amazonaws.com] has left #shogun [] | 16:00 | |
-!- HeikoS [~heiko@untrust-out.swc.ucl.ac.uk] has joined #shogun | 16:55 | |
-!- mode/#shogun [+o HeikoS] by ChanServ | 16:55 | |
@HeikoS | lisitsyn: jojo | 18:18 |
@sukey | [https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4198 synchronized by karlnapf | 18:46 |
@sukey | [https://github.com/shogun-toolbox/shogun] Pull Request https://github.com/shogun-toolbox/shogun/pull/4198 synchronized by karlnapf | 19:14 |
-!- HeikoS [~heiko@untrust-out.swc.ucl.ac.uk] has quit [Ping timeout: 260 seconds] | 19:18 | |
--- Log closed Wed Mar 07 00:00:30 2018 |
Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!