| --- Log opened Tue Nov 05 00:00:11 2013 | ||
| -!- pickle27 [~kevin@24-212-221-132.cable.teksavvy.com] has joined #shogun | 00:06 | |
| -!- zxtx [~zv@129-79-241-148.dhcp-bl.indiana.edu] has quit [Ping timeout: 268 seconds] | 00:11 | |
| -!- pickle27 [~kevin@24-212-221-132.cable.teksavvy.com] has left #shogun [] | 00:13 | |
| -!- shogun-notifier- [~irker@7nn.de] has joined #shogun | 00:30 | |
| shogun-notifier- | shogun: Fernando Iglesias :develop * ae23d41 / doc/ipython-notebooks/statistics/mmd_two_sample_testing.ipynb: https://github.com/shogun-toolbox/shogun/commit/ae23d415f4286b8abc9b9cf161f35539003500d8 | 00:30 |
|---|---|---|
| shogun-notifier- | shogun: Shorter abstract in hypothesis testing notebook | 00:30 |
| shogun-notifier- | shogun: so that it fits better into the website | 00:30 |
| shogun-notifier- | shogun: Fernando Iglesias :develop * efc1c8c / doc/ipython-notebooks/statistics/mmd_two_sample_testing.ipynb: https://github.com/shogun-toolbox/shogun/commit/efc1c8c351160ff7975937f454c36044db433f1c | 00:30 |
| shogun-notifier- | shogun: Merge pull request #1749 from iglesias/develop | 00:30 |
| shogun-notifier- | shogun: | 00:30 |
| shogun-notifier- | shogun: Shorter abstract in hypothesis testing notebook | 00:30 |
| shogun-buildbot | build #1931 of bsd1 - libshogun is complete: Failure [failed test] Build details are at http://buildbot.shogun-toolbox.org/builders/bsd1%20-%20libshogun/builds/1931 blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com> | 00:41 |
| shogun-buildbot | build #1932 of bsd1 - libshogun is complete: Success [build successful] Build details are at http://buildbot.shogun-toolbox.org/builders/bsd1%20-%20libshogun/builds/1932 | 00:46 |
| -!- zxtx [~zv@c-98-223-198-47.hsd1.in.comcast.net] has joined #shogun | 00:51 | |
| -!- travis-ci [~travis-ci@ec2-184-72-203-210.compute-1.amazonaws.com] has joined #shogun | 01:18 | |
| travis-ci | [travis-ci] it's Fernando Iglesias's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/13498921 | 01:18 |
| -!- travis-ci [~travis-ci@ec2-184-72-203-210.compute-1.amazonaws.com] has left #shogun [] | 01:18 | |
| shogun-buildbot | build #103 of clang34 - undefined behaviour analysis is complete: Failure [failed test] Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20undefined%20behaviour%20analysis/builds/103 blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com> | 01:33 |
| -!- iglesiasg [~iglesias@s83-179-44-135.cust.tele2.se] has quit [Quit: Ex-Chat] | 01:35 | |
| shogun-buildbot | build #102 of clang34 - thread analysis is complete: Failure [failed test] Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20thread%20analysis/builds/102 blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com> | 01:49 |
| -!- Netsplit *.net <-> *.split quits: lisitsyn | 01:58 | |
| -!- Netsplit over, joins: lisitsyn | 01:59 | |
| shogun-buildbot | build #121 of clang34 - static analysis is complete: Failure [failed analyse] Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20static%20analysis/builds/121 blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com> | 02:31 |
| shogun-buildbot | build #104 of clang34 - undefined behaviour analysis is complete: Failure [failed test] Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20undefined%20behaviour%20analysis/builds/104 blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com> | 02:42 |
| shogun-buildbot | build #103 of clang34 - thread analysis is complete: Failure [failed test] Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20thread%20analysis/builds/103 blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com> | 02:57 |
| -!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout] | 03:30 | |
| shogun-buildbot | build #122 of clang34 - static analysis is complete: Failure [failed analyse] Build details are at http://buildbot.shogun-toolbox.org/builders/clang34%20-%20static%20analysis/builds/122 blamelist: Fernando Iglesias <fernando.iglesiasg@gmail.com> | 03:41 |
| -!- benibadman [~benibadma@port-92-206-52-177.dynamic.qsc.de] has joined #shogun | 07:05 | |
| -!- benibadman [~benibadma@port-92-206-52-177.dynamic.qsc.de] has quit [Remote host closed the connection] | 07:05 | |
| -!- benibadman [~benibadma@port-92-206-52-177.dynamic.qsc.de] has joined #shogun | 07:05 | |
| -!- benibadman [~benibadma@port-92-206-52-177.dynamic.qsc.de] has quit [Ping timeout: 245 seconds] | 07:10 | |
| -!- benibadman [~benibadma@port-92-206-52-177.dynamic.qsc.de] has joined #shogun | 07:31 | |
| -!- benibadman [~benibadma@port-92-206-52-177.dynamic.qsc.de] has quit [Remote host closed the connection] | 07:54 | |
| -!- benibadman [~benibadma@port-92-206-52-177.dynamic.qsc.de] has joined #shogun | 07:54 | |
| -!- benibadman [~benibadma@port-92-206-52-177.dynamic.qsc.de] has quit [Ping timeout: 240 seconds] | 07:59 | |
| -!- sonne|osx [~sonne@89.204.139.126] has joined #shogun | 08:19 | |
| sonne|osx | besser82: whats up? | 08:20 |
| -!- sonne|osx [~sonne@89.204.139.126] has quit [Quit: sonne|osx] | 08:35 | |
| -!- lisitsyn1 [~lisitsin@mxs.kg.ru] has joined #shogun | 08:55 | |
| -!- benibadman [~benibadma@94.135.236.129] has joined #shogun | 09:01 | |
| -!- new_lido [~walid@41.218.173.235] has joined #shogun | 09:02 | |
| -!- benibadman [~benibadma@94.135.236.129] has quit [Remote host closed the connection] | 09:02 | |
| -!- benibadman [~benibadma@94.135.236.129] has joined #shogun | 09:03 | |
| -!- sonne|work [~sonnenbu@24-134-74-216-dynip.superkabel.de] has quit [Quit: Leaving.] | 09:29 | |
| -!- sonne|work [~sonnenbu@24-134-74-216-dynip.superkabel.de] has joined #shogun | 09:48 | |
| -!- new_lido [~walid@41.218.173.235] has quit [Ping timeout: 264 seconds] | 09:53 | |
| -!- new_lido [~walid@41.218.181.144] has joined #shogun | 10:07 | |
| -!- benibadm_ [~benibadma@94.135.236.129] has joined #shogun | 10:11 | |
| -!- benibadm_ [~benibadma@94.135.236.129] has quit [Remote host closed the connection] | 10:12 | |
| -!- benibadman [~benibadma@94.135.236.129] has quit [Ping timeout: 246 seconds] | 10:15 | |
| -!- iglesiasg [~iglesias@2001:6b0:1:1da0:2089:9fad:841f:6fd9] has joined #shogun | 10:44 | |
| -!- mode/#shogun [+o iglesiasg] by ChanServ | 10:44 | |
| -!- lisitsyn1 [~lisitsin@mxs.kg.ru] has quit [Quit: Leaving.] | 12:32 | |
| -!- Saurabh7 [~Saurabh7@115.248.130.148] has joined #shogun | 13:21 | |
| -!- new_lido [~walid@41.218.181.144] has quit [Quit: Leaving] | 13:52 | |
| -!- taylan [d5f4a885@gateway/web/freenode/ip.213.244.168.133] has joined #shogun | 14:06 | |
| taylan | Hi All, | 14:07 |
| taylan | Does any body know the role of directors? | 14:07 |
| taylan | Can't we extend regular classes, ie. ContingencyTableEvaluation instrad of DirectorContingencyTableEvaluation | 14:08 |
| taylan | A second question, I want to use an external evaluation, depending on the input dataset. Does set_indices function do what I want? i.e if I pass some cost annotation to the dataset, can I use the indices set by set_indices to access those global annotations? | 14:11 |
| @iglesiasg | hey taylan | 14:25 |
| @iglesiasg | taylan, regarding the director classes, the use case is more complex than that. They are useful to extend functionality of the libshogun interface using a modular interface | 14:26 |
| @iglesiasg | taylan, so that, for example, code that you have implemented in a modular interface like Python can be called from anywhere in the libshogun interface | 14:27 |
| taylan | ah, ok..so I don't need the directors for extending the class in python.. | 14:28 |
| taylan | Thank you for the answer..you got any clues for me for the second question? | 14:29 |
| taylan | Sorry, the question should be like this: If I pass some cost annotation to the evaluation class, can I use the indices set by set_indices to access those global annotations? | 14:30 |
| @iglesiasg | Mm, I am sorry but I don't think I get the point | 14:31 |
| taylan | ok, so instead of evaluating my classifier performance with the existing evaluators, I want to extend the Evaluation class, passing some costs for each label. This means, some samples are more costly to wrongly classify, and some are less.. | 14:34 |
| @iglesiasg | all right | 14:34 |
| @iglesiasg | so I have never done this myself using Shogun directly but I would bet there must be something for sure to do this | 14:35 |
| @iglesiasg | since it is something quite common | 14:35 |
| taylan | so I was wondering whether the set_indices method was passing me the real indices of the labels. This is most probably the case, I just wanted to make sure.. | 14:36 |
| taylan | ok, I will anyway give it a try and write back here. | 14:36 |
| @iglesiasg | sure, try it better | 14:37 |
| @iglesiasg | in case you don't get an answer about it right, I suggest you to send a mail to the mailing list | 14:37 |
| @iglesiasg | Heiko should be able to explain this without a trouble, he implemented this part I think | 14:37 |
| taylan | ok, thanks a lot! | 14:48 |
| @iglesiasg | taylan, no problem, you are welcome! | 14:51 |
| -!- thoralf [~thoralf@enki.zib.de] has joined #shogun | 15:16 | |
| thoralf | Heyho. | 15:17 |
| -!- benibadman [~benibadma@94.135.236.129] has joined #shogun | 15:19 | |
| @wiking | yo | 15:20 |
| sonne|work | wiking: another question | 15:30 |
| sonne|work | wiking: I want to display the images from the slide thing on the cloud website | 15:30 |
| sonne|work | wiking: problem is that we need the notebook directory somewhere | 15:31 |
| sonne|work | on the cloud server | 15:31 |
| sonne|work | I mean the pre-rendered ones | 15:31 |
| sonne|work | so I can automagically extract the images | 15:31 |
| @wiking | sonne|work: images? | 15:32 |
| sonne|work | wiking: the thumbnails we have in the slide thing at the bottom | 15:32 |
| @wiking | sonne|work: so you want to actually add the prerendered images? | 15:32 |
| sonne|work | wiking: so you can just click on them | 15:33 |
| @wiking | click on them where? | 15:33 |
| sonne|work | and that would open the notebook | 15:33 |
| sonne|work | wiking: cloud.* | 15:33 |
| @wiking | ah before login? | 15:33 |
| @wiking | at the login page? | 15:33 |
| sonne|work | instead of this login window you would see as main page the notebook | 15:33 |
| sonne|work | basically just the images in a grid | 15:33 |
| @wiking | and then a login on the button? | 15:34 |
| sonne|work | yeah | 15:34 |
| @wiking | *buttom | 15:34 |
| sonne|work | bottom | 15:34 |
| sonne|work | yes | 15:34 |
| @wiking | mmm | 15:34 |
| @wiking | ok well modify the template | 15:34 |
| sonne|work | ? | 15:34 |
| @wiking | index.html is the template for the login page | 15:34 |
| sonne|work | I know | 15:34 |
| sonne|work | I started doing this already | 15:34 |
| @wiking | so just modify it and that's all | 15:34 |
| sonne|work | no | 15:34 |
| sonne|work | it is not all | 15:35 |
| @wiking | why not? | 15:35 |
| sonne|work | I need the prerendered notebooks | 15:35 |
| @wiking | it's on the shogun website | 15:35 |
| @wiking | static/.. | 15:35 |
| sonne|work | that doesn't help | 15:35 |
| @wiking | why not? | 15:35 |
| sonne|work | we need them locally on the machine running cloud.* | 15:35 |
| @wiking | why? | 15:35 |
| sonne|work | because I parse the notebooks and extract the images from them | 15:36 |
| @wiking | i mean you can add an <img src="whatever" /> | 15:36 |
| sonne|work | no static image | 15:36 |
| @wiking | why would it be a non-static | 15:36 |
| sonne|work | wiking: well it is like this on www.* etc too | 15:37 |
| @wiking | so? | 15:37 |
| sonne|work | I need the notebooks | 15:37 |
| sonne|work | that is all | 15:37 |
| @wiking | jquery | 15:37 |
| @wiking | ? | 15:38 |
| sonne|work | ?? | 15:38 |
| @wiking | fetch the notebook and parse it with jquery | 15:38 |
| @wiking | the preprendered ipynb + html is available | 15:38 |
| @wiking | on www. | 15:38 |
| @wiking | just fetch it with jquery | 15:38 |
| sonne|work | you want some dependency on www.* on cloud.* ? | 15:38 |
| sonne|work | is that clever? | 15:38 |
| @wiking | what's the problem? | 15:38 |
| sonne|work | wiking: the dependency that is all | 15:49 |
| sonne|work | wiking: you need www.* to work - if it is down you don't have cloud.* working | 15:50 |
| -!- lisitsyn [~lisitsyn@80.252.20.67] has quit [Ping timeout: 245 seconds] | 16:07 | |
| -!- lisitsyn [~lisitsyn@80.252.20.67] has joined #shogun | 16:11 | |
| thoralf | When using the python_modular interface, is there anything I need to consider to avoid memory leaks? | 16:26 |
| thoralf | It seems like me programm is heavily leaking memory (using liblinear in a loop) | 16:26 |
| sonne|work | thoralf: errm it shouldn't what are youdoing? | 16:30 |
| sonne|work | in any case w/ python | 16:30 |
| sonne|work | del object | 16:30 |
| sonne|work | as often as possible... | 16:30 |
| sonne|work | well early | 16:30 |
| thoralf | sonne|work: I'm loading a big data file (csc matrix) and creating sparse features + labels. Running a loop hundreds of times on the same data - and already "del predicted_labels" and "del svm" after every run. | 16:32 |
| thoralf | resource.struct_rusage().ru_maxrss grows by 400-500 MB in every iteration. | 16:32 |
| sonne|work | thoralf: well only chance is to do some valgrind thing on a small data set to check if there is no leak | 16:33 |
| thoralf | sonne|work: Okay, I thought I possibly did something stupid and could avoid valgrind... | 16:34 |
| thoralf | Thanks ;) | 16:34 |
| sonne|work | thoralf: I am not aware of a leak in liblinear / sparse etc | 16:35 |
| sonne|work | so no idea | 16:35 |
| -!- taylan [d5f4a885@gateway/web/freenode/ip.213.244.168.133] has quit [Ping timeout: 250 seconds] | 16:39 | |
| -!- Saurabh7 [~Saurabh7@115.248.130.148] has quit [Ping timeout: 268 seconds] | 16:43 | |
| -!- zxtx [~zv@c-98-223-198-47.hsd1.in.comcast.net] has quit [Ping timeout: 246 seconds] | 17:12 | |
| -!- taylan [d5f4a885@gateway/web/freenode/ip.213.244.168.133] has joined #shogun | 17:22 | |
| -!- benibadman [~benibadma@94.135.236.129] has quit [Remote host closed the connection] | 17:27 | |
| -!- iglesiasg [~iglesias@2001:6b0:1:1da0:2089:9fad:841f:6fd9] has quit [Quit: Ex-Chat] | 17:31 | |
| -!- sonne|osx [~sonne@89.204.130.113] has joined #shogun | 17:56 | |
| -!- zxtx [~zv@129-79-241-148.dhcp-bl.indiana.edu] has joined #shogun | 17:58 | |
| -!- sonne|osx [~sonne@89.204.130.113] has quit [Quit: sonne|osx] | 18:07 | |
| @wiking | thoralf: u in tuberlin? | 19:08 |
| thoralf | wiking: No, Zuse-Institute-Berlin | 19:08 |
| -!- sonne|osx [~sonne@f053044146.adsl.alicedsl.de] has joined #shogun | 19:26 | |
| thoralf | sonne|work: Maybe you can tell me whats wrong: https://github.com/shogun-toolbox/shogun/issues/1750 | 19:26 |
| thoralf | Hey sonne|osx | 19:27 |
| thoralf | sonne|osx: I can reproduce the leak in a minimal example. | 19:28 |
| @wiking | thoralf: oh man i thought that that leak was fixed already | 19:34 |
| thoralf | wiking: So it's already known? Do you maybe know a hotfix for this? | 19:37 |
| @wiking | thoralf: i've fixed this | 19:38 |
| @wiking | but now i've realised | 19:38 |
| @wiking | that actually it wasn't this | 19:38 |
| @wiking | :( | 19:38 |
| @wiking | it was in multimachine | 19:38 |
| @wiking | letmecheck | 19:38 |
| @wiking | maybe the same thing happened ther | 19:38 |
| @wiking | oh man this looks weird | 19:40 |
| @wiking | thoralf: i guess u haven't tried with c++ | 19:40 |
| thoralf | wiking: I'm about to... | 19:41 |
| thoralf | wiking: Hmm. I don't need to. I've been using LibLinear all the time, I'm memchecking all my programs, so either new or it should be working in c++ | 19:44 |
| -!- sonne|osx [~sonne@f053044146.adsl.alicedsl.de] has quit [Quit: sonne|osx] | 19:49 | |
| -!- sonne|osx [~sonne@f053044146.adsl.alicedsl.de] has joined #shogun | 20:01 | |
| thoralf | wiking: All heap blocks were freed -- no leaks are possible | 20:18 |
| -!- sonne|osx [~sonne@f053044146.adsl.alicedsl.de] has quit [Quit: sonne|osx] | 20:24 | |
| -!- FSCV [~FSCV@50.7.50.60] has joined #shogun | 23:12 | |
| --- Log closed Wed Nov 06 00:00:12 2013 | ||
Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!