| --- Log opened Fri Nov 01 00:00:05 2013 | ||
| @iglesiasg | so expensive is it? | 00:01 |
|---|---|---|
| @sonney2k | iglesiasg, no no we get 2k$ from google as starter package | 00:03 |
| @iglesiasg | aah | 00:04 |
| @iglesiasg | very kind these guys from Google :D | 00:04 |
| -!- HeikoS [~heiko@97e0a10b.skybroadband.com] has quit [Quit: Leaving.] | 00:41 | |
| -!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout] | 01:41 | |
| -!- iglesiasg [~iglesiasg@s83-179-44-135.cust.tele2.se] has quit [Quit: Leaving] | 02:03 | |
| -!- zxtx [~zv@129-79-241-148.dhcp-bl.indiana.edu] has quit [Ping timeout: 272 seconds] | 02:28 | |
| -!- sonne|osx_ [~sonne@f053040240.adsl.alicedsl.de] has joined #shogun | 03:52 | |
| -!- sonne|osx [~sonne@f053042175.adsl.alicedsl.de] has quit [Ping timeout: 246 seconds] | 03:52 | |
| -!- sonne|osx_ is now known as sonne|osx | 03:52 | |
| -!- zxtx [~zv@c-98-223-198-47.hsd1.in.comcast.net] has joined #shogun | 04:11 | |
| -!- sonne|osx [~sonne@f053040240.adsl.alicedsl.de] has quit [Quit: sonne|osx] | 07:28 | |
| -!- lisitsyn [~lisitsyn@80.252.20.67] has joined #shogun | 07:51 | |
| -!- sonne|osx [~sonne@89.204.153.206] has joined #shogun | 08:08 | |
| @wiking | sonne|osx: ok i'll have to work quite some time on being able to make a distributed webapp for cloud... ;P | 08:16 |
| @wiking | sonne|osx: as we'll need to be able to share the user instances<->container id mapping between the instances that can run docker | 08:17 |
| sonne|osx | wiking: well it would be cool. I guess we can get some sponsorship by our friends at google / amazon/ microsoft | 08:17 |
| sonne|osx | wiking: so some system that works transparently across those would be nice | 08:18 |
| @wiking | sonne|osx: well what we need basically is a webapp that serves the docker instances across various nodes | 08:18 |
| @wiking | taking in account the load on a given nodee | 08:18 |
| @wiking | *node | 08:18 |
| @wiking | that i guess could be a simple weighted round robin :P | 08:18 |
| sonne|osx | wiking: btw with HeikoS we discussed about the distributed stuff we wanted to do and it might be a GSoC project to do e.g. modelselection using azure/ec2/gcloud | 08:19 |
| @wiking | sonne|osx: well instances are now easy to setup | 08:19 |
| sonne|osx | wiking: only problem I see is how to get user data back and forth | 08:19 |
| @wiking | if one has docker | 08:19 |
| @wiking | sonne|osx: well hdfs | 08:19 |
| sonne|osx | wiking: so it writes to fatbot's hd? | 08:19 |
| @wiking | mmm wait | 08:21 |
| sonne|osx | wiking: errm and we should really do some backup of fatbot now | 08:21 |
| @wiking | sonne|osx: i thought you are speaking about distributed shogun stuff | 08:21 |
| @wiking | sonne|osx: because there the easiest is that u do a hdfs kind of stuff and there the nodes are r/w to hdfs | 08:22 |
| sonne|osx | wiking: no your cloud stuff but indeed hdfs would also fix things but no idea how this can work when your connection is rather limited (firewall?) | 08:22 |
| @wiking | sonne|osx: but with cloud it's not that big a deal | 08:23 |
| @wiking | sonne|osx: each node has it's own docker manager | 08:23 |
| @wiking | and the master node is just talking with these managers | 08:23 |
| sonne|osx | wiking: I am thinking about scenarios where you have a cluster and an entrance node | 08:23 |
| sonne|osx | and only the entrance node has direct network access | 08:23 |
| @wiking | and the master node is taking care between the userid<->docker instance id mapping | 08:23 |
| sonne|osx | everything else goes via the cluster | 08:23 |
| @wiking | sonne|osx: this is for distributed shogun? or cloud now? :) | 08:24 |
| sonne|osx | wiking: but how is stuff written then? | 08:24 |
| sonne|osx | haha | 08:24 |
| sonne|osx | that was for distributed shogun but what I just said about your stuff | 08:24 |
| @wiking | sonne|osx: what do you mean how is it written? | 08:25 |
| sonne|osx | sry gtg | 08:25 |
| sonne|osx | brb | 08:25 |
| -!- sonne|osx [~sonne@89.204.153.206] has quit [Quit: sonne|osx] | 08:25 | |
| sonne|work | wiking: I mean the data that people write when they change the notebook | 08:54 |
| sonne|work | wiking: how / where is this stored? | 08:54 |
| -!- iglesiasg [~iglesiasg@s83-179-44-135.cust.tele2.se] has joined #shogun | 09:12 | |
| -!- mode/#shogun [+o iglesiasg] by ChanServ | 09:12 | |
| @iglesiasg | good morning! | 09:14 |
| -!- shogun-toolbox [~shogun@7nn.de] has quit [Ping timeout: 256 seconds] | 09:55 | |
| --- Log closed Fri Nov 01 09:55:14 2013 | ||
| --- Log opened Fri Nov 01 09:55:23 2013 | ||
| -!- shogun-t1olbox [~shogun@7nn.de] has joined #shogun | 09:55 | |
| -!- Irssi: #shogun: Total of 13 nicks [3 ops, 0 halfops, 0 voices, 10 normal] | 09:55 | |
| !sendak.freenode.net [freenode-info] channel trolls and no channel staff around to help? please check with freenode support: http://freenode.net/faq.shtml#gettinghelp | 09:55 | |
| -!- Irssi: Join to #shogun was synced in 8 secs | 09:55 | |
| -!- Netsplit *.net <-> *.split quits: shogun-toolbox | 09:58 | |
| -!- iglesiasg [~iglesiasg@s83-179-44-135.cust.tele2.se] has quit [Quit: Leaving] | 11:30 | |
| @wiking | sonne|work: ah that's in aufs | 11:54 |
| sonne|work | wiking: aufs? | 11:56 |
| @wiking | sonne|work: http://en.wikipedia.org/wiki/Aufs | 12:09 |
| sonne|work | wiking: but how do you sync that if you would run stuff on some google cloud machine ? | 12:10 |
| @wiking | :) | 12:10 |
| @wiking | i do not have an answer for that | 12:11 |
| -!- iglesiasg [~iglesiasg@s83-179-44-135.cust.tele2.se] has joined #shogun | 12:50 | |
| -!- mode/#shogun [+o iglesiasg] by ChanServ | 12:50 | |
| -!- iglesiasg [~iglesiasg@s83-179-44-135.cust.tele2.se] has quit [Quit: Leaving] | 13:34 | |
| sonne|work | wiking: care to share? | 13:44 |
| @wiking | what? | 13:47 |
| -!- iglesiasg [~iglesias@2001:6b0:1:1da0:e4f8:8e29:a992:b7df] has joined #shogun | 14:13 | |
| -!- mode/#shogun [+o iglesiasg] by ChanServ | 14:13 | |
| -!- HeikoS [~heiko@pat-191-250.internal.eduroam.ucl.ac.uk] has joined #shogun | 15:04 | |
| -!- mode/#shogun [+o HeikoS] by ChanServ | 15:04 | |
| sonne|work | HeikoS: hey! | 15:06 |
| sonne|work | HeikoS: does it work now? | 15:06 |
| @HeikoS | sonne|work: hi! I have my other computer now | 15:07 |
| @HeikoS | could you send me the git link again? | 15:07 |
| @HeikoS | will try it here then and put it into my dropbox | 15:07 |
| @HeikoS | otherwise I will try tomorrow from home | 15:08 |
| sonne|work | HeikoS: no idea :D | 15:08 |
| sonne|work | so try it from home | 15:08 |
| -!- HeikoS [~heiko@pat-191-250.internal.eduroam.ucl.ac.uk] has quit [Client Quit] | 15:09 | |
| -!- HeikoS [~heiko@pat-191-250.internal.eduroam.ucl.ac.uk] has joined #shogun | 15:13 | |
| -!- mode/#shogun [+o HeikoS] by ChanServ | 15:13 | |
| @HeikoS | sonney2k: finally got an encrypted folder in my dropbox for all the key stuff, you convinced me! | 15:14 |
| @HeikoS | sonne|work: will check the git from home then | 15:14 |
| -!- zxtx [~zv@c-98-223-198-47.hsd1.in.comcast.net] has quit [Ping timeout: 259 seconds] | 16:18 | |
| -!- lisitsyn [~lisitsyn@80.252.20.67] has quit [Quit: Leaving.] | 16:37 | |
| -!- zxtx [~zv@129-79-241-148.dhcp-bl.indiana.edu] has joined #shogun | 17:10 | |
| -!- shogun-notifier- [~irker@7nn.de] has joined #shogun | 17:16 | |
| shogun-notifier- | shogun-web: Fernando Iglesias :master * d000999 / static/workshop/2013/keynote.pdf: https://github.com/shogun-toolbox/shogun-web/commit/d00099954cab9cca05a2b656b9d9fccedaaffc07 | 17:16 |
| shogun-notifier- | shogun-web: Add Gunnar's slides from workshop 2013 | 17:16 |
| shogun-notifier- | shogun-web: Fernando Iglesias :master * 55289fd / static/workshop/2013/keynote.pdf: https://github.com/shogun-toolbox/shogun-web/commit/55289fdc8a29e388c2216fb604fb21b22d6c9afa | 17:16 |
| shogun-notifier- | shogun-web: Merge pull request #36 from iglesias/master | 17:16 |
| shogun-notifier- | shogun-web: | 17:16 |
| shogun-notifier- | shogun-web: Add Gunnar's slides from workshop 2013 | 17:16 |
| -!- sonne|osx [~sonne@82.113.99.211] has joined #shogun | 17:19 | |
| sonne|osx | wiking: what do you think should I try to get some free EC2's? | 17:21 |
| @wiking | sonne|osx: well if gcloud is not yet ready :P | 17:22 |
| @wiking | but the more the merier | 17:22 |
| @wiking | as they say | 17:22 |
| sonne|osx | wiking: azure's too? | 17:22 |
| @wiking | mmm whatever is possible for free :P | 17:22 |
| sonne|osx | wiking: you know - I know a couple of people so I might as well ask... | 17:22 |
| sonne|osx | kk | 17:23 |
| @wiking | go ahead :) | 17:23 |
| shogun-notifier- | shogun: Koen van de Sande :develop * de423c2 / / (6 files): https://github.com/shogun-toolbox/shogun/commit/de423c217990f6374f5f9f98b3ce0345daa07bda | 17:25 |
| shogun-notifier- | shogun: Fix overflow of 32-bit signed integers when multiplying two 32-bit integers: cast to 64-bit integers first, otherwise matrices with number of elements > 2^31 (e.g. a 48,000x48,000 custom kernel matrix) will not work. | 17:25 |
| shogun-notifier- | shogun: Koen van de Sande :develop * 466d2ee / xiqdjx4p.sem.txt: https://github.com/shogun-toolbox/shogun/commit/466d2ee48b4a206e873d79eb6327804bf0ba66d9 | 17:25 |
| shogun-notifier- | shogun: Accidental file included | 17:26 |
| shogun-notifier- | shogun: Koen van de Sande :develop * a3f81b7 / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/a3f81b70eccc8a5b6921f725874365cd24e35c75 | 17:26 |
| shogun-notifier- | shogun: Clang will not take int64_t as an index into a vector, add [] for int64_t in SGVector | 17:26 |
| shogun-notifier- | shogun: Koen van de Sande :develop * 6533afb / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/6533afbea3dc79d02c2f6a3459d532b9505a68b9 | 17:26 |
| shogun-notifier- | shogun: Need a third operator[] | 17:26 |
| shogun-notifier- | shogun: | 17:26 |
| shogun-notifier- | shogun: Because the uint32_t used to index vectors elsewhere now cannot choose | 17:26 |
| shogun-notifier- | shogun: between index_t and int64_t (before it only had the choice of | 17:26 |
| shogun-notifier- | shogun: index_t=int32_t) | 17:26 |
| shogun-notifier- | shogun: Koen van de Sande :develop * 2168003 / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/21680032da57bbd9e4ad0e80f93d2c47788885a3 | 17:26 |
| shogun-notifier- | shogun: Other try to fix ambiguities: a single operator[] with int64_t | 17:26 |
| shogun-notifier- | shogun: Soeren Sonnenburg :develop * 64dc831 / src/shogun/lib/ (6 files): https://github.com/shogun-toolbox/shogun/commit/64dc831f2ebaf7b0dad8d596a965f23fb319d0ad | 17:26 |
| shogun-notifier- | shogun: Merge pull request #1731 from koenvandesande/fix_index_t_overflows | 17:26 |
| shogun-notifier- | shogun: | 17:26 |
| shogun-notifier- | shogun: Fix overflows of index_t for large matrices | 17:26 |
| @iglesiasg | all right, Gunnar's slides from the workshop are in the webpage now | 17:26 |
| @iglesiasg | one missing :) | 17:26 |
| @wiking | mine i know | 17:27 |
| shogun-notifier- | shogun: Soeren Sonnenburg :develop * d51d89e / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/d51d89eb12763291036afb5b8ce25a3def166846 | 17:28 |
| shogun-notifier- | shogun: add int32_t / uint32_t SGVector access functions | 17:28 |
| sonne|osx | iglesiasg: increadible | 17:28 |
| sonne|osx | iglesiasg: could you please make the video page the default for the workshop? | 17:29 |
| sonne|osx | iglesiasg: if I click here http://shogun-toolbox.org/page/Events/workshop2013 | 17:29 |
| @iglesiasg | sonne|osx, mm I think we talked already about that. You mean to click on Workshop 2013 and that videos appear directly | 17:29 |
| sonne|osx | it doesn't select videos | 17:29 |
| sonne|osx | iglesiasg: yes | 17:29 |
| sonne|osx | iglesiasg: you did it in a way that when you click on events that the workshop & videos are activated | 17:30 |
| @iglesiasg | sonne|osx, ok but then, when is the stuff that is currently shown in in that page shown? | 17:30 |
| sonne|osx | but not the rest | 17:30 |
| sonne|osx | iglesiasg: ahh true | 17:30 |
| @iglesiasg | sonne|osx, one possibility is to show one video in the current small article called video recordings | 17:31 |
| @iglesiasg | just so that the thumbnail is directly seen when clicking on Workshop 2013 | 17:31 |
| sonne|osx | iglesiasg: yeah these certainly need *PICTURES* | 17:31 |
| sonne|osx | boring to watch | 17:31 |
| sonne|osx | wiking: about the cloud thing - is all of that in the shogun-cloud repo? | 17:31 |
| sonne|osx | wiking: I mean templates too? | 17:32 |
| sonne|osx | wiking: I would want to create some image matrix with all the notebooks we have | 17:32 |
| sonne|osx | wiking: and then put them on http://cloud.shogun-toolbox.org/ | 17:32 |
| sonne|osx | to have the same thing we have on our homepage but more condensed | 17:33 |
| shogun-buildbot | build #2435 of deb1 - libshogun is complete: Failure [failed compile] Build details are at http://buildbot.shogun-toolbox.org/builders/deb1%20-%20libshogun/builds/2435 blamelist: Soeren Sonnenburg <sonne@debian.org>, Koen van de Sande <koen@tibed.net> | 17:37 |
| -!- sonne|osx [~sonne@82.113.99.211] has quit [Quit: sonne|osx] | 17:40 | |
| shogun-buildbot | build #1926 of bsd1 - libshogun is complete: Failure [failed test] Build details are at http://buildbot.shogun-toolbox.org/builders/bsd1%20-%20libshogun/builds/1926 blamelist: Koen van de Sande <koen@tibed.net> | 17:47 |
| @wiking | sonne|work: yep | 17:55 |
| -!- iglesiasg [~iglesias@2001:6b0:1:1da0:e4f8:8e29:a992:b7df] has quit [Quit: Ex-Chat] | 17:55 | |
| -!- travis-ci [~travis-ci@ec2-54-211-90-234.compute-1.amazonaws.com] has joined #shogun | 18:22 | |
| travis-ci | [travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/13371348 | 18:22 |
| -!- travis-ci [~travis-ci@ec2-54-211-90-234.compute-1.amazonaws.com] has left #shogun [] | 18:22 | |
| -!- thoralf [~thoralf@enki.zib.de] has quit [Quit: Konversation terminated!] | 18:23 | |
| shogun-buildbot | build #2002 of deb3 - modular_interfaces is complete: Failure [failed test ruby modular] Build details are at http://buildbot.shogun-toolbox.org/builders/deb3%20-%20modular_interfaces/builds/2002 blamelist: Koen van de Sande <koen@tibed.net> | 19:00 |
| @sonney2k | wiking, HeikoS good news from Gunnar! | 19:43 |
| @sonney2k | he intends to have a project developing software (ml algorithms...) that we don't yet have in shogun and that would be integrated at some point by his group | 19:43 |
| @HeikoS | sonney2k: very nice! | 19:48 |
| @HeikoS | going home. see you tomorrow! | 19:48 |
| -!- HeikoS [~heiko@pat-191-250.internal.eduroam.ucl.ac.uk] has quit [Quit: Leaving.] | 19:48 | |
| shogun-notifier- | shogun: Soeren Sonnenburg :develop * 4157057 / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/415705786bc1b0c17378f900110d7af16691d386 | 20:13 |
| shogun-notifier- | shogun: add uint64_t index for access | 20:13 |
| shogun-buildbot | build #2436 of deb1 - libshogun is complete: Failure [failed compile] Build details are at http://buildbot.shogun-toolbox.org/builders/deb1%20-%20libshogun/builds/2436 blamelist: Soeren Sonnenburg <sonne@debian.org> | 20:16 |
| shogun-notifier- | shogun: Soeren Sonnenburg :develop * e507019 / src/shogun/lib/SGVector.h: https://github.com/shogun-toolbox/shogun/commit/e5070190f505b4aaaa60e9b5aaa744932fd14489 | 20:20 |
| shogun-notifier- | shogun: missing uint64_t access | 20:20 |
| shogun-buildbot | build #2437 of deb1 - libshogun is complete: Failure [failed compile] Build details are at http://buildbot.shogun-toolbox.org/builders/deb1%20-%20libshogun/builds/2437 blamelist: Soeren Sonnenburg <sonne@debian.org> | 20:24 |
| -!- travis-ci [~travis-ci@ec2-54-242-163-71.compute-1.amazonaws.com] has joined #shogun | 20:31 | |
| travis-ci | [travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/13378556 | 20:31 |
| -!- travis-ci [~travis-ci@ec2-54-242-163-71.compute-1.amazonaws.com] has left #shogun [] | 20:31 | |
| -!- FSCV [~FSCV@50.7.50.60] has joined #shogun | 20:37 | |
| -!- travis-ci [~travis-ci@ec2-54-242-163-71.compute-1.amazonaws.com] has joined #shogun | 20:45 | |
| travis-ci | [travis-ci] it's Soeren Sonnenburg's turn to pay the next round of drinks for the massacre he caused in shogun-toolbox/shogun: http://travis-ci.org/shogun-toolbox/shogun/builds/13378882 | 20:45 |
| -!- travis-ci [~travis-ci@ec2-54-242-163-71.compute-1.amazonaws.com] has left #shogun [] | 20:45 | |
| -!- lisitsyn [~lisitsyn@109-226-82-69.clients.tlt.100megabit.ru] has joined #shogun | 20:57 | |
| lisitsyn | sonney2k: is it just some project that is going to be merged at some point or what? | 21:03 |
| -!- iglesiasg [53b32c87@gateway/web/freenode/ip.83.179.44.135] has joined #shogun | 21:06 | |
| iglesiasg | hey | 21:06 |
| iglesiasg | sonney2k: so what are these algorithms that Gunnar's people are working on about? | 21:06 |
| lisitsyn | iglesiasg: yeah I am interested too ;) | 21:09 |
| iglesiasg | lisitsyn: cool! So do you know something about it? | 21:09 |
| lisitsyn | iglesiasg: no | 21:09 |
| iglesiasg | Just out of curiosity | 21:09 |
| iglesiasg | all right, let's see what we find out then :) | 21:09 |
| -!- iglesiasg [53b32c87@gateway/web/freenode/ip.83.179.44.135] has quit [Quit: Page closed] | 22:07 | |
| -!- FSCV [~FSCV@50.7.50.60] has quit [Quit: Leaving] | 22:52 | |
| -!- shogun-notifier- [~irker@7nn.de] has quit [Quit: transmission timeout] | 23:20 | |
| -!- HeikoS [~androirc@97e0a10b.skybroadband.com] has joined #shogun | 23:32 | |
| -!- mode/#shogun [+o HeikoS] by ChanServ | 23:32 | |
| @HeikoS | HeikoS, . | 23:34 |
| --- Log closed Sat Nov 02 00:00:07 2013 | ||
Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!