--- Log opened Fri Aug 26 00:00:25 2011 | ||
blackburn | where is CIA | 01:25 |
---|---|---|
CIA-87 | shogun: Sergey Lisitsyn master * r420fce1 / (2 files): Plif fixes - http://git.io/pK0HpQ | 01:25 |
CIA-87 | shogun: Sergey Lisitsyn master * rc31b795 / (2 files): Improved CDistance parallel implementation - http://git.io/P-Uc2g | 01:25 |
-!- blackburn [~blackburn@31.28.45.83] has quit [Quit: Leaving.] | 01:39 | |
-!- f-x [~user@117.192.214.159] has joined #shogun | 01:49 | |
-!- f-x` [~user@117.192.214.159] has joined #shogun | 04:23 | |
-!- f-x [~user@117.192.214.159] has quit [Ping timeout: 260 seconds] | 04:25 | |
CIA-87 | shogun: Soeren Sonnenburg master * r0a8fcea / src/interfaces/modular/modshogun_ignores.i : fix swig java syntax error? - http://git.io/fmvRnA | 06:43 |
CIA-87 | shogun: Soeren Sonnenburg master * r759fabb / (2 files in 2 dirs): add make check-examples-ruby_modular target - http://git.io/PD_84Q | 06:43 |
CIA-87 | shogun: Soeren Sonnenburg master * r443fa3e / (src/configure src/interfaces/modular/modshogun_ignores.i): comment the == ignore line as java_modular chokes on it - http://git.io/7KiZ9g | 08:59 |
@sonney2k | serialhex, ping ping | 09:02 |
CIA-87 | shogun: Soeren Sonnenburg master * r14bccf1 / examples/undocumented/csharp_modular/check.sh : improve check.sh to take arguments with scripts to be tested - http://git.io/iD-bfw | 09:31 |
CIA-87 | shogun: Soeren Sonnenburg master * rb17f07e / src/interfaces/modular/modshogun_ignores.i : temporarily disable all ignores of operators - http://git.io/lxl0Ag | 09:31 |
CIA-87 | shogun: Soeren Sonnenburg master * ref7f6a3 / src/configure : | 10:45 |
CIA-87 | shogun: make configure fail when java is enabled but java/javac/ant are not | 10:45 |
CIA-87 | shogun: detected - http://git.io/eyo-RA | 10:45 |
CIA-87 | shogun: Soeren Sonnenburg master * r3997e8d / src/Makefile.template : add check examples targets - http://git.io/99L9jA | 10:45 |
-!- shogun-buildbot [~shogun-bu@7nn.de] has quit [Quit: buildmaster reconfigured: bot disconnecting] | 11:02 | |
-!- shogun-buildbot [~shogun-bu@7nn.de] has joined #shogun | 11:03 | |
@sonney2k | f-x`, are you around? | 11:07 |
f-x` | sonney2k: yes | 11:12 |
-!- f-x [~user@117.192.214.159] has joined #shogun | 11:13 | |
@sonney2k | f-x`/f-x, I just wanted to ask whether you think your submitted code is in releasable state | 11:13 |
@sonney2k | or what you still want to improve | 11:14 |
@sonney2k | as you might know we currently intend to release on aug 31 | 11:14 |
f-x` | sonney2k: it depends on what feature is being used | 11:15 |
f-x | i.e. StreamingSimpleFeatures etc will mostly be good | 11:15 |
@sonney2k | f-x, ok and which are not so? | 11:15 |
f-x` | but there are others which I'll be happier if I work on before releasing | 11:15 |
f-x | sonney2k: eg. StreamingStringFeatures is something I want to experiment on further | 11:16 |
@sonney2k | f-x, is it doable for you to finish the tests within the next few days?\ | 11:16 |
f-x` | VW is good, one minor addition I can think of will make it good enough | 11:16 |
@sonney2k | f-x, you can always improve | 11:17 |
@sonney2k | this won't be the last release of shogun | 11:17 |
f-x` | sonney2k: yes, i think i can do it if i work on the testing part now | 11:17 |
@sonney2k | however it would be great if we could release sth rather now/soon and then gradually continue development | 11:17 |
@sonney2k | so better fix/test now and mark things unstable if you are not convinced that they work | 11:17 |
@sonney2k | the shogun-buildbot is doing a great job in helping us detect regressions... | 11:18 |
f-x` | sonney2k: ok, i'll concentrate on getting the *Features things working in a more stable manner first | 11:18 |
f-x | one features class per day should mean all 3 covered in the next 3 days, which is hopefully okay | 11:19 |
@sonney2k | yes ok | 11:19 |
@sonney2k | it is best if you write some small (python_modular) test script for them | 11:20 |
@sonney2k | then these will always be tested | 11:20 |
f-x` | sonney2k: could you point me to some similar scripts for the features classes we already have? | 11:20 |
@sonney2k | f-x, just look at the python_modular/feature*.py examples | 11:20 |
f-x` | ok, will do | 11:21 |
-!- f-x [~user@117.192.214.159] has left #shogun ["ERC Version 5.3 (IRC client for Emacs)"] | 11:22 | |
-!- f-x` [~user@117.192.214.159] has quit [Quit: ERC Version 5.3 (IRC client for Emacs)] | 11:22 | |
-!- f-x [~user@117.192.214.159] has joined #shogun | 11:23 | |
@sonney2k | f-x, thank you very much! | 11:24 |
f-x | sonney2k: np, will look to get it done as soon as possible | 11:24 |
@sonney2k | lets make this the best shogun release ever :D | 11:25 |
f-x | yay! :) | 11:25 |
CIA-87 | shogun: Soeren Sonnenburg master * rcfbef75 / doc/Makefile : fix make doc - http://git.io/yrQQKg | 11:45 |
-!- blackburn [~blackburn@31.28.45.83] has joined #shogun | 12:06 | |
blackburn | sonney2k: so did you manage to fix java compilation? it works for me btw | 12:08 |
@sonney2k | blackburn, yes - there were some things just not installed | 12:28 |
@sonney2k | on the buildslave I mean | 12:28 |
@sonney2k | blackburn, but look at http://shogun-toolbox.org:5347/builders/java_modular/builds/99/steps/test_1/logs/stdio | 12:28 |
@sonney2k | still lots of errors... | 12:28 |
@sonney2k | though some of them seem to be easiliy solved | 12:29 |
@sonney2k | like | 12:29 |
@sonney2k | ================================================================================ | 12:29 |
@sonney2k | error in classifier_liblinear_modular.java | 12:29 |
@sonney2k | ================================================================================ | 12:29 |
@sonney2k | Unable to create matrix from .../data/fm_train_real.dat: .../data/fm_train_real.dat (No such file or directory) | 12:29 |
@sonney2k | or should I say .........../data/ *lol* | 12:29 |
@sonney2k | blackburn, btw csharp works more or less too now but also has issues running the examples | 12:30 |
blackburn | nice | 12:30 |
blackburn | I'll fix java soon | 12:30 |
@sonney2k | though I need sploving's help | 12:30 |
blackburn | he disappeared :D | 12:31 |
@sonney2k | I hope he will do the fixes | 12:31 |
@sonney2k | blackburn, do you know if serialhex has time to fix all the ruby examples? | 12:34 |
blackburn | no idea | 12:34 |
@sonney2k | the build now also works but many new tests fail | 12:34 |
@sonney2k | the ones that are just not yet ported for real | 12:34 |
@sonney2k | in the worst case we have to do it all... | 12:34 |
@sonney2k | or remove non-working examples when we run out of time | 12:35 |
CIA-87 | shogun: Soeren Sonnenburg master * r4a4d755 / src/interfaces/modular/modshogun_ignores.i : turn on ignores again as the culprit was broken java detection in configure - http://git.io/PEnKsA | 12:36 |
blackburn | sonney2k: uh.. found bug | 13:28 |
blackburn | it seems that if some getter is called and result isn't 'saved' anywhere - it leads to memory error | 13:29 |
blackburn | in java | 13:29 |
@sonney2k | result isn't saved - what does that mean? | 13:31 |
@sonney2k | f-x, please fix the if thing | 13:33 |
@sonney2k | and then I commit | 13:33 |
@sonney2k | blackburn, you mean a shogun object | 13:33 |
@sonney2k | or double[,] ? | 13:34 |
blackburn | sonney2k: double matrix | 13:36 |
blackburn | i.e. get_histogram() | 13:36 |
@sonney2k | blackburn, please be more verbose | 13:37 |
f-x | sonney2k: ah, i see - no if () needed before any SG_UNREF? | 13:37 |
@sonney2k | I still don't understand | 13:37 |
@sonney2k | f-x, SG_UNREF checks that already | 13:37 |
blackburn | sonney2k: yeah I overvodkaed | 13:37 |
blackburn | I will check before | 13:37 |
@sonney2k | blackburn, it is more like you chat while riding on you bear | 13:38 |
blackburn | sonney2k: checked, I was wrong | 13:38 |
blackburn | orr | 13:39 |
f-x | sonney2k: ok, done | 13:39 |
blackburn | histogram bug I guess | 13:39 |
CIA-87 | shogun: Shashwat Lal Das master * r66c4ffd / (3 files in 2 dirs): Improvements in StreamingStringFeatures and reindentation of ParseBuffer. - http://git.io/reyMOg | 13:40 |
CIA-87 | shogun: Shashwat Lal Das master * r65a020c / examples/undocumented/libshogun/streaming_stringfeatures.cpp : StreamingStringFeatures libshogun example. - http://git.io/FDBKsQ | 13:40 |
CIA-87 | shogun: Shashwat Lal Das master * ra6bf023 / examples/undocumented/libshogun/streaming_stringfeatures.cpp : Commented StreamingStringFeatures example better. - http://git.io/LXsbcw | 13:40 |
CIA-87 | shogun: Shashwat Lal Das master * r1d81f89 / src/shogun/features/StreamingStringFeatures.h : Removed pointer checking before SG_UNREF in StreamingStringFeatures. - http://git.io/aWuOSw | 13:40 |
CIA-87 | shogun: Soeren Sonnenburg master * r58b557f / (4 files in 3 dirs): | 13:40 |
CIA-87 | shogun: Merge pull request #311 from frx/streaming_vw | 13:40 |
CIA-87 | shogun: StreamingStringFeatures improvements - http://git.io/GRmMUg | 13:40 |
@sonney2k | f-x, ^ merged | 13:40 |
f-x | ok : | 13:40 |
f-x | ) | 13:40 |
f-x | some more coming up soon | 13:40 |
blackburn | for (i=0; i< (int32_t) (1<<16); i++) | 13:42 |
blackburn | hist[i]=0; | 13:42 |
blackburn | WTF?! | 13:42 |
blackburn | uh | 13:42 |
blackburn | okay not a bug | 13:43 |
@sonney2k | :) | 13:45 |
blackburn | sonney2k: histogram get_histogram fails in java.. | 13:48 |
blackburn | no idea why | 13:48 |
blackburn | sonney2k: STACK OVERFLOW! | 13:52 |
@sonney2k | blackburn, uhh | 13:52 |
@sonney2k | how that and where | 13:52 |
blackburn | get_histogram returns vector of size 65536 | 13:52 |
blackburn | so distribution_histogram_modular fails | 13:53 |
@sonney2k | so? | 13:53 |
@sonney2k | but the vector is not on stack?! | 13:53 |
blackburn | looks like it is | 13:53 |
@sonney2k | blackburn, you talk about SGVector ? | 13:53 |
blackburn | yes, SGVector mapped to DoubleMatrix | 13:54 |
@sonney2k | but SGVector is just a double* and int | 13:54 |
@sonney2k | not sure about the java typemap mapping | 13:54 |
blackburn | I tried return just 40k of histogram elements | 13:54 |
blackburn | and got stack overflow | 13:54 |
blackburn | if it is 65536 all is fucked up with SIGSERV | 13:55 |
blackburn | sonney2k: JNITYPE arr[cols] | 13:56 |
@sonney2k | blackburn, indeed loock at swig_typemaps.i line 113 | 13:56 |
blackburn | FUCK | 13:56 |
@sonney2k | yeah | 13:56 |
@sonney2k | so please do a SG_MALLOC there | 13:56 |
blackburn | *** sploving | 13:57 |
@sonney2k | blackburn, same thing will happen in SGMatrix | 13:58 |
blackburn | STACK MEMORY ALLOCATION | 14:04 |
blackburn | sonney2k: get_degree defined two times in SpectrumMismatchRBFKernel :D | 14:07 |
blackburn | :D | 14:07 |
blackburn | sonney2k: okay fixed | 14:15 |
CIA-87 | shogun: Sergey Lisitsyn master * r02feda6 / src/shogun/distributions/Histogram.cpp : Fixes for Histogram - http://git.io/pju8ug | 14:22 |
CIA-87 | shogun: Sergey Lisitsyn master * r5630a1d / (2 files): Removed unnecessary double definitions of methods at string kernels - http://git.io/t3Aa4Q | 14:22 |
CIA-87 | shogun: Sergey Lisitsyn master * r63b5aec / src/interfaces/java_modular/swig_typemaps.i : Changed memory allocation method in java typemaps - http://git.io/Dhm03g | 14:22 |
CIA-87 | shogun: Sergey Lisitsyn master * r9c4972b / (3 files): Some java examples fixes - http://git.io/MfMKqw | 14:22 |
@sonney2k | blackburn, btw now we have to check that this is not causing a memory leak | 14:24 |
blackburn | sonney2k: no, shouldn't | 14:24 |
blackburn | sonney2k: java would crash with some MTHFCKR SIGNAL :D | 14:25 |
@sonney2k | blackburn, I mean you might have to call SG_FREE later... | 14:26 |
@sonney2k | blackburn, so do all java examples work now? | 14:28 |
@sonney2k | blackburn, wait you have a copy'n'paste bug here | 14:29 |
@sonney2k | https://github.com/shogun-toolbox/shogun/commit/63b5aec58bf1f8b1cb6d13cfd3db975596133d1e | 14:29 |
@sonney2k | line 480 | 14:29 |
blackburn | oh | 14:31 |
blackburn | :D | 14:31 |
blackburn | sonney2k: no, not all | 14:31 |
blackburn | in progress | 14:31 |
blackburn | sonney2k: but where to call SG_FREE?? | 14:31 |
@sonney2k | after the JNI_CALL thing? | 14:32 |
blackburn | will it copy array? | 14:32 |
@sonney2k | I don't know | 14:32 |
blackburn | me too | 14:32 |
blackburn | sonney2k: looks like no | 14:34 |
blackburn | it uses some Set[Type]ArrayRegion | 14:34 |
@sonney2k | http://download.oracle.com/javase/1.4.2/docs/guide/jni/spec/functions.html | 14:34 |
@sonney2k | Set<PrimitiveType>ArrayRegion Routines | 14:35 |
@sonney2k | it only copies | 14:35 |
@sonney2k | so we have to SG_FREE | 14:35 |
blackburn | okay | 14:35 |
CIA-87 | shogun: Sergey Lisitsyn master * r911732f / src/interfaces/java_modular/swig_typemaps.i : Fixes for java typemaps - http://git.io/Rd3Krg | 14:43 |
blackburn | sorry gtg | 14:43 |
-!- blackburn [~blackburn@31.28.45.83] has quit [Quit: Leaving.] | 14:43 | |
-!- sploving1 [~sploving@210.77.14.6] has joined #shogun | 14:53 | |
sploving1 | sonney2k, are you around? | 14:53 |
@sonney2k | sploving1, yes | 14:53 |
sploving1 | hist[0]=92 what do you mean | 14:54 |
sploving1 | I did not understand it clearly | 14:54 |
@sonney2k | a histogram is computed over the characters in the string | 14:54 |
@sonney2k | that says that the string null termination character appeared 92 times | 14:54 |
@sonney2k | (I think you have 92 strings there) | 14:54 |
sploving1 | what does get_num_bits_in_histogram()=3 mean? | 14:55 |
@sonney2k | that one would need 3 bits to encode the 5 different characters | 14:55 |
@sonney2k | but DNA has only 4 characters - 2bits needed so that won't fit | 14:56 |
sploving1 | even though a DNA alphabet was expected so only ord('A') (C/G/T) should | 14:57 |
sploving1 | appear? | 14:57 |
sploving1 | DNA? | 14:57 |
@sonney2k | ? | 14:57 |
@sonney2k | A,C,G,T | 14:57 |
@sonney2k | but you have a '\0' in the string | 14:58 |
sploving1 | you mean ACGT'\0' | 14:58 |
@sonney2k | I guess that you pass a string 1 byte too long | 14:58 |
@sonney2k | no | 14:58 |
sploving1 | sonney2k, in C we have '\0' in the string | 14:58 |
@sonney2k | ACATCGTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTACGTACGTATCGTAGCTGTACG\0 | 14:58 |
@sonney2k | sploving1, in shogun not | 14:58 |
@sonney2k | never | 14:58 |
@sonney2k | we have a ptr and a length | 14:59 |
sploving1 | the length is not include the '\0', so I add 1 in the typemap | 14:59 |
@sonney2k | so one fix would be to just say str.length = len-1 | 14:59 |
sploving1 | str.length mean shogun length, len means C length, am I right? | 15:00 |
@sonney2k | that is the problem then | 15:00 |
@sonney2k | yes len means csharp len | 15:00 |
sploving1 | max_len = shogun::CMath::max(len, max_len); strings[i].slen = len + 1; | 15:01 |
sploving1 | maybe this is where is the but | 15:01 |
sploving1 | bug | 15:01 |
sploving1 | max_len = shogun::CMath::max(len, max_len); strings[i].slen = len; | 15:01 |
sploving1 | am I right? | 15:01 |
@sonney2k | could be | 15:02 |
@sonney2k | likely yes | 15:03 |
sploving1 | I will have a try | 15:03 |
@sonney2k | sploving1, OK - when that is done could you please have a look at the gaussian kernel example? it doesn't return the correct results (looks more like uninited memory...) | 15:04 |
sploving1 | okay. I saw your email. but have no idea about that now | 15:04 |
sploving1 | why the other examples work well | 15:04 |
sploving1 | but gaussian_kernel not work well | 15:05 |
@sonney2k | sploving1, the linear kernel one also crashes | 15:06 |
@sonney2k | seems to be the same problem | 15:06 |
sploving1 | fixed the stringlist but and pushed | 15:09 |
CIA-87 | shogun: Baozeng Ding master * r1c36dfa / src/interfaces/csharp_modular/swig_typemaps.i : fix stringlist bug - http://git.io/O6LLsg | 15:11 |
CIA-87 | shogun: Soeren Sonnenburg master * r2226301 / src/interfaces/csharp_modular/swig_typemaps.i : | 15:11 |
CIA-87 | shogun: Merge pull request #312 from sploving/master | 15:11 |
CIA-87 | shogun: fix stringlist bug - http://git.io/zVJFYQ | 15:11 |
@sonney2k | sploving1, thanks | 15:11 |
sploving1 | I need a simple example to test the matrix | 15:11 |
@sonney2k | sploving1, the gaussian kernel one | 15:11 |
sploving1 | when I output the gaussian_kernel, it prints a lot of numbers | 15:11 |
sploving1 | I did not even know which is in the triangle | 15:12 |
sploving1 | linear is easier? | 15:12 |
sploving1 | not at all | 15:12 |
sploving1 | foreach(double item in km_train) { | 15:13 |
sploving1 | Console.Write(item); | 15:13 |
sploving1 | } | 15:13 |
sploving1 | maybe I just printf the first line | 15:13 |
sploving1 | the first element should be 1, am I right? | 15:13 |
@sonney2k | sploving1, linear crashes here | 15:13 |
sploving1 | linear_word? | 15:14 |
@sonney2k | why not use kernel_gaussian_modular.cs? | 15:15 |
@sonney2k | yes | 15:15 |
@sonney2k | you can simplify gaussian if you want | 15:15 |
@sonney2k | just use | 15:15 |
sploving1 | I think kernel_gaussian_modular.cs is easy | 15:15 |
sploving1 | why you say k[i,i]=1 | 15:15 |
@sonney2k | GaussianKernel kernel = new GaussianKernel(feats_train, feats_train, width); | 15:15 |
@sonney2k | double[,] km_train = kernel.get_kernel_matrix(); | 15:15 |
sploving1 | this is shogun inner issue? | 15:15 |
@sonney2k | then km_train[i,i] should be 1.0 | 15:15 |
@sonney2k | sploving1, by definition of the gaussian kernel | 15:16 |
@sonney2k | exp(0) == 1 | 15:16 |
sploving1 | you mean Console.Write(km_train[0,0]) should be 1 | 15:16 |
@sonney2k | yes | 15:16 |
@sonney2k | i,i I would use though | 15:16 |
@sonney2k | but yes | 15:17 |
@sonney2k | km_train[0,0] should be 1 too :) | 15:17 |
sploving1 | km_train[0,0] is 1 here | 15:19 |
sploving1 | I will test km_train[1,1] | 15:19 |
sploving1 | sonney2k, in my machine it is 1 | 15:21 |
* sonney2k checks again | 15:21 | |
sploving1 | I test a random number km_train[8,8] | 15:22 |
sploving1 | it print 1 | 15:22 |
@sonney2k | sploving1, uhh it could be a printing problem | 15:22 |
@sonney2k | because there are no spaces between numbers | 15:23 |
sploving1 | yeap | 15:23 |
sploving1 | I am not very familiar with Csharp | 15:23 |
sploving1 | another issue, is linear_word?? | 15:24 |
@sonney2k | sploving1, yeah but if you replace GaussianKernel in the example with LinearKernel - it already fails | 15:24 |
@sonney2k | (remove width parameter) | 15:24 |
sploving1 | LinearKernel is different from gaussian kernel | 15:27 |
sploving1 | LinearKernel kernel = new LinearKernel(feats_train, feats_test); | 15:27 |
@sonney2k | yes | 15:27 |
sploving1 | not LinearKernel kernel = new LinearKernel(feats_train, feats_train) | 15:28 |
@sonney2k | err feats_train, feats_train | 15:28 |
@sonney2k | then feats_train, feats_test | 15:28 |
@sonney2k | will be two different matrices at the end | 15:28 |
@sonney2k | hmmhh just changing this in the gaussian_modular example didn't cause any trouble | 15:30 |
sploving1 | then what do you mean fails? | 15:31 |
@sonney2k | kernel_linear_word_modular.cs | 15:32 |
sploving1 | what is the output? | 15:33 |
sploving1 | it works in my machine | 15:33 |
sploving1 | I just run it | 15:34 |
@sonney2k | error in kernel_linear_word_modular.cs | 15:34 |
@sonney2k | ================================================================================ | 15:34 |
@sonney2k | Stacktrace: | 15:34 |
@sonney2k | at (wrapper managed-to-native) System.Runtime.InteropServices.Marshal.copy_from_unmanaged (intptr,int,System.Array,int) <0x0005c> | 15:34 |
@sonney2k | at (wrapper managed-to-native) System.Runtime.InteropServices.Marshal.copy_from_unmanaged (intptr,int,System.Array,int) <0x0005c> | 15:34 |
@sonney2k | at System.Runtime.InteropServices.Marshal.Copy (intptr,double[],int,int) <0x0002b> | 15:34 |
@sonney2k | at Kernel.get_kernel_matrix () <0x00117> | 15:34 |
@sonney2k | at kernel_linear_word_modular.Main () <0x00417> | 15:34 |
@sonney2k | at (wrapper runtime-invoke) object.runtime_invoke_void (object,intptr,intptr,intptr) <0x00049> | 15:34 |
@sonney2k | Native stacktrace: | 15:34 |
@sonney2k | mono() [0x487ad6] | 15:34 |
@sonney2k | mono() [0x4d354f] | 15:34 |
@sonney2k | /lib/libpthread.so.0(+0xef60) [0x2ae01a083f60] | 15:34 |
@sonney2k | /lib/libc.so.6(memcpy+0x15b) [0x2ae01a5938ab] | 15:34 |
@sonney2k | [0x40878e1c] | 15:34 |
@sonney2k | Debug info from gdb: | 15:34 |
@sonney2k | 82../sysdeps/unix/syscall-template.S: No such file or directory. | 15:34 |
@sonney2k | [Thread debugging using libthread_db enabled] | 15:34 |
@sonney2k | [New Thread 0x2aaaabfc0700 (LWP 27816)] | 15:34 |
@sonney2k | [New Thread 0x2aaaaacac700 (LWP 27815)] | 15:34 |
@sonney2k | 0x00002ae01a0830bd in read () at ../sysdeps/unix/syscall-template.S:82 | 15:34 |
@sonney2k | in ../sysdeps/unix/syscall-template.S | 15:34 |
@sonney2k | 3 Thread 0x2aaaaacac700 (LWP 27815) pthread_cond_wait@@GLIBC_2.3.2 () | 15:34 |
@sonney2k | at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 | 15:34 |
@sonney2k | 2 Thread 0x2aaaabfc0700 (LWP 27816) sem_wait () | 15:34 |
@sonney2k | at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:86 | 15:34 |
@sonney2k | * 1 Thread 0x2ae01aaa6560 (LWP 27814) 0x00002ae01a0830bd in read () | 15:34 |
@sonney2k | at ../sysdeps/unix/syscall-template.S:82 | 15:35 |
@sonney2k | Thread 3 (Thread 0x2aaaaacac700 (LWP 27815)): | 15:35 |
@sonney2k | #0 pthread_cond_wait@@GLIBC_2.3.2 () | 15:35 |
sploving1 | sploving@sploving-laptop:~/shogun/examples/undocumented/csharp_modular$ gmcs kernel_linear_word_modular.cs ../../../src/interfaces/csharp_modular/*.cs Load.cs | 15:35 |
@sonney2k | at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 | 15:35 |
@sonney2k | #1 0x00000000005b9923 in ?? () | 15:35 |
@sonney2k | #2 0x00000000005c3df5 in ?? () | 15:35 |
@sonney2k | #3 0x00000000005ba6cc in ?? () | 15:35 |
@sonney2k | #4 0x00002ae01a07b8ba in start_thread (arg=<value optimized out>) | 15:35 |
@sonney2k | at pthread_create.c:300 | 15:35 |
@sonney2k | #5 0x00002ae01a5e302d in clone () | 15:35 |
@sonney2k | at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 | 15:35 |
@sonney2k | #6 0x0000000000000000 in ?? () | 15:35 |
@sonney2k | Thread 2 (Thread 0x2aaaabfc0700 (LWP 27816)): | 15:35 |
sploving1 | gmcs kernel_linear_word_modular.cs ../../../src/interfaces/csharp_modular/*.cs Load.cs | 15:35 |
sploving1 | 3225298287975.8333332634420366.666671695298255.833332207874406.66667650041502.51134620958.333332416249691.666672916079415.833331993367822.52085382010.833332022279906.66667774516660.8333331098078452.525371736202290739252.51854593462.59082828309355664002135953558.3333312410622353264642162.53336058517.5245351197.51619731072.51944673349.1666714905433001387078190.833331732567496.66667785354618.3333331124892627.52730151351.666672129274961.666672872351952.5259668 | 15:36 |
sploving1 | here it print out the above numbers | 15:36 |
@sonney2k | hmmhh | 15:37 |
sploving1 | maybe others can help have a try | 15:37 |
@sonney2k | sploving1, how many cores do you have? | 15:37 |
sploving1 | 2 core | 15:37 |
@sonney2k | me too | 15:38 |
sploving1 | i5 | 15:38 |
@sonney2k | core2 duo | 15:38 |
sploving1 | I think others can help have a try | 15:38 |
@sonney2k | sploving1, it is also crashing on the build bot | 15:40 |
@sonney2k | http://shogun-toolbox.org:5347/builders/csharp_modular/builds/103/steps/test_1/logs/stdio | 15:40 |
sploving1 | how to run build bot? | 15:42 |
sploving1 | buid bot is ?? | 15:42 |
@sonney2k | sploving1, as soon as you commit sth, it compiles everything and checks the examples | 15:44 |
@sonney2k | sploving1, 64bit machine or 32bit? | 15:47 |
sploving1 | sonney2k, can I run it in my machine? | 15:47 |
@sonney2k | yours I mean? | 15:47 |
sploving1 | you mean OS? | 15:47 |
@sonney2k | I think the out typemap is broken | 15:47 |
sploving1 | 32 | 15:47 |
@sonney2k | buildbot and my notebook here are 64bit | 15:48 |
@sonney2k | so I guess that is the reason then | 15:48 |
* sonney2k checks the out typemap for SGMatrix | 15:48 | |
sploving1 | soney2k, buildbot is another machine? super machine? | 15:48 |
sploving1 | I am so interested in it | 15:48 |
@sonney2k | sploving1, look at line 130 | 15:49 |
@sonney2k | in swig_typemaps.i | 15:49 |
sploving1 | res[i + 2] = (CTYPE) $1.matrix[i]; | 15:49 |
sploving1 | ?? | 15:49 |
@sonney2k | yeah | 15:49 |
@sonney2k | I mean what is CTYPE? | 15:49 |
@sonney2k | sth like int? | 15:49 |
@sonney2k | you then first assign res[0] / res[1] with some lengths (integers) | 15:50 |
@sonney2k | and then res[i+2] with the ptr to data I guess? | 15:50 |
@sonney2k | on my machine ptrs will be 64 bit I think so this could be the reason | 15:50 |
sploving1 | int, long, float, double, short are all CTYPE | 15:50 |
@sonney2k | sploving1, buildbot is some core i7 2600 w/ 16G memory just building shogun all the time | 15:51 |
sploving1 | just a core? not a machine / notebook with disk? | 15:52 |
@sonney2k | intel core i7 | 15:52 |
@sonney2k | the processor | 15:52 |
@sonney2k | just some machine | 15:52 |
@sonney2k | desktop | 15:52 |
sploving1 | oh. I know, you just named a popular machine, which is running the shogun always | 15:53 |
sploving1 | are there any way we can run shogun in irc? | 15:54 |
@sonney2k | shogun-buildbot, dance | 15:54 |
sploving1 | I saw lua irc can run lua command | 15:54 |
shogun-buildbot | <(^.^<) | 15:54 |
shogun-buildbot | <(^.^)> | 15:54 |
shogun-buildbot | (>^.^)> | 15:54 |
shogun-buildbot | (7^.^)7 | 15:54 |
shogun-buildbot | (>^.^<) | 15:54 |
sploving1 | great | 15:54 |
@sonney2k | sploving1, back to the SGMatrix out typemap | 15:55 |
@sonney2k | can't you use the struct SGMatrix has? | 15:55 |
@sonney2k | and then in the csout typemap just use the respective ptrs | 15:55 |
sploving1 | ? | 15:56 |
sploving1 | not understand | 15:56 |
@sonney2k | sploving1, what you did doesn't work | 15:56 |
@sonney2k | you allocate an array of e.g. uint16_t | 15:57 |
@sonney2k | and then assign rows / cols in elements 0/1 | 15:57 |
@sonney2k | and the data ptr to index 2 | 15:57 |
sploving1 | yeap | 15:57 |
@sonney2k | now when e.g. rows is bigger than 65536 rows etc won't fit in that datatype | 15:58 |
@sonney2k | nor the 32bit (in your case) or 64bit data ptr | 15:58 |
@sonney2k | so why not use the SGMatrix struct directly? | 15:58 |
sploving1 | no | 15:59 |
sploving1 | %typemap(imtype, out="IntPtr", inattributes="int rows, int cols, [MarshalAs(UnmanagedType.LPArray)]") shogun::SGMatrix<SGTYPE>%{CSHARPTYPE[,]%} | 15:59 |
sploving1 | in Csharp, we cannot know rows and cols | 16:00 |
sploving1 | so I mange the typemap to add two args, rows and cols | 16:01 |
@sonney2k | is the LPArray a ptr to the array? | 16:01 |
@sonney2k | adding these two args is fine - but you need a big enough buffer to hold them | 16:01 |
sploving1 | yeap | 16:01 |
@sonney2k | so CTYPE cannot work | 16:01 |
-!- CIA-87 [~CIA@cia.atheme.org] has quit [Ping timeout: 252 seconds] | 16:01 | |
-!- CIA-3 [~CIA@cia.atheme.org] has joined #shogun | 16:02 | |
@sonney2k | you need sth that is 2*size(int32_t)+size(void*) big and then assign sizes to the respective elements | 16:03 |
@sonney2k | actually it is not a ptr | 16:03 |
@sonney2k | so sizeof(CTYPE)*num_rows*num_cols + 2*sizeof(int32_t) | 16:04 |
@sonney2k | sploving1, do you agree? | 16:04 |
sploving1 | let me think | 16:05 |
sploving1 | yeap | 16:12 |
f-x | sonney2k: do you think it is ok if i typedef something like vw_size_t to uint32_t and use it in place of size_t in vw? | 16:12 |
@sonney2k | sploving1, any idea how to properly fix it? | 16:12 |
shogun-buildbot | build #118 of r_static is complete: Failure [failed test test_1] Build details are at http://www.shogun-toolbox.org:5347/builders/r_static/builds/118 blamelist: sploving1@gmail.com | 16:12 |
sploving1 | sonney2k, how to use SG_MALLOC to malloc a two int and len*sizeof(CTYPE) | 16:12 |
@sonney2k | f-x, sure | 16:13 |
f-x | sonney2k: ok, i'll see how that works out | 16:13 |
@sonney2k | f-x, but why not uint32_t directly (or whaever was meant?) | 16:13 |
@sonney2k | sploving1, only possilbe with hacks | 16:13 |
f-x | sonney2k: i feel something like *size_t would explain the meaning better | 16:13 |
f-x | if we convert it to uint32_t we lose out on some info about the intended use of the variable | 16:14 |
@sonney2k | f-x, ok | 16:14 |
@sonney2k | sploving1, that is why I suggested a struc | 16:14 |
@sonney2k | sploving1, you could use | 16:15 |
@sonney2k | char* res = SG_MALLOC(char, sizeof(CTYPE)*len + 2*sizeof(int32_t)); | 16:15 |
@sonney2k | ((int32_t*) res)[0] = rows; | 16:15 |
@sonney2k | ((int32_t*) res)[1] = cols; | 16:15 |
@sonney2k | CTYPE* dst = (CTYPE*) (res+2*sizeof(int32_t)); | 16:15 |
@sonney2k | for (i = 0; i < len; i++) { | 16:15 |
@sonney2k | dst[i + 2] = (CTYPE) $1.matrix[i]; | 16:15 |
@sonney2k | } | 16:15 |
@sonney2k | or so | 16:15 |
@sonney2k | it seems $result is a CTYPE* though | 16:16 |
@sonney2k | so you might have to cast that again | 16:16 |
@sonney2k | and then when you marshal do the same (un)mangling | 16:16 |
sploving1 | sonney, souds right. but dst is no need. res[i+2] is OK | 16:18 |
@sonney2k | no res[i+2] is not | 16:18 |
@sonney2k | if we have | 16:18 |
@sonney2k | char* res; | 16:18 |
@sonney2k | then res[i+2] would be the 3rd byte | 16:19 |
@sonney2k | and only one byte for rows/cols | 16:19 |
sploving1 | CTYPE* dst = (CTYPE*) (res+2*sizeof(int32_t)); why? | 16:20 |
sploving1 | CTYPE* dst = (CTYPE*) res | 16:20 |
sploving1 | is oK | 16:20 |
sploving1 | then we use des[i+2] | 16:20 |
@sonney2k | sploving1, rows and cols are always integers - correct? | 16:22 |
@sonney2k | so they are 4 bytes always no matter what CTYPE we use - right? | 16:22 |
sploving1 | yepa | 16:22 |
sploving1 | yeap | 16:22 |
sploving1 | you mean another way? | 16:23 |
@sonney2k | so when CTYPE==int or then dst[i+2] would point at byte 9 - which is correct | 16:23 |
@sonney2k | but when CTYPE==char then dst[i+2] points to byte 3 - > kaboom | 16:24 |
@sonney2k | do you see the problem? | 16:24 |
sploving1 | i know, then it should be dst[i] = (CTYPE) $1.matrix[i]; | 16:25 |
sploving1 | not dst[i + 2] = (CTYPE) $1.matrix[i]; | 16:25 |
sploving1 | I think | 16:25 |
@sonney2k | ?! | 16:25 |
@sonney2k | no | 16:25 |
@sonney2k | don't you want to marshal the following sequence: | 16:26 |
@sonney2k | int,int, CTYPE[some_size] | 16:26 |
@sonney2k | ? | 16:26 |
@sonney2k | ahh dst[i] yes not res[i+2] | 16:26 |
-!- f-x` [~user@117.192.214.159] has joined #shogun | 16:27 | |
shogun-buildbot | build #113 of python_static is complete: Failure [failed test_1] Build details are at http://www.shogun-toolbox.org:5347/builders/python_static/builds/113 blamelist: sploving1@gmail.com | 16:28 |
@sonney2k | what's wrong with the buildbot now?! | 16:30 |
-!- f-x` [~user@117.192.214.159] has quit [Client Quit] | 16:30 | |
-!- f-x [~user@117.192.214.159] has quit [Ping timeout: 260 seconds] | 16:30 | |
-!- f-x [~user@117.192.214.159] has joined #shogun | 16:30 | |
@sonney2k | sploving1, can you fix it? | 16:40 |
shogun-buildbot | build #125 of cmdline_static is complete: Failure [failed test_1] Build details are at http://www.shogun-toolbox.org:5347/builders/cmdline_static/builds/125 blamelist: sploving1@gmail.com | 16:42 |
CIA-3 | shogun: Shashwat Lal Das master * r54bc14c / (21 files in 4 dirs): Conversion of vw's size_t to typedef'd uint32_t - http://git.io/Zsk-2A | 16:45 |
CIA-3 | shogun: Soeren Sonnenburg master * r653e96c / (21 files in 4 dirs): | 16:45 |
CIA-3 | shogun: Merge pull request #313 from frx/streaming_vw | 16:45 |
CIA-3 | shogun: Conversion of vw's size_t to typedef'd uint32_t - http://git.io/U-0mOQ | 16:45 |
shogun-buildbot | build #117 of octave_static is complete: Failure [failed test_1] Build details are at http://www.shogun-toolbox.org:5347/builders/octave_static/builds/117 blamelist: sploving1@gmail.com | 16:45 |
sploving1 | what is the matter? | 16:47 |
@sonney2k | sploving1, it is crashing because of the wrong assignments / array sizes | 16:48 |
@sonney2k | sploving1, just create a ByteFeatures example and you will see also on your machine | 16:49 |
sploving1 | maybe there is something missing | 16:50 |
sploving1 | when I use len instead of len+1 | 16:50 |
sploving1 | sonney2k, cannot convert 'char*' to 'double*' in assignment | 16:52 |
@sonney2k | ? | 16:52 |
sploving1 | can I use void * res = SG_MALLOC(char, sizeof(CTYPE) * len + 2 * sizeof(int32_t)); | 16:52 |
sploving1 | instead of char * | 16:52 |
@sonney2k | sploving1, you can also cast at the end | 16:52 |
sploving1 | when I use CTYPE *r = (CTYPE *)res; it means doulbe * r = (double*) res | 16:53 |
sploving1 | cannot work | 16:53 |
sploving1 | as res is char* | 16:53 |
@sonney2k | serialhex, but you can use $result = (CTYPE*) res; | 16:54 |
@sonney2k | sploving, but you can use $result = (CTYPE*) res; | 16:54 |
@sonney2k | however you need to make sure that the marshaling is ok | 16:54 |
@sonney2k | because it is in fact not a (CTYPE*) but some *whatever* | 16:54 |
sploving1 | $rest is not double* | 16:55 |
sploving1 | $result is not doulbe * | 16:55 |
sploving1 | $result can use any cast, you mean | 16:55 |
@sonney2k | what is result? | 16:55 |
@sonney2k | (CTYPE*) yes | 16:55 |
@sonney2k | sploving1, but you also need to adjust the csout typemap | 16:56 |
sploving1 | I know that | 16:56 |
@sonney2k | sploving1, ok then please do - thanks | 16:59 |
shogun-buildbot | build #120 of octave_modular is complete: Failure [failed compile] Build details are at http://www.shogun-toolbox.org:5347/builders/octave_modular/builds/120 blamelist: sonne@debian.org | 17:01 |
sploving1 | sonney2k, pulled | 17:07 |
shogun-buildbot | build #131 of libshogun is complete: Failure [failed compile] Build details are at http://www.shogun-toolbox.org:5347/builders/libshogun/builds/131 blamelist: fraggerx@gmail.com | 17:19 |
@sonney2k | sploving1, btw is that bug also in vectors? | 17:20 |
CIA-3 | shogun: Baozeng Ding master * reb8b842 / src/interfaces/csharp_modular/swig_typemaps.i : fix rows and cols type bug - http://git.io/ARLpWg | 17:20 |
CIA-3 | shogun: Soeren Sonnenburg master * rfcf7316 / src/interfaces/csharp_modular/swig_typemaps.i : | 17:20 |
CIA-3 | shogun: Merge pull request #314 from sploving/master | 17:20 |
CIA-3 | shogun: fix rows and cols bug - http://git.io/bEFhoA | 17:20 |
sploving1 | sonney2k, fixed toghter | 17:21 |
@sonney2k | great - thanks! | 17:22 |
@sonney2k | sploving1, for strings you use sth else right? | 17:22 |
sploving1 | sonney2k, about the stringlist, I took carefully have a check, but did not find any where to fix | 17:23 |
@sonney2k | f-x, you forgot to add shogun/classifier/vw/vw_constants.h: | 17:23 |
@sonney2k | f-x, it fails to build now | 17:23 |
sploving1 | I gtg bye. | 17:24 |
-!- sploving1 [~sploving@210.77.14.6] has left #shogun [] | 17:24 | |
shogun-buildbot | build #121 of octave_modular is complete: Success [build successful] Build details are at http://www.shogun-toolbox.org:5347/builders/octave_modular/builds/121 | 17:33 |
f-x | sonney2k: oh, in the .i? sorry | 17:35 |
@sonney2k | f-x, not the actual .h | 17:35 |
f-x | it compiled on mine, checking again | 17:35 |
f-x | ohhh | 17:36 |
f-x | i understand - git add | 17:36 |
f-x | :( | 17:36 |
@sonney2k | f-x, yes | 17:36 |
@sonney2k | not sure if you forgot it in the .i file too | 17:36 |
@sonney2k | then it will also break there | 17:36 |
f-x | sonney2k: will add it there as well | 17:36 |
@sonney2k | the faster the better :) | 17:37 |
f-x | sonney2k: which .i file would be a good place to add it? i think it should work without the .i inclusion though | 17:38 |
f-x | it doesn't provide any functions for the target language as such | 17:38 |
@sonney2k | ok | 17:38 |
@sonney2k | then not needed | 17:38 |
@sonney2k | pull request please | 17:38 |
f-x | just a sec | 17:39 |
f-x | there you go | 17:40 |
CIA-3 | shogun: Shashwat Lal Das master * r3dbfc26 / src/shogun/classifier/vw/vw_constants.h : Added vw_constants.h to repository. - http://git.io/pH1d1Q | 17:41 |
@sonney2k | thx | 17:41 |
CIA-3 | shogun: Soeren Sonnenburg master * r3afc64d / src/shogun/classifier/vw/vw_constants.h : | 17:41 |
CIA-3 | shogun: Merge pull request #315 from frx/streaming_vw | 17:41 |
CIA-3 | shogun: Added vw_constants.h to repository. - http://git.io/GmKH0Q | 17:41 |
shogun-buildbot | build #133 of libshogun is complete: Success [build successful] Build details are at http://www.shogun-toolbox.org:5347/builders/libshogun/builds/133 | 17:42 |
@sonney2k | f-x, see ^ | 17:42 |
@sonney2k | all good again | 17:42 |
f-x | phew :) | 17:42 |
CIA-3 | shogun: Soeren Sonnenburg master * r148b751 / src/interfaces/csharp_modular/swig_typemaps.i : fix int_32_t typo - http://git.io/yb_bHA | 17:46 |
shogun-buildbot | build #135 of libshogun is complete: Success [build successful] Build details are at http://www.shogun-toolbox.org:5347/builders/libshogun/builds/135 | 17:53 |
shogun-buildbot | build #127 of cmdline_static is complete: Success [build successful] Build details are at http://www.shogun-toolbox.org:5347/builders/cmdline_static/builds/127 | 17:57 |
shogun-buildbot | build #120 of r_static is complete: Success [build successful] Build details are at http://www.shogun-toolbox.org:5347/builders/r_static/builds/120 | 17:57 |
shogun-buildbot | build #119 of octave_static is complete: Success [build successful] Build details are at http://www.shogun-toolbox.org:5347/builders/octave_static/builds/119 | 17:58 |
shogun-buildbot | build #115 of python_static is complete: Success [build successful] Build details are at http://www.shogun-toolbox.org:5347/builders/python_static/builds/115 | 18:00 |
-!- blackburn [~blackburn@31.28.45.83] has joined #shogun | 18:27 | |
blackburn | sonney2k: uh what a nice error to debug | 18:28 |
blackburn | can you please comment out plotting thing in swissroll.py and run it? | 18:30 |
CIA-3 | shogun: Sergey Lisitsyn master * raa95573 / src/shogun/mathematics/lapack.cpp : Remove asserts from DSYGVX - http://git.io/19rmMw | 18:57 |
CIA-3 | shogun: Sergey Lisitsyn master * ra920d11 / src/shogun/preprocessor/LaplacianEigenmaps.cpp : More informative error checking in laplacian eigenmaps - http://git.io/FPiv0A | 18:57 |
-!- f-x` [~user@117.192.216.242] has joined #shogun | 19:26 | |
-!- f-x [~user@117.192.214.159] has quit [Ping timeout: 260 seconds] | 19:27 | |
@sonney2k | blackburn, do the other graphical examples work for you? | 19:29 |
@sonney2k | does anyone here have a 32bit system | 19:46 |
@sonney2k | ? | 19:46 |
@sonney2k | f-x`, blackburn you? | 19:46 |
blackburn | sonney2k: both swissroll.py and hemisphere.py works for me | 19:50 |
blackburn | sonney2k: yes I have x86 system | 19:50 |
blackburn | sonney2k: could you please comment out lines 53,54 in swissroll.py and run? | 19:52 |
blackburn | ah and 50 | 19:52 |
@sonney2k | blackburn, could you please compile the csharp_modular interface with swig_typemaps.i line 154 changed like | 20:52 |
@sonney2k | - Marshal.Copy(new IntPtr(ptr.ToInt32() + 2 * Marshal.SizeOf(typeof(int))), ret, 0, len); | 20:52 |
@sonney2k | + Marshal.Copy(new IntPtr(ptr.ToInt64() + 2 * Marshal.SizeOf(typeof(int))), ret, 0, len); | 20:52 |
blackburn | okay | 20:52 |
blackburn | will try | 20:52 |
@sonney2k | and then run make check-examples | 20:53 |
blackburn | sonney2k: when you try my example ;) | 20:53 |
@sonney2k | blackburn, compiling already | 20:54 |
@sonney2k | too bad that my mono here is not yet .NET 4.0 compatible | 20:55 |
@sonney2k | this pointer hacking is beyond all my imagination :) | 20:55 |
@sonney2k | blackburn we are damn close to c# stuff working reliably | 20:57 |
blackburn | ??? ??? ?????? | 20:57 |
blackburn | sonney2k: I sent some email to andreas, any chance he will answer during this weekend? | 20:57 |
blackburn | (10:56:33 PM) blackburn: sonney2k: I sent some email to andreas, any chance he will answer during this weekend? | 20:57 |
blackburn | got some connection problem | 20:58 |
@sonney2k | ?! | 20:58 |
blackburn | not sure it was delivered | 20:58 |
@sonney2k | yes 2 times | 20:58 |
blackburn | :D | 20:58 |
blackburn | ok sorry | 20:58 |
@sonney2k | little chance | 20:58 |
blackburn | bad bad | 20:58 |
@sonney2k | btw, he is *the* ICA guy | 20:58 |
blackburn | independent component analysis? | 20:58 |
@sonney2k | and he was very excited about what we did - maybe next year for gsoc he could mentor ica etc algorithms | 20:59 |
@sonney2k | yes | 20:59 |
blackburn | there is a chance I implement it during our mid-season period | 20:59 |
blackburn | okay I simply will send him a letter if all ok | 21:00 |
blackburn | I asked him for some more information | 21:00 |
@sonney2k | blackburn, I would suggest to ask him for relevant algorithms | 21:00 |
@sonney2k | he is *the expert* | 21:00 |
@sonney2k | blackburn, when I comment the lines above some figure pops up | 21:00 |
blackburn | nice, could you please make a screenshot? | 21:01 |
blackburn | btw do you have arpack? | 21:01 |
@sonney2k | numbers on axis overlap badly | 21:01 |
@sonney2k | blackburn, sure | 21:01 |
blackburn | sure about arpack? | 21:01 |
blackburn | I have no solution for overlapping yet | 21:01 |
@sonney2k | grep -i arpack .config | 21:02 |
@sonney2k | DEFINES=-DSWIG_TYPE_TABLE=shogun -DSHOGUN -DLINUX -DHAVE_POWL -DHAVE_SQRTL -DHAVE_LOG2 -DHAVE_PTHREAD -DHAVE_HDF5 -DHAVE_JSON -DHAVE_XML -DHAVE_ATLAS -DHAVE_LAPACK -DHAVE_ARPACK -DUSE_GLPK -DUSE_LZO -DUSE_GZIP -DUSE_BZIP2 -DUSE_LZMA -DHAVE_LARGEFILE -DUSE_SHORTREAL_KERNELCACHE -DUSE_HMMPARALLELSTRUCTURES -DUSE_HMMPARALLEL -DUSE_BIGSTATES -DUSE_HMMCACHE -DUSE_REFERENCE_COUNTING -DUSE_SVMLIGHT -DUSE_SPINLOCKS -DHAVE_DOXYGEN | 21:02 |
@sonney2k | POSTLINKFLAGS= -lm -pthread -lhdf5 -ljson -lxml2 -llapack -lcblas -llapack_atlas -larpack -lglpk -lm -llzo2 -lz -lbz2 -llzma | 21:02 |
blackburn | please disable arpack if it is enabled | 21:02 |
@sonney2k | ^arpack | 21:02 |
blackburn | bug is in the lapack | 21:02 |
@sonney2k | ?! | 21:02 |
@sonney2k | lapack arpack? | 21:02 |
@sonney2k | what | 21:02 |
blackburn | andreas used lapack when he got a bug | 21:02 |
blackburn | not arpack | 21:02 |
@sonney2k | blackburn, ok disabling arpack | 21:03 |
blackburn | thanks | 21:03 |
@sonney2k | blackburn, does c# do sth? | 21:03 |
blackburn | I was installing mono develop files | 21:03 |
blackburn | compiling | 21:03 |
@sonney2k | blackburn, hemisphere.py is not working - can that be? | 21:05 |
@sonney2k | blackburn, did you forget to commit ../../../../data/toy/hemisphere_color.dat | 21:05 |
@sonney2k | ? | 21:05 |
blackburn | ehh | 21:07 |
blackburn | sonney2k: don't you have hemisphere_color? | 21:08 |
@sonney2k | no | 21:08 |
blackburn | I have..? | 21:08 |
@sonney2k | blackburn, did you forget to git add it? | 21:09 |
blackburn | not! | 21:09 |
blackburn | https://github.com/shogun-toolbox/shogun-data/tree/master/toy | 21:09 |
blackburn | it is here! | 21:09 |
blackburn | ?! | 21:09 |
@sonney2k | blackburn, what is current? | 21:10 |
@sonney2k | 7ebf99a3944e92e157d934c8f11b6e5e5a27844d ? | 21:10 |
blackburn | data is 90a72b3ec2df44dceb7d7d24c8bf878a257a7867 | 21:11 |
blackburn | you are one commit before | 21:11 |
@sonney2k | weird | 21:12 |
@sonney2k | hum | 21:13 |
@sonney2k | I thought git submodule update will sync it | 21:13 |
@sonney2k | obviously not | 21:13 |
@sonney2k | anyway example doesn't run because I don't have 3d projection | 21:14 |
blackburn | disable it | 21:14 |
blackburn | err comment | 21:14 |
@sonney2k | blackburn, does all_evaluation still work / is this still supported? | 21:14 |
blackburn | all evaluation? | 21:15 |
@sonney2k | graphical/all_eval*.py | 21:15 |
blackburn | no it fails on classify | 21:15 |
@sonney2k | LocalTangentSpaceAlignment done | 21:15 |
@sonney2k | Traceback (most recent call last): | 21:15 |
@sonney2k | File "swissroll.py", line 63, in <module> | 21:15 |
@sonney2k | new_feats = preproc.apply_to_feature_matrix(features) | 21:15 |
@sonney2k | File "/usr/local/lib/python2.6/dist-packages/modshogun.py", line 41669, in apply_to_feature_matrix | 21:15 |
@sonney2k | return _modshogun.SimpleRealPreprocessor_apply_to_feature_matrix(self, *args) | 21:15 |
@sonney2k | SystemError: [ERROR] assertion *info==0 failed in file mathematics/lapack.cpp line 373 | 21:15 |
@sonney2k | blackburn, even when fixing this it doesn't work | 21:16 |
blackburn | damn | 21:16 |
blackburn | but good | 21:16 |
blackburn | sonney2k: it is the same error andreas got | 21:16 |
@sonney2k | blackburn, I just wanted to know if you roc/prc things are making this obsolete or not | 21:16 |
@sonney2k | great huh? | 21:16 |
blackburn | uh | 21:16 |
blackburn | no, all_evaluation won't work this way | 21:16 |
blackburn | many modifications to do | 21:16 |
blackburn | sonney2k: your git is not up-to-date! | 21:17 |
@sonney2k | blackburn, so did the c# compile? | 21:17 |
blackburn | yes | 21:17 |
blackburn | it did | 21:17 |
blackburn | running tests | 21:17 |
@sonney2k | Traceback (most recent call last): | 21:18 |
@sonney2k | File "swissroll.py", line 63, in <module> | 21:18 |
@sonney2k | new_feats = preproc.apply_to_feature_matrix(features) | 21:18 |
@sonney2k | File "/usr/local/lib/python2.6/dist-packages/modshogun.py", line 41669, in apply_to_feature_matrix | 21:18 |
@sonney2k | return _modshogun.SimpleRealPreprocessor_apply_to_feature_matrix(self, *args) | 21:18 |
blackburn | all ok | 21:18 |
@sonney2k | SystemError: [ERROR] DSYGVX failed with code: -20. | 21:18 |
@sonney2k | blackburn, you sure that you have a 32bit system? | 21:18 |
blackburn | sonney2k: yeah I'm pretty sure | 21:18 |
@sonney2k | uname -m | 21:18 |
@sonney2k | x86_64 | 21:18 |
blackburn | i686 | 21:18 |
@sonney2k | great | 21:18 |
@sonney2k | then I have the ultimate(tm) fix :) | 21:19 |
@sonney2k | blackburn, btw buildbot uptime 21:19:19 up 1 day, 1:32, 1 user, load average: 0.13, 0.25, 0.55 | 21:19 |
@sonney2k | :) | 21:19 |
blackburn | sonney2k: all examples are ok | 21:19 |
blackburn | sonney2k: I guess my issue is x64 related too | 21:20 |
@sonney2k | blackburn, that was with the Int64 stuff already in the swig_typemap? | 21:20 |
@sonney2k | Marshal.Copy(new IntPtr(ptr.ToInt64() + 2 * Marshal.SizeOf(typeof(int))), ret, 0, len); | 21:21 |
blackburn | sonney2k: yes I did suggested fix | 21:21 |
blackburn | yes | 21:21 |
@sonney2k | ^this | 21:21 |
@sonney2k | ok | 21:21 |
@sonney2k | (Int32 on x86_64 will crash) | 21:21 |
blackburn | oh | 21:21 |
blackburn | isee | 21:21 |
@sonney2k | blackburn, dammed! why did cwidmer let you pass - I explicitly told him to not do so ;-) | 21:27 |
CIA-3 | shogun: Soeren Sonnenburg master * rd8986e9 / src/interfaces/csharp_modular/swig_typemaps.i : use int64 to represent c#/c ptr - http://git.io/ulSu-w | 21:28 |
CIA-3 | shogun: Soeren Sonnenburg master * rc5e08d9 / examples/undocumented/libshogun/mathematics_arpack.cpp : ifdef HAVE_ARPACK example to not fail on buildbot test - http://git.io/w-7bPA | 21:33 |
blackburn | uh | 21:33 |
blackburn | sonney2k: yeah probably I shouldn't hehe | 21:33 |
CIA-3 | shogun: Soeren Sonnenburg master * r301e5f5 / (2 files): also ifdef HAVE_LAPACK liblinear based examples - http://git.io/1QA62A | 21:36 |
blackburn | sonney2k: probably I need you to test some things | 21:38 |
@sonney2k | blackburn, I really hope you are getting the remaining java examples fixed | 21:38 |
blackburn | sonney2k: yeah sure sure but I need to fix laplacian shit | 21:39 |
@sonney2k | it is only 4 java examples that fail now ... | 21:39 |
@sonney2k | so shoot blackburn | 21:39 |
@sonney2k | I am your man | 21:39 |
@sonney2k | btw did you hear anything from serialhex? | 21:39 |
blackburn | sonney2k: anything like? | 21:40 |
@sonney2k | I mean regarding ruby examples? | 21:40 |
blackburn | no | 21:40 |
blackburn | sonney2k: mathematics/lapack.cpp add before line 366 | 21:40 |
blackburn | SG_SPRINT("info=%d\n",info); | 21:41 |
blackburn | same before 372 | 21:41 |
blackburn | please ;) | 21:41 |
@sonney2k | we really need him for the ruby stuff :( | 21:41 |
blackburn | and run example again | 21:41 |
@sonney2k | pretty please | 21:41 |
blackburn | I need to know where 20th parameter set to wrong value | 21:42 |
@sonney2k | blackburn, wait info is a ptr | 21:42 |
blackburn | oh yes | 21:42 |
@sonney2k | do you mean *info ? | 21:42 |
blackburn | *info | 21:42 |
blackburn | yes | 21:42 |
@sonney2k | on your command | 21:43 |
@sonney2k | info=0 | 21:43 |
@sonney2k | info=-20 | 21:43 |
blackburn | hmm okay | 21:43 |
@sonney2k | I really don't understand why the CPU fan is at 250 RPM even under full load | 21:44 |
@sonney2k | on the other hand the cpu is at <60 C | 21:44 |
@sonney2k | so probably it just doesn't care | 21:44 |
@sonney2k | (my notebook is at 90 C ...) | 21:44 |
blackburn | sonney2k: what is "int" size on your machine? | 21:45 |
@sonney2k | IIRC int is always 32bit | 21:45 |
@sonney2k | long int would be 64 | 21:45 |
blackburn | I can't understand why it can fail on my machine | 21:45 |
blackburn | it seems andreas uses 64 too | 21:45 |
@sonney2k | it cannot fail you mean? | 21:45 |
@sonney2k | it does not fail? | 21:46 |
blackburn | oh sh | 21:46 |
blackburn | yes | 21:46 |
blackburn | on my machine everything is ok | 21:46 |
blackburn | sonney2k: could you please SG_SPRINT after "lwork = (int)work[0]"? | 21:47 |
@sonney2k | blackburn, line? | 21:48 |
blackburn | 367 | 21:48 |
blackburn | or 368 now | 21:48 |
@sonney2k | blackburn, why is work a double* ? | 21:49 |
@sonney2k | but lwork an int? | 21:49 |
blackburn | LWORK (input) INTEGER | 21:49 |
blackburn | sonney2k: LWORK is a length of WORK | 21:49 |
@sonney2k | lwork = (int)work[0]; | 21:50 |
@sonney2k | but that converts the double to an int | 21:50 |
blackburn | sonney2k: on the first call it determines the optimal work size | 21:50 |
blackburn | and stores it in work(1) | 21:50 |
blackburn | or work[0] | 21:50 |
@sonney2k | sure about that? | 21:50 |
blackburn | WORK (workspace/output) DOUBLE PRECISION array, dimension (MAX(1,LWORK)) * On exit, if INFO = 0, WORK(1) returns the optimal LWORK. | 21:50 |
@sonney2k | ok but then that is the error | 21:50 |
blackburn | 20th argument is wrong | 21:51 |
@sonney2k | you need to do lwork = *((int*) work); | 21:51 |
blackburn | try that | 21:51 |
blackburn | sonney2k: so why lwork = *((int*) work)? any difference? | 21:56 |
@sonney2k | blackburn, yes it works now | 21:56 |
@sonney2k | (my machine is not that fast...) | 21:56 |
blackburn | so examples works now? | 21:56 |
@sonney2k | yes | 21:56 |
blackburn | uh | 21:57 |
blackburn | sonney2k: I'll fix all the similar errors | 21:57 |
blackburn | and commit | 21:57 |
@sonney2k | k | 21:57 |
@sonney2k | blackburn, I hope you understand what the error was | 21:57 |
blackburn | no | 21:57 |
blackburn | :D | 21:57 |
@sonney2k | then better try hard | 21:57 |
@sonney2k | it is important | 21:57 |
@sonney2k | you have double* work; | 21:58 |
@sonney2k | so what will work[0] give you ? | 21:58 |
blackburn | first double element | 21:58 |
@sonney2k | and then when you do (int) of it? | 21:58 |
blackburn | oh | 21:58 |
@sonney2k | int of the *double* element | 21:58 |
blackburn | I got work[2] | 21:58 |
blackburn | in means of integer array | 21:58 |
@sonney2k | int of the first 64bit double | 21:59 |
blackburn | yeah I see | 21:59 |
@sonney2k | ok | 21:59 |
@sonney2k | so the fix is clear now? | 21:59 |
blackburn | yeah seems so | 22:00 |
@sonney2k | ok good | 22:00 |
@sonney2k | I had a long chat session with baozeng today about some csharp marshalling and the errors he made were very similar | 22:00 |
blackburn | oh it was hard I guess :D | 22:01 |
@sonney2k | read the logs | 22:01 |
CIA-3 | shogun: Soeren Sonnenburg master * r0fcedaa / examples/undocumented/python_modular/graphical/all_evaluation.py : remove all_evaluation - http://git.io/nV_eyQ | 22:02 |
@sonney2k | aha | 22:02 |
@sonney2k | hemisphere data is gone again | 22:02 |
@sonney2k | could it be that you didn't commit data? | 22:02 |
@sonney2k | blackburn, in the shogun repository? | 22:03 |
@sonney2k | I mean like git commit data ? | 22:03 |
blackburn | sonney2k: yeah may be | 22:04 |
@sonney2k | please do so | 22:04 |
@sonney2k | then I can git submodule update | 22:04 |
shogun-buildbot | build #114 of csharp_modular is complete: Success [build successful] Build details are at http://www.shogun-toolbox.org:5347/builders/csharp_modular/builds/114 | 22:05 |
@sonney2k | yeaaaaahhhh! | 22:05 |
@sonney2k | only ruby and java left | 22:05 |
CIA-3 | shogun: Sergey Lisitsyn master * rf1cc27a / data : Data update - http://git.io/HJztAw | 22:06 |
blackburn | sonney2k: should be ok now | 22:06 |
@sonney2k | blackburn, yes indeed | 22:07 |
@sonney2k | I don't get the example to work though | 22:07 |
blackburn | which example? | 22:08 |
@sonney2k | hemisphere | 22:08 |
@sonney2k | when commenting the 3d stuff | 22:08 |
@sonney2k | I still have | 22:08 |
@sonney2k | swiss_roll_fig.scatter(X[0], X[1], X[2], s=10, c=tt, cmap=plt.cm.Spectral) | 22:08 |
@sonney2k | TypeError: scatter() got multiple values for keyword argument 's' | 22:08 |
@sonney2k | so I guess it needs a new matplotlib | 22:08 |
blackburn | sonney2k: yes it is 3d scatter | 22:08 |
blackburn | comment it out | 22:08 |
blackburn | sonney2k: not really there is a way to do that for your matplotlib | 22:09 |
blackburn | I don't remember how | 22:09 |
@sonney2k | blackburn, would be cool if you could do a try: except: around this | 22:09 |
@sonney2k | such that not all figures fail | 22:09 |
blackburn | sonney2k: no, it is possible to do that even in old matplotlib | 22:09 |
@sonney2k | shh ok | 22:09 |
@sonney2k | ahh ok | 22:09 |
@sonney2k | :) | 22:09 |
blackburn | but I need to fix things in lapack | 22:10 |
@sonney2k | so we now have to fix 2 graphical examples | 22:10 |
@sonney2k | 4 java bugs | 22:10 |
@sonney2k | your lapack issue (basically resolved) | 22:10 |
@sonney2k | and the ruby examples | 22:10 |
@sonney2k | then everything works \o/ | 22:10 |
blackburn | sonney2k: I should add lapack test for libshogun | 22:13 |
blackburn | like I did for arpack | 22:13 |
@sonney2k | ? | 22:13 |
@sonney2k | I don't understand? | 22:13 |
@sonney2k | you mean some mathemetics_lapack.cpp ? | 22:14 |
blackburn | mathematics_arpack.cpp | 22:14 |
blackburn | yes | 22:14 |
blackburn | sonney2k: now it fails on my machine?! | 22:19 |
@sonney2k | blackburn, where? | 22:20 |
blackburn | lapack issue | 22:20 |
@sonney2k | yeah but not in the same line right? | 22:20 |
blackburn | same.. | 22:20 |
@sonney2k | show me the code please | 22:20 |
blackburn | ah no | 22:20 |
blackburn | dsyevr | 22:20 |
blackburn | i did | 22:20 |
blackburn | lwork = *((int*)work); | 22:21 |
blackburn | sonney2k: but works in the old way | 22:22 |
blackburn | probably better to use double work1 variable | 22:22 |
blackburn | like you did in dsyev | 22:22 |
@sonney2k | but my code is wrong too | 22:23 |
blackburn | sonney2k: ?! | 22:26 |
@sonney2k | the (int) work1; | 22:26 |
@sonney2k | it has the same problem | 22:26 |
blackburn | not possible | 22:28 |
@sonney2k | blackburn, could you please print out the returned integers? | 22:28 |
blackburn | where? | 22:29 |
blackburn | dsygvx? | 22:29 |
@sonney2k | in dsyevr / dsyev | 22:29 |
@sonney2k | once with the (int*) thing and once with the int(work1) | 22:29 |
blackburn | better dsygvx | 22:31 |
blackburn | DSYGVX lwork=21500 | 22:31 |
blackburn | 21500 for WORKAROUND ARRAY? :D | 22:32 |
@sonney2k | sounds good | 22:32 |
@sonney2k | what else? | 22:32 |
@sonney2k | temp buffer | 22:32 |
@sonney2k | not workaround | 22:32 |
blackburn | yeah | 22:32 |
blackburn | but larger than I thought | 22:32 |
blackburn | it is bigger than matrices.. | 22:32 |
blackburn | ah no | 22:33 |
blackburn | noon | 22:33 |
blackburn | i'm crazy | 22:33 |
blackburn | sonney2k: if I use *((int*)work) I got 0 | 22:33 |
@sonney2k | ok so that is obviously not the intended value | 22:34 |
@sonney2k | btw I find | 22:34 |
@sonney2k | http://software.intel.com/sites/products/documentation/hpc/mkl/lapack/mkl_lapack_examples/dsyev_ex.c.htm | 22:34 |
@sonney2k | they also use (int) work1; | 22:34 |
blackburn | I will try with work1 | 22:34 |
-!- f-x` [~user@117.192.216.242] has quit [Remote host closed the connection] | 22:35 | |
@sonney2k | blackburn, but that is the same... | 22:35 |
@sonney2k | hmmhhh | 22:35 |
blackburn | no it is not | 22:35 |
blackburn | :D | 22:36 |
CIA-3 | shogun: Sergey Lisitsyn master * r139c42a / src/shogun/mathematics/lapack.cpp : Attempt to fix DSYGVX - http://git.io/yfZRpg | 22:37 |
blackburn | sonney2k: could you please update and try? | 22:37 |
@sonney2k | works | 22:38 |
blackburn | okay so it should be the common way | 22:39 |
@sonney2k | blackburn, now I see what you did wrong: you called SG_FREE and then accessed the content of work[0 | 22:39 |
@sonney2k | ] | 22:39 |
blackburn | oh | 22:40 |
blackburn | bad | 22:40 |
@sonney2k | SG_FREE(work); | 22:40 |
@sonney2k | 367 | 22:40 |
@sonney2k | - lwork = (int)work[0]; | 22:40 |
blackburn | okay it is better anyway | 22:40 |
@sonney2k | ok | 22:40 |
@sonney2k | yeah | 22:40 |
@sonney2k | blackburn, ok now please continue with java - if you happen to get in touch with serialhex ask him for rub rub ruby :) | 22:43 |
blackburn | okay | 22:43 |
@sonney2k | my ruby is not good enough - I have a couple of Q's | 22:43 |
blackburn | we should call him as russian kids call ?????????? | 22:44 |
blackburn | i'm not sure you know wtf it is | 22:44 |
@sonney2k | 22:44:52 up 1 day, 2:58, 1 user, load average: 8.82, 10.51, 10.14 | 22:45 |
@sonney2k | the buildbot is working | 22:45 |
@sonney2k | but cpu temp 54 - highest | 22:45 |
@sonney2k | weird | 22:45 |
@sonney2k | blackburn, no I don't know | 22:46 |
blackburn | impressive load | 22:46 |
@sonney2k | blackburn, I find interesting images when I google for it though http://www.google.com/search?q=%D1%81%D0%BD%D0%B5%D0%B3%D1%83%D1%80%D0%BE%D1%87%D0%BA%D0%B0&hl=en&prmd=ivns&tbm=isch&tbo=u&source=univ&sa=X&ei=GQZYTtXaEsj1sgapz_XaCg&ved=0CDsQsAQ&biw=1440&bih=754 | 22:46 |
blackburn | yeah :D | 22:46 |
blackburn | hahah | 22:46 |
@sonney2k | is it the male or female one? | 22:48 |
blackburn | ?????????? is some kind of wife for ??? ????? | 22:49 |
blackburn | ??? ????? is ~ santa claus | 22:49 |
@sonney2k | yeah that I knew | 22:49 |
@sonney2k | moros == snow? | 22:49 |
blackburn | oh | 22:49 |
blackburn | sorry it is his daughter | 22:49 |
blackburn | :D | 22:49 |
blackburn | :D | 22:49 |
blackburn | moroz is hmm | 22:49 |
@sonney2k | uhh ohh | 22:49 |
blackburn | hard cold | 22:49 |
blackburn | ahahhaha | 22:50 |
@sonney2k | my russian became totally useless | 22:50 |
blackburn | that's crazy but I wrong again | 22:50 |
@sonney2k | yours too? | 22:50 |
blackburn | snegurochka is a GRANDdaughter | 22:50 |
blackburn | fail | 22:50 |
blackburn | :D | 22:50 |
@sonney2k | epic | 22:50 |
blackburn | sonney2k: ???? = snow | 22:51 |
blackburn | sonney2k: you was near | 22:51 |
@sonney2k | I guess one should sue you for the false claims :D | 22:51 |
@sonney2k | anyway please go on | 22:51 |
blackburn | with lapack or snegurochka? :D | 22:52 |
blackburn | sonney2k: could you please make a screenshot of output of swissroll? | 22:53 |
blackburn | it probably could help to avoid some crazy shit after | 22:53 |
@sonney2k | http://dl.dropbox.com/u/31480471/arpack.png | 22:54 |
blackburn | good | 22:55 |
blackburn | landmark isomap is crazy but it is random | 22:55 |
blackburn | sonney2k: need your help again | 22:55 |
blackburn | or your machine, the same | 22:56 |
blackburn | :D | 22:56 |
blackburn | sonney2k: please run https://gist.github.com/af0a931e8c849691df4a | 23:00 |
blackburn | oh no | 23:00 |
blackburn | updated | 23:01 |
@sonney2k | yes nice 3d figure | 23:08 |
blackburn | FUCK | 23:08 |
blackburn | why you haven't answered 10s before :D | 23:08 |
blackburn | installed old matplotlib | 23:09 |
@sonney2k | did you punish you bear | 23:09 |
@sonney2k | ahh | 23:09 |
shogun-buildbot | build #136 of cmdline_static is complete: Failure [failed test_1] Build details are at http://www.shogun-toolbox.org:5347/builders/cmdline_static/builds/136 blamelist: blackburn91@gmail.com | 23:10 |
blackburn | sonney2k: the problem is I can't combine 3d and 2d plots in matplotlib 0.99.. | 23:11 |
blackburn | ah wrong | 23:11 |
blackburn | not | 23:12 |
blackburn | what the f I'm saying | 23:12 |
shogun-buildbot | build #137 of cmdline_static is complete: Success [build successful] Build details are at http://www.shogun-toolbox.org:5347/builders/cmdline_static/builds/137 | 23:13 |
blackburn | uh it is hard to combine versions heh | 23:20 |
blackburn | sonney2k: GOT IT | 23:27 |
blackburn | should work now.. | 23:27 |
CIA-3 | shogun: Sergey Lisitsyn master * rcc0f888 / (2 files): Hack made hemisphere and swissroll work both in matplotlib 0.99 and >1.0 - http://git.io/z5pvpw | 23:33 |
blackburn | sonney2k: could you please try? | 23:34 |
@sonney2k | it opens 2 figures | 23:45 |
blackburn | yeah | 23:46 |
blackburn | okay | 23:46 |
blackburn | nice | 23:46 |
blackburn | sonney2k: unfortunately I can't combine 3d and 2d so for 0.99 - with two figures only | 23:46 |
blackburn | on >1.0 it would work better | 23:46 |
blackburn | starting java examples fixing | 23:47 |
--- Log closed Sat Aug 27 00:00:29 2011 |
Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!