IRC logs of #shogun for Sunday, 2011-05-08

--- Log opened Sun May 08 00:00:48 2011
blackburnit is a sleep time :D00:37
blackburnserialhex: see you00:37
-!- blackburn [~qdrgsm@188.122.225.203] has quit [Quit: Leaving.]00:43
-!- blackburn [~qdrgsm@188.122.225.203] has joined #shogun10:18
@mlsecLarge matrices in LLE? The local covariance. Or distances10:22
@mlsecOr the weight matrix?10:26
blackburnmlsec: local covariance is dim*k10:31
@mlsecok10:32
blackburnmlsec: pretty large anyway10:32
@mlsecbut sparse10:32
blackburnyeap10:32
blackburnhm.. can we work with sparse matrices effectively?10:33
@mlsecwhy not10:33
@mlsecwhat about the weight matrices? do you apply an eigen decomposion10:33
@mlsecas suggested by roweis10:33
blackburnmlsec: oh, I didn't started working on eigenproblem10:34
@mlsecit could be that for high-dimensional data solving this eigenproblem can be very hard10:34
blackburnI see10:35
@mlseci am not sure though.10:35
blackburnas for sparse matrices, I don't see any class for that in shogun..10:37
@mlsechmm. could be that sonneyk did not need a sparse matrix so far10:37
@mlsecmaybe we can build on some blas and atlas stuff, which hopefully can be linked to shogun (or are already linked)10:38
@mlsecthis would help in later doing decompositions (svd or eigen)10:38
blackburnmlsec: we have SparseFeatures, I will take a look on it10:38
blackburnanyway blas and atlas stuff sounds better10:39
@mlsecsparse features is likely a sparse vector10:39
blackburnat least I can implement it without sparseness and then speed it up10:41
@mlsecyes. you could also start with a reference implementation in an interpreted language like python or matlab10:42
@mlsecthis could help to find the bottlenecks and pitfalls10:42
blackburnI already have matlab implementation by roweis10:43
@mlsecok10:43
blackburnpython is more 'comfortable' for me, but anyway I got comprehension of matlab way to implement it10:44
blackburnthe only problem is that all the things done with matrices, even distance :)10:46
blackburnmlsec: btw, do you know if LLE will work for other distances?10:47
blackburnI don't sure it will for some distances10:47
@mlsecblackburn: LLE cannot be applied to arbitrary distances11:30
blackburnmlsec: only for euclidean?11:30
@mlsecblackburn: as part of the embedding the distance between a vector and its reconstruction is phrased in terms of local covariance11:30
blackburnyes, I understand it11:31
@mlsecsuch a decomposition of a distance is only possible if the distance is related to a Euclidean distance11:31
blackburnyeap, I see11:31
blackburnthank you11:31
@mlsecin other words, you can apply other distance functions, e.g. Manhattan, Kulback-Leibler, etc, if there is someway to express them as a Euclidean distance11:32
@mlsecthis is related to kernel functions and has the same underlying concept11:32
-!- blackburn [~qdrgsm@188.122.225.203] has quit [Quit: Leaving.]12:49
-!- serialhex [~quassel@99-101-148-183.lightspeed.wepbfl.sbcglobal.net] has quit [Remote host closed the connection]13:12
-!- blackburn [~qdrgsm@188.122.225.203] has joined #shogun13:21
-!- blackburn [~qdrgsm@188.122.225.203] has quit [Quit: Leaving.]16:05
-!- alesis-novik [~alesis@188.74.87.84] has quit [Quit: I'll be Bach]19:21
-!- blackburn [~qdrgsm@188.122.225.203] has joined #shogun19:51
-!- alesis-novik [~alesis@188.74.87.84] has joined #shogun20:42
-!- warpy [~warpy@bzq-79-182-12-108.red.bezeqint.net] has joined #shogun22:38
warpyanyone awake at this late hour ?22:38
blackburnyeap22:39
warpyhey man22:39
warpywhats your roll in shogun22:39
warpyrole*22:39
blackburnI'm a GSoC student working on dimreduction algos22:40
warpywhich one are you working on ?22:40
blackburnLLE, Hessian LLE, MDS, Isomap, SNE22:41
warpycant say i am familiar with those22:41
blackburnme too22:42
blackburn:D22:42
warpylol22:42
warpyso why these ?22:42
blackburnwill get familiar gradually22:42
blackburnthey was proposed by my mentor and I know they are good sometimes22:43
warpywho is he ?22:43
blackburnChristian Widmer, cwidmer22:43
blackburnwhat about you? :)22:44
warpya guy i work with is trying to do the c# typemap22:44
warpythis thing is complex and is driving us nuts22:44
blackburnah, you are mentor :)22:45
warpyi am looking for some one to .... consult22:45
warpyumm, dont think so22:45
blackburneh..22:45
warpy:)22:46
warpynot officially thats for sure22:46
warpyand i have zero experience with shogun/swig22:46
warpyso ... cant take that honor yet :)22:46
blackburnso you work with sploving, right?22:46
warpyno22:46
warpyDaniel22:46
blackburnahh22:46
blackburnyou are working not with GSoC student22:47
blackburnI see22:47
warpyright we missed the gsoc by a day22:47
warpydoesnt matter, we need this functionality22:47
blackburnI haven't had any experience with C#22:47
warpythis work is all about swig typemaps, daniel is doing a good job decrypting the documentations22:49
blackburnI have some issues with python swig22:49
warpywhat ?22:50
blackburnhad*22:50
warpy..explain22:50
blackburnjust little misunderstanding with some function returning numpy array22:50
warpyso no bugs in it ?22:51
blackburnbut haven't had any serious experience, just know a little about current typemaps22:51
blackburnI don't know, I just used already implemented typemaps, the problem was only with its usage22:52
warpycool22:54
* sonney2k is not aware of any bugs in python_modular and this is currently the interface I use most22:57
warpyhey sonney2k22:57
blackburnwow sonney2k is here :D22:57
warpydaniel is almost finished rewriting the java modular into c#22:57
warpywithout testing/debugging but22:57
warpyis there someone who is an expert on this22:58
@sonney2kblackburn, 50% here...22:58
warpythat can provide help , if we need to consult22:58
@sonney2kwarpy, java_modular is still not really written...22:58
warpybut its a start22:58
@sonney2kso what did he port?22:58
@sonney2kahh ok22:58
warpymost of the code in the java file22:59
@sonney2kwarpy, daniel should try to get vectors translated first22:59
warpysingle arrays were in there22:59
@sonney2kwarpy, did you get c# to work at all?22:59
warpythe interface ?22:59
@sonney2kI mean did you manage to start the resulting .exe?23:00
warpyyou should ask him, i know small amounts of detail23:00
warpynot yet as far as i know23:00
@sonney2k(the first step IMHO)23:00
@sonney2kI am here sometimes but have to leave usually very unexpectedly (at least currently)23:01
warpydo you have experience with swig, hands on stuff ?23:01
@sonney2kwarpy, I wrote all the interfaces + typemaps that are currently there.23:03
warpywell, we would definitely can use some help.23:04
@sonney2kwell ask23:04
warpyhe is working on it. i am just following23:05
blackburnsonney2k: have you any idea how I can work with sparse matrices in LLE?23:05
@sonney2kwarpy, then tell him to ask me :)23:06
warpyi will let him know that he can contact you regarding this, i bet he have some unknowns.23:06
warpyits a steep learning curve, complex stuff23:06
warpybtw whe you said vectors23:07
@sonney2kwarpy, not so difficult if you have examples - and we have plenty in other languages23:07
@sonney2kblackburn, use CSparseFeatures ...23:07
warpyyou were talking about arrays ?23:07
@sonney2kfor me this is the same thing23:07
warpywell the jave thing have arrays23:07
blackburnsonney2k: eigendecomposition..?23:07
warpyso hopefully this will be a start23:08
warpyalso c# is not documented in swig23:08
warpywhich is a pain23:08
blackburnin ass23:08
blackburn:D23:08
@sonney2kblackburn, you should check some other matrix packages like eigen or so - nothing like this is core shogun focus...23:09
blackburnsonney2k: I will need two 'special' things with sparses - dot product (it is in SparseFeatures) and eigenproblem solving23:10
blackburnmay be just do it without any sparseness could be a good idea?23:10
blackburnthen latter add it23:10
warpynight :)23:11
@sonney2kblackburn, I think so...23:11
@sonney2kwarpy, cu23:11
@bettyboobye sonney2k23:11
@sonney2kbettyboo, :P23:11
@bettyboosonney2k: not exactly perfect but intelligible :P23:11
-!- warpy [~warpy@bzq-79-182-12-108.red.bezeqint.net] has quit [Ping timeout: 252 seconds]23:15
@sonney2kblackburn, I woudl really do the simplest possbile things first23:20
@sonney2kthen more advanced stuff23:20
blackburnyeah I think the same23:21
@sonney2kotherwise you can easily become stuck and get nowhere23:21
@sonney2kblackburn, you were asking sth yesterday but I had to leave/got disconnected - so didn't see the question...23:32
blackburnah23:32
blackburnsonney2k: I think these messages23:33
blackburnblackburnsonney2k: we discussed possibility of writing a paper about dimreduction with shogun to some journal21:26blackburnsonney2k: he said it is possible with "Open Research Computation"21:27blackburnbut while I was reading FAQ, I became surprised a lot with "We charge a flat fee of £995/$1660/€1120 for each accepted manuscript."21:28blackburnsonney2k: is it a common practice?21:28blackburnI'm a bit newbie with these issues23:33
blackburnjh23:33
blackburneeeeeeee23:33
blackburnreh23:33
blackburnblackburnsonney2k: we discussed possibility of writing a paper about dimreduction with shogun to some journal21:2623:33
blackburnblackburnsonney2k: he said it is possible with "Open Research Computation"21:2723:33
blackburnblackburnbut while I was reading FAQ, I became surprised a lot with "We charge a flat fee of £995/$1660/€1120 for each accepted manuscript."21:2823:33
blackburnblackburnsonney2k: is it a common practice?21:2823:33
blackburnblackburnI'm a bit newbie with these issues23:33
@sonney2kblackburn, common practise in open access journals...23:34
blackburnwhy they charge a fee?23:35
@sonney2kusually when you apply for a grant it is covered in there...23:35
blackburnah23:35
@sonney2kblackburn, to cover their costs -  it is free for all afterwards under some CC-by* license23:35
blackburnI see23:36
blackburnso there is no way to have a publication about shogun dimreduction without fees, right?23:36
@sonney2kblackburn, you didn't fix the calcroc issue in GUIMath.cpp right?23:36
@sonney2kblackburn, there could be - jmlr for example23:37
blackburnsonney2k: eh.. I asked you to comment lines, I didn't wanted to create a new pull request for that23:37
@sonney2kbut standards are set very high ...23:37
@sonney2kblackburn, I thought you had some idea how to fix things. anyway deleting the offending lines now.23:38
blackburnI don't know, there are many things I don't understand how to fix23:38
@sonney2kdeleted23:39
@sonney2kblackburn, which others?23:40
blackburnI mean that function in GUIMath doing some things I don't understand :)23:40
blackburnyou said that nobody uses libshogunui so I decided to not think about it :)23:41
blackburnJMLR is pretty serious.. I don't sure I can do anything for it23:43
blackburnsonney2k: well may be I should fix it for ROCEvaluation usage?23:47
@sonney2kblackburn, not nobody... just not myself23:47
@sonney2k(others complained already that git trunk doesn't compile)23:47
blackburnI have involuntary rejection of libshogunui :D23:49
@sonney2kblackburn, I wish this could die ...23:51
@sonney2kI mean all the static interfaces - they are just *pff*23:52
blackburnI feel the same :)23:52
@sonney2kit is only that we have no matlab support in swig...23:56
blackburnis it possible?23:57
blackburn* to have one23:57
@sonney2kyes - but I don't know about swig's internals nor do I have the time to write it......23:59
--- Log closed Mon May 09 00:00:50 2011

Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!