--- Log opened Thu Feb 14 00:00:10 2019 | ||
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection] | 03:05 | |
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun | 05:06 | |
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host] | 05:06 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 05:06 | |
-!- mode/#shogun [+o wiking] by ChanServ | 05:06 | |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 268 seconds] | 05:10 | |
-!- braceletboy [67157d53@gateway/web/cgi-irc/kiwiirc.com/ip.103.21.125.83] has joined #shogun | 06:18 | |
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun | 06:29 | |
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host] | 06:29 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 06:29 | |
-!- mode/#shogun [+o wiking] by ChanServ | 06:29 | |
-!- braceletboy [67157d53@gateway/web/cgi-irc/kiwiirc.com/ip.103.21.125.83] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client] | 06:58 | |
-!- braceletboy [67157d53@gateway/web/cgi-irc/kiwiirc.com/ip.103.21.125.83] has joined #shogun | 07:02 | |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection] | 07:06 | |
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun | 07:12 | |
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host] | 07:12 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 07:12 | |
-!- mode/#shogun [+o wiking] by ChanServ | 07:12 | |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection] | 07:17 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 07:27 | |
-!- mode/#shogun [+o wiking] by ChanServ | 07:27 | |
-!- braceletboy [67157d53@gateway/web/cgi-irc/kiwiirc.com/ip.103.21.125.83] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client] | 07:30 | |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 245 seconds] | 07:32 | |
-!- gf712 [90520825@gateway/web/freenode/ip.144.82.8.37] has joined #shogun | 08:44 | |
-!- wiking_ [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun | 08:53 | |
-!- wiking_ [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Remote host closed the connection] | 09:17 | |
-!- wiking_ [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun | 10:17 | |
-!- wiking_ [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Ping timeout: 246 seconds] | 10:22 | |
-!- wiking_ [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun | 10:23 | |
-!- wiking_ [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Ping timeout: 258 seconds] | 10:30 | |
-!- wiking_ [~wiking@2001:67c:10ec:5784:8000::3ff] has joined #shogun | 10:52 | |
-!- wiking_ [~wiking@2001:67c:10ec:5784:8000::3ff] has quit [Ping timeout: 264 seconds] | 10:57 | |
-!- wiking_ [~wiking@2001:67c:10ec:5784:8000::3ff] has joined #shogun | 10:59 | |
-!- wiking_ is now known as wiking | 11:00 | |
-!- wiking [~wiking@2001:67c:10ec:5784:8000::3ff] has quit [Changing host] | 11:00 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 11:00 | |
-!- mode/#shogun [+o wiking] by ChanServ | 11:00 | |
@wiking | gf712: hey | 11:00 |
---|---|---|
@wiking | gf712: ok so lemme check which image has conda as for mkl you'll need that | 11:01 |
gf712 | wiking hey | 11:01 |
gf712 | OK | 11:01 |
@wiking | gf712: ok try to add a matrix to the macos | 11:03 |
@wiking | it has miniconda | 11:03 |
@wiking | follow this | 11:03 |
@wiking | https://github.com/shogun-toolbox/shogun/pull/4521/files#diff-cd203ab2cacc4db8deb9051a30b4cdf0R152 | 11:03 |
@wiking | https://github.com/shogun-toolbox/shogun/pull/4521/files#diff-a8f3a60f795ce4311c41e7f78b27c9b3R7 | 11:04 |
@wiking | strategy: | 11:04 |
@wiking | matrix: | 11:04 |
@wiking | etc | 11:04 |
@wiking | if u have q just ping me | 11:04 |
gf712 | OK thanks, I'll have a look now | 11:04 |
gf712 | wiking so just add a strategy in macOS right? one for the current job without mkl and one with? | 11:08 |
gf712 | and add https://github.com/shogun-toolbox/shogun/pull/4521/files#diff-cd203ab2cacc4db8deb9051a30b4cdf0R152 environment vars? | 11:08 |
gf712 | and then hope for the best :D | 11:08 |
@wiking | yes | 11:09 |
@wiking | somethign liek this | 11:09 |
@wiking | just send me the diff or the thing u think it is | 11:09 |
@wiking | and i can review | 11:09 |
@wiking | btw libtooling is amazing | 11:10 |
gf712 | I was having a look at that yesterday | 11:10 |
gf712 | but didn't quite understand what it does... | 11:10 |
gf712 | so it checks the llvm symbols? | 11:10 |
@wiking | its basically an AST traverser | 11:11 |
@wiking | and more | 11:11 |
@wiking | i just said that i wanna refactor all the shogun classes that are not header only | 11:11 |
@wiking | and add some stuff to the code | 11:11 |
@wiking | :) | 11:11 |
@wiking | 82 LoC. :) | 11:11 |
@wiking | but you can for example change the function name | 11:11 |
@wiking | and its uses everywhere by it | 11:12 |
@wiking | currently writing a litbooling tool for const getters :) | 11:12 |
gf712 | ahh ok | 11:12 |
@wiking | i mean that if a getter is none const | 11:12 |
@wiking | make it const | 11:12 |
@wiking | :) | 11:12 |
gf712 | so it checks if it is const-able | 11:12 |
gf712 | ? | 11:12 |
gf712 | and then spits out cpp code with the consts? | 11:13 |
gf712 | or does it apply const at compile time? | 11:13 |
@wiking | it compiles the code | 11:15 |
@wiking | and since compilation is AST | 11:15 |
@wiking | then you can play around | 11:15 |
@wiking | yeah you can query things like is the method const | 11:15 |
@wiking | or virtual | 11:15 |
@wiking | etc | 11:15 |
@wiking | anything | 11:15 |
@wiking | here's a small example | 11:15 |
@wiking | ifStmt(hasCondition(binaryOperator(hasOperatorName("==")).bind("op"))) | 11:15 |
@wiking | this matches in the code every if statement with == | 11:15 |
gf712 | ah ok! | 11:16 |
gf712 | so how are you using it? are you checking everything that could be const and print the line? | 11:17 |
gf712 | is it just in cpp? | 11:17 |
gf712 | or do they have something like that with a python wrapper? | 11:17 |
@wiking | well this is a cpp tool | 11:19 |
@wiking | but you have a interactive cli | 11:19 |
@wiking | clang-query | 11:19 |
@wiking | no not printing | 11:19 |
@wiking | you can actually rewrite the code | 11:19 |
@wiking | :) | 11:19 |
@wiking | in the original source | 11:19 |
gf712 | ahhhhh | 11:20 |
gf712 | much more sophisticated than I thought | 11:20 |
gf712 | I thought you had to write cpp code, compile and then run and check your printf | 11:21 |
gf712 | that sounds awesome! | 11:21 |
@wiking | well | 11:21 |
@wiking | i wrote 82 lines of c++ code | 11:22 |
@wiking | and that did everything | 11:22 |
gf712 | but you have interactive mode that helps you see the hits right? | 11:22 |
gf712 | it's a bit like a custom clang tidy in the end? | 11:22 |
@wiking | yes | 11:23 |
@wiking | super small example | 11:23 |
@wiking | https://kevinaboos.wordpress.com/2013/07/23/clang-tutorial-part-ii-libtooling-example/ | 11:23 |
gf712 | wiking is this going in the right direction https://github.com/gf712/shogun/commit/8469232f3470c82d2e9c7e4e6cebe40982b290e7.patch | 11:30 |
gf712 | ? | 11:30 |
@wiking | steps: | 11:31 |
@wiking | + - template: ./macos-steps.yml | 11:31 |
@wiking | i mean | 11:32 |
@wiking | steps should be the same for both cases | 11:32 |
@wiking | and then in the macos-steps.yml | 11:32 |
@wiking | you do some if hacks | 11:32 |
@wiking | to check what you are building | 11:32 |
@wiking | :) | 11:32 |
gf712 | ahh ok | 11:33 |
gf712 | wiking do I need to set the env variables btw? | 11:33 |
gf712 | because they are already provided by conda no? | 11:34 |
@wiking | see that bug | 11:34 |
@wiking | the conda env setup | 11:34 |
@wiking | is not the best with azure | 11:34 |
@wiking | that's why there's this hacko | 11:34 |
@wiking | lisitsyn: is there a reason why in CSGObject we actually rely on the implicit copy operator? ;) | 11:35 |
@wiking | afaik this way it's not doing the right thing | 11:36 |
@wiking | either we should delete it or define irt | 11:36 |
@wiking | explcitly | 11:36 |
gf712 | wiking what is the logic behind ${{ if eq(parameters.swig, 'true') }} in docker-steps.xml | 11:39 |
gf712 | why parameters.swig? | 11:39 |
@wiking | coz that template is used | 11:39 |
@wiking | twice | 11:39 |
@wiking | once for building libshogun and once for swig interfaces | 11:40 |
gf712 | ah ok I see it now | 11:40 |
gf712 | sorry | 11:40 |
@wiking | and different stuff needs to be done | 11:40 |
-!- Lefteris [~lefteris@2a05:b400:100:100:f9af:4903:155f:ef4c] has joined #shogun | 11:42 | |
@wiking | nw | 11:43 |
gf712 | wiking is this more what you meant https://github.com/gf712/shogun/commit/91dea487acb9e1aa29b2cc6123c6b44e29f74e67.patch | 11:48 |
@wiking | ok almost | 11:48 |
@wiking | :) | 11:48 |
@wiking | can i comment on this | 11:48 |
gf712 | yup go ahead | 11:49 |
@wiking | ah shit | 11:49 |
@wiking | just realised | 11:49 |
@wiking | we are fucked | 11:49 |
@wiking | stop it | 11:49 |
@wiking | _) | 11:49 |
@wiking | Accelerator framework has prio | 11:50 |
@wiking | over mkl | 11:50 |
@wiking | :( | 11:50 |
@wiking | mmm | 11:50 |
@wiking | try it though | 11:50 |
@wiking | but it'll need more cmake hacks | 11:50 |
@wiking | but | 11:50 |
@wiking | you need to install mkl == true => conda install mkl-devel | 11:50 |
@wiking | before the cmake task | 11:50 |
gf712 | does it? | 11:50 |
@wiking | we can hack it i think | 11:51 |
gf712 | in my laptop mkl works fine | 11:51 |
gf712 | and I didn't mess with anything | 11:51 |
@wiking | mmmm | 11:51 |
@wiking | it should have prio | 11:51 |
@wiking | ;) | 11:51 |
gf712 | ah then maybe I messed around with it by accident.. | 11:52 |
gf712 | so conda install mkl-devel would be inside steps: | 11:52 |
gf712 | in the task? | 11:52 |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection] | 12:02 | |
-!- wiking [~wiking@2001:67c:10ec:5784:8000::3ff] has joined #shogun | 12:04 | |
-!- wiking [~wiking@2001:67c:10ec:5784:8000::3ff] has quit [Changing host] | 12:04 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 12:04 | |
-!- mode/#shogun [+o wiking] by ChanServ | 12:04 | |
@wiking | sorry man | 12:04 |
@wiking | here | 12:04 |
@wiking | had a quick meeting | 12:04 |
@wiking | the conda install should go inside the template | 12:04 |
@wiking | gf712: added some comments | 12:06 |
gf712 | np | 12:07 |
gf712 | OK, I'll have a look | 12:07 |
@wiking | you see what i mean? | 12:07 |
gf712 | I am not very good with CIs | 12:07 |
@wiking | time to learn it | 12:07 |
@wiking | ;) | 12:07 |
@wiking | and its yaml | 12:08 |
@wiking | :) | 12:08 |
gf712 | "you could jsut check for the var itself"? | 12:08 |
gf712 | which var? | 12:08 |
@wiking | mmm acutally coz its a template | 12:08 |
@wiking | nevermind | 12:08 |
gf712 | erf I like the low level stuff so I don't need to learn the API someone else wrote.. | 12:08 |
@wiking | forget that comment | 12:08 |
@wiking | but the other part | 12:08 |
@wiking | needs fixing | 12:08 |
@wiking | that's bad syntax | 12:09 |
@wiking | :) | 12:09 |
@wiking | and logic | 12:09 |
@wiking | first you need to install mkl | 12:09 |
gf712 | why /.ci/ci.yml (Line: 148, Col: 11): A mapping was not expected? | 12:09 |
@wiking | and then run the cmake | 12:09 |
gf712 | OK | 12:09 |
@wiking | i'll grab lunch now | 12:09 |
@wiking | ttyl | 12:09 |
gf712 | aight | 12:09 |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection] | 12:10 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 13:06 | |
-!- mode/#shogun [+o wiking] by ChanServ | 13:06 | |
-!- gf712 [90520825@gateway/web/freenode/ip.144.82.8.37] has quit [Quit: Page closed] | 13:07 | |
-!- gf712 [90520825@gateway/web/freenode/ip.144.82.8.37] has joined #shogun | 13:24 | |
@wiking | gf712: hey | 13:35 |
gf712 | wiking hey | 13:38 |
gf712 | how do you capture env variables in conditions? | 13:39 |
@wiking | mmmm | 13:44 |
@wiking | yeah that seems to be a problem | 13:44 |
@wiking | :< | 13:44 |
@wiking | but lemme google | 13:44 |
gf712 | I saw variables[''] somewhere | 13:45 |
gf712 | might try that | 13:45 |
@wiking | https://docs.microsoft.com/en-us/azure/devops/pipelines/yaml-schema?view=azure-devops&tabs=schema#job-templates | 13:45 |
@wiking | :S | 13:45 |
@wiking | ah yeah tehre's one thing like that | 13:45 |
@wiking | eq(variables['mkl'], 'true') | 13:46 |
@wiking | gf712: ^ | 13:46 |
gf712 | OK, let me try that | 13:47 |
gf712 | no syntax errors at least.. | 13:48 |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection] | 13:55 | |
-!- Lefteris [~lefteris@2a05:b400:100:100:f9af:4903:155f:ef4c] has quit [Quit: Leaving] | 14:03 | |
-!- Lefteris [~lefteris@2a05:b400:100:100:f9af:4903:155f:ef4c] has joined #shogun | 14:48 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 14:56 | |
-!- mode/#shogun [+o wiking] by ChanServ | 14:57 | |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 250 seconds] | 15:01 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 15:05 | |
-!- mode/#shogun [+o wiking] by ChanServ | 15:05 | |
@wiking | gf712: hey | 15:05 |
@wiking | whats happening :) | 15:06 |
@wiking | what's line 149? | 15:07 |
@wiking | i mean 147 | 15:07 |
@wiking | nono | 15:07 |
@wiking | that should not fly | 15:07 |
@wiking | i think with the matrix | 15:08 |
@wiking | - template: ./macos-steps.yml | 15:08 |
@wiking | yes | 15:09 |
@wiking | that one is better now | 15:09 |
@wiking | :) | 15:09 |
@wiking | thisone should not work | 15:09 |
gf712 | ah sorry | 15:09 |
@wiking | - ${{ if eq('$(use_mkl)', 'true') }}: | 15:09 |
@wiking | why dont use use | 15:09 |
gf712 | ahh | 15:09 |
@wiking | eq(variables['mkl'] | 15:09 |
@wiking | ? | 15:09 |
gf712 | it didn't work | 15:09 |
@wiking | mmm other stuff didn't work | 15:10 |
@wiking | not that | 15:10 |
@wiking | :) | 15:10 |
gf712 | but why 'mkl'? | 15:10 |
@wiking | https://github.com/shogun-toolbox/shogun/commit/c0d5cdd1d30486ffa1b43481f833df9a70ba3f8b#diff-cd203ab2cacc4db8deb9051a30b4cdf0R147 | 15:10 |
@wiking | this was the problem | 15:10 |
gf712 | you mean variables['use_mkl'] | 15:10 |
gf712 | ? | 15:10 |
@wiking | ok lemme see now | 15:10 |
@wiking | last pr | 15:10 |
@wiking | and i tell yhou what's wrong | 15:10 |
@wiking | so yes | 15:10 |
@wiking | now it's goot | 15:10 |
@wiking | with setting the env | 15:11 |
@wiking | so yes | 15:11 |
@wiking | eq(variables['use_mkl'], 'true') | 15:11 |
gf712 | but there is no setup | 15:11 |
@wiking | yes because you dont test it now right | 15:11 |
@wiking | i'll cancel the build | 15:11 |
@wiking | use the one above i write you | 15:11 |
gf712 | so - ${{ if eq(variables['use_mkl'], 'true') }}: | 15:11 |
gf712 | and - ${{ if eq(variables['use_mkl'], 'false') }}: | 15:11 |
gf712 | I thought I tried this earlier | 15:12 |
gf712 | but lets see | 15:12 |
@wiking | yes you stried that | 15:13 |
@wiking | *tried that but there was a syntax error | 15:13 |
@wiking | putting the template param in the wrong place | 15:13 |
@wiking | now it's not in the matrix which is good | 15:13 |
gf712 | ok lets see just pushed | 15:14 |
gf712 | I thought I had done that before that | 15:14 |
gf712 | I feel like I've been through all the permutations... | 15:14 |
gf712 | wiking still no setup :/ | 15:15 |
gf712 | is there a way to test locally> | 15:15 |
gf712 | ? | 15:15 |
gf712 | echo $(use_mkl) returns true though | 15:16 |
@wiking | yes but that's another thing | 15:16 |
@wiking | one is templating | 15:16 |
@wiking | the other is var within yaml | 15:16 |
gf712 | ah ok! | 15:17 |
@wiking | ok | 15:17 |
@wiking | you can do another trick | 15:18 |
@wiking | instead of using tempaltes | 15:18 |
@wiking | you use condition: for the job | 15:18 |
@wiking | so condition: eq(variables['use_mkl'], 'true') | 15:18 |
@wiking | for the script/job | 15:18 |
@wiking | and then it will be skipped | 15:18 |
@wiking | if its false | 15:18 |
@wiking | and vice versa | 15:18 |
@wiking | and remove the {{ if... | 15:19 |
gf712 | https://github.com/shogun-toolbox/shogun/pull/4529/files#diff-da52a64097efdb78b548a503f8fe3cadR27 | 15:19 |
gf712 | so condition in here? | 15:19 |
@wiking | yes and as well for the task | 15:19 |
@wiking | as condition is per step | 15:19 |
@wiking | so here https://github.com/shogun-toolbox/shogun/pull/4529/files#diff-da52a64097efdb78b548a503f8fe3cadR41 | 15:20 |
@wiking | and here https://github.com/shogun-toolbox/shogun/pull/4529/files#diff-da52a64097efdb78b548a503f8fe3cadR29 | 15:20 |
gf712 | and where does script: conda install mkl-devel go? | 15:20 |
@wiking | the condition is for a step | 15:21 |
@wiking | so it woudl be like | 15:21 |
@wiking | - script: conda install mkl-devel | 15:21 |
@wiking | condition: ... | 15:21 |
@wiking | too much ident but i hope u see what i mean | 15:21 |
gf712 | yup | 15:21 |
@wiking | see this | 15:21 |
@wiking | https://github.com/shogun-toolbox/shogun/blob/develop/.ci/download-extract.yml#L66 | 15:21 |
gf712 | and then Cmake is another step | 15:22 |
@wiking | https://github.com/shogun-toolbox/shogun/blob/develop/.ci/download-extract.yml#L56 | 15:22 |
@wiking | yes | 15:22 |
gf712 | which needs a condition? | 15:22 |
@wiking | well | 15:22 |
@wiking | since now it's the same task ? | 15:22 |
@wiking | no it's not | 15:22 |
@wiking | and actually | 15:22 |
@wiking | oh no | 15:22 |
@wiking | :D | 15:22 |
@wiking | i've just realised | 15:22 |
@wiking | wrong | 15:22 |
@wiking | https://github.com/shogun-toolbox/shogun/pull/4529/files#diff-da52a64097efdb78b548a503f8fe3cadR30 | 15:22 |
@wiking | you need a separate shell script | 15:22 |
@wiking | i mean step | 15:22 |
@wiking | like in windows | 15:23 |
@wiking | you can have the very same | 15:23 |
@wiking | cmake task | 15:23 |
@wiking | so no condition for it | 15:23 |
@wiking | the conda env vars | 15:24 |
@wiking | should go into the matrix element of MKL | 15:24 |
gf712 | yup | 15:24 |
gf712 | doing that now | 15:24 |
@wiking | you need to copy this whole step | 15:24 |
@wiking | https://github.com/shogun-toolbox/shogun/pull/4521/files#diff-a8f3a60f795ce4311c41e7f78b27c9b3R8 | 15:24 |
@wiking | with adding the condition | 15:25 |
@wiking | for MKL | 15:25 |
@wiking | and actually | 15:25 |
@wiking | mmm ok dont do it | 15:25 |
@wiking | lets see how it goes | 15:25 |
@wiking | but i'm doubting | 15:25 |
@wiking | so just have one condition | 15:25 |
@wiking | for the conda install | 15:25 |
@wiking | script part | 15:25 |
@wiking | cmake is one task | 15:25 |
@wiking | without the variables | 15:25 |
@wiking | dunno if that's gonna work actually but lets see | 15:26 |
gf712 | so without https://github.com/shogun-toolbox/shogun/pull/4521/files#diff-a8f3a60f795ce4311c41e7f78b27c9b3R8 | 15:26 |
@wiking | yes | 15:26 |
@wiking | without that for the time being | 15:26 |
gf712 | but the use_mkl stays outside variables right? | 15:27 |
gf712 | MKL: | 15:27 |
gf712 | use_mkl: true | 15:27 |
gf712 | variables: | 15:27 |
gf712 | CONDA_DEFAULT_ENV: shogun | 15:27 |
gf712 | .. | 15:27 |
@wiking | no | 15:28 |
@wiking | no need for variables | 15:28 |
@wiking | just CONDA_DEFAULT_ENV | 15:28 |
gf712 | ah ok | 15:28 |
@wiking | see windows matrix | 15:28 |
@wiking | from the pr | 15:28 |
@wiking | but | 15:28 |
@wiking | for the time being | 15:29 |
@wiking | dont even add those | 15:29 |
gf712 | ah sorry | 15:29 |
@wiking | as currenlty you dont create | 15:29 |
gf712 | I thought I saw variables | 15:29 |
@wiking | a separate | 15:29 |
gf712 | my bad | 15:29 |
@wiking | conda env | 15:29 |
@wiking | so lets assume it'll be good | 15:29 |
@wiking | 'good' | 15:29 |
@wiking | just by the conda install | 15:29 |
@wiking | but we'll see what setup says | 15:29 |
@wiking | so no need for the CONDA_* anywhere | 15:29 |
@wiking | brb | 15:29 |
@wiking | 10 mins and i'm here again | 15:29 |
gf712 | ok, lets see | 15:29 |
gf712 | :D | 15:30 |
gf712 | the conda is still there just want to let it run to see what happens | 15:33 |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection] | 15:40 | |
-!- wiking [~wiking@2001:67c:10ec:5784:8000::3ff] has joined #shogun | 15:42 | |
-!- wiking [~wiking@2001:67c:10ec:5784:8000::3ff] has quit [Changing host] | 15:42 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 15:42 | |
-!- mode/#shogun [+o wiking] by ChanServ | 15:42 | |
@wiking | gf712: ok | 15:47 |
@wiking | getting there | 15:47 |
@wiking | lets see if cmake can detect mkl | 15:47 |
gf712 | yup one thing at a time.. :p | 15:48 |
@wiking | hahah | 15:49 |
@wiking | conda is not in path | 15:49 |
@wiking | :D | 15:49 |
@wiking | that is interesting | 15:49 |
gf712 | wiking isn't conga installed :( | 15:49 |
gf712 | conda | 15:49 |
gf712 | hmmm | 15:49 |
@wiking | https://github.com/Microsoft/azure-pipelines-image-generation/blob/master/images/macos/macos-Readme.md | 15:49 |
@wiking | https://github.com/Microsoft/azure-pipelines-image-generation/blob/master/images/macos/macos-Readme.md#package-management | 15:50 |
@wiking | :S | 15:50 |
gf712 | oh so it should be there..? | 15:50 |
@wiking | yes | 15:50 |
gf712 | miniconda has the same name right? | 15:51 |
gf712 | as in alias | 15:51 |
@wiking | https://github.com/spyder-ide/spyder/blob/master/azure-pipelines.yml#L14 | 15:52 |
@wiking | ? | 15:52 |
@wiking | yes | 15:52 |
@wiking | conda is conda | 15:52 |
gf712 | Microsoft-hosted agents won't have Conda in their PATH by default. You will need to run this task in order to use Conda. | 15:52 |
@wiking | but i dont think | 15:52 |
@wiking | gf712: that's not true in case of windows | 15:52 |
@wiking | :D | 15:52 |
@wiking | yeah that USE_CONDA is internal shit | 15:52 |
@wiking | https://github.com/fastai/fastai/blob/25ac1a62a2f8a630913366de39a6787f8dc580cd/azure-pipelines.yml#L303 | 15:53 |
@wiking | :D | 15:53 |
@wiking | but this is in re some envs perm | 15:53 |
gf712 | can try to activate environment with environmentName:? | 15:55 |
@wiking | ? | 15:55 |
gf712 | and see what happens? | 15:55 |
@wiking | there's no env | 15:55 |
@wiking | :) | 15:55 |
gf712 | well the only different is that though | 15:55 |
@wiking | and dont use CondaEnv task | 15:55 |
@wiking | it's a shit | 15:55 |
gf712 | if you look at the fastai pipeline | 15:56 |
@wiking | yes | 15:56 |
@wiking | its a shit | 15:56 |
@wiking | dont use that task | 15:56 |
gf712 | ok | 15:56 |
@wiking | see the github bug | 15:56 |
@wiking | that is linked in that pr | 15:56 |
@wiking | well fun times :))) | 15:56 |
@wiking | can u add a thing | 15:57 |
@wiking | echo $CONDA | 15:57 |
@wiking | as a step | 15:57 |
gf712 | yea | 15:57 |
gf712 | I'll do that | 15:57 |
@wiking | somewhere in the beginnign | 15:57 |
gf712 | haha | 15:57 |
gf712 | no | 15:57 |
@wiking | maybe that env is defined | 15:57 |
gf712 | just at the end :D | 15:57 |
@wiking | but plz | 15:58 |
@wiking | remove those env vars | 15:58 |
@wiking | CONDA_* | 15:58 |
gf712 | yup I did | 15:58 |
@wiking | kk | 15:58 |
@wiking | man creating a dll in fucking windows | 15:58 |
@wiking | is a pain | 15:58 |
gf712 | yup can imagine... | 15:59 |
gf712 | are you just testing it on azure or do you have a local windows to test? | 16:00 |
@wiking | both | 16:00 |
gf712 | wiking so $(CONDA) is there | 16:01 |
-!- Lefteris [~lefteris@2a05:b400:100:100:f9af:4903:155f:ef4c] has quit [Quit: Leaving] | 16:01 | |
@wiking | but sometimes it just way too slow | 16:01 |
@wiking | to run the whole thing | 16:01 |
gf712 | maybe I just do $(CONDA) install | 16:01 |
@wiking | in virtualenv | 16:01 |
gf712 | ah it's in a VM? | 16:01 |
@wiking | yes | 16:01 |
@wiking | dont have native windows | 16:01 |
@wiking | :D | 16:01 |
@wiking | ok so | 16:01 |
@wiking | $(CONDA)/bin/conda install | 16:01 |
@wiking | but yeah | 16:02 |
@wiking | highly unlikely that cmake will find that mkl | 16:02 |
@wiking | but lets see | 16:02 |
gf712 | yup | 16:02 |
@wiking | i cancelled the build | 16:02 |
gf712 | cool thanks | 16:02 |
gf712 | so what bugs are you getting with windows? | 16:03 |
@wiking | dll export shit | 16:03 |
gf712 | is it linking issues? | 16:03 |
@wiking | yes | 16:03 |
@wiking | 2019-02-14T14:20:18.0530626Z FactorGraph_unittest.obj : error LNK2001: unresolved external symbol "void * __cdecl shogun::sg_malloc(unsigned __int64)" (?sg_malloc@shogun@@YAPEAX_K@Z) [D:\a\1\s\build\tests\unit\shogun-unit-test.vcxproj] | 16:03 |
@wiking | etc | 16:03 |
@wiking | 2019-02-14T14:20:18.0605145Z lars_unittest.obj : error LNK2019: unresolved external symbol "public: __cdecl shogun::CLeastAngleRegression::CLeastAngleRegression(void)" (??0CLeastAngleRegression@shogun@@QEAA@XZ) referenced in function "private: virtual void __cdecl LeastAngleRegression_lasso_n_less_than_d_Test::TestBody(void)" (?TestBody@LeastAngleRegression_lasso_n_less_than_d_Test@@EEAAXXZ) [D:\a\1\s\build\tests\unit\sho | 16:03 |
@wiking | gun-unit-test.vcxproj] | 16:03 |
@wiking | and so forth and so on | 16:03 |
@wiking | but i crushed a lot already | 16:03 |
@wiking | so now the dll actually is there | 16:03 |
@wiking | it needs some more exports | 16:03 |
gf712 | oh is that what SHOGUN_EXPORT is for? | 16:04 |
@wiking | https://cmake.org/cmake/help/v3.3/module/GenerateExportHeader.html | 16:04 |
@wiking | windows story | 16:05 |
@wiking | :> | 16:05 |
gf712 | so that tells the linker to export all those symbols? | 16:06 |
@wiking | yes | 16:06 |
@wiking | but then this means | 16:06 |
@wiking | that our windows builds | 16:06 |
gf712 | but is only useful for ms? | 16:06 |
@wiking | were totally asdf | 16:06 |
@wiking | till now | 16:06 |
@wiking | :)))) | 16:06 |
gf712 | haha | 16:06 |
gf712 | but people used windows before no? | 16:07 |
@wiking | well | 16:07 |
@wiking | there's plenty of issues around | 16:07 |
@wiking | where people complain importing dll | 16:07 |
@wiking | :DDD | 16:07 |
@wiking | no wonder now why | 16:07 |
gf712 | but at some point it worked right? :p | 16:07 |
@wiking | dont think so | 16:07 |
@wiking | :> | 16:07 |
@wiking | welcome to a project | 16:07 |
@wiking | that nobody uses | 16:07 |
gf712 | oh hahaha | 16:07 |
@wiking | :D | 16:07 |
gf712 | need to make sure people use it in windows now | 16:08 |
@wiking | ok accelerate usese accelerate | 16:08 |
@wiking | lets see what does the mkl does | 16:08 |
@wiking | mmmm | 16:09 |
@wiking | man | 16:09 |
@wiking | just realised | 16:09 |
@wiking | we need to take care | 16:09 |
@wiking | about the ccache artifact naming | 16:09 |
@wiking | for the different macos | 16:09 |
@wiking | ;) | 16:09 |
@wiking | since they'll be different | 16:09 |
gf712 | yea... | 16:09 |
gf712 | install is working | 16:10 |
gf712 | but I forgot to put -y | 16:10 |
@wiking | ok i'll kill it after setup | 16:10 |
gf712 | so now I think its stuck :( | 16:10 |
@wiking | you think it'll hang now? | 16:10 |
@wiking | :D | 16:10 |
gf712 | damn | 16:10 |
gf712 | that sucks | 16:10 |
gf712 | ok | 16:10 |
@wiking | add --quite | 16:10 |
@wiking | as well | 16:10 |
gf712 | I need to check the flag | 16:10 |
gf712 | oh is that it | 16:10 |
gf712 | ah ok | 16:11 |
@wiking | i usally add that as well | 16:11 |
@wiking | ;) | 16:11 |
@wiking | shall i kill it? | 16:11 |
gf712 | conda config --set always_yes yes --set changeps1 no | 16:12 |
gf712 | shall I add that | 16:12 |
gf712 | yup kill it | 16:12 |
@wiking | killed | 16:12 |
@wiking | aaah this is overkill | 16:12 |
gf712 | maybe | 16:12 |
gf712 | just found it in one of my old projects | 16:13 |
gf712 | anyway I'll just add -y | 16:13 |
@wiking | --yes and --quite should be fine | 16:13 |
@wiking | or -y and -q | 16:13 |
@wiking | as u prefer | 16:13 |
gf712 | cool, let's see what happens... | 16:15 |
gf712 | wiking PermissionError: [Errno 13] Permission denied: '/usr/local/miniconda/.condatmp' | 16:22 |
@wiking | yeah | 16:23 |
@wiking | m$ | 16:23 |
@wiking | thnx a lot for this great shit | 16:23 |
@wiking | gf712: remember there was a chmod 777 | 16:23 |
@wiking | scrip | 16:23 |
@wiking | t | 16:23 |
@wiking | ;) | 16:23 |
@wiking | do that before the conda install | 16:24 |
@wiking | as the same task | 16:24 |
@wiking | - script: | | 16:24 |
gf712 | you mean https://github.com/fastai/fastai/blob/25ac1a62a2f8a630913366de39a6787f8dc580cd/azure-pipelines.yml#L303 | 16:24 |
@wiking | chmod | 16:24 |
@wiking | .... | 16:24 |
@wiking | yeah well | 16:24 |
@wiking | that is not really what you want | 16:24 |
@wiking | since again | 16:24 |
@wiking | hyou dont have an env | 16:24 |
@wiking | dunno really | 16:24 |
@wiking | this is a fucking shit | 16:24 |
@wiking | as usual | 16:24 |
@wiking | D: | 16:24 |
@wiking | you need to play with it until it works | 16:24 |
@wiking | but yeah | 16:25 |
@wiking | or | 16:25 |
@wiking | just | 16:25 |
@wiking | sudo conda install mkl-devel | 16:25 |
@wiking | that should do it btw | 16:25 |
@wiking | ;) | 16:25 |
gf712 | hmmm | 16:25 |
@wiking | seems u can get sudo on that machine | 16:25 |
@wiking | which is interesting | 16:25 |
@wiking | but yeah nevermind | 16:25 |
gf712 | but can you then access the files as a users | 16:25 |
@wiking | ;) | 16:25 |
@wiking | yea | 16:25 |
@wiking | read for sure | 16:25 |
gf712 | ok | 16:25 |
@wiking | its enought for us | 16:25 |
gf712 | the sudo is the same with travis | 16:25 |
gf712 | you can probably disable somewhere | 16:26 |
@wiking | brb | 16:26 |
gf712 | yup same | 16:27 |
gf712 | ttyl | 16:27 |
-!- gf712 [90520825@gateway/web/freenode/ip.144.82.8.37] has quit [Quit: Page closed] | 16:27 | |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection] | 16:29 | |
-!- wiking [~wiking@2001:67c:10ec:5784:8000::3ff] has joined #shogun | 16:29 | |
-!- wiking [~wiking@2001:67c:10ec:5784:8000::3ff] has quit [Changing host] | 16:29 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 16:29 | |
-!- mode/#shogun [+o wiking] by ChanServ | 16:29 | |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 264 seconds] | 16:34 | |
-!- linh [c112f012@gateway/web/freenode/ip.193.18.240.18] has joined #shogun | 16:46 | |
linh | Hi there, I got one question: What kind of file format do shogun support? Is shogun able to do text mining, image analytics etc. (advanced data analytics)? Thank you in advance | 16:48 |
-!- gf712 [90520825@gateway/web/freenode/ip.144.82.8.37] has joined #shogun | 17:29 | |
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun | 17:38 | |
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host] | 17:38 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 17:38 | |
-!- mode/#shogun [+o wiking] by ChanServ | 17:38 | |
gf712 | wiking so it didn't find mkl | 17:46 |
gf712 | but can force it | 17:46 |
gf712 | ~/anaconda3/lib/libmkl_core.dylib -DMKL_INCLUDE_DIR=~/anaconda3/include/ | 17:46 |
gf712 | even -DLAPACK_LIBRARIES=~/anaconda3/lib/libmkl_core.dylib -DMKL_INCLUDE_DIR=~/anaconda3/include/ | 17:46 |
gf712 | just need to fix path for azure | 17:47 |
-!- linh [c112f012@gateway/web/freenode/ip.193.18.240.18] has quit [Ping timeout: 256 seconds] | 17:49 | |
@wiking | expected | 17:51 |
@wiking | ok | 17:52 |
@wiking | that sounds good | 17:52 |
@wiking | well | 17:52 |
@wiking | the path is | 17:52 |
@wiking | $(CONDA) | 17:52 |
@wiking | :> | 17:52 |
@wiking | and that's the prefix | 17:52 |
@wiking | and i guess | 17:52 |
gf712 | yup | 17:52 |
@wiking | $(CONDA)/lib|include | 17:52 |
gf712 | that was just to test on my machine | 17:52 |
@wiking | did cmake detected it like that? | 17:52 |
gf712 | I think it used mkl before because it detects it with python | 17:52 |
@wiking | k | 17:53 |
gf712 | yes if I add those flags it works | 17:53 |
@wiking | ok so you wanna do this like | 17:53 |
@wiking | using a matrix variable | 17:53 |
gf712 | ah ok | 17:53 |
@wiking | cmakeOptions: '' | 17:53 |
@wiking | check swig | 17:53 |
@wiking | there i use this trick | 17:53 |
@wiking | and basically in the cmake command | 17:53 |
@wiking | just add | 17:53 |
@wiking | $(cmakeOptions) | 17:53 |
@wiking | so the right string will be added there | 17:54 |
@wiking | nomkl = empty string | 17:54 |
gf712 | ah ok I see | 17:54 |
gf712 | let's see what happens.. | 17:56 |
gf712 | I like that azure cancels the previous job from the same branch if a newer commit exists | 17:57 |
gf712 | I think travis just accumulated them | 17:57 |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection] | 17:58 | |
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has joined #shogun | 18:07 | |
-!- wiking [~wiking@c-185-45-237-122.customer.ggaweb.ch] has quit [Changing host] | 18:07 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 18:07 | |
-!- mode/#shogun [+o wiking] by ChanServ | 18:07 | |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Remote host closed the connection] | 18:09 | |
-!- gf712 [90520825@gateway/web/freenode/ip.144.82.8.37] has quit [Ping timeout: 256 seconds] | 18:11 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 18:11 | |
-!- mode/#shogun [+o wiking] by ChanServ | 18:11 | |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Ping timeout: 246 seconds] | 18:16 | |
-!- besser82 [~besser82@fedora/besser82] has quit [Quit: Freedom, Friends, Features, First [fedoraproject.org]] | 18:51 | |
-!- besser82 [~besser82@fedora/besser82] has joined #shogun | 18:55 | |
-!- mode/#shogun [+o besser82] by ChanServ | 18:55 | |
-!- wiking [~wiking@huwico/staff/wiking] has joined #shogun | 19:10 | |
-!- mode/#shogun [+o wiking] by ChanServ | 19:10 | |
-!- wiking [~wiking@huwico/staff/wiking] has quit [Client Quit] | 19:13 | |
-!- gf712 [560fc4e5@gateway/web/freenode/ip.86.15.196.229] has joined #shogun | 19:33 | |
-!- gf712 [560fc4e5@gateway/web/freenode/ip.86.15.196.229] has quit [Ping timeout: 256 seconds] | 19:38 | |
--- Log closed Fri Feb 15 00:00:11 2019 |
Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!