| --- Log opened Fri Dec 30 00:00:19 2011 | ||
| -!- blackburn [~blackburn@188.168.4.27] has quit [Quit: Leaving.] | 06:02 | |
| -!- in3xes [~in3xes@49.249.162.22] has joined #shogun | 15:46 | |
| -!- heiko [~heiko@host109-158-55-154.range109-158.btcentralplus.com] has joined #shogun | 17:21 | |
| -!- in3xes [~in3xes@49.249.162.22] has quit [Ping timeout: 240 seconds] | 17:32 | |
| -!- heiko [~heiko@host109-158-55-154.range109-158.btcentralplus.com] has quit [Ping timeout: 240 seconds] | 17:39 | |
| -!- heiko [~heiko@host109-158-55-154.range109-158.btcentralplus.com] has joined #shogun | 18:01 | |
| -!- heiko [~heiko@host109-158-55-154.range109-158.btcentralplus.com] has quit [Ping timeout: 276 seconds] | 18:06 | |
| -!- heiko [~heiko@host109-158-55-154.range109-158.btcentralplus.com] has joined #shogun | 18:45 | |
| -!- puneetgoyal [~puneetgoy@117.197.160.53] has joined #shogun | 19:36 | |
| -!- heiko [~heiko@host109-158-55-154.range109-158.btcentralplus.com] has quit [Ping timeout: 240 seconds] | 19:36 | |
| -!- blackburn1 [~blackburn@109.226.80.162] has joined #shogun | 19:56 | |
| -!- heiko [~heiko@host86-150-48-229.range86-150.btcentralplus.com] has joined #shogun | 19:57 | |
| blackburn1 | heiko: how do you do? | 19:58 |
|---|---|---|
| -!- blackburn1 [~blackburn@109.226.80.162] has quit [Quit: Leaving.] | 19:59 | |
| heiko | hej blackburn | 19:59 |
| heiko | I am fine :) | 19:59 |
| heiko | and you? | 19:59 |
| -!- Netsplit *.net <-> *.split quits: CIA-1 | 20:08 | |
| -!- Netsplit *.net <-> *.split quits: puneetgoyal | 20:19 | |
| -!- heiko [~heiko@host86-150-48-229.range86-150.btcentralplus.com] has quit [Ping timeout: 240 seconds] | 20:20 | |
| -!- Netsplit *.net <-> *.split quits: naywhayare | 20:23 | |
| -!- Netsplit *.net <-> *.split quits: @sonney2k, shogun-buildbot | 20:23 | |
| -!- Netsplit over, joins: puneetgoyal, CIA-1, naywhayare, @sonney2k, shogun-buildbot | 20:24 | |
| -!- heiko [~heiko@host86-167-55-27.range86-167.btcentralplus.com] has joined #shogun | 20:36 | |
| -!- blackburn [~blackburn@109.226.100.113] has joined #shogun | 20:48 | |
| puneetgoyal | blackburn: hi | 21:32 |
| -!- puneetgoyal [~puneetgoy@117.197.160.53] has quit [Quit: Leaving] | 21:43 | |
| -!- puneetgoyal [~chatzilla@117.197.160.53] has joined #shogun | 22:52 | |
| blackburn | puneetgoyal: hi | 23:05 |
| -!- in3xes [~in3xes@180.149.49.230] has joined #shogun | 23:06 | |
| puneetgoyal | blackburn: I have calculated the tf-idf values for every word in every payload of every email.....but I am confused on the representation of them | 23:07 |
| blackburn | puneetgoyal: nice | 23:07 |
| blackburn | well just store it as matrix | 23:07 |
| blackburn | choose e.g. 10 of them | 23:07 |
| blackburn | with highest tf-idf | 23:07 |
| puneetgoyal | so should I consider the tf-idf value of a word for different documents, or take some average? | 23:08 |
| puneetgoyal | I mean a lot of documents will have same word...and each of them will have a different value... | 23:09 |
| blackburn | hmm yes | 23:09 |
| -!- heiko [~heiko@host86-167-55-27.range86-167.btcentralplus.com] has quit [Ping timeout: 240 seconds] | 23:09 | |
| blackburn | I don't know what is the best way | 23:09 |
| puneetgoyal | how will it work if we have different values for a same word.. | 23:10 |
| blackburn | ehm? can't see any problem | 23:10 |
| puneetgoyal | please elaborate | 23:10 |
| blackburn | puneetgoyal: ok consider you have calculated td-idfs | 23:11 |
| blackburn | then you can choose some of them | 23:12 |
| blackburn | e.g. 3 | 23:12 |
| blackburn | X,Y,Z | 23:12 |
| puneetgoyal | ok | 23:12 |
| blackburn | then feature vector for document | 23:12 |
| blackburn | is tf-idfs of X,Y,Z respectively | 23:12 |
| blackburn | got it? | 23:12 |
| puneetgoyal | yeah | 23:12 |
| blackburn | I am not sure it is the best way | 23:13 |
| blackburn | but would work | 23:13 |
| puneetgoyal | hmm..ok | 23:13 |
| blackburn | the only heuristics is how to choose words | 23:14 |
| -!- in3xes [~in3xes@180.149.49.230] has quit [Quit: Leaving] | 23:16 | |
| -!- puneetgoyal [~chatzilla@117.197.160.53] has quit [Remote host closed the connection] | 23:17 | |
| blackburn | cu | 23:21 |
| -!- blackburn [~blackburn@109.226.100.113] has quit [Quit: Leaving.] | 23:21 | |
| -!- puneetgoyal [~puneetgoy@117.197.160.53] has joined #shogun | 23:21 | |
| --- Log closed Sat Dec 31 00:00:19 2011 | ||
Generated by irclog2html.py 2.10.0 by Marius Gedminas - find it at mg.pov.lt!