IRC Logs for #circuits Sunday, 2014-04-13

prologic_pdurbin, no it hasn't :) hehe00:52
prologic_I've only resurrected it recently (last couple of days/nights)00:52
prologic_but yeah it's back now :)00:52
prologic_and rock'n 'n roll'n :)00:52
prologichi robert_00:52
prologic@uptime00:52
kdbUptime: 0+20:53:19 (CPU: 72.11s 0.10%)00:52
prologic@errors00:52
kdbErrors: 200:52
prologic@help ctcp00:56
kdbIRC CTCP Events Plugin00:56
kdb    This plugin provides responses to IRC CTCP Events and00:56
kdb    responds to them appropiately.00:56
kdb    NOTE: There are no commands for this plugin (yet).00:56
prologicpdurbin, it also has a web interface :)00:57
prologichttp://arrow.shortcircuit.net.au:9000/00:57
robert_hai.01:59
robert_how goes it?02:00
*** pdurbin has quit IRC03:35
*** An_Ony_Moose has quit IRC03:35
*** kdb has quit IRC03:35
*** prologic has quit IRC03:35
*** LeuX has quit IRC03:35
*** c45y has quit IRC03:35
*** epicmuffin has quit IRC03:35
*** robert_ has quit IRC03:35
*** koobs has quit IRC03:35
*** edk has quit IRC03:36
*** robert_ has joined #circuits04:46
*** koobs has joined #circuits04:46
*** c45y has joined #circuits04:46
*** epicmuffin has joined #circuits04:46
*** c45y has quit IRC04:57
*** epicmuffin has quit IRC04:57
*** robert_ has quit IRC04:57
*** koobs has quit IRC04:57
*** pdurbin has joined #circuits05:13
*** robert_ has joined #circuits05:13
*** patx_ has joined #circuits05:15
*** spaceone has joined #circuits05:15
*** FSX has joined #circuits05:15
*** edk has joined #circuits05:16
*** LeuX has joined #circuits05:16
*** epicmuffin has joined #circuits05:16
*** An_Ony_Moose has joined #circuits05:16
*** ninkotech has joined #circuits05:16
*** ircnotifier has joined #circuits05:17
*** Romster has joined #circuits05:17
*** prologic has joined #circuits05:17
*** kdb has joined #circuits05:17
*** realzies has joined #circuits05:17
kdbHey ninkotech05:19
kdbHey an_ony_moose05:19
kdbHey epicmuffin05:19
kdbHeya leux05:19
kdbHeya edk05:19
kdbYo fsx05:19
kdbHeya spaceone05:19
kdbHeya patx_05:19
kdbWelcome back robert_ :)05:19
kdbYo pdurbin05:19
kdbWelcome back irclogger_ :)05:19
kdbHody ircnotifier05:19
kdbHeya romster05:19
robert_prologic: hai.. again. :p05:30
*** koobs has joined #circuits05:31
*** c45y has joined #circuits05:31
kdbHeya koobs05:31
kdbHi c45y05:31
*** Osso has joined #circuits05:48
kdbHeya osso05:49
koobskdb: o/~06:07
kdbUnknown Command: o/~06:07
Romster@kdb weather portland victoria 330506:12
kdbUnknown Command: kdb06:12
Romsterhmm06:12
*** LeuX has quit IRC06:13
*** LeuX has joined #circuits06:14
*** LeuX has quit IRC06:34
prologicheya realzies06:35
prologic@google portland victoria metar code06:35
kdbTotal results: 27206:35
kdbTop 4 hits:06:35
kdb 1. http://www.garfnet.org.uk/joomla/index.php%3Foption%3Dcom_content%26view%3Darticle%26id%3D121:global-metar-stations-over-3000-of-them%26catid%3D2:reference-tables%26Itemid%3D6006:35
kdb 2. http://www.cnrfc.noaa.gov/metar.php06:35
kdb 3. https://play.google.com/store/apps/details%3Fid%3Dcom.airportcode06:35
kdb 4. https://play.google.com/store/apps/details%3Fid%3Dde.apps2go.flightcode06:35
kdbFor more results, see: http://www.google.com/search?oe=utf8&ie=utf8&source=uds&start=0&hl=en&q=portland+victoria+metar+code06:35
prologic@weather YMML06:38
kdbWeather report for Melbourne Airport, Australia (YMML) as of 2014-04-13 06:00:00Z06:38
kdbWeather: Scattered clouds06:38
kdbSky: partly cloudy06:38
kdbTemperature: 19.00 C / 66.00 F06:38
kdbHumidity: 59%06:38
kdbWind: 6.71 m/s [170 deg (S)]06:38
kdbPressure: 1019 hPa06:38
kdbDew: 11.000000 C / 51.000000 F06:38
prologicrobert_, I think that's your closest no?06:38
prologic@part #kdb06:39
*** LeuX has joined #circuits06:47
robert_prologic: hmm?07:10
robert_@weather PIE07:11
kdbERROR: Could not get weather report for PIE: HTTP Error 404: Not Found07:11
robert_@weather TPA07:11
kdbERROR: Could not get weather report for TPA: HTTP Error 404: Not Found07:11
robert_@weather TIA07:11
kdbERROR: Could not get weather report for TIA: HTTP Error 404: Not Found07:11
robert_you don't have 'states weather :p07:11
robert_@weather 3371407:11
kdbERROR: Could not get weather report for 33714: HTTP Error 404: Not Found07:11
robert_@weather KTPA07:12
kdbERROR: Unknown format code 'd' for object of type 'str': ('weather KTPA')07:12
robert_@weather KPSG07:13
kdbERROR: Could not get weather report for KPSG: HTTP Error 404: Not Found07:13
robert_@weather KSPG07:13
kdbWeather report for ST PETERSBURG WHITTED AIRPORT , FL, United States (KSPG) as of 2014-04-13 06:53:00Z07:14
kdbWeather: Clear sky07:14
kdbSky: clear07:14
kdbTemperature: 21.70 C / 71.10 F07:14
kdbHumidity: 78%07:14
kdbWind: 4.47 m/s [100 deg (E)]07:14
kdbPressure: 1019 hPa07:14
kdbDew: 17.800000 C / 64.000000 F07:14
robert_@weather KTAP07:14
kdbERROR: Could not get weather report for KTAP: HTTP Error 404: Not Found07:14
robert_@weather KTPA07:14
kdbERROR: Unknown format code 'd' for object of type 'str': ('weather KTPA')07:14
robert_L:p07:14
robert_:p **07:15
robert_it's 71F here?07:16
robert_Not bad.07:16
*** edk has quit IRC07:18
*** edk has joined #circuits07:18
kdbWelcome back edk :)07:18
*** ChanServ has joined #circuits07:18
kdbHeya chanserv07:18
prologicrobert_, hehe07:34
prologicyeah it only knows about METAR gobal weather staiion codes07:35
prologicor at least that's the only service it looks up07:35
prologicif you know of any other useful services with nice AJAX or similar API(s) I could include those too :)07:35
prologic@errors07:35
kdbErrors: 407:35
prologichmm07:35
prologicnot really sure those should be countered as errors07:36
prologicheh07:36
prologicshould capture them a bit better07:36
prologic@uptime07:36
kdbUptime: 1+3:36:45 (CPU: 95.44s 0.10%)07:36
Romster@google romster crux07:42
kdbTotal results: 1030007:42
kdbTop 4 hits:07:42
kdb 1. http://crux.ster.so/ports/romster/07:42
kdb 2. http://crux.nu/portdb/07:42
kdb 3. http://crux.nu/Main/About07:42
kdb 4. http://irclogs.shortcircuit.net.au/%2523crux-devel/2013-12-27.log.html07:42
kdbFor more results, see: http://www.google.com/search?oe=utf8&ie=utf8&source=uds&start=0&hl=en&q=romster+crux07:42
Romstermuch better07:42
Romsterhmm why did it link to that log file i'm mentioned everywhere in the logs07:43
Romsterheh and that log url is not found07:43
Romster%2523 #07:44
Romsterhttp://irclogs.shortcircuit.net.au/%23crux-devel/2013-12-07.log.html i'm not even in that file... weird google.07:45
prologicwtf is %2523?07:52
prologicit should just be %2307:52
prologicapparently %25 is %07:53
prologichmmm07:53
prologic@reload google07:56
kdbUnloaded plugin: google07:56
kdbLoaded plugin: Google07:56
prologic@google james mills prologic07:56
kdbTotal results: 81507:56
kdbTop 4 hits:07:56
kdb 1. https://bitbucket.org/prologic07:56
kdb 2. http://prologic.shortcircuit.net.au/07:56
kdb 3. https://github.com/therealprologic07:56
kdb 4. https://twitter.com/therealprologic07:56
kdbFor more results, see: http://www.google.com/search?oe=utf8&ie=utf8&source=uds&start=0&hl=en&q=james+mills+prologic07:56
prologic@google romster crux07:56
kdbTotal results: 1030007:56
kdbTop 4 hits:07:56
kdb 1. http://crux.ster.so/ports/romster/07:56
kdb 2. http://crux.nu/portdb/07:56
kdb 3. http://crux.nu/Main/About07:56
kdb 4. http://irclogs.shortcircuit.net.au/%23crux-devel/2013-12-27.log.html07:56
kdbFor more results, see: http://www.google.com/search?oe=utf8&ie=utf8&source=uds&start=0&hl=en&q=romster+crux07:56
prologicthat's better07:56
prologicnow that kdb is ported to circuits 3.0 and stable08:18
prologicI might think about integrating the codebases of ircnotifier and irclogger into kdb as pulgins08:19
Romsterah you fixed the html urlcode stuff cool08:25
Romsteri thought of that ages ago never told you though08:25
prologicI was just using the wrong key from the json result coming back from the google search ajax api08:25
prologic:)08:25
prologicurl vs. unescapedUrl08:26
prologicall good08:26
Romsterthough its also probably nice to keep one seperate as an example of how to write a bot from scratch with circuits.08:26
Romsteras well as a module to kdb08:26
prologicthat's why there's examples/ircbot.py08:26
prologic@google circuits examples ircbot.py08:26
kdbTotal results: 59508:26
kdbTop 4 hits:08:26
kdb 1. http://eli.thegreenplace.net/2013/01/28/twisted-based-irc-server-example/08:26
kdb 2. http://trac-hacks.org/ticket/195208:26
kdb 3. http://null-byte.wonderhowto.com/inspiration/community-byte-coding-irc-bot-python-for-beginners-0130713/08:26
kdb 4. http://code.google.com/p/go-wiki/wiki/Projects08:26
kdbFor more results, see: http://www.google.com/search?oe=utf8&ie=utf8&source=uds&start=0&hl=en&q=circuits+examples+ircbot.py08:26
prologicbah08:27
prologic@google python circuits examples ircbot.py08:27
kdbTotal results: 14208:27
kdbTop 4 hits:08:27
kdb 1. http://eli.thegreenplace.net/2013/01/28/twisted-based-irc-server-example/08:27
kdb 2. http://null-byte.wonderhowto.com/inspiration/community-byte-coding-irc-bot-python-for-beginners-0130713/08:27
kdb 3. http://null-byte.wonderhowto.com/inspiration/goodnight-byte-coding-irc-bot-python-for-beginners-0130901/08:27
kdb 4. http://hawkee.com/snippet/5490/08:27
kdbFor more results, see: http://www.google.com/search?oe=utf8&ie=utf8&source=uds&start=0&hl=en&q=python+circuits+examples+ircbot.py08:27
prologicbah :)08:27
prologichttps://bitbucket.org/circuits/circuits/src/tip/examples/ircbot.py08:27
prologicif I'm going to integrate irclogger into kdb as a plugin08:27
prologicI would like to either find a better UI for it08:28
prologicfor viewing and searching logs08:28
prologicor implement one myself08:28
prologicbbs dinner time08:28
Romsteri'd like to see duckduckgo searches too.08:32
Romsteri use that as my primary search and if i want goodle i use the shebang !g08:32
Romsters/goodle/google/08:32
Romsteroh a plugin i'd love to see is when one does a regex like that ^08:32
Romsterthe bot replies with08:33
RomsterRomster, meant to say: i use that as my primary search and if i want google i use the shebang !g08:33
Romsteri seen other bots do that.08:33
prologicreally?08:58
prologichmm08:58
prologicwell08:58
prologicyou could code one up :)08:58
*** c45y has quit IRC09:18
*** koobs has quit IRC09:18
*** ChanServ has quit IRC09:18
*** ChanServ has joined #circuits09:19
*** koobs has joined #circuits09:19
*** c45y has joined #circuits09:19
kdbWelcome back chanserv :)09:19
kdbWelcome back koobs :)09:19
kdbWelcome back c45y :)09:19
Romstermaybe i can but i'm working more on my version-sort10:12
Romster$ ./lsurl.py --common-ext http://crux.ster.so/distfiles/ | ./filter-tool.py --show-stats --print-sorted --synchronous-debug |wgetpaste10:23
RomsterYour paste can be seen here: https://gist.github.com/1057796310:23
Romsterwhat do you think so far prologic ?10:23
prologicRomster, hmmm?10:56
prologicyou wrote lsurl.py and filter-tool.py?10:56
prologicseems okay the output10:56
Romstera friend did, i gave him my bash stuff and the showed how i wanted it and he wrote that. he is too busy to contunue but i'm so far working on the rules myself for filtering.11:02
Romsteryou already know what i'll do with it.11:02
prologicanyway I'm off to bed11:09
prologicnight11:09
Romsterg'night11:13
prologicnope not tired yet11:24
prologic:)11:24
prologic*sigh*11:24
prologic@uptime11:24
kdbUptime: 1+7:25:31 (CPU: 109.85s 0.10%)11:24
prologicwhat shall I work on now11:25
prologic@load xmlrpc11:39
kdbCould not load plugin: XMLRPC Error: maximum recursion depth exceeded while calling a Python object11:39
prologic@load xmlrpc11:40
kdbLoaded plugin: XMLRPC11:40
prologicgeez11:41
prologic10s ping from kdb11:41
prologic@jump rajaniemi.freenode.net11:41
*** kdb has quit IRC11:41
*** kdb has joined #circuits11:42
prologic@events11:43
kdbEvents: 1766911:43
prologicfarkk11:43
prologicwtf is wrong with FreeNode11:43
prologiceven ChanServ is responding slowly11:44
prologic@reload xmlrpc11:46
kdbUnloaded plugin: xmlrpc11:46
kdbLoaded plugin: XMLRPC11:46
prologic@load rmessage12:02
kdbLoaded plugin: RMessage12:02
prologic@reload xmlrpc12:02
kdbUnloaded plugin: xmlrpc12:03
kdbLoaded plugin: XMLRPC12:03
prologic@reload rmessages12:03
kdbPlugin rmessages is not loaded!12:03
prologic@load rmessage12:03
kdbPlugin rmessage already loaded!12:03
prologic@reload rmessage12:03
kdbUnloaded plugin: rmessage12:03
kdbLoaded plugin: RMessage12:03
prologic@reload rmessage12:04
kdbUnloaded plugin: rmessage12:04
kdbLoaded plugin: RMessage12:04
kdb<prologic@daisy> Test from daisy12:04
prologicf'n awesome12:04
Romsterthought you were going to bed <<12:08
prologicnah12:08
prologicgot xmlrpc and remote messages going with kdb12:09
prologic@rlog12:09
prologic@reload rmessage12:10
kdbUnloaded plugin: rmessage12:10
kdbLoaded plugin: RMessage12:10
prologic@rlog12:10
kdbLast 5 Remote Messages:12:10
kdb 0: Test12:10
kdb 1: Test12:10
kdb 2: Test from daisy12:10
prologic@reload rmessage12:12
kdbUnloaded plugin: rmessage12:12
kdbLoaded plugin: RMessage12:12
prologic@rlog12:12
kdbLast 5 Remote Messages:12:12
kdb 1: Test12:12
kdb 2: Test12:12
kdb 3: Test from daisy12:12
prologic@reload xmlrpc12:14
kdbUnloaded plugin: xmlrpc12:14
kdbLoaded plugin: XMLRPC12:14
kdb<prologic@daisy> Test from daisy12:14
prologic@load scmupdate12:24
kdbLoaded plugin: SCMUpdate12:24
kdb<prologic@daisy> test12:40
*** testkdb has joined #circuits12:48
kdbHi testkdb12:48
prologictestkdb, load broadcast12:48
testkdbLoaded plugin: Broadcast12:48
prologic@status12:48
testkdbIRC: Online12:48
kdbIRC: Online12:48
kdbWeb: Online12:48
prologictestkdb, die12:48
*** testkdb has quit IRC12:48
prologic@google slashdot rss feed13:30
kdbTotal results: 61300013:30
kdbTop 4 hits:13:30
kdb 1. http://slashdot.org/faq/feeds.shtml13:30
kdb 2. http://slashdot.org/13:30
kdb 3. https://slashdot.org/faq13:30
kdb 4. http://www.thefreedictionary.com/_/rss-directory.htm13:30
kdbFor more results, see: http://www.google.com/search?oe=utf8&ie=utf8&source=uds&start=0&hl=en&q=slashdot+rss+feed13:30
prologic@load rss13:31
kdbCould not load plugin: rss Error: invalid syntax (rss.py, line 276)13:31
prologic@load rss13:32
kdbCould not load plugin: rss Error: 'return' with argument inside generator (rss.py, line 142)13:32
prologic@load rss13:33
kdbCould not load plugin: rss Error: No module named protocols.irc13:33
prologic@load rss13:36
kdbCould not load plugin: rss Error: No module named feedparser13:36
prologic@load rss13:37
kdbCould not load plugin: rss Error: cannot import name decodeHTML13:37
prologic@load rss13:40
kdbCould not load plugin: rss Error: invalid syntax (rss.py, line 74)13:40
prologic@load rss13:41
kdbLoaded plugin: RSS13:41
prologic@radd http://rss.slashdot.org/Slashdot/slashdot 513:41
kdbUnknown Command: radd13:42
prologic@reload rss13:42
kdbUnloaded plugin: rss13:42
kdbLoaded plugin: RSS13:42
prologic@radd http://rss.slashdot.org/Slashdot/slashdot 513:42
prologic@reload rss13:43
kdbUnloaded plugin: rss13:43
kdbLoaded plugin: RSS13:43
prologic@radd http://rss.slashdot.org/Slashdot/slashdot 513:43
prologic@reload rss13:44
kdbUnloaded plugin: rss13:44
kdbLoaded plugin: RSS13:44
prologic@radd http://rss.slashdot.org/Slashdot/slashdot 513:44
kdbRSS: Slashdot (http://slashdot.org/)13:44
kdb * Obama Says He May Or May Not Let the NSA Exploit the Next Heartbleed: An anonymous reader writes "The White House has joined the public debate about <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/di8MGaUGAUI/story01.htm>13:44
kdb * Why the IETF Isn't Working: An anonymous reader writes "Vidya Narayanan spent seven years working on the <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/zOj6lV_VS_8/story01.htm>13:44
kdb * Titanfall</em> Dev Claims Xbox One Doesn't Need DX12 To Improve Performance: MojoKid writes: "One of the hot topics in the wake of Titanfall's launch has <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/9tkVsNOiOMw/story01.htm>13:44
prologic@rlist13:44
kdbERROR: Unknown format code 'd' for object of type 'float': ('rlist')13:44
prologic@reload rss13:45
kdbUnloaded plugin: rss13:45
kdbLoaded plugin: RSS13:45
prologic@rlist13:45
kdbRSS Feeds ((u'prologic', u'~prologic', u'unaffiliated/prologic')):13:45
kdb 1. Slashdot (http://slashdot.org/)/5mins (Next Update in 2mins)13:45
kdb 2. Slashdot (http://slashdot.org/)/5mins (Next Update in 3mins)13:45
prologic@rdel 213:45
kdbFeed 2 deleted.13:46
prologic@rlist13:46
kdbRSS Feeds ((u'prologic', u'~prologic', u'unaffiliated/prologic')):13:46
kdb 1. Slashdot (http://slashdot.org/)/5mins (Next Update in 1mins)13:46
prologic@reload rss13:47
kdbUnloaded plugin: rss13:47
kdbLoaded plugin: RSS13:47
prologic@rlist13:47
kdbERROR: sourceJoin() takes exactly 3 arguments (1 given): ('rlist')13:47
prologic@reload rss13:47
kdbUnloaded plugin: rss13:47
kdbLoaded plugin: RSS13:47
prologic@rlist13:47
kdbUnknown Command: rlist13:47
prologic@load rss13:48
kdbPlugin rss already loaded!13:48
prologic@reload rss13:48
kdbUnloaded plugin: rss13:48
kdbLoaded plugin: RSS13:48
prologic@rlist13:48
kdbRSS Feeds (prologic!~prologic@unaffiliated/prologic):13:48
kdb 1. Slashdot (http://slashdot.org/)/5mins (Next Update in 0mins)13:48
pdurbinyeah, I think I would have noticed kdb13:48
prologic@reload rss13:49
kdbUnloaded plugin: rss13:49
kdbLoaded plugin: RSS13:49
prologichey pdurbin :)13:50
prologicyeah it's been a bit neglected for a long while13:50
pdurbino/13:50
pdurbinnot anymore, apparently13:50
prologicI thought it was about time to resurrect it in time for circuits 3.0 :)13:50
prologichehe13:50
prologic@rlist13:50
kdbUnknown Command: rlist13:50
prologic@load rss13:50
pdurbinoh? 3.0 is nigh?13:50
kdbPlugin rss already loaded!13:50
prologic*nods*13:50
prologicvery nigh13:50
prologic@rlist13:50
kdbUnknown Command: rlist13:50
prologic@commands rss13:51
kdbERROR: 'rss': ('commands rss')13:51
prologic@reload rss13:52
kdbUnloaded plugin: rss13:52
kdbLoaded plugin: RSS13:52
prologic@rlist13:52
kdbNo feeds available.13:52
prologic@radd http://rss.slashdot.org/Slashdot/slashdot13:52
kdbRSS: Slashdot (http://slashdot.org/)13:52
kdb * US Takes Out Gang That Used Zeus Malware To Steal Millions: coondoggie (973519) writes "The US Department of Justice charged nine members <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/T-dyJv5GFno/story01.htm>13:52
kdb * Obama Says He May Or May Not Let the NSA Exploit the Next Heartbleed: An anonymous reader writes "The White House has joined the public debate about <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/di8MGaUGAUI/story01.htm>13:52
kdb * Why the IETF Isn't Working: An anonymous reader writes "Vidya Narayanan spent seven years working on the <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/zOj6lV_VS_8/story01.htm>13:52
prologic@rlist13:53
kdbRSS Feeds (#circuits):13:53
kdb 1. Slashdot (http://slashdot.org/)/60mins (Next Update in 59mins)13:53
prologicahh13:53
prologicthat's better13:53
prologiccontextually aware rss feed plugin13:53
prologici.e: feeds per whoever asks for them13:53
prologicnow I guess we wain 2mins and see what blows up13:53
prologicor doesn't :)13:53
prologic@timer 5 boo13:54
kdbTimer set for 5s13:54
kdbboo13:54
prologic@timer set 120 foobar13:59
kdbInvalid duration specified!13:59
prologic@timer 120 foobar13:59
kdbTimer set for 120s13:59
prologicthen again13:59
prologichow often does Slashdot see new articles :013:59
prologic@events13:59
kdbEvents: 2174213:59
prologic@nstats13:59
kdbTraffic: 58.25KB / 36.61KB (94.85KB)13:59
kdbfoobar14:01
prologichmmm14:06
prologic@rlist14:09
kdbRSS Feeds (#circuits):14:09
kdb 1. Slashdot (http://slashdot.org/)/60mins (Next Update in 43mins)14:09
prologicoh14:10
prologicbugger this I ain't waiting that long14:10
prologicI'm going to bed :)14:10
Romsterhuh?14:50
Romsteroh lol that update14:50
Romstercrawl --max_depth=5 --whitelist=http://sourceforge.net/projects/xine/files/xine-lib/ http://sourceforge.net/projects/xine/files/xine-lib/ |egrep '/download$'14:50
Romsterno results i was expecting a list of files.14:51
Romsterif i go into a directory with the files i get the result i want14:51
Romster$ crawl --max_depth=5 --whitelist=http://sourceforge.net/projects/xine/files/xine-lib/ http://sourceforge.net/projects/xine/files/xine-lib/1.2.5/ |egrep '/download$'14:51
RomsterQ: 439 F: 5 V: 5 L: 443http://sourceforge.net/projects/xine/files/xine-lib/1.2.5/README.txt/download14:51
Romsterhttp://sourceforge.net/projects/xine/files/xine-lib/1.2.5/README.txt.asc/download14:51
Romsterhttp://sourceforge.net/projects/xine/files/xine-lib/1.2.5/xine-lib-1.2.5.tar.xz/download14:51
Romsteri get the file there but if i'm a directory above that i would like to collect all the files.14:52
Romsteris sourceforge doing something to prevent following urls.14:52
Romsterhttp://sourceforge.net/projects/xine/files/xine-lib/1.2.5/14:52
Romsterhttp://sourceforge.net/projects/xine/files/xine-lib/1.2.5/stats/timeline14:52
Romsterhttp://sourceforge.net/projects/xine/files/xine-lib/1.2.4/14:52
Romsterhttp://sourceforge.net/projects/xine/files/xine-lib/1.2.4/stats/timeline14:52
Romsterhttp://sourceforge.net/projects/xine/files/xine-lib/1.2.3/14:52
Romsterare the type of urls i'm trying to spider.14:53
kdbRSS: Slashdot (http://slashdot.org/)14:53
kdb * Apple's Spotty Record of Giving Back To the Tech Industry: chicksdaddy (814965) writes "Given Apple's status as the world's most valuable <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/uWMvWlFrl3c/story01.htm>14:53
prologicoh hey Romster14:55
prologicdid it update the feed? :)14:55
Romsteri see the14:55
Romster<kdb> RSS: Slashdot (http://slashdot.org/)14:55
Romster<kdb>  * Apple's Spotty Record of Giving Back To the Tech Industry: chicksdaddy (814965) writes "Given Apple's status as the world's most valuable <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/uWMvWlFrl3c/story01.htm>14:55
Romsterbut you can probably see the backlog?14:56
Romsteryour spider is not following sourceforge urls like i need it too.14:56
prologicyeah14:56
prologic:)14:56
prologichaving problems with my crawler?14:57
prologicare you giving the right options?14:57
Romsteryes you see the back log?14:57
prologichold on14:57
Romsterhttp://irclogs.shortcircuit.net.au/%23circuits/latest.log.html#t14:50:3314:58
prologicthat's not a valid whitelist14:58
prologicwhitelist and blkaclist options takena python regex expression14:58
Romsteri noticed that.14:58
prologicand match is used14:58
Romsteroh14:58
prologicso you have to use exact regexes14:58
prologicI dno't recommend you try to restrict your crawl jst yet14:58
prologicfirst get a crawl working at all14:58
Romster--whitelist=".*sourceforge.net.*" ?14:59
Romsterk i wont restrict just yet14:59
prologic--whitelist='^.*sourceforge\.net.*$"14:59
prologicis more valid14:59
prologicit has to be valid python regex :)14:59
prologicanyway14:59
Romstercrawl --max_depth=5 http://sourceforge.net/projects/xine/files/xine-lib/1.2.5/ |egrep '/download$'14:59
prologictry without first14:59
Romsterhttp://sourceforge.net/projects/xine/files/xine-lib/1.2.5/README.txt.asc/download14:59
prologicthen try whtie/black lists14:59
Romsterthat works as i need it14:59
prologicyou can specify a pattern of urls you want too15:00
Romsterbut if i do a directory before the version directories and try to collect them all it wont list any files.15:00
prologicmeaning you don't need to pipe it out to grep15:00
Romsterright15:00
Romsteri was being lazy there15:00
prologicprobably because it's not linked?15:00
prologicit'll only find what links there are15:00
prologicfollow them15:01
prologicfind more links15:01
prologicetc15:01
Romsterbut it shows http://sourceforge.net/projects/xine/files/xine-lib/1.2.4/ such lines15:01
Romsterit just wont go into that directory and look15:01
prologicwhy max depth of 5?15:01
Romsteri just kept uping it to see when it might get to them files i was epecting a max depth of 1 to be enough15:02
prologicno15:02
prologicmax-depth means it'll stop following after the specified no.15:03
Romsteri realise that15:03
prologicyou want to remove this restriction too unless you absolutely know how deep things are ;)15:03
prologicspyda it far too flexible :)15:03
Romstercrawl --whitelist="^.*sourceforge\.net.*$" --pattern="/download$" http://sourceforge.net/projects/xine/files/xine-lib/15:04
Romsternow that's taking forever :D15:05
prologichaha15:10
prologicit takes a while to get right15:10
Romsterit got some exception but it was jsut crawling indeffently15:12
Romsterit's seriously flawed it wont crawl the links i want i know i arn't doing it wrong.15:13
prologicI doubt that it's flawd :)15:24
prologicmore like sourceforge is giving you a hard time15:24
prologicit also doesn't fake it's own identity either15:24
prologicso websites may (or may not) block the crawling15:24
prologicalso if you find a bug15:24
prologicreport it and I'll fix it :)15:24
prologicotherwise it's 100% unit tests15:24
Romstercrawl --max_depth=2 --whitelist="^.*sourceforge\.net.*$" --pattern="/download$" http://sourceforge.net/projects/xine/files/xine-lib/15:26
Romsterno results i should have all them 1.2.3/file-1.2.3.tar.bz2/download files off that list.15:27
Romstermore spefficly */foo-1.2.3.tar.bz2 files off all them versioned directories15:27
Romsterand i get none15:27
Romsterit's not transversing them directories15:27
Romsterhttp://pastebin.com/A7t8Ys4f15:28
Romsterthem directories it's not even looking in them15:28
Romsterit should be going though all those.15:29
Romsterif i go thought them directories in the spider it lists the files.15:31
Romsteri'll mess with this later.15:38
kdbRSS: Slashdot (http://slashdot.org/)15:54
kdb * The GNOME Foundation Is Running Out of Money: An anonymous reader writes "The GNOME Foundation is running out of money. The <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/WHIMkAdzgtI/story01.htm>15:54
kdbRSS: Slashdot (http://slashdot.org/)16:55
kdb * Anyone Can Buy Google Glass April 15: An anonymous reader writes "Starting at 9 a.m. ET on April 15 anyone in the US <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/tDUcQzIorBY/story01.htm>16:55
kdbRSS: Slashdot (http://slashdot.org/)18:57
kdb * Private Keys Stolen Within Hours From Heartbleed OpenSSL Site: Billly Gates (198444) writes "It was reported when heartbleed was discovered <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/grwWWwyPbkQ/story01.htm>18:57
*** robert_ has quit IRC19:15
kdbRSS: Slashdot (http://slashdot.org/)19:58
kdb * Is Germany Raising a Generation of Illiterates?: StartsWithABang (3485481) writes "Over at Starts With A Bang, the weekly <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/v5AUl6M-sus/story01.htm>19:58
prologicRomster, if the website uses Javascript the bot won't be able to render the pages correctly19:59
prologicthat could be the problem perhaps19:59
Romsterthought of that but the it wouldn't list it in the output http://pastebin.com/A7t8Ys4f20:02
Romsterall that would be missing20:02
Romsterit's there the spider refuses to go looking in them directories.20:02
Romsterif i use the spider in a directory it then shows the file.20:02
Romsterso some sort of parsing issue.20:03
prologicthat's my point though20:19
prologictry with elinks or curl20:20
prologicdo those directories even have valid hrefs?20:20
prologicif they don't the bot can't follow them20:20
prologicif they're like:20:20
prologic<a href="#dir1">dir1</a>20:20
prologicthere's nothing to follow20:20
prologicas that'll be a client-side only refereenacable lnik20:20
*** marky1991 has joined #circuits20:29
kdbHello marky199120:29
marky1991hi20:30
*** marky1991 has quit IRC20:30
*** marky1991 has joined #circuits20:30
*** marky1991 has quit IRC20:30
*** marky1991 has joined #circuits20:30
marky1991Has anyone here used the node module?20:32
marky1991I'm a liuttle confused by the example that uses it. In one example, nodeserver.py, the code just registers the NodeServer with a Node. But in the node module, there's a NodeServer class (There's also a NodeClient class). Are you supposed to use Nodes or are you supposed to use the NodeServer/Client classes20:34
marky1991?20:34
marky1991The server/client appear to just be wrappers anyway20:34
marky1991oops, the clienht is not a wrapper.20:35
marky1991Scratch the wrapper business. I just looked at the code and there is definietly unique functionality for them both. IO was misremembering what I saw previously20:36
kdbRSS: Slashdot (http://slashdot.org/)20:59
kdb * Neil Gaiman Confirms Movie Talks For Sandman, American Gods: An anonymous reader writes "Neil Gaiman has confirmed that things are finally <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/B64QNKnyYGA/story01.htm>20:59
prologicmorn’n all21:35
prologichi marky199121:35
prologicwhat can I do for you?21:35
prologicmarky1991: circuits.node huh?21:36
prologichmm21:36
prologicwhat’s your application use case for this?21:37
prologicI’d love to help you here :)21:37
prologicmainly because circuits.node sucks a little bit21:37
prologicand could do with some API-level improvements I think21:37
kdbRSS: Slashdot (http://slashdot.org/)22:00
kdb * UN: Renewables, Nuclear Must Triple To Save Climate: An anonymous reader writes "On the heels of a study that concluded there was <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/y2BelkEgSRA/story01.htm>22:00
ircnotifiercb003acf0e78 by prologic: Fixed RSS plugin22:38
ircnotifiera325da223fec by prologic: Preparing 0.0.9 Release22:38
ircnotifier900775529b98 by prologic: Added project documentation22:38
ircnotifier3643e4ac5eba by prologic: Added tag 0.9.0 for changeset 900775529b9822:38
ircnotifiera0d56eb38b3a by prologic: Preparing 0.1.0 Development22:38
prologicenjoy :)22:40
prologic@cstats22:41
kdbCommand Stats: 385/d 16/h Total: 686 Top 5: read:436 load:59 join:43 quit:33 reload:2122:41
prologicreally? you got to be kidding me22:42
prologic@cstats22:42
kdbCommand Stats: 387/d 16/h Total: 689 Top 5: read:438 load:59 join:43 quit:33 reload:2122:42
prologic@errors22:42
kdbErrors: 1522:42
prologic@errors22:42
kdbErrors: 1522:42
prologichmm22:42
prologicstrange command stats22:43
prologicread has been used over 400 times22:43
prologicI don’t beieve it22:43
prologicI think the read event of underlying socket is getting mixed in there :/22:43
marky1991hey prologic.22:44
marky1991I'm trying to make a simple networked game22:44
prologichttps://bitbucket.org/prologic/kdb/src/tip/kdb/plugins/stats.py#cl-23122:44
prologic:(22:44
prologicOh how stupid of me22:44
prologicthat’s gong to capture and listen to the underlying socket read events too22:45
marky1991What's a node meant to be used for in the curent design of circuits.node?22:45
prologic@reload stats22:46
kdbUnloaded plugin: stats22:46
kdbLoaded plugin: Stats22:46
prologic@cstats22:46
kdbCommand Stats: 398/d 16/h Total: 711 Top 5: read:455 load:59 join:43 quit:33 reload:2222:46
prologic@cstats22:46
kdbCommand Stats: 399/d 16/h Total: 712 Top 5: read:455 load:59 join:43 quit:33 reload:2222:46
prologicthat’s better22:46
prologic@reload stats22:47
kdbUnloaded plugin: stats22:47
kdbLoaded plugin: Stats22:47
prologic@cstats22:47
kdbCommand Stats: 400/d 16/h Total: 714 Top 5: read:455 load:59 join:43 quit:33 reload:2322:47
ircnotifierd3cc7678c780 by prologic: Fixed counting usage statistics of commands22:47
prologichi marky199122:48
marky1991hey prologic22:48
prologicright now circuits.node is sort of a server/client bridge between two remote or local circuits apps/systems22:48
marky1991Right. That's how I'm trying to use it22:48
prologicit was my great hope to abstract this to a  point where you can simply just:22:48
prologicNode().register(...)22:48
prologicbut the API(s) aren’t quite there yet22:48
prologicIt _does_ work however in it’s current form22:48
prologicJust not as well as I’d like22:48
prologicI want to support other transports at least22:49
prologicUDP, TCP, UNIX Pipes, etc22:49
marky1991So is nodeserver.py a good representative of how the API is intended to be used?22:49
prologicthen maybe even make RabbitMQ a transparent transport as well22:49
prologiclet me have a look22:49
marky1991Right now I tried using NodeServer and Nodeclient, bnuit it's only working when the client and server are on the same machine22:50
prologichttps://bitbucket.org/circuits/circuits/src/bf972d411ad44710777706b1f53cf7f4c05ce50b/examples/nodeserver.py?at=default22:50
prologicso no, not quite22:50
prologicthe Server/Client implemtantions are meant ot be transparent to hte user/developer (you)22:50
prologicThe idea is to “bind” a Node22:51
prologicor not22:51
prologicall the API-level functionality should be just in Node() itself22:51
prologicideally22:51
marky1991okay22:51
prologicso if we were to support otehr transports for example22:51
prologicI’d expect this:22:51
prologicNode(“udp://0.0.0.0:4243”).register(self)22:51
prologicor22:51
prologicNode(“rabbitmq://0.0.0.0:1234").register(self)22:51
prologicThe examples nodeserver.py22:52
prologicand hello_node.py22:52
prologicshould be good examples ot use/follow right now22:52
marky1991okay22:52
prologicBut please! If you can contribute to circuits22:52
prologicthis would be a wonderful way to do so :)22:52
prologici.e: improve circuits.node22:52
marky1991and to confirm, the node module is intended to work across the network, correct?22:52
prologicat the very least add in the ability to use other transports like I described above22:52
prologiccorrect22:52
prologicso22:53
prologicudp://22:53
prologictcp://22:53
marky1991Okay, excellent.22:53
prologicunix://22:53
marky1991right22:53
prologicwe should at least support these three right now22:53
prologicbut for now it only assumes and supports tcp22:53
marky1991For my purposes, trhat will be fine22:53
prologicthe bind parameter should grow support to parse <type>://<bind>:<port>22:53
marky1991I'll think about contributing to the node modyule22:53
prologicgreatly appreciate it if you did :)22:53
marky1991I tried contributing to circuits a couple of yearts back22:53
marky1991Back before windows and python 3 was properly supported22:54
prologicahh22:54
marky1991Hopefully it'll go better this time22:54
prologicI don’t quite remember you :)22:54
prologicwhat did you try to contribute?22:54
marky1991yeah, it was a while back22:54
prologicmaybe you’re in the hg churn logs :)22:54
prologic*nods*22:54
prologicwe’re nearly ready to release 3.022:54
prologicvery exciting22:54
marky1991I just tred to make it properly support windows22:54
marky1991anyway, i need to go22:54
prologicnps22:54
marky1991io'll be back when i hgave more questions22:55
prologiccya around22:55
marky1991thanls22:55
prologic@rlist22:59
kdbRSS Feeds (#circuits):22:59
kdb 1. Slashdot (http://slashdot.org/)/60mins (Next Update in 0mins)22:59
kdbRSS: Slashdot (http://slashdot.org/)23:01
kdb * Russia Wants To Establish a Permanent Moon Base: An anonymous reader writes "Having established its presence in the Crimean <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/WOGy4SumY6g/story01.htm>23:01
prologic@reload rss23:02
kdbUnloaded plugin: rss23:02
kdbLoaded plugin: RSS23:02
prologic@rlist23:02
kdbRSS Feeds (#circuits):23:02
kdb 1. Slashdot (http://rss.slashdot.org/Slashdot/slashdot) / 60mins (Next Update in 59mins)23:02
prologic@rdel 123:03
kdbFeed 1 deleted.23:03
prologic@radd http://rss.slashdot.org/Slashdot/slashdot 3023:03
kdbRSS: Slashdot (http://slashdot.org/)23:03
kdb * Russia Wants To Establish a Permanent Moon Base: An anonymous reader writes "Having established its presence in the Crimean <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/WOGy4SumY6g/story01.htm>23:03
kdb * UN: Renewables, Nuclear Must Triple To Save Climate: An anonymous reader writes "On the heels of a study that concluded there was <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/y2BelkEgSRA/story01.htm>23:03
kdb * Neil Gaiman Confirms Movie Talks For Sandman, American Gods: An anonymous reader writes "Neil Gaiman has confirmed that things are finally <http://rss.slashdot.org/~r/Slashdot/slashdot/~3/B64QNKnyYGA/story01.htm>23:03
prologic@rlist23:03
kdbRSS Feeds (#circuits):23:03
kdb 1. Slashdot (http://rss.slashdot.org/Slashdot/slashdot) / 30mins (Next Update in 29mins)23:03
ircnotifier7b0fbc38d5b5 by prologic: Fixed RLIST Display in RSS Plugin23:04
prologic@eval 7.5 * 323:06
kdb22.523:06
prologicc45y: ping?23:52
pdurbinwow, suddenly I'm aware of what's on slashdot again23:57

Generated by irclog2html.py 2.11.0 by Marius Gedminas - find it at mg.pov.lt!