prologic | jaeger, don't buy VPS(es) | 00:03 |
---|---|---|
prologic | share it across the crux community | 00:03 |
prologic | I'm happy to and willing to support this myself | 00:03 |
prologic | or i.e: share the costs | 00:03 |
jaeger | I had a test set up in VMs a bit back with nginx, bind, and some geoip stuff | 00:11 |
jaeger | not sure if I still have those VMs around, though | 00:11 |
prologic | jaeger, perhaps we can build a docker image that other willing participants in the crux community can easily run? | 03:25 |
*** mavrick61 has quit IRC | 03:28 | |
*** mavrick61 has joined #crux-devel | 03:30 | |
Romster | prologic, does docker need special hardware to work? can older machines run docker? | 03:49 |
Romster | like core 2's can they run docker? | 03:49 |
Romster | or the cpu needs some flag to be able to. | 03:50 |
jaeger | whatever LxC needs, presumably | 03:56 |
*** Roosevelt has joined #crux-devel | 04:47 | |
prologic | special hw; no | 06:48 |
prologic | Yeah just a recent kernel | 06:48 |
prologic | So any CRUX 3.1 user will be fine | 06:48 |
prologic | If it helps I could probably provide a sed script that enables Docker support in recent kernels (at least CRUX 3.1+) | 06:49 |
prologic | But if we built a Docker image that provided a distributed cdn for CRUX distfiles it would make community participation trivial | 06:50 |
teK_ | I am happy to provide a mirror in Nuernberg, Germany | 09:14 |
teK_ | though no docker images for now :} | 09:14 |
jue | good morning | 09:25 |
teK_ | hello Jürgen | 09:25 |
jue | FYI, I'm mostly offline for the next week, so please have a look at my ports if something important happens | 09:27 |
teK_ | sure | 09:27 |
teK_ | have fun (work or private leave?) | 09:27 |
jue | thanks | 09:28 |
jue | short vacation :) | 09:28 |
teK_ | awesome | 09:28 |
teK_ | where are you heading to?:) | 09:28 |
jue | Allgäu, Tannheimer Tal | 09:29 |
jue | ok, have to leave now, take care | 09:30 |
*** jue has quit IRC | 09:30 | |
teK_ | sounds nice | 10:35 |
teK_ | have nice vacation | 10:35 |
*** crash_ has joined #crux-devel | 10:42 | |
*** Romster has quit IRC | 12:24 | |
*** diverse has quit IRC | 12:39 | |
*** leo-unglaub has joined #crux-devel | 13:46 | |
*** leo-unglaub has quit IRC | 14:39 | |
*** crash_ has quit IRC | 15:05 | |
*** leo-unglaub has joined #crux-devel | 15:32 | |
teK_ | =======> ERROR: Downloading 'http://jw.tks6.net/files/slim-crux-smooth.tar.gz' failed. | 16:43 |
teK_ | the whole site is one large 403 | 16:43 |
frinnst | D; | 16:46 |
teK_ | I just dl'd every source URL from core,opt,xorg .. this makes up 3.8GB of data | 16:46 |
frinnst | romster seems to have mirrored it: http://crux.ster.so/distfiles/ | 16:47 |
teK_ | ~6 ports could not be dl'ed | 16:47 |
frinnst | http://crux.ster.so/distfiles/slim-crux-smooth.tar.gz | 16:47 |
teK_ | Workster: do you have a script to (re)build that mirror periodically? | 16:47 |
teK_ | thx frinnst, I just wanted to see how much data a mirror would have toprovide | 16:47 |
teK_ | dl'ing contrib atm | 16:47 |
teK_ | I used this zsh-beauty, BTW. cd /usr/ports ; for i in $PWD/{core,opt,xorg}/*(/) ; do cd "$i"; sudo pkgmk -do || echo problem in "$i" >> /tmp/dl.log ; done ; cd /usr/ports | 16:48 |
teK_ | sourceforge @40KB/s.. yay :} | 16:49 |
*** diverse has joined #crux-devel | 16:52 | |
*** crash_ has joined #crux-devel | 17:37 | |
teK_ | -2 | 17:44 |
teK_ | it's 6.5GB in total | 17:55 |
teK_ | :-) | 17:55 |
*** leo-unglaub has quit IRC | 19:08 | |
*** leo-unglaub has joined #crux-devel | 19:09 | |
*** heroux has joined #crux-devel | 19:42 | |
prologic | teK_, fantastic | 20:03 |
prologic | so if we set something up that can be easily run | 20:04 |
prologic | we'll at least have 3 members of a community driven CDN? | 20:04 |
prologic | jeager, myself and you :) | 20:04 |
*** mechaniputer has quit IRC | 20:04 | |
*** crash_ has quit IRC | 20:26 | |
*** Feksclaus has joined #crux-devel | 20:33 | |
teK_ | frinnst wanted to take part, too | 21:22 |
*** diverse has quit IRC | 21:31 | |
prologic | oh excellent | 21:32 |
*** Romster has joined #crux-devel | 21:37 | |
*** horrorStruck has quit IRC | 22:09 | |
*** crash_ has joined #crux-devel | 22:09 | |
frinnst | geez | 23:00 |
prologic | geez? | 23:02 |
teK_ | I niced-up the script a little.. | 23:10 |
teK_ | http://dpaste.com/3SJD30K | 23:10 |
teK_ | if you care | 23:10 |
prologic | what script? | 23:17 |
teK_ | jaeger: you can forget about prtwash, it only seems to work when the source files are in the package directory... | 23:20 |
teK_ | prologic: a script to download all the source files needed to build core,opt,contrib,xorg | 23:20 |
jaeger | Ah, ok. Maybe its logic could be adapted to work for this | 23:20 |
prologic | tek_ ahh nice | 23:21 |
prologic | I'll use that :) | 23:21 |
teK_ | jaeger: probably | 23:21 |
prologic | I'm thinking of something like: rsync between peers; a little service with geoip to hit an appropriate mirror and download the specified URL | 23:21 |
prologic | only issue is seeding the CDN | 23:22 |
prologic | I was thinking the service could also automagically seed the CDN by way of "if URL doesn't exist locally"; download it and serve it up | 23:22 |
teK_ | it's decentral seeding ;) | 23:22 |
prologic | precisely :) | 23:22 |
prologic | that's what I was thinking | 23:22 |
prologic | I can try and hack this up tonight :) | 23:22 |
prologic | seems easy to build I think | 23:23 |
teK_ | prologic: yes, that's rather easy to do. I have seen transparent redirects with lighttpd | 23:23 |
prologic | yeah | 23:23 |
prologic | then users just have to modfiyt their /etc/pkgmk.conf | 23:23 |
prologic | and add something like cdn.crux.nu | 23:23 |
prologic | or whatever we set it up as | 23:23 |
teK_ | the redirects have to use our package-db and "reverse" match the filename | 23:24 |
teK_ | this might be tricky :) | 23:24 |
prologic | what are you thinking? | 23:25 |
teK_ | the user says: | 23:25 |
prologic | I'll probably code up a little python wsgi | 23:25 |
teK_ | wget http://cdn.crux.nu/nonmirroredfile-1.2.tar.gz | 23:25 |
teK_ | you have to look-up the full upstream url of nonmirroredfile-1.2.tar.gz from our ports tree | 23:26 |
prologic | ahh yes I see | 23:26 |
prologic | okay easy enough | 23:26 |
teK_ | this involves some shel magic :) | 23:26 |
teK_ | *shell | 23:26 |
prologic | a O(1) hashmap of source(s) to filenames | 23:26 |
teK_ | yeah | 23:26 |
prologic | nah | 23:26 |
prologic | some of this stuff is far easier in something (say) like Python :) | 23:26 |
teK_ | thus the reverse match | 23:26 |
prologic | but yeah I get the idea | 23:27 |
prologic | *nods* | 23:27 |
teK_ | yes the hashmap is easy but filling it from Pkgfiles is another story | 23:27 |
prologic | *nods* | 23:27 |
prologic | will have to periodically parse all Pkgfile(s) from the ports tree | 23:27 |
prologic | I guess | 23:27 |
teK_ | I put the script here: http://crux.nu/~tek/distfiles.sh | 23:29 |
teK_ | gotta go | 23:30 |
teK_ | bye, guys | 23:30 |
prologic | ta | 23:31 |
prologic | I'll use it :) | 23:31 |
*** crash_ has quit IRC | 23:38 | |
*** leo-unglaub has quit IRC | 23:48 |
Generated by irclog2html.py 2.11.0 by Marius Gedminas - find it at mg.pov.lt!