| prologic | jaeger, don't buy VPS(es) | 00:03 |
|---|---|---|
| prologic | share it across the crux community | 00:03 |
| prologic | I'm happy to and willing to support this myself | 00:03 |
| prologic | or i.e: share the costs | 00:03 |
| jaeger | I had a test set up in VMs a bit back with nginx, bind, and some geoip stuff | 00:11 |
| jaeger | not sure if I still have those VMs around, though | 00:11 |
| prologic | jaeger, perhaps we can build a docker image that other willing participants in the crux community can easily run? | 03:25 |
| *** mavrick61 has quit IRC | 03:28 | |
| *** mavrick61 has joined #crux-devel | 03:30 | |
| Romster | prologic, does docker need special hardware to work? can older machines run docker? | 03:49 |
| Romster | like core 2's can they run docker? | 03:49 |
| Romster | or the cpu needs some flag to be able to. | 03:50 |
| jaeger | whatever LxC needs, presumably | 03:56 |
| *** Roosevelt has joined #crux-devel | 04:47 | |
| prologic | special hw; no | 06:48 |
| prologic | Yeah just a recent kernel | 06:48 |
| prologic | So any CRUX 3.1 user will be fine | 06:48 |
| prologic | If it helps I could probably provide a sed script that enables Docker support in recent kernels (at least CRUX 3.1+) | 06:49 |
| prologic | But if we built a Docker image that provided a distributed cdn for CRUX distfiles it would make community participation trivial | 06:50 |
| teK_ | I am happy to provide a mirror in Nuernberg, Germany | 09:14 |
| teK_ | though no docker images for now :} | 09:14 |
| jue | good morning | 09:25 |
| teK_ | hello Jürgen | 09:25 |
| jue | FYI, I'm mostly offline for the next week, so please have a look at my ports if something important happens | 09:27 |
| teK_ | sure | 09:27 |
| teK_ | have fun (work or private leave?) | 09:27 |
| jue | thanks | 09:28 |
| jue | short vacation :) | 09:28 |
| teK_ | awesome | 09:28 |
| teK_ | where are you heading to?:) | 09:28 |
| jue | Allgäu, Tannheimer Tal | 09:29 |
| jue | ok, have to leave now, take care | 09:30 |
| *** jue has quit IRC | 09:30 | |
| teK_ | sounds nice | 10:35 |
| teK_ | have nice vacation | 10:35 |
| *** crash_ has joined #crux-devel | 10:42 | |
| *** Romster has quit IRC | 12:24 | |
| *** diverse has quit IRC | 12:39 | |
| *** leo-unglaub has joined #crux-devel | 13:46 | |
| *** leo-unglaub has quit IRC | 14:39 | |
| *** crash_ has quit IRC | 15:05 | |
| *** leo-unglaub has joined #crux-devel | 15:32 | |
| teK_ | =======> ERROR: Downloading 'http://jw.tks6.net/files/slim-crux-smooth.tar.gz' failed. | 16:43 |
| teK_ | the whole site is one large 403 | 16:43 |
| frinnst | D; | 16:46 |
| teK_ | I just dl'd every source URL from core,opt,xorg .. this makes up 3.8GB of data | 16:46 |
| frinnst | romster seems to have mirrored it: http://crux.ster.so/distfiles/ | 16:47 |
| teK_ | ~6 ports could not be dl'ed | 16:47 |
| frinnst | http://crux.ster.so/distfiles/slim-crux-smooth.tar.gz | 16:47 |
| teK_ | Workster: do you have a script to (re)build that mirror periodically? | 16:47 |
| teK_ | thx frinnst, I just wanted to see how much data a mirror would have toprovide | 16:47 |
| teK_ | dl'ing contrib atm | 16:47 |
| teK_ | I used this zsh-beauty, BTW. cd /usr/ports ; for i in $PWD/{core,opt,xorg}/*(/) ; do cd "$i"; sudo pkgmk -do || echo problem in "$i" >> /tmp/dl.log ; done ; cd /usr/ports | 16:48 |
| teK_ | sourceforge @40KB/s.. yay :} | 16:49 |
| *** diverse has joined #crux-devel | 16:52 | |
| *** crash_ has joined #crux-devel | 17:37 | |
| teK_ | -2 | 17:44 |
| teK_ | it's 6.5GB in total | 17:55 |
| teK_ | :-) | 17:55 |
| *** leo-unglaub has quit IRC | 19:08 | |
| *** leo-unglaub has joined #crux-devel | 19:09 | |
| *** heroux has joined #crux-devel | 19:42 | |
| prologic | teK_, fantastic | 20:03 |
| prologic | so if we set something up that can be easily run | 20:04 |
| prologic | we'll at least have 3 members of a community driven CDN? | 20:04 |
| prologic | jeager, myself and you :) | 20:04 |
| *** mechaniputer has quit IRC | 20:04 | |
| *** crash_ has quit IRC | 20:26 | |
| *** Feksclaus has joined #crux-devel | 20:33 | |
| teK_ | frinnst wanted to take part, too | 21:22 |
| *** diverse has quit IRC | 21:31 | |
| prologic | oh excellent | 21:32 |
| *** Romster has joined #crux-devel | 21:37 | |
| *** horrorStruck has quit IRC | 22:09 | |
| *** crash_ has joined #crux-devel | 22:09 | |
| frinnst | geez | 23:00 |
| prologic | geez? | 23:02 |
| teK_ | I niced-up the script a little.. | 23:10 |
| teK_ | http://dpaste.com/3SJD30K | 23:10 |
| teK_ | if you care | 23:10 |
| prologic | what script? | 23:17 |
| teK_ | jaeger: you can forget about prtwash, it only seems to work when the source files are in the package directory... | 23:20 |
| teK_ | prologic: a script to download all the source files needed to build core,opt,contrib,xorg | 23:20 |
| jaeger | Ah, ok. Maybe its logic could be adapted to work for this | 23:20 |
| prologic | tek_ ahh nice | 23:21 |
| prologic | I'll use that :) | 23:21 |
| teK_ | jaeger: probably | 23:21 |
| prologic | I'm thinking of something like: rsync between peers; a little service with geoip to hit an appropriate mirror and download the specified URL | 23:21 |
| prologic | only issue is seeding the CDN | 23:22 |
| prologic | I was thinking the service could also automagically seed the CDN by way of "if URL doesn't exist locally"; download it and serve it up | 23:22 |
| teK_ | it's decentral seeding ;) | 23:22 |
| prologic | precisely :) | 23:22 |
| prologic | that's what I was thinking | 23:22 |
| prologic | I can try and hack this up tonight :) | 23:22 |
| prologic | seems easy to build I think | 23:23 |
| teK_ | prologic: yes, that's rather easy to do. I have seen transparent redirects with lighttpd | 23:23 |
| prologic | yeah | 23:23 |
| prologic | then users just have to modfiyt their /etc/pkgmk.conf | 23:23 |
| prologic | and add something like cdn.crux.nu | 23:23 |
| prologic | or whatever we set it up as | 23:23 |
| teK_ | the redirects have to use our package-db and "reverse" match the filename | 23:24 |
| teK_ | this might be tricky :) | 23:24 |
| prologic | what are you thinking? | 23:25 |
| teK_ | the user says: | 23:25 |
| prologic | I'll probably code up a little python wsgi | 23:25 |
| teK_ | wget http://cdn.crux.nu/nonmirroredfile-1.2.tar.gz | 23:25 |
| teK_ | you have to look-up the full upstream url of nonmirroredfile-1.2.tar.gz from our ports tree | 23:26 |
| prologic | ahh yes I see | 23:26 |
| prologic | okay easy enough | 23:26 |
| teK_ | this involves some shel magic :) | 23:26 |
| teK_ | *shell | 23:26 |
| prologic | a O(1) hashmap of source(s) to filenames | 23:26 |
| teK_ | yeah | 23:26 |
| prologic | nah | 23:26 |
| prologic | some of this stuff is far easier in something (say) like Python :) | 23:26 |
| teK_ | thus the reverse match | 23:26 |
| prologic | but yeah I get the idea | 23:27 |
| prologic | *nods* | 23:27 |
| teK_ | yes the hashmap is easy but filling it from Pkgfiles is another story | 23:27 |
| prologic | *nods* | 23:27 |
| prologic | will have to periodically parse all Pkgfile(s) from the ports tree | 23:27 |
| prologic | I guess | 23:27 |
| teK_ | I put the script here: http://crux.nu/~tek/distfiles.sh | 23:29 |
| teK_ | gotta go | 23:30 |
| teK_ | bye, guys | 23:30 |
| prologic | ta | 23:31 |
| prologic | I'll use it :) | 23:31 |
| *** crash_ has quit IRC | 23:38 | |
| *** leo-unglaub has quit IRC | 23:48 | |
Generated by irclog2html.py 2.11.0 by Marius Gedminas - find it at mg.pov.lt!