| *** heroux has quit IRC | 00:07 | |
| *** heroux has joined #crux-devel | 00:08 | |
| *** heroux has quit IRC | 01:38 | |
| Romster | why don't we have a /etc/profile.d/ setup yet? | 01:39 |
|---|---|---|
| Romster | it would be much easier to export variable's than to stick a README stating you need to set this for it to work. | 01:40 |
| *** heroux has joined #crux-devel | 01:47 | |
| *** onodera has quit IRC | 01:54 | |
| *** _________mavric6 has quit IRC | 02:44 | |
| *** _________mavric6 has joined #crux-devel | 02:45 | |
| *** darfo has joined #crux-devel | 02:55 | |
| darfo | "<frinnst2> has anybody tried the download-as patches?" | 03:00 |
| darfo | where are they and can I check them out on CRUX 3.2 | 03:00 |
| Romster | i haven't yet but i was gonna take a look this weekend. | 03:09 |
| Romster | hmm i think it's on the todo crux 3.3 page? | 03:09 |
| darfo | yeah, FS#923. I was reading that yesterday. | 03:13 |
| Romster | i don't know if i wanna do that.... it makes more issues. | 03:13 |
| Romster | ya know it's not a problem with the default settings, as each file is saved in $PWD of the pkgfiles location. no file conflicts there. | 03:14 |
| Romster | the issue is the mirrors and setting PKGMK_SOURCE_DIR | 03:14 |
| darfo | Yes, but I like having all my source files in one directory. | 03:16 |
| Romster | i have another solution i just do /hash/<filename>/<sha256sum>/ | 03:16 |
| darfo | It makes it easy to share them with other machines via HTTP | 03:16 |
| darfo | And to clean out old versions. | 03:16 |
| Romster | http://romster.me/distfiles/hash/ | 03:16 |
| darfo | I'll take a look at that. | 03:16 |
| darfo | It seems there isn't a concensus on how to address the problem | 03:17 |
| Romster | i made them with hardlinks and i got md5 sha256 sums on all of them, i use a few scripts for it. i need to polish it off more. | 03:17 |
| darfo | btw, thanks for restarting the irc logger the other day | 03:17 |
| Romster | well we could set the filename int he source but it's still going to break other scripts. | 03:18 |
| Romster | no problem i just poked prologic i know his hangouts :D | 03:18 |
| darfo | yes, it is a tough problem to fix elegantly. I've been trying to come | 03:18 |
| Romster | http://romster.me/distfiles/hash/youtube-dl/md5/ like that 2 versions of the same file | 03:18 |
| darfo | up with an elegant solution but no luck | 03:19 |
| Romster | to share the source with more than one Pkgfile read the .md5sum file find the source in the url/directory | 03:20 |
| Romster | that is my take on it no need to change any file names. | 03:20 |
| darfo | aah, that is neat | 03:20 |
| Romster | upside is if .md5sum changes you don't get the stale youtube-dl in this case you download a fresh copy | 03:20 |
| Romster | that also works for any say v1.2.3.tar.xz files matching. | 03:21 |
| darfo | those are ones I'm having problems with | 03:21 |
| Romster | and it's easy to remove files that none of the .md5sums don't list. | 03:22 |
| Romster | for old files that are not used anymore. | 03:22 |
| darfo | ooh, I like the sound of that. I end up doing a mass purge | 03:22 |
| darfo | every six months or so. | 03:22 |
| Romster | this might be more complex than renaming files though | 03:22 |
| darfo | maybe. but renaming makes things non-obvious too. | 03:23 |
| Romster | purge but keep last distfiles that are still listed in source/.md5sums | 03:23 |
| darfo | It seems like it's gonna take a lot of changes no matter which solution | 03:23 |
| Romster | it does the non-obvious part is what i don't like, it breaks other scripts thinking that is the name, sure that can be fixed. | 03:23 |
| Romster | but that still does not fix a changed hash on the same name file? | 03:24 |
| darfo | I am going to do an analysis of how many ports I have that use the same source but built differently. | 03:24 |
| Romster | my method by design will ignore the old file | 03:24 |
| Romster | well some i have on crux.ster.zone with a $name-$version because of that too. | 03:25 |
| darfo | that's why it seems like a better solution if a bit more complex | 03:25 |
| Romster | that is another option but it obscures where the file is got from originally. | 03:25 |
| darfo | agreed. I've been doing that with some git sources so at least the source | 03:26 |
| darfo | can be reproduced | 03:26 |
| Romster | and introduces a possability of host being unreachable and can't get the file and help where is the original name so i can get it off another mirror say gentoo? | 03:26 |
| darfo | true, that will be an issue. argh. this is a tough nut to crack. | 03:27 |
| Romster | sure we have some mirrors now but if crux.nu is down what was them mirrors again? | 03:27 |
| darfo | same in my case with putting git tarballs on a server | 03:28 |
| darfo | but I've always been willing to wait a while (days) to get source | 03:28 |
| Romster | and we could argue why we arn't doing git+http://example.com/downlaod/foo.git#$version or something? | 03:28 |
| Romster | for a git branch | 03:28 |
| darfo | but I'm not responsible for anything security critical like ssl | 03:28 |
| Romster | we don't want git in core i'd imagine. | 03:29 |
| darfo | i learned how to cut a tarball in gitlab by tagging a version | 03:29 |
| darfo | so it has a real name just like the good old days | 03:29 |
| Romster | git archive or something? | 03:30 |
| darfo | since it is compressed it doesn't eat a lot of space | 03:30 |
| darfo | yes | 03:30 |
| Romster | yeah and self host it for source= | 03:30 |
| Romster | still that obscures things i think. but is the only solution if no archives are released | 03:31 |
| Romster | whole thing is a mess, i personally like my method /var/ports/distfiles/hash/${file}/md5/${hash5}/${file} | 03:31 |
| Romster | reason why i use md5 directory is i also do sha256, but i don't see crux ever switching. we have this signature ting for crux 3.3 that i haven't even done anything with at all. | 03:32 |
| Romster | really not sure on the solution other than github should fix there crap, which won't happen. | 03:36 |
| Romster | and supporting the http header filename isn't always reliable and it also obscures the real filename unless you do a header lookup and save that result and that introduces a problem if it times out or no network connection at that time. | 03:38 |
| Romster | i've thought this though long and hard darfo | 03:38 |
| Romster | s/though/through/ | 03:38 |
| darfo | i know you have. i've been reading what everybody has been saying | 03:40 |
| darfo | but I don't know if they've really tried to live with some of the proposed | 03:40 |
| darfo | solutions | 03:40 |
| Romster | and i know crux wants a kiss solution | 03:40 |
| darfo | sadly they custom of properly named tarballs has fallen away | 03:41 |
| darfo | s/they/the/ | 03:41 |
| darfo | I don't want multiple copies of the same source as one proposal would cause | 03:43 |
| Romster | to be honet it's simple enoughto read the .md5sum file and set $md5sum from that and wget http://crux.nu/distfiles/$file/$md5sum/$file or even http://crux.nu/downlaod.php?hash=$md5sum&file=$file but that later way is ugly in my opinion | 03:43 |
| Romster | my proposal (i should add this to the bug report) only keeps one copy | 03:44 |
| darfo | but that puts all the source load on crux.nu where now the downloads get spread all over. | 03:44 |
| Romster | another thing i do is grab the souces and save them in my hash and some ocasions i download them all again and rehash and see if the hash hasn't changed. if it does i end up with multiple copies i can diff them. | 03:45 |
| darfo | Yes, that would catch what happened to one of my ports recently. Upstream changed the tarball contents but not the version number. | 03:45 |
| Romster | not really tek has a redirect on http://crux.nu/distfiles to http://crux.nu/~tek/downlaod.php.... that picks a mirror like crux.ninja crux.guru crux.ster.zone and a few others | 03:46 |
| Romster | crux.nu/distfiles is just a kick off spot, but it's a single point of failure. we would be better with a download.crux.nu subdomain with a round robbin dns for these other mirrors. unless the dns also goes down on crux. | 03:48 |
| Romster | but that is another topic | 03:48 |
| darfo | what if you added a file next to your source file with the origin URL? in the distfiles hash tree I mean. | 03:49 |
| Romster | i'm working on another solution to archive downloading (but i don't think crux would be interested in it's complexity) | 03:49 |
| darfo | no, jaeger and other already work a lot at explaining how crux works to newbies | 03:49 |
| Romster | i often make a url file in my crux.ster.zone/downloads/foo/{url,file,MD%SUM} | 03:50 |
| Romster | so i know where the source url file came from | 03:50 |
| Romster | crux isn't for newbies through | 03:50 |
| Romster | it's for experienced linux users but then i did start out with only knowing a little. | 03:51 |
| darfo | i don't mean newbies like that, I mean arch and ubuntu convertees | 03:51 |
| darfo | with url, file, and MD%SUM every thing is auditable | 03:52 |
| Romster | most if not all distros hide the glory details and i origionally found crux hard to start with but i learned so much i couldn't go to some hand holding distro now. | 03:52 |
| Romster | not unless i got that old that i didn't care to tinker anymore. (not likely to happen) | 03:52 |
| darfo | the older I get the more I want to know what's actually going on | 03:53 |
| darfo | to many snoopers and shysters want to take advantage of disinterest | 03:53 |
| Romster | anyways my little project is to use aria2 download manager and meta4 files that describe the mirrors and ways to get that file, and that also handles the sums for me. | 03:53 |
| Romster | i like knowing what everything does, windows 10 scares me, google scares me... all data collection scares me | 03:54 |
| Romster | putting adds in everything also scares me. | 03:54 |
| Romster | ads* | 03:54 |
| Romster | hell firmware... it could be phoning home | 03:55 |
| darfo | yes, that is not what the internet was started for | 03:55 |
| Romster | i might be paranoid but this shit happens | 03:55 |
| darfo | it was supposed to be about sharing and all raising up technology | 03:55 |
| Romster | i don't mind paid services for movies and such but information should be free. | 03:55 |
| Romster | this is why i use crux i like knowing what goes on and tinker. | 03:56 |
| darfo | I'm just as paranoid but I've kinda surrendered to being under surveillance all the time in the city because of all the cameras and the state of biometrics. | 03:56 |
| Romster | finger prints that shit is bad | 03:56 |
| darfo | me too. I had to support RHEL 6 & 7 at work. | 03:57 |
| Romster | not only can they clone it, but you can't just change your finger prints like a password or gpg key now | 03:57 |
| Romster | and if someone is serious enough just cut your finger off and take it to get into top secret facility | 03:58 |
| darfo | I was reading the other day they had to up their number of match points on finger prints because there are so many people in the world now. | 03:58 |
| Romster | and the chances of any two people having the similar print | 03:59 |
| darfo | ahh, the last one of those I worked in they had to take your both your eyeballs and weigh the same to get in. | 03:59 |
| darfo | they weren't top secret just very concerned about corporate espionage | 04:05 |
| Romster | weight hmm interesting carries a briefcase with extra weight beeep nope no entry | 04:09 |
| Romster | anyways this source archive issue, not sure what the solution will be | 04:10 |
| Romster | i am biased but i like my hashed directory idea | 04:11 |
| Romster | it adds some complexity behind the scenes, but the pkgmk command changes are minimal to tack on the url path | 04:11 |
| Romster | it can do this for just the MIRRORS in pkgmk.conf | 04:12 |
| darfo | had to give your briefcase or test gear to security and they passed it through to make sure no exploses of strong magnets | 04:15 |
| darfo | s/exploses/explosives/ | 04:15 |
| Romster | darfo, you probably know of my versionsort.com stuff and it's been stagnating for ages, and recently been working on how to get the job done (like revision 20 of it...), is to make meta4 files that describe all mirrors crux ones and project mirros and it's main download site and that handles the hashing and checks, but more importantly it'll download in segments from a group of servers no more waiting.... for slow downloads. (unless your last | 04:16 |
| Romster | mile is the weakest link :P) | 04:16 |
| Romster | on top of this, i want to make a pkgdl daemon pkgdld. that you send RPC json files to from prt-get it'll pre-fetch all files as it's building the first package. | 04:17 |
| darfo | woohoo. i'd see get hopping but I know you're a busy fellow. I've been waiting for versionsort. But like I said: I'm patient. | 04:17 |
| Romster | i got a friend helping me when he isn't busy | 04:18 |
| darfo | I do a manual form of that with prt-get --margs="do" sysup followed by prt-get sysup | 04:18 |
| Romster | to the end use pre-caching files and fast downloads, to the packager semi-automated grabbing new files and building packages. | 04:19 |
| darfo | Not quite as multitasking as your method but it gets my local source up-to-date so I can start the sysup on my other CRUX boxen and use the source | 04:19 |
| Romster | cron fetching new versions from versonsort.com data. (when that is operational) | 04:19 |
| Romster | if source changes or server goes down well not stuck waiting for the source | 04:20 |
| darfo | alas, until I get a fatter pipe I will get rate-shaped on that and end up at 50kbps as usual. Canada internet sux. | 04:20 |
| Romster | and if it's changed can see what has changed. | 04:20 |
| Romster | ewwww i got 700kbs to home in australia | 04:21 |
| Romster | when iw as on dialup i was messing with xdelta on large 100MB plus source files and made small bianry diff files to get over dialup. | 04:21 |
| darfo | you live in a real country that won't put up with ISP BS obviously | 04:21 |
| Romster | it would make a 100MB or so file for a new version turn out to be 10MB if you had the previous version | 04:22 |
| Romster | i'd like to do that again but the meta4 xml specification doesn't have that in the specs | 04:22 |
| darfo | when I was on dialup I was also using the base kernel and then only applying patches to get to the next point release. | 04:23 |
| darfo | i like xdelta. that was the only thing I liked about OpenSUSE and RHEL 7. | 04:24 |
| darfo | but they were still binary distros | 04:24 |
| Romster | i'd like to add patch/rsync/zsync/xdelta some method to make pkgdl fetch a diff if it finds a older version of the source on the system to use. | 04:25 |
| darfo | that would be kind to both the Internet and my ISP bill | 04:28 |
| Romster | http://hvlinux.net/linux/ports/hvlinux/opt/xulrunner/pre-install ugly but this did work in the day | 04:28 |
| darfo | wouldn't want you slowing down all the important pr0n or e-business :) | 04:28 |
| Romster | it wold look for the old version find the patches needed to bring it up to the new version... | 04:29 |
| Romster | if no old source or patches found or too many are needed to make size too big skip them and just grab the archive directly. | 04:29 |
| Romster | but this time it will be written in a sane language. | 04:30 |
| Romster | i did some crash shit back then... | 04:30 |
| Romster | crazy* | 04:31 |
| darfo | ah, but brute force is still force. that's a long read. | 04:31 |
| Romster | long nights that was | 04:33 |
| Romster | i'll get there even if it takes another 5 years to get this done | 04:34 |
| Romster | easy solution would be to offer rsync but i find it doens't work well with different file names. | 04:34 |
| Romster | and it doesn't work well with compressed archives, which is why i did xdelta at the .tar level | 04:35 |
| Romster | qt5 is alost done, lets hope this is the last change in a long while. | 04:36 |
| Romster | almost* | 04:36 |
| darfo | they need to modularize qt5 like they did xorg. The compile is a ridiculous hog. | 04:37 |
| Romster | i've built it like 15 times now | 04:38 |
| Romster | thank goodness for ccahce | 04:38 |
| darfo | hehe | 04:38 |
| Romster | i haven't seen jue in awhile is he on holidays? | 04:39 |
| darfo | don't know | 04:39 |
| darfo | but I hope so. I had a holiday recently and it did me a world of good. | 04:40 |
| Romster | i could do with one too, but i did get friday off this long weekend. | 04:41 |
| darfo | I'll be glad when winter finally (maybe) gets here so I can spend more time at the keyboard. | 04:41 |
| darfo | do anything special? | 04:42 |
| Romster | nah went to the beach walked like 4 killometers on sand, spend today sleepng in to 10am and at the computer since | 04:42 |
| Romster | and it's nearly 3pm | 04:43 |
| darfo | that beats the hell out of work | 04:43 |
| Romster | overcast and patches of rain today, yesterday was perfect sunny | 04:43 |
| darfo | I quit my regular job in May but I've been so busy with projects on the farm and house. Thinking about getting another job so I can rest :p | 04:44 |
| darfo | That's our usual statutory 3-day weekends. Sunny during the work week, then crap weather on the long weekend. Not got for morale. | 04:45 |
| darfo | I miss the old IRC bot where you could ask when last time someone was seen. | 04:49 |
| darfo | I better quit talking and get some sleep. I've already said more today than in all the years I've been lurking here. | 04:50 |
| Romster | lol yeah you don't say much usually and yeah i miss that bog | 04:51 |
| Romster | bot | 04:51 |
| Romster | good night darfo :) | 04:51 |
| Romster | making coffee and working on stuff. | 04:51 |
| darfo | have a good afternoon romster :) | 04:51 |
| Romster | at least this is relaxing :) | 04:51 |
| darfo | :) | 04:52 |
| *** onodera has joined #crux-devel | 10:06 | |
| *** onodera has quit IRC | 10:21 | |
| *** onodera has joined #crux-devel | 12:18 | |
| *** heroux has quit IRC | 18:21 | |
| *** heroux has joined #crux-devel | 18:22 | |
| *** groovy2shoes has joined #crux-devel | 18:24 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!