Show newer

getting more experienced with doesn't mean you'll break shit less often, you just get slightly faster at fixing it again

let me re-iterate this with a quote from girl in red: "bad idea!"

Show thread

@thufie it's the weirdest fuckin mistake!?! I looked over the config while debugging and realized the line was 4 characters shorter than the others...

@thufie i swapped something in the ZFS mirror ssd's for IO performance, and somehow the system config lost the dashes in the drive UUID's... so it refused to boot after I upgraded + rebooted it

woo we got minimal boot (minus a dhcp timeout), now I can morph deploy the actual fix again

Show thread

glad I at least installed the random ancient GPU i found in a box, so I can actually see what's going on

Show thread

don't update and reboot your servers right before you want to go to bed kids...

Show thread

if your emergency server maintenance doesn't look like this, what are you even doing

.town Matrix is currently down, working on a fix but it's a pain

i really really should finish my pi-kvm... fucked up my server and now I had to lug my monitor + keyboard downstairs....

@morgan@cathode.church xeiaso.net/blog/prometheus-gra is a bit NixOS centric, but basically you set up Prometheus to store your data, and configure the various HTTP servers/routes it has to scrape for data (prometheus-node-exporter for system stats of the server, and your various software that has metrics), then configure Grafana to add that prometheus instance as a datasource

@morgan@cathode.church oh the docs are awful.. but it's a very simple text format to return from an application

i love how easy it is to make prometheus metric endpoints

Show thread

@pixouls also i need more skill points i don't have time for all this grinding :(

i keep running upstairs, seeing my wife is still on call, then running back down again to continue waiting for her to be finished

Show older
Pixietown

Small server part of the pixie.town infrastructure. Registration is closed.