author_luna

#author_luna #pleroma #fediverse Disclaimer: I am not a main developer of the Pleroma project, however I used the software for years and have to be up to date on what has been happening with it. I sadly do not have much context from the early days, and I …

#author_luna #sysadmin-notes #linux #uefi my motherboard broke, so i bought a new one and had issues getting my pre existing linux ssd to boot in it, attempted all sorts of weird BIOS settings until [eviee](https://eviee.gay/) gave me an idea: > bootload…

+++ date = "2023-06-05" +++ *or, "a sequel to [[quickly train gpt-j on some data]] except the data is better and the model is Vicuna"* #large_language_models #artificial_intelligence #author_luna ## why > luna: ...now i need another cursed project > d…

+++ date = "2023-06-10" +++ #artificial_intelligence #tagging #author_luna #ai_research i clearly know how numbers work. --- i found out about the [deepdanbooru](https://github.com/KichangKim/DeepDanbooru) project some 1~2 years ago, and used it in co…

#large_language_models #notes #author_luna i was able to use https://github.com/Lightning-AI/lit-llama to finetune llama-7b on a dual-3090 setup from a colleague of mine ~~however, the project does not support unstructured datasets, so i hacked together…

+++ date = "2023-06-14" +++ #author_luna #discord #security **TL;DR** People were able to extract unitialized memory from the machines at Discord that created thumbnails. That includes images uploaded to the CDN. This issue has been discovered **AS OF JA…

#author_luna #python #python-packaging #notes %at=2023-07-23T18:28:44 these are *mine.* i have been writing python software for 10 years (though Python to production is more like 5yrs ago), so i know how to deal with things when they go bad (or sometimes…

#author_luna #artificial_intelligence #large_language_models #fine_tuning #peft tldr "because it didn't work with just the original lora layers", i dont know the exact reasons why https://f.l4.pm/notice/AXriEbvXG3SvzArR44 in [the original LoRA paper](ht…

#author_luna #large_language_models #peft #artificial_intelligence if i'm wrong about this email me. --- from what i gathered those two do not mix together very well. qlora it seems does their own quantization system on the NF4 datatype, which require…

#author_luna #sysadmin-notes #netbsd this took me a little while to learn but here is the process 1. resize the disk (with `qemu-img`) 2. boot into netbsd installer, exit the installer 3. use `dmesg` to find out which disk is it mapped to 1. i'm sure …

#author_luna #sysadmin-notes #netbsd #wireguard [read netbsd's docs first](https://man.netbsd.org/wg.4) i wanted to make [our ephemeral vpn tool](https://gitlab.com/bigbigvpn) work with netbsd 10.0 RC1's new wg(4) interface that is wireguard compatible.…