artificial_intelligence

+++ date = "2023-03-24" +++ #large_language_models #artificial_intelligence #musings it started with me reading this tweet: !twitter[https://twitter.com/spawning_/status/1639020027989962752] this is only tangential to the tweet's subject, but i wonder …

+++ date = "2023-03-24" +++ #decentralization #technology #artificial_intelligence at the moment, [huggingface](https://huggingface.co) is one of the main hubs for model distribution, they're basically a "free CDN", and that _DOES NOT SCALE_. from what i…

#artificial_intelligence #large_language_models #technology based on https://betterprogramming.pub/fine-tuning-gpt-j-6b-on-google-colab-or-equivalent-desktop-or-server-gpu-b6dc849cb205 ran on [[RunPod]], which provided the "cheapest" RTX A6000 GPU as …

https://www.runpod.io/ #artificial_intelligence #cloud_computing #technology provides gpu renting there are two models: - secure cloud: first party RunPod hardware - community cloud: decentralized compute, they vet and provide that at (supposedly) ch…

+++ date = "2023-06-05" +++ *or, "a sequel to [[quickly train gpt-j on some data]] except the data is better and the model is Vicuna"* #large_language_models #artificial_intelligence #author_luna ## why > luna: ...now i need another cursed project > d…

+++ date = "2023-06-10" +++ #artificial_intelligence #tagging #author_luna #ai_research i clearly know how numbers work. --- i found out about the [deepdanbooru](https://github.com/KichangKim/DeepDanbooru) project some 1~2 years ago, and used it in co…

these are transcriptions and notes about interesting points in the podcast that i can share to friends to discuss about them #artificial_intelligence [this one](https://www.youtube.com/watch?v=dNrTrx42DGQ) ## memes - superhuman ai can generate super…

#author_luna #artificial_intelligence #large_language_models #fine_tuning #peft tldr "because it didn't work with just the original lora layers", i dont know the exact reasons why https://f.l4.pm/notice/AXriEbvXG3SvzArR44 in [the original LoRA paper](ht…

#author_luna #large_language_models #peft #artificial_intelligence if i'm wrong about this email me. --- from what i gathered those two do not mix together very well. qlora it seems does their own quantization system on the NF4 datatype, which require…