artificial_intelligence

+++ date = "2023-03-24" +++ #large_language_models #artificial_intelligence #musings it started with me reading this tweet: !twitter[https://twitter.com/spawning_/status/1639020027989962752] this is only tangential to the tweet's subject, but i wonder …

+++ date = "2023-03-24" +++ #decentralization #technology #artificial_intelligence at the moment, [huggingface](https://huggingface.co) is one of the main hubs for model distribution, they're basically a "free CDN", and that _DOES NOT SCALE_. from what i…

#artificial_intelligence #large_language_models #technology based on https://betterprogramming.pub/fine-tuning-gpt-j-6b-on-google-colab-or-equivalent-desktop-or-server-gpu-b6dc849cb205 ran on [RunPod], which provided the "cheapest" RTX A6000 GPU as …

https://www.runpod.io/ #artificial_intelligence #cloud_computing #technology provides gpu renting there are two models: - secure cloud: first party RunPod hardware - community cloud: decentralized compute, they vet and provide that at (supposedly) ch…

+++ date = "2023-06-05" +++ *or, "a sequel to [quickly train gpt-j on some data] except the data is better and the model is Vicuna"* #large_language_models #artificial_intelligence #author_luna ## why > luna: ...now i need another cursed project > d…

+++ date = "2023-06-10" +++ #artificial_intelligence #tagging #author_luna #ai_research i clearly know how numbers work. UPDATE %at=2024-08-04T20:47:23.363Z rerun with a new model UPDATE %at=2025-04-12T00:49:10.510Z almost a year has passed! almost tw…

these are transcriptions and notes about interesting points in the podcast that i can share to friends to discuss about them #artificial_intelligence [this one](https://www.youtube.com/watch?v=dNrTrx42DGQ) ## memes - superhuman ai can generate super…

#author_luna #artificial_intelligence #large_language_models #fine_tuning #peft tldr "because it didn't work with just the original lora layers", i dont know the exact reasons why https://f.l4.pm/notice/AXriEbvXG3SvzArR44 in [the original LoRA paper](ht…

#author_luna #large_language_models #peft #artificial_intelligence if i'm wrong about this email me. --- from what i gathered those two do not mix together very well. qlora it seems does their own quantization system on the NF4 datatype, which require…

#author_luna #spam #artificial_intelligence #large_language_models this is a copy-paste of a long thread i wrote up on fedi mid december 2023. thought it had enough power to be its own article --- the more i look at spam the more i look at The Architec…