Category: Machine Learning
-
GPT Systems: Train GPT 2 – Godot 4.3 Experimental
Recently I’ve pressed the ‘reset button‘ in my plans for my future. I’ve seen, and heard, a ton of interesting things which has led to me needing this recent break. Without dwelling on how I’ve started to defend myself, finally, I’d rather focus on the…
-
Introducing GPT-systems: My LLM Experiments
As part of getting back into the right head space, I needed to decide on decent side projects to keep myself busy with. After looking, and debating, I’m moving through the edX TinyML course at a steady pace, then I picked up the humble bundle…
-
Experiment: Own Optical Character Recognition (OCR)
As my next idea for LLMs use, I decided to dabble with some OCR. Converting images to text in a speedy manner. Over the weekend I spent a little time experimenting with MiniCPM-Llama3-V-2_5-int4. The idea I have is to get details from my purchase slips,…
-
Llama 3: Project Management, Design, and Planning
Two weeks ago, I started with the simple LLM training post, and then meta-llama released a new improved model, meta-llama-3-8B. At 16Gb it has a pace that is alright for my minimal hardware, it only takes a few minutes to answer questions. My goal became…
-
Experiment: Train Own LLM, Step 1
While I’ve been experimenting with the LLMs through Hugging Face, I didn’t have a reason to start my own models. Everything changes regularly, so I haven’t yet found what fits my ideas well enough. That being said, I still haven’t decided what I will be…