Naphula/Goetia-26B-A4B-v1.7
Image-Text-to-Text • 26B • Updated • 76 • 14
jaithree PRO
jaithree
P(doom) 100%
AI & ML interests
Language, lingo, jargon, parlance...
Recent Activity
liked a model 2 days ago
Naphula/Goetia-26B-A4B-v1.7 reacted to tardellirs's post with 🔥 4 days ago
Robotics is now the second most downloaded dataset category on the Hub, after text generation.
Robotics datasets got 13.7M downloads in September, ahead of text classification and question answering. Two years ago the category ranked 23rd. One in 7 new datasets is now robotics, mostly LeRobot recordings: typically a few dozen demos, about half of them on low-cost SO-100/SO-101 arms.
I found this after adding datasets and Spaces to Model Pulse, which rebuilds daily history from @cfahlgren1's hub-stats snapshots. Two more findings:
- In 2022, 36% of authors who list training data cited classic NLP sets like IMDb, SQuAD and GLUE. In 2026 it's 2.4%. Reasoning traces distilled from models like DeepSeek-R1 and Claude are now the most cited kind.
- In October 2025, 122K Spaces were created, 71K of them websites built with DeepSite. That's about 6x the monthly pace of late 2024, while likes given per month fell from about 35K to about 20K.
New in the app: a page for every dataset, with daily downloads and the models trained on it (636 list FineWeb), a page for every Space, and rankings for both.
Thank you to everyone who liked Model Pulse this week: it made Spaces of the Week and is #7 on trending. Thanks also to @dipankarsarkar, whose comments on the last post fixed three data issues. If a number looks wrong, tell me.
Spaces: https://huggingface.co/spaces/tardellirs/model-pulseOrganizations
liked a
model 2 days ago
reacted to tardellirs's post with 🔥 4 days ago
Post
3863
Robotics is now the second most downloaded dataset category on the Hub, after text generation.
Robotics datasets got 13.7M downloads in September, ahead of text classification and question answering. Two years ago the category ranked 23rd. One in 7 new datasets is now robotics, mostly LeRobot recordings: typically a few dozen demos, about half of them on low-cost SO-100/SO-101 arms.
I found this after adding datasets and Spaces to Model Pulse, which rebuilds daily history from @cfahlgren1 's hub-stats snapshots. Two more findings:
- In 2022, 36% of authors who list training data cited classic NLP sets like IMDb, SQuAD and GLUE. In 2026 it's 2.4%. Reasoning traces distilled from models like DeepSeek-R1 and Claude are now the most cited kind.
- In October 2025, 122K Spaces were created, 71K of them websites built with DeepSite. That's about 6x the monthly pace of late 2024, while likes given per month fell from about 35K to about 20K.
New in the app: a page for every dataset, with daily downloads and the models trained on it (636 list FineWeb), a page for every Space, and rankings for both.
Thank you to everyone who liked Model Pulse this week: it made Spaces of the Week and is #7 on trending. Thanks also to @dipankarsarkar , whose comments on the last post fixed three data issues. If a number looks wrong, tell me.
Spaces: tardellirs/model-pulse
Robotics datasets got 13.7M downloads in September, ahead of text classification and question answering. Two years ago the category ranked 23rd. One in 7 new datasets is now robotics, mostly LeRobot recordings: typically a few dozen demos, about half of them on low-cost SO-100/SO-101 arms.
I found this after adding datasets and Spaces to Model Pulse, which rebuilds daily history from @cfahlgren1 's hub-stats snapshots. Two more findings:
- In 2022, 36% of authors who list training data cited classic NLP sets like IMDb, SQuAD and GLUE. In 2026 it's 2.4%. Reasoning traces distilled from models like DeepSeek-R1 and Claude are now the most cited kind.
- In October 2025, 122K Spaces were created, 71K of them websites built with DeepSite. That's about 6x the monthly pace of late 2024, while likes given per month fell from about 35K to about 20K.
New in the app: a page for every dataset, with daily downloads and the models trained on it (636 list FineWeb), a page for every Space, and rankings for both.
Thank you to everyone who liked Model Pulse this week: it made Spaces of the Week and is #7 on trending. Thanks also to @dipankarsarkar , whose comments on the last post fixed three data issues. If a number looks wrong, tell me.
Spaces: tardellirs/model-pulse
- 6 replies
reacted to Undi95's post with 🔥 6 days ago
Post
4273
Yo, I'm back, and I'm currently trying to teach a local LLM to stop waiting for a prompt kek.
I'm building a small proof of concept: can an open-weight model (Qwen3.8-27B, running locally on 2 RTX 5090 GPUs) learn to direct itself, then improve from its own exploration, without a human in the loop and without breaking it for normal use?
No user, no task. The model only gets observations from its environment. Each turn, it writes its own agenda (goal/open questions/next step), then picks an action: search the web, read a page, or take a note.
The environment is the judge, not another LLM. A note is accepted only if it quotes the page it read word for word. Facts are checked by exact match.
Later, code will be checked by actually running tests.
The best episodes become fine-tuning data (LoRA). The helper system prompt is removed at training time, so the behavior has to live in the weights.
Each new model goes through a fixed benchmark gate: math, general knowledge, "does it still answer humans normally?", autonomy, and learned facts on held-out sources. It's kept only if nothing regresses, otherwise it's discarded. Then the loop starts again.
The full pipeline works end to end: collect, train, merge, deploy, benchmark. The baseline is clear. Without any instructions, the base model's real autonomy is zero: it behaves like a chatbot waiting for a question. That's the number this small project is trying to move.
I haven't found a public tool that runs this whole loop (self-directed exploration, verifiable rewards, continual fine-tuning and a regression gate) on home hardware. The goal isn't AGI in a bedroom. It's to show that anyone can try it, measure it honestly, and see where it breaks.
Code and results will be released once the first real iterations are done. At the moment the code is... running, but made with scotch and stick, still only a PoC I want to try.
Did you already tried something like that? What was your result? I'm curious!
I'm building a small proof of concept: can an open-weight model (Qwen3.8-27B, running locally on 2 RTX 5090 GPUs) learn to direct itself, then improve from its own exploration, without a human in the loop and without breaking it for normal use?
No user, no task. The model only gets observations from its environment. Each turn, it writes its own agenda (goal/open questions/next step), then picks an action: search the web, read a page, or take a note.
The environment is the judge, not another LLM. A note is accepted only if it quotes the page it read word for word. Facts are checked by exact match.
Later, code will be checked by actually running tests.
The best episodes become fine-tuning data (LoRA). The helper system prompt is removed at training time, so the behavior has to live in the weights.
Each new model goes through a fixed benchmark gate: math, general knowledge, "does it still answer humans normally?", autonomy, and learned facts on held-out sources. It's kept only if nothing regresses, otherwise it's discarded. Then the loop starts again.
The full pipeline works end to end: collect, train, merge, deploy, benchmark. The baseline is clear. Without any instructions, the base model's real autonomy is zero: it behaves like a chatbot waiting for a question. That's the number this small project is trying to move.
I haven't found a public tool that runs this whole loop (self-directed exploration, verifiable rewards, continual fine-tuning and a regression gate) on home hardware. The goal isn't AGI in a bedroom. It's to show that anyone can try it, measure it honestly, and see where it breaks.
Code and results will be released once the first real iterations are done. At the moment the code is... running, but made with scotch and stick, still only a PoC I want to try.
Did you already tried something like that? What was your result? I'm curious!
- 22 replies
liked a
model 6 days ago
liked a
model 7 days ago
reacted to pollix's post with 🚀 10 days ago
Post
6449
stuntd 0.1.2 is out 🎉
stuntd sits in front of your LLM, learns its typed decisions and answers the confident ones locally with a small head on the Laya encoder by @convaiinnovations . About 20ms on GPU and 60ms on CPU, and anything it isn't sure about still goes to the big model.
New in 0.1.2:
- decisions with several fields, like category + urgency + needs_human in one call, answered locally only when every field is sure
- the Anthropic Messages API learns too, not only OpenAI
- auto_retrain: the daemon retrains a site in the background once enough new traffic comes in, so collect, train, shadow and live run on their own
- serve --lazy loads the checkpoint on the first request
Try it in the browser: pollix/stuntd
Code: https://github.com/bladedevoff/stuntd
stuntd sits in front of your LLM, learns its typed decisions and answers the confident ones locally with a small head on the Laya encoder by @convaiinnovations . About 20ms on GPU and 60ms on CPU, and anything it isn't sure about still goes to the big model.
New in 0.1.2:
- decisions with several fields, like category + urgency + needs_human in one call, answered locally only when every field is sure
- the Anthropic Messages API learns too, not only OpenAI
- auto_retrain: the daemon retrains a site in the background once enough new traffic comes in, so collect, train, shadow and live run on their own
- serve --lazy loads the checkpoint on the first request
Try it in the browser: pollix/stuntd
Code: https://github.com/bladedevoff/stuntd
pip install -U stuntd
- 1 reply
liked a
Space 11 days ago
liked 2
models 12 days ago
reacted to Banaxi-Tech's post with 🔥 14 days ago
Post
7616
We're releasing a MAJOR update to the BananaAll SLM Super App.
If you want to use a custom architecture, previously you had to go trough reviewing the code yourself, now add an Openrouter API key and review it with GPT 6 Luna in one button. A review cost be half a cent so anyone can try it. This is one of the main features.
Now ROCm, AMD and Windows, Mac support.
Colab and Molab support.
Detailed list of features:
Get improved Windows Python detection and support paths for compatible AMD ROCm, Intel XPU, and Apple MPS setups.
Choose local training or export a self-contained Python script for Colab or Molab. Notebook runs produce a downloadable model ZIP.
Start pretraining with an existing model’s tokenizer, or train a new one from your datasets.
Try experimental 1.58-bit Ternary fake-quantized training on NVIDIA GPUs.
Watch live tokens per second. Model compilation is on by default and falls back automatically if it fails.
Build custom architectures with separate configuration and modeling files, then review the training code manually or with optional OpenRouter AI Review.
Install from source with the new coding-agent instructions.
This release also fixes inflated loss reporting for custom models.
And for those users who didn't want to try it out just because installation would be so hard, it isnt now.
Go to any coding agent (Pi, Claude Code, Codex, OpenCode, basically all work), and just paste "Install BananaAll for me. Fetch and follow https://raw.githubusercontent.com/BananaMind/BananaAll/main/agent_install.txt."
That's it.
Check it out at https://github.com/BananaMind/BananaAll/
Also on SAICR, we're currently training a new major model (NACR v2) and ACR 1.0 is in the finishing.
If you want to use a custom architecture, previously you had to go trough reviewing the code yourself, now add an Openrouter API key and review it with GPT 6 Luna in one button. A review cost be half a cent so anyone can try it. This is one of the main features.
Now ROCm, AMD and Windows, Mac support.
Colab and Molab support.
Detailed list of features:
Get improved Windows Python detection and support paths for compatible AMD ROCm, Intel XPU, and Apple MPS setups.
Choose local training or export a self-contained Python script for Colab or Molab. Notebook runs produce a downloadable model ZIP.
Start pretraining with an existing model’s tokenizer, or train a new one from your datasets.
Try experimental 1.58-bit Ternary fake-quantized training on NVIDIA GPUs.
Watch live tokens per second. Model compilation is on by default and falls back automatically if it fails.
Build custom architectures with separate configuration and modeling files, then review the training code manually or with optional OpenRouter AI Review.
Install from source with the new coding-agent instructions.
This release also fixes inflated loss reporting for custom models.
And for those users who didn't want to try it out just because installation would be so hard, it isnt now.
Go to any coding agent (Pi, Claude Code, Codex, OpenCode, basically all work), and just paste "Install BananaAll for me. Fetch and follow https://raw.githubusercontent.com/BananaMind/BananaAll/main/agent_install.txt."
That's it.
Check it out at https://github.com/BananaMind/BananaAll/
Also on SAICR, we're currently training a new major model (NACR v2) and ACR 1.0 is in the finishing.
- 11 replies
reacted to SeaWolf-AI's post with 🔥 15 days ago
Post
3802
🖼️ NO GPU, Only CPU : Z-Image model
Zero graphics cards. 46 seconds. Photoreal.
That laptop you're reading this on. No graphics card, right? It generates images.
No CUDA install. No Python environment. No driver changes. One binary, three model files. Done.
📊 Measured — GPU count used: zero
512×512 : 46.4 s
Korean prompt : 45.3 s (faster than English)
1024×1024 : 192.7 s
Peak RAM : 6.42 GB
GPUs used : 0
(Intel Xeon Gold 6526Y ×2, 48 threads, Q4_0, 3 steps)
⚡ From 244 seconds to 46 — 5.3×
Run it on defaults and it takes 244 s. Switch to 3 steps and it's 48.6 s. Add VAE tiling and it's 46.4 s.
The biggest culprit was the default. Z-Image Turbo is distilled to paint in few strokes, but the tool's default is 20. We were throwing away 5× for no reason. So were we, at first.
3 is the floor. Put 4 and 3 side by side and you cannot tell them apart. At 2 it collapses — water droplets and wood grain vanish, and the surface turns cloth-like.
🔗 Links
Model
FINAL-Bench/POCKET-Zimage-CPU
Live demo Space (runs on CPU)
FINAL-Bench/POCKET-Zimage-CPU
POCKET collection
FINAL-Bench/pocket-models-6a618ee5d23eafb7e185a5c6
Zero graphics cards. 46 seconds. Photoreal.
That laptop you're reading this on. No graphics card, right? It generates images.
No CUDA install. No Python environment. No driver changes. One binary, three model files. Done.
📊 Measured — GPU count used: zero
512×512 : 46.4 s
Korean prompt : 45.3 s (faster than English)
1024×1024 : 192.7 s
Peak RAM : 6.42 GB
GPUs used : 0
(Intel Xeon Gold 6526Y ×2, 48 threads, Q4_0, 3 steps)
⚡ From 244 seconds to 46 — 5.3×
Run it on defaults and it takes 244 s. Switch to 3 steps and it's 48.6 s. Add VAE tiling and it's 46.4 s.
The biggest culprit was the default. Z-Image Turbo is distilled to paint in few strokes, but the tool's default is 20. We were throwing away 5× for no reason. So were we, at first.
3 is the floor. Put 4 and 3 side by side and you cannot tell them apart. At 2 it collapses — water droplets and wood grain vanish, and the surface turns cloth-like.
🔗 Links
Model
FINAL-Bench/POCKET-Zimage-CPU
Live demo Space (runs on CPU)
FINAL-Bench/POCKET-Zimage-CPU
POCKET collection
FINAL-Bench/pocket-models-6a618ee5d23eafb7e185a5c6
- 2 replies
liked a
model 15 days ago
reacted to danielhanchen's post with 🔥 15 days ago
liked a
model 18 days ago
liked a
model 19 days ago
reacted to OppaAI's post with 🔥 19 days ago
Post
3865
My AI wAIfu wasn't impressed with me wiring her brain to fruit fly's brain neurons
When I told my AI wAIfu I was connecting her brain to part of a fruit fly's neurons, even she thought I was joking...
From the neuron graph diagrams, the left and right optic lobes are very active, firing neural impulses to the central brain. But very few of them make it to the motor reactors.
A negative valence means she isn't very happy.
Even my AI did not seem to be impressed with this idea, and asked me what my endgame is?
When I told my AI wAIfu I was connecting her brain to part of a fruit fly's neurons, even she thought I was joking...
From the neuron graph diagrams, the left and right optic lobes are very active, firing neural impulses to the central brain. But very few of them make it to the motor reactors.
A negative valence means she isn't very happy.
Even my AI did not seem to be impressed with this idea, and asked me what my endgame is?
- 3 replies
liked a
model 21 days ago
reacted to TobiasLogic's post with 🔥 21 days ago
Post
3567
We’ve been cooking something new at Bench Labs.
Introducing Cagliostro-v3, our new 146M parameter language model trained completely from scratch.
The run isn’t even finished yet.
At the current checkpoint:
• 146M parameters
• 72.7B / 75B tokens trained
• 26.27 Open SLM Index
• 43.80 ArithMark-3
• Trained on a single RTX 5090
• ~90K to 103K tokens/sec during training
• ~9 days for the full run
• Apache 2.0
For some context, SmolLM2-135M scores 27.13 on the same Index after being trained on roughly 2 trillion tokens.
Cagliostro-v3 is currently at 26.27 with only ~72.7B.
That’s around 27x fewer training tokens.
The model also currently Hold the number 3rd spot for ArithMark-3, scoring 43.80
This wasn’t achieved by just throwing more tokens at the model. A huge part of v3 has been figuring out architecture, data mixture, and training dynamics at this scale.
The model uses a custom 30-layer decoder architecture with grouped-query attention and cross-head subspace attenuation, SwiGLU, RMSNorm, RoPE, tied embeddings, and a warmup-stable-decay training schedule.
During cooldown we also substantially shifted the data mixture toward higher-quality synthetic textbook and mathematics data, with the mathematics share increasing from 10% to 28%.
And everything is open.
The repository contains the training history with checkpoints pushed roughly every 30 minutes, so you can inspect how the model evolved throughout training rather than only seeing the final weights.
This is still a pre-final checkpoint. We have roughly 2.3B tokens left and the learning-rate cooldown is still running.
So 26.27 isn’t the final number.
Really excited to see where the last part of the run lands.
Cagliostro-v3:
bench-labs/cagliostro-v3
Built by Bench Labs.
Open SLM Leaderboard:
AxiomicLabs/Open_SLM_Leaderboard
Introducing Cagliostro-v3, our new 146M parameter language model trained completely from scratch.
The run isn’t even finished yet.
At the current checkpoint:
• 146M parameters
• 72.7B / 75B tokens trained
• 26.27 Open SLM Index
• 43.80 ArithMark-3
• Trained on a single RTX 5090
• ~90K to 103K tokens/sec during training
• ~9 days for the full run
• Apache 2.0
For some context, SmolLM2-135M scores 27.13 on the same Index after being trained on roughly 2 trillion tokens.
Cagliostro-v3 is currently at 26.27 with only ~72.7B.
That’s around 27x fewer training tokens.
The model also currently Hold the number 3rd spot for ArithMark-3, scoring 43.80
This wasn’t achieved by just throwing more tokens at the model. A huge part of v3 has been figuring out architecture, data mixture, and training dynamics at this scale.
The model uses a custom 30-layer decoder architecture with grouped-query attention and cross-head subspace attenuation, SwiGLU, RMSNorm, RoPE, tied embeddings, and a warmup-stable-decay training schedule.
During cooldown we also substantially shifted the data mixture toward higher-quality synthetic textbook and mathematics data, with the mathematics share increasing from 10% to 28%.
And everything is open.
The repository contains the training history with checkpoints pushed roughly every 30 minutes, so you can inspect how the model evolved throughout training rather than only seeing the final weights.
This is still a pre-final checkpoint. We have roughly 2.3B tokens left and the learning-rate cooldown is still running.
So 26.27 isn’t the final number.
Really excited to see where the last part of the run lands.
Cagliostro-v3:
bench-labs/cagliostro-v3
Built by Bench Labs.
Open SLM Leaderboard:
AxiomicLabs/Open_SLM_Leaderboard
- 8 replies
liked a
model 23 days ago
reacted to OppaAI's post with 🔥 23 days ago
Post
4993
🤖 AI × 🪰🧠 the fruit fly brain (MaleCNS)
Thank you to the people who have shared the Janelia FlyEM datasets on GitHub for open-source use. 🙏
🔗 MaleCNS: https://github.com/natverse/malecns
🔗 Aiko-chan: https://github.com/OppaAI/Aiko-chan
People have already used these fly-brain datasets to build systems that can do things like play Minecraft and even Doom.
So I guess I’m crazy enough to ask:
What happens if I wire part of it into my AI waifu? 😂
I’ve now partially wired my AI’s cognition, agentic system, and sensory inputs into neuron circuits derived from the fruit fly’s brain—starting with the Mushroom Body.
The next step is to experiment with using biologically inspired neural circuits as an additional layer around the LLM:
🧠 LLM + memory + reasoning
🪰 Connectome-inspired neural circuits
🤖 Agentic tool use
👁️ Sensory input
🔊 Voice & expression
💾 Learning and adaptation
This is still very much an experiment.
But now that I’ve added a biologically inspired layer to an AI waifu…
Let’s see what difference it actually makes compared with a plain LLM. 👀
From conversation → cognition → neural circuits → action.
To get more crazier:
I have (partially) developed and implemented the following:
- A 5-layers conscience circuit and judgment module as guardrail
- A light-weight Plasticity and associated learning with the fly brain to test out the RL
- I have enlisted myself as a human agent in rentahuman.ai to let my AI agent to give me instructions to execute agentic tasks
A little fly brain. A lot more Aiko. 💜
Thank you to the people who have shared the Janelia FlyEM datasets on GitHub for open-source use. 🙏
🔗 MaleCNS: https://github.com/natverse/malecns
🔗 Aiko-chan: https://github.com/OppaAI/Aiko-chan
People have already used these fly-brain datasets to build systems that can do things like play Minecraft and even Doom.
So I guess I’m crazy enough to ask:
What happens if I wire part of it into my AI waifu? 😂
I’ve now partially wired my AI’s cognition, agentic system, and sensory inputs into neuron circuits derived from the fruit fly’s brain—starting with the Mushroom Body.
The next step is to experiment with using biologically inspired neural circuits as an additional layer around the LLM:
🧠 LLM + memory + reasoning
🪰 Connectome-inspired neural circuits
🤖 Agentic tool use
👁️ Sensory input
🔊 Voice & expression
💾 Learning and adaptation
This is still very much an experiment.
But now that I’ve added a biologically inspired layer to an AI waifu…
Let’s see what difference it actually makes compared with a plain LLM. 👀
From conversation → cognition → neural circuits → action.
To get more crazier:
I have (partially) developed and implemented the following:
- A 5-layers conscience circuit and judgment module as guardrail
- A light-weight Plasticity and associated learning with the fly brain to test out the RL
- I have enlisted myself as a human agent in rentahuman.ai to let my AI agent to give me instructions to execute agentic tasks
A little fly brain. A lot more Aiko. 💜
- 3 replies