GODELEV/PretrainingDatasets
0 Bytes
🏗️ Building on HF
Mr Munk
GODELEV
AI & ML interests
High schooler by day, LLM builder by night. Driven by a deep love for both Physics and AI. Currently spending my runtime building on Hugging Face, experimenting with transformer architectures, and training custom LLMs.
Recent Activity
liked a Space about 3 hours ago
StentorLabs/SLM_Arena new activity about 10 hours ago
GODELEV/Arithmetic-XL:[bot] Conversion to Parquet reacted to Banaxi-Tech's post with 👀 2 days ago
A new model is coming!
Its going to take a long time on my 5070 Ti so expect a release in ~1 month.
We think this model is going to be SOTA For its size.
Our Mini Version will be 25M Parameters and Pro with 140M.
The Pro version has a 3072 Context Window (Extensible to up to 6K with RoPE) And the Mini version has a context window of 4096 (Up to 8K with RoPE)
Meanwhile we are currently working on a Instruct Version of our BananaMind 1.5 Base.
The training will start this weekend
We are very exited to release it when its done!Organizations
None yet
models 12
GODELEV/Archaea-74M-V1.1
Text Generation • 74M • Updated • 20 • 2
GODELEV/Exp-1
9.85M • Updated • 513 • 1
GODELEV/TOK-16K
Updated
GODELEV/TOK-8K
Updated
GODELEV/TOK-32K
Updated
GODELEV/Ant-10M
Text Generation • 9.9M • Updated • 125 • 4
GODELEV/Archaea-74M
Text Generation • 74M • Updated • 325 • 3
GODELEV/TOK-4K
Updated
GODELEV/Ant-5M
Text Generation • 4.71M • Updated • 676 • 2
GODELEV/Test-1-4000
Text Generation • 0.2B • Updated • 93
datasets 20
GODELEV/Arithmetic-XL
Viewer • Updated • 24M • 55 • 1
GODELEV/Arithmetic-Large
Preview • Updated • 44
GODELEV/D1-8
Viewer • Updated • 9.37M • 142
GODELEV/D1-8-Lite
Viewer • Updated • 6.3M • 90
GODELEV/D1-32
Viewer • Updated • 11.1M • 180
GODELEV/D1-32-Lite
Viewer • Updated • 5.66M • 74
GODELEV/Ant-5M-V2-TE
Viewer • Updated • 2.5M • 68
GODELEV/Ant-5M-V2-T
Viewer • Updated • 3.01M • 103
GODELEV/12345
Viewer • Updated • 777k • 37
GODELEV/Arithmetic-1.5M
Viewer • Updated • 1.5M • 103