tokyotech-llm

Team

university

swallow-llm

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

nokazaki updated a collection 11 days ago

nokazaki updated a collection 11 days ago

nokazaki updated a collection 11 days ago

View all activity

nokazaki

updated 2 collections 11 days ago

Swallow

Continual Pre-Training from Llama 2 • 15 items • Updated 11 days ago • 3

Swallow-MS

Swallow MS/MX (Mistral/Mixtral) models • 3 items • Updated 11 days ago • 1

Taishi-N324

authored a paper 4 months ago

MixtureVitae: Open Web-Scale Pretraining Dataset With High Quality Instruction and Reasoning Data Built from Permissive-First Text Sources

Paper • 2509.25531 • Published Sep 29, 2025 • 9

kazukifujii

authored a paper 5 months ago

Balancing Speed and Stability: The Trade-offs of FP8 vs. BF16 Training in LLMs

Paper • 2411.08719 • Published Nov 10, 2024 • 1

Taishi-N324

authored a paper 5 months ago

Optimal Sparsity of Mixture-of-Experts Language Models for Reasoning Tasks

Paper • 2508.18672 • Published Aug 26, 2025 • 10

Taishi-N324

authored a paper 7 months ago

Rewriting Pre-Training Data Boosts LLM Performance in Math and Code

Paper • 2505.02881 • Published May 5, 2025 • 4

kazukifujii

authored a paper 9 months ago

Rewriting Pre-Training Data Boosts LLM Performance in Math and Code

Paper • 2505.02881 • Published May 5, 2025 • 4

Taishi-N324

authored a paper 10 months ago

Building Instruction-Tuning Datasets from Human-Written Instructions with Open-Weight Large Language Models

Paper • 2503.23714 • Published Mar 31, 2025 • 1

Taishi-N324

authored 4 papers 11 months ago

Balancing Speed and Stability: The Trade-offs of FP8 vs. BF16 Training in LLMs

Paper • 2411.08719 • Published Nov 10, 2024 • 1

Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMs

Paper • 2412.14471 • Published Dec 19, 2024

Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Branching Tree Search

Paper • 2503.04412 • Published Mar 6, 2025 • 5

Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization

Paper • 2502.19261 • Published Feb 26, 2025 • 6