Long Context Pre-Training with Lighthouse Attention
Paper • 2605.06554 • Published • 21
AI & ML interests
We are dedicated to advancing the field of natural language processing, in collaboration with the open-source community, through bleeding-edge research and a commitment to symbiotic development.
Recent Activity
View all activity
Papers
View all Papers
bloc97
submitted a
paper to Daily Papers 1 day ago
emozilla
authored a
paper 3 days ago
bloc97
authored a
paper 3 days ago
gigant
authored a
paper 3 days ago
bloc97
submitted a
paper to Daily Papers 4 days ago
apyh
updated a
model about 2 months ago
Rename model-00001-of-00004.safetensors to model-00069-of-00004.safetensors
2
#1 opened 2 months ago
by 
morongosteve
teknium
published a
model 2 months ago
teknium
updated a
dataset 2 months ago
teknium
published a
dataset 2 months ago
dmayhem93
authored a
paper 8 months ago
teknium
authored 2
papers 9 months ago
emozilla
authored a
paper 9 months ago
gigant
authored 2
papers about 1 year ago
bloc97
authored a
paper over 1 year ago
emozilla
authored 2
papers over 1 year ago
bloc97
authored a
paper over 2 years ago