Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
gmongaras 's Collections
2Mamba2Furious: Linear in Complexity...
Papers I'm going to read
Stable Diffusion 3 Checkpoints
datasets
Cosine Attention (Cottention)
Reddit Models
Squad Models
BERT_512
Subtitle Data

Cosine Attention (Cottention)

updated Oct 7, 2024

Models for the paper Cottention: Linear Transformers With Cosine Attention https://arxiv.org/abs/2409.18747

Upvote
-

  • gmongaras/Cosine_Attention_GPT_300M

    Feature Extraction • Updated Oct 7, 2024 • 4

  • gmongaras/Softmax_Attention_GPT_1.2B

    Feature Extraction • Updated Oct 7, 2024 • 1

  • gmongaras/Softmax_Attention_GPT_300M

    Feature Extraction • Updated Oct 7, 2024 • 4

  • gmongaras/Cosine_Attention_GPT_1.2B

    Feature Extraction • Updated Oct 7, 2024 • 5

  • gmongaras/Cosine_Attention_BERT

    Feature Extraction • Updated Oct 7, 2024 • 8

  • gmongaras/Softmax_Attention_BERT

    Feature Extraction • Updated Oct 7, 2024 • 8
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs