--- library_name: transformers tags: - From_Scratch - Custom - YSNRFD - ysnrfd - LLM - ysnrfd - Persian_LLM datasets: - none language: - fa - en --- # REPORT ANY PROBLEMS IN MODEL LOADING AND INFERENCE ## Model Details **WARNINNGS:** This Model IS **Pre-Trained**, **in the future will be finetuned**. ### Model Description The First Persian LLM By YSNRFD, This Model support Only English text Inputs, In The Future I Want Add Persian Language Support. - **Developed by:** ysnrfd - **Funded by:** ysnrfd - **Shared by:** ysnrfd - **Model type:** LLM - **Language(s) (NLP):** English - **License:** ysnrfd LICENSE ### Training Data wikitext2 #### Training Hyperparameters - **Training regime:** fp32 mixed precision ## Evaluation Not Yet ### Testing Data, Factors & Metrics ysnrfd en testing data #### Testing Data Not Yet #### Summary The Fisrt Persian LLM Trained From Scratch (Size Like SLM) - **Hardware Type:** Nvidia Tesla T4 - **Hours used:** 11H - **Cloud Provider:** Google Colab ### Model Architecture and Objective YSNRFD Architecture #### Hardware Nvidia Tesla T4 #### Software Python Code, From Scratch, Pytorch