--- license: apache-2.0 library_name: custom pipeline_tag: text-classification tags: - biomedical-ai - rna - human-genetics - clinical-trials - naive-bayes - transparent-model datasets: - Shicheng/rna-human-genetics-ai-atlas model-index: - name: Biomedical AI Resource Track Baseline results: - task: type: text-classification name: Atlas track classification dataset: type: Shicheng/rna-human-genetics-ai-atlas name: RNA, Human Genetics & AI Atlas metrics: - type: accuracy value: 0.8 name: Leave-one-out accuracy - type: f1 value: 0.780357 name: Leave-one-out macro F1 --- # Biomedical AI Resource Track Baseline A small, fully transparent text-classification baseline that assigns public biomedical-AI resource descriptions to one of four atlas tracks: 1. Computational Biology 2. Human Biobank 3. AI Agents & Agentic AI 4. Human Data Integration & AI This is an **original curation-support model**, not a duplicated foundation model and not a scientific or clinical predictor. ## Intended use The model can help route newly discovered Hugging Face resources into the appropriate section of the [`RNA, Human Genetics & AI Atlas`](https://huggingface.co/datasets/Shicheng/rna-human-genetics-ai-atlas). It is useful as a reproducible baseline for testing future improvements to atlas curation. It must **not** be used for biological inference, target prioritization, clinical decisions, candidate screening, or assessment of scientific quality. ## Architecture - Multinomial Naive Bayes - Lowercase word unigrams and adjacent word bigrams - Features retained when observed at least twice - Laplace smoothing, $\alpha=1$ - 165 retained features - JSON weights; no proprietary runtime or binary serialization - Python standard library only ## Training data The model was trained on all 20 descriptions in [`Shicheng/rna-human-genetics-ai-atlas`](https://huggingface.co/datasets/Shicheng/rna-human-genetics-ai-atlas), snapshot reviewed on 2026-11-01. The exact SHA-256 fingerprint of `resources.csv` is stored in `model.json`. Resource titles and evidence summaries are the only predictive text. Likes, downloads, owners, and review questions are not used as model inputs. ## Evaluation Evaluation used leave-one-out cross-validation over all 20 records. | Metric | Result | |---|---:| | Accuracy | 0.8000 | | Macro F1 | 0.7804 | | AI Agents & Agentic AI F1 | 0.7500 | | Computational Biology F1 | 0.8000 | | Human Biobank F1 | 0.5714 | | Human Data Integration & AI F1 | 1.0000 | Full predictions, probabilities, per-class metrics, and the confusion matrix are available in `evaluation.json`. ## Run inference ```bash python predict.py "Agent that integrates genetics, clinical trials, and target-evidence provenance" ``` The output is JSON containing the predicted track and normalized class probabilities. ## Reproduce training and evaluation Place this repository beside a checkout of the atlas dataset using the same directory layout, then run: ```bash python train.py ``` `train.py` regenerates both `model.json` and `evaluation.json` using only the Python standard library. ## Limitations - Twenty examples are far too few for a general-purpose classifier. - The labels reflect one curator's practical taxonomy rather than a universal ontology. - Resource descriptions often span multiple tracks. - Probabilities are not calibrated confidence estimates. - Human Biobank performance is weakest and should be reviewed manually. - The evaluation reuses the same small curation snapshot and does not establish external generalization. ## Relationship to the atlas - [Dataset](https://huggingface.co/datasets/Shicheng/rna-human-genetics-ai-atlas) - [Searchable Space](https://huggingface.co/spaces/Shicheng/rna-human-genetics-ai-atlas) - [Curated Collection](https://huggingface.co/collections/Shicheng/ai-for-rna-biology-human-genetics-and-drug-discovery-6ae7d2997b5be2d9912e09c9) ## Maintainer Created by [Shicheng Guo](https://huggingface.co/Shicheng) as a public, nonconfidential demonstration of transparent biomedical-AI resource curation.