Amalq/stress-roberta-base

StressRoberta model:

This model was initialized with roberta-base and trained with Stress-SMHD, which is a subset of Self-Reported Mental Health Diagnoses (SMHD) dataset which consists of Reddit posts by patients with anxiety, PTSD (Post Traumatic Stress Disorder), or depression. We follow the standard pretraining protocols of RoBERTa with Huggingface’s Transformers library.

Usage Load the model via Huggingface’s Transformers library:

from transformers import AutoTokenizer,    
AutoModel tokenizer = AutoTokenizer.from_pretrained("Amalq/stress-roberta-base")    
model = AutoModel.from_pretrained("Amalq/stress-roberta-base")   

Perplexity of this model is: 5.22