Question Answering and Sentence completion format

#13

by codegood - opened Nov 27, 2023

Nov 27, 2023

Hello,

I'm trying to build a model where I'll be fine tuning this model using sentences to increase it's knowledge base and then training it on Question Answering pairs for better performance.

I've the following questions:

Is Sentence completion an ideal way to improve knowledge base of the model?
What is the format for question answering? I know see how to ask question, but want to know how to add the ground truth answer which I think will be after tag.

Thanks

yinsong1986

Amazon org Nov 28, 2023

Hi @codegood

Thanks for your interest!

Yep point 1 is a reasonable idea
The format is suggested as
<|prompter|>YOUR QUESTION<|assistant|>YOUR ANSWER
But theoretically you can use whatever format you like to fine tune the model. Hope this helps. Cheers!

yinsong1986 changed discussion status to closed Dec 13, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment