| | --- |
| | license: bsd-3-clause |
| | --- |
| | # CodeGen (CodeGen-Mono 350M) |
| |
|
| | Clone of [Salesforce/codegen-350M-mono](https://huggingface.co/Salesforce/codegen-350M-mono) converted to ONNX and optimized. |
| |
|
| | ## Usage |
| |
|
| | ```python |
| | from transformers import AutoTokenizer |
| | from optimum.onnxruntime import ORTModelForCausalLM |
| | |
| | model = ORTModelForCausalLM.from_pretrained("TextCortex/codegen-350M-optimized") |
| | tokenizer = AutoTokenizer.from_pretrained("TextCortex/codegen-350M-optimized") |
| | |
| | text = "def hello_world():" |
| | input_ids = tokenizer(text, return_tensors="pt").input_ids |
| | generated_ids = model.generate( |
| | input_ids, |
| | max_length=64, |
| | temperature=0.1, |
| | num_return_sequences=1, |
| | early_stopping=True, |
| | ) |
| | out = tokenizer.decode(generated_ids[0], skip_special_tokens=True) |
| | print(out) |
| | ``` |
| |
|
| | Refer to the original model for more details. |
