Cyril
/
ai-lab-transformers-playground
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Increase default max_new_tokens in generate method to enhance text generation capacity

This commit is contained in:
Cyril 2025-10-12 22:19:52 +02:00
parent 8978cf74e3
commit 79227d6def
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/pipelines/textgen.py
View File

@ -30,7 +30,7 @@ class TextGenerator:
print("Model loaded successfully!")
def generate(self, prompt: str, max_new_tokens: int = 100, num_return_sequences: int = 1,
def generate(self, prompt: str, max_new_tokens: int = 500, num_return_sequences: int = 1,
temperature: float = 1.0, do_sample: bool = True) -> Dict:
"""
Generate text from a prompt