-
Notifications
You must be signed in to change notification settings - Fork 58
Open
Description
Describe the issue
Issue:
Command:
python -m llava.serve.gradio_web_server_llava_plus --controller http://localhost:20001 --model-list-mode reload
Log:
==== request ====
2025-04-10 16:52:12 | INFO | stdout | error: HTTPConnectionPool(host='localhost', port=40000): Read timed out.
complete log:
python -m llava.serve.gradio_web_server_llava_plus --controller http://localhost:20001 --model-list-mode reload
Using conversation: conv_vicuna_v1
2025-04-10 17:14:20 | INFO | gradio_web_server | args: Namespace(host='0.0.0.0', port=None, controller_url='http://localhost:20001', concurrency_count=8, model_list_mode='reload', share=False, moderate=False, embed=False, debug=False, with_debug_parameter=False)
2025-04-10 17:14:20 | INFO | gradio_web_server | Models: ['weights']
2025-04-10 17:14:20 | INFO | gradio_web_server | Namespace(host='0.0.0.0', port=None, controller_url='http://localhost:20001', concurrency_count=8, model_list_mode='reload', share=False, moderate=False, embed=False, debug=False, with_debug_parameter=False)
2025-04-10 17:14:21 | ERROR | stderr | /data/hmaurya/miniconda3/envs/llava/lib/python3.10/site-packages/gradio/blocks.py:261: UserWarning: api_name load_example already exists, using load_example_1
2025-04-10 17:14:21 | ERROR | stderr | warnings.warn(f"api_name {api_name} already exists, using {api_name_}")
2025-04-10 17:14:21 | ERROR | stderr | /data/hmaurya/miniconda3/envs/llava/lib/python3.10/site-packages/gradio/blocks.py:261: UserWarning: api_name load_example already exists, using load_example_2
2025-04-10 17:14:21 | ERROR | stderr | warnings.warn(f"api_name {api_name} already exists, using {api_name_}")
2025-04-10 17:14:21 | ERROR | stderr | /data/hmaurya/miniconda3/envs/llava/lib/python3.10/site-packages/gradio/blocks.py:261: UserWarning: api_name load_example already exists, using load_example_3
2025-04-10 17:14:21 | ERROR | stderr | warnings.warn(f"api_name {api_name} already exists, using {api_name_}")
2025-04-10 17:14:21 | ERROR | stderr | /data/hmaurya/miniconda3/envs/llava/lib/python3.10/site-packages/gradio/blocks.py:261: UserWarning: api_name load_example already exists, using load_example_4
2025-04-10 17:14:21 | ERROR | stderr | warnings.warn(f"api_name {api_name} already exists, using {api_name_}")
2025-04-10 17:14:21 | ERROR | stderr | /data/hmaurya/miniconda3/envs/llava/lib/python3.10/site-packages/gradio/blocks.py:261: UserWarning: api_name load_example already exists, using load_example_5
2025-04-10 17:14:21 | ERROR | stderr | warnings.warn(f"api_name {api_name} already exists, using {api_name_}")
2025-04-10 17:14:21 | ERROR | stderr | /data/hmaurya/miniconda3/envs/llava/lib/python3.10/site-packages/gradio/blocks.py:261: UserWarning: api_name load_example already exists, using load_example_6
2025-04-10 17:14:21 | ERROR | stderr | warnings.warn(f"api_name {api_name} already exists, using {api_name_}")
2025-04-10 17:14:21 | ERROR | stderr | /data/hmaurya/miniconda3/envs/llava/lib/python3.10/site-packages/gradio/blocks.py:261: UserWarning: api_name load_example already exists, using load_example_7
2025-04-10 17:14:21 | ERROR | stderr | warnings.warn(f"api_name {api_name} already exists, using {api_name_}")
2025-04-10 17:14:21 | ERROR | stderr | /data/hmaurya/miniconda3/envs/llava/lib/python3.10/site-packages/gradio/blocks.py:261: UserWarning: api_name load_example already exists, using load_example_8
2025-04-10 17:14:21 | ERROR | stderr | warnings.warn(f"api_name {api_name} already exists, using {api_name_}")
2025-04-10 17:14:21 | INFO | stdout | Running on local URL: http://0.0.0.0:7860
2025-04-10 17:14:21 | INFO | stdout |
2025-04-10 17:14:21 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
2025-04-10 17:16:39 | INFO | gradio_web_server | load_demo. ip: 127.0.0.1
2025-04-10 17:16:39 | INFO | gradio_web_server | Models: ['weights']
2025-04-10 17:16:49 | INFO | gradio_web_server | add_text. ip: 127.0.0.1. len: 22
2025-04-10 17:16:49 | INFO | gradio_web_server | http_bot. ip: 127.0.0.1
2025-04-10 17:16:49 | INFO | stdout | template_name: vicuna_v1
2025-04-10 17:16:49 | INFO | stdout | Messages: [['USER', ('whats the image about?\n<image>', <PIL.Image.Image image mode=RGB size=2423x220 at 0x7FCF0E82D870>, 'Crop', <PIL.PngImagePlugin.PngImageFile image mode=RGBA size=2423x220 at 0x7FCF0E82D6C0>)], ['ASSISTANT', None]]
2025-04-10 17:16:49 | INFO | gradio_web_server | model_name: weights, worker_addr: http://localhost:40000
2025-04-10 17:16:49 | INFO | gradio_web_server | ==== request ====
{'model': 'weights', 'prompt': "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: <image>\nwhats the image about? ASSISTANT:", 'temperature': 0.2, 'top_p': 0.7, 'max_new_tokens': 512, 'stop': '</s>', 'images': "List of 1 images: ['52d7af06fc459176df0f795b4d0887aa']"}
==== request ====
Screenshots:
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels
