[Bug] Unbound local variable when running fib benchmark #106
Description
Regression PR
#105
Command
fib benchmark -n 500 -rps inf --max-concurrent 100 --dataset-name random --prefix-text "Please describe the image, and indicate as many details as possible" --ignore-input-distribution --output-token-distribution normal 256 16 --base-url http://localhost:8080 --seed 42 --output-file vision.fib.num_queries.500.max_concurr.100.json --backend cserve-chat --model Qwen/Qwen2.5-VL-7B-Instruct --endpoint openai/v1/chat/completions --num-of-imgs-per-req 1 --img-ratios-per-req 32x32,64x64,128x128,256x256,512x512
Traceback (most recent call last):
File "/root/miniconda3/bin/fib", line 8, in
sys.exit(main())
^^^^^^
File "/root/flexible-inference-bench/src/flexible_inference_benchmark/main.py", line 748, in main
run_main(args)
File "/root/flexible-inference-bench/src/flexible_inference_benchmark/main.py", line 634, in run_main
requests_media = generate_request_media(
^^^^^^^^^^^^^^^^^^^^^^^
File "/root/flexible-inference-bench/src/flexible_inference_benchmark/main.py", line 137, in generate_request_media
future.result()
File "/root/miniconda3/lib/python3.12/concurrent/futures/_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
File "/root/miniconda3/lib/python3.12/concurrent/futures/thread.py", line 59, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/flexible-inference-bench/src/flexible_inference_benchmark/main.py", line 131, in _process_sample
media = [media_str] * num_imgs_per_req
^^^^^^^^^
UnboundLocalError: cannot access local variable 'media_str' where it is not associated with a value