Skip to content

Tensorboard logger fail with deformable_detr/train_on_coco.py #45

@ragier

Description

@ragier

with command line : python alonet/deformable_detr/train_on_coco.py --log tensorboard --model deformable-detr-r50

Traceback (most recent call last):
  File "alonet/deformable_detr/train_on_coco.py", line 50, in <module>
    main()
  File "alonet/deformable_detr/train_on_coco.py", line 41, in main
    lit_model.run_train(
  File "/home/remi/aloception/alonet/detr/train.py", line 252, in run_train
    alonet.common.pl_helpers.run_pl_training(
  File "/home/remi/aloception/alonet/common/pl_helpers.py", line 167, in run_pl_training
    trainer.fit(lit_model, data_loader)
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 553, in fit
    self._run(model)
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 918, in _run
    self._dispatch()
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 986, in _dispatch
    self.accelerator.start_training(self)
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/accelerators/accelerator.py", line 92, in start_training
    self.training_type_plugin.start_training(trainer)
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/plugins/training_type/training_type_plugin.py", line 161, in start_training
    self._results = trainer.run_stage()
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 996, in run_stage
    return self._run_train()
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1031, in _run_train
    self._run_sanity_check(self.lightning_module)
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1115, in _run_sanity_check
    self._evaluation_loop.run()
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/loops/base.py", line 118, in run
    output = self.on_run_end()
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/loops/dataloader/evaluation_loop.py", line 137, in on_run_end
    self.on_evaluation_epoch_end()
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/loops/dataloader/evaluation_loop.py", line 258, in on_evaluation_epoch_end
    self.trainer.call_hook(hook_name)
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1217, in call_hook
    trainer_hook(*args, **kwargs)
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/trainer/callback_hook.py", line 119, in on_validation_epoch_end
    callback.on_validation_epoch_end(self, self.lightning_module)
  File "/home/ubuntu/anaconda3/envs/pytorch_190/lib/python3.8/site-packages/pytorch_lightning/utilities/distributed.py", line 48, in wrapped_fn
    return fn(*args, **kwargs)
  File "/home/remi/aloception/alonet/detr/callbacks.py", line 50, in on_validation_epoch_end
    self.log_boxes_2d(
  File "/home/remi/aloception/alonet/callbacks/object_detector_callback.py", line 85, in log_boxes_2d
    log_image(trainer, name, images)
  File "/home/remi/aloception/alonet/common/logger.py", line 109, in log_image
    boxes = image["boxes"]
IndexError: only integers, slices (`:`), ellipsis (`...`), numpy.newaxis (`None`) and integer or boolean arrays are valid indices

Metadata

Metadata

Assignees

Labels

alonetbugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions