BUG: ObjDet finalization slowdown

### valor version checks

- [X] I have confirmed this bug exists on the latest version of valor.


### Reproducible Example

```python
Check object detection benchmarks.
```


### Issue Description

While improved by #778, Object Detection finalization in valor-lite is still slower than prior to #775.

### Expected Behavior

Performance should meet or exceed previous benchmarks.