Mouse moves camera when in controller mode

**Describe the bug**
Mouse moves camera when in controller mode

**Severity:** Med
**Probability:** High

**To Reproduce**
Steps to reproduce the behavior:
1. Host/Join and start
2. Note that moving mouse move the camera when in controller mode

**Expected behavior**
Mouse shouldnt move camera when using controller

