It may be useful to provide a way of doing that.
VirtualBox does this for example.
Maybe:
--clipboard=[copy|paste|both|off|disabled]
So each end can limit what it will support.
And a toggle at runtime via the tray menu (as long as it is not 'disabled').