[Feature] Investigate opportunity to unify our ToBytes and serde_json serialization

[howardwu]

🚀 Feature

serde-rs/json#1039

There may be an opportunity to fix our 8-byte padding offset between ToBytes and serde_json. It only appears in a handful of structs.