It looks like non-digest files simply get copied into the output directory but nothing about them is added to the manifest file. In my particular case it helps to have non-digest assets added to the body of the manifest file.
Do you think that may be something you could add to the gem?