Add missed loaders for the ReLU and ELU activation layers

[zaleslaw]

Each layer should have an implementation for export/import from/to JSON configuration (Keras compatible format) (see ModelLoader.kt and ModelSaver.kt)

The saving functions for the ReLU and ELU activation layer are missed

As an integration example, add a convolutional neural network to the examples package (in CNN package for example), it could be based on improved LeNet model, train it on "mnist" or "fashion mnist" and add it as an integration test to the "examples" module tests

• add saving function for ReLU activation layer
• add saving function for ELU activation layer
• add an example
• convert this example to the integration test
• train network, tune it to achieve accuracy more than >70%

[avan1235]

I can take if there are no volunteers for this issue and I was adding the ELU layer as I don't see other work for now for me and I'd like to try to export the trained model in kotlinDL to see how it works 😉

[zaleslaw]

I suppose you are enough mature for second-level tasks, let's leave it for newcomers, it's easy to add, but need to understand some important things.
If it will be not closed till the end of July, I'll notify you or fix it be myself

[dosier]

Nevermind my commits, we happened to work on it at the same time :D

[mkaze]

@kokorins @dosier Just a tip: it's much better to first leave a comment mentioning that you are working on a PR for an existing issue in the issue page (or create an issue first if it does not already exist and let the maintainers know that you are interested to work on it). With that, you can prevent duplicated effort and you don't end up working on an issue which another person is also working on at the same time. Further, for some of the issues, you may need to confirm and check with maintainers that you want to start working on it; this is so as to prevent working on an issue which is not really an issue or is not a priority at least in a near future. Currently, the maintainer of this project is @zaleslaw.

[zaleslaw]

Yeah, as @dosier we have not yet the contribution guidelines, but looks like this is a time to write something about that.
Sorry for the situation, @dosier

[zaleslaw]

@kokorins could you please write any comment here, to assign the ticket on you

[kokorins]

I've just read a code a bit and decided to contribute. As there were no action until the Pull Request, I havent expected any parallel work.

Can someone share the code style for the project (IntelliJ xml or something of those lines)?