Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
54 commits
Select commit Hold shift + click to select a range
39e6638
Fix typo in `concepts.md`
roger-yu-ds Jun 5, 2021
d68266d
Modifies setup to allow output stdoout and stderror in Python
danilojsl Jun 7, 2021
de2bb3c
Updates version for testing
danilojsl Jun 7, 2021
ad72bf4
Fixing yake bug, was throwing exception on empty token input
Jun 8, 2021
0bc7e13
Added denormalization for anchorDateMonth integer value
wolliq Jun 15, 2021
67af121
added missing getter/setter for random seed
DevinTDHa Jun 15, 2021
4186c11
python pubtator fix
xusliebana Jun 18, 2021
897af29
fix datematecher utils for relatives dates
xusliebana Jun 21, 2021
e02f442
make the Java error appear first
albertoandreottiATgmail Jun 21, 2021
5f1919b
Merge pull request #5706 from JohnSnowLabs/bugfix/datematcher-correct…
xusliebana Jun 22, 2021
ba85252
Merge pull request #5664 from roger-yu-ds/master
maziyarpanahi Jun 22, 2021
e8ff078
Merge pull request #5677 from JohnSnowLabs/feature/allow-stdout-sterr…
maziyarpanahi Jun 22, 2021
19e7c2e
Merge pull request #5693 from JohnSnowLabs/bugfix/get-anchor-date-mon…
maziyarpanahi Jun 22, 2021
da1e8b1
Merge pull request #5697 from hatrungduc/missing-setters-getters
maziyarpanahi Jun 22, 2021
6719b88
Merge pull request #5702 from JohnSnowLabs/pubtator-allow-work-in-python
maziyarpanahi Jun 22, 2021
412b5f7
Merge pull request #5709 from JohnSnowLabs/change_error_order
maziyarpanahi Jun 22, 2021
fd60d1c
Migrate ALBERT to TF v2 [skip ci]
maziyarpanahi Jun 23, 2021
8419bb4
Update Scala unit test
maziyarpanahi Jun 23, 2021
2fe91bc
Update the code styling [skip ci]
maziyarpanahi Jun 23, 2021
c2b4e64
Merge pull request #5683 from shaddoxac/feature/yake-handle-empty-tokens
maziyarpanahi Jun 23, 2021
6638c0c
Docs: Added examples for Perceptron*, POS, SentimentDetector*, Vivekn…
DevinTDHa Jun 7, 2021
6cd0b6a
Docs: Added examples for BertEmbeddings, BertSentenceEmbeddings, Sent…
DevinTDHa Jun 8, 2021
9658ae0
Docs: Added doc string for companion objects
DevinTDHa Jun 8, 2021
e582af8
Docs: Added examples for AlbertEmbeddings, ElmoEmbeddings, XlnetEmbed…
DevinTDHa Jun 9, 2021
4f81b66
Docs: Added examples for DistilBertEmbeddings, RoBertaEmbeddings
DevinTDHa Jun 10, 2021
8be03bc
Docs: Added examples for ChunkEmbeddings, MarianTransformer, T5Transf…
DevinTDHa Jun 10, 2021
47d5192
Docs: Added examples for ClassifierDL*, MultiClassifierDL, SentimentDL*
DevinTDHa Jun 14, 2021
a112027
fix type
DevinTDHa Jun 15, 2021
f7b606a
Docs: Added examples for LanguageDetectorDL, NerCrf*, Yake*
DevinTDHa Jun 15, 2021
bf7cc76
Docs: Added examples for NerDL*, NerConverter
DevinTDHa Jun 16, 2021
103345d
Docs: Added examples for NorvigSweeting*, SymmetricDelete*
DevinTDHa Jun 18, 2021
53d1895
Docs: Added examples for ContextSpellChecker*, DependencyParser*, Typ…
DevinTDHa Jun 21, 2021
28c822c
Docs: NerDLApproach needs CoNLL 2003 only
DevinTDHa Jun 22, 2021
ca0bc42
Docs: Added Examples for RegexTokenizer, WordSegmenter*
DevinTDHa Jun 23, 2021
13dff41
resolve conflict [skip ci]
maziyarpanahi Jun 23, 2021
1e148d8
Merge branch '311-release-candidate' of https://github.com/JohnSnowLa…
maziyarpanahi Jun 23, 2021
3e5978a
bump version to 3.1.1
maziyarpanahi Jun 23, 2021
079c9cc
Docs: References to Pretrained Pipelines
DevinTDHa Jun 23, 2021
6d9f89c
Merge pull request #5714 from JohnSnowLabs/feature/albert-tf2-batch
maziyarpanahi Jun 23, 2021
7457c0b
Merge branch '311-release-candidate' into doc-examples-update
maziyarpanahi Jun 23, 2021
d4919f3
Merge pull request #5668 from hatrungduc/doc-examples-update
maziyarpanahi Jun 23, 2021
3d3c81d
Add missing setRandomSeed in SentimentDLApproach
maziyarpanahi Jun 23, 2021
97db6cd
Remove logger from session [skip ci]
maziyarpanahi Jun 23, 2021
d97a091
Add signatures to the get session
maziyarpanahi Jun 23, 2021
d453a8b
Merge pull request #5715 from JohnSnowLabs/bugfix/tf-wrapper
maziyarpanahi Jun 23, 2021
bfd45f7
Make sure batchSize is the same internally
maziyarpanahi Jun 23, 2021
ef0ae6f
Merge pull request #5716 from JohnSnowLabs/bugfix/nerdl-minibatch
maziyarpanahi Jun 23, 2021
1b92afc
Make sure TF v2 is being saved [skip ci]
maziyarpanahi Jun 23, 2021
3429c50
Fix styling and sync isPaddedToken param name [skip ci]
maziyarpanahi Jun 23, 2021
bd374ec
Update CHANGELOG [skip ci]
maziyarpanahi Jun 23, 2021
54f43ac
Add missing YakeModel from annotators [skip ci]
maziyarpanahi Jun 23, 2021
596a893
Update YakeModel APIs link [skip ci]
maziyarpanahi Jun 23, 2021
970386d
Update Conda to 3.1.1 [skip ci]
maziyarpanahi Jun 23, 2021
21b56ec
Update Scaladoc to 3.1.1 [skip ci]
maziyarpanahi Jun 23, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
34 changes: 34 additions & 0 deletions CHANGELOG
Original file line number Diff line number Diff line change
@@ -1,3 +1,37 @@
========
3.1.1
========

----------------
New Features
----------------
* Migrate AlbertEmbeddings to TensorFlow v2. This allows the importing of HuggingFace ALBERT models to Spark NLP
* Migrate AlbertEmbeddings to BatchAnnotate to allow better performance on accelerated hardware such as GPU
* Enable stdout/stderr in real-time for child processes `sparknlp.start()`. Thanks to PySpark 3.x, this is now possible with `sparknlp.start(real_time_output=True)` to have the outputs of Spark NLP (such as metrics during training) right in your Jupyter, Colab, and Kaggle notebooks.
* Complete examples for all annotators in Scaladoc APIs https://github.com/JohnSnowLabs/spark-nlp/pull/5668

----------------
Bug Fixes & Enhancements
----------------
* Fix YakeModel issue with empty token https://github.com/JohnSnowLabs/spark-nlp/pull/5683 thanks to @shaddoxac
* Fix getAnchorDateMonth method in DateMatcher and MultiDateMatcher https://github.com/JohnSnowLabs/spark-nlp/pull/5693
* Fix the broken PubTutor class in Python https://github.com/JohnSnowLabs/spark-nlp/pull/5702
* Fix relative dates in DateMatcher and MultiDateMatcher such as `day after tomorrow` or `day before yesterday` https://github.com/JohnSnowLabs/spark-nlp/pull/5706
* Add isPaddedToken param to PubTutor https://github.com/JohnSnowLabs/spark-nlp/pull/5702
* Fix issue with `logger` inside session on some setup https://github.com/JohnSnowLabs/spark-nlp/pull/5715
* Add signatures to TF session to handle inputs/outputs more dynamically in BertEmbeddings, DistilBertEmbeddings, RoBertaEmbeddings, and XlmRoBertaEmbeddings https://github.com/JohnSnowLabs/spark-nlp/pull/5715
* Fix XlmRoBertaEmbeddings issue with `init_all_tables` https://github.com/JohnSnowLabs/spark-nlp/pull/5715
* Add missing random seed param to ClassifierDLApproach, MultiClassifierDLApproach, and SentimentDLApproach https://github.com/JohnSnowLabs/spark-nlp/pull/5697
* Make the Java Exceptions appear before Py4J exceptions for ease of debugging in Python https://github.com/JohnSnowLabs/spark-nlp/pull/5709
* Make sure batchSize set in NerDLModel is the same internally to feed TensorFlow https://github.com/JohnSnowLabs/spark-nlp/pull/5716

----------------
Backward compatibility
----------------

We have migrated AlbertEmbeddings to TensorFlow v2, the earlier models prior to 3.1.1 won't work after this release.
We have already updated the models and uploaded them on Models Hub. You can use `pretrained()` that takes care of it automatically or please make sure you download the new models manually.

========
3.1.0
========
Expand Down
Loading