Closed
Description
Description
We should avoid repeatedly adding files to the Spark context so we can remove this warning:
...
INFO:cortex:Sanity checking transformers against the first 100 samples
19/03/26 01:43:53 SPARK:WARN CacheManager: Asked to cache already cached data.
INFO:cortex:Transforming class to class_indexed
19/03/26 01:43:54 SPARK:WARN SparkContext: The path /mnt/context/transformer_cortex_index_string.py has been added already. Overwriting of added paths is not supported in the current version.
19/03/26 01:43:55 SPARK:WARN SparkContext: The path /mnt/context/transformer_cortex_index_string.py has been added already. Overwriting of added paths is not supported in the current version.
INFO:cortex:class: Iris-setosa Iris-setosa Iris-setosa
INFO:cortex:class_indexed: 0 0 0
INFO:cortex:Transforming petal_length to petal_length_normalized
19/03/26 01:43:56 SPARK:WARN SparkContext: The path /mnt/context/transformer_cortex_normalize.py has been added already. Overwriting of added paths is not supported in the current version.
19/03/26 01:43:56 SPARK:WARN SparkContext: The path /mnt/context/transformer_cortex_normalize.py has been added already. Overwriting of added paths is not supported in the current version.
...