Spark Dataframe UDF - Schema for type Any is not supported
When implementing udf (user defined function),
don't forget to take care of all possible situation that can happen in the code block.
when IF comes, remember that ELSE always follows.
So simple, So Stupid.
'소프트웨어 개발 > Scala - Functional' 카테고리의 다른 글
| scala collect list scala (0) | 2018.06.29 |
|---|---|
| 스파크 전치... (0) | 2018.06.20 |
| Custom parameter when using udf (0) | 2018.05.19 |
| Spark 2, Decision Tree FeatureImportance (0) | 2018.04.10 |
| Scala Data Structure Efficiency (0) | 2017.11.26 |