24/10/24 21:14:00 ERROR ApplicationMaster: User class threw exception: java.lang.IllegalArgumentException: Can't use serialized shuffle for shuffleId: 0, because the serializer: org.apache.spark.serializer.JavaSerializer does not support object relocation.
Support reject JavaSerializer earlier and use sort shuffleManager instead.
Code of Conduct
Search before asking
What would you like to be improved?
How should we improve?
Support reject JavaSerializer earlier and use sort shuffleManager instead.
Are you willing to submit PR?