cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Community Tip - Your Friends List is a way to easily have access to the community members that you interact with the most! X

Creating Profile aborted - Spark maxResultSize

skef
11-Garnet
11-Garnet
‎Jul 31, 2018 04:57 AM
‎Jul 31, 2018 04:57 AM

Creating Profile aborted - Spark maxResultSize

A 'CreateProfile' job is aborted, throwing this exception:
 
SparkException: Job aborted due to stage failure: Total size of serialized results of 69 tasks (1026.2 MB) is bigger than spark.driver.maxResultSize (1024.0 MB)
 
Obviously, thingworx analytics is using apache spark for analyzing datasets. I need the maxResultSize to be configurable in order to be able to get the profiles of a large dataset. 
 
Is are any possibility to change the maxResultSize in the micro service?
Labels:
0 Kudos
Notify Moderator
0 REPLIES 0
Top Tags