cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 

Community Tip - Did you get an answer that solved your problem? Please mark it as an Accepted Solution so others with the same problem can find the answer easily. X

Creating Profile aborted - Spark maxResultSize

skef
11-Garnet

Creating Profile aborted - Spark maxResultSize

A 'CreateProfile' job is aborted, throwing this exception:
 
SparkException: Job aborted due to stage failure: Total size of serialized results of 69 tasks (1026.2 MB) is bigger than spark.driver.maxResultSize (1024.0 MB)
 
Obviously, thingworx analytics is using apache spark for analyzing datasets. I need the maxResultSize to be configurable in order to be able to get the profiles of a large dataset. 
 
Is are any possibility to change the maxResultSize in the micro service?
0 REPLIES 0
Top Tags