R2023a Cloudera Hadoop error com.mathworks.toolbox.parallel.hadoop.MatlabStartupFailureException: parallel:mapreduce:HadoopTaskOtherFailure
19 views (last 30 days)
Show older comments
On MATLAB R2023a MATLAB Distributed Computing Server (MDCS) running on Cloudera Hadoop we periodically get the below error in a mapreduce job failure but then it will run fine. Any ideas?
2024-04-26 16:04:35,721 ERROR [IPC Server handler 24 on 34933] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1690115930864_20721693_r_000000_0 - exited : com.mathworks.toolbox.parallel.hadoop.MatlabStartupFailureException: parallel:mapreduce:HadoopTaskOtherFailure
Caused by: com.mathworks.util.ShutdownRuntimeException: Java is shutting down
at com.mathworks.mvm.MvmFactory.nativeStartSession(Native Method)
at com.mathworks.mvm.MvmSession.createSession(MvmSession.java:276)
at com.mathworks.mvm.MvmSession.createSession(MvmSession.java:249)
at com.mathworks.toolbox.parallel.hadoop.worker.MvmPool.initializeMvmSession(Unknown Source)
at com.mathworks.toolbox.parallel.hadoop.worker.MvmPool.<init>(Unknown Source)
at com.mathworks.toolbox.parallel.hadoop.link.MatlabWorkerSingleton.initialize(Unknown Source)
at com.mathworks.toolbox.parallel.hadoop.link.MatlabReducer.setup(Unknown Source)
at com.mathworks.toolbox.parallel.hadoop.link.MatlabReducer.run(Unknown Source)
at com.mathworks.toolbox.parallel.hadoop.MatlabReflectionReducer.run(Unknown Source)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:628)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:390)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
0 Comments
Answers (0)
See Also
Categories
Find more on Startup and Shutdown in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!