com.vmware.bdd.exception.TaskException: task execution failed: failed to notify VHM swithing to manual for cluster: data_compute_separation_cluster

SpringSource Issue Tracker | Yifeng Xiao | 4 years ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Reproduce steps: 1. Deploy a vApp and create a cluster with a long name. Creation failed because create resource pool failed. {code} FAILED 28% node group: master, instance number: 1 roles:[hadoop_namenode, hadoop_jobtracker] NAME IP STATUS TASK ------------------------------------------------------------------- data_compute_separation_cluster-master-0 Not Exist Cloning VM node group: data, instance number: 4 roles:[hadoop_datanode] NAME IP STATUS TASK ----------------------------------------------------------------- data_compute_separation_cluster-data-1 Not Exist Cloning VM data_compute_separation_cluster-data-0 Not Exist Cloning VM data_compute_separation_cluster-data-3 Not Exist Cloning VM data_compute_separation_cluster-data-2 Not Exist Cloning VM node group: compute, instance number: 8 roles:[hadoop_tasktracker] NAME IP STATUS TASK -------------------------------------------------------------------- data_compute_separation_cluster-compute-2 Not Exist Cloning VM data_compute_separation_cluster-compute-1 Not Exist Cloning VM data_compute_separation_cluster-compute-4 Not Exist Cloning VM data_compute_separation_cluster-compute-3 Not Exist Cloning VM data_compute_separation_cluster-compute-0 Not Exist Cloning VM data_compute_separation_cluster-compute-5 Not Exist Cloning VM data_compute_separation_cluster-compute-6 Not Exist Cloning VM data_compute_separation_cluster-compute-7 Not Exist Cloning VM node group: client, instance number: 1 roles:[hadoop_client, pig, hive, hive_server] NAME IP STATUS TASK ------------------------------------------------------------------- data_compute_separation_cluster-client-0 Not Exist Cloning VM cluster data_compute_separation_cluster create failed: internal error: Resource pool creation failed for cluster data_compute_separation_cluster you can get task failure details from serengeti server log at: /opt/serengeti/logs/serengeti*,/opt/serengeti/logs/ironfan* {code} 2. Delete the cluster. Actual Result: Cli message: {code} FAILED 0% node group: master, instance number: 1 roles:[hadoop_namenode, hadoop_jobtracker] NAME IP STATUS TASK ------------------------------------------------------------------- data_compute_separation_cluster-master-0 Not Exist Cloning VM node group: data, instance number: 4 roles:[hadoop_datanode] NAME IP STATUS TASK ----------------------------------------------------------------- data_compute_separation_cluster-data-1 Not Exist Cloning VM data_compute_separation_cluster-data-0 Not Exist Cloning VM data_compute_separation_cluster-data-3 Not Exist Cloning VM data_compute_separation_cluster-data-2 Not Exist Cloning VM node group: compute, instance number: 8 roles:[hadoop_tasktracker] NAME IP STATUS TASK -------------------------------------------------------------------- data_compute_separation_cluster-compute-2 Not Exist Cloning VM data_compute_separation_cluster-compute-1 Not Exist Cloning VM data_compute_separation_cluster-compute-4 Not Exist Cloning VM data_compute_separation_cluster-compute-3 Not Exist Cloning VM data_compute_separation_cluster-compute-0 Not Exist Cloning VM data_compute_separation_cluster-compute-5 Not Exist Cloning VM data_compute_separation_cluster-compute-6 Not Exist Cloning VM data_compute_separation_cluster-compute-7 Not Exist Cloning VM node group: client, instance number: 1 roles:[hadoop_client, pig, hive, hive_server] NAME IP STATUS TASK ------------------------------------------------------------------- data_compute_separation_cluster-client-0 Not Exist Cloning VM cluster data_compute_separation_cluster delete failed: task failed {code} log in serengeti.log: {code} 2013 Jun 01 05:52:27,796+0000 ERROR SimpleAsyncTaskExecutor-5| com.vmware.bdd.aop.logging.ExceptionHandlerAspect: Service error com.vmware.bdd.exception.TaskException: task execution failed: failed to notify VHM swithing to manual for cluster: data_compute_separation_cluster at com.vmware.bdd.exception.TaskException.EXECUTION_FAILED(TaskException.java:27) at com.vmware.bdd.service.job.ClusterJobExecutionListener.waitForManual(ClusterJobExecutionListener.java:166) at com.vmware.bdd.service.job.ClusterJobExecutionListener.beforeJob(ClusterJobExecutionListener.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:318) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:55) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202) at $Proxy131.beforeJob(Unknown Source) at org.springframework.batch.core.listener.CompositeJobExecutionListener.beforeJob(CompositeJobExecutionListener.java:71) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:290) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:120) at java.lang.Thread.run(Thread.java:636) 2013 Jun 01 05:52:27,797+0000 ERROR SimpleAsyncTaskExecutor-5| org.springframework.batch.core.job.AbstractJob: Encountered fatal error executing job com.vmware.bdd.exception.TaskException: task execution failed: failed to notify VHM swithing to manual for cluster: data_compute_separation_cluster at com.vmware.bdd.exception.TaskException.EXECUTION_FAILED(TaskException.java:27) at com.vmware.bdd.service.job.ClusterJobExecutionListener.waitForManual(ClusterJobExecutionListener.java:166) at com.vmware.bdd.service.job.ClusterJobExecutionListener.beforeJob(ClusterJobExecutionListener.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:318) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:55) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202) at $Proxy131.beforeJob(Unknown Source) at org.springframework.batch.core.listener.CompositeJobExecutionListener.beforeJob(CompositeJobExecutionListener.java:71) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:290) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:120) at java.lang.Thread.run(Thread.java:636) {code}

    SpringSource Issue Tracker | 4 years ago | Yifeng Xiao
    com.vmware.bdd.exception.TaskException: task execution failed: failed to notify VHM swithing to manual for cluster: data_compute_separation_cluster
  2. 0

    Reproduce steps: 1. Deploy a vApp and create a cluster with a long name. Creation failed because create resource pool failed. {code} FAILED 28% node group: master, instance number: 1 roles:[hadoop_namenode, hadoop_jobtracker] NAME IP STATUS TASK ------------------------------------------------------------------- data_compute_separation_cluster-master-0 Not Exist Cloning VM node group: data, instance number: 4 roles:[hadoop_datanode] NAME IP STATUS TASK ----------------------------------------------------------------- data_compute_separation_cluster-data-1 Not Exist Cloning VM data_compute_separation_cluster-data-0 Not Exist Cloning VM data_compute_separation_cluster-data-3 Not Exist Cloning VM data_compute_separation_cluster-data-2 Not Exist Cloning VM node group: compute, instance number: 8 roles:[hadoop_tasktracker] NAME IP STATUS TASK -------------------------------------------------------------------- data_compute_separation_cluster-compute-2 Not Exist Cloning VM data_compute_separation_cluster-compute-1 Not Exist Cloning VM data_compute_separation_cluster-compute-4 Not Exist Cloning VM data_compute_separation_cluster-compute-3 Not Exist Cloning VM data_compute_separation_cluster-compute-0 Not Exist Cloning VM data_compute_separation_cluster-compute-5 Not Exist Cloning VM data_compute_separation_cluster-compute-6 Not Exist Cloning VM data_compute_separation_cluster-compute-7 Not Exist Cloning VM node group: client, instance number: 1 roles:[hadoop_client, pig, hive, hive_server] NAME IP STATUS TASK ------------------------------------------------------------------- data_compute_separation_cluster-client-0 Not Exist Cloning VM cluster data_compute_separation_cluster create failed: internal error: Resource pool creation failed for cluster data_compute_separation_cluster you can get task failure details from serengeti server log at: /opt/serengeti/logs/serengeti*,/opt/serengeti/logs/ironfan* {code} 2. Delete the cluster. Actual Result: Cli message: {code} FAILED 0% node group: master, instance number: 1 roles:[hadoop_namenode, hadoop_jobtracker] NAME IP STATUS TASK ------------------------------------------------------------------- data_compute_separation_cluster-master-0 Not Exist Cloning VM node group: data, instance number: 4 roles:[hadoop_datanode] NAME IP STATUS TASK ----------------------------------------------------------------- data_compute_separation_cluster-data-1 Not Exist Cloning VM data_compute_separation_cluster-data-0 Not Exist Cloning VM data_compute_separation_cluster-data-3 Not Exist Cloning VM data_compute_separation_cluster-data-2 Not Exist Cloning VM node group: compute, instance number: 8 roles:[hadoop_tasktracker] NAME IP STATUS TASK -------------------------------------------------------------------- data_compute_separation_cluster-compute-2 Not Exist Cloning VM data_compute_separation_cluster-compute-1 Not Exist Cloning VM data_compute_separation_cluster-compute-4 Not Exist Cloning VM data_compute_separation_cluster-compute-3 Not Exist Cloning VM data_compute_separation_cluster-compute-0 Not Exist Cloning VM data_compute_separation_cluster-compute-5 Not Exist Cloning VM data_compute_separation_cluster-compute-6 Not Exist Cloning VM data_compute_separation_cluster-compute-7 Not Exist Cloning VM node group: client, instance number: 1 roles:[hadoop_client, pig, hive, hive_server] NAME IP STATUS TASK ------------------------------------------------------------------- data_compute_separation_cluster-client-0 Not Exist Cloning VM cluster data_compute_separation_cluster delete failed: task failed {code} log in serengeti.log: {code} 2013 Jun 01 05:52:27,796+0000 ERROR SimpleAsyncTaskExecutor-5| com.vmware.bdd.aop.logging.ExceptionHandlerAspect: Service error com.vmware.bdd.exception.TaskException: task execution failed: failed to notify VHM swithing to manual for cluster: data_compute_separation_cluster at com.vmware.bdd.exception.TaskException.EXECUTION_FAILED(TaskException.java:27) at com.vmware.bdd.service.job.ClusterJobExecutionListener.waitForManual(ClusterJobExecutionListener.java:166) at com.vmware.bdd.service.job.ClusterJobExecutionListener.beforeJob(ClusterJobExecutionListener.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:318) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:55) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202) at $Proxy131.beforeJob(Unknown Source) at org.springframework.batch.core.listener.CompositeJobExecutionListener.beforeJob(CompositeJobExecutionListener.java:71) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:290) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:120) at java.lang.Thread.run(Thread.java:636) 2013 Jun 01 05:52:27,797+0000 ERROR SimpleAsyncTaskExecutor-5| org.springframework.batch.core.job.AbstractJob: Encountered fatal error executing job com.vmware.bdd.exception.TaskException: task execution failed: failed to notify VHM swithing to manual for cluster: data_compute_separation_cluster at com.vmware.bdd.exception.TaskException.EXECUTION_FAILED(TaskException.java:27) at com.vmware.bdd.service.job.ClusterJobExecutionListener.waitForManual(ClusterJobExecutionListener.java:166) at com.vmware.bdd.service.job.ClusterJobExecutionListener.beforeJob(ClusterJobExecutionListener.java:118) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:318) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:55) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202) at $Proxy131.beforeJob(Unknown Source) at org.springframework.batch.core.listener.CompositeJobExecutionListener.beforeJob(CompositeJobExecutionListener.java:71) at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:290) at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:120) at java.lang.Thread.run(Thread.java:636) {code}

    SpringSource Issue Tracker | 4 years ago | Yifeng Xiao
    com.vmware.bdd.exception.TaskException: task execution failed: failed to notify VHM swithing to manual for cluster: data_compute_separation_cluster

    Root Cause Analysis

    1. com.vmware.bdd.exception.TaskException

      task execution failed: failed to notify VHM swithing to manual for cluster: data_compute_separation_cluster

      at com.vmware.bdd.exception.TaskException.EXECUTION_FAILED()
    2. com.vmware.bdd
      ClusterJobExecutionListener.beforeJob
      1. com.vmware.bdd.exception.TaskException.EXECUTION_FAILED(TaskException.java:27)
      2. com.vmware.bdd.service.job.ClusterJobExecutionListener.waitForManual(ClusterJobExecutionListener.java:166)
      3. com.vmware.bdd.service.job.ClusterJobExecutionListener.beforeJob(ClusterJobExecutionListener.java:118)
      3 frames
    3. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:616)
      4 frames
    4. Spring AOP
      JdkDynamicAopProxy.invoke
      1. org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:318)
      2. org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
      3. org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
      4. org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:55)
      5. org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
      6. org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
      7. org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
      8. org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
      8 frames
    5. Unknown
      $Proxy131.beforeJob
      1. $Proxy131.beforeJob(Unknown Source)
      1 frame
    6. Spring Batch Core
      SimpleJobLauncher$1.run
      1. org.springframework.batch.core.listener.CompositeJobExecutionListener.beforeJob(CompositeJobExecutionListener.java:71)
      2. org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:290)
      3. org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:120)
      3 frames
    7. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:636)
      1 frame