org.pentaho.osgi.api.IKarafFeatureWatcher$FeatureWatcherException: Unknown error in KarafWatcher

Pentaho BI Platform Tracking | João Pereira | 10 months ago
  1. 0

    When executing DI-Server 6.0 GA on JBoss EAP 6.4, we are not able to properly initialize karaf. Karaf does tries to initialize but it shutdowns right after. Moreover, when trying to shutdown DI-Server it gets blocked. I get these errors on the logs: {noformat} [org.pentaho.di.osgi.KarafLifecycleListener] (KarafLifecycleListner Timeout Thread) The Kettle Karaf Lifycycle Listener failed to execute properly. Releasing lifecycle hold, but some services may be unavailable. {noformat} {noformat} ERROR [org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/pentaho-di]] (ServerService Thread Pool -- 72) JBWEB000289: Servlet proxy threw load() exception: javax.servlet.ServletException: Bundle context attribute [org.osgi.framework.BundleContext] not set in servlet context at org.apache.felix.http.proxy.ProxyServlet.getBundleContext(ProxyServlet.java:81) [org.apache.felix.http.proxy-2.3.0.jar:2.3.0] at org.apache.felix.http.proxy.ProxyServlet.doInit(ProxyServlet.java:50) [org.apache.felix.http.proxy-2.3.0.jar:2.3.0] at org.apache.felix.http.proxy.ProxyServlet.init(ProxyServlet.java:39) [org.apache.felix.http.proxy-2.3.0.jar:2.3.0] at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1194) [jbossweb-7.5.7.Final-redhat-1.jar:7.5.7.Final-redhat-1] at org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:1100) [jbossweb-7.5.7.Final-redhat-1.jar:7.5.7.Final-redhat-1] at org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:3593) [jbossweb-7.5.7.Final-redhat-1.jar:7.5.7.Final-redhat-1] at org.apache.catalina.core.StandardContext.start(StandardContext.java:3802) [jbossweb-7.5.7.Final-redhat-1.jar:7.5.7.Final-redhat-1] at org.jboss.as.web.deployment.WebDeploymentService.doStart(WebDeploymentService.java:163) [jboss-as-web-7.5.0.Final-redhat-21.jar:7.5.0.Final-redhat-21] at org.jboss.as.web.deployment.WebDeploymentService.access$000(WebDeploymentService.java:61) [jboss-as-web-7.5.0.Final-redhat-21.jar:7.5.0.Final-redhat-21] at org.jboss.as.web.deployment.WebDeploymentService$1.run(WebDeploymentService.java:96) [jboss-as-web-7.5.0.Final-redhat-21.jar:7.5.0.Final-redhat-21] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_79] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_79] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_79] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_79] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_79] at org.jboss.threads.JBossThread.run(JBossThread.java:122) {noformat} {noformat} ERROR [org.pentaho.di.osgi.KarafLifecycleListener] (Thread-131) Error in Feature Watcher: org.pentaho.osgi.api.IKarafFeatureWatcher$FeatureWatcherException: Unknown error in KarafWatcher at org.pentaho.osgi.impl.KarafFeatureWatcherImpl.waitForFeatures(KarafFeatureWatcherImpl.java:130) at org.pentaho.di.osgi.KarafLifecycleListener$2.run(KarafLifecycleListener.java:95) [pdi-osgi-bridge-core-6.0.0.0-353.jar:6.0.0.0-353] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_79] Caused by: org.pentaho.osgi.api.IKarafFeatureWatcher$FeatureWatcherException: Timed out waiting for Karaf features to install: config,management,kar,ssh,cxf,camel,camel-blueprint,camel-stream,pentaho-camel-jms,pentaho-server,mongolap,pentaho-monitoring-to-snmp,pentaho-monitoring-jms-broker,pentaho-metaverse,pdi-dataservice,pentaho-yarn-obf,pentaho-marketplace at org.pentaho.osgi.impl.KarafFeatureWatcherImpl.waitForFeatures(KarafFeatureWatcherImpl.java:116) ... 2 more ERROR [org.pentaho.di.osgi.KarafLifecycleListener] (Thread-131) Error in Blueprint Watcher: org.pentaho.osgi.api.IKarafBlueprintWatcher$BlueprintWatcherException: Unknown error in KarafBlueprintWatcher at org.pentaho.osgi.impl.KarafBlueprintWatcherImpl.waitForBlueprint(KarafBlueprintWatcherImpl.java:89) at org.pentaho.di.osgi.KarafLifecycleListener$2.run(KarafLifecycleListener.java:112) [pdi-osgi-bridge-core-6.0.0.0-353.jar:6.0.0.0-353] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_79] Caused by: org.pentaho.osgi.api.IKarafBlueprintWatcher$BlueprintWatcherException: Timed out waiting for blueprints to load: pdi-dataservice-server-plugin,pentaho-big-data-impl-shim-initializer,pentaho-big-data-impl-shim-hdfs,pentaho-big-data-impl-shim-pig,pentaho-big-data-impl-vfs-hdfs,pentaho-big-data-kettle-plugins-common-named-cluster-bridge,pentaho-big-data-kettle-plugins-guiTestActionHandlers,pentaho-big-data-kettle-plugins-pig,pentaho-hadoop-shims-mapr-osgi-jaas,pentaho-big-data-impl-clusterTests,pentaho-big-data-impl-shim-shimTests,pentaho-blueprint-activators-6.0.0.0,pentaho-ss4-proxies,pentaho-ss2-proxies,pentaho-proxy-spring4,pentaho-requirejs-osgi-manager,pentaho-blueprint-activators-6.0.0.0,pentaho-angular-bundle,mondrian,org.apache.cxf.karaf.cxf-karaf-commands,org.apache.karaf.management.server,org.apache.karaf.config.core,org.apache.karaf.config.command,pentaho-marketplace-ba,pentaho-yarn-api,pentaho-yarn-impl-shim,pentaho-yarn-kettle-plugin,pentaho-monitoring-plugin,pentaho-camel-snmp,pentaho-blueprint-activators-6.0.0.0,org.apache.karaf.shell.ssh,pentaho-metaverse-core,pentaho-blueprint-activators-6.0.0.0 at org.pentaho.osgi.impl.KarafBlueprintWatcherImpl.waitForBlueprint(KarafBlueprintWatcherImpl.java:77) ... 2 more {noformat} Until now, I have identified a set of bundles from features: pentaho-big-data-plugin-osgi, pentaho-big-data-plugin-testless-osgi, and pentaho-yarn-obf that block karaf and if removed they allow karaf to initialize. The bundles that prevent karaf from properly initializing on jboss are: - mvn:pentaho/pentaho-yarn-impl-shim/6.0.0.0-353/jar/obf - mvn:pentaho/pentaho-big-data-impl-shim-shimTests/6.0.0.0-353 - mvn:pentaho/pentaho-big-data-impl-shim-initializer/6.0.0.0-353 - mvn:pentaho/pentaho-big-data-impl-shim-hdfs/6.0.0.0-353 - mvn:pentaho/pentaho-big-data-impl-shim-pig/6.0.0.0-353 - mvn:pentaho/pentaho-big-data-kettle-plugins-common-named-cluster-bridge/6.0.0.0-353 - mvn:pentaho/pentaho-hadoop-shims-mapr-osgi-jaas/6.0.0.0-353

    Pentaho BI Platform Tracking | 10 months ago | João Pereira
    org.pentaho.osgi.api.IKarafFeatureWatcher$FeatureWatcherException: Unknown error in KarafWatcher
  2. 0

    When executing DI-Server 6.0 GA on JBoss EAP 6.4, we are not able to properly initialize karaf. Karaf does tries to initialize but it shutdowns right after. Moreover, when trying to shutdown DI-Server it gets blocked. I get these errors on the logs: {noformat} [org.pentaho.di.osgi.KarafLifecycleListener] (KarafLifecycleListner Timeout Thread) The Kettle Karaf Lifycycle Listener failed to execute properly. Releasing lifecycle hold, but some services may be unavailable. {noformat} {noformat} ERROR [org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/pentaho-di]] (ServerService Thread Pool -- 72) JBWEB000289: Servlet proxy threw load() exception: javax.servlet.ServletException: Bundle context attribute [org.osgi.framework.BundleContext] not set in servlet context at org.apache.felix.http.proxy.ProxyServlet.getBundleContext(ProxyServlet.java:81) [org.apache.felix.http.proxy-2.3.0.jar:2.3.0] at org.apache.felix.http.proxy.ProxyServlet.doInit(ProxyServlet.java:50) [org.apache.felix.http.proxy-2.3.0.jar:2.3.0] at org.apache.felix.http.proxy.ProxyServlet.init(ProxyServlet.java:39) [org.apache.felix.http.proxy-2.3.0.jar:2.3.0] at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1194) [jbossweb-7.5.7.Final-redhat-1.jar:7.5.7.Final-redhat-1] at org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:1100) [jbossweb-7.5.7.Final-redhat-1.jar:7.5.7.Final-redhat-1] at org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:3593) [jbossweb-7.5.7.Final-redhat-1.jar:7.5.7.Final-redhat-1] at org.apache.catalina.core.StandardContext.start(StandardContext.java:3802) [jbossweb-7.5.7.Final-redhat-1.jar:7.5.7.Final-redhat-1] at org.jboss.as.web.deployment.WebDeploymentService.doStart(WebDeploymentService.java:163) [jboss-as-web-7.5.0.Final-redhat-21.jar:7.5.0.Final-redhat-21] at org.jboss.as.web.deployment.WebDeploymentService.access$000(WebDeploymentService.java:61) [jboss-as-web-7.5.0.Final-redhat-21.jar:7.5.0.Final-redhat-21] at org.jboss.as.web.deployment.WebDeploymentService$1.run(WebDeploymentService.java:96) [jboss-as-web-7.5.0.Final-redhat-21.jar:7.5.0.Final-redhat-21] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_79] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_79] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_79] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_79] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_79] at org.jboss.threads.JBossThread.run(JBossThread.java:122) {noformat} {noformat} ERROR [org.pentaho.di.osgi.KarafLifecycleListener] (Thread-131) Error in Feature Watcher: org.pentaho.osgi.api.IKarafFeatureWatcher$FeatureWatcherException: Unknown error in KarafWatcher at org.pentaho.osgi.impl.KarafFeatureWatcherImpl.waitForFeatures(KarafFeatureWatcherImpl.java:130) at org.pentaho.di.osgi.KarafLifecycleListener$2.run(KarafLifecycleListener.java:95) [pdi-osgi-bridge-core-6.0.0.0-353.jar:6.0.0.0-353] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_79] Caused by: org.pentaho.osgi.api.IKarafFeatureWatcher$FeatureWatcherException: Timed out waiting for Karaf features to install: config,management,kar,ssh,cxf,camel,camel-blueprint,camel-stream,pentaho-camel-jms,pentaho-server,mongolap,pentaho-monitoring-to-snmp,pentaho-monitoring-jms-broker,pentaho-metaverse,pdi-dataservice,pentaho-yarn-obf,pentaho-marketplace at org.pentaho.osgi.impl.KarafFeatureWatcherImpl.waitForFeatures(KarafFeatureWatcherImpl.java:116) ... 2 more ERROR [org.pentaho.di.osgi.KarafLifecycleListener] (Thread-131) Error in Blueprint Watcher: org.pentaho.osgi.api.IKarafBlueprintWatcher$BlueprintWatcherException: Unknown error in KarafBlueprintWatcher at org.pentaho.osgi.impl.KarafBlueprintWatcherImpl.waitForBlueprint(KarafBlueprintWatcherImpl.java:89) at org.pentaho.di.osgi.KarafLifecycleListener$2.run(KarafLifecycleListener.java:112) [pdi-osgi-bridge-core-6.0.0.0-353.jar:6.0.0.0-353] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_79] Caused by: org.pentaho.osgi.api.IKarafBlueprintWatcher$BlueprintWatcherException: Timed out waiting for blueprints to load: pdi-dataservice-server-plugin,pentaho-big-data-impl-shim-initializer,pentaho-big-data-impl-shim-hdfs,pentaho-big-data-impl-shim-pig,pentaho-big-data-impl-vfs-hdfs,pentaho-big-data-kettle-plugins-common-named-cluster-bridge,pentaho-big-data-kettle-plugins-guiTestActionHandlers,pentaho-big-data-kettle-plugins-pig,pentaho-hadoop-shims-mapr-osgi-jaas,pentaho-big-data-impl-clusterTests,pentaho-big-data-impl-shim-shimTests,pentaho-blueprint-activators-6.0.0.0,pentaho-ss4-proxies,pentaho-ss2-proxies,pentaho-proxy-spring4,pentaho-requirejs-osgi-manager,pentaho-blueprint-activators-6.0.0.0,pentaho-angular-bundle,mondrian,org.apache.cxf.karaf.cxf-karaf-commands,org.apache.karaf.management.server,org.apache.karaf.config.core,org.apache.karaf.config.command,pentaho-marketplace-ba,pentaho-yarn-api,pentaho-yarn-impl-shim,pentaho-yarn-kettle-plugin,pentaho-monitoring-plugin,pentaho-camel-snmp,pentaho-blueprint-activators-6.0.0.0,org.apache.karaf.shell.ssh,pentaho-metaverse-core,pentaho-blueprint-activators-6.0.0.0 at org.pentaho.osgi.impl.KarafBlueprintWatcherImpl.waitForBlueprint(KarafBlueprintWatcherImpl.java:77) ... 2 more {noformat} Until now, I have identified a set of bundles from features: pentaho-big-data-plugin-osgi, pentaho-big-data-plugin-testless-osgi, and pentaho-yarn-obf that block karaf and if removed they allow karaf to initialize. The bundles that prevent karaf from properly initializing on jboss are: - mvn:pentaho/pentaho-yarn-impl-shim/6.0.0.0-353/jar/obf - mvn:pentaho/pentaho-big-data-impl-shim-shimTests/6.0.0.0-353 - mvn:pentaho/pentaho-big-data-impl-shim-initializer/6.0.0.0-353 - mvn:pentaho/pentaho-big-data-impl-shim-hdfs/6.0.0.0-353 - mvn:pentaho/pentaho-big-data-impl-shim-pig/6.0.0.0-353 - mvn:pentaho/pentaho-big-data-kettle-plugins-common-named-cluster-bridge/6.0.0.0-353 - mvn:pentaho/pentaho-hadoop-shims-mapr-osgi-jaas/6.0.0.0-353

    Pentaho BI Platform Tracking | 10 months ago | João Pereira
    org.pentaho.osgi.api.IKarafFeatureWatcher$FeatureWatcherException: Unknown error in KarafWatcher

    Root Cause Analysis

    1. org.pentaho.osgi.api.IKarafFeatureWatcher$FeatureWatcherException

      Timed out waiting for Karaf features to install: config,management,kar,ssh,cxf,camel,camel-blueprint,camel-stream,pentaho-camel-jms,pentaho-server,mongolap,pentaho-monitoring-to-snmp,pentaho-monitoring-jms-broker,pentaho-metaverse,pdi-dataservice,pentaho-yarn-obf,pentaho-marketplace

      at org.pentaho.osgi.impl.KarafFeatureWatcherImpl.waitForFeatures()
    2. org.pentaho.osgi
      KarafFeatureWatcherImpl.waitForFeatures
      1. org.pentaho.osgi.impl.KarafFeatureWatcherImpl.waitForFeatures(KarafFeatureWatcherImpl.java:116)
      1 frame
    3. org.pentaho.di
      KarafLifecycleListener$2.run
      1. org.pentaho.di.osgi.KarafLifecycleListener$2.run(KarafLifecycleListener.java:95)[pdi-osgi-bridge-core-6.0.0.0-353.jar:6.0.0.0-353]
      1 frame
    4. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)[rt.jar:1.7.0_79]
      1 frame