org.apache.spark.sql.AnalysisException: resolved attribute(s) OIL_PRODUCTION_AVG#827,CUT_OFF#822 missing from TIME#63,OIL_PRODUCTION#43 in operator !Project [TIME#63, OIL_PRODUCTION#43, CASE WHEN (abs((OIL_PRODUCTION#43 - OIL_PRODUCTION_AVG#827)) < CUT_OFF#822) THEN 1 ELSE 0 END AS Label#833];; !Project [TIME#63, OIL_PRODUCTION#43, CASE WHEN (abs((OIL_PRODUCTION#43 - OIL_PRODUCTION_AVG#827)) < CUT_OFF#822) THEN 1 ELSE 0 END AS Label#833] +- Project [TIME#63, OIL_PRODUCTION#43]

Stack Overflow | Darshita | 2 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Apache Spark Structured Streaming: How to use multiple DataFrame Columns in one condition?

    Stack Overflow | 2 months ago | Darshita
    org.apache.spark.sql.AnalysisException: resolved attribute(s) OIL_PRODUCTION_AVG#827,CUT_OFF#822 missing from TIME#63,OIL_PRODUCTION#43 in operator !Project [TIME#63, OIL_PRODUCTION#43, CASE WHEN (abs((OIL_PRODUCTION#43 - OIL_PRODUCTION_AVG#827)) < CUT_OFF#822) THEN 1 ELSE 0 END AS Label#833];; !Project [TIME#63, OIL_PRODUCTION#43, CASE WHEN (abs((OIL_PRODUCTION#43 - OIL_PRODUCTION_AVG#827)) < CUT_OFF#822) THEN 1 ELSE 0 END AS Label#833] +- Project [TIME#63, OIL_PRODUCTION#43]
  2. 0

    Spark 1.5.2: org.apache.spark.sql.AnalysisException: unresolved operator 'Union;

    Stack Overflow | 8 months ago | Neel
    org.apache.spark.sql.AnalysisException: unresolved operator 'Union;
  3. 0

    Unable to merge spark dataframe columns with df.withColumn()

    Stack Overflow | 1 year ago | kentt
    org.apache.spark.sql.AnalysisException: resolved attribute(s) SOG#3 missing from time#1 in operator !Project [time#1,SOG#3 AS SOG#34];
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Spark - How to identify a failed Job

    Stack Overflow | 7 months ago | Yohan Liyanage
    org.apache.spark.sql.AnalysisException: Path does not exist: s3n://data/2016-08-31/*.csv;
  6. 0

    Having count(distinct) not working with hivecontext query in spark 1.6

    Stack Overflow | 5 months ago | Yash_spark
    org.apache.spark.sql.AnalysisException: resolved attribute(s) gid#687,z#688 missing from x#685,y#252,z#255 in operator !Aggregate [x#685,y#252], [cast(((count(if ((gid#687 = 1)) z#688 else null),mode=Complete,isDistinct=false) > cast(1 as bigint)) as boolean) AS havingCondition#686,x#685,y#252];

  1. tyson925 1 times, last 4 months ago
4 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. org.apache.spark.sql.AnalysisException

    resolved attribute(s) OIL_PRODUCTION_AVG#827,CUT_OFF#822 missing from TIME#63,OIL_PRODUCTION#43 in operator !Project [TIME#63, OIL_PRODUCTION#43, CASE WHEN (abs((OIL_PRODUCTION#43 - OIL_PRODUCTION_AVG#827)) < CUT_OFF#822) THEN 1 ELSE 0 END AS Label#833];; !Project [TIME#63, OIL_PRODUCTION#43, CASE WHEN (abs((OIL_PRODUCTION#43 - OIL_PRODUCTION_AVG#827)) < CUT_OFF#822) THEN 1 ELSE 0 END AS Label#833] +- Project [TIME#63, OIL_PRODUCTION#43]

    at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$class.failAnalysis()
  2. Spark Project Catalyst
    Analyzer.checkAnalysis
    1. org.apache.spark.sql.catalyst.analysis.CheckAnalysis$class.failAnalysis(CheckAnalysis.scala:40)
    2. org.apache.spark.sql.catalyst.analysis.Analyzer.failAnalysis(Analyzer.scala:57)
    3. org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1.apply(CheckAnalysis.scala:337)
    4. org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1.apply(CheckAnalysis.scala:67)
    5. org.apache.spark.sql.catalyst.trees.TreeNode.foreachUp(TreeNode.scala:128)
    6. org.apache.spark.sql.catalyst.analysis.CheckAnalysis$class.checkAnalysis(CheckAnalysis.scala:67)
    7. org.apache.spark.sql.catalyst.analysis.Analyzer.checkAnalysis(Analyzer.scala:57)
    7 frames
  3. Spark Project SQL
    Dataset.withColumn
    1. org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:48)
    2. org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:63)
    3. org.apache.spark.sql.Dataset.org$apache$spark$sql$Dataset$$withPlan(Dataset.scala:2822)
    4. org.apache.spark.sql.Dataset.select(Dataset.scala:1121)
    5. org.apache.spark.sql.Dataset.withColumn(Dataset.scala:1866)
    5 frames