com.facebook.presto.spi.PrestoException

Error opening Hive split s3n://netflix-dataoven-prod-users/hive/warehouse/nyigitbasi.db/nested_field_test/20160713_002223_00017_he7h3_a34c4336-28ce-4a72-9253-3529044d3710 (offset=0, length=548): Schema mismatch, metastore schema for row column row_field has 4 fields but parquet schema has 1 fields

Samebug tips0

There are no available Samebug tips for this exception. If you know how to solve this issue, help other users by writing a short tip.

Don't give up yet. Paste your full stack trace to get a solution.

Solutions on the web50

  • Error opening Hive split s3n://netflix-dataoven-prod-users/hive/warehouse/nyigitbasi.db/nested_field_test/20160713_002223_00017_he7h3_a34c4336-28ce-4a72-9253-3529044d3710 (offset=0, length=548): Schema mismatch, metastore schema for row column row_field has 4 fields but parquet schema has 1 fields
  • Error opening Hive split hdfs://CLUSTERALIAS/apps/hive/warehouse/employee/MOCK_DATA.csv (offset=0, length=62315) using org.apache.hadoop.mapred.TextInputFormat: java.net.UnknownHostException: CLUSTERALIAS
  • via GitHub by electrum
    , 11 months ago
    Error opening Hive split hdfs://hdp2-master-01:8020/apps/hive/warehouse/myorctable/000000_0 (offset=0, length=647999546) using org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: com.facebook.presto.hive.HiveRecordSet$2 cannot be cast to org.apache.hadoop.hive.ql.io.orc.OrcSplit
  • Stack trace

    • com.facebook.presto.spi.PrestoException: Error opening Hive split s3n:/
    • etflix-dataoven-prod-users/hive/warehouse
    • yigitbasi.db
    • ested_field_test/20160713_002223_00017_he7h3_a34c4336-28ce-4a72-9253-3529044d3710 (offset=0, length=548): Schema mismatch, metastore schema for row column row_field has 4 fields but parquet schema has 1 fields at com.facebook.presto.hive.parquet.ParquetHiveRecordCursor.createParquetRecordReader(ParquetHiveRecordCursor.java:489) at com.facebook.presto.hive.parquet.ParquetHiveRecordCursor.<init>(ParquetHiveRecordCursor.java:254) at com.facebook.presto.hive.parquet.ParquetRecordCursorProvider.createHiveRecordCursor(ParquetRecordCursorProvider.java:96) at com.facebook.presto.hive.HivePageSourceProvider.getHiveRecordCursor(HivePageSourceProvider.java:129) at com.facebook.presto.hive.HivePageSourceProvider.createPageSource(HivePageSourceProvider.java:107) at com.facebook.presto.spi.connector.classloader.ClassLoaderSafeConnectorPageSourceProvider.createPageSource(ClassLoaderSafeConnectorPageSourceProvider.java:44) at com.facebook.presto.split.PageSourceManager.createPageSource(PageSourceManager.java:48) at com.facebook.presto.operator.ScanFilterAndProjectOperator.createSourceIfNecessary(ScanFilterAndProjectOperator.java:292) at com.facebook.presto.operator.ScanFilterAndProjectOperator.isFinished(ScanFilterAndProjectOperator.java:180) at com.facebook.presto.operator.Driver.processInternal(Driver.java:375) at com.facebook.presto.operator.Driver.processFor(Driver.java:301) at com.facebook.presto.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:618) at com.facebook.presto.execution.TaskExecutor$PrioritizedSplitRunner.process(TaskExecutor.java:529) at com.facebook.presto.execution.TaskExecutor$Runner.run(TaskExecutor.java:665) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.IllegalArgumentException: Schema mismatch, metastore schema for row column row_field has 4 fields but parquet schema has 1 fields at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145) at com.facebook.presto.hive.parquet.ParquetHiveRecordCursor$ParquetStructConverter.createConverters(ParquetHiveRecordCursor.java:864) at com.facebook.presto.hive.parquet.ParquetHiveRecordCursor$ParquetStructConverter.<init>(ParquetHiveRecordCursor.java:946) at com.facebook.presto.hive.parquet.ParquetHiveRecordCursor.createGroupConverter(ParquetHiveRecordCursor.java:821) at com.facebook.presto.hive.parquet.ParquetHiveRecordCursor.access$300(ParquetHiveRecordCursor.java:125) at com.facebook.presto.hive.parquet.ParquetHiveRecordCursor$PrestoReadSupport.<init>(ParquetHiveRecordCursor.java:534) at com.facebook.presto.hive.parquet.ParquetHiveRecordCursor.createParquetRecordReader(ParquetHiveRecordCursor.java:428) ... 16 more

    Write tip

    You have a different solution? A short tip here would help you and many other users who saw this issue last week.

    Users with the same issue

    2 times, 1 year ago
    10 times, 2 weeks ago
    Once, 1 month ago
    Once, 2 months ago
    3 times, 3 months ago
    32 more bugmates