java.lang.RuntimeException

Failed to apply upload policy

Samebug tips0

There are no available Samebug tips for this exception. If you know how to solve this issue, help other users by writing a short tip.

Don't give up yet. Paste your full stack trace to get a solution.

Solutions on the web39487

  • Failed to apply upload policy
  • via GitHub by doriwal
    , 9 months ago
    Failed to apply upload policy
  • via Google Groups by Unknown author, 1 year ago
    Failed to apply upload policy
  • Stack trace

    • java.lang.RuntimeException: Failed to apply upload policy at com.pinterest.secor.consumer.Consumer.checkUploadPolicy(Consumer.java:118) at com.pinterest.secor.consumer.Consumer.run(Consumer.java:106) Caused by: org.apache.hadoop.fs.ChecksumException: Checksum error: /home/usr/secor_prod_binaries_1/message_logs/backup/21738_20/dt=20160807/hour=02/Hostname-error_log-20160807-02-00.gz at 2096128 at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.readChunk(ChecksumFileSystem.java:254) at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:276) at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:228) at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:196) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.compress.DecompressorStream.getCompressedData(DecompressorStream.java:159) at org.apache.hadoop.io.compress.DecompressorStream.decompress(DecompressorStream.java:143) at org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:85) at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) at java.io.BufferedInputStream.read(BufferedInputStream.java:254) at com.pinterest.secor.io.impl.DelimitedTextFileReaderWriterFactory$DelimitedTextFileReader.next(DelimitedTextFileReaderWriterFactory.java:80) at com.pinterest.secor.uploader.Uploader.trim(Uploader.java:144) at com.pinterest.secor.uploader.Uploader.trimFiles(Uploader.java:177) at com.pinterest.secor.uploader.Uploader.checkTopicPartition(Uploader.java:206) at com.pinterest.secor.uploader.Uploader.applyPolicy(Uploader.java:216) at com.pinterest.secor.consumer.Consumer.checkUploadPolicy(Consumer.java:114)

    Write tip

    You have a different solution? A short tip here would help you and many other users who saw this issue last week.

    Users with the same issue

    7 times, 8 months ago
    2 times, 1 year ago
    Unknown user
    2 times, 1 year ago
    Unknown user
    2 times, 1 year ago