org.jruby.exceptions.RaiseException: (InvalidByteSequenceError) ""\xA7"" on ASCII-8BIT

JIRA | Santo Natale | 3 years ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    Hi, I'm experiencing the exception below on Windows 2008 r2/Windows 2012: ###################################################### Exception in thread "LogStash::Runner" org.jruby.exceptions.RaiseException: (InvalidByteSequenceError) ""\xA7"" on ASCII-8BIT at org.jruby.RubyString.encode(org/jruby/RubyString.java:7599) at json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71) at LogStash::Event.to_json(file:/C:/logstash/logstash.jar!/logstash/event.rb:168) at LogStash::Outputs::Redis.receive(file:/C:/logstash/logstash.jar!/logstash/outputs/redis.rb:151) at LogStash::Outputs::Base.handle(file:/C:/logstash/logstash.jar!/logstash/outputs/base.rb:86) at RUBY.initialize((eval):17) at org.jruby.RubyProc.call(org/jruby/RubyProc.java:271) at LogStash::Pipeline.output(file:/C:/logstash/logstash.jar!/logstash/pipeline.rb:259) at RUBY.outputworker(file:/C:/logstash/logstash.jar!/logstash/pipeline.rb:218) at RUBY.start_outputs(file:/C:/logstash/logstash.jar!/logstash/pipeline.rb:145) ############################################# This happens randomly, but quite often ( several times per day ). Here's the configuration file: ########################################## input { eventlog { logfile => ["Application", "Security", "System", "Forwarded Events"] } } output { # stdout { codec => rubydebug } redis { host => "redis.example.com" data_type => "list" key => "eventlogs" } } ################################## The java implementation used is java sun jre7u51 . Different logstash instances on linux machines with openjdk 7u51 with output on the same redis server don't experience the crash. Do you need additional details ? Thank you very much,

    JIRA | 3 years ago | Santo Natale
    org.jruby.exceptions.RaiseException: (InvalidByteSequenceError) ""\xA7"" on ASCII-8BIT
  2. 0

    I got the following error when I enable Windows servers to send Eventlogs via NXLog to Logstash: Exception in thread "LogStash::Runner" org.jruby.exceptions.RaiseException: (InvalidByteSequenceError) ""\xE2"" on ASCII-8BIT at org.jruby.RubyString.encode(org/jruby/RubyString.java:7599) at json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71) at LogStash::Event.to_json(file:/opt/logstash/logstash-1.3.0.dev-4fc342b-flatjar.jar!/logstash/event.rb:157) at LogStash::Outputs::File.receive(file:/opt/logstash/logstash-1.3.0.dev-4fc342b-flatjar.jar!/logstash/outputs/file.rb:72) at LogStash::Outputs::Base.handle(file:/opt/logstash/logstash-1.3.0.dev-4fc342b-flatjar.jar!/logstash/outputs/base.rb:86) at RUBY.initialize((eval):269) at org.jruby.RubyProc.call(org/jruby/RubyProc.java:271) at LogStash::Pipeline.output(file:/opt/logstash/logstash-1.3.0.dev-4fc342b-flatjar.jar!/logstash/pipeline.rb:259) at RUBY.outputworker(file:/opt/logstash/logstash-1.3.0.dev-4fc342b-flatjar.jar!/logstash/pipeline.rb:218) at RUBY.start_outputs(file:/opt/logstash/logstash-1.3.0.dev-4fc342b-flatjar.jar!/logstash/pipeline.rb:145) After this logstash exists. The problem is connected to the file output module. If I enable it it dies in a minute, without it it is stable. The relevant output config is: file { path => "/var/log/logstash-export/%{+YYYY-MM-dd}/% {host} /% {source} .log" codec => plain { charset => "UTF-8" } } Original issue was LOGSTASH-1595.

    JIRA | 3 years ago | Laszlo Toth
    org.jruby.exceptions.RaiseException: (InvalidByteSequenceError) ""\xE2"" on ASCII-8BIT
  3. 0

    exception in output thread silently locks up logstash

    GitHub | 2 years ago | lexelby
    org.jruby.exceptions.RaiseException: (InvalidByteSequenceError) ""\xB9"" on ASCII-8BIT
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Getting this quite a bit: 2013-11-06_17:30:06.92724 {:timestamp=>"2013-11-06T17:30:06.926000+0000", :message=>"Failed to flush outgoing items", :outgoing_count=>18, :exception=>#<Encoding::InvalidByteSequenceError: ""\xDE"" on ASCII-8BIT>, :backtrace=>["org/jruby/RubyString.java:7596:in `encode'", "json/ext/GeneratorMethods.java:71:in `to_json'", "file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/logstash/event.rb:156:in `to_json'", "file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/logstash/outputs/elasticsearch.rb:163:in `flush'", "org/jruby/RubyArray.java:1613:in `each'", "file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/logstash/outputs/elasticsearch.rb:158:in `flush'", "file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/stud/buffer.rb:219:in `buffer_flush'", "org/jruby/RubyHash.java:1324:in `each'", "file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/stud/buffer.rb:216:in `buffer_flush'", "file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/stud/buffer.rb:193:in `buffer_flush'", "file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/stud/buffer.rb:112:in `buffer_initialize'", "org/jruby/RubyKernel.java:1517:in `loop'", "file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/stud/buffer.rb:110:in `buffer_initialize'"], :level=>:warn} 2013-11-06_17:30:06.97237 Exception in thread "LogStash::Runner" org.jruby.exceptions.RaiseException: (InvalidByteSequenceError) ""\xDE"" on ASCII-8BIT 2013-11-06_17:30:06.97246 at org.jruby.RubyString.encode(org/jruby/RubyString.java:7596) 2013-11-06_17:30:06.97247 at json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71) 2013-11-06_17:30:06.97247 at LogStash::Event.to_json(file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/logstash/event.rb:156) 2013-11-06_17:30:06.97248 at LogStash::Codecs::JSON.encode(file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/logstash/codecs/json.rb:37) 2013-11-06_17:30:06.97248 at LogStash::Outputs::Tcp.receive(file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/logstash/outputs/tcp.rb:142) 2013-11-06_17:30:06.97249 at LogStash::Outputs::Base.handle(file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/logstash/outputs/base.rb:85) 2013-11-06_17:30:06.97250 at RUBY.initialize((eval):117) 2013-11-06_17:30:06.97251 at org.jruby.RubyProc.call(org/jruby/RubyProc.java:271) 2013-11-06_17:30:06.97253 at LogStash::Pipeline.output(file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/logstash/pipeline.rb:254) 2013-11-06_17:30:06.97254 at RUBY.outputworker(file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/logstash/pipeline.rb:213) 2013-11-06_17:30:06.97255 at RUBY.start_outputs(file:/usr/local/logstash/server/lib/logstash-1.2.2.jar!/logstash/pipeline.rb:140)

    JIRA | 4 years ago | Scott Smith
    org.jruby.exceptions.RaiseException: (InvalidByteSequenceError) ""\xDE"" on ASCII-8BIT
  6. 0

    In my setup I use logstash to handle syslog input. One of my network appliances (mail-relay) sends logmessages with "strange" or may be wrong encoding, which leads to crashing logstash. I think, the above message is not validly encoded. In my opinion, if logstash is used in mission-critical environments, it should be tollerant to such "wrongly encoded" events. I checked with the file output and the redis output. Error Message (Redis): {noformat} Exception in thread "LogStash::Runner" org.jruby.exceptions.RaiseException: (GeneratorError) source sequence is illegal/malformed utf-8 at json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71) at LogStash::Event.to_json(file:/opt/logstash/logstash-1.2.1-flatjar.jar!/logstash/event.rb:169) at LogStash::Outputs::Redis.receive(file:/opt/logstash/logstash-1.2.1-flatjar.jar!/logstash/outputs/redis.rb:150) at RUBY.initialize((eval):17) at org.jruby.RubyProc.call(org/jruby/RubyProc.java:255) at LogStash::Pipeline.output(file:/opt/logstash/logstash-1.2.1-flatjar.jar!/logstash/pipeline.rb:247) at RUBY.outputworker(file:/opt/logstash/logstash-1.2.1-flatjar.jar!/logstash/pipeline.rb:212) at RUBY.start_outputs(file:/opt/logstash/logstash-1.2.1-flatjar.jar!/logstash/pipeline.rb:140) {noformat} Error Message (File): {noformat} Exception in thread "LogStash::Runner" org.jruby.exceptions.RaiseException: (GeneratorError) source sequence is illegal/malformed utf-8 at json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71) at LogStash::Event.to_json(file:/opt/logstash/logstash-1.2.1-flatjar.jar!/logstash/event.rb:169) at LogStash::Outputs::File.receive(file:/opt/logstash/logstash-1.2.1-flatjar.jar!/logstash/outputs/file.rb:68) at RUBY.initialize((eval):28) at org.jruby.RubyProc.call(org/jruby/RubyProc.java:255) at LogStash::Pipeline.output(file:/opt/logstash/logstash-1.2.1-flatjar.jar!/logstash/pipeline.rb:247) at RUBY.outputworker(file:/opt/logstash/logstash-1.2.1-flatjar.jar!/logstash/pipeline.rb:212) at RUBY.start_outputs(file:/opt/logstash/logstash-1.2.1-flatjar.jar!/logstash/pipeline.rb:140) {noformat} I recorded the corrupted messages with tcpdump and was able to reproduce the exception. Steps to reproduce: 1. Start logstash with following config-file: {noformat} input { udp { port => 514 type => syslog } } output { file { path => "/tmp/out.log" flush_interval => 0 } } {noformat} 2. Send correct message to syslog {noformat} echo -en "syslog correct" | nc -u localhost 514 {noformat} (Check /tmp/out.log for the message 3. Send corrupted message to syslog {noformat} echo -en "syslog corrupted: \xfc" | nc -u localhost 514 {noformat} (Nothing is written to /tmp/out.log, logstash crashes with above error-message) I double-checked with an alternative logstash configuration with charset "ASCII-8BIT". In this case the logline wasn't written to /tmp/out.log but logstash at least kept working normaly. Alternative logstash config: {noformat} input { udp { port => 515 type => syslog codec => plain { charset => "ASCII-8BIT" } } } output { file { path => "/tmp/fortimail-log/out.log" flush_interval => 0 } } {noformat}

    JIRA | 4 years ago | Lucas Bremgartner
    org.jruby.exceptions.RaiseException: (GeneratorError) source sequence is illegal/malformed utf-8

    Root Cause Analysis

    1. org.jruby.exceptions.RaiseException

      (InvalidByteSequenceError) ""\xA7"" on ASCII-8BIT

      at org.jruby.RubyString.encode()
    2. JRuby Main Maven Artifact
      RubyString.encode
      1. org.jruby.RubyString.encode(org/jruby/RubyString.java:7599)
      1 frame
    3. json.ext
      GeneratorMethods$RbHash.to_json
      1. json.ext.GeneratorMethods$RbHash.to_json(json/ext/GeneratorMethods.java:71)
      1 frame