org.apache.http.client.CircularRedirectException: Circular redirect to 'http://.../robots.txt/'

opensearchserve | a90a | 2 years ago
  1. 0

    Hanged Crawl

    opensearchserve | 2 years ago | a90a
    org.apache.http.client.CircularRedirectException: Circular redirect to 'http://.../robots.txt/'
  2. 0

    Any way to overcome Circular Redirect using HttpClient 4.1.1 (Java in General forum at Coderanch)

    coderanch.com | 9 months ago
    org.apache.http.client.ClientProtocolException
  3. 0

    Error Report:

    GitHub | 2 years ago | rastating
    org.apache.http.client.ClientProtocolException
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    CircularRedirectException with google authentication

    Stack Overflow | 5 years ago | Alex1987
    org.apache.http.client.CircularRedirectException: Circular redirect to 'http://www.google.co.il/'
  6. 0

    Solution for ClientProtocolException Caused by CircularRedirectException - DZone Java

    dzone.com | 3 months ago
    org.apache.http.client.ClientProtocolException

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.http.client.CircularRedirectException

      Circular redirect to 'http://.../robots.txt/'

      at org.apache.http.impl.client.DefaultRedirectStrategy.getLocationURI()
    2. Apache HttpClient
      DefaultRedirectStrategy.getRedirect
      1. org.apache.http.impl.client.DefaultRedirectStrategy.getLocationURI(DefaultRedirectStrategy.java:174)
      2. org.apache.http.impl.client.DefaultRedirectStrategy.getRedirect(DefaultRedirectStrategy.java:217)
      2 frames
    3. com.jaeksoft.searchlib
      ThreadAbstract.run
      1. com.jaeksoft.searchlib.crawler.web.spider.HttpAbstract.getRedirectLocation(HttpAbstract.java:222)
      2. com.jaeksoft.searchlib.crawler.web.spider.HttpDownloader.getDownloadItem(HttpDownloader.java:94)
      3. com.jaeksoft.searchlib.crawler.web.spider.HttpDownloader.request(HttpDownloader.java:123)
      4. com.jaeksoft.searchlib.crawler.web.spider.HttpDownloader.request(HttpDownloader.java:159)
      5. com.jaeksoft.searchlib.crawler.web.spider.HttpDownloader.get(HttpDownloader.java:175)
      6. com.jaeksoft.searchlib.crawler.web.spider.Crawl.download(Crawl.java:283)
      7. com.jaeksoft.searchlib.crawler.web.robotstxt.RobotsTxtCache.getRobotsTxt(RobotsTxtCache.java:107)
      8. com.jaeksoft.searchlib.crawler.web.spider.Crawl.checkRobotTxtAllow(Crawl.java:236)
      9. com.jaeksoft.searchlib.crawler.web.process.WebCrawlThread.crawl(WebCrawlThread.java:181)
      10. com.jaeksoft.searchlib.crawler.web.process.WebCrawlThread.runner(WebCrawlThread.java:126)
      11. com.jaeksoft.searchlib.process.ThreadAbstract.run(ThreadAbstract.java:291)
      11 frames
    4. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
      3. java.lang.Thread.run(Unknown Source)
      3 frames