#3924 Pygments errors on chardet encoding

v1.0.0
closed
nobody
None
SCM
nobody
2015-08-20
2012-03-20
No
https://sourceforge.net/p/rumble/code/ci/8247803a25baaf2c451cfbc75161ee6ca1021fdc/tree/compile.sh?force=True
Module /var/local/allura/Allura/allura/templates/repo/file.html:49 in block "content"
<<      <div class="clip grid-19">
             <h3><span class="ico-l"><b data-icon="{{g.icons['table'].char}}" class="ico {{g.icons['table'].css}}"></b> {{h.really_unicode(blob.name)}}</span></h3>
             {{g.highlight(blob.text, filename=blob.name)}}
           </div>
         {% endif %}
>>  {{g.highlight(blob.text, filename=blob.name)}}
Module allura.lib.app_globals:261 in highlight
<<          else:
                   lexer = pygments.lexers.get_lexer_by_name(lexer, encoding='chardet')
               return h.html.literal(pygments.highlight(text, lexer, formatter))

           def forge_markdown(self, **kwargs):
>>  return h.html.literal(pygments.highlight(text, lexer, formatter))
Module pygments:86 in highlight
<<      it is returned as a string.
           """
           return format(lex(code, lexer), formatter, outfile)
>>  return format(lex(code, lexer), formatter, outfile)
Module pygments:45 in lex
<<      """
           try:
               return lexer.get_tokens(code)
           except TypeError, err:
               if isinstance(err.args[0], str) and \
>>  return lexer.get_tokens(code)
Module pygments.lexer:146 in get_tokens
<<                                        'from http://chardet.feedparser.org/')
                       enc = chardet.detect(text)
                       text = text.decode(enc['encoding'])
                   else:
                       text = text.decode(self.encoding)
>>  text = text.decode(enc['encoding'])
TypeError: decode() argument 1 must be string, not None

Discussion

  • Dave Brondsema

    Dave Brondsema - 2012-03-23
    • Description has changed:

    Diff:

    --- old 
    +++ new 
    @@ -1,4 +1,4 @@
    -https://sourceforge.net/p/rumble/code/ci/8247803a25baaf2c451cfbc75161ee6ca1021fdc/tree/compile.sh?force=True
    +    https://sourceforge.net/p/rumble/code/ci/8247803a25baaf2c451cfbc75161ee6ca1021fdc/tree/compile.sh?force=True
    
     ~~~~
     Module /var/local/allura/Allura/allura/templates/repo/file.html:49 in block "content"
    
    • size: --> 2
     
  • Dave Brondsema

    Dave Brondsema - 2012-03-23

    The .sh script has an "esc" character at the beginning of the echo strings

     
  • Dave Brondsema

    Dave Brondsema - 2012-04-09
    • milestone: forge-apr-20 --> forge-backlog
     
  • Dave Brondsema

    Dave Brondsema - 2012-08-15

    This works now

     
  • Dave Brondsema

    Dave Brondsema - 2012-08-15
    • status: open --> closed
    • size: 2 --> 0
    • milestone: forge-backlog --> forge-aug-24
     

Log in to post a comment.