#1505 Fix unicode error in posting messages to ticket threads from email

v1.0.0
closed
sf-2 (994)
General
nobody
2015-08-20
2011-02-15
No

Here is the error message:

Delivered-To: rcopeland@geek.net
Received: by 10.220.93.16 with SMTP id t16cs297138vcm;
        Tue, 15 Feb 2011 10:41:56 -0800 (PST)
X-pstn-nxpr: disp=neutral, envrcpt=rcopeland@geek.net
X-pstn-nxp: bodyHash=a48dc8b43804760be286534833301b4cbf44d30c, headerHash=a7725ed60db994593b9306bf88d2de194f9e2126, keyName=4, rcptHash=f9d5824b91a4db5dfc9a1d51a7a611798819d73b, sourceip=74.125.149.201, version=1
Received: by 10.227.132.69 with SMTP id a5mr3979470wbt.123.1297795315748;
        Tue, 15 Feb 2011 10:41:55 -0800 (PST)
Return-Path: <allura+bncCAAQ5pHr6gQaBNkOCN4@geek.net>
Received: from psmtp.com ([74.125.149.115])
        by mx.google.com with SMTP id k6si4954667wbc.64.2011.02.15.10.41.46
        (version=TLSv1/SSLv3 cipher=OTHER);
        Tue, 15 Feb 2011 10:41:55 -0800 (PST)
Received-SPF: pass (google.com: domain of allura+bncCAAQ5pHr6gQaBNkOCN4@geek.net designates 74.125.149.201 as permitted sender) client-ip=74.125.149.201;
Authentication-Results: mx.google.com; spf=pass (google.com: domain of allura+bncCAAQ5pHr6gQaBNkOCN4@geek.net designates 74.125.149.201 as permitted sender) smtp.mail=allura+bncCAAQ5pHr6gQaBNkOCN4@geek.net
Received: from source ([74.125.149.201]) (using TLSv1) by na3sys009amx231.postini.com ([74.125.148.10]) with SMTP;
    Tue, 15 Feb 2011 12:41:52 CST
Received: from source ([74.125.82.71]) (using TLSv1) by na3sys009aob109.postini.com ([74.125.148.12]) with SMTP
    ID DSNKTVrI5ilFsGRuq/cOe84toydhea5vdyz1@postini.com; Tue, 15 Feb 2011 10:41:51 PST
Received: by mail-ww0-f71.google.com with SMTP id 13sf156834wwb.6
        for <multiple recipients>; Tue, 15 Feb 2011 10:41:42 -0800 (PST)
Received: by 10.213.10.84 with SMTP id o20mr879230ebo.8.1297795302476;
        Tue, 15 Feb 2011 10:41:42 -0800 (PST)
X-BeenThere: allura@geek.net
Received: by 10.213.26.196 with SMTP id f4ls153854ebc.1.p; Tue, 15 Feb 2011
 10:41:41 -0800 (PST)
X-pstn-nxpr: disp=neutral, envrcpt=allura@geek.net
X-pstn-nxp: bodyHash=2be188b79c04bebdd65eb16ad49641760849e657, headerHash=c08e1456330d3f39015cbcf3a7980223d404542c, keyName=4, rcptHash=f2b76366b518d4b11487acdbbe8cc205c99c65e3, sourceip=216.34.181.60, version=1
Received: by 10.213.17.147 with SMTP id s19mr5865299eba.89.1297795301826;
        Tue, 15 Feb 2011 10:41:41 -0800 (PST)
X-pstn-nxpr: disp=neutral, envrcpt=allura@geek.net
X-pstn-nxp: bodyHash=2be188b79c04bebdd65eb16ad49641760849e657, headerHash=c08e1456330d3f39015cbcf3a7980223d404542c, keyName=4, rcptHash=f2b76366b518d4b11487acdbbe8cc205c99c65e3, sourceip=216.34.181.60, version=1
Received: by 10.213.17.147 with SMTP id s19mr5865296eba.89.1297795301771;
        Tue, 15 Feb 2011 10:41:41 -0800 (PST)
Received: from psmtp.com ([74.125.149.64])
        by mx.google.com with SMTP id a56si3466316eei.4.2011.02.15.10.41.39
        (version=TLSv1/SSLv3 cipher=OTHER);
        Tue, 15 Feb 2011 10:41:41 -0800 (PST)
Received-SPF: pass (google.com: domain of nobody@sourceforge.net designates 216.34.181.60 as permitted sender) client-ip=216.34.181.60;
Received: from source ([216.34.181.60]) (using TLSv1) by na3sys009amx224.postini.com ([74.125.148.10]) with SMTP;
    Tue, 15 Feb 2011 12:41:39 CST
Received: from [127.0.0.1] (helo=sfu-scmprocess-3.b.ch3.sourceforge.com)
    by sfu-scmprocess-3.v42.ch3.sourceforge.com with esmtp (Exim 4.74)
    (envelope-from <nobody@sourceforge.net>)
    id 1PpPqD-0007AY-3G
    for allura@geek.net; Tue, 15 Feb 2011 18:41:37 +0000
MIME-Version: 1.0
Subject: WebApp Error: <class 'bson.errors.InvalidStringData'>: strings in
    documents must be valid UTF-8
From: nobody@sourceforge.net
To: allura@geek.net
Message-Id: <E1PpPqD-0007AY-3G@sfu-scmprocess-3.v42.ch3.sourceforge.com>
Date: Tue, 15 Feb 2011 18:41:37 +0000
X-pstn-neptune: 0/0/0.00/0
X-pstn-levels: (S:99.90000/99.90000 CV:99.9000 FC:95.5390 LC:95.5390 R:95.9108 P:95.9108 M:97.0282 C:98.6951 )
X-pstn-settings: 2 (0.5000:0.5000) s cv gt3 gt2 gt1
X-pstn-addresses: from <nobody@sourceforge.net> forward (org good) [111/6]
X-Original-Sender: nobody@sourceforge.net
X-Original-Authentication-Results: mx.google.com; spf=pass (google.com: domain
 of nobody@sourceforge.net designates 216.34.181.60 as permitted sender) smtp.mail=nobody@sourceforge.net
Precedence: list
Mailing-list: list allura@geek.net; contact allura+owners@geek.net
List-ID: <allura.geek.net>
List-Post: <http://groups.google.com/a/geek.net/group/allura/post?hl=en_US>, <mailto:allura@geek.net>
List-Help: <http://www.google.com/support/a/geek.net/bin/static.py?hl=en_US&page=groups.cs>,
 <mailto:allura+help@geek.net>
List-Archive: <http://groups.google.com/a/geek.net/group/allura/?hl=en_US>
List-Unsubscribe: <http://groups.google.com/a/geek.net/group/allura/subscribe?hl=en_US>,
 <mailto:allura+unsubscribe@geek.net>
Content-Type: multipart/alternative;
    boundary="===============1036215869943813081=="
X-pstn-neptune: 0/0/0.00/0
X-pstn-levels: (S:99.90000/99.90000 CV:99.9000 FC:95.5390 LC:95.5390 R:95.9108 P:95.9108 M:97.0282 C:98.6951 )

--===============1036215869943813081==
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
Content-Type: text/plain; charset="UTF-8"

File '/var/local/allura/Allura/allura/command/reactor.py', line 201 in callback
  method.im_func(pylons.c.app, msg.delivery_info['routing_key'], data)
File '/var/local/allura/ForgeTracker/forgetracker/tracker_main.py', line 105 in message_auditor
  super(ForgeTrackerApp, self).message_auditor(routing_key, data, t)
File '/var/local/allura/Allura/allura/app.py', line 259 in message_auditor
  **kw)
File '/var/local/allura/Allura/allura/model/discuss.py', line 187 in post
  post.approve()
File '/var/local/allura/Allura/allura/model/discuss.py', line 409 in approve
  self.commit()
File '/var/local/allura/Allura/allura/model/artifact.py', line 557 in commit
  session(ss).insert_now(ss, state(ss))
File '/var/local/env-allura/lib/python2.6/site-packages/Ming-0.2.1dev_20110214-py2.6.egg/ming/orm/ormsession.py', line 24 in inner
  result = func(session, *args, **kwargs)
File '/var/local/env-allura/lib/python2.6/site-packages/Ming-0.2.1dev_20110214-py2.6.egg/ming/orm/ormsession.py', line 79 in insert_now
  mapper(obj).insert(self, obj, st)
File '/var/local/env-allura/lib/python2.6/site-packages/Ming-0.2.1dev_20110214-py2.6.egg/ming/orm/mapped_class.py', line 47 in insert
  session.impl.insert(doc)
File '/var/local/env-allura/lib/python2.6/site-packages/Ming-0.2.1dev_20110214-py2.6.egg/ming/session.py', line 18 in wrapper
  return func(self, doc, *args, **kwargs)
File '/var/local/env-allura/lib/python2.6/site-packages/Ming-0.2.1dev_20110214-py2.6.egg/ming/session.py', line 128 in insert
  bson = self._impl(doc).insert(data, safe=True)
File '/var/local/env-allura/lib/python2.6/site-packages/pymongo-1.9-py2.6-linux-x86_64.egg/pymongo/collection.py', line 270 in insert
  check_keys, safe, kwargs), safe)
File '/var/local/env-allura/lib/python2.6/site-packages/pymongo-1.9-py2.6-linux-x86_64.egg/pymongo/message.py', line 67 in insert
  bson_data = "".join([bson.BSON.encode(doc, check_keys) for doc in docs])
File '/var/local/env-allura/lib/python2.6/site-packages/pymongo-1.9-py2.6-linux-x86_64.egg/bson/__init__.py', line 462 in encode
  return cls(_dict_to_bson(document, check_keys))
InvalidStringData: strings in documents must be valid UTF-8
app: u'tickets'
exchange: 'audit'
key: u'Tickets.msg.1502'
message:
'''{\'content_type\': \'text/plain\',
 \'filename\': None,
 \'headers\': {\'Content-Transfer-Encoding\': \'quoted-printable\',
             \'Content-Type\': \'text/plain; charset=ISO-8859-1\',
             \'Date\': \'Tue, 15 Feb 2011 13:41:27 -0500\',
             \'From\': \'Richard Copeland <rick446@users.sf.net>\',
             \'In-Reply-To\': \'<79E5CC39-3421-4351-947D-2AF96FE74F08@geek.net>\',
             \'MIME-Version\': \'1.0\',
             \'Message-ID\': \'<AANLkTikHqFjBtNsXarLRwh_VS999k-yWPdy2rNPXF9q_@mail.gmail.com>\',
             \'Received\': \'from na3sys009aog107.obsmtp.com ([74.125.149.197])\
\\tby sog-mx-1.v43.ch3.sourceforge.com with smtps (TLSv1:AES256-SHA:256)\
\\t(Exim 4.74)\
\\tid 1PpPqA-0004QQ-Il\
\\tfor 1502@tickets.allura.p.re.sf.net; Tue, 15 Feb 2011 18:41:35 +0000\',
             \'References\': \'<a7fd5b5e8879159e361ba5c8127a6fe7c6a78e67.tickets@allura.p.sourceforge.net>\
\\t<79E5CC39-3421-4351-947D-2AF96FE74F08@geek.net>\',
             \'Sender\': \'rcopeland@geek.net\',
             \'Subject\': \'Re: [allura:tickets] #1502 Production Push (R:allura_20110215,\
 D:20110215) - allura\',
             \'To\': \'"[allura:tickets]" <1502@tickets.allura.p.re.sf.net>\',
             \'X-Google-Sender-Auth\': \'_M5SI3wT2V_aQwS9zfx-cCId4mA\',
             \'X-Headers-End\': \'1PpPqA-0004QQ-Il\',
             \'X-Spam-Report\': \'Spam Filtering performed by mx.sourceforge.net.\
 See http://spamassassin.org/tag/ for more details.\
 -0.0 SPF_PASS               SPF: sender matches SPF record\
  1.0 HTML_MESSAGE           BODY: HTML included in message\
  1.3 AWL                    AWL: From: address is in the auto white-list\',
             \'X-Spam-Score\': \'2.3 (++)\'},
 \'in_reply_to\': [\'79E5CC39-3421-4351-947D-2AF96FE74F08@geek.net\'],
 \'message_id\': \'A\',
 \'mount_point\': \'tickets\',
 \'payload\': \'Another reply\
\
On Tue, Feb 15, 2011 at 1:37 PM, Rick Copeland <rcopeland@geek.net> wrote:\
\
> Reply to the ticket comment\
>\
> On Feb 15, 2011, at 1:35 PM, Rick Cop\\xe9land wrote:\
>\
> Comment on the push ticket\
> ------------------------------\
>\
> Sent from sourceforge.net because you indicated interest in\
> https://sourceforge.net/p/allura/tickets/1502/\
>\
> To unsubscribe from further messages, please visit\
> https://sourceforge.net/auth/prefs/\
>\
>\
>\
\',
 \'project_id\': \'4c3487c61be1ce11da00003e\',
 \'references\': [\'a7fd5b5e8879159e361ba5c8127a6fe7c6a78e67.tickets@allura.p.sourceforge.net\',
                \'79E5CC39-3421-4351-947D-2AF96FE74F08@geek.net\'],
 \'user_id\': \'4bf2eb681be1ce0f9a00000e\'}'''
project: u'allura'
user: u'rick446'

Discussion

  • Rick Copeland - 2011-02-16
    • status: open --> code-review
    • assigned_to: Rick Copéland
    • size: --> 1
     
  • Rick Copeland - 2011-02-16
    • status: code-review --> validation
     
  • Rick Copeland - 2011-02-18
    • status: validation --> closed
     
  • Rick Copeland - 2011-02-18

    It works!

     
  • Rick Copeland - 2011-02-24
    • milestone: backlog --> feb-24
     

Log in to post a comment.