Ticket search results

Trac ticket error: astimezone() cannot be applied to a naive datetime

Dave Brondsema — Thu, 20 Aug 2015 22:07:00 -0000

Errored on a CSV file like this from a Trac 1.0.1 instance: __group__,ticket,summary,component,status,type,priority,owner,modified,_time,_reporter prep,48,Create Stuff,Application,new,build,major,nobody,2014-02-09T05:16:55-05:00,16:14:18-05:00,John Doe Trace: ~~~~ Traceback (most recent call last): File "/var/local/allura/ForgeImporters/forgeimporters/base.py", line 131, in import_tool mount_point=mount_point, mount_label=mount_label, **kw) File "/var/local/allura/ForgeImporters/forgeimporters/trac/tickets.py", line 119, in import_tool json.dumps(export(trac_url), cls=DateJSONEncoder), File "/var/local/allura/Allura/allura/scripts/trac_export.py", line 304, in export verbose=verbose, do_attachments=do_attachments) File "/var/local/allura/Allura/allura/scripts/trac_export.py", line 99, in __init__ self.ticket_queue = self.next_ticket_ids() File "/var/local/allura/Allura/allura/scripts/trac_export.py", line 263, in next_ticket_ids r[1]), 'date_updated': self.trac2z_date(r[2])} File "/var/local/allura/Allura/allura/scripts/trac_export.py", line 127, in trac2z_date d = d.astimezone(pytz.UTC) ValueError: astimezone() cannot be applied to a naive datetime ~~~~

Trac-Tickets Importer Rejects URL Containing IP Address [ss6716]

Chris Tsai — Thu, 20 Aug 2015 22:07:00 -0000

[forge:site-support:#6716] >I receive the following message.. >'That is not a valid URL' >...when attempting to import tickets from a Trac project URL whose domain is an IP address.

Handle importing from older Trac formats

Dave Brondsema — Mon, 02 Feb 2015 02:43:49 -0000

E.g. trac 0.10.3 on http://www.spamboard.net/wiki/TitleIndex requires: - CONTENT_DIV_ATTRS = {'class': 'wikipage searchable'} + CONTENT_DIV_ATTRS = {'class': 'wikipage'} (And with that, may require stripping the `

` that is within the wikipage. Also `def page_list` needs to use the href instead of the text of each link. It'll need to strip off the base URL portion.

Trac wiki import errors on child pages with "," in name

Dave Brondsema — Thu, 20 Aug 2015 22:07:10 -0000

E.g importing from http://sourceforge.net/apps/trac/shareaza/wiki/ See http://sourceforge.net/apps/trac/shareaza/wiki/TitleIndex for a list of its pages. Error is: ~~~~ Traceback (most recent call last): File "/home/dbrondsema/dbrondsema-1019/forge/Allura/allura/model/monq_model.py", line 258, in __call__ self.result = func(*self.args, **self.kwargs) File "/home/dbrondsema/dbrondsema-1019/forge/ForgeImporters/forgeimporters/base.py", line 122, in import_tool mount_point=mount_point, mount_label=mount_label, **kw) File "/var/local/env-allura/lib/python2.7/site-packages/tracwikiimporter/importer.py", line 118, in import_tool load_data(f.name, WikiFromTrac.parser(), options) File "/home/dbrondsema/dbrondsema-1019/forge/ForgeWiki/forgewiki/scripts/wiki_from_trac/loaders.py", line 54, in load_data import_wiki(cli, options.project, options.wiki, options, doc_txt) File "/home/dbrondsema/dbrondsema-1019/forge/ForgeWiki/forgewiki/scripts/wiki_from_trac/loaders.py", line 70, in import_wiki r = cli.call(url + '/' + title, **page) File "/home/dbrondsema/dbrondsema-1019/forge/Allura/allura/lib/import_api.py", line 63, in call raise e HTTPError: HTTP Error 403: Forbidden ~~~~

Trac ticket import failure

Tim Van Steenburgh — Thu, 20 Aug 2015 22:07:10 -0000

Importing https://sourceforge.net/apps/trac/sivic: Importing the Tickets data from the sivic Trac project to the sivic SourceForge project failed with the error: 'ascii' codec can't decode byte 0xe2 in position 57: ordinal not in range(128) ~~~~ Traceback (most recent call last): File "/home/tvansteenburgh/tvansteenburgh-1024/forge/ForgeImporters/forgeimporters/base.py", line 122, in import_tool mount_point=mount_point, mount_label=mount_label, **kw) File "/home/tvansteenburgh/tvansteenburgh-1024/forge/ForgeImporters/forgeimporters/trac/tickets.py", line 124, in import_tool json.dumps(export(trac_url), cls=DateJSONEncoder), File "/home/tvansteenburgh/tvansteenburgh-1024/forge/Allura/allura/scripts/trac_export.py", line 290, in export doc = [t for t in islice(ex, limit)] File "/home/tvansteenburgh/tvansteenburgh-1024/forge/Allura/allura/scripts/trac_export.py", line 271, in next return self.get_ticket(id, extra) File "/home/tvansteenburgh/tvansteenburgh-1024/forge/Allura/allura/scripts/trac_export.py", line 219, in get_ticket t = self.parse_ticket(id) File "/home/tvansteenburgh/tvansteenburgh-1024/forge/Allura/allura/scripts/trac_export.py", line 166, in parse_ticket c['comment'] = html2text.html2text(changes + body) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 57: ordinal not in range(128) ~~~~

Trac import erroneously adds blockquote >s

Dave Brondsema — Thu, 14 Nov 2013 22:29:06 -0000

See https://sourceforge.net/apps/trac/open-ms/ticket/517#comment:3 and https://sourceforge.net/p/test-brondsem/tickets-open-ms/517/#a8bd

imported trac content with r123 refs still link to old host

Dave Brondsema — Thu, 20 Aug 2015 22:07:10 -0000

E.g. : ~~~~ Also fixed for ExecutePipeline? in [r10739](http://sourceforge.net/apps/trac/open-ms/changeset/10739). ~~~~ I think we want to rewrite this to simply `[r10739]` or possibly `[r10739](r10739)` (so that brackets aren't displayed). IIRC, there are more specific similar syntaxes too that may need to be considered.

Trac import doesn't preserve line breaks

Dave Brondsema — Thu, 20 Aug 2015 22:07:10 -0000

Compare https://sourceforge.net/apps/trac/open-ms/ticket/390 and https://sourceforge.net/p/test-brondsem/tickets-open-ms/390/ The line breaks between the "list items" are lost.

Trac importer gets internal timeouts

Dave Brondsema — Thu, 20 Aug 2015 22:07:20 -0000

We need to avoid internal timeouts like this. Perhaps bumping a timeout value in the connection would help, but it seems a better fix would be for internal work like this to just run the ticket importer API controller (or model) directly instead of going through HTTP. ~~~~ Traceback (most recent call last): File "/var/local/allura/Allura/allura/model/monq_model.py", line 258, in __call__ self.result = func(*self.args, **self.kwargs) File "/var/local/forge-classic/sfx/importers/trac/tracker.py", line 18, in import_tool importer.import_tool(c.project, c.user, **kw) File "/var/local/allura/ForgeImporters/forgeimporters/trac/tickets.py", line 146, in import_tool export_string, validate=False) File "/var/local/allura/ForgeTracker/forgetracker/scripts/import_tracker.py", line 62, in import_tracker res = cli.call(url, doc=json.dumps(doc_import), options=json.dumps(import_options)) File "/var/local/allura/Allura/allura/lib/import_api.py", line 56, in call result = urllib2.urlopen(url, urllib.urlencode(params)) File "/var/local/env-allura/lib/python2.7/site-packages/TimerMiddleware-0.4.4-py2.7.egg/timermiddleware/__init__.py", line 121, in __call__ return self.run_and_log(self._inner, None, *args, **kwargs) File "/var/local/env-allura/lib/python2.7/site-packages/TimerMiddleware-0.4.4-py2.7.egg/timermiddleware/__init__.py", line 126, in run_and_log return func(*args, **kwargs) File "/usr/lib64/python2.7/urllib2.py", line 126, in urlopen return _opener.open(url, data, timeout) File "/usr/lib64/python2.7/urllib2.py", line 400, in open response = self._open(req, data) File "/usr/lib64/python2.7/urllib2.py", line 418, in _open '_open', req) File "/usr/lib64/python2.7/urllib2.py", line 378, in _call_chain result = func(*args) File "/usr/lib64/python2.7/urllib2.py", line 1207, in http_open return self.do_open(httplib.HTTPConnection, req) File "/usr/lib64/python2.7/urllib2.py", line 1180, in do_open r = h.getresponse(buffering=True) File "/usr/lib64/python2.7/httplib.py", line 1030, in getresponse response.begin() File "/usr/lib64/python2.7/httplib.py", line 407, in begin version, status, reason = self._read_status() File "/usr/lib64/python2.7/httplib.py", line 365, in _read_status line = self.fp.readline() File "/var/local/env-allura/lib/python2.7/site-packages/TimerMiddleware-0.4.4-py2.7.egg/timermiddleware/__init__.py", line 117, in wrapper return self.run_and_log(func, inst, *args, **kwargs) File "/var/local/env-allura/lib/python2.7/site-packages/TimerMiddleware-0.4.4-py2.7.egg/timermiddleware/__init__.py", line 126, in run_and_log return func(*args, **kwargs) File "/usr/lib64/python2.7/socket.py", line 447, in readline data = self._sock.recv(self._rbufsize) timeout: timed out ~~~~

Handle trac cc field

Dave Brondsema — Thu, 20 Aug 2015 22:07:10 -0000

We currently import the CC field as a custom field. We shouldn't do that at all, it's useless like that. We should also convert it to a subscription if possible, but we don't know the full email address and if we did it may not match an Allura user. A halfway solution might be to consider each CC as a vote. https://sourceforge.net/apps/trac/mcclidar/ticket/33 is one example. Don't have an example of multiple CCs handy

Convert trac syntax better

Dave Brondsema — Thu, 20 Aug 2015 22:07:10 -0000

The Trac ticket export/import process doesn't handle the following syntax correctly: * headings e.g. `== NOTE ==` * preformatted blocks, using `{{{ ... }}}` -- this does seem to come through OK in comments, presumably because we're converting those differently * lists that have no blank line preceding them, e.g. `blah blah\n* foo\n* bar` * https://sourceforge.net/apps/trac/gfarm/ticket/594#comment:5 gets a `\n` incorrectly introduced between "merged into" and "2.6 branch" * `----` for a horizontal line becomes a markdown heading if there is no blank line before it * special characters that Markdown might interpret need to be escaped. Simple example: `foo bar` Perhaps helpers.plain2markdown() will help. * Make sure external links like `[http://google.com test]` work (I'm not sure) These are the issues I noticed - look through the Trac syntax reference to see if there are more.

Trac import: small tweaks to reply formatting

Dave Brondsema — Thu, 20 Aug 2015 22:07:20 -0000

Reply text gets created like this: ~~~~ Replying to [m-kasahr](656#fe1b): ~~~~ The newline is unnecessary and should be removed so it's all on one line. Ticket URLs require a trailing slash, so the url should be `656/#fe1b` which will allow anchors to work properly without reloading the whole page.

Trac import: close milestone if all tickets closed

Dave Brondsema — Thu, 20 Aug 2015 22:07:20 -0000

We've done this for google code ticket import already.

Support trac commit/ticket syntax in commit messages

Dave Brondsema — Thu, 20 Aug 2015 22:07:10 -0000

Tickets & wiki imported from trac [#4213] and [#6139] as well as SVN commits that have trac syntax for referencing tickets and svn revisions should still work in Allura. Examples: * `#123` for tickets (no brackets) * `r456` for svn revision * https://sourceforge.net/apps/trac/gfarm/changeset/8016 * A less frequent format: * `ticket:100` * `comment:13:ticket:408` * `source:gfarm_v2/trunk/server/gfmd/inode.c@6697#L3233` We can't change content during import since it's in SVN commit messages too. A regex should be easy to identify these. TBD: allow this simpler syntax all the time, or just for trac-imported content via some flag?