Ticket search results

Github import error on deleted users

Dave Brondsema — Mon, 24 Sep 2018 19:36:24 -0000

``` Traceback (most recent call last): File "/var/local/allura/ForgeImporters/forgeimporters/base.py", line 131, in import_tool mount_point=mount_point, mount_label=mount_label, **kw) File "/var/local/allura/ForgeImporters/forgeimporters/github/tracker.py", line 137, in import_tool self.process_events(extractor, ticket, issue) File "/var/local/allura/ForgeImporters/forgeimporters/github/tracker.py", line 205, in process_events self.get_user_link(event['actor']['login'])) TypeError: 'NoneType' object has no attribute '__getitem__' ``` This occurs when a deleted-on-github user is involved in a thread. https://github.com/ampache/ampache/issues/1669 in this case

Update tool imports to support exported attachments.

Heith Seewald — Fri, 11 Mar 2016 20:48:38 -0000

With ticket [#8051], we added support for downloading file attachments when exporting tool data. Our tool import functionality should support that format. One thing to consider is how we handle importing a zip file that contains data for multiple tools.

Remove Google Code importers

Dave Brondsema — Wed, 27 Jan 2016 18:43:59 -0000

Google Code is in archive mode, so importers as they are now don't work - and some tests fail too. Supporting the archive format would be nice, but at least for now we should just remove the importers.

Bug: removed upsert() method needed by TracWikiImporter

Dave Brondsema — Mon, 16 Nov 2015 16:09:46 -0000

We removed upsert() in [f33baf] but it is actually used. We should bring it back with a `user` param, or update TracWikiImporter to not need it. Traceback (most recent call last): File "/var/local/allura/ForgeImporters/forgeimporters/base.py", line 131, in import_tool mount_point=mount_point, mount_label=mount_label, **kw) File "/var/local/env-allura/lib/python2.7/site-packages/TracWikiImporter-0.4.2-py2.7.egg/tracwikiimporter/importer.py", line 94, in import_tool options.token = self.get_token(user) File "/var/local/env-allura/lib/python2.7/site-packages/TracWikiImporter-0.4.2-py2.7.egg/tracwikiimporter/importer.py", line 116, in get_token consumer_token = OAuthConsumerToken.upsert(self.classname) AttributeError: type object 'OAuthConsumerToken' has no attribute 'upsert'

Wiki not imported properly from Google Code

John Barrett — Mon, 21 Sep 2015 14:06:09 -0000

https://sourceforge.net/p/forge/site-support/11216/ ---- Details from Support Ticket: ---- Hi, I have imported following project from google code. https://sourceforge.net/p/openwonderland/ The code imported successfully but the wiki page didn't look same as on the google code. https://sourceforge.net/p/openwonderland/wiki/OpenWonderland https://code.google.com/p/openwonderland/wiki/OpenWonderland Is it not imported properly?

Phone validation interfering with project import

Dave Brondsema — Fri, 04 Sep 2015 18:28:15 -0000

~~~~ 15:18:01,597 ERROR [forgeimporters.base] error registering project: foobar Traceback (most recent call last): File "/var/local/allura/ForgeImporters/forgeimporters/base.py", line 292, in process project_name=kw['project_name']) File "/var/local/allura/Allura/allura/model/neighborhood.py", line 129, in register_project self, shortname, project_name, user or getattr(c, 'user', None), user_project, private_project, apps) File "/var/local/forge-classic/ForgeSF/forgesf/sf_providers.py", line 426, in register_project self.validate_project(neighborhood, shortname, project_name, user, user_project, private_project) File "/var/local/allura/Allura/allura/lib/plugin.py", line 816, in validate_project raise forge_exc.ProjectPhoneVerificationError() ProjectPhoneVerificationError ~~~~

Wiki importer for allura's own export format

Dave Brondsema — Sun, 06 Mar 2016 10:16:20 -0000

Blog importer for allura's own export format

Dave Brondsema — Tue, 21 Jul 2015 18:54:33 -0000

Forum importer for allura's own export format

Dave Brondsema — Mon, 17 May 2021 15:07:01 -0000

Error on google code import with paginated comments

Dave Brondsema — Thu, 20 Aug 2015 22:06:09 -0000

Importing https://code.google.com/p/usbloader-gui/issues/detail?id=1769 fails with the following error. I suspect it is due to the comment pagination which we probably don't handle at all. ~~~~ Traceback (most recent call last): File "/var/local/allura/ForgeImporters/forgeimporters/base.py", line 131, in import_tool mount_point=mount_point, mount_label=mount_label, **kw) File "/var/local/allura/ForgeImporters/forgeimporters/google/tracker.py", line 123, in import_tool self.process_fields(ticket, issue) File "/var/local/allura/ForgeImporters/forgeimporters/google/tracker.py", line 164, in process_fields ticket.mod_date = dateutil.parser.parse(issue.get_issue_mod_date()) File "/var/local/allura/ForgeImporters/forgeimporters/google/__init__.py", line 309, in get_issue_mod_date last_update = Comment(comments[-1], self.project_name) File "/var/local/allura/ForgeImporters/forgeimporters/google/__init__.py", line 391, in __init__ tag.find('span', 'author').find(True, 'userlink')) AttributeError: 'NoneType' object has no attribute 'find' ~~~~

Check for wiki presence before importing it

Dave Brondsema — Thu, 20 Aug 2015 22:06:52 -0000

The wiki import (both individual and full-project, I suspect) will throw an error if the wiki is not available. We should catch and handle that situation (e.g. silently skip on full-project import, and error to user on individual import form maybe) so that we don't have unnecessary error emails. ~~~~ Importing the Wiki data from the Groove GitHub project to the groovejam SourceForge project failed with the error: 'git clone --bare -v https://github.com/radhouenerouached/Groove.wiki /tmp/tmpU1fq4V' returned exit status 128: fatal: remote error: access denied or repository not exported: /b/nw/bf/80/1f/107924511/28155028.wiki.git Traceback (most recent call last): File "/var/local/allura/ForgeImporters/forgeimporters/base.py", line 131, in import_tool mount_point=mount_point, mount_label=mount_label, **kw) File "/var/local/allura/ForgeImporters/forgeimporters/github/wiki.py", line 162, in import_tool self.import_pages(wiki_url, history=with_history) File "/var/local/allura/ForgeImporters/forgeimporters/github/wiki.py", line 259, in import_pages wiki = git.Repo.clone_from(wiki_url, to_path=wiki_path, bare=True) File "/var/local/env-allura/lib/python2.7/site-packages/GitPython-0.3.2.RC1_20140304-py2.7.egg/git/repo/base.py", line 742, in clone_from return cls._clone(Git(os.getcwd()), url, to_path, GitCmdObjectDB, progress, **kwargs) File "/var/local/env-allura/lib/python2.7/site-packages/GitPython-0.3.2.RC1_20140304-py2.7.egg/git/repo/base.py", line 694, in _clone finalize_process(proc) File "/var/local/env-allura/lib/python2.7/site-packages/GitPython-0.3.2.RC1_20140304-py2.7.egg/git/util.py", line 129, in finalize_process proc.wait() File "/var/local/env-allura/lib/python2.7/site-packages/GitPython-0.3.2.RC1_20140304-py2.7.egg/git/cmd.py", line 101, in wait raise GitCommandError(self.args, status, self.proc.stderr.read()) GitCommandError: 'git clone --bare -v https://github.com/radhouenerouached/Groove.wiki /tmp/tmpU1fq4V' returned exit status 128: fatal: remote error: access denied or repository not exported: /b/nw/bf/80/1f/107924511/28155028.wiki.git ~~~~ https://github.com/radhouenerouached/Groove

Use OAuth token for github project validation

Igor Bondarenko — Thu, 20 Aug 2015 22:07:00 -0000

Use OAuth token for project validation or else github will return 403 (probably only if request limit is reached) and user will see "This project is unavailable for import" message

Issues import from GitHub is broken

Igor Bondarenko — Thu, 20 Aug 2015 22:07:00 -0000

~~~~~ 5:08:33,519 ERROR [taskd:forgeimporters.base.import_tool:5475ecee04687d5bd4a43343:allura.lib.helpers] Failed after 0 retries on url with a timeout of 5.0: https://api.github.com/repos/atom/atom/issues?state=opened&access_token=<...>: HTTP Error 422: Unprocessable Entity Traceback (most recent call last): File "/home/ibondarenko/ibondarenko-1194/forge/Allura/allura/lib/helpers.py", line 1025, in urlopen return urllib2.urlopen(url, timeout=timeout) File "/var/local/env-allura/lib/python2.7/site-packages/TimerMiddleware-0.4.4-py2.7.egg/timermiddleware/__init__.py", line 121, in __call__ return self.run_and_log(self._inner, None, *args, **kwargs) File "/var/local/env-allura/lib/python2.7/site-packages/TimerMiddleware-0.4.4-py2.7.egg/timermiddleware/__init__.py", line 126, in run_and_log return func(*args, **kwargs) File "/usr/lib64/python2.7/urllib2.py", line 126, in urlopen return _opener.open(url, data, timeout) File "/usr/lib64/python2.7/urllib2.py", line 406, in open response = meth(req, response) File "/usr/lib64/python2.7/urllib2.py", line 519, in http_response 'http', request, response, code, msg, hdrs) File "/usr/lib64/python2.7/urllib2.py", line 444, in error return self._call_chain(*args) File "/usr/lib64/python2.7/urllib2.py", line 378, in _call_chain result = func(*args) File "/usr/lib64/python2.7/urllib2.py", line 527, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) HTTPError: HTTP Error 422: Unprocessable Entity ~~~~~

Ticket attachments aren't imported

Dave Brondsema — Thu, 20 Aug 2015 22:07:00 -0000

During an Allura ticket import, attachments that go with a comment are imported, but attachments that go with the ticket itself are not.

Text lost in mediawiki importer

Dave Brondsema — Sat, 11 Apr 2015 19:38:15 -0000

When converting https://sourceforge.net/p/allura/pastebin/5391e4847929e541de0160d9 the "Custom WMS map sources" section is lost. This can be tested in an automated test for example changing the `history` method in `TestMediawikiLoader` to use the content for one of the 'text' fields.

Google code importer should handle Apache-Extras/EclipseLabs projects

Dave Brondsema — Thu, 20 Aug 2015 22:07:00 -0000

E.g. projects at https://code.google.com/a/eclipselabs.org/hosting/ and https://code.google.com/a/apache-extras.org/hosting/ are slightly different than regular projects.

Trac ticket error: astimezone() cannot be applied to a naive datetime

Dave Brondsema — Thu, 20 Aug 2015 22:07:00 -0000

Errored on a CSV file like this from a Trac 1.0.1 instance: __group__,ticket,summary,component,status,type,priority,owner,modified,_time,_reporter prep,48,Create Stuff,Application,new,build,major,nobody,2014-02-09T05:16:55-05:00,16:14:18-05:00,John Doe Trace: ~~~~ Traceback (most recent call last): File "/var/local/allura/ForgeImporters/forgeimporters/base.py", line 131, in import_tool mount_point=mount_point, mount_label=mount_label, **kw) File "/var/local/allura/ForgeImporters/forgeimporters/trac/tickets.py", line 119, in import_tool json.dumps(export(trac_url), cls=DateJSONEncoder), File "/var/local/allura/Allura/allura/scripts/trac_export.py", line 304, in export verbose=verbose, do_attachments=do_attachments) File "/var/local/allura/Allura/allura/scripts/trac_export.py", line 99, in __init__ self.ticket_queue = self.next_ticket_ids() File "/var/local/allura/Allura/allura/scripts/trac_export.py", line 263, in next_ticket_ids r[1]), 'date_updated': self.trac2z_date(r[2])} File "/var/local/allura/Allura/allura/scripts/trac_export.py", line 127, in trac2z_date d = d.astimezone(pytz.UTC) ValueError: astimezone() cannot be applied to a naive datetime ~~~~

Trac-Tickets Importer Rejects URL Containing IP Address [ss6716]

Chris Tsai — Thu, 20 Aug 2015 22:07:00 -0000

[forge:site-support:#6716] >I receive the following message.. >'That is not a valid URL' >...when attempting to import tickets from a Trac project URL whose domain is an IP address.

Handle importing from older Trac formats

Dave Brondsema — Mon, 02 Feb 2015 02:43:49 -0000

E.g. trac 0.10.3 on http://www.spamboard.net/wiki/TitleIndex requires: - CONTENT_DIV_ATTRS = {'class': 'wikipage searchable'} + CONTENT_DIV_ATTRS = {'class': 'wikipage'} (And with that, may require stripping the `

` that is within the wikipage. Also `def page_list` needs to use the href instead of the text of each link. It'll need to strip off the base URL portion.

Validate Trac URLs before importing

Cory Johns — Thu, 20 Aug 2015 22:07:00 -0000

https://sourceforge.net/nf/admin/task_manager/view/52ebe3f21be1ce2af7b78b31 Validate Trac URLs so we don't get 404s or spurious NoneType errors during import.

Validate Github projects before importing

Dave Brondsema — Thu, 20 Aug 2015 22:07:10 -0000

Like [#6895] for Google Code, our github importer should check to see if a user/repo pair is valid before importing (and erroring on a 404 later)

Default username for GitHub import

Cory Johns — Thu, 26 Feb 2015 06:09:49 -0000

Since we use oauth to connect to GitHub, we should default the username field on the GitHub import pages, since most people will be importing their own projects. We should still allow changing it, however, since that won't always be the case.

Trac wiki import errors on child pages with "," in name

Dave Brondsema — Thu, 20 Aug 2015 22:07:10 -0000

E.g importing from http://sourceforge.net/apps/trac/shareaza/wiki/ See http://sourceforge.net/apps/trac/shareaza/wiki/TitleIndex for a list of its pages. Error is: ~~~~ Traceback (most recent call last): File "/home/dbrondsema/dbrondsema-1019/forge/Allura/allura/model/monq_model.py", line 258, in __call__ self.result = func(*self.args, **self.kwargs) File "/home/dbrondsema/dbrondsema-1019/forge/ForgeImporters/forgeimporters/base.py", line 122, in import_tool mount_point=mount_point, mount_label=mount_label, **kw) File "/var/local/env-allura/lib/python2.7/site-packages/tracwikiimporter/importer.py", line 118, in import_tool load_data(f.name, WikiFromTrac.parser(), options) File "/home/dbrondsema/dbrondsema-1019/forge/ForgeWiki/forgewiki/scripts/wiki_from_trac/loaders.py", line 54, in load_data import_wiki(cli, options.project, options.wiki, options, doc_txt) File "/home/dbrondsema/dbrondsema-1019/forge/ForgeWiki/forgewiki/scripts/wiki_from_trac/loaders.py", line 70, in import_wiki r = cli.call(url + '/' + title, **page) File "/home/dbrondsema/dbrondsema-1019/forge/Allura/allura/lib/import_api.py", line 63, in call raise e HTTPError: HTTP Error 403: Forbidden ~~~~

Attached images on comments not importing on GitHub Issues Importer

Cory Johns — Thu, 20 Aug 2015 22:07:10 -0000

Confirmed in [#6922] that the filename is (now) being matched properly and handed off to `Attachment` / `p.add_multiple_attachments()` properly, but it's not showing up on the imported ticket comment. E.g. https://sf-cjohns-1025.sb.sf.net/p/allura/huboard/48/#0df6 vs https://github.com/rauhryan/huboard/issues/48#issuecomment-5397695

Make doc.url.importers URL more specific

Dave Brondsema — Thu, 20 Aug 2015 22:07:10 -0000

The `doc.url.importers` URL is used for all importers. It would be more useful it if it was specific to the importer source. For example `doc.url.importers.google = ...` and `doc.url.importers.trac = ...`