zarhooie: Girl on a blueberry bramble looking happy. Text: Kat (DW Powered by Santa Disco)
Cream Puff with Teeth ([personal profile] zarhooie) wrote in [site community profile] dw_support2012-11-07 10:52 pm

What is going on

Hello again, Support!

Very short version: Mark has diagnosed the comment import issue and is working on a tool to fix it.

Slightly longer version: Stuff broke importing entries from LiveJournal. LiveJournal made a change which confused the importer. During the time between when LiveJournal made their change and when Mark fixed the importer, some users ran imports. [These users now have a problem.] In order to do a successful import, the affected users will need to remove all imported content from their journals to prevent duplication. Mark is building a user-facing tool for this so the users won't need to do it manually or wait for Mark to remove the imported content from Dreamwidth's end.

What Happened: Previously, when the Dreamwidth importer contacted another site to get content (comments, entries, and so on), it would use the entry's URL on the other site. LiveJournal's recent code changes have changed the way they output the URL. This prevented the duplication detector from, well, detecting duplicates. It also prevented comments from being imported because there was no URL to latch on to.

What We're Doing to Fix It: The importer has been changed to generate an entry identification string, and will use that to detect duplicates and grab comments going forward.

Part of fixing it means clearing stuff that was previously imported. There's a tool to do this from the site administrator side. Mark is working on making this a self-service tool, so users who need to use it won't have to go through Support to make it happen anymore.

What This Means for Support: There are a lot of requests about the importer right now. We are going to let them know what happened, and that we are waiting for the duplicate removal tool to be ready for them to use. Mark is working on making a tool available to users, but it is taking a little longer than expected. When something is going to remove
content, he doesn't want to take any chances.

What this means for Users: If you have tried to import since LiveJournal changed their code, you will need to delete all imported comment from your journal and start fresh. We will announce the coming of the tool in [site community profile] dw_maintenance (probably here in [site community profile] dw_support also), as well as in any open support requests on the topic.

The tool will delete any comments left on imported entries in addition to the entries themselves. [It will delete ALL imported entries, not just entries imported when the importer was broken.] In short, if you imported an entry, and someone commented on that entry in Dreamwidth, that comment will be lost. This is an edge case, so it's unlikely you'll run into this issue. Comments should be imported from LiveJournal without any issues.

Once your imported content has been removed, you can try to import again. If you see any duplicates after this, please let Support know. Please be patient while importing-- wait times may be longer than normal due to volume.

Thank you for much for your patience through this Exciting Adventure!

Dreamwidth Support Admin

(x-posted to [site community profile] dw_support_training
aralias: (Default)

[personal profile] aralias 2012-11-08 02:35 pm (UTC)(link)
Hi. Is the failure to import icons from LJ a similar problem? I've got 100 spaces on DW and 99 icons on LJ but only my default is importing. Thanks.
aralias: (Default)

[personal profile] aralias 2012-11-08 04:18 pm (UTC)(link)
salvaged_pride: (Default)

[personal profile] salvaged_pride 2012-11-13 02:41 pm (UTC)(link)
How will we be alerted when this tool is finished? I am having terrible duplicate (triplicate) entry issues and yet still not all of my entries have imported. With the issues happening on LJ, I want to get my entries off there asap.
salvaged_pride: (Default)

[personal profile] salvaged_pride 2012-11-18 02:30 pm (UTC)(link)
Sorry for another comment, but unfortunately the method you described above and what we discussed in PM did not work. The same entries that would not previously import are still not importing - of course some of the entries I want most of all.
salvaged_pride: (Default)

[personal profile] salvaged_pride 2012-11-18 06:07 pm (UTC)(link)
I have.

I responded to it but haven't heard anything. Thank you kindly as always!
salvaged_pride: (Default)

[personal profile] salvaged_pride 2012-11-21 01:12 pm (UTC)(link)
Thank you, I hope to hear from you soon. My writing is still on LJ and I'd like to get this account settled to go before NaNo is finished.