Wedge

Public area => The Pub => Importing into Wedge => Topic started by: Farjo on January 22nd, 2014, 03:38 AM

Title: Importer tool
Post by: Farjo on January 22nd, 2014, 03:38 AM
https://github.com/Wedge/importer

I have just used it and worked on my SMF 2 installation. However there was a bit of guesswork involved so to help others here's what I had to do.

1. the 'path to smf2' must be the relative address. So if wedge is in a subfolder off of your smf install then you need to input ../ (dot dot slash). For me SMF is in public_html and wedge is another folder off the root, and I access wedge using a subdomain. So I had to put ../public_html - the dot dot slash says "take me to the folder above this one." Absolute address works fine :)

2. The importer asks for the wedge database password but it then gave me an error as it wasn't able to read the SMF database. So the other thing I had to do was to give the wedge database user permission to the SMF database.

The above is not intended for techie people who are probably grinding their teeth at such language!

Anyway it worked well and everything seems to have been imported - even an unread message I received today :)
Title: Re: Importer tool
Post by: Nao on January 22nd, 2014, 07:33 AM
Absolute path works for me. Dunno why it didn't for you.
Database permissions van be complicated to get right. Honestly, I wouldn't know why you need access to one db on another...

As a reminder, the importer tool still doesn't support avatars, attachments and media items. I'll look into it when I'm done with fixing install problems.
Title: Re: Importer tool
Post by: Pandos on January 22nd, 2014, 12:45 PM
Attachments and avatars import is fixed. Please wait till Nao pushes the PR to master.
Title: Re: Importer tool
Post by: Farjo on January 22nd, 2014, 01:01 PM
I'll have another look at the path later :)
Title: Re: Importer tool
Post by: Nao on January 22nd, 2014, 02:23 PM
Pushed to the repo.

Avatar & attachment confirmed to work fine. Thanks!
Also added some translatable strings.

Now, all we need to do is import Aeva Media settings and files... (I'm sure it'll be easy. Nah, just kidding.)
Title: Re: Importer tool
Post by: Pandos on January 22nd, 2014, 02:26 PM
Gotcha!
Just a pair of minutes ago I was thinking about a poll for that :)
Should not be very hard to do.
Title: Re: Importer tool
Post by: Farjo on January 23rd, 2014, 03:27 AM
One picky thing: the importer has a readme file with the same name as the main wedge one so when uploading the importer files it'll be overwritten.

And one thing from my specific data conversion is that we have a news item that starts with a center BB tag. The importer brings this in as center] i.e. it misses the open square bracket. This in turn mucks up the layout of the whole board.
Title: Re: Importer tool
Post by: Farjo on January 23rd, 2014, 07:01 PM
Imported from v2.0.6 (just upgraded to 2.0.7 today).

I am travelling and this hostel's WiFi is the slowest I have encountered. So maybe there was a stutter when it came to that date due to a bad connection. I'm moving on tomorrow so let's leave it until the evening or the next day and I will re-install and run the importer again. Hopefully their WiFi will be faster!
Title: Re: Importer tool
Post by: Farjo on January 25th, 2014, 07:02 PM
Quote from Farjo on January 23rd, 2014, 07:01 PM
I am travelling and this hostel's WiFi is the slowest I have encountered. So maybe there was a stutter when it came to that date due to a bad connection. I'm moving on tomorrow so let's leave it until the evening or the next day and I will re-install and run the importer again. Hopefully their WiFi will be faster!
I spoke too soon - this hostel's WiFi is even worse :sob: So I'll try it when I can.
Title: Re: Importer tool
Post by: Nao on January 29th, 2014, 10:17 AM
Okay, I think I'm done with the mysqli upgrade...

I'm now fighting with custom attachment folders, or something, which Pandos added support for. Unfortunately, he forgot to create said folders... :P
Title: Re: Importer tool
Post by: Pandos on January 29th, 2014, 10:21 AM
Quote from Nao on January 29th, 2014, 10:17 AM
Okay, I think I'm done with the mysqli upgrade...

I'm now fighting with custom attachment folders, which Pandos added support for. Unfortunately, he forgot to create said folders... :P
No?
why create folders, if folders are already used?
I'm using custom folders over NFS. So for that it make no sense to create new folders in wedge.
Posted: January 29th, 2014, 10:20 AM

OK, one thing: it must be copied, because of the new extension.
Title: Re: Importer tool
Post by: Nao on January 29th, 2014, 10:47 AM
For instance, attachments/p2 in my source folder is trying to be copied to attachments/p2 in the new forum, and it gives me an error message saying it doesn't exist.

I've given up on this, and committed my current work (i.e. the MySQLi conversion for Lorenzo), but feel free to give it another try. In the meantime, all I can say is: it looks like the new version is working. Phew... ;)
Title: Re: Importer tool
Post by: MultiformeIngegno on January 29th, 2014, 10:50 AM
Yeah! Will try it this evening (unfortunately I can't do my tests during the day as I'm in university). :)
Title: Re: Importer tool
Post by: Nao on January 29th, 2014, 10:50 AM
No problem.
Title: Re: Importer tool
Post by: MultiformeIngegno on January 30th, 2014, 01:18 AM
Ehm... so imbarassed... I had mistyped smf database............ now the problem is that now it's 10 minutes stuck at copying smileys.

SMF and wedge folders are all 775, chwoned to www-data:www-data (which is in root group).
If can be of any help this is the url I'm at import.php?step=1&substep=9&start=24750

EDIT: I reloaded the page and I got this:

Message: Undefined property: Importer::$xml
Trace: Undefined property: Importer::$xml
Line: 528
File: /var/www/.altro/tests/import.php
Title: Re: Importer tool
Post by: MultiformeIngegno on January 30th, 2014, 01:25 AM
Now when I visit the forum, smileys have these invalid urls http://domain.tld/gz/..[url]http://127.0.0.1/wedge/assets/smileys/default/smiley.gif[/url]

the dots are in the url, I just changed the domain.tld part
Title: Re: Importer tool
Post by: MultiformeIngegno on January 30th, 2014, 01:28 AM
Eheh, auto-fixing tags failed on my previous post.. let's try again with an image
Title: Re: Importer tool
Post by: MultiformeIngegno on January 30th, 2014, 01:54 AM
In my imported SMF install I had a board with topic approval on. Now I can see on wedge there's one topic to approve. But when I click the icon I'm brought to an empty moderation center (index.php?action=moderate;area=postmod;sa=topics;brd=27;ef3ee2e=049639d9324450639d45ddcf59d66c0a.
Title: Re: Importer tool
Post by: MultiformeIngegno on January 30th, 2014, 03:59 PM
Quote from MultiformeIngegno on January 30th, 2014, 01:18 AM
Ehm... so imbarassed... I had mistyped smf database............ now the problem is that now it's 10 minutes stuck at copying smileys.

SMF and wedge folders are all 775, chwoned to www-data:www-data (which is in root group).
If can be of any help this is the url I'm at import.php?step=1&substep=9&start=24750

EDIT: I reloaded the page and I got this:

Message: Undefined property: Importer::$xml
Trace: Undefined property: Importer::$xml
Line: 528
File: /var/www/.altro/tests/import.php
:whistle:
Title: Re: Importer tool
Post by: Nao on January 30th, 2014, 07:38 PM
Quote from MultiformeIngegno on January 30th, 2014, 01:18 AM
Ehm... so imbarassed... I had mistyped smf database............
........
Quote from MultiformeIngegno on January 30th, 2014, 01:18 AM
now the problem is that now it's 10 minutes stuck at
EDIT: I reloaded the page and I got this:

Message: Undefined property: Importer::$xml
Trace: Undefined property: Importer::$xml
Line: 528
File: /var/www/.altro/tests/import.php
That's normal. IIRC, it's because your session has expired. You need to return to the first page of the import script, and start again.
Title: Re: Importer tool
Post by: Nao on January 30th, 2014, 07:41 PM
Quote from MultiformeIngegno on January 30th, 2014, 01:25 AM
the dots are in the url, I just changed the domain.tld part
What's the value of $settings['smileys_dir'] and 'smileys_url' in the {db_prefix}settings table..?
Title: Re: Importer tool
Post by: Nao on January 30th, 2014, 07:44 PM
Quote from MultiformeIngegno on January 30th, 2014, 01:54 AM
In my imported SMF install I had a board with topic approval on. Now I can see on wedge there's one topic to approve. But when I click the icon I'm brought to an empty moderation center (index.php?action=moderate;area=postmod;sa=topics;brd=27;ef3ee2e=049639d9324450639d45ddcf59d66c0a.
Do you get to the proper place by replacing sa=topics with sa=replies..? Although I doubt so?
Title: Re: Importer tool
Post by: Nao on January 30th, 2014, 07:45 PM
Quote from MultiformeIngegno on January 30th, 2014, 01:28 AM
Eheh, auto-fixing tags failed on my previous post.. let's try again with an image
Auto-fixing never fails. It just asks for your opinion on whether it did the right job. :P
Title: Re: Importer tool
Post by: MultiformeIngegno on January 30th, 2014, 09:49 PM
Quote from Nao on January 30th, 2014, 07:41 PM
Quote from MultiformeIngegno on January 30th, 2014, 01:25 AM
the dots are in the url, I just changed the domain.tld part
What's the value of $settings['smileys_dir'] and 'smileys_url' in the {db_prefix}settings table..?
Can someone help me with the query I need to run to show the value? Can't install phpmyadmin right now..
Title: Re: Importer tool
Post by: Pandos on January 30th, 2014, 10:21 PM
Quote from MultiformeIngegno on January 30th, 2014, 09:49 PM
Quote from Nao on January 30th, 2014, 07:41 PM
Quote from MultiformeIngegno on January 30th, 2014, 01:25 AM
the dots are in the url, I just changed the domain.tld part
What's the value of $settings['smileys_dir'] and 'smileys_url' in the {db_prefix}settings table..?
Can someone help me with the query I need to run to show the value? Can't install phpmyadmin right now..
You mean for wedge?
Please change path and URL!
Code: [Select]
INSERT INTO `wedge_settings` VALUES ('smileys_dir','/***YOUR***PATH***TO***WEDGE/assets/smileys'),('smileys_url','http://***YOUR***URL***/wedge/assets/smileys'),('smiley_sets_default','default'),('smiley_sets_known','default,aaron'),('smiley_sets_names','Alienine\'s Set\nAaron\'s Set');
Title: Re: Importer tool
Post by: MultiformeIngegno on January 30th, 2014, 11:51 PM
Quote from Pandos on January 30th, 2014, 10:21 PM
Quote from MultiformeIngegno on January 30th, 2014, 09:49 PM
Quote from Nao on January 30th, 2014, 07:41 PM
Quote from MultiformeIngegno on January 30th, 2014, 01:25 AM
the dots are in the url, I just changed the domain.tld part
What's the value of $settings['smileys_dir'] and 'smileys_url' in the {db_prefix}settings table..?
Can someone help me with the query I need to run to show the value? Can't install phpmyadmin right now..
You mean for wedge?
Please change path and URL!
Code: [Select]
INSERT INTO `wedge_settings` VALUES ('smileys_dir','/***YOUR***PATH***TO***WEDGE/assets/smileys'),('smileys_url','http://***YOUR***URL***/wedge/assets/smileys'),('smiley_sets_default','default'),('smiley_sets_known','default,aaron'),('smiley_sets_names','Alienine\'s Set\nAaron\'s Set');
Insert? I think Nao wanted to just know the values I had. So we can understand what caused wrong links.. Doesn't INSERT add something?
Title: Re: Importer tool
Post by: Pandos on January 31st, 2014, 09:55 AM
Quote from MultiformeIngegno on January 30th, 2014, 11:51 PM
Insert? I think Nao wanted to just know the values I had. So we can understand what caused wrong links.. Doesn't INSERT add something?
Sorry, was a hard day... :)
Code: [Select]
SELECT variable, value FROM wedge_settings WHERE variable LIKE 'smiley%';
Title: Re: Importer tool
Post by: Pandos on January 31st, 2014, 04:08 PM
Quote from Nao on January 31st, 2014, 02:45 PM
Pandos, I'm asking for the result of that query... not for the query itself... I'm not a SQL champ but I can still write those without help... I hope :lol:
Hope so too! :lol: :lol:
My answer was related to:
Quote from MultiformeIngegno on January 30th, 2014, 09:49 PM
Can someone help me with the query I need to run to show the value? Can't install phpmyadmin right now..
So I'm not so blind at all :)
Title: Re: Importer tool
Post by: Nao on January 31st, 2014, 04:15 PM
Anyway, here are my values...

theme_url
ttp://127.0.0.1/wedge/core/html

images_url
ttp://127.0.0.1/wedge/assets

smileys_url
ttp://127.0.0.1/wedge/assets/smileys

avatar_url
ttp://127.0.0.1/wedge/assets/avatars

(I removed the starting 'h' because otherwise it'd link to them. Now it reminds me of the good old 2ch days, ah ah...)

This is after a clean install + SMF reimport. (I'm thinking the import tool has nothing to do with this, so it should be on the other topic.)
Obviously, none of these are right, and I'm really, REALLY surprised that Wedge works so well with so many wrong paths... :lol:
Well, I guess I made it noob-friendly after all!

@Bun, well the good thing about this importer is that it's relatively forgiving with DB errors, but still, that's something to fix...
Title: Re: Importer tool
Post by: TE on February 1st, 2014, 08:31 AM
Can someone please split this topic into multiple .. I can help with one or the other issue but it's a total chaos?

Maybe create an extra board for that.
Title: Re: Importer tool
Post by: Nao on February 1st, 2014, 09:21 AM
I'll try to create a new board today.
Title: Re: Importer tool
Post by: Nao on February 1st, 2014, 09:34 PM
Moving this topic into its own board.

Thorsten, you're now a moderator over this section, so you should be able to split posts into topics yourself, unless you want me to do it!
Title: Re: Importer tool
Post by: TE on February 2nd, 2014, 09:36 AM
Topic locked. Please start your own topic, if you have issues with the importer.
Title: Re: Importer tool
Post by: Nao on February 2nd, 2014, 12:43 PM
You could have said thanks, or something... Your post feels like you're punishing me :lol:
Title: Re: Importer tool
Post by: TE on February 2nd, 2014, 02:50 PM
Quote from Nao on February 2nd, 2014, 12:43 PM
You could have said thanks, or something... Your post feels like you're punishing me :lol:
LOL yes, thanks. That post wasn't a direct answer to your's :lol:
Title: Re: Importer tool
Post by: Nao on February 16th, 2014, 11:36 PM
[Commit revision b3807d4]
(https://gravatar.com/avatar/0879c588019800e5349fe171d69e1c28?d=https%3A%2F%2Fidenticons.github.com%2Fa77898357042a3151178ee5ac33742a6.png&r=x)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Sun, 16 Feb 2014 23:36:24 +0100
Stats: 1 file changed(https://github.com/Wedge/importer/commit/b3807d4f01473d4ea3a43f9137839fa6a9c10ab8); +4 (insertions), -6 (deletions)
Title: Re: Importer tool
Post by: Nao on February 20th, 2014, 11:45 PM
[Commit revision ed0e2b2]
(https://gravatar.com/avatar/0879c588019800e5349fe171d69e1c28?d=https%3A%2F%2Fidenticons.github.com%2Fa77898357042a3151178ee5ac33742a6.png&r=x)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Thu, 20 Feb 2014 23:45:23 +0100
Stats: 1 file changed(https://github.com/Wedge/importer/commit/ed0e2b20d5dd504fa2e4bdb8f2292f8106f2a7b5); +25 (insertions), -6 (deletions)
Title: Re: Importer tool
Post by: Nao on February 26th, 2014, 10:53 PM
[Commit revision d65f1ff]
(https://gravatar.com/avatar/0879c588019800e5349fe171d69e1c28?d=https%3A%2F%2Fidenticons.github.com%2Fa77898357042a3151178ee5ac33742a6.png&r=x)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Wed, 26 Feb 2014 22:53:38 +0100
Stats: 2 files changed(https://github.com/Wedge/importer/commit/d65f1ffa23d20349eeafd351889fcda9c960814d); +28 (insertions), -9 (deletions)
Title: Re: Importer tool
Post by: Nao on February 26th, 2014, 11:57 PM
[Commit revision bf6dbf2]
(https://avatars.githubusercontent.com/u/1857192)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Wed, 26 Feb 2014 23:57:15 +0100
Stats: 2 files changed(https://github.com/Wedge/importer/commit/bf6dbf24468401f1f9a98050ecce19d078d38d7e); +2 (insertions), -2 (deletions)
Title: Re: Importer tool
Post by: Nao on February 27th, 2014, 10:31 AM
[Commit revision 19cd1ad]
(https://avatars.githubusercontent.com/u/1857192)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Thu, 27 Feb 2014 10:30:45 +0100
Stats: 3 files changed(https://github.com/Wedge/importer/commit/19cd1ad188eec1b453805fc7cdb7fe8355458a99); +20 (insertions), -4 (deletions)
Title: Re: Importer tool
Post by: Nao on March 28th, 2014, 09:34 PM
[Commit revision 8c2ced7]
(https://avatars.githubusercontent.com/u/1857192?)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Fri, 28 Mar 2014 21:33:58 +0100
Stats: 8 files changed(https://github.com/Wedge/importer/commit/8c2ced7ee96e3c08df69ac6fb2be09cfb495e524); +2 (insertions), -40 (deletions)
Title: Re: Importer tool
Post by: Nao on March 30th, 2014, 12:24 AM
[Commit revision ebc715a]
(https://avatars.githubusercontent.com/u/1857192?)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Sun, 30 Mar 2014 00:24:23 +0100
Stats: 3 files changed(https://github.com/Wedge/importer/commit/ebc715a1efb93cd304763de8a4a0ce420efa5358); +15 (insertions), -0 (deletion)
Title: Re: Importer tool
Post by: Nao on April 8th, 2014, 01:04 PM
[Commit revision aad30be]
(https://avatars.githubusercontent.com/u/1857192?)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Fri, 04 Apr 2014 22:46:12 +0200
Stats: 1 file changed(https://github.com/Wedge/importer/commit/aad30bee704b447f1565bf08e1de905bff0b67db); +2 (insertions), -4 (deletions)
[Commit revision 1f3c70f]
(https://avatars.githubusercontent.com/u/1857192?)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Sat, 05 Apr 2014 12:50:41 +0200
Stats: 1 file changed(https://github.com/Wedge/importer/commit/1f3c70f21136c8216fe7a8f9f72aa2b2bc95a659); +5 (insertions), -5 (deletions)
Title: Re: Importer tool
Post by: Nao on May 12th, 2014, 01:12 PM
[Commit revision 26e2ca3]
(https://avatars.githubusercontent.com/u/1857192?)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Mon, 12 May 2014 13:12:35 +0200
Stats: 2 files changed(https://github.com/Wedge/importer/commit/26e2ca3fec54fb4caccd2ab95efa81af01e7350d); +2 (insertions), -2 (deletions)
Title: Re: Importer tool
Post by: Nao on May 12th, 2014, 01:46 PM
[Commit revision b7f06c6]
(https://avatars.githubusercontent.com/u/1857192?)Author: Nao(https://github.com/Nao) (Signed-off)
Date: Mon, 12 May 2014 13:46:28 +0200
Stats: 2 files changed(https://github.com/Wedge/importer/commit/b7f06c6798836ebe613ddf10ba41c0955564c20a); +3 (insertions), -9 (deletions)