Java-Gaming.org Hi !
Featured games (90)
games approved by the League of Dukes
Games in Showcase (744)
Games in Android Showcase (225)
games submitted by our members
Games in WIP (825)
games currently in development
News: Read the Java Gaming Resources, or peek at the official Java tutorials
 
    Home     Help   Search   Login   Register   
Pages: 1 2 3 [4]
  ignore  |  Print  
  Gosh, it's quiet in here  (Read 5527 times)
0 Members and 1 Guest are viewing this topic.
Offline SHC
« Reply #90 - Posted 2017-11-16 04:13:41 »

A quick change is that I added error reporting and also a progress notifier in the tool. This migration script is CLI based, as you can see it:



This should be more better as I will get to know if the script was hanged or not. I had to admit it is stressing out the MySQL server, as I can see the disk access at 99% rate. I have also added recognition of user groups, and currently this script translates everyone as Members, Mods and Admins.

By the way, did I mention that I'm committing this to GitHub? It's at https://github.com/sriharshachilakapati/JGO-Flarum-Migration

Great progress dudes!

Thanks! That will keep me excited to do, it was boring a bit to stare at the screen doing nothing while the migration is done. Currently for 11513 users, it is taking me ~12 minutes to do the port, that is with the reduced data which excludes people who have never logged in after activating their accounts and also non-activated accounts.

Ofcourse this is one of the first snags of a data-migration: how do we get application X to understand the password-encryption (salted-hash) from application Y. Typically this involves a bit of custom code in the new application. I could PM you your own SMF credentials (as hash+salt) and you could test your new implementation with that.

Yep I agree. I had looked into the sources of Flarum and found that it uses the same hashing used by Laravel framework, which I guess is bcrypt. I'd like to experiment with that, please do send me my own credentials in the PM.

Having to reset your password seems like a pretty reasonable thing when switching to a new site.

True that, it would be fine with most of the users as they log-in with social media anyways, but wouldn't hurt more for experimenting right?

Offline princec

« JGO Spiffy Duke »


Medals: 982
Projects: 3
Exp: 16 years


Eh? Who? What? ... Me?


« Reply #91 - Posted 2017-11-16 09:10:47 »

Keep it simple... just require everyone to change their password on first login, move on.

Cas Smiley

Offline SHC
« Reply #92 - Posted 2017-11-16 09:22:42 »

Keep it simple... just require everyone to change their password on first login, move on.

It could stress out JGO servers as requiring to change the password means that the server has to send a lot of mails with links.

Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline princec

« JGO Spiffy Duke »


Medals: 982
Projects: 3
Exp: 16 years


Eh? Who? What? ... Me?


« Reply #93 - Posted 2017-11-16 10:01:01 »

You underestimate just how, er, popular JGO isn't.

Cas Smiley

Offline elect

JGO Knight


Medals: 50



« Reply #94 - Posted 2017-11-16 10:09:00 »

Keep it simple... just require everyone to change their password on first login, move on.

Cas Smiley

this is also always a good practise from time to time, tough
Offline Riven
Administrator

« JGO Overlord »


Medals: 1327
Projects: 4
Exp: 16 years


Hand over your head.


« Reply #95 - Posted 2017-11-16 16:34:22 »

Thanks! That will keep me excited to do, it was boring a bit to stare at the screen doing nothing while the migration is done. Currently for 11513 users, it is taking me ~12 minutes to do the port, that is with the reduced data which excludes people who have never logged in after activating their accounts and also non-activated accounts.

Typically data-migration is fastest if you let the database do the bulk of the work:

1  
2  
3  
4  
SELECT ... some data-transformations in the select-statement
  INTO dst_table
  FROM src_table
  JOIN ... potentially some more JOINs to be able to properly fill dst_table


Migrating 11K users should take a split second, with this approach.

Hi, appreciate more people! Σ ♥ = ¾
Learn how to award medals... and work your way up the social rankings!
Offline abcdef
« Reply #96 - Posted 2017-11-22 16:32:39 »

How are things going SHC? Is there somewhere you are hosting it that we can have a play with?
Offline SHC
« Reply #97 - Posted 2017-11-22 17:19:09 »

How are things going SHC? Is there somewhere you are hosting it that we can have a play with?

I'm having a little bit of trouble with posts breaking because of tables. Flarum's BBCode plugin has limited tags, so I'm now in the process of writing an extension for it. Also, the icode tag breaks as well.

However the markdown support is good, so in the end, I might be just using the text formatter library and translate from BBCode to markdown. Just now I'm reading up the internal representation of posts. It appears that SMF stores the posts as raw BBCode. Flarum however stores it in a internal XML format that is easier to render.

By the way, I'm not going to host this anywhere without the permission of @Riven. In the meanwhile you can set up a local Flarum instance and run the migrator yourself.

Offline Riven
Administrator

« JGO Overlord »


Medals: 1327
Projects: 4
Exp: 16 years


Hand over your head.


« Reply #98 - Posted 2017-11-24 19:24:37 »

You have that permission, SHC. The (textual) content in the dump is slightly mangled, anybody using this as the foundation of a fork would have to be nuts Smiley

How are you liking the data-migration so far?

How easy is it to extend the Flarum UI? For example, adding a sidebar like on JGO.

Do you consider Flarum as a community-centric platform, or more of a Q&A platform?
When looking at the Flarum UI it feels to me like the focus is on Q&A. Maybe it's me Smiley

Hi, appreciate more people! Σ ♥ = ¾
Learn how to award medals... and work your way up the social rankings!
Offline SHC
« Reply #99 - Posted 2017-11-25 11:15:37 »

Thanks for that Riven, but I think that I'm going to do that only once I believe it got to a point to show others. I still have to write code to migrate posts.

However I'm taking some time, as I now have to move to a city that is ~700 km away because of job. I might not be available for two weeks because of house hunting, packing and moving things etc.

I'll be getting back to this from 11 or 12 December. The progress is smooth enough.

Regarding the UI of Flarum, I beleive that it is community centric, as is Discourse. To me they both appear to be same. However, I don't think you can get a sidebar into it. You can, by fiddling with adding a component to Mithril, but I don't think you can integrate it without spoiling the look. That's my opinion though.

See ya soon once I settle down there.

Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline SkyAphid
« Reply #100 - Posted 2017-11-25 19:40:29 »

I'm not sure what's going on in this thread but the excitement of everyone in here makes me excited too lol

it just werks
Offline ral0r2

Junior Devvie


Medals: 1



« Reply #101 - Posted 2017-12-14 19:48:27 »

I'm not sure what's going on in this thread but the excitement of everyone in here makes me excited too lol

+

I'm a daily lurker as well Cheesy
Offline ra4king

JGO Kernel


Medals: 506
Projects: 3
Exp: 5 years


I'm the King!


« Reply #102 - Posted 2017-12-16 07:54:58 »

So has this died?

Offline SHC
« Reply #103 - Posted 2017-12-16 10:24:12 »

Nope it isn't. I'm still working on it Roi. Only that I'm having a tough time looking to port the post contents.

Pages: 1 2 3 [4]
  ignore  |  Print  
 
 

 
Ecumene (150 views)
2017-09-30 02:57:34

theagentd (225 views)
2017-09-26 18:23:31

cybrmynd (302 views)
2017-08-02 12:28:51

cybrmynd (290 views)
2017-08-02 12:19:43

cybrmynd (298 views)
2017-08-02 12:18:09

Sralse (291 views)
2017-07-25 17:13:48

Archive (979 views)
2017-04-27 17:45:51

buddyBro (1104 views)
2017-04-05 03:38:00

CopyableCougar4 (1681 views)
2017-03-24 15:39:42

theagentd (1431 views)
2017-03-24 15:32:08
Java Gaming Resources
by philfrei
2017-12-05 19:38:37

Java Gaming Resources
by philfrei
2017-12-05 19:37:39

Java Gaming Resources
by philfrei
2017-12-05 19:36:10

Java Gaming Resources
by philfrei
2017-12-05 19:33:10

List of Learning Resources
by elect
2017-03-13 14:05:44

List of Learning Resources
by elect
2017-03-13 14:04:45

SF/X Libraries
by philfrei
2017-03-02 08:45:19

SF/X Libraries
by philfrei
2017-03-02 08:44:05
java-gaming.org is not responsible for the content posted by its members, including references to external websites, and other references that may or may not have a relation with our primarily gaming and game production oriented community. inquiries and complaints can be sent via email to the info‑account of the company managing the website of java‑gaming.org
Powered by MySQL Powered by PHP Powered by SMF 1.1.18 | SMF © 2013, Simple Machines | Managed by Enhanced Four Valid XHTML 1.0! Valid CSS!