Java-Gaming.org Hi !
Featured games (91)
games approved by the League of Dukes
Games in Showcase (755)
Games in Android Showcase (229)
games submitted by our members
Games in WIP (842)
games currently in development
News: Read the Java Gaming Resources, or peek at the official Java tutorials
 
    Home     Help   Search   Login   Register   
Pages: 1 2 3 [4]
  ignore  |  Print  
  Gosh, it's quiet in here  (Read 19931 times)
0 Members and 1 Guest are viewing this topic.
Offline SHC
« Reply #90 - Posted 2017-11-16 04:13:41 »

A quick change is that I added error reporting and also a progress notifier in the tool. This migration script is CLI based, as you can see it:



This should be more better as I will get to know if the script was hanged or not. I had to admit it is stressing out the MySQL server, as I can see the disk access at 99% rate. I have also added recognition of user groups, and currently this script translates everyone as Members, Mods and Admins.

By the way, did I mention that I'm committing this to GitHub? It's at https://github.com/sriharshachilakapati/JGO-Flarum-Migration

Great progress dudes!

Thanks! That will keep me excited to do, it was boring a bit to stare at the screen doing nothing while the migration is done. Currently for 11513 users, it is taking me ~12 minutes to do the port, that is with the reduced data which excludes people who have never logged in after activating their accounts and also non-activated accounts.

Ofcourse this is one of the first snags of a data-migration: how do we get application X to understand the password-encryption (salted-hash) from application Y. Typically this involves a bit of custom code in the new application. I could PM you your own SMF credentials (as hash+salt) and you could test your new implementation with that.

Yep I agree. I had looked into the sources of Flarum and found that it uses the same hashing used by Laravel framework, which I guess is bcrypt. I'd like to experiment with that, please do send me my own credentials in the PM.

Having to reset your password seems like a pretty reasonable thing when switching to a new site.

True that, it would be fine with most of the users as they log-in with social media anyways, but wouldn't hurt more for experimenting right?

Offline princec

« JGO Spiffy Duke »


Medals: 1030
Projects: 3
Exp: 20 years


Eh? Who? What? ... Me?


« Reply #91 - Posted 2017-11-16 09:10:47 »

Keep it simple... just require everyone to change their password on first login, move on.

Cas Smiley

Offline SHC
« Reply #92 - Posted 2017-11-16 09:22:42 »

Keep it simple... just require everyone to change their password on first login, move on.

It could stress out JGO servers as requiring to change the password means that the server has to send a lot of mails with links.

Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline princec

« JGO Spiffy Duke »


Medals: 1030
Projects: 3
Exp: 20 years


Eh? Who? What? ... Me?


« Reply #93 - Posted 2017-11-16 10:01:01 »

You underestimate just how, er, popular JGO isn't.

Cas Smiley

Offline elect

JGO Knight


Medals: 59



« Reply #94 - Posted 2017-11-16 10:09:00 »

Keep it simple... just require everyone to change their password on first login, move on.

Cas Smiley

this is also always a good practise from time to time, tough
Offline Riven
Administrator

« JGO Overlord »


Medals: 1340
Projects: 4
Exp: 16 years


Hand over your head.


« Reply #95 - Posted 2017-11-16 16:34:22 »

Thanks! That will keep me excited to do, it was boring a bit to stare at the screen doing nothing while the migration is done. Currently for 11513 users, it is taking me ~12 minutes to do the port, that is with the reduced data which excludes people who have never logged in after activating their accounts and also non-activated accounts.

Typically data-migration is fastest if you let the database do the bulk of the work:

1  
2  
3  
4  
SELECT ... some data-transformations in the select-statement
  INTO dst_table
  FROM src_table
  JOIN ... potentially some more JOINs to be able to properly fill dst_table


Migrating 11K users should take a split second, with this approach.

Hi, appreciate more people! Σ ♥ = ¾
Learn how to award medals... and work your way up the social rankings!
Offline abcdef
« Reply #96 - Posted 2017-11-22 16:32:39 »

How are things going SHC? Is there somewhere you are hosting it that we can have a play with?
Offline SHC
« Reply #97 - Posted 2017-11-22 17:19:09 »

How are things going SHC? Is there somewhere you are hosting it that we can have a play with?

I'm having a little bit of trouble with posts breaking because of tables. Flarum's BBCode plugin has limited tags, so I'm now in the process of writing an extension for it. Also, the icode tag breaks as well.

However the markdown support is good, so in the end, I might be just using the text formatter library and translate from BBCode to markdown. Just now I'm reading up the internal representation of posts. It appears that SMF stores the posts as raw BBCode. Flarum however stores it in a internal XML format that is easier to render.

By the way, I'm not going to host this anywhere without the permission of @Riven. In the meanwhile you can set up a local Flarum instance and run the migrator yourself.

Offline Riven
Administrator

« JGO Overlord »


Medals: 1340
Projects: 4
Exp: 16 years


Hand over your head.


« Reply #98 - Posted 2017-11-24 19:24:37 »

You have that permission, SHC. The (textual) content in the dump is slightly mangled, anybody using this as the foundation of a fork would have to be nuts Smiley

How are you liking the data-migration so far?

How easy is it to extend the Flarum UI? For example, adding a sidebar like on JGO.

Do you consider Flarum as a community-centric platform, or more of a Q&A platform?
When looking at the Flarum UI it feels to me like the focus is on Q&A. Maybe it's me Smiley

Hi, appreciate more people! Σ ♥ = ¾
Learn how to award medals... and work your way up the social rankings!
Offline SHC
« Reply #99 - Posted 2017-11-25 11:15:37 »

Thanks for that Riven, but I think that I'm going to do that only once I believe it got to a point to show others. I still have to write code to migrate posts.

However I'm taking some time, as I now have to move to a city that is ~700 km away because of job. I might not be available for two weeks because of house hunting, packing and moving things etc.

I'll be getting back to this from 11 or 12 December. The progress is smooth enough.

Regarding the UI of Flarum, I beleive that it is community centric, as is Discourse. To me they both appear to be same. However, I don't think you can get a sidebar into it. You can, by fiddling with adding a component to Mithril, but I don't think you can integrate it without spoiling the look. That's my opinion though.

See ya soon once I settle down there.

Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline SkyAphid
« Reply #100 - Posted 2017-11-25 19:40:29 »

I'm not sure what's going on in this thread but the excitement of everyone in here makes me excited too lol

it just werks
Offline ral0r2

Junior Devvie


Medals: 2



« Reply #101 - Posted 2017-12-14 19:48:27 »

I'm not sure what's going on in this thread but the excitement of everyone in here makes me excited too lol

+

I'm a daily lurker as well Cheesy
Offline ra4king

JGO Kernel


Medals: 508
Projects: 3
Exp: 5 years


I'm the King!


« Reply #102 - Posted 2017-12-16 07:54:58 »

So has this died?

Offline SHC
« Reply #103 - Posted 2017-12-16 10:24:12 »

Nope it isn't. I'm still working on it Roi. Only that I'm having a tough time looking to port the post contents.

Offline AzureusNation

Junior Newbie


Medals: 1



« Reply #104 - Posted 2017-12-19 09:20:28 »

Hey SHC,

I'm a DBA at Money Supermarket in the UK. I think I might be able to help you out migrating all of the data over. Just a little background, we have over 50 SQL servers and over 600 Database instances running. We are constantly moving data between schemas so please message me and we'll talk on Discord
Offline lauwenmark

Junior Newbie





« Reply #105 - Posted 2018-04-01 06:40:13 »

Has this project died completely? Is there any work that could be done to help with it?
Offline SHC
« Reply #106 - Posted 2018-04-01 06:58:27 »

Nope it isn't dead. I'm just waiting for some issues in the Flarum and mainly waiting for it to get to stable. It's mostly done except for some issues in porting the post content. Feel free to look into the code and test it out.

https://github.com/sriharshachilakapati/JGO-Flarum-Migration

Offline SHC
« Reply #107 - Posted 2018-04-08 17:53:38 »

Discussions!! Still not complete, but the first look just for those of you interested:



Currently, only topics are migrated. Posts in it aren't. I need to know all the custom implemented BBCode tags here in order to be able to do that.

@Riven Can you list me all custom tags that are enabled here? I only knew icode, code and youtube tags.

Offline SHC
« Reply #108 - Posted 2018-04-12 07:06:17 »



Posts in topics are now migrated!!

It seems in very old posts, code tags aren't being used. And also from quotations that were made from deleted posts, it seems to produce some empty quote tags. Will look into it.

Offline SHC
« Reply #109 - Posted 2018-04-13 12:31:23 »

I think I need some help with optimizations now. I've previously never worked with PHP nor MySQL, so I know my code just aims to look pretty. However, it is performing so bad, that it is now taking me complete two days just to migrate all the users, ignore the posts.

Can anyone lend me a hand? The latest code is already in GitHub along with instructions: https://github.com/sriharshachilakapati/JGO-Flarum-Migration/

Offline Riven
Administrator

« JGO Overlord »


Medals: 1340
Projects: 4
Exp: 16 years


Hand over your head.


« Reply #110 - Posted 2018-04-13 17:27:53 »

Typically you use plain old SQL queries in data-migration. It would probably take a second or two to migrate the JGO user-table into any other application-specific user-table.

Hi, appreciate more people! Σ ♥ = ¾
Learn how to award medals... and work your way up the social rankings!
Offline mudlee

Junior Devvie


Medals: 4
Exp: 5 years



« Reply #111 - Posted 2018-04-28 08:15:30 »

I think the lwjgl guys use(d?) the same forum and they installed a mobile friendly theme (not migrated to a new one I guess) and it helps a lot at least for start as I can read it on my mobile.

To the original topic: people, espedially young people wants everything to be done quick. The thing how its dirty or how it really works does not matter, at least not that much. Thats why nodejs exists. And its not just true for game writing, its true for every aspect of life. So sad.

I read an article about why ludum dare shoukd deny engines like unity and I used to  say not the tool the goal there, but nowadays I would say, the article was right.
Offline CommanderKeith
« Reply #112 - Posted 2018-04-29 13:54:14 »

Interesting view, I read your response as an answer to the question of why fewer young or new developers choose Java and visit this forum: they prefer scripting languages and ready-made engines and build chains such as unity rather than lower level languages such as java where you have to do everything manually.

I sometimes think that these engines such as unity in some ways fulfill the write once run anywhere promise that java originally had. Plus they have a very rich eco system of assets and tutorials. Java has its own libgdx which is great and helps with that, but smaller scale obviously than unity.

Since artists, animators, designers and programmers are often familiar with unity's told and build chain, I imagine it's become the defacto standard in professional game development.

Even @princec used unity in his latest highly polished game Basingstoke.

A younger version of myself would probably choose unity to make games. However, I'm glad I learned Java which is much more useful for general programming such as servlets.

Offline princec

« JGO Spiffy Duke »


Medals: 1030
Projects: 3
Exp: 20 years


Eh? Who? What? ... Me?


« Reply #113 - Posted 2018-04-29 15:48:23 »

Unity's a bit crap in some ways.

I started to like C# for a bit... and then I got annoyed by it. C# is very much Java 5 + Blackjack and hookers, like someone said "screw you I'm gonna make my own language like Java with <insert cool features>" but didn't quite think it all through to the end.

That said... I really want to pinch some features from C# now. Value types, pass by reference for value types, multidimensional arrays, extension methods, and true generic templates, all make life genuinely much more excellent.

But Unity hasn't helped us at all.

Cas Smiley

Offline SHC
« Reply #114 - Posted 2018-04-29 16:21:02 »

You forgot the built-in properties support too.. I also like the async methods and built-in events and delegate system.

Offline ByerN
« Reply #115 - Posted 2018-04-29 16:42:42 »

To the original topic: people, espedially young people wants everything to be done quick. The thing how its dirty or how it really works does not matter, at least not that much. Thats why nodejs exists. And its not just true for game writing, its true for every aspect of life. So sad.

I would like to extend it a little and say that people these days wants to not be programmer and create the application at the same time. That's one of the things that makes engines very popular. I've found that, for example, for managers it's very attractive to find some easy engine where any wanna-be-developer can just click some buttons and generate whole application... and it fails so brutally hard usually. Or hire team of developers to create generic engine where he or any other excel-powerpoint-fullstack-developer can just put some content and create application. That's how it works today.

Of course, solutions like using game dev engines are very effective and you DRY a lot. It is making your work easier and efficient (as long as you are in the boundaries of your framework's/engine's ideology. Otherwise, you have to hack everything to get it work like you want and it is even harder to achieve correct result).

I am not using unity or unreal engine because it's not giving me enough control over my application that I want (and I love programming Cheesy).
But I have to say that exporting games to xbox or ps is so attractive. Is there any possibility to do this with Libgdx? I don't know much about game consoles.

Other thing is programming language itself. For about half year ago I've started to more often use scala then java and I like it. But here we got a different programming paradigm (and scala's syntactic sugar that is so great and hard to understand at the same time).
Offline mudlee

Junior Devvie


Medals: 4
Exp: 5 years



« Reply #116 - Posted 2018-04-29 17:14:03 »

Well, I gave almost 1 year for unity. And actually, I really love it. I mean, the editor and the UX is just top. What I did not like is that:
  • Asset store calling me in my dreams. "Don't write your own, just buy that one, its better than yours"
  • C# -> It's OK, but I pretty much love Java

So it's easy. My mentality really has to fight against the "you don't have to reinvent the wheel, others did it, and did it better, than you can do ever". Somehow it's true. You click the Ambient Occlusion and its done. But... isn't better if you know how it really works? I think yes, you should learn.

I really want to ship my idea asap, but it has a price. I can ship it with a tool, that teaches me not to learn everything but use others' code.

Pro-con. I vote for write your own, and sometimes I use unity just to get some ideas and run away from the problems.
Offline princec

« JGO Spiffy Duke »


Medals: 1030
Projects: 3
Exp: 20 years


Eh? Who? What? ... Me?


« Reply #117 - Posted 2018-04-29 19:47:38 »

You forgot the built-in properties support too.. I also like the async methods and built-in events and delegate system.
Actually those features I don't really like that much. Properties support is just crap syntactic sugar and tbh solves nothing important and doesn't even save much typing. Though I'm on the fence about the continuations support though I can't help but feel that continuations are some sort of giant bodge masking a terrible failure in conception but I haven't quite managed to see through the magic yet to figure out what it is about them that bothers me so.

Cas Smiley

Offline tariqbroadnax

Junior Devvie


Medals: 5
Exp: 3 years



« Reply #118 - Posted 2018-04-30 12:45:20 »

So no one wants multi-line strings?
Offline princec

« JGO Spiffy Duke »


Medals: 1030
Projects: 3
Exp: 20 years


Eh? Who? What? ... Me?


« Reply #119 - Posted 2018-04-30 12:58:09 »

Oh, them too Smiley Just haven't used them in C# this time around.

Cas Smiley

Pages: 1 2 3 [4]
  ignore  |  Print  
 
 

 
DesertCoockie (52 views)
2018-05-13 18:23:11

nelsongames (82 views)
2018-04-24 18:15:36

nelsongames (74 views)
2018-04-24 18:14:32

ivj94 (757 views)
2018-03-24 14:47:39

ivj94 (87 views)
2018-03-24 14:46:31

ivj94 (643 views)
2018-03-24 14:43:53

Solater (102 views)
2018-03-17 05:04:08

nelsongames (184 views)
2018-03-05 17:56:34

Gornova (426 views)
2018-03-02 22:15:33

buddyBro (1086 views)
2018-02-28 16:59:18
Java Gaming Resources
by philfrei
2017-12-05 19:38:37

Java Gaming Resources
by philfrei
2017-12-05 19:37:39

Java Gaming Resources
by philfrei
2017-12-05 19:36:10

Java Gaming Resources
by philfrei
2017-12-05 19:33:10

List of Learning Resources
by elect
2017-03-13 14:05:44

List of Learning Resources
by elect
2017-03-13 14:04:45

SF/X Libraries
by philfrei
2017-03-02 08:45:19

SF/X Libraries
by philfrei
2017-03-02 08:44:05
java-gaming.org is not responsible for the content posted by its members, including references to external websites, and other references that may or may not have a relation with our primarily gaming and game production oriented community. inquiries and complaints can be sent via email to the info‑account of the company managing the website of java‑gaming.org
Powered by MySQL Powered by PHP Powered by SMF 1.1.18 | SMF © 2013, Simple Machines | Managed by Enhanced Four Valid XHTML 1.0! Valid CSS!