Java-Gaming.org Hi !
Featured games (83)
games approved by the League of Dukes
Games in Showcase (538)
Games in Android Showcase (132)
games submitted by our members
Games in WIP (600)
games currently in development
News: Read the Java Gaming Resources, or peek at the official Java tutorials
 
    Home     Help   Search   Login   Register   
Pages: [1]
  ignore  |  Print  
  Creating my own 'pak' file creator  (Read 4107 times)
0 Members and 1 Guest are viewing this topic.
Offline Gorgorath

Junior Devvie




Java games rock!


« Posted 2006-11-17 08:24:38 »

I want to write my own pak file creator, i've searched the internet for virtual file systems and found truezip, while truezip will fullfill my needs there is one big drawback, it stores zip files up to 4 GB whereas my files tend to be a factor 10 larger. But since these files are stored in a way like this /textures/...,/pointclouds/... etcetc.
I'm wondering how difficult it can be to wrap this files in a nice pak file and browse inside this file as if it were a normal file.

any pointers?

Paul
Offline darkprophet

Senior Devvie




Go Go Gadget Arms


« Reply #1 - Posted 2006-11-17 10:13:03 »

Whats the need to create a pak file? The reason C/C++ people make them is because they dont have jars...

Friends don't let friends make MMORPGs.

Blog | Volatile-Engine
Offline Evil-Devil

Senior Devvie


Medals: 2


Fir Tree Master


« Reply #2 - Posted 2006-11-17 10:22:04 »

Who the hell would store ~40GB  of data in ONE file?
Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline Gorgorath

Junior Devvie




Java games rock!


« Reply #3 - Posted 2006-11-17 10:49:57 »

Who the hell would store ~40GB  of data in ONE file?
Beside polygons, models, textures, i'm also storing point clouds, where a single point of such an cloud consist of an
(x, y z ) (r, g, b) ( u,v ) and (normal.x, normal.y, normal.z) since this data is coming from a laser scanner it are billions of points(which are then divided in an octree)
so 40 gig is not that much
Offline Evil-Devil

Senior Devvie


Medals: 2


Fir Tree Master


« Reply #4 - Posted 2006-11-17 11:04:01 »

Wouldn't  it better to split the data? I assume you don't need all the data at once or all the time.
Beside the fact only linux/unix with newest fileformats support such big files. NTFS for windows only allows 4GB? files.
And if compressing your data, if not allready done, will decrease the overall size.

But for the topic, if your not happy with truezip or any other zip format, use your own.
You could use the Zip/GZip Out/In Streams of the java zip package to compress individual files and store them in the fileformat of your choice. Just build a filetable Wink
Offline tusaki

Junior Devvie


Medals: 1


In a mad world only the mad are sane.


« Reply #5 - Posted 2006-11-17 11:20:32 »

Who the hell would store ~40GB  of data in ONE file?
Beside polygons, models, textures, i'm also storing point clouds, where a single point of such an cloud consist of an
(x, y z ) (r, g, b) ( u,v ) and (normal.x, normal.y, normal.z) since this data is coming from a laser scanner it are billions of points(which are then divided in an octree)
so 40 gig is not that much

Perhaps it would make sense in this case to use a database instead of a file-structure?
Offline Gorgorath

Junior Devvie




Java games rock!


« Reply #6 - Posted 2006-11-17 11:21:24 »

i already store the leafnodes as individual files, so they would never reach the 4 gig limit
Offline Gorgorath

Junior Devvie




Java games rock!


« Reply #7 - Posted 2006-11-17 11:23:19 »

Who the hell would store ~40GB  of data in ONE file?
Beside polygons, models, textures, i'm also storing point clouds, where a single point of such an cloud consist of an
(x, y z ) (r, g, b) ( u,v ) and (normal.x, normal.y, normal.z) since this data is coming from a laser scanner it are billions of points(which are then divided in an octree)
so 40 gig is not that much

Perhaps it would make sense in this case to use a database instead of a file-structure?

How should i achieve this, right now the algorithm to load files goes like this -> determine visible nodes -> load files -> memory map them -> render
but i have no idea how to do it in say SQL or with other databases
Offline mabraham

Junior Devvie





« Reply #8 - Posted 2006-11-18 18:30:32 »

Wouldn't  it better to split the data? I assume you don't need all the data at once or all the time.
Beside the fact only linux/unix with newest fileformats support such big files. NTFS for windows only allows 4GB? files.
That is plain wrong, NTFS certainly does support files >4G.

FYI - http://en.wikipedia.org/wiki/NTFS
Offline Evil-Devil

Senior Devvie


Medals: 2


Fir Tree Master


« Reply #9 - Posted 2006-11-20 11:35:08 »

Wouldn't  it better to split the data? I assume you don't need all the data at once or all the time.
Beside the fact only linux/unix with newest fileformats support such big files. NTFS for windows only allows 4GB? files.
That is plain wrong, NTFS certainly does support files >4G.

FYI - http://en.wikipedia.org/wiki/NTFS
Thx, but haven't you seen my questionmark behind the 4GB ? I was't that sure about it if it really ends with 4GB. Non the less, 4GB is quite big for one file on a personal computer ...
Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline mabraham

Junior Devvie





« Reply #10 - Posted 2006-11-24 10:56:16 »

Thx, but haven't you seen my questionmark behind the 4GB ?
Oh in that case please accept my sincerest apologies, I misinterpreted your posting as a statement!
Smiley
Pages: [1]
  ignore  |  Print  
 
 
You cannot reply to this message, because it is very, very old.

 

Add your game by posting it in the WIP section,
or publish it in Showcase.

The first screenshot will be displayed as a thumbnail.

rwatson462 (28 views)
2014-12-15 09:26:44

Mr.CodeIt (19 views)
2014-12-14 19:50:38

BurntPizza (37 views)
2014-12-09 22:41:13

BurntPizza (73 views)
2014-12-08 04:46:31

JscottyBieshaar (34 views)
2014-12-05 12:39:02

SHC (47 views)
2014-12-03 16:27:13

CopyableCougar4 (42 views)
2014-11-29 21:32:03

toopeicgaming1999 (110 views)
2014-11-26 15:22:04

toopeicgaming1999 (96 views)
2014-11-26 15:20:36

toopeicgaming1999 (29 views)
2014-11-26 15:20:08
Understanding relations between setOrigin, setScale and setPosition in libGdx
by mbabuskov
2014-10-09 22:35:00

Definite guide to supporting multiple device resolutions on Android (2014)
by mbabuskov
2014-10-02 22:36:02

List of Learning Resources
by Longor1996
2014-08-16 10:40:00

List of Learning Resources
by SilverTiger
2014-08-05 19:33:27

Resources for WIP games
by CogWheelz
2014-08-01 16:20:17

Resources for WIP games
by CogWheelz
2014-08-01 16:19:50

List of Learning Resources
by SilverTiger
2014-07-31 16:29:50

List of Learning Resources
by SilverTiger
2014-07-31 16:26:06
java-gaming.org is not responsible for the content posted by its members, including references to external websites, and other references that may or may not have a relation with our primarily gaming and game production oriented community. inquiries and complaints can be sent via email to the info‑account of the company managing the website of java‑gaming.org
Powered by MySQL Powered by PHP Powered by SMF 1.1.18 | SMF © 2013, Simple Machines | Managed by Enhanced Four Valid XHTML 1.0! Valid CSS!