Java-Gaming.org Hi !
Featured games (83)
games approved by the League of Dukes
Games in Showcase (542)
Games in Android Showcase (133)
games submitted by our members
Games in WIP (606)
games currently in development
News: Read the Java Gaming Resources, or peek at the official Java tutorials
 
    Home     Help   Search   Login   Register   
Pages: [1]
  ignore  |  Print  
  efficient Random Writes  (Read 1182 times)
0 Members and 1 Guest are viewing this topic.
Offline moogie

JGO Ninja


Medals: 15
Projects: 6
Exp: 10 years


Java games rock!


« Posted 2005-08-03 00:56:54 »

I have decided to try my hand at making a simple peered file transfer system based on UDP.

This restricts the size of the blocks of the file being transferred  to 63k so that it will fit in a UDP packet with some control variables.

Since the reading of blocks from one client to send to another client will be random (to attempt to evenly spread the blocks and thus work load) there is little i can do improve the random IO block reads. However this does not seem to be the major bottleneck as i achieve over 5meg a second of random blocks when using one source. With more more sources this throughput increases.

The problem is with the random writes of the blocks received... how can i speed up the random writes?

currently i can only think of two ways, both with disadvantages:

1. queued write

2. post transfer sorting

With the queued write there is to be a thread who polls a queue and takes the first block from the queue and writes it to the local disk. At the same time, blocks from one or multiple sources are adding to the end of the queue.

This as the advantage of not slowing down the throughput of the incoming blocks for the most part, however depending on the maximum size of the queue it will reach a point where it will have to wait until a block is written before accepting more blocks to the queue.

The post transfer sorting will allow the maximum throughput and will never have the situation of artificially pausing recieving the blocks as it will be sequentially writing the blocks as they are recieved most likely in a buffered fashion. In addition to the writing of the blocks, the actual positions of the blocks are also recorded. This is so that after the transfer is finished the file can be reconstructed using the positions stored.

The disadvantage for this method is two fold: it requires more disc space as it needs to store the blocks and the positions and it has to spend time reconstructing the file.


Is there a better way? of if not, which is most commonly used?

Java4k RIP 2014
Pages: [1]
  ignore  |  Print  
 
 
You cannot reply to this message, because it is very, very old.

 

Add your game by posting it in the WIP section,
or publish it in Showcase.

The first screenshot will be displayed as a thumbnail.

Elsealabs (20 views)
2014-12-28 10:39:27

CopyableCougar4 (21 views)
2014-12-28 02:10:29

BurntPizza (25 views)
2014-12-27 22:38:51

Mr.CodeIt (15 views)
2014-12-27 04:03:04

TheDudeFromCI (20 views)
2014-12-27 02:14:49

Mr.CodeIt (26 views)
2014-12-23 03:34:11

rwatson462 (60 views)
2014-12-15 09:26:44

Mr.CodeIt (48 views)
2014-12-14 19:50:38

BurntPizza (98 views)
2014-12-09 22:41:13

BurntPizza (116 views)
2014-12-08 04:46:31
How do I start Java Game Development?
by gouessej
2014-12-27 19:41:21

Resources for WIP games
by kpars
2014-12-18 10:26:14

Understanding relations between setOrigin, setScale and setPosition in libGdx
by mbabuskov
2014-10-09 22:35:00

Definite guide to supporting multiple device resolutions on Android (2014)
by mbabuskov
2014-10-02 22:36:02

List of Learning Resources
by Longor1996
2014-08-16 10:40:00

List of Learning Resources
by SilverTiger
2014-08-05 19:33:27

Resources for WIP games
by CogWheelz
2014-08-01 16:20:17

Resources for WIP games
by CogWheelz
2014-08-01 16:19:50
java-gaming.org is not responsible for the content posted by its members, including references to external websites, and other references that may or may not have a relation with our primarily gaming and game production oriented community. inquiries and complaints can be sent via email to the info‑account of the company managing the website of java‑gaming.org
Powered by MySQL Powered by PHP Powered by SMF 1.1.18 | SMF © 2013, Simple Machines | Managed by Enhanced Four Valid XHTML 1.0! Valid CSS!