Hi !
Featured games (90)
games approved by the League of Dukes
Games in Showcase (753)
Games in Android Showcase (228)
games submitted by our members
Games in WIP (842)
games currently in development
News: Read the Java Gaming Resources, or peek at the official Java tutorials
    Home     Help   Search   Login   Register   
Pages: [1]
  ignore  |  Print  
  efficient Random Writes  (Read 1703 times)
0 Members and 1 Guest are viewing this topic.
Offline moogie

JGO Ninja

Medals: 16
Projects: 6
Exp: 10 years

Java games rock!

« Posted 2005-08-03 00:56:54 »

I have decided to try my hand at making a simple peered file transfer system based on UDP.

This restricts the size of the blocks of the file being transferred  to 63k so that it will fit in a UDP packet with some control variables.

Since the reading of blocks from one client to send to another client will be random (to attempt to evenly spread the blocks and thus work load) there is little i can do improve the random IO block reads. However this does not seem to be the major bottleneck as i achieve over 5meg a second of random blocks when using one source. With more more sources this throughput increases.

The problem is with the random writes of the blocks received... how can i speed up the random writes?

currently i can only think of two ways, both with disadvantages:

1. queued write

2. post transfer sorting

With the queued write there is to be a thread who polls a queue and takes the first block from the queue and writes it to the local disk. At the same time, blocks from one or multiple sources are adding to the end of the queue.

This as the advantage of not slowing down the throughput of the incoming blocks for the most part, however depending on the maximum size of the queue it will reach a point where it will have to wait until a block is written before accepting more blocks to the queue.

The post transfer sorting will allow the maximum throughput and will never have the situation of artificially pausing recieving the blocks as it will be sequentially writing the blocks as they are recieved most likely in a buffered fashion. In addition to the writing of the blocks, the actual positions of the blocks are also recorded. This is so that after the transfer is finished the file can be reconstructed using the positions stored.

The disadvantage for this method is two fold: it requires more disc space as it needs to store the blocks and the positions and it has to spend time reconstructing the file.

Is there a better way? of if not, which is most commonly used?

Java4k RIP 2014
Pages: [1]
  ignore  |  Print  

nelsongames (13 views)
2018-04-24 18:15:36

nelsongames (11 views)
2018-04-24 18:14:32

ivj94 (586 views)
2018-03-24 14:47:39

ivj94 (49 views)
2018-03-24 14:46:31

ivj94 (383 views)
2018-03-24 14:43:53

Solater (63 views)
2018-03-17 05:04:08

nelsongames (110 views)
2018-03-05 17:56:34

Gornova (159 views)
2018-03-02 22:15:33

buddyBro (707 views)
2018-02-28 16:59:18

buddyBro (93 views)
2018-02-28 16:45:17
Java Gaming Resources
by philfrei
2017-12-05 19:38:37

Java Gaming Resources
by philfrei
2017-12-05 19:37:39

Java Gaming Resources
by philfrei
2017-12-05 19:36:10

Java Gaming Resources
by philfrei
2017-12-05 19:33:10

List of Learning Resources
by elect
2017-03-13 14:05:44

List of Learning Resources
by elect
2017-03-13 14:04:45

SF/X Libraries
by philfrei
2017-03-02 08:45:19

SF/X Libraries
by philfrei
2017-03-02 08:44:05 is not responsible for the content posted by its members, including references to external websites, and other references that may or may not have a relation with our primarily gaming and game production oriented community. inquiries and complaints can be sent via email to the info‑account of the company managing the website of java‑
Powered by MySQL Powered by PHP Powered by SMF 1.1.18 | SMF © 2013, Simple Machines | Managed by Enhanced Four Valid XHTML 1.0! Valid CSS!