Hi !
Featured games (90)
games approved by the League of Dukes
Games in Showcase (751)
Games in Android Showcase (227)
games submitted by our members
Games in WIP (838)
games currently in development
News: Read the Java Gaming Resources, or peek at the official Java tutorials
    Home     Help   Search   Login   Register   
Pages: [1]
  ignore  |  Print  
  Set BLOB through JDBC  (Read 2260 times)
0 Members and 1 Guest are viewing this topic.
Offline Marvin Fröhlich

Senior Devvie

May the 4th, be with you...

« Posted 2010-11-22 15:27:38 »


I want to set a blob field through JDBC and Java 1.5. I cannot currently update to Java 1.6.

The blob can be very large. Let's say, I have a 1 GB file. I cannot assume, that I have 1 GB free heap space. I want to directly stream the bytes into the blob. Hence I used setBinaryStream( 1, in, Integer.MAX_VALUE ) on the PreparedStatement. Unfortunately I have to pass the stream length to the method, because I am using Java 1.5. But this is stupid. I simply don't know the stream length. And I cannot buffer the whole stream content in memory just to get the size, since it could be too large. Passing Integer.MAX_VALUE works, but blows up the memory consumption. A have also tried -1, but this has the same effect as Integer.MAX_VALUE.

So my question is: How can I set a blob field value from an InputStream without buffering more than necessary in memory?

Thanks in advance,
Offline ryanm

Senior Devvie

Projects: 1
Exp: 15 years

Used to be bleb

« Reply #1 - Posted 2010-11-22 15:57:27 »

Where does the blob data come from?
Offline Marvin Fröhlich

Senior Devvie

May the 4th, be with you...

« Reply #2 - Posted 2010-11-22 16:07:37 »

In my case it is a file posted with a web page. But we could also say, it is an arbitrary InputStream, of which we of course don't know the size Wink.

Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline princec

« JGO Spiffy Duke »

Medals: 1009
Projects: 3
Exp: 20 years

Eh? Who? What? ... Me?

« Reply #3 - Posted 2010-11-22 17:48:02 »

You are SOL I'm afraid. If it's a file at least you can do file.length().

Also you will probably rather horribly find that many drivers buffer the whole stream into memory before sending it to the database. Why they do this f**kwittedness is beyond imagining, but suffice to say, I've come across this exact same problem. So you're probably shafted even if you use Java 6 too. Unless your JDBC drivers are canny.

Cas Smiley

Offline Riven

« JGO Overlord »

Medals: 1335
Projects: 4
Exp: 16 years

Hand over your head.

« Reply #4 - Posted 2010-11-22 21:34:22 »

Just split your data over multiple records and bind the results together using an non-unique index with some identifier and a counter (auto increment primary key), for your ORDER BY.

I bet that's reliable and fast across all database implementations.

Hi, appreciate more people! Σ ♥ = ¾
Learn how to award medals... and work your way up the social rankings!
Offline Marvin Fröhlich

Senior Devvie

May the 4th, be with you...

« Reply #5 - Posted 2010-11-23 10:07:22 »

Thanks a lot guys. Now I at least know for sure, that I am not blind Smiley.

Pages: [1]
  ignore  |  Print  

ivj94 (11 views)
2018-03-24 14:47:39

ivj94 (7 views)
2018-03-24 14:46:31

ivj94 (10 views)
2018-03-24 14:43:53

Solater (20 views)
2018-03-17 05:04:08

nelsongames (40 views)
2018-03-05 17:56:34

Gornova (44 views)
2018-03-02 22:15:33

buddyBro (176 views)
2018-02-28 16:59:18

buddyBro (64 views)
2018-02-28 16:45:17

xxMrPHDxx (470 views)
2017-12-31 17:17:51

xxMrPHDxx (142 views)
2017-12-31 17:15:51
Java Gaming Resources
by philfrei
2017-12-05 19:38:37

Java Gaming Resources
by philfrei
2017-12-05 19:37:39

Java Gaming Resources
by philfrei
2017-12-05 19:36:10

Java Gaming Resources
by philfrei
2017-12-05 19:33:10

List of Learning Resources
by elect
2017-03-13 14:05:44

List of Learning Resources
by elect
2017-03-13 14:04:45

SF/X Libraries
by philfrei
2017-03-02 08:45:19

SF/X Libraries
by philfrei
2017-03-02 08:44:05 is not responsible for the content posted by its members, including references to external websites, and other references that may or may not have a relation with our primarily gaming and game production oriented community. inquiries and complaints can be sent via email to the info‑account of the company managing the website of java‑
Powered by MySQL Powered by PHP Powered by SMF 1.1.18 | SMF © 2013, Simple Machines | Managed by Enhanced Four Valid XHTML 1.0! Valid CSS!