R: [xml] very large XML docs

Date view Thread view Subject view Author view

From: Andrea LUCIANO (andrea.luciano@icteam.it)
Date: Thu Oct 19 2000 - 04:33:04 EDT


I don't know and can't imagine your requirements, but just one question: is
it really necessary in your project to store a so long data stream in a tag?
Sometime it's better to use a property that specify a media reference that
provides data stream (i.e. a link to a file on your file system).

Bye,
A.L.

----- Original Message -----
From: F. David Sacerdoti <fds@cs.ucsd.edu>
To: <xml@xmlsoft.org>
Sent: Wednesday, October 18, 2000 9:53 PM
Subject: [xml] very large XML docs

>
>
> I am using libxml for a scientific library project here at UCSD in
> conjunction with the San Diego Supercomputing Center. The library will
> be running on supercomputer clusters (Blue Horizon), and is used in very
> large calculations.
>
> I have a question about dealing with very large documents. Since I may
> be creating tags with several hundred megabytes of data in them, I would
> like to stream the xml doc to disk as it is created. This would allow me
> to use a limited buffer size for these very large tags.
>
> I have seen xmlOutputBufferCreateFile() which can be used with
> xmlOutputBufferWrite() to write a fixed length buffer to disk, but is it
> true that the entire xml doc must be built in memory before any of it
> can be written to disk?
>
> Would it be possible to write a partially created xml tree to disk,
> allowing me to free some memory buffers, and then go on to compute and
> write the rest of the tree?
>
> Thank you,
> David Sacerdoti
>
> ----
> Message from the list xml@rpmfind.net
> Archived at : http://xmlsoft.org/messages/
> to unsubscribe: echo "unsubscribe xml" | mail majordomo@rpmfind.net
>

----
Message from the list xml@rpmfind.net
Archived at : http://xmlsoft.org/messages/
to unsubscribe: echo "unsubscribe xml" | mail  majordomo@rpmfind.net


Date view Thread view Subject view Author view

This archive was generated by hypermail 2b29 : Thu Oct 19 2000 - 04:45:08 EDT