Unix Technical Forum

Re: how to copy large data fast

This is a discussion on Re: how to copy large data fast within the Informix forums, part of the Database Server Software category; --> >From: "bozon" <curtis@crowson1.com> >I believe that you can unload to a named pipe with HPL and then load >from ...


Go Back   Unix Technical Forum > Database Server Software > Informix

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 04-20-2008, 03:59 PM
Ian Michael Gumby
 
Posts: n/a
Default Re: how to copy large data fast




>From: "bozon" <curtis@crowson1.com>
>I believe that you can unload to a named pipe with HPL and then load
>from that same named pipe. This is a very fast way of doing this. I
>think there might even be a program in the iiug repository that will
>set up the hpl job to do this so you don't have to go through the
>horrible HPL GUI. I think you can even create the jobs and run many in
>parallel.
>

Interesting.
Although you'd be using an SQL unload command to the named pipe and then use
the HPL to read from the named pipe.

In theory, you'd still be faster if you were to select and write the results
in to shareed memory, then have n readers from shared memory that write to a
tcp/ip socket on the remote machine and then each socket has x readers each
with a connection to the database.

I say in theory because the complexity of the code outweighs its value
unless you were just experimenting. You'd then be limited by hardware, and
the size of your network pipe.


But the question goes, how fast is fast enough?

Even unloading to a named pipe and then using HPL across a network may be
faster, you still have to consider the margin of speed vs the complexity.

Note: Some of the technology that I'm talking about could be found in the
RTL that may or may not still be marketed by IBM. (I think they discontinued
the Fin Foundation Bundle but not the individual products.)

But hey! what do I know? I'm paid to solve client's problems, not play and
develop tools that may or may not improve the quality of life for a DBA. ;-)

__________________________________________________ _______________
Communicate instantly! Use your Hotmail address to sign into Windows Live
Messenger now. http://get.live.com/messenger/overview

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 10:53 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.0
www.UnixAdminTalk.com