Unix Technical Forum

tar > 2GB file

This is a discussion on tar > 2GB file within the HP-UX Operating System forums, part of the Unix Operating Systems category; --> I have a HPUX 11.0, that hold a database on it. I want to tar and compress the backup ...


Go Back   Unix Technical Forum > Unix Operating Systems > HP-UX Operating System

Register FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 01-16-2008, 04:46 PM
LHradowy
 
Posts: n/a
Default tar > 2GB file

I have a HPUX 11.0, that hold a database on it. I want to tar and compress
the backup and send it to a offline backup storage. I get an error...
tar: Size of mydb/db4/hist_01.dbf > 2GB. Not dumped.

This is because of the tar I am using? Or the OS that I am using?
Will getting GNUtar fix this problem?

Thanks


Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 01-16-2008, 04:46 PM
Jim Hollenback
 
Posts: n/a
Default Re: tar > 2GB file

LHradowy (laura.hradowy@NOSPAM.mts.ca) wrote:
: I have a HPUX 11.0, that hold a database on it. I want to tar and compress
: the backup and send it to a offline backup storage. I get an error...
: tar: Size of mydb/db4/hist_01.dbf > 2GB. Not dumped.

: This is because of the tar I am using? Or the OS that I am using?
: Will getting GNUtar fix this problem?

From the tar manpage

Because of industry standards and interoperability goals, tar does not
support the archival of files larger than 2GB or files that have
user/group IDs greater than 60K. Files with user/group IDs greater
than 60K are archived and restored under the user/group ID of the
current process.

Guess it is the tar your using. I've heard that GNUtar does not have this
limitation. You should be able to get GNUtar from hpux.connect.org.uk or
one of the mirrors.

--
Jim Hollenback
jholly@cup.hp.com
my opinion.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 01-16-2008, 04:46 PM
Simon Waters
 
Posts: n/a
Default Re: tar > 2GB file

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

LHradowy wrote:
> I have a HPUX 11.0, that hold a database on it. I want to tar and compress
> the backup and send it to a offline backup storage. I get an error...
> tar: Size of mydb/db4/hist_01.dbf > 2GB. Not dumped.
>
> This is because of the tar I am using? Or the OS that I am using?
> Will getting GNUtar fix this problem?


I'm the kind of sad, old fashioned, Unix admin who never allows Oracle
data files to exceed 2GB (actually I usually use 1GB, which was an old
Oracle recommendation IIRC). Old habits die hard! Not sure I should
recommend this luddite approach but it has served me well, and avoids a
lot of stupid grief with 2GB file limits on back-ups, NFS, file systems
etc. For as long as you name them simply, it is as easy to do something
to files named 1,2,3,4, as it is to one large file, and even easier to
rearrange files to spread I/O over disks and the like.

You're getting plenty of advice that maybe you are pushing HP tar a
little hard, yes I think GNU tar or star may be good alternatives for
you, you should also consider HP-UX 'fbackup' depending on your
archiving needs, it probably has more "exposure" on HP-UX, and is
particularly good for backup to tape.

Whilst I don't like proprietary solutions you may find it fits your
needs better, especially if you can be confident you are only restoring
to HP-UX systems.

I think most "tars" now know to exclude the tar archive being created
(GNU and star do), although I'm not logging into the nearest HP-UX box
to find out if HP's does.

The 2Gb question is more than adequately answered before - www.deja.com
is your friend.
-----BEGIN PGP SIGNATURE-----
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQE/DAtxGFXfHI9FVgYRAtXhAJ42i1RM/3IEgbGh0Qx8iYyHI0XnjgCfcVla
xQbWxlO/F1ELn7PweXUz4kU=
=pmlO
-----END PGP SIGNATURE-----

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 01-16-2008, 04:46 PM
LHradowy
 
Posts: n/a
Default Re: tar > 2GB file


"Simon Waters" <Simon@wretched.demon.co.uk> wrote in message
news:beh226$fm1$1$8302bc10@news.demon.co.uk...
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> LHradowy wrote:
> > I have a HPUX 11.0, that hold a database on it. I want to tar and

compress
> > the backup and send it to a offline backup storage. I get an error...
> > tar: Size of mydb/db4/hist_01.dbf > 2GB. Not dumped.
> >
> > This is because of the tar I am using? Or the OS that I am using?
> > Will getting GNUtar fix this problem?

>
> I'm the kind of sad, old fashioned, Unix admin who never allows Oracle
> data files to exceed 2GB (actually I usually use 1GB, which was an old
> Oracle recommendation IIRC). Old habits die hard! Not sure I should
> recommend this luddite approach but it has served me well, and avoids a
> lot of stupid grief with 2GB file limits on back-ups, NFS, file systems
> etc. For as long as you name them simply, it is as easy to do something
> to files named 1,2,3,4, as it is to one large file, and even easier to
> rearrange files to spread I/O over disks and the like.
>
> You're getting plenty of advice that maybe you are pushing HP tar a
> little hard, yes I think GNU tar or star may be good alternatives for
> you, you should also consider HP-UX 'fbackup' depending on your
> archiving needs, it probably has more "exposure" on HP-UX, and is
> particularly good for backup to tape.
>
> Whilst I don't like proprietary solutions you may find it fits your
> needs better, especially if you can be confident you are only restoring
> to HP-UX systems.
>
> I think most "tars" now know to exclude the tar archive being created
> (GNU and star do), although I'm not logging into the nearest HP-UX box
> to find out if HP's does.
>
> The 2Gb question is more than adequately answered before - www.deja.com
> is your friend.


I figured out the problem, the problem had "nolargefiles" associated with
it. Tar works file with gzip.
Thanks for all the help...


Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 01-16-2008, 04:46 PM
Ian Springer
 
Posts: n/a
Default Re: tar > 2GB file

> >: This is because of the tar I am using? Or the OS that I am using?
> >: Will getting GNUtar fix this problem?
> >
> > From the tar manpage
> >
> > Because of industry standards and interoperability goals, tar does

not
> > support the archival of files larger than 2GB or files that have
> > user/group IDs greater than 60K. Files with user/group IDs greater
> > than 60K are archived and restored under the user/group ID of the
> > current process.
> >
> > Guess it is the tar your using. I've heard that GNUtar does not have

this
> > limitation. You should be able to get GNUtar from hpux.connect.org.uk or
> > one of the mirrors.

>
> If you are on 11.x then tar can handle up to 8GB files with a patch.
> I can't find the appropriate patch for 11.0, I thought it existed, but

here's the patch for 11i:
>
> PHCO_26423
>

http://www2.itrc.hp.com/service/patc...ux:800 :11:11

There's no equivalent patch for 11.0. Here's the blurb I plan on eventually
adding to the FAQ:

Because of industry standards and interoperability goals, neither tar, cpio,
pax, nor dump support the archival of files larger than 2GB. fbackup,
however, does support the archival of large files. However, the following
patches can be applied to 11.11 to allow the tar and pax commands to archive
files up to 8 GB in size:

o tar: PHCO_26423

o pax: PHCO_26422

Other options are:

o install GNU tar or dd, which have no filesize limit

o use the split command to split up the file into smaller chunks



Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 06:06 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.0
www.UnixAdminTalk.com