View Single Post

   
  #2 (permalink)  
Old 04-24-2008, 06:16 PM
Tom Lane
 
Posts: n/a
Default Re: [PERFORMANCE] Error loading 37G CSV file "invalid string enlargement request size 65536"

"Adonias Malosso" <malosso@gmail.com> writes:
> I´m running a copy for a 37G CSV and receiving the following error:
> "invalid string enlargement request size 65536"


AFAICS this would only happen if you've got an individual line of COPY
data exceeding 1GB. (PG versions later than 8.2 give a slightly more
helpful "out of memory" error in such a case.)

Most likely, that was not your intention, and the real problem is
incorrect quoting/escaping in the CSV file, causing COPY to think
that a large number of physical lines should be read as one logical line.

regards, tom lane

--
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance

Reply With Quote