This is a discussion on A little COPY speedup within the Pgsql Patches forums, part of the PostgreSQL category; --> "Simon Riggs" <simon@2ndquadrant.com> writes: > Feedback from someone else looking to the problem last year. IIRC there > was ...
| |||||||
| FAQ | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
| ||||
| "Simon Riggs" <simon@2ndquadrant.com> writes: > Feedback from someone else looking to the problem last year. IIRC there > was a feeling that if we didn't have to search for delimiters the COPY > FROM input parsing could be easier. Of what use is the above comment? You have to parse the input into fields somehow. "It can be arbitrarily fast ... if it doesn't have to get the right answer." regards, tom lane ---------------------------(end of broadcast)--------------------------- TIP 7: You can help support the PostgreSQL project by donating at http://www.postgresql.org/about/donate |
| |||
| On Fri, 2007-03-02 at 13:24 -0500, Tom Lane wrote: > "Simon Riggs" <simon@2ndquadrant.com> writes: > > Feedback from someone else looking to the problem last year. IIRC there > > was a feeling that if we didn't have to search for delimiters the COPY > > FROM input parsing could be easier. > > Of what use is the above comment? To me, none. Andrew asked me why I was vague - I explained. If I'd written it on IRC it would be wisdom, on email not at all. -- Simon Riggs EnterpriseDB http://www.enterprisedb.com ---------------------------(end of broadcast)--------------------------- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to majordomo@postgresql.org so that your message can get through to the mailing list cleanly |
| |||
| "Tom Lane" <tgl@sss.pgh.pa.us> writes: > "Simon Riggs" <simon@2ndquadrant.com> writes: >> Feedback from someone else looking to the problem last year. IIRC there >> was a feeling that if we didn't have to search for delimiters the COPY >> FROM input parsing could be easier. > > Of what use is the above comment? You have to parse the input into > fields somehow. Well those two requirements aren't inconsistent if you're using fixed-width input text files. Not that I'm enamoured of such file formats, just saying. The only file formats I ever wanted when I was doing this kind of stuff is tab separated, all the others (comma separated and (egads) *pipe* separated?!) are just disasters. -- Gregory Stark EnterpriseDB http://www.enterprisedb.com ---------------------------(end of broadcast)--------------------------- TIP 6: explain analyze is your friend |
| |||
| Gregory Stark <stark@enterprisedb.com> writes: > "Tom Lane" <tgl@sss.pgh.pa.us> writes: >> Of what use is the above comment? You have to parse the input into >> fields somehow. > Well those two requirements aren't inconsistent if you're using fixed-width > input text files. Not that I'm enamoured of such file formats, just saying. [ shrug... ] And of course, shoving a large quantity of padding spaces through the software has zero cost. regards, tom lane ---------------------------(end of broadcast)--------------------------- TIP 4: Have you searched our list archives? http://archives.postgresql.org |
| ||||
| Gregory Stark wrote: > > > The only file formats I ever wanted when I was doing this kind of stuff is tab > separated, all the others (comma separated and (egads) *pipe* separated?!) are > just disasters. > > Others of us have to operate in a world where we don't get to choose the format of data we receive. Having Postgres work with common data interchange formats is a Good Thing (tm). (I also have my own opinion of the disutility of tab as a separator.) cheers andrew ---------------------------(end of broadcast)--------------------------- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq |