SEO

Hi there,

I have started working on a new place where they have a lot of medical
data stored in relational databases they later exploit with
statistical software. The situation is a bit chaotic as they're using
a lot of local Access databases, some databases hosted in an old
version of Microsoft SQL Server and a lot of data in other non
relational files (SPSS, Excel, ...). I was hoping to impose a bit of
order and I started installing a current version of PostgreSQL to host
all the databases they're using.

I now have two problems:

1. I have to migrate all the data they currently have to the new
system, maybe making some transformations in the way.

2. They're continously receiving new data in heterogeneous formats and
I need some way to import this data in a easy way into the existing
databases.

Googling a bit I have discovered that what I probably need is an ETL
(extract, transform and load) tool, preferably open sourced and very
PostgreSQL friendly... does anybody on this list have experience with
such kind of tools? Would anybody recommend anything? Maybe I could
try another approach?

Thanks in advance, best regards
Jose

---------------------------(end of broadcast)---------------------------
TIP 6: explain analyze is your friend

On Wednesday 24 August 2005 03:50, Jose Gonzalez Gomez wrote:
> Googling a bit I have discovered that what I probably need is an ETL
> (extract, transform and load) tool, preferably open sourced and very
> PostgreSQL friendly... does anybody on this list have experience with
> such kind of tools? Would anybody recommend anything? Maybe I could
> try another approach?
>

You might want to take a look at kettle, which is part of the bizgres package.
I haven't used it but it seemed pretty flexible when I saw the demo at oscon,
and there certainly pg friendly.
http://www.bizgres.org/pages.php?pg=downloads
--
Robert Treat
Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL

---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faq

2005/8/24, Robert Treat <xzilla@users.sourceforge.net>:
> On Wednesday 24 August 2005 03:50, Jose Gonzalez Gomez wrote:
> > Googling a bit I have discovered that what I probably need is an ETL
> > (extract, transform and load) tool, preferably open sourced and very
> > PostgreSQL friendly... does anybody on this list have experience with
> > such kind of tools? Would anybody recommend anything? Maybe I could
> > try another approach?
> >
>
> You might want to take a look at kettle, which is part of the bizgres package.
> I haven't used it but it seemed pretty flexible when I saw the demo at oscon,
> and there certainly pg friendly.
> http://www.bizgres.org/pages.php?pg=downloads

I knew about that, but unfortunately there doesn't seem to be any
version for Windows (I develop in Windows ( ) and I neither have
find anywhere to download just the ketl tool instead of the whole
bizgres server... if I don't find anything else I may try to download
the Linux version and give it a try...

Thanks a lot, best regards
Jose

---------------------------(end of broadcast)---------------------------
TIP 4: Have you searched our list archives?

http://archives.postgresql.org

On Wed, Aug 24, 2005 at 09:50:06AM +0200, Jose Gonzalez Gomez wrote:
> Hi there,
>
> I have started working on a new place where they have a lot of medical
> data stored in relational databases they later exploit with
> statistical software. The situation is a bit chaotic as they're using
> a lot of local Access databases, some databases hosted in an old
> version of Microsoft SQL Server and a lot of data in other non
> relational files (SPSS, Excel, ...). I was hoping to impose a bit of
> order and I started installing a current version of PostgreSQL to host
> all the databases they're using.
>
> I now have two problems:
>
> 1. I have to migrate all the data they currently have to the new
> system, maybe making some transformations in the way.

I generally use Perl for these kinds of tasks. One way that makes
this process less manual is with DBI-Link

http://pgfoundry.org/projects/dbi-link/

Cheers,
D
--
David Fetter david@fetter.org http://fetter.org/
phone: +1 510 893 6100 mobile: +1 415 235 3778

Remember to vote!

---------------------------(end of broadcast)---------------------------
TIP 4: Have you searched our list archives?

http://archives.postgresql.org

On Aug 24, 2005, at 6:00 AM, Jose Gonzalez Gomez wrote:

> 2005/8/24, Robert Treat <xzilla@users.sourceforge.net>:
>
>> On Wednesday 24 August 2005 03:50, Jose Gonzalez Gomez wrote:
>>
>>> Googling a bit I have discovered that what I probably need is an ETL
>>> (extract, transform and load) tool, preferably open sourced and very
>>> PostgreSQL friendly... does anybody on this list have experience
>>> with
>>> such kind of tools? Would anybody recommend anything? Maybe I could
>>> try another approach?
>>>
>>>
>>
>> You might want to take a look at kettle, which is part of the
>> bizgres package.
>> I haven't used it but it seemed pretty flexible when I saw the
>> demo at oscon,
>> and there certainly pg friendly.
>> http://www.bizgres.org/pages.php?pg=downloads
>>
>
> I knew about that, but unfortunately there doesn't seem to be any
> version for Windows (I develop in Windows ( ) and I neither have
> find anywhere to download just the ketl tool instead of the whole
> bizgres server... if I don't find anything else I may try to download
> the Linux version and give it a try...

I'm pretty sure that the ketl tool is written in Java, so it should
run on Windows. Just download the source tarball, it's in there, you
don't have to install everything.

-bob


---------------------------(end of broadcast)---------------------------
TIP 2: Don't 'kill -9' the postmaster