I just unmerge (emerge -C) xfree and emerge xorg-x11. As I read the
message it stated that unless xorg.conf is found it will read XF86Config,
which is fine with me and works

so I:
cp /etc/X11/XF86Config-4 /etc/X11/xorg.conf
the X tries to start i.e. I see nvidia then fails
the log says
Fatal server error:
could not open default font 'fixed'
rm /etc/X11/xorg.conf
it starts fine
I didn't reboot yet but i don't think that might have influence.
How come?