I have almost spent a day in trying out all the possibilities and by now I have no clue..

What I want to do
===========
When I connect to my linux server using vnc viewer I want to see xfce desktop

Operating system: GNU/Linux
I install xfce by doing "sudo yum groupinstall xfce"
then I made changes in the /.vnc/xstartup file to include startxfce4 &, but it is not working. Below is my xstartup file. Please help.

++++++++++++++++++
#!/bin/sh

vncconfig -iconic &
unset SESSION_MANAGER
unset DBUS_SESSION_BUS_ADDRESS
OS=`uname -s`
if [ $OS = 'Linux' ]; then
  case "$WINDOWMANAGER" in
    *gnome*)
      if [ -e /etc/SuSE-release ]; then
        PATH=$PATH:/opt/gnome/bin
        export PATH
        #startxfce4 &
      fi
      ;;
     #*)
     #exec /bin/sh /etc/xdg/xfce4/xinitrc
  esac
fi
if [ -x /etc/X11/xinit/xinitrc ]; then
  #startxfce4 &
  exec /etc/X11/xinit/xinitrc
fi
if [ -f /etc/X11/xinit/xinitrc ]; then
  #startxfce4 &
  exec sh /etc/X11/xinit/xinitrc
fi
[ -r $HOME/.Xresources ] && xrdb $HOME/.Xresources
xsetroot -solid grey

xterm -geometry 80x24+10+10 -ls -title "XFCE" &
startxfce4 &