You can increase the VM arguments, on %MD_PUBLISHER_INSTALL_DIR%\publisher.ini, like:
The values to set depend on the specifications of the system you are working on. If this is not enough, you could try to increase again the Xmx value.
If during your work the out of memory error dialog box appears, change the Java Heap size and the MaxPermSize directly in this dialog box.
In the Xmx field change the number of heap size to bigger heap size in megabytes. In the XX:MaxPermSize field you can increase the MaxPermSize.
You can also change the java heap size or MaxPermSize in the
If you have this kind of error, it means that there is a compatibility issue between Java, Rhapsody and the Publisher.