How come the shadowmaps sometimes get a sharp edge when rendering, is thre some way I can fix this problem?
Here is an example of what i mean:
Bonjour wurp,
This is a common problem found in mental ray. I would call this a limitation. It is the same as in SI3D. There is not much you can do about it, but this:
Reduce the Softness of your Shadow Map. mental ray has a real hard time dealing with large Softness values, producing this kind of results on certain areas.
Use several lights with reduced Softness value to increase the shadow area instead of one source with a big Softness. I you put these lights close to each other, you will even be able to simulate an area light. I suggest you use the BankOfPointLights script you can find here:
http://www.aldis.org.uk/3DResources/Scripts.htm
Hope this helps
Salutations - Cheers
Bernard Lebel