Help Needed With Maya & Fc5

[keop]

hello,

i need some help with loading maya into my linux.
when trying to run, it's loads (got spalsh), when drawing/painting/refreshing main window it crashes with error of:

QUOTE
maya encountered a fatal error

Signal: 11 (Unknown Signal)
Fatal Error. Attempting to save in /usr/tmp/********.ma

read on some thread here it would help to get some more info, using gdb, so after used this tip (maya -d gdb r ) i have this info displayed:
MAYA_DEBUG_NO_SIGNAL_HANDLERS is set.

CODE
...
Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread -1208330528 (LWP 2967)]
0x02719991 in GLFunctionTable::populate () from /usr/aw/maya/lib/libHWGL.so
(gdb) bt
#0  0x02719991 in GLFunctionTable::populate () from /usr/aw/maya/lib/libHWGL.so
#1  0x0272a19d in GLStartupContext::GLStartupContext ()
   from /usr/aw/maya/lib/libHWGL.so
#2  0x02794100 in OGLRenderBackEnd::createResourceContext ()
   from /usr/aw/maya/lib/libHWRender.so
#3  0x06ff0ae8 in T3dView::updateViewingParameters ()
   from /usr/aw/maya/lib/libDataModel.so
#4  0x06fd0a32 in TidleRefreshCmd::refresh ()
   from /usr/aw/maya/lib/libDataModel.so
#5  0x06fcc6c5 in TtoolRefresh::refreshFast ()
   from /usr/aw/maya/lib/libDataModel.so
#6  0x06ff1819 in T3dView::doUpdate () from /usr/aw/maya/lib/libDataModel.so
#7  0x04472ab9 in Tresponder::handleEvent ()
   from /usr/aw/maya/lib/libExtensionLayer.so
#8  0x00ca15f2 in T3dPort::exposeXtCB () from /usr/aw/maya/lib/lib3dGraphics.so
#9  0x03ab4a63 in XtCallCallbackList () from /usr/lib/libXt.so.6
#10 0x00ca29d6 in non-virtual thunk to T3dPort::~T3dPort$delete() ()
   from /usr/aw/maya/lib/lib3dGraphics.so
#11 0x0af2dce0 in ?? ()
#12 0x0af2ab40 in ?? ()
#13 0xbf805f28 in ?? ()
#14 0x0501b133 in XUnionRectWithRegion () from /usr/lib/libX11.so.6
#15 0x03ac27c3 in XtAddExposureToRegion () from /usr/lib/libXt.so.6
---Type to continue, or q to quit---
#16 0x03ac2d2a in XtDispatchEventToWidget () from /usr/lib/libXt.so.6
#17 0x03ac3378 in _XtSendFocusEvent () from /usr/lib/libXt.so.6
#18 0x03ac2347 in XtDispatchEvent () from /usr/lib/libXt.so.6
#19 0x0447021e in TeventHandler::analyzeEvent ()
   from /usr/aw/maya/lib/libExtensionLayer.so
#20 0x0447039a in TeventHandler::processXEvent ()
   from /usr/aw/maya/lib/libExtensionLayer.so
#21 0x0447063a in TunixEventHandler::handleEvents ()
   from /usr/aw/maya/lib/libExtensionLayer.so
#22 0x044679ae in TGUIapplication::run ()
   from /usr/aw/maya/lib/libExtensionLayer.so
#23 0x0446553c in Tapplication::start ()
   from /usr/aw/maya/lib/libExtensionLayer.so
#24 0x080587ca in appmain ()
#25 0x08067c09 in main ()

liked said, i use FC5, got nvidia 3d card, got driver/openGL installed (not from nvidia site, i used a support thread @ fedora's forum to enable 3d support).
is there any known issues for FC5, or packages required to overcome "signal 11" ??
(or whats the nvidia driver version marked as stable enough to use)

thx in advanced.

[mandarin]

The stack trace would indicate that the initialization of the OpenGL hardware renderer didn't complete.

What version of Maya ? 8 or something earlier. If 7 then copy libGLu.so from CD to the Maya lib directory

What graphic card/driver are you using ?
24bit visuals ?
check that Cg/Ashli plugins are not being autoloaded

run glxinfo and see what visuals, renderer is being used. direct/indirect mesa/nvidia

should be similar to:

glxinfo
name of display: lnx-fc5:0.0
display: lnx-fc5:0 screen: 0
direct rendering: Yes
server glx vendor string: NVIDIA Corporation
server glx version string: 1.4
server glx extensions:
GLX_EXT_visual_info, GLX_EXT_visual_rating, GLX_SGIX_fbconfig,
GLX_SGIX_pbuffer, GLX_SGI_video_sync, GLX_SGI_swap_control,
GLX_ARB_multisample, GLX_NV_float_buffer, GLX_ARB_fbconfig_float,
GLX_NV_swap_group
...
OpenGL vendor string: NVIDIA Corporation
OpenGL renderer string: Quadro FX 1400/PCI/SSE2
OpenGL version string: 2.0.2 NVIDIA 87.62
OpenGL extensions:
...
visual x bf lv rg d st colorbuffer ax dp st accumbuffer ms cav
id dep cl sp sz l ci b ro r g b a bf th cl r g b a ns b eat

---

0x21 24 tc 0 32 0 r y . 8 8 8 0 4 24 8 16 16 16 16 0 0 None
0x22 24 dc 0 32 0 r y . 8 8 8 0 4 24 8 16 16 16 16 0 0 None
0x25 24 tc 0 32 0 r y . 8 8 8 8 4 24 8 16 16 16 16 0 0 None
...
0x7b 8 pc 1 8 1 c y . 0 0 0 0 4 0 0 0 0 0 0 0 0 None
0x7c 8 pc 0 8 1 c y . 0 0 0 0 4 0 0 0 0 0 0 0 0 None
0x7d 8 pc 1 8 1 c . . 0 0 0 0 4 0 0 0 0 0 0 0 0 None
0x7e 8 pc 0 8 1 c . . 0 0 0 0 4 0 0 0 0 0 0 0 0 None

ou have Quadro FX card, have you enable the colour overlay planes > option CIOverlay

[scott-thomas]

I have the same problem (FC5 Maya 8 Quadro 750 XGL), it's becoming quite frustrating.

I've tried what cobrana had suggested;
mv /usr/aw/maya/libgcc_s.so.1 /tmp
mv /usr/aw/maya/libstdc++.so.5.0.6 /tmp
ln -s /lib/libgcc_s.so.1 /usr/aw/maya/lib/libgcc_s.so.1
ln -s /usr/lib/libstdc++.so.5.0.7 /usr/aw/maya//lib/libstdc++.so.5.0.6
ldconfig

but that didn't help.

I am using the drivers provided by livna and glxinfo reports the following:

CODE
name of display: :0.0
display: :0  screen: 0
direct rendering: Yes
server glx vendor string: NVIDIA Corporation
server glx version string: 1.4
server glx extensions:
    GLX_EXT_visual_info, GLX_EXT_visual_rating, GLX_SGIX_fbconfig,
    GLX_SGIX_pbuffer, GLX_SGI_video_sync, GLX_SGI_swap_control,
    GLX_ARB_multisample, GLX_NV_swap_group
client glx vendor string: NVIDIA Corporation
client glx version string: 1.4
client glx extensions:
    GLX_ARB_get_proc_address, GLX_ARB_multisample, GLX_EXT_visual_info,
    GLX_EXT_visual_rating, GLX_EXT_import_context, GLX_SGI_video_sync,
    GLX_NV_swap_group, GLX_NV_video_out, GLX_SGIX_fbconfig, GLX_SGIX_pbuffer,
    GLX_SGI_swap_control, GLX_NV_float_buffer, GLX_ARB_fbconfig_float
GLX version: 1.3
GLX extensions:
    GLX_EXT_visual_info, GLX_EXT_visual_rating, GLX_SGIX_fbconfig,
    GLX_SGIX_pbuffer, GLX_SGI_video_sync, GLX_SGI_swap_control,
    GLX_ARB_multisample, GLX_NV_swap_group, GLX_ARB_get_proc_address
OpenGL vendor string: NVIDIA Corporation
OpenGL renderer string: Quadro4 750 XGL/AGP/SSE2
OpenGL version string: 1.5.6 NVIDIA 87.74
OpenGL extensions:
    GL_ARB_depth_texture, GL_ARB_imaging, GL_ARB_multisample,
    GL_ARB_multitexture, GL_ARB_occlusion_query, GL_ARB_pixel_buffer_object,
    GL_ARB_point_parameters, GL_ARB_point_sprite, GL_ARB_shadow,
    GL_ARB_shader_objects, GL_ARB_shading_language_100,
    GL_ARB_texture_border_clamp, GL_ARB_texture_compression,
    GL_ARB_texture_cube_map, GL_ARB_texture_env_add,
    GL_ARB_texture_env_combine, GL_ARB_texture_env_dot3,
    GL_ARB_texture_mirrored_repeat, GL_ARB_texture_rectangle,
    GL_ARB_transpose_matrix, GL_ARB_vertex_buffer_object,
    GL_ARB_vertex_program, GL_ARB_vertex_shader, GL_ARB_window_pos,
    GL_S3_s3tc, GL_EXT_texture_env_add, GL_EXT_abgr, GL_EXT_bgra,
    GL_EXT_blend_color, GL_EXT_blend_minmax, GL_EXT_blend_subtract,
    GL_EXT_compiled_vertex_array, GL_EXT_Cg_shader,
    GL_EXT_draw_range_elements, GL_EXT_fog_coord, GL_EXT_multi_draw_arrays,
    GL_EXT_packed_pixels, GL_EXT_paletted_texture, GL_EXT_pixel_buffer_object,
    GL_EXT_point_parameters, GL_EXT_rescale_normal, GL_EXT_secondary_color,
    GL_EXT_separate_specular_color, GL_EXT_shadow_funcs,
    GL_EXT_shared_texture_palette, GL_EXT_stencil_wrap, GL_EXT_texture3D,
    GL_EXT_texture_compression_s3tc, GL_EXT_texture_cube_map,
    GL_EXT_texture_edge_clamp, GL_EXT_texture_env_combine,
    GL_EXT_texture_env_dot3, GL_EXT_texture_filter_anisotropic,
    GL_EXT_texture_lod, GL_EXT_texture_lod_bias, GL_EXT_texture_object,
    GL_EXT_timer_query, GL_EXT_vertex_array, GL_HP_occlusion_test,
    GL_IBM_rasterpos_clip, GL_IBM_texture_mirrored_repeat,
    GL_KTX_buffer_region, GL_NV_blend_square, GL_NV_copy_depth_to_color,
    GL_NV_depth_clamp, GL_NV_fence, GL_NV_fog_distance,
    GL_NV_gpu_program_parameters, GL_NV_light_max_exponent,
    GL_NV_multisample_filter_hint, GL_NV_occlusion_query,
    GL_NV_packed_depth_stencil, GL_NV_pixel_data_range, GL_NV_point_sprite,
    GL_NV_register_combiners, GL_NV_register_combiners2,
    GL_NV_texgen_reflection, GL_NV_texture_compression_vtc,
    GL_NV_texture_env_combine4, GL_NV_texture_rectangle, GL_NV_texture_shader,
    GL_NV_texture_shader2, GL_NV_texture_shader3, GL_NV_vertex_array_range,
    GL_NV_vertex_array_range2, GL_NV_vertex_program, GL_NV_vertex_program1_1,
    GL_SGIS_generate_mipmap, GL_SGIS_multitexture, GL_SGIS_texture_lod,
    GL_SGIX_depth_texture, GL_SGIX_shadow, GL_SUN_slice_accum
glu version: 1.3
glu extensions:
    GLU_EXT_nurbs_tessellator, GLU_EXT_object_space_tess

   visual  x  bf lv rg d st colorbuffer ax dp st accumbuffer  ms  cav
id dep cl sp sz l  ci b ro  r  g  b  a bf th cl  r  g  b  a ns b eat

---

0x21 24 tc  0 32  0 r  y  .  8  8  8  0  4 24  8 16 16 16 16  0 0 None
0x22 24 dc  0 32  0 r  y  .  8  8  8  0  4 24  8 16 16 16 16  0 0 None
0x23 24 tc  0 32  0 r  y  .  8  8  8  8  4 24  8 16 16 16 16  0 0 None
0x24 24 tc  0 32  0 r  .  .  8  8  8  0  4 24  8 16 16 16 16  0 0 None
0x25 24 tc  0 32  0 r  .  .  8  8  8  8  4 24  8 16 16 16 16  0 0 None
0x26 24 tc  0 32  0 r  y  .  8  8  8  0  4 24  0 16 16 16 16  0 0 None
0x27 24 tc  0 32  0 r  y  .  8  8  8  8  4 24  0 16 16 16 16  0 0 None
0x28 24 tc  0 32  0 r  .  .  8  8  8  0  4 24  0 16 16 16 16  0 0 None
0x29 24 tc  0 32  0 r  .  .  8  8  8  8  4 24  0 16 16 16 16  0 0 None
0x2a 24 tc  0 32  0 r  y  .  8  8  8  0  4  0  0 16 16 16 16  0 0 None
0x2b 24 tc  0 32  0 r  y  .  8  8  8  8  4  0  0 16 16 16 16  0 0 None
0x2c 24 tc  0 32  0 r  .  .  8  8  8  0  4  0  0 16 16 16 16  0 0 None
0x2d 24 tc  0 32  0 r  .  .  8  8  8  8  4  0  0 16 16 16 16  0 0 None
0x2e 24 tc  0 32  0 r  y  .  8  8  8  0  4 24  0 16 16 16 16  2 1 Ncon
0x2f 24 tc  0 32  0 r  y  .  8  8  8  8  4 24  0 16 16 16 16  2 1 Ncon
0x30 24 tc  0 32  0 r  y  .  8  8  8  0  4 24  0 16 16 16 16  4 1 Ncon
0x31 24 tc  0 32  0 r  y  .  8  8  8  8  4 24  0 16 16 16 16  4 1 Ncon
0x32 24 tc  0 32  0 r  .  .  8  8  8  0  4 24  0 16 16 16 16  2 1 Ncon
0x33 24 tc  0 32  0 r  .  .  8  8  8  8  4 24  0 16 16 16 16  2 1 Ncon
0x34 24 tc  0 32  0 r  .  .  8  8  8  0  4 24  0 16 16 16 16  4 1 Ncon
0x35 24 tc  0 32  0 r  .  .  8  8  8  8  4 24  0 16 16 16 16  4 1 Ncon
0x36 24 tc  0 32  0 r  y  .  8  8  8  0  4 24  8 16 16 16 16  2 1 Ncon
0x37 24 tc  0 32  0 r  y  .  8  8  8  8  4 24  8 16 16 16 16  2 1 Ncon
0x38 24 tc  0 32  0 r  y  .  8  8  8  0  4 24  8 16 16 16 16  4 1 Ncon
0x39 24 tc  0 32  0 r  y  .  8  8  8  8  4 24  8 16 16 16 16  4 1 Ncon
0x3a 24 tc  0 32  0 r  .  .  8  8  8  0  4 24  8 16 16 16 16  2 1 Ncon
0x3b 24 tc  0 32  0 r  .  .  8  8  8  8  4 24  8 16 16 16 16  2 1 Ncon
0x3c 24 tc  0 32  0 r  .  .  8  8  8  0  4 24  8 16 16 16 16  4 1 Ncon
0x3d 24 tc  0 32  0 r  .  .  8  8  8  8  4 24  8 16 16 16 16  4 1 Ncon
0x3e 24 dc  0 32  0 r  y  .  8  8  8  8  4 24  8 16 16 16 16  0 0 None
0x3f 24 dc  0 32  0 r  .  .  8  8  8  0  4 24  8 16 16 16 16  0 0 None
0x40 24 dc  0 32  0 r  .  .  8  8  8  8  4 24  8 16 16 16 16  0 0 None
0x41 24 dc  0 32  0 r  y  .  8  8  8  0  4 24  0 16 16 16 16  0 0 None
0x42 24 dc  0 32  0 r  y  .  8  8  8  8  4 24  0 16 16 16 16  0 0 None
0x43 24 dc  0 32  0 r  .  .  8  8  8  0  4 24  0 16 16 16 16  0 0 None
0x44 24 dc  0 32  0 r  .  .  8  8  8  8  4 24  0 16 16 16 16  0 0 None
0x45 24 dc  0 32  0 r  y  .  8  8  8  0  4  0  0 16 16 16 16  0 0 None
0x46 24 dc  0 32  0 r  y  .  8  8  8  8  4  0  0 16 16 16 16  0 0 None
0x47 24 dc  0 32  0 r  .  .  8  8  8  0  4  0  0 16 16 16 16  0 0 None
0x48 24 dc  0 32  0 r  .  .  8  8  8  8  4  0  0 16 16 16 16  0 0 None
0x49 24 dc  0 32  0 r  y  .  8  8  8  0  4 24  0 16 16 16 16  2 1 Ncon
0x4a 24 dc  0 32  0 r  y  .  8  8  8  8  4 24  0 16 16 16 16  2 1 Ncon
0x4b 24 dc  0 32  0 r  y  .  8  8  8  0  4 24  0 16 16 16 16  4 1 Ncon
0x4c 24 dc  0 32  0 r  y  .  8  8  8  8  4 24  0 16 16 16 16  4 1 Ncon
0x4d 24 dc  0 32  0 r  .  .  8  8  8  0  4 24  0 16 16 16 16  2 1 Ncon
0x4e 24 dc  0 32  0 r  .  .  8  8  8  8  4 24  0 16 16 16 16  2 1 Ncon
0x4f 24 dc  0 32  0 r  .  .  8  8  8  0  4 24  0 16 16 16 16  4 1 Ncon
0x50 24 dc  0 32  0 r  .  .  8  8  8  8  4 24  0 16 16 16 16  4 1 Ncon
0x51 24 dc  0 32  0 r  y  .  8  8  8  0  4 24  8 16 16 16 16  2 1 Ncon
0x52 24 dc  0 32  0 r  y  .  8  8  8  8  4 24  8 16 16 16 16  2 1 Ncon
0x53 24 dc  0 32  0 r  y  .  8  8  8  0  4 24  8 16 16 16 16  4 1 Ncon
0x54 24 dc  0 32  0 r  y  .  8  8  8  8  4 24  8 16 16 16 16  4 1 Ncon
0x55 24 dc  0 32  0 r  .  .  8  8  8  0  4 24  8 16 16 16 16  2 1 Ncon
0x56 24 dc  0 32  0 r  .  .  8  8  8  8  4 24  8 16 16 16 16  2 1 Ncon
0x57 24 dc  0 32  0 r  .  .  8  8  8  0  4 24  8 16 16 16 16  4 1 Ncon
0x58 24 dc  0 32  0 r  .  .  8  8  8  8  4 24  8 16 16 16 16  4 1 Ncon

Anyone got any more suggestions ? :\

PS: This is what gdb reports when maya crashes:
Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread -1209128720 (LWP 4075)]
0x034d0991 in GLFunctionTable::populate () from /usr/aw/maya8.0/lib/libHWGL.so

[mandarin]

For Maya 8, you should not need to change any of the C++ libraries or libGLU.so

Maya 8 wasn't qual'd for the Quadro XGL750 card. You may want to turn on the hardware overlays on the card. in the xorg.conf file add in Option "CIOverlay" "On"

[scott-thomas]

ok, I'll try that, though the readme of the drivers says that only the FX cards require that setting. Anyways, I'll give it a try, thanks !

[jpdoc]

I'm also trying to get Maya 8 working.

I get this error when I tried to run Maya:

/usr/aw/maya8.0/bin/maya.bin: error while loading shared libraries: /usr/lib/nvidia/libGLcore.so.1: cannot restore segment prot after reloc: Permission denied

Then I also get this error:

Illegal instruction

Any ideas about these errors fellas?

I'm using Fedora Core 5.

[mandarin]

These errors are due to Maya shared libraries not being compatible with SELinux being enabled.
do a google search on selinux disable to find ways of disabling SELinux /etc/selinux/config

If you need to have SELinux enabled then you will have to modify the security context of the Maya libraries.

chcon command.

[jpdoc]

I typed this command:

$ ls --context /usr/aw/maya8.0/bin/maya.bin

and this came up:

-rwxr-xr-x root root system_u:object_r:lib_t /usr/aw/maya8.0/bin/maya.bin

As well, from this site: http://fedora.redhat.com/docs/selinux-faq-fc5/

I did a search (using Ctrl + F on the keyboard) for the error message

"error while loading shared libraries . . . . cannot restore segment prot after reloc: Permission Denied"

And it tells me the first hint usually solves it.

I'm not sure what the first hint is - I mean do they mean "execmod" (which my terminal says "command not found") is the first hint or . . .

# /usr/sbin/semanage fcontext -a -t textrel_shlib_t '/usr/lib/libavutil.so.49.0.0'
# /sbin/restorecon -v /usr/lib/libavutil.so.49.0.0

. . . Is the first hint?

---

I also did the search on Google as you recommended but haven't found anything I could understand about chcon for a beginner.

I've read something about types and domains which I'm not sure what it is either.

Further more, I typed:

chcon --help

giving me a list of options but I have no idea which option I should give to make the Maya run.

[b]CHCON(1) User Commands CHCON(1)

NAME
chcon - change security context

SYNOPSIS
chcon [OPTION]... CONTEXT FILE...
chcon [OPTION]... --reference=RFILE FILE...

DESCRIPTION
Change the security context of each FILE to CONTEXT.

   -c, --changes
          like verbose but report only when a change is made

   -h, --no-dereference
          affect symbolic links instead of any referenced file (available only on systems with lchown system
          call)

   -f, --silent, --quiet
          suppress most error messages

   -l, --range
          set range RANGE in the target security context

   --reference=RFILE
          use RFILE[/b]

[scott-thomas]

Switching on the overlay didn't help in my case btw. If anyone has more suggestions, please post them !

Would a different Linux distribution make a difference ? I am getting used to installing them again and again

[jpdoc]

By the way, after further research, I tried this command:

# chcon -t textrel_shlib_t /usr/lib/nvidia/libGLcore.so.1

and that still didn't fix the problem I keep getting that "error while loading shared library" message.

Not sure if that helps any but I tried it.

[jpdoc]

Warnold, I think it's something to do with my CPU.

Even when I disable SELinux, it keep displaying the second message - Illegal Instruction.

I think Maya 8 was built for a 2+ GHz processor.

Don't think my 1.2 GHz will be enough. I'll have to upgrade my computer to get it working I think.

[mandarin]

Maya 8 requires support of SSE instructions, Athon XP or higher, Intel P3 or higher

[jpdoc]

Yup, some guy said something like that too.

Guess I'll really need a new computer if I want to use Maya 8, thanks for trying to help Warnold.