[5] Thread 6 (Thread 0x7ffd46afec40 (LWP 444067) "s3d.x"):
[5] #0 0x00007fffe636b187 in wait4 () from /lib64/libc.so.6
[5] #1 0x00007fffe62bd6cb in do_system () from /lib64/libc.so.6
[5] #2 0x00007fffe4290443 in gasneti_system_redirected () from /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/test_cases/0d_ammonia/../..//legion/language/install/lib64/librealm.so.26
[5] #3 0x00007fffe4290a88 in gasneti_bt_gdb () from /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/test_cases/0d_ammonia/../..//legion/language/install/lib64/librealm.so.26
[5] #4 0x00007fffe4294445 in gasneti_print_backtrace () from /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/test_cases/0d_ammonia/../..//legion/language/install/lib64/librealm.so.26
[5] #5 0x00007fffe29376b5 in gasneti_defaultSignalHandler () from /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/test_cases/0d_ammonia/../..//legion/language/install/lib64/librealm.so.26
[5] #6 <signal handler called>
[5] #7 Legion::Internal::Runtime::trace_free (info=..., this=0x5979fd0, size=101, elems=1) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/kernel/runtime.cc:10503
[5] #8 Legion::Internal::Runtime::trace_free (this=0x5979fd0, info=..., size=101, elems=1) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/kernel/runtime.cc:10493
[5] #9 0x00007fffe0fdcd95 in Legion::Internal::legion_free<void, Legion::Internal::BufferManager<Legion::Internal::SemanticInfo, (Legion::Internal::AllocationLifetime)4> > (ptr=0x0, size=<optimized out>) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/kernel/allocation.h:138
[5] #10 Legion::Internal::BufferManager<Legion::Internal::SemanticInfo, (Legion::Internal::AllocationLifetime)4>::clear (this=this@entry=0x7feff7f1bb70) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/utilities/buffers.h:114
[5] #11 0x00007fffe0fc7884 in Legion::Internal::BufferManager<Legion::Internal::SemanticInfo, (Legion::Internal::AllocationLifetime)4>::save_buffer (this=0x7feff7f1bb70, buffer=0x7fffe554d48e, s=6) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/utilities/buffers.h:128
[5] #12 Legion::Internal::BufferManager<Legion::Internal::SemanticInfo, (Legion::Internal::AllocationLifetime)4>::BufferManager (this=0x7feff7f1bb70, buffer=0x7fffe554d48e, s=6) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/utilities/buffers.h:37
[5] #13 Legion::Internal::SemanticInfo::SemanticInfo (this=0x7feff7f1bb70, buf=0x7fffe554d48e, s=6, is_mut=false) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/utilities/buffers.h:202
[5] #14 Legion::Internal::FieldSpaceNode::attach_semantic_information (this=0x7feff270a240, fid=101, tag=0, source=5, buffer=0x7fffe554d48e, size=6, is_mutable=false, local_only=true) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/nodes/field.cc:423
[5] #15 0x00007fffe0f37da1 in Legion::Internal::Runtime::attach_semantic_information (this=0x5979fd0, handle=..., fid=<optimized out>, fid@entry=101, tag=tag@entry=0, buffer=buffer@entry=0x7fffe554d48e, size=6, is_mutable=false) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/kernel/runtime.cc:3527
[5] #16 0x00007fffe0d28e21 in Legion::Runtime::attach_semantic_information (this=this@entry=0x5914470, handle=..., fid=fid@entry=101, tag=tag@entry=0, buffer=buffer@entry=0x7fffe554d48e, size=<optimized out>, is_mut=<optimized out>) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/api/runtime.cc:3918
[5] #17 0x00007fffe0d28fbe in Legion::Runtime::attach_name (this=0x5914470, handle=..., fid=101, name=0x7fffe554d48e "RHO_U", is_mutable=<optimized out>) at /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/legion/runtime/legion/api/runtime.cc:3979
[5] #18 0x00007fffe53816ca in $<main> () from /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/test_cases/0d_ammonia/../..//build/ammonia/libregent_tasks.so
[5] #19 0x00007fffe537ff18 in $__regent_task_main_primary () from /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/test_cases/0d_ammonia/../..//build/ammonia/libregent_tasks.so
[5] #20 0x00007fffe2aa9c1b in Realm::Task::execute_on_processor(Realm::Processor) () from /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/test_cases/0d_ammonia/../..//legion/language/install/lib64/librealm.so.26
[5] #21 0x00007fffe2aa9d16 in Realm::UserThreadTaskScheduler::execute_task(Realm::Task*) () from /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/test_cases/0d_ammonia/../..//legion/language/install/lib64/librealm.so.26
[5] #22 0x00007fffe2aa8122 in Realm::ThreadedTaskScheduler::scheduler_loop() () from /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/test_cases/0d_ammonia/../..//legion/language/install/lib64/librealm.so.26
[5] #23 0x00007fffe2ab41da in Realm::UserThread::uthread_entry() () from /lustre/orion/cmb103/scratch/seshuy/legion_s3d_subrank/test_cases/0d_ammonia/../..//legion/language/install/lib64/librealm.so.26
[5] #24 0x00007fffe62c32fe in ?? () from /lib64/libc.so.6
[5] #25 0x0000000000000000 in ?? ()
Building and running with TRACE_ALLOCATION seems to seg fault: