listdir of non-existent paths segfaults (seems to be a hadoop/jvm bug)

[GoogleCodeExporter]

The following will crash the jvm, as long the as the path exists:

    fs = pyhdfs.connect(host, port)
    l = pyhdfs.listdir(fs, '/doesnotexist')

This really does not seem to be a bug in libpyhdfs, but I figured I'll file 
this ticket so anyone else looking for this problem sees this.

I have no idea how hadoop can trigger a jvm segfault.

This is the output:

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007ff0fadb0ee8, pid=29972, tid=140673005336304
#
# JRE version: 6.0_16-b01
# Java VM: Java HotSpot(TM) 64-Bit Server VM (14.2-b01 mixed mode linux-
amd64 )
# Problematic frame:
# V  [libjvm.so+0x3d4ee8]
#
# An error report file with more information is saved as:
# /home/tv/src/libpyhdfs.git/test/hs_err_pid29972.log
#
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
#

A sample logfile is attached.

Original issue reported on code.google.com by tommi.vi...@gmail.com on 3 Nov 2009 at 11:35

Attachments:

• hs_err_pid29972.log

[GoogleCodeExporter]

If you give a invalid `fs' argument, jvm will crash, too.
For example:
fs=23432432
pyhdfs.disconnect(fs)

In pyhdfs.listdir, Maybe we can check the `path' argument to ensure it's type 
before
calling hdfsListDirectory?  Thoung I think the client application using this lib
should make sure the arguments are valid.

Original comment by kofreestyler on 4 Nov 2009 at 2:16

[GoogleCodeExporter]

Original comment by kofreestyler on 4 Nov 2009 at 2:24

• Changed state: Accepted