Building Dr. Memory from sources on Ubuntu x86_64

[derekbruening]

From [email protected] on June 11, 2010 11:35:42

$ ctest -S tests/runsuite.cmake
CMake Error at tests/runsuite.cmake:128 (message):
cannot find DynamoRIO VMKERNEL build at
/home/timurrrr/drmemory/SVN/trunk/tests/../../../exports_vmk/cmake
Error in read script: /home/timurrrr/drmemory/SVN/trunk/tests/runsuite.cmake

I've applied the following patch to do without VMK:
Index: tests/runsuite.cmake

--- tests/runsuite.cmake ( revision 16 )
+++ tests/runsuite.cmake (working copy)
@@ -123,11 +123,11 @@
endif (NOT EXISTS "${DR_path}")
endif (NOT arg_vmk_only)

-if (UNIX)

• if (NOT EXISTS "${DRvmk_path}")
• message(FATAL_ERROR "cannot find DynamoRIO VMKERNEL build at ${DRvmk_path}")
• endif (NOT EXISTS "${DRvmk_path}")
  -endif (UNIX)
  +#if (UNIX)
  +# if (NOT EXISTS "${DRvmk_path}")
  +# message(FATAL_ERROR "cannot find DynamoRIO VMKERNEL build at ${DRvmk_path}")
  +# endif (NOT EXISTS "${DRvmk_path}")
  +#endif (UNIX)

allow setting the base cache variables via an include file

set(base_cache "")
@@ -368,18 +368,18 @@
" ON) # only run release tests for long suite
endif (NOT arg_vmk_only)
if (UNIX)

• testbuild("${name}-vmk-debug-32" OFF "

•  ${tool}
  

•  DynamoRIO_DIR:PATH=${DRvmk_path}
  

•  CMAKE_BUILD_TYPE:STRING=Debug
  

•  VMKERNEL:BOOL=ON
  

•  " OFF)
  

• testbuild("${name}-vmk-release-32" OFF "

•  ${tool}
  

•  DynamoRIO_DIR:PATH=${DRvmk_path}
  

•  CMAKE_BUILD_TYPE:STRING=Release
  

•  VMKERNEL:BOOL=ON
  

•  " ON) # only run release tests for long suite
  

• #testbuild("${name}-vmk-debug-32" OFF "

• ${tool}

• DynamoRIO_DIR:PATH=${DRvmk_path}

• CMAKE_BUILD_TYPE:STRING=Debug

• VMKERNEL:BOOL=ON

• " OFF)

• #testbuild("${name}-vmk-release-32" OFF "

• ${tool}

• DynamoRIO_DIR:PATH=${DRvmk_path}

• CMAKE_BUILD_TYPE:STRING=Release

• VMKERNEL:BOOL=ON

• " ON) # only run release tests for long suite

else (UNIX)
if ("${tool}" MATCHES "MEMORY")
# No online symbol support for cygwin yet so using separate build

Then
$ ctest -S tests/runsuite.cmake
Error(s) when building project
No tests were found!!!

RESULTS

drheapstat-debug-32: **** pre-build configure errors ****
drheapstat-release-32: **** pre-build configure errors ****
drmemory-debug-32: **** 50 build errors ****
/.../trunk/drmemory/syscall_linux.c:50:59: error: asm-i386/stat.h: No such file or directory
/.../trunk/drmemory/syscall_linux.c:78:21: error: asm/ipc.h: No such file or directory
/.../trunk/drmemory/syscall_linux.c:116:29: error: linux/umsdos_fs.h: No such file or directory
/.../trunk/drmemory/syscall_linux.c:251: error: invalid application of ‘sizeof’ to incomplete type ‘struct __old_kernel_stat’
<... and more errors ...>

Looks like Kostya had the same issues earlier but he doesn't remember whether he succeeded in building Dr.Memory for Linux: https://groups.google.com/group/drmemory-users/browse_thread/thread/9769aadd7bb197b5?pli=1

Original issue: http://code.google.com/p/drmemory/issues/detail?id=6

[derekbruening]

From [email protected] on June 11, 2010 08:41:17

Looks like I've worked around the #include issues with the following patch:
Index: drmemory/syscall_linux.c

--- drmemory/syscall_linux.c ( revision 16 )
+++ drmemory/syscall_linux.c (working copy)
@@ -38,13 +38,11 @@
#define __USE_GNU 1

#include <sys/types.h>
-#if 0
+#if 1
/* FIXME PR 413981: need portable inclusion of these types:

• For Ubuntu 9.04 x64 this works:
  _/

  include <asm/stat.h>

  -# include <sys/ustat.h>
  -# include <sys/statfs.h>
  #else
  /_ What's needed on FC10 x64 _/

  include <asm-i386/stat.h> /_ struct __old_kernel_stat */

  @@ -75,7 +73,6 @@

  /* ipc /
  #include <sys/ipc.h>
  -#include <asm/ipc.h>
  #include <sys/sem.h>
  #include <sys/shm.h>
  #include <sys/msg.h>
  @@ -113,7 +110,7 @@
  #include <linux/route.h>
  #include <linux/if_arp.h>
  #include <linux/soundcard.h>
  -#include <linux/umsdos_fs.h>
  +#include <linux/msdos_fs.h>
  #include <linux/vt.h>
  #include <linux/ipmi.h> / PR 531644 */

==END=OF=PATCH==

[derekbruening]

From [email protected] on June 11, 2010 08:53:23

Now it fails with

drmemory-debug-32: **** 50 build errors ****
/.../trunk/drmemory/syscall_linux.c:329: error: invalid application of ‘sizeof’ to incomplete type ‘struct statfs’
/.../trunk/drmemory/syscall_linux.c:330: error: invalid application of ‘sizeof’ to incomplete type ‘struct statfs’
/.../trunk/drmemory/syscall_linux.c:1138: error: ‘MTIOCGETCONFIG’ undeclared (first use in this function)
/.../trunk/drmemory/syscall_linux.c:1138: error: (Each undeclared identifier is reported only once
/.../trunk/drmemory/syscall_linux.c:1138: error: for each function it appears in.)
/.../trunk/drmemory/syscall_linux.c:1138: error: invalid application of ‘sizeof’ to incomplete type ‘struct mtconfiginfo’
/.../trunk/drmemory/syscall_linux.c:1139: error: ‘MTIOCSETCONFIG’ undeclared (first use in this function)
<...>

[derekbruening]

From [email protected] on August 04, 2010 07:12:04

Labels: Component-Build

[derekbruening]

From [email protected] on August 20, 2010 07:37:24

Derek,
What version of Linux do you use? FC10?
I can create a VM with that version Linux and try to fix the build issues so Dr. Memory is buildable on (at least) that version of Linux + Ubuntu.

Cc: derek.bruening

[derekbruening]

From [email protected] on August 20, 2010 07:50:59

I'm using FC12 now, but building with gcc 4.1.2 and glibc-2.2.5-44 headers.

here are my notes on the issue:

[linux] portable inclusion of syscall types

on different platforms the header files needed for our very specific kernel
syscall arg struct types vary and it's going to be a pain to get it right
everywhere.

xref linux build broken on gcc 4.4

Since this is open-source it would be nice to support more recent gcc
versions so that external contributors can actually build and run the test
suite.

native gcc (4.4.3) on my FC12 box:
drmemory/syscall_linux.c:50:59: error: asm-i386/stat.h: No such file or directory
drmemory/syscall_linux.c:78:21: error: asm/ipc.h: No such file or directory
In file included from drmemory/syscall_linux.c:98:
/usr/include/linux/ext2_fs.h: In function ‘ext2_mask_flags’:
drmemory/syscall_linux.c:116:29: error: linux/umsdos_fs.h: No such file or directory
...

Probably the right approach is to use CMake to locate the header files for
each particular platform. If there are struct differences we'll have to
add that complexity to syscall_linux.c.

[derekbruening]

From [email protected] on August 20, 2010 08:01:26

FC12 -> x86 or x64_64?
Do you plan to upgrade to FC13?

[derekbruening]

From [email protected] on August 20, 2010 08:21:15

FC12 x86_64, though see above: what really matters is what gcc and include headers are used and mine are from a toolchain and not from FC12.

no, no plans to upgrade in immediate future, since very latest FC kernels often have problems w/ VMware Workstation

[derekbruening]

From [email protected] on November 30, 2010 12:17:39

Derek,
can you please try building DynamoRIO/DrMemory on Lucid x86_64?
I think we have the same environment now.

Also, can you please post the shell commands to build DR+DrM on Linux so I can try setting up a buildbot?

[derekbruening]

From [email protected] on December 02, 2010 09:03:45

with r99 Dr. Memory now builds on Lucid and FC12 x64

there are still 3 issues:

1. tests/loader fails for two reasons: issue uninit and unaddr in loader _dl_rtld_di_serinfo + _dl_make_stack_executable #79 , and b/c it uses hardcoded paths
2. tests/suppress contains hardcoded offsets
3. Dr. Heapstat requires Flex + Java to build

Owner: [email protected]
Cc: -derek.bruening [email protected]

[derekbruening]

From [email protected] on December 07, 2010 18:45:04

tests are fixed in r102 , r103 , r105 along with issue #80 I will write up instructions for Flex on a wiki page

resolving this issue

Status: Verified

[derekbruening]

From [email protected] on December 10, 2010 18:02:54

Issue 126 has been merged into this issue.