Build problem on branch rump-hypcall

[pscollins]

I'm looking into the rump-hypcall branch since it seems to be the most updated from master; I get the following error (I make clean'd and make mrproper'd after my previous failed builds), following the build instructions from the main lkl repo:

➜  libos-lkl-linux git:(rump-hypcall) cd tools/lkl 
➜  lkl git:(rump-hypcall) make RUMP_PREFIX=~/tcp-userspace/frankenlibc/librumpuser
make -C ../.. ARCH=lkl defconfig
make[1]: Entering directory `/usr/local/google/home/pscollins/tcp-userspace/libos-lkl-linux'
  HOSTCC  scripts/basic/fixdep
  HOSTCC  scripts/kconfig/conf.o
  SHIPPED scripts/kconfig/zconf.tab.c
  SHIPPED scripts/kconfig/zconf.lex.c
  SHIPPED scripts/kconfig/zconf.hash.c
  HOSTCC  scripts/kconfig/zconf.tab.o
  HOSTLD  scripts/kconfig/conf
scripts/kconfig/conf  --defconfig Kconfig
kernel/time/Kconfig:155:warning: range is invalid
./arch/lkl/defconfig:96:warning: override: reassigning to symbol NET
./arch/lkl/defconfig:97:warning: override: reassigning to symbol INET
./arch/lkl/defconfig:99:warning: override: reassigning to symbol NETDEVICES
./arch/lkl/defconfig:102:warning: override: reassigning to symbol VIRTIO_NET
./arch/lkl/defconfig:104:warning: override: reassigning to symbol EPOLL
#
# configuration written to .config
#
make[1]: Leaving directory `/usr/local/google/home/pscollins/tcp-userspace/libos-lkl-linux'
make -C ../.. ARCH=lkl  install INSTALL_PATH=/usr/local/google/home/pscollins/tcp-userspace/libos-lkl-linux/tools/lkl
make[1]: Entering directory `/usr/local/google/home/pscollins/tcp-userspace/libos-lkl-linux'
scripts/kconfig/conf  --silentoldconfig Kconfig
kernel/time/Kconfig:155:warning: range is invalid
make[1]: Leaving directory `/usr/local/google/home/pscollins/tcp-userspace/libos-lkl-linux'
make[1]: Entering directory `/usr/local/google/home/pscollins/tcp-userspace/libos-lkl-linux'
  CHK     include/config/kernel.release
  UPD     include/config/kernel.release
  WRAP    arch/lkl/include/generated/asm/atomic.h
  WRAP    arch/lkl/include/generated/asm/barrier.h
  WRAP    arch/lkl/include/generated/asm/bitops.h
  WRAP    arch/lkl/include/generated/asm/bug.h
  WRAP    arch/lkl/include/generated/asm/bugs.h
  WRAP    arch/lkl/include/generated/asm/cache.h
  WRAP    arch/lkl/include/generated/asm/cacheflush.h
  WRAP    arch/lkl/include/generated/asm/checksum.h
  WRAP    arch/lkl/include/generated/asm/cmpxchg-local.h
  WRAP    arch/lkl/include/generated/asm/cmpxchg.h
  WRAP    arch/lkl/include/generated/asm/cputime.h
  WRAP    arch/lkl/include/generated/asm/current.h
  WRAP    arch/lkl/include/generated/asm/delay.h
  WRAP    arch/lkl/include/generated/asm/device.h
  WRAP    arch/lkl/include/generated/asm/div64.h
  WRAP    arch/lkl/include/generated/asm/emergency-restart.h
  WRAP    arch/lkl/include/generated/asm/errno.h
  WRAP    arch/lkl/include/generated/asm/exec.h
  WRAP    arch/lkl/include/generated/asm/ftrace.h
  WRAP    arch/lkl/include/generated/asm/futex.h
  WRAP    arch/lkl/include/generated/asm/hardirq.h
  WRAP    arch/lkl/include/generated/asm/hw_irq.h
  WRAP    arch/lkl/include/generated/asm/ioctl.h
  WRAP    arch/lkl/include/generated/asm/ipcbuf.h
  WRAP    arch/lkl/include/generated/asm/irq_regs.h
  WRAP    arch/lkl/include/generated/asm/irqflags.h
  WRAP    arch/lkl/include/generated/asm/irq_work.h
  WRAP    arch/lkl/include/generated/asm/kdebug.h
  WRAP    arch/lkl/include/generated/asm/kmap_types.h
  WRAP    arch/lkl/include/generated/asm/linkage.h
  WRAP    arch/lkl/include/generated/asm/local.h
  WRAP    arch/lkl/include/generated/asm/local64.h
  WRAP    arch/lkl/include/generated/asm/mcs_spinlock.h
  WRAP    arch/lkl/include/generated/asm/mmu.h
  WRAP    arch/lkl/include/generated/asm/mmu_context.h
  WRAP    arch/lkl/include/generated/asm/module.h
  WRAP    arch/lkl/include/generated/asm/msgbuf.h
  WRAP    arch/lkl/include/generated/asm/page.h
  WRAP    arch/lkl/include/generated/asm/param.h
  WRAP    arch/lkl/include/generated/asm/parport.h
  WRAP    arch/lkl/include/generated/asm/pci_iomap.h
  WRAP    arch/lkl/include/generated/asm/percpu.h
  WRAP    arch/lkl/include/generated/asm/pgalloc.h
  WRAP    arch/lkl/include/generated/asm/poll.h
  WRAP    arch/lkl/include/generated/asm/preempt.h
  WRAP    arch/lkl/include/generated/asm/resource.h
  WRAP    arch/lkl/include/generated/asm/rwsem.h
  WRAP    arch/lkl/include/generated/asm/scatterlist.h
  WRAP    arch/lkl/include/generated/asm/seccomp.h
  WRAP    arch/lkl/include/generated/asm/sections.h
  WRAP    arch/lkl/include/generated/asm/segment.h
  WRAP    arch/lkl/include/generated/asm/sembuf.h
  WRAP    arch/lkl/include/generated/asm/serial.h
  WRAP    arch/lkl/include/generated/asm/shmbuf.h
  WRAP    arch/lkl/include/generated/asm/siginfo.h
  WRAP    arch/lkl/include/generated/asm/signal.h
  WRAP    arch/lkl/include/generated/asm/simd.h
  WRAP    arch/lkl/include/generated/asm/sizes.h
  WRAP    arch/lkl/include/generated/asm/socket.h
  WRAP    arch/lkl/include/generated/asm/sockios.h
  WRAP    arch/lkl/include/generated/asm/stat.h
  WRAP    arch/lkl/include/generated/asm/statfs.h
  WRAP    arch/lkl/include/generated/asm/string.h
  WRAP    arch/lkl/include/generated/asm/swab.h
  WRAP    arch/lkl/include/generated/asm/switch_to.h
  WRAP    arch/lkl/include/generated/asm/termbits.h
  WRAP    arch/lkl/include/generated/asm/termios.h
  WRAP    arch/lkl/include/generated/asm/time.h
  WRAP    arch/lkl/include/generated/asm/timex.h
  WRAP    arch/lkl/include/generated/asm/tlb.h
  WRAP    arch/lkl/include/generated/asm/tlbflush.h
  WRAP    arch/lkl/include/generated/asm/topology.h
  WRAP    arch/lkl/include/generated/asm/trace_clock.h
  WRAP    arch/lkl/include/generated/asm/unaligned.h
  WRAP    arch/lkl/include/generated/asm/vga.h
  WRAP    arch/lkl/include/generated/asm/word-at-a-time.h
  WRAP    arch/lkl/include/generated/asm/xor.h
  WRAP    arch/lkl/include/generated/uapi/asm/auxvec.h
  WRAP    arch/lkl/include/generated/uapi/asm/elf.h
  WRAP    arch/lkl/include/generated/uapi/asm/errno.h
  WRAP    arch/lkl/include/generated/uapi/asm/fcntl.h
  WRAP    arch/lkl/include/generated/uapi/asm/ioctl.h
  WRAP    arch/lkl/include/generated/uapi/asm/ioctls.h
  WRAP    arch/lkl/include/generated/uapi/asm/ipcbuf.h
  WRAP    arch/lkl/include/generated/uapi/asm/kvm_para.h
  WRAP    arch/lkl/include/generated/uapi/asm/mman.h
  WRAP    arch/lkl/include/generated/uapi/asm/msgbuf.h
  WRAP    arch/lkl/include/generated/uapi/asm/param.h
  WRAP    arch/lkl/include/generated/uapi/asm/poll.h
  WRAP    arch/lkl/include/generated/uapi/asm/posix_types.h
  WRAP    arch/lkl/include/generated/uapi/asm/ptrace.h
  WRAP    arch/lkl/include/generated/uapi/asm/resource.h
  WRAP    arch/lkl/include/generated/uapi/asm/sembuf.h
  WRAP    arch/lkl/include/generated/uapi/asm/setup.h
  WRAP    arch/lkl/include/generated/uapi/asm/shmbuf.h
  WRAP    arch/lkl/include/generated/uapi/asm/shmparam.h
  WRAP    arch/lkl/include/generated/uapi/asm/siginfo.h
  WRAP    arch/lkl/include/generated/uapi/asm/signal.h
  WRAP    arch/lkl/include/generated/uapi/asm/socket.h
  WRAP    arch/lkl/include/generated/uapi/asm/sockios.h
  WRAP    arch/lkl/include/generated/uapi/asm/stat.h
  WRAP    arch/lkl/include/generated/uapi/asm/statfs.h
  WRAP    arch/lkl/include/generated/uapi/asm/swab.h
  WRAP    arch/lkl/include/generated/uapi/asm/termbits.h
  WRAP    arch/lkl/include/generated/uapi/asm/termios.h
  WRAP    arch/lkl/include/generated/uapi/asm/timex.h
  WRAP    arch/lkl/include/generated/uapi/asm/types.h
  CHK     include/generated/uapi/linux/version.h
  UPD     include/generated/uapi/linux/version.h
  CHK     include/generated/utsrelease.h
  UPD     include/generated/utsrelease.h
  CC      kernel/bounds.s
  CHK     include/generated/bounds.h
  UPD     include/generated/bounds.h
  CHK     include/generated/timeconst.h
  UPD     include/generated/timeconst.h
  CC      arch/lkl/kernel/asm-offsets.s
  CHK     include/generated/asm-offsets.h
  UPD     include/generated/asm-offsets.h
  CALL    scripts/checksyscalls.sh
  CC      scripts/mod/empty.o
  HOSTCC  scripts/mod/mk_elfconfig
  MKELF   scripts/mod/elfconfig.h
  HOSTCC  scripts/mod/modpost.o
  CC      scripts/mod/devicetable-offsets.s
  GEN     scripts/mod/devicetable-offsets.h
  HOSTCC  scripts/mod/file2alias.o
  HOSTCC  scripts/mod/sumversion.o
  HOSTLD  scripts/mod/modpost
  HOSTCC  scripts/kallsyms
  CC      init/main.o
In file included from ./arch/lkl/include/asm/pgtable.h:12:0,
                 from include/linux/mm.h:55,
                 from include/linux/ring_buffer.h:5,
                 from include/linux/trace_events.h:5,
                 from include/trace/syscall.h:6,
                 from include/linux/syscalls.h:81,
                 from init/main.c:18:
./arch/lkl/include/asm/io.h: In function ‘__raw_readb’:
./arch/lkl/include/asm/io.h:15:2: error: implicit declaration of function ‘rumpuser_iomem_access’ [-Werror=implicit-function-declaration]
  ret = rumpuser_iomem_access(addr, &value, sizeof(value), 0);
  ^
./arch/lkl/include/asm/io.h: In function ‘ioremap’:
./arch/lkl/include/asm/io.h:100:2: error: implicit declaration of function ‘rumpuser_ioremap’ [-Werror=implicit-function-declaration]
  return rumpuser_ioremap(offset, size);
  ^
./arch/lkl/include/asm/io.h:100:2: warning: return makes pointer from integer without a cast [enabled by default]
cc1: some warnings being treated as errors
make[2]: *** [init/main.o] Error 1
make[1]: *** [init] Error 2
make[1]: Leaving directory `/usr/local/google/home/pscollins/tcp-userspace/libos-lkl-linux'
make: *** [lib/lkl.o] Error 2

I can't find references to this function anywhere online, is there a missing file that should be committed?

[thehajime]

sorry for the confusion. the rump-hypercall branch is meant to build with frankenlibc or rumprun repository, which I described a bit in my blog post (thehajime/blog#1).

I would suggest to use the stable branch of LKL (https://github.com/lkl/linux), which you may already be aware of this.

[pscollins]

Yes, I'm building it with frankenlibc --- I can't find functions with either of those names in frankenlibc or rumprun. Are you sure you're not missing files?

[thehajime]

the document for frankenlibc build is not there yet but, here is how I test my rump-hypercall branch in local machine.

cd frankenlibc
git checkout lkl-musl
git submodule update --init
./build.sh -k linux linux

(this is the case you are on a linux host)

you can also see how it is tested and how the test result is (indeed, the test is not passed yet).

https://github.com/libos-nuse/frankenlibc/blob/lkl-musl/circle.yml
https://circleci.com/gh/libos-nuse/frankenlibc/tree/lkl-musl

[Rondom]

I hope it is okay to hijack this issue. I have also tried building that branch and failed :-)
The thing, is that I do not want frankenlibc. Can this branch be used to get a library-LKL with a rump-syscallproxy server?

The only requirement I have is the syscall proxy, apart from that I want to use LKL as a library as is. That means I want to be able to access both the host and the LKL-syscalls in the same process. Thus frankenlibc is not what I want, if I understand it correctly.

[thehajime]

I hope it is okay to hijack this issue. I have also tried building that branch and failed :-)
The thing, is that I do not want frankenlibc. Can this branch be used to get a library-LKL with a rump-syscallproxy server?

syscall proxy is currently disabled (though already implemented).
I haven't come up with the nice integration with this branch and syscall proxy so far; maybe we need to link rump hypcall and syscall proxy from src-netbsd repository as the previous implementation (libos-nuse/linux-libos-tools) does.

The only requirement I have is the syscall proxy, apart from that I want to use LKL as a library as is. That means I want to be able to access both the host and the LKL-syscalls in the same process. Thus frankenlibc is not what I want, if I understand it correctly.

you're right - if you need to call the host syscalls as well as lkl syscalls, you can't use frankenlibc as it is.