diff --git a/README.md b/README.md index f1b6a21..d970684 100644 --- a/README.md +++ b/README.md @@ -3,6 +3,8 @@ RosbagInputFormat is an open source **splittable** Hadoop InputFormat for the RO The complete source code is available in src/ folder and the jar file is generated using SBT (see build.sbt) +For an example of rosbag file larger than 2 GB see doc/Rosbag larger than 2 GB.ipynb Solved the issue https://github.com/valtech/ros_hadoop/issues/6 The issue was due to ByteBuffer being limitted by JVM Integer size and has nothing to do with Spark or how the RosbagMapInputFormat works within Spark. It was only problematic to extract the conf index with the jar. + # Usage 1. Download latest release jar file and put it in classpath