C Software Setup

1. Create a dedicated workspace and clone this repo in it

$ mkdir -p robocup24_ws/src
$ cd robocup24_ws/src
robocup24_ws/src $ git clone https://github.com/CoreSenseEU/CoreSense4Home.git

2. Install internal dependencies

robocup24_ws/src $ vcs import --recursive < CoreSense4Home/robocup_bringup/thirdparty.repos
robocup24_ws/src $ cd ..
robocup24_ws $ rosdep install --from-paths src --ignore-src -r -y

3. Install Whisper_ROS

   1. Install CUDA (V12.1)
   2. Follow instructions on whisper_ros repo

4. Install llama_ros

5. Install Perception System

robocup24_ws/src $ pip3 install -r ThirdParty/yolov8_ros/requirements.txt

6. Install external dependencies

robocup24_ws/src $ cd ..
robocup24_ws $ rosdep install --from-paths src --ignore-src -r -y

7. Build

robocup24_ws $ colcon build --symlink-install

How to launch carrry_my_luggage:

robocup24_ws $  ros2 launch robocup_bringup carry_my_luggage_dependencies.launch.py

robocup24_ws $  ros2 launch robocup_bringup carry_my_luggage.launch.py 

How to launch receptionist:

robocup24_ws $  ros2 launch robocup_bringup receptionist_dependencies.launch.py 

robocup24_ws $  ros2 launch robocup_bringup receptionist.launch.py  

Dialog and YOLO versions

audio-common==0.0.0
audio-common-msgs==0.0.0
audioread==3.0.1
cv-bridge==3.2.1
gTTS==2.5.1
librosa==0.10.0
llama-bringup==0.0.0
llama-msgs==0.0.0
llama-ros==0.0.0
numpy==1.26.4
nvidia-cublas-cu12==12.1.3.1
nvidia-cuda-cupti-cu12==12.1.105
nvidia-cuda-nvcc-cu12==12.2.140
nvidia-cuda-nvrtc-cu12==12.1.105
nvidia-cuda-runtime-cu12==12.1.105
nvidia-cudnn-cu12==8.9.2.26
nvidia-cufft-cu12==11.0.2.54
nvidia-curand-cu12==10.3.2.106
nvidia-cusolver-cu12==11.4.5.107
nvidia-cusparse-cu12==12.1.0.106
nvidia-nccl-cu12==2.18.1
nvidia-nvjitlink-cu12==12.2.140
nvidia-nvtx-cu12==12.1.105
oauthlib==3.2.0
olefile==0.46
onnxruntime==1.16.3
opencv-python==4.8.1.78
pocketsphinx==0.1.15
proto-plus==1.23.0
protobuf==4.23.4
PyAudio==0.2.14
scikit-learn==1.4.0
scipy==1.11.4
sound-recognition==0.0.0
sound-recognition-msgs==0.0.0
soundfile==0.12.1
speech-to-text==0.0.0
speech-to-text-msgs==0.0.0
SpeechRecognition==3.10.1
stereo-msgs==4.2.3
tensorflow==2.15.0.post1
tensorflow-estimator==2.15.0
tensorflow-io-gcs-filesystem==0.36.0
text-to-speech==0.0.0
text-to-speech-msgs==0.0.0
torch==2.1.2
torchaudio==2.1.2
torchvision==0.16.2
tqdm==4.66.1
TTS==0.22.0
ultralytics==8.0.232
whisper-msgs==0.0.0