demo.mp4
- Real-Time Object Detection on Smartphones thanks to NanoDet
- Bluetooth Chat: SimpleBluetoothTerminal
- Capure Images without User input
This is the software for a robot. The robot is specifically built to get best scores at a tournament at HSLU. It drives trough a parcour. A Smartphone is attached to it. The goal from a software perspective is to detect plants in real-time and communicate this the with hardware, so that the roboters stops. It then takes a image, which is uploaded to a webserver. The species of the plant will also be determined by calling an API. This is all happening completly autonomous without user input. The app will connect to a Bluetooth device in order to send commands to a microcontroller. At the same time this is happening, status updates are sent to the webserver.
For the complete documentation of this hslu project, find it here: Gruppe38_Abschlussdokumentation_100622.pdf
This project wouldn't exist without libraries and other open-source projects.
- SimpleBluetoothTerminal to enable communicating with a ESP32 microcontroller over Bluetooth.
- CameraXBasic Example project which uses the CameraX library.
- ncnn-android-nanodet NanoDet object detection, which depends on ncnn. I modified the code to only check for certain objects. (And ignore all the rest)
- nv-websocket-client ,which offers a High-quality WebSocket client implementation for Android in Java.
- NanoDet Super fast and lightweight anchor-free object detection model. Real-time on mobile devices.