GSPro-MLM2PRO-OCR-Connector

A Python app that interfaces the Rapsodo MLM2PRO golf launch monitor with the GSPro golf simulation software using OpenCV and TesserOCR.

Required:

1. Screen Mirroring App

• iPhone/iPad one of:
  • AirPlay app from Windows Store - https://www.microsoft.com/store/productId/9P6QSQ5PH9KR
  • 5KPlayer - https://www.5kplayer.com/
• Android one of:
  • SCRCPY - 'Screen Copy' via USB - https://github.com/Genymobile/scrcpy (also requires enabling of USB debugging mode in Developer options. See https://developer.android.com/studio/debug/dev-options)
  • EasyCast app from the play store (not as good as scrcpy)

2. Rapsodo MLM2PRO App

• iPhone/iPad - https://apps.apple.com/us/app/rapsodo-mlm2pro/id1659665092
• Android - https://play.google.com/store/apps/details?id=com.rapsodo.MLM&hl=en_US&gl=US

3. Golf Balls

• Callaway® RPT™ Chrome Soft X® Golf Balls (3 Included in MLM2PRO box), these are necessary to accurately calculate Spin Axis and Spin Rate - https://rapsodo.com/products/callaway-rpt-chrome-soft-x-golf-balls
• or any other ball with dot stickers from
  • justapotamus - https://justapotamusdesigns.com/collections/rapsodo-mlm2pro-ball-dots
  • rapsodoballdots - https://rapsodoballdots.com/

Steps:

1. Download the ZIP from the latest release, unzip it, and open the Settings.json file (https://github.com/rowengb/GSPro-MLM2PRO-OCR/releases).
2. By default, the WINDOW_NAME is set to "AirPlay" (for iOS). If you are using 5KPlayer, you may need to change your device name to remove the apostrophe. If you are using Android, change it to the name of the SCRCPY window (your device name). Also update the TARGET_HEIGHT and TARGET_WIDTH accordingly. Once done, save the file (Ctrl+S) and close it.
3. Open the Rapsodo MLM2PRO app, connect your Launch Monitor, and go to Simulation > Rapsodo Range.
4. If using a phone, click on the little arrow next to "Ball Speed" on the right to show all the metrics.
5. Mirror your device screen using
   • iPhone/iPad: AirPlay or 5KPlayer apps
   • Android: EasyCast app or scrcpy via USB debugging mode
6. Adjust the AirPlay/scrcpy window size so that the Rapsodo MLM2Pro App fills it out with little to no black borders/bars (Doesn't have to be perfect, the connector app will still work with black borders/bars but may not be as accurate) - (Example: https://ibb.co/DMHx12S).
7. Open GSPRO and GSPRO Connect Open API window (Go to Range or Local Match to test).
8. Run the MLM2PROConnectorV2.exe app file as ADMINISTRATOR (located in the previously downloaded/unzipped ZIP file) and wait for the "Press enter after you've hit your first shot" line to show.
9. Take your first shot, wait for the numbers to populate on the Rapsodo Range in the MLM2PRO app and then press the Enter key.
10. Set the ROIs for each shot metric one by one by creating rectangles around the desired value (See tutorial/example here - https://www.youtube.com/watch?v=zLptVv8umaU). Make sure you leave room around the numbers and text, as shown. You can copy and paste the ROI values printed into your settings.json to avoid the need to select the boundaries each time. If you get a misread shot, read the console to determine which one, then edit the ROI in your JSON. The first two numbers are the X,Y location of the upper left corner, and the next two are width and height. You can Ctrl-C to exit the connector and relaunch it to test your new ROI dimesions.
11. Optional: Putting. There are two putting options for this connector:
    • Webcam-based putting via this utility https://github.com/alleexx/cam-putting-py/releases
      • Including the line "PUTTING_MODE" : 1, in your settings.json will enable this mode
      • The ball_tracking.exe is included in this download, and will start automatically
      • If you want to disable it, you can set "PUTTING_MODE" : 0, in the settings.json
      • See the readme at the above location for setup and usage details
      • If you want to pass command-line arguments to ball_tracking.exe (such as to select ball color), you can add those in your settings.json with a line like this: "BALL_TRACKING_OPTIONS" : "-c orange2",
      • The webcam window will pop up when putter is selected in GSPRO. To disable this behavior, add "PUTTING_OPTIONS" : 0, to your settings.json
      • Any putts detected while the putter isn't selected in GSPRO will be ignored
    • Exputt-based. Exputt is a standalone putting simulator, which comes with its own putting surface and camera. To use it, we must capture its HDMI signal on your PC, instead of feeding it to a TV or monitor
      • Including the line "PUTTING_MODE" : 2, in your settings.json will enable this mode
      • Example of an HDMI capture dongle is https://www.amazon.ca/dp/B0CDLS9YNF
      • Using Exputt is similar to the MLM app except you capture the HDMI signal instead of mirroring the phone or tablet
      • For now, Exputt needs to be set for Yards or Feet (Imperial, not metric)
      • Windows includes an app called 'Camera' which we can use to view the HDMI signal from Exputt
      • If your Windows is in French mode, there's an accent on the e of Camera. See settings.json for the fix
      • You will define a window name, its dimensions, and 4 ROI areas in the same was as for MLM app. These are located in the same settings.json
      • A setup demonstration is at https://www.youtube.com/watch?v=ajbW5WcIwCs
      • Read the description in that video to see the step-by-step instructions
      • The ROIs are easier to identify in Exputt because there is no extraneous text near the numbers
      • Once the window name, dimensions and 4 EX_ROIs are set up, you don't need to edit the settings.json any more
12. Optional: if your MLM app is taking too long to draw the shot trace (current app version for android), you can enable the following setting in settings.json "AUDIBLE_MLM_READY" : 1, This will give you an audible indication that MLM is still busy, then let you know when it's ready for the next shot. The first time you try this option, it will prompt you for ROI7, which is the "Total distance" number from the MLM app. Once done, copy and paste ROI7 into your settings.json for future sessions. See demo at https://youtu.be/QF0gxpWUhY8
13. Done!

NOTE: If you'd like console message to appear in color, double-click the console_colors.reg file included here NOTE: Make sure to have GSPro, GSPro Connect and the AirPlay receiver app open and running before opening the MLM2PROConnectorV2.exe app otherwise it will just close instantly after pressing enter to confirm your first shot. NOTE: If you need to kill this connector (via Ctrl-C), you will need to reset the GSPRO side by selecting "Settings, Game, Reset GSPRO Connect,Close" before restarting this connector.