16. AI Detection from APP

In this project, we will use an app - SunFounder Controller to view real-time video streaming, as well as use the AI detection features on your mobile device, such as face and pose detection.

SunFounder Controller is an application that allows users to customize the controller for controlling their robot or as an IoT platform. 11 kinds of show and control widgets are integrated in this APP, such as Button, Joystick, Gauge, and Radar. The controller page has 17 areas from A~Q, you can place different widgets to customize your own controller.

Now take a look at how to use the APP in a simple way.

How to do?

  1. The ESP32-CAM and the Arduino board share the same RX (receive) and TX (transmit) pins. So, when you’re uploading code, you’ll need to first disconnect the ESP32-CAM to avoid any conflicts or potential issues.

    ../_images/unplug_cam1.png

  2. Open the 16_ai_detection_from_app.ino file under the path of zeus-car-main\examples\16_ai_detection_from_app.

  3. After the code is uploaded successfully, you can plug in the ESP32-CAM and then slide the power switch to ON to start the Zeus Car.

    ../_images/plug_esp32_cam.jpg

  4. Toggle the Upload Switch to the side of Run (right side on this diagram) to start the ESP32 CAM.

    ../_images/zeus_run.jpg

  5. Press the reset button to get the Arduino board’s program running again.

    ../_images/zeus_reset_button.jpg

  6. Now, install SunFounder Controller from APP Store(iOS) or Google Play(Android) to your mobile device.

  7. Connect to Zeus_Car WLAN.

    • Find Zeus_Car on the WLAN of the mobile phone (tablet), enter the password 12345678 and connect to it.

    ../_images/app_wlan.png

    • The default connection mode is AP mode. So after you connect, there will be a prompt telling you that there is no Internet access on this WLAN network, please choose to continue connecting.

    ../_images/app_no_internet.png

  8. Then open the APP and create a controller.

    • To add a controller on SunFounder Controller, click the + icon.

      ../_images/app1.png

    • Select the Blank and Dual Stick template and give it a name.

      ../_images/view_app1.jpg

    • As you are now inside the controller, click the app_camera icon to enable the AI detection feature. You will find both Face Detection and Pose Detection options.

      ../_images/view_app6.jpg

    • Save all settings by clicking on the app_save button. As no widgets have been selected, the screen is completely black.

      ../_images/view_app3.jpg

    • The next step is to connect the Zeus Car to your device via the app_connect button. Wait a few seconds and Zeus_Car(IP) will appear, click on it to connect.

      ../_images/view_app4.jpg

      Note

      Please make sure your Wi-Fi is connected to Zeus_Car, if you are not seeing the above message for a long time.

  9. Run the Controller.

    After the “Connected Successfully” message appears, click the app_run button, then the camera footage will appear on the app.

    If you have Face Detection turned on, then the face that appears in the screen will be framed.

    ../_images/view_app7.jpg

    If you have Pose Detection on, then the pose will be depicted.

    ../_images/view_app8.jpg

    Note

    If you want to switch to another AI detection, you can click on the app_edit icon and repeat the above steps.