Week 2 2024 Spring

Homework:

• Video:
  • Intro to ml5
  • Image classifier with ml5 and MobileNet on image, and webcam
• Coding:
  • Build on top of the image classifier example from the coding session. Publish it on your blog / GitHub. Add your homework link to the list below.
  • Or try any of the ml5js examples, make something based on any of these examples.

Help:

• ml4w-homework: How to push code to a Github Repo and host sketch on Github
• Video: How to host p5 sketch on GitHub pages

Resources:

• All image classifier demos from week 1
• ml5.js examples
• ml5 Playful Examples
• tf.js examples
• Core Concept of TensorFlow.js
• Google AI experiments
• A Beginner's Guide to Machine Learning with ml5.js, introduction to tf.js 6.1 - 6.5

Inspirations about image classifier

• Emojis Scavenger Hunt
• Thing Translator
• Giorgio Cam
• Safty glasses on, shop machine running

Some ideas

You can -

• change the sketch background, show an image/gif, play a song when MobileNet recognizes a certain object.
• use p5.speech library to say the results from the mobile
• use Google Translate to translate the results to another language
• make an emoji webcam scavenger hunt game
• connect p5 sketch to an Arduino board through serial communication, when MobileNet recognizes a certain object, light up a LED.

Questions?

• add your question here

Add your name / link to your assignment below

• Your name, [Project name](Project Link), Project Description
• Jing C, Try KNN Classification, KNN classification
• Weber W LASER EYES MEME, MoveNet
• Alan Ren, handPose Pong, next-gen HandPose, FULL SCREEN
• Ruby Zhang, DoodleNet Drawing Competition - in progress
• Tamanna J, Moving Eyes, Handpose
• Octavio F, Sidescroll choir, Pitch Detection
• Andrew T, stippling words
• Vivian Xie, meow-meow
• Yian Chen, try
• Nathan Duker, FaceTheRain