Week 2 2019 Spring

Homework:

• Reading:

  • How to build a Teachable Machine with TensorFlow.js
  • Real-time Human Pose Estimation in the Browser with TensorFlow.js

• Video:

  • Coding train: ml5.js: KNN Classification part 1- 3

• Coding:

  • Add new outputs to the KNN Image Classifier example, mix it with videos, games, or physical computing
  • Or build something based on poseNet example.
  • Publish your project on GitHub or your own blog, or record a video and put it on your blog. Add your project link below.

See demos live

• KNN Image Classifier Video
• KNN Image Classifier Video + Sound
• KNN Image Classifier Video + Square
• Regression with feature extractor
• Posnet
• PoseNet with KNNClassification
• PoseNet Video + Music

Inspirations about KNN image classifier and PoseNet:

• Getting Alexa to Respond to Sign Language Using Your Webcam and TensorFlow.js, live demo
• Teachable machine
• Objectifier Spatial Programming
• Pacman with tf.js
• Pong ML Game
• Play Pong with your webcam from ml4a
• Moving morrir
• Sidewalk Orchestra
• Making music by posing melody shapes to my webcam
• Make music with Posenet from ml4a

Resource:

• KNN image classifier in ml5.js
• PoseNet in ml5.js
• Brick breaker game in p5.js
• Snack game in p5.js

Questions?

• add your question here

Add your name/link to your assignment below

• Your name, [Project name](Project Link), Project Description
• Eva Philips, Writing with Sign Language, With this program you can train and type using sign language.
• Vince MingPu Shao. Posenet blog post and play with it here. An easy exploration with postnet model by scaling up the dots on detection key points.
• Alice Sun, Snake Game, takes video input to control the snake, with KNN Classification
• Xinyue Li Face Filters Based on Gestures, face filters would apply when users make certain gestures.
• Fenfen Chen PoseNet Drawing, Draw with poseNet to keep your nose from touching the yellow area.😉
• August Luhrs, KeNNosis, As God, try and keep your population alive and thriving with your indirect use of webcam-KNNClassified divine actions; as a force of evil, try and corrupt/kill everyone alive (requires multiple clients).
• Sachiko Nakajima, Nose Player, I put 5 musical sounds which can be played by your NOSE!!!
• Yves, PUT YOUR HANDS UP!!, Get the party started by putting both of your hands in the air 🙌
• Dylan, Posenet Censored, Censors your eyes?
• Louise, Sit up straight!, Tells you to sit up straight when you are at the computer!
• Suzanne Signal:Noise, Plays audio when you move your face around the screen.