Which Frame?

Search a video semantically with AI. For example, try a natural language search query like "a person with sunglasses". You can also search with images like Google's reverse image search and also a combined text + image. The underlying querying is powered by OpenAI’s CLIP neural network for "zero-shot" image classification.

Try it out!

http://whichframe.chuanenlin.com

Setting up

1. Clone the repository.

git clone https://github.com/chuanenlin/whichframe.git
cd whichframe

2. Install package dependencies.

pip install -r requirements.txt

3. Run the app.

streamlit run whichframe.py

Examples

🔤 Text Search

Query

"three red cars side by side"

Result

🌅 Image Search

Query

Result

🔤 Text + 🌅 Image Search

Query

"a red subaru" +

Result