Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration 🤗

[NeurIPS 2024] AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation

A minimal, but effective implementation of CLIP (Contrastive Language-Image Pretraining) in PyTorch

Low-latency ONNX and TensorRT based zero-shot classification and detection with contrastive language-image pre-training based prompts

Download flickr8k, flickr30k image caption datasets

Este proyecto presenta una solución de Computer Vision para la detección y clasificación de objetos en imágenes, las cuales son extraídas como frames de vídeos. Utiliza el modelo FastSAM para la detección de objetos, y para la clasificación, emplea embeddings que pueden ser generados mediante dos modelos distintos: CLIP o SigLIP.

A simple open-sourced SigLIP model finetuned on Genshin Impact's image-text pairs.

Meme search and discovery engine using OpenAI CLIP and Salesforce BLIP

Notes for the Vision Language Model implementation by Umar Jamil

Implementation of PaliGemma

Framework for learning multi-domain image embeddings suitable for multi-domain image retrieval at instance-level

Web scraper for Wildberries simple vectorization/multimodal embedding workflow