Skip to content

haseeb-heaven/gemini-vision-pro

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

22 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Gemini Vision Pro Logo

πŸš€ Description: πŸš€ This is the amazing Google Gemini Vision Pro πŸ“Έ, a powerful tool that scans images, generates descriptions using Gemini AI Pro Vision API, and provides speech feedback πŸ—£οΈ. It also captures images using the webcam πŸ–₯️.

🌟 Introduction 🌟

Google Gemini Vision Pro is a versatile application that combines image processing πŸ–ΌοΈ, speech recognition 🎀, and text-to-speech capabilities πŸ“’. With this application, you can capture images using your webcam πŸ“·, convert spoken words to text πŸ“, generate image descriptions πŸ“š, and even have the descriptions spoken back to you πŸ“£.

Installation Guide

Step 1: Clone the repository

git clone https://github.com/haseeb-heaven/Gemini-Vision-Pro
cd Gemini-Vision-Pro

Step 2: Install the dependencies

pip install -r requirements.txt

Step 3: Run the application

streamlit run script.py

Step 4: Obtain the Google Palm API key and Setup the application

  1. Obtain the Google Palm API key.
  2. Visit the following URL: Google AI Studio
  3. Click on the Create API Key button.
  4. The generated key is your API key. Please make sure to copy it and paste it in the application settings.
  5. The API key is crucial for the functioning, Please ensure to keep it safe and do not share it with anyone.

Gemini AI settings:

Gemini Settings

AI Sections

The core AI sections of this project include:

  • πŸ“· Webcam detection using WebRTC, OpenCV, and PIL
  • πŸ—£οΈ Speech-to-text conversion using Google Cloud Speech-to-Text API
  • πŸŽ™οΈ Text-to-speech conversion using Google Cloud Text-to-Speech API
  • πŸ“Έ Image processing using Gemini AI Pro Vision API

Features

  • πŸ“· Webcam detection with real-time image capture
  • πŸ—£οΈ Speech-to-text conversion for spoken words
  • πŸŽ™οΈ Text-to-speech for generating spoken descriptions
  • πŸ“Έ Image processing using AI to provide detailed descriptions
  • πŸ“ Logging using Python's logging module
  • βš™οΈ Error handling with Python's exception handling

WebUI - Application Showcase

YouTube demo:

Gemini Vision demo

Webcam with live feed:

Webcam with live feed

Gemini Ai Vision demo with object as Cap:

Gemini Ai Vision Cap

Gemini Ai Vision demo with Hand:

Gemini Ai Vision Hand

Gemini Ai Vision demo with Gesture:

Gemini Ai Vision Gesture

Packages Used

This project relies on various Python packages, including:

  • Streamlit - A web app framework used to build the application
  • Streamlit Webrtc - Used for capturing images from the webcam
  • OpenCV - Utilized for webcam image capture
  • PIL (Pillow) - Used for image processing and conversion
  • gTTS (Google Text-to-Speech) - Converts text to speech
  • SpeechRecognition - Converts speech to text
  • google.cloud.speech - Part of Google Cloud services for speech-to-text conversion

πŸ“š Links and References

Follow these links for Google Gemini Vision Pro related content:

Versioning

  • Version: 1.0 : Initial Release

Contributing

We welcome contributions! Please follow our Contribution Guidelines to get started.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Author

  • HeavenHM
  • Date: 17-12-2023