π Description: π This is the amazing Google Gemini Vision Pro πΈ, a powerful tool that scans images, generates descriptions using Gemini AI Pro Vision API, and provides speech feedback π£οΈ. It also captures images using the webcam π₯οΈ.
Google Gemini Vision Pro is a versatile application that combines image processing πΌοΈ, speech recognition π€, and text-to-speech capabilities π’. With this application, you can capture images using your webcam π·, convert spoken words to text π, generate image descriptions π, and even have the descriptions spoken back to you π£.
git clone https://github.com/haseeb-heaven/Gemini-Vision-Pro
cd Gemini-Vision-Pro
pip install -r requirements.txt
streamlit run script.py
- Obtain the Google Palm API key.
- Visit the following URL: Google AI Studio
- Click on the Create API Key button.
- The generated key is your API key. Please make sure to copy it and paste it in the application settings.
- The API key is crucial for the functioning, Please ensure to keep it safe and do not share it with anyone.
The core AI sections of this project include:
- π· Webcam detection using WebRTC, OpenCV, and PIL
- π£οΈ Speech-to-text conversion using Google Cloud Speech-to-Text API
- ποΈ Text-to-speech conversion using Google Cloud Text-to-Speech API
- πΈ Image processing using Gemini AI Pro Vision API
- π· Webcam detection with real-time image capture
- π£οΈ Speech-to-text conversion for spoken words
- ποΈ Text-to-speech for generating spoken descriptions
- πΈ Image processing using AI to provide detailed descriptions
- π Logging using Python's logging module
- βοΈ Error handling with Python's exception handling
This project relies on various Python packages, including:
- Streamlit - A web app framework used to build the application
- Streamlit Webrtc - Used for capturing images from the webcam
- OpenCV - Utilized for webcam image capture
- PIL (Pillow) - Used for image processing and conversion
- gTTS (Google Text-to-Speech) - Converts text to speech
- SpeechRecognition - Converts speech to text
- google.cloud.speech - Part of Google Cloud services for speech-to-text conversion
Follow these links for Google Gemini Vision Pro related content:
- Version: 1.0 : Initial Release
We welcome contributions! Please follow our Contribution Guidelines to get started.
This project is licensed under the MIT License - see the LICENSE file for details.
- HeavenHM
- Date: 17-12-2023