Skip to content

MuskanAi is a personal Digital Assistant which is capable of performing all Automation task whether it is Controlling your Devices, Browsing the Internet and Emotional Understanding..

License

Notifications You must be signed in to change notification settings

4darsh-Dev/MuskanAi

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

66 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

MuskanAi ✨

Overview

A digital assitant which has full automation capabilties of Nautral Language Understanding and speech input and output along with Emotional Intelligence and Web Browsing also perform day to day activities like Sending message,answering calls, etc. Uses Fine-Tuned Deep Learning Large Languae Model (LLMs) for Emotional Understading and Question Answering.

Muskan AI-digital-assitant-by-adarsh-maurya

GitHub code size GitHub contributors GitHub commit activity GitHub issues GitHub License Python Django JavaScript HTML CSS Markdown

GitHub forks GitHub Repo stars

Tech Stack πŸ› οΈ

  • Front End: HTML, CSS, JavaScript
  • Digital Assitant Python(pyttsx3,Nltk,PyTorch,pandas,numpy,scikit-learn,transformers)
  • Backend and API: Django and REST Framework
  • Deep Learning LLM Hugging Face API

Roadmap πŸ—ΊοΈ

Approach

  1. Dataset Collection:

    • Gather publicly available datasets from sources like Kaggle, Hugging Face, and other repositories.
    • Create custom-labelled datasets from movie dialogues, social media conversations, video transcripts, and CC content to train the models for specific tasks.
  2. Model Fine-Tuning:

    • Fine-tune llama2-7b and BERT models using the collected datasets for sentiment analysis, question answering, and NER tasks.
    • Implement transfer learning techniques to adapt the models to various contexts and domains.
  3. Contextual Understanding:

    • Utilize Q/A datasets containing contextual information with emotional annotations to enhance the models' understanding of emotional context.
    • Incorporate ontologies to interpret cultural contexts and social relationships influencing emotional expression.
  4. Reinforcement Learning:

    • Implement a reinforcement learning mechanism based on user feedback (positive/negative ratings) to continually improve the models' performance in generating responses.

Workflow

Our workflow follows a sequential process:

  1. User Input: Users provide input queries or statements.
  2. Intent Recognition: Determine the intent behind the user input.
  3. Sentiment Analysis: Analyze the sentiment of the input.
  4. Response Generation: Generate appropriate responses based on the input and sentiment analysis.

Milestones

  • Milestone 1: Dataset Collection and Preprocessing
  • Milestone 2: Model Fine-Tuning for Sentiment Analysis
  • Milestone 3: Model Fine-Tuning for Question Answering
  • Milestone 4: Model Fine-Tuning for Named Entity Recognition
  • Milestone 5: Integration of Reinforcement Learning Mechanism
  • Milestone 6: Testing and Evaluation
  • Milestone 7: Documentation and Finalization

Screenshots πŸ“Έ

Muskan AI-digital-assitant-by-adarsh-maurya

Project Setup Locally πŸš€

Setting up Django API

  1. clone the git repository locally.
git clone https://github.com/4darsh-Dev/MuskanAi.git
  1. Install python and setup virtual envionment.

1. Open terminal in MuskanAi folder

pip install virtualenv 
cd MuskanAi
python -m venv myenv 

Activating virtual environment named as myenv

1. In Windows πŸͺŸ
.\myenv\Scripts\activate  
2. In Linux/Mac 🐧
 source myenv/bin/activate
  1. Installing required modules and libraries
 pip install -r requirements.txt 
  1. Running Django Development Server
python manage.py makemigrations 
python manage.py migrate 
python manage.py runserver 

-- Server will be started at localhost (example: http://127.0.0.1:8000/)

Documentation πŸ“–

Detailed documentation on usage, contribution guidelines, and API integration can be found in the Documentation Link.

About Authors πŸ§‘β€πŸ’»

πŸ”— Links

portfolio linkedin

Acknowledgments πŸ™

We express our gratitude to the incredible individuals who have contributed to the development and success of MuskanAi. 🌟 Your dedication, passion, and insights have played a pivotal role in shaping this project.

Special thanks to the open-source community for their continuous support and collaborative spirit. πŸš€ Your contributions, whether big or small, have contributed to the growth and improvement of CogniGuard.

Feedback πŸ“¬

We value your feedback! Report issues at [email protected] Propose features, or submit pull requests. Let's create a fair and transparent digital environment together! 🌐✨