# **NoVa - A Personalized AI Agent for Contextual and Autonomous Interaction** --- ## **Introduction** NoVa is not just a chatbot. It is an **autonomous AI agent** designed to dynamically adapt to conversation contexts and respond with intelligence and personality. Built for advanced interaction on Discord, NoVa integrates: - **Multi-model AI** - **Contextual memory** - **Real-time web search** - **External tool execution** - **A unique personality reflecting its creator, Michele Grimaldi** Thanks to integration with **Hugging Face Inference API**, NoVa can generate adaptive responses while leveraging models like **LLaMA 3.2-3B** , **Google Gemma 2-2B** and **Mixtral-8x7B-Instruct-v0.1**. ### **Goal:** NoVa is evolving into a **fully functional AI agent**, capable of executing external tools and interacting beyond simple conversation. --- ## **Problem and Solution** ### **Challenge:** Most chatbots lack: - **Contextual memory** → Forget past messages, leading to disconnected responses. - **A defined personality** → Responses are often generic and lack character. - **Real-time adaptability** → Limited ability to execute tools or retrieve updated information. ### **Solution: NoVa Overcomes These Limitations** ✔ **Conversational Memory** → Stores and manages up to **15 messages per user** for better contextual responses. ✔ **Advanced System Prompt** → Ensures a unique, consistent personality across interactions. ✔ **Multi-model AI** → Supports both **LLaMA 3.2-3B** , **Google Gemma 2-2B** and **Mixtral-8x7B-Instruct-v0.1**, allowing real-time switching. ✔ **Real-Time Web Search** → Uses **SmolAgents** to retrieve up-to-date information. ✔ **Unique Conversational Style** → NoVa is direct, ironic, and adds intelligent sarcasm with a touch of dark humor. --- ## **Technology and Architecture** ### **Core Technologies** - **Language:** Python - **AI Libraries:** Hugging Face Transformers, LangChain (for future integrations), PyTorch - **AI Models:** - **LLaMA 3.2-3B** (Meta) - **Google Gemma 2-2B** - **Mixtral-8x7B-Instruct-v0.1** - **APIs and Frameworks:** - **Hugging Face Inference API** → Text generation - **Discord API** → Real-time interaction - **SmolAgents** → External tool execution ### **Contextual Memory** - NoVa retains **up to 15 messages per user**. - This enhances continuity and ensures responses align with previous interactions. - **LAST UPDATES** A file called **memory_tool.py** has been integrated, this file **has the goal of Automatically storing important information**. #### **Use a simple database, in this case sqlite.** **Making the memory more dynamic**, **using a CodeAgent to generate intelligent queries** based on the context of the user's request. Speeding up the **retrieval of information**, preventing NoVa from always returning generic answers such as "No relevant memories found." **Optimizing the search system, using a SQL index** and selecting only the most relevant information based on the user's request. **How the memory system works** - **SQLite database** → Saves information in nova_memory.db with user_id, timestamp and message. - **store_memory() function** → Saves a new message for NoVa to remember. - **forward() function** → Retrieves the most recent information related to the user's query. - **Using CodeAgent** → Instead of searching for information with fixed queries, CodeAgent generates dynamic queries to find the most relevant information. **THE FILE HAS CURRENTLY BEEN CREATED, BUT NOT INTEGRATED INTO THE MAIN FILE, bot.py.** --- ## **Current and Future Features** ### **Implemented Features:** ✔ **Dynamic AI Model Switching** → Change between **LLaMA** and **Gemma** using Discord commands (`use gemma`, `use llama`, `use mistral`). ✔ **Contextual Memory** → Stores recent messages for more coherent conversations. **(Still in progress with `memory_tool.py`)** ✔ **Advanced Response Management** → Text cleaning, filtering, and formatting. ✔ **Real-Time Web Search** → Uses **SmolAgents** for up-to-date information retrieval. ✔ **Tool Execution** → Supports: - `SummarizeTextTool` → Summarizes a given text. - `SearchWebTool` → Performs DuckDuckGo searches. - `VisitWebpageTool` → Fetches and analyzes webpage content. --- #### **WebVoyager Integration into NoVa** **Web Interaction without OpenAI** → The main WebVoyager script (`run.py`) has been rewritten to enable **direct interaction with the web**, using inference from **Hugging Face** instead of OpenAI. **New Prompt Handling** → The agent now utilizes a **structured task system**, controlled via `task_test.jsonl` in the `data` directory ([repo link](https://github.com/Mike014/WebVoyager/tree/WebVoyager/NoVa)). **Capabilities**: - **Navigate webpages**, extract content, and follow links. - **Perform Wikipedia searches and retrieve information**. - **Identify interactive elements on webpages**. - **Retrieve and summarize content**. ##### **Current Limitations & Next Steps** **Incomplete Hugging Face Inference Integration** → Some tasks fail due to API quota or authentication issues. **Agent Memory Handling Needs Refinement** → The way tasks are stored and processed can be improved. **Dynamic Tool Expansion** → More AI tools will be integrated for better automation. **Final Goal**: Full integration of **WebVoyager** into **NoVa**, making it a fully autonomous agent capable of **reading, analyzing, and executing tasks on the web**. --- ### **Future Developments:** **External API Integration** → Expand toolset with APIs for automation and research. **Enhanced Conversational Memory** → Implement **Retrieval-Augmented Generation (RAG)** for better long-term recall. **Voice Interaction** → Enable spoken commands and responses for a **natural user experience**. **Performance Optimization** → Reduce response latency and improve model efficiency. **WebVoyager Integration into NoVa** --- ## **Progress shown on LinkedIn post** [🔗 LinkedIn Post](https://www.linkedin.com/feed/update/urn:li:activity:7297924279516471296/) --- ## **How NoVa Works on Discord** ### **Context-Aware Conversations** **Example: Memory Retention** ```plaintext User: "I had too many chocolate cookies today." NoVa: "Ah, the eternal struggle between self-control and sugar... Who won?" User: "Definitely the cookies..." NoVa: "Another fallen soldier in the battle against cravings. RIP self-discipline." ```

NoVa AI Nova First Pic Nova Second Pic Nova Third Pic Nova Fourth Pic NoVa Generate Code NoVa Remind Conversation NoVa Web Search Memory_of_nova