ScrapYoutuber Banner

# ScrapYoutuber ## About ScrapYoutuber is a time-saving tool that helps sponsors and companies quickly gather essential data about YouTubers, including main topics, social media presence, and engagement rates. Powered by the Langraph framework, it streamlines the process of evaluating YouTube channels for marketing and partnerships. ## Demo [![Demo](Frame.jpg)](https://www.youtube.com/watch?v=wiHAdLXlr0M) ## Inference Pipeline ![ScrapYoutuber pipeline](ScrapYoutuber_pipeline.png) ## Features - **YouTube Channel Insights**: Automatically scrape main topics covered by the YouTuber. - **Social Media Extraction**: Gather links to other social media accounts like Instagram, Twitter, etc. - **Engagement Metrics**: Retrieve key engagement metrics such as view counts, likes, comments, and subscriber data. - **Multi-Agent System**: Leverages a system of intelligent agents to distribute tasks and ensure efficient web scraping and data retrieval. - **Powered by LLMs**: Uses advanced language models to process and summarize the collected information. - **Retrieval-Augmented Generation (RAG)**: Ensures accurate and contextually relevant data by retrieving information from multiple sources. - **YouTube API Integration**: Seamlessly integrates with the YouTube Data API for additional metadata and statistics. ## Technologies Used - **Multi-Agent System (LangGraph)**: Efficient parallel task execution. - **Web Scraping (Tavely API)**: Gathers information from YouTube and social media. - **Retrieval-Augmented Generation (RAG) (LangChain, Chroma, NVIDIA API, etc.)**: Retrieves and summarizes relevant information. - **YouTube API**: Accesses structured data from YouTube. ## Installation To run ScrapYoutuber locally, follow these steps: ### Clone the repository: ```sh git clone https://github.com/ITSAIDI/ScrapYoutuber.git cd ScrapYoutuber ``` ### Install dependencies: ```sh pip install -r requirements.txt ``` ### Set up API keys: - Get your API key from YouTube Data API. - Store it in a `.env` file or directly in the configuration file. - You also need to add an `LLM_API_Key`. The default is Fireworks API, but you can change that in `LLMs.py`. ### Run the application: ```sh python main.py ``` ## Usage 1. Provide the YouTuber’s channel URL to the tool. 2. ScrapYoutuber will automatically collect and display information, including: - Main content topics - Links to social media accounts - Key engagement metrics (e.g., average views, likes, comments) 3. Summarized results will be displayed in the terminal or saved to a file.

Owleye: Convert the Webcam to an Eye Tracker

Empowering Accessibility: An AI Chatbot for Navigating Adult Disability Payment Forms

Shellmancer

Maze Solver using OpenCV

Muhann flashcard Saas

Voice recognition chatbot with llama3.1

PPE Detection

Clipgen AI - AI Agent for YouTubers

Free and Open-Source Interview AI Coach powered by Assembly AI and Gemini – your personal assistant

Ai Test Generator

w3b3_agent

Agro-Pro Website & Mobile Application

ToothGapID

Multi-Model Reasoning Using Different LLM Models

Siamese Neural Network

ScrapYoutuber

Object proximity YOLO based (OPYB)

Udemy-Course-Mastering-LangChain-and-AWS

VisionMath - AI mathematical expression solver

MindBridge Hotline: Check-Ins for Lifelong Wellness