# Abstract This project explores the application of computer vision in identifying medicinal plants and mapping their associated medicinal benefits. Using deep learning techniques, particularly Convolutional Neural Networks (CNNs), a model was trained to classify images of various medicinal plants. This model not only identifies the plant species but also provides details on their medicinal uses, offering an innovative solution for plant identification in healthcare. By integrating image recognition with plant benefits, the project aims to bridge the gap between traditional plant knowledge and modern AI technologies. # Introduction Medicinal plants have been used for centuries in various cultures around the world, and their importance in alternative medicine continues to grow. However, traditional methods of plant identification often require extensive expertise and time. With the rise of artificial intelligence (AI) and machine learning, there is an opportunity to automate the identification process, making it more accessible. This project focuses on creating a plant identification model that is not only capable of recognizing plants from images but also mapping their medicinal benefits. The project uses the Indian Medicinal Leaves dataset, which contains labeled images of various plants, each associated with a set of medicinal benefits. The goal is to develop a robust model that can predict both the species of a plant and its medicinal properties from a simple image. # Related work Recent advancements in computer vision have made significant strides in object detection, classification, and segmentation. In the context of plant identification, several studies have demonstrated the use of deep learning models, particularly Convolutional Neural Networks (CNNs), to identify plant species from images. Models like ResNet and Inception have been successfully applied to plant image classification tasks. However, the integration of plant identification with their medicinal benefits is an emerging area. Previous works primarily focus on plant identification without incorporating the medicinal aspect. This project seeks to innovate by integrating both plant recognition and benefit mapping, offering a more holistic solution. # Methodology The approach used in this project involves several key steps: 1. Dataset Preparation: The project uses the Indian Medicinal Leaves dataset from Kaggle, which contains images of medicinal plants along with their corresponding benefits. The dataset includes over 100 unique species of plants. 2. Data Preprocessing: The images are resized to a consistent dimension to ensure uniformity for model input. Augmentation techniques, such as rotation, flipping, and zooming, were applied to enhance the dataset and improve model generalization. 3. Model Selection: A Convolutional Neural Network (CNN) architecture was chosen due to its proven effectiveness in image classification tasks. Specifically, ResNet50, a pre-trained deep learning model, was fine-tuned for this task. This model has been shown to provide excellent performance on image recognition tasks, benefiting from transfer learning to adapt to the plant dataset. 4. Model Training: The model was trained using categorical cross-entropy loss and the Adam optimizer. Training was performed in epochs with a learning rate schedule to optimize the model's performance. 5. Medicinal Benefits Mapping: After identifying the plant species, the model retrieves the associated medicinal benefits from the dataset, providing a comprehensive response to the user. 6. Evaluation: The model’s performance was evaluated using accuracy, precision, recall, and F1-score metrics. This helped to assess how well the model performs in terms of identifying the correct plant species and associating the correct medicinal benefits. # Experiments During the experimentation phase, different CNN architectures were tested to determine the most effective model. The ResNet50 model, pre-trained on ImageNet, was chosen due to its depth and ability to generalize well to new datasets. The model was fine-tuned with the medicinal plant dataset, adjusting for class imbalances by applying techniques such as class weights. Several iterations of data augmentation were applied to ensure the model could generalize well under various real-world conditions, such as different lighting and environmental factors. The model was trained over multiple epochs to ensure convergence and optimal performance. # Test image I test the code by giving some leaf image like the betel leaf ![Screenshot 2024-12-29 202139.png](Screenshot%202024-12-29%20202139.png) # Output ![predicted leaf.png](predicted%20leaf.png) ![probability.png](probability.png) ![output.png](output.png) # Results The trained model achieved an accuracy of above 90%, successfully classifying a wide range of medicinal plants. The model was also able to accurately map the plant species to their medicinal benefits, providing users with detailed information about the plant’s uses in medicine. Confusion matrices and classification reports were used to evaluate the model's performance. The results showed that while the model performed well on most plant species, certain species with similar visual characteristics posed challenges. These challenges can be addressed by incorporating more data and using advanced techniques such as ensemble learning or multi-modal approaches. # Discussion The project demonstrated the potential of computer vision in identifying medicinal plants and their associated benefits. The model was able to provide valuable insights into traditional plant knowledge, making it more accessible to individuals without expert knowledge. However, there are areas where the model can be improved. The accuracy of the model can be enhanced by increasing the diversity of the dataset, especially for plants with visually similar leaves. Moreover, the use of multi-modal data (such as plant leaf shape and texture) could further improve classification accuracy. Another potential improvement is deploying the model in a real-time mobile application, allowing users to take pictures of plants in the field and get instant identification and medicinal benefits. # Conclusion This project successfully created a computer vision model capable of identifying medicinal plants and mapping their associated benefits. By combining plant identification with medicinal knowledge, this project not only demonstrates the capabilities of modern AI but also offers a practical tool for those interested in plant-based medicine. Future work can explore expanding the dataset, improving model accuracy with more advanced techniques, and deploying the model as a mobile application to enhance its accessibility. # References Kaggle Dataset: https://www.kaggle.com/datasets/aryashah2k/indian-medicinal-leaves-dataset Research Paper: "Deep Learning for Plant Identification" – Journal of AI Research, 2023. ResNet50 Architecture: He, K., Zhang, X., Ren, S., & Sun, J. (2016). "Deep Residual Learning for Image Recognition". IEEE CVPR 2016. # Acknowledgements I would like to thank the creators of the Indian Medicinal Leaves dataset for making this valuable resource available. I also appreciate the contributions from the machine learning community that provided the frameworks and resources to make this project possible.