In today’s fast-paced and high-pressure world, the need for accessible and effective mental health resources has never been more urgent. Modern lifestyles are often accompanied by relentless personal and professional demands, leading to increased stress, anxiety, and other mental health challenges. Constant connectivity, overwhelming information, and societal expectations make it difficult for individuals to effectively disconnect and manage their mental well-being.
With these stressors affecting daily life, we were inspired to create a solution: a software application aimed at addressing these issues. Earlent is an AI-driven mental health companion designed to provide instant, empathetic support to those in need.
Earlent utilizes state-of-the-art cloud infrastructure and advanced AI technologies to develop an empathetic and intelligent virtual companion aimed at enhancing the mental well-being of users. By facilitating compassionate and insightful interactions, the platform seeks to provide immediate and personalized mental health support that is readily accessible from any location. This ensures that individuals in need can easily access the help they require.
The Earlent application provides eight core features designed to enhance mental health management and promote well-being:
1. Chat Interface:
The heart of the platform is an intuitive, AI-driven chat interface that facilitates empathetic conversations. The AI responds to users' mental health-related inquiries in a compassionate, understanding manner, offering guidance, suggestions, and emotional support. Whether someone feels overwhelmed or needs someone to "talk" to, the chat interface is designed to feel like a personal companion. The chat can also recommend therapists on request. Another feature of the chat interface is its ability to recommend websites likes when asked and not only does it do that, but it presents it in a user-friendly interface design.
Key Features:
Speech-to-Text and Text-to-Speech: Users can interact using voice input and receive audio responses, enhancing accessibility and providing a more natural conversation experience.
Multi-Source Web Search Integration: The AI utilizes Tavily, Bing, Google, and YouTube searches to recommend therapists, articles, videos, and other resources upon request, presented in a user-friendly interface.
Personalized Recommendations: It offers tailored suggestions for well-being routines, mindfulness practices, and stress-relief techniques based on user input and mood.
Location-Based Assistance: The AI can help users find nearby mental health professionals or wellness centers when asked.
2. Well-being Routines:
Earlent encourages users to maintain daily or weekly routines focused on mental and emotional health. These routines might include mindfulness practices, meditation activities, or stress relief techniques, tailored to individual needs and preferences. This feature makes use of YouTube and Google API to pull resources and display them based on the users' inputted search data
3. Mood Logger:
Users can record and store their daily moods, serving as a digital journal to help track emotional states over time. When a chat session is finalized, the AI analyzes the user's mood based on the conversation and provides immediate insights. This helps users reflect on their emotions and better understand their mental health. While the app offers mood analysis at the end of chats, future updates may include more extensive AI-driven analysis and trend identification based on users' logged data.
4. Schedule Check-in:
Earlent enables users to schedule periodic check-ins to reflect on their mental state and stay on track with managing their mental health. After scheduling a check-in, users will receive timely notifications to remind them of their upcoming sessions. Specifically, the app sends notifications:
5. Anonymous Login:
Earlent offers an anonymous login option for users who prefer not to create an account or disclose personal information. This feature allows users to access the chat interface and other functionalities without necessarily setting up an account in the application, ensuring privacy and encouraging more individuals to seek support without hesitation. Anonymous users can benefit from the AI-driven chat interface and receive guidance while maintaining complete anonymity.
6. Forgot Password Feature:
Earlent provides a secure "Forgot Password" feature. Users who have forgotten their passwords can enter their registered email addresses to receive a tokenized link. This link allows them to create a new password securely, ensuring they regain access to their accounts without compromising security.
7. Data Management:
Users have control over their data with the ability to download or delete all or selected portions of their chat history with the AI. This allows users to manage their personal information according to their preferences.
8. Account Deletion:
For users who wish to discontinue using the service, Earlent offers an option to delete their accounts completely. This process ensures that all personal data, including chat histories and user profiles, are permanently removed from the system, respecting user privacy and data protection preferences.
In Summary:
Earlent - The Mental Health Companion is an innovative and AI-powered platform designed to provide personalized and empathetic mental health support. By offering features like a responsive chat interface, customizable well-being routines, mood logging with AI analysis, scheduled check-ins with reminders, anonymous login options, secure password recovery, comprehensive data management, and the option to delete accounts, Earlent empowers users to take control of their mental health in a convenient, supportive, and accessible way.
##How we built it
Database: Azure Cosmos DB (v-core) for its robust, scalable database services to manage dynamic data requirements efficiently.
LLM: The Azure OpenAI platform was integrated for generating empathetic, context-aware responses through advanced AI models like GPT 4o mini.
AI Services: Azure Speech Services enable users to interact with the platform using their voice, improving accessibility and user experience. Speech-to-text allowed users to input requests through speech, while text-to-speech provided responses audibly using window.speechSynthesis.
Frontend: React was chosen for its efficiency in building interactive user interfaces, with Vite used to optimize the development experience and MUI (Material-UI) to design a modern, user-friendly interface.
Backend: Flask was chosen to manage backend operations, including API routing and middleware functionalities, due to its lightweight and unopinionated structure.
Agentic Framework: LangChain was integrated to enhance the AI's functionality, enabling the AI to keep track of conversation history and use tools for web search, vector search and map services.
APIs and Services: We utilized several external APIs to enrich the AI's capabilities:
AI Vector Search with FAISS: We integrated FAISS (Facebook AI Similarity Search) for efficient similarity search and clustering of dense vectors, enhancing the AI's ability to retrieve relevant information quickly.
Services & Libraries: pywebpush allowed for real-time communication with users through web push notifications, facilitated by user subscriptions managed through the Subscription model. Flask-Mail was used to manage email communications within the app.
CI/CD Docker was used to containerize the application, ensuring consistency across different computing environments. Github Actions was used to optimize the deployment process by wiring it directly to Render's web services.
Throughout the development of the Earlent application, we encountered several challenges that tested our problem-solving skills and adaptability.
Setting up, allocating, and deploying Azure resources was more time-consuming than we initially anticipated. Navigating quotas and limits sometimes hindered our progress and required us to adjust our resource utilization strategies. It was indeed a great learning experience.
As first-time users of the Flask framework, we needed time to familiarize ourselves with its patterns and structures. The initial learning curve was steep, but the comprehensive documentation and intuitive syntax facilitated our understanding. This experience broadened our expertise in backend development and will undoubtedly benefit future projects.
One of the most significant challenges was building an AI agent using LangChain that effectively interacts with users through various tools. LangChain's innovative architecture allows AI models to function as "reasoning machines," leveraging tools like web search APIs and vector databases to generate more informed responses. However, to the inconsistencies in the LangChain documentation especially the aspects of details, quality, and versioning, we had to carry out extensive research and trial-and-error. Overcoming these hurdles deepened our comprehension of advanced AI architectures and improved our problem-solving abilities.
Working with services involving the Web Push API and speech-to-text functionality was a new experience for our team. We successfully incorporated real-time communication through web push notifications and enhanced accessibility with speech-to-text and text-to-speech capabilities, significantly improving the user experience.
Throughout the development of Earlent, we achieved several milestones that we're particularly proud of:
The development journey of Earlent was a transformative experience that enriched our team in numerous ways:
In Summary
Our journey with Earlent was not just about building an application but also about growing as developers and as a team. We expanded our technical skills across various platforms and services, a better understanding of user-centric design, and reinforced our commitment to ethical considerations in technology.
We are committed to continually enhancing Earlent to better serve our users' mental health needs. Here are some of the exciting features and improvements we have planned for future updates:
We plan to introduce a community forum similar to Reddit, where users can connect with others, share experiences, and offer support. This platform will foster a sense of community, allowing users to engage in discussions, ask questions, and provide mutual encouragement in a safe and moderated environment.
We aim to implement a customizable 3D avatar that interacts with users within the app. Users will be able to personalize the avatar's appearance and choose from a variety of voices and languages. This feature will enhance user engagement by providing a more immersive and personalized experience.
Users will soon be able to manage their data directly through the AI chat interface. This includes scheduling, updating, or deleting check-ins and other personal data by simply communicating with the AI. This feature will streamline data management, making it more intuitive and user-friendly.
We plan to develop a secure communication bridge between users and mental health professionals. This feature will allow users to connect with licensed therapists and doctors directly through the app, facilitating access to professional support when needed.
To make Earlent accessible to a broader audience and promote diversity, we will introduce support for multiple languages. Users will be able to interact with the AI and navigate the app in their preferred language, breaking down language barriers and reaching a global user base.
We are working on further enhancing our agentic workflow to allow the AI model to keep track of users' progress over time. This will enable the AI to provide more personalized support and insights, which will be presented to users through an interactive dashboard. This feature will help users visualize their mental health journey and identify areas of improvement.
We plan to build a comprehensive knowledge base of mental health resources that the AI can refer to when assisting users. Additionally, users will have the ability to "favorite" resources, allowing for easy access to preferred articles, exercises, or recommendations in the future.
To enhance personalization, we will introduce a variety of voice options for the AI, allowing users to choose the voice that they find most comforting and relatable. This includes different accents, tones, and speech patterns to cater to individual preferences.
By focusing on these developments, we aim to make Earlent an even more powerful and versatile tool for mental health support. Our goal is to create a platform that not only provides empathetic assistance but also fosters a supportive community, offers professional connections, and adapts to the unique needs of each user.
There are no models linked
There are no models linked
