Multi-Source AI Summarization and Query-Answering for Incremental Study

✨ What new feature or change would you like to see added in RemNote?

I propose two enhancements to RemNote’s AI capabilities. First, I want the AI to generate summaries for multiple sources simultaneously, including PDFs, YouTube videos, and audio files, rather than being limited to summarising a single file at a time. Currently, RemNote supports uploading multiple files to individual Rems, but the summary feature only processes one source per summary. Second, I want the AI chat to gather knowledge from multiple uploaded sources to answer my queries, instead of relying on a single source. This would allow the AI chat to provide more comprehensive and contextual responses by drawing on all relevant materials. The feature should also support incrementally adding new sources (e.g., notes from new class sessions) and updating the summaries and AI chat knowledge base dynamically.

🤔 What problem does it solve for you? How would it improve your workflow or experience with RemNote?

These enhancements would address the challenge of studying lengthy, overwhelming chapters that require up to 60 hours to review fully. My course chapters are extensive, and revisiting an entire chapter after completion is daunting. Currently, RemNote’s AI can only summarise or answer questions based on a single source, making it difficult to synthesise information from multiple class sessions efficiently. By enabling the AI to summarise multiple sources at once, I could upload notes, videos, or audio from each class session as it’s completed and receive a consolidated summary of all materials, allowing me to study smaller, manageable portions incrementally. Similarly, an AI chat that draws on multiple sources would provide more accurate and relevant answers to my questions, as it could reference all my uploaded materials.

These changes would improve my workflow by supporting a modular, session-by-session study approach. I could process and review material in real-time as classes progress, reinforcing learning without waiting for a chapter to be complete. The ability to add new sources and update summaries and AI chat responses dynamically would keep my study materials organized and aligned with my course pace. This would make studying more efficient, less stressful, and better suited to managing complex, multi-source content.

🚀 Are there any examples of this suggestion implemented in other apps (if applicable)?

Similar functionalities exist in other applications, demonstrating the feasibility and value of these features:

• Google’s NotebookLM: NotebookLM allows users to upload multiple sources (PDFs, YouTube videos, audio files, web URLs) and generates summaries or answers questions based on all sources simultaneously. It supports up to 50 sources with a 25-million-word capacity, providing a cohesive summary and contextual responses across materials.

• Claude (Anthropic): Claude can process multiple uploaded documents or sources at once, generating summaries or answering queries by integrating information from all inputs, offering a similar multi-source knowledge synthesis.

• AI Notebook App: This app supports multi-type inputs (audio, text, PDFs, YouTube videos) and uses AI to summarize content or answer questions based on multiple sources, streamlining the analysis of diverse materials.

Afforai

Notion (with AI)

Genei

SciSummary

FlowHunt

These examples show how AI-driven summarization and query-answering across multiple sources can enhance learning. Implementing these features in RemNote would make it a more powerful tool for students like me managing extensive course materials.