An automated assistant for literature review using Generative AI (Gen AI) and Retrieval Augmented by Generation (RAG) techniques. The project searches for articles in the arXiv database and generates automatic abstracts with two method options:
- BART (local): Uses the BART model from Hugging Face for offline generation.
- OpenAI GPT: Uses the OpenAI API for abstract generation.
- Topic Selection: The user can type the desired research topic.
- Model Selection: The user can choose between the BART (local) or OpenAI GPT (API) model.
- Automatic Summary: Generation of academic summaries in a clear and objective way.
- Interactive Dashboard: View articles and their summaries in a user-friendly graphical interface.
See below a preview of the project interface:
- Python 3.8+
- Streamlit
- Hugging Face Transformers
- OpenAI API (optional)
- Clone the repository:
git clone https://github.com/GabrielWendell/AI-Gen-RAG-Bibliographic-Review-Assistant.git
cd AI-Gen-RAG-Bibliographic-Review-Assistant
- Install the dependencies:
pip install -r requirements.txt
- Execute the project:
streamlit run main.py
- Follow the instructions in the terminal:
- Enter the topic you want to search for:
quantum computing
- Choose the summarization method:
1 for BART (local)
2 for OpenAI GPT (API)
- Python
- Streamlit
- Transformers (Hugging Face)
- OpenAI API
- Dash and Plotly for visualization
AI-Gen-RAG-Bibliographic-Review-Assistant/
├── README.md # Project description and instructions for use
├── requirements.txt # Project dependencies
├── main.py # Main script
├── modules/ # Project modules
│ ├── data_fetch.py
│ ├── dashboard.py
│ ├── text_summarization.py
│ └── text_summarization_openai.py
└── LICENSE # License to use
Contributions are welcome! Feel free to submit pull requests or open issues.
This project is licensed under the GPL 3.0 License.
This project was developed by Gabriel Wendell as part of a challenge for the trainee researcher selection process at Itaú.