first commit

README.md

@@ -1,13 +1,31 @@
 ---
-title: PaperGPT
-emoji: ⚡
-colorFrom: indigo
-colorTo: indigo
+title: papergpt
+app_file: src/app.py
 sdk: gradio
 sdk_version: 3.35.2
-app_file: app.py
-pinned: false
-license: gpl-3.0
 ---
+# PaperGPT
+Paper editor tool
 
-Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
+
+``` python 3.8
+python -m pip install -r requirements.txt
+cd src
+python app.py
+```
+
+
+### deploy to huggingface space
+
+```
+python -m pip install huggingface_hub
+huggingface-cli login
+```
+
+```
+gradio deploy
+```
+
+```
+setup space repository secret: OPENAI_API_KEY
+```

requirements.txt

@@ -0,0 +1,4 @@
+gradio==3.35.2
+langchain==0.0.146
+openai==0.27.2
+tiktoken==0.4.0

sample/.ipynb_checkpoints/sample_abstract-checkpoint.tex

@@ -0,0 +1,8 @@
+
+\begin{abstract}
+With the emerging trend of GPT models, we establish a framework, AutoML-GPT, integrates with a comprehensive set of tools and libraries, granting access to a wide range of data preprocessing techniques, feature engineering methods, and model selection algorithms. Users can specify their requirements, constraints, and evaluation metrics through a conversational interface.
+Throughout the process, AutoML-GPT employs advanced techniques for hyperparameter optimization, and model selection, ensuring that the resulting model achieves optimal performance. The system effectively manages the complexity of the machine learning pipeline, guiding users towards the best choices without requiring deep domain knowledge.
+Through our experimental results on diverse datasets, we demonstrate that AutoML-GPT significantly reduces the time and effort required for machine learning tasks. Its ability to leverage the vast knowledge encoded in large language models enables it to provide valuable insights, identify potential pitfalls, and suggest effective solutions to common challenges faced during model training. Demo link: \url{https://youtu.be/QFoQ4pj9OHw}
+\end{abstract}
+
+

sample/sample.tex

@@ -0,0 +1,233 @@
+%%%%%%%% ICML 2023 EXAMPLE LATEX SUBMISSION FILE %%%%%%%%%%%%%%%%%
+
+\documentclass{article}
+
+% Recommended, but optional, packages for figures and better typesetting:
+\usepackage{microtype}
+\usepackage{graphicx}
+\usepackage{subfigure}
+\usepackage{booktabs} % for professional tables
+
+% hyperref makes hyperlinks in the resulting PDF.
+% If your build breaks (sometimes temporarily if a hyperlink spans a page)
+% please comment out the following usepackage line and replace
+% \usepackage{icml2023} with \usepackage[nohyperref]{icml2023} above.
+\usepackage{hyperref}
+
+
+% Attempt to make hyperref and algorithmic work together better:
+\newcommand{\theHalgorithm}{\arabic{algorithm}}
+
+% Use the following line for the initial blind version submitted for review:
+% \usepackage{icml2023}
+
+% If accepted, instead use the following line for the camera-ready submission:
+\usepackage[accepted]{icml2023}
+
+% For theorems and such
+\usepackage{amsmath}
+\usepackage{amssymb}
+\usepackage{mathtools}
+\usepackage{amsthm}
+
+% if you use cleveref..
+\usepackage[capitalize,noabbrev]{cleveref}
+
+%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
+% THEOREMS
+%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
+\theoremstyle{plain}
+\newtheorem{theorem}{Theorem}[section]
+\newtheorem{proposition}[theorem]{Proposition}
+\newtheorem{lemma}[theorem]{Lemma}
+\newtheorem{corollary}[theorem]{Corollary}
+\theoremstyle{definition}
+\newtheorem{definition}[theorem]{Definition}
+\newtheorem{assumption}[theorem]{Assumption}
+\theoremstyle{remark}
+\newtheorem{remark}[theorem]{Remark}
+
+% Todonotes is useful during development; simply uncomment the next line
+%    and comment out the line below the next line to turn off comments
+%\usepackage[disable,textsize=tiny]{todonotes}
+\usepackage[textsize=tiny]{todonotes}
+
+
+% The \icmltitle you define below is probably too long as a header.
+% Therefore, a short form for the running title is supplied here:
+% \icmltitlerunning{Submission and Formatting Instructions for ICML 2023}
+
+\begin{document}
+
+\twocolumn[
+\icmltitle{AutoML-GPT: Large Language Model for AutoML}
+
+% It is OKAY to include author information, even for blind
+% submissions: the style file will automatically remove it for you
+% unless you've provided the [accepted] option to the icml2023
+% package.
+
+% List of affiliations: The first argument should be a (short)
+% identifier you will use later to specify author affiliations
+% Academic affiliations should list Department, University, City, Region, Country
+% Industry affiliations should list Company, City, Region, Country
+
+% You can specify symbols, otherwise they are numbered in order.
+% Ideally, you should not use this facility. Affiliations will be numbered
+% in order of appearance and this is the preferred way.
+% \icmlsetsymbol{equal}{*}
+
+\begin{icmlauthorlist}
+\icmlauthor{Yun-Da Tsai}{NTU}
+\icmlauthor{Yu-Che Tsai}{NTU}
+\icmlauthor{Bo-Wei Huang}{NTU}
+\icmlauthor{Chun-Pai Yang}{NTU}
+\icmlauthor{Shou-De Lin}{NTU}
+%\icmlauthor{}{sch}
+% \icmlauthor{Firstname8 Lastname8}{sch}
+% \icmlauthor{Firstname8 Lastname8}{yyy,comp}
+%\icmlauthor{}{sch}
+%\icmlauthor{}{sch}
+\end{icmlauthorlist}
+
+\icmlaffiliation{NTU}{Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan}
+% \icmlaffiliation{comp}{Company Name, Location, Country}
+% \icmlaffiliation{sch}{School of ZZZ, Institute of WWW, Location, Country}
+
+\icmlcorrespondingauthor{Yun-Da Tsai}{[email protected]}
+% \icmlcorrespondingauthor{Firstname2 Lastname2}{[email protected]}
+
+% You may provide any keywords that you
+% find helpful for describing your paper; these are used to populate
+% the "keywords" metadata in the PDF but will not be shown in the document
+\icmlkeywords{Machine Learning, ICML}
+
+\vskip 0.3in
+]
+
+% this must go after the closing bracket ] following \twocolumn[ ...
+
+% This command actually creates the footnote in the first column
+% listing the affiliations and the copyright notice.
+% The command takes one argument, which is text to display at the start of the footnote.
+% The \icmlEqualContribution command is standard text for equal contribution.
+% Remove it (just {}) if you do not need this facility.
+
+\printAffiliationsAndNotice{}  % leave blank if no need to mention equal contribution
+% \printAffiliationsAndNotice{\icmlEqualContribution} % otherwise use the standard text.
+
+\begin{abstract}
+With the emerging trend of GPT models, we establish a framework, AutoML-GPT, integrates with a comprehensive set of tools and libraries, granting access to a wide range of data preprocessing techniques, feature engineering methods, and model selection algorithms. Users can specify their requirements, constraints, and evaluation metrics through a conversational interface.
+Throughout the process, AutoML-GPT employs advanced techniques for hyperparameter optimization, and model selection, ensuring that the resulting model achieves optimal performance. The system effectively manages the complexity of the machine learning pipeline, guiding users towards the best choices without requiring deep domain knowledge.
+Through our experimental results on diverse datasets, we demonstrate that AutoML-GPT significantly reduces the time and effort required for machine learning tasks. Its ability to leverage the vast knowledge encoded in large language models enables it to provide valuable insights, identify potential pitfalls, and suggest effective solutions to common challenges faced during model training. Demo link: \url{https://youtu.be/QFoQ4pj9OHw}
+\end{abstract}
+
+\section{Introduction}
+Automated Machine Learning (AutoML) has gained significant attention in recent years as a powerful technique for automating various stages of the machine learning workflow. It aims to simplify the model development process by automatically searching, selecting, and optimizing machine learning models without extensive manual intervention. AutoML has the potential to democratize machine learning and make it accessible to a broader audience, including non-experts and domain specialists.
+AutoML encompasses tasks such as data pre-processing, feature engineering, model selection, and hyperparameter tuning. These tasks require expertise, time, and computational resources. To address these challenges, researchers have proposed various approaches and frameworks for AutoML, such as Auto-sklearn~\cite{autosklearn}, Auto-Keras~\cite{autokeras}, and AutoGluon~\cite{autoGluon}. These approaches aim to automate the process of model selection and configuration, making it easier for practitioners to build accurate and efficient machine learning models.
+
+Large language models, such as OpenAI's GPT3~\cite{GPT3} and Google's PaLM~\cite{chowdhery2022palm}, have emerged as powerful tools in natural language processing and understanding. These models have been extensively trained on vast amounts of text data and have demonstrated remarkable capabilities in language understanding, text generation, sentiment analysis, and other language-related tasks. Large language models excel at capturing complex patterns, understanding context, and generating coherent responses.
+The strength of large language models lies in their ability to comprehend and process unstructured textual data effectively. They learn rich semantic representations of language, enabling them to understand the nuances and subtleties present in text. By leveraging pre-trained language models, researchers have achieved significant advancements in various natural language processing tasks, including machine translation, question-answering, and language generation.
+
+While large language models have found success in these specific applications, their comprehensive integration into the AutoML framework is an area that remains relatively unexplored. Existing research has focused on utilizing language models for individual tasks within AutoML, such as data pre-processing, feature engineering. However, the potential of leveraging these models to automate the entire AutoML pipeline, from data preparation to hyperparameter optimization, has not been extensively studied, which becomes the motivation of this work. 
+Large language models exhibit exceptional strengths in AutoML from multiple perspectives. In terms of data understanding, LLMs could be used in data preprocessing by efficiently handling missing values, normalizing or scaling features, and detecting outliers. Additionally, large language models have the ability to conduct correlation analysis, discover causal relationships, and perform feature selection, effectively identifying and eliminating irrelevant or redundant features. Furthermore, these models contribute to the identification of potential models that are well-suited for a given dataset and task, providing valuable guidance in the model selection phase. In this paper, we designed AutoML-GPT, a dual agent system, that is build upon large language models. The agents in the system are both capable of communication, planning and tools using in order to complete complex machine learning tasks. In our experiments, AutoML-GPT showed compatible performance compared to human experts in  11 tabular datasets chosen from recent Kaggle competitions that reflect real modern-day ML applications.
+
+\vspace{-10pt}
+
+
+\section{Large Language Models For AutoML}
+\begin{figure}[t!]
+  \centering
+  \includegraphics[width=1\linewidth]{autoML-GPT.pdf}
+  \caption{Pipeline of AutoML-GPT.}
+  \label{fig:autoML_pipeline}
+  \vspace{-10pt}
+\end{figure}
+To integrate a Large Language Model (LLM) into the AutoML framework, we propose a systematic methodology that involves two agents: the Reasoning agent and the Coding agent as illustrated in Figure~\ref{fig:autoML_pipeline}. The Reasoning agent handles the task of understanding human requests and planning the sequence of tool usage within the AutoML pipeline. It leverages the advanced language comprehension capabilities of the LLM to accurately interpret and understand complex and multiple requests, such as end-to-end training. The Reasoning agent is responsible for planning the sequence of tool usage, combining different tools in an optimal manner to achieve the desired AutoML pipeline. Additionally, it monitors the status of the pipeline, keeping track of completed tasks, such as model selection and dataset loading. This enables the Reasoning agent to efficiently manage the workflow and provide timely updates to the user.
+The Coding agent, on the other hand, is responsible for the implementation of the planned tasks. It starts by reading relevant documentation and modules to gain the necessary knowledge. Using its understanding of programming languages and AutoML tools, the Coding agent generates thoughts and formulates the code required for executing the designated tasks. It implements the code in a structured manner and executes it to carry out the specified actions within the AutoML pipeline. The Coding agent plays a crucial role in translating the reasoning and planning of the Reasoning agent into executable code.
+
+The interaction between the Reasoning and Coding agents is iterative and collaborative. The Reasoning agent receives the execution output from the Coding agent and utilizes it to provide relevant and informative responses to the user. This enables the Reasoning agent to communicate the progress of the AutoML pipeline, reply to user queries, and deliver meaningful insights based on the executed tasks.
+By employing this methodology with the Reasoning and Coding agents, the integration of LLM into the AutoML framework benefits from the reasoning and planning capabilities of the Reasoning agent, as well as the code generation and execution expertise of the Coding agent. This collaborative approach ensures accurate interpretation of user requests, precise planning of tool usage, reliable code implementation, and effective communication with the user, facilitating a seamless and efficient AutoML pipeline.
+
+% \begin{table*}[!bth]
+% \centering
+% \caption{ % Overview of 
+% Summary of the 11 Kaggle competitions used in our benchmark, including: the date of each competition, around how many teams participated, and the number of rows/columns in the provided training data.  
+% The metrics used to evaluate predictive performance in each competition include: root mean squared logarithmic error (RMSLE), coefficient of determination ($R^2$), mean absolute error (MAE), logarithmic loss (log-loss), 
+% area under the Receiver Operating Characteristic curve (AUC), and normalized Gini index (Gini).  
+% }
+% \label{tab:kaggle}
+
+% \begin{tabular}{llllllll}
+% \toprule
+% \textbf{Competition} & \textbf{Task} & \textbf{Metric} & \textbf{Year} & \textbf{Teams} & \textbf{Rows} &  \textbf{Colums}  \\
+% \midrule
+% house-prices-advanced-regression-techniques & regression & RMSLE & current & 5100 & 1460 & 80  \\
+% mercedes-benz-greener-manufacturing & regression & $R^2$ & 2017 & 3800 & 4209 & 377 \\
+%  santander-value-prediction-challenge & regression & RMSLE & 2019 & 4500 & 4459 & 4992  \\
+% allstate-claims-severity & regression & MAE & 2017 & 3000 & 1.8E+5 & 131 \\
+% bnp-paribas-cardif-claims-management & binary & log-loss & 2016  & 2900 & 1.1E+5 & 132 \\ 
+% santander-customer-transaction-prediction & binary & AUC & 2019 & 8800 & 2.2E+5 & 201 \\
+% santander-customer-satisfaction & binary & AUC & 2016 & 5100 & 7.6E+4 & 370 \\
+% porto-seguro-safe-driver-prediction & binary & Gini & 2018 & 5200 & 6.0E+5 & 58 \\
+% ieee-fraud-detection & binary & AUC & 2019 & 6400 & 5.9E+5 & 432 \\
+% walmart-recruiting-trip-type-classification & multi-class & log-loss & 2016 & 1000 & 6.5E+5 & 7  \\
+% otto-group-product-classification-challenge & multi-class & log-loss & 2015 & 3500 & 6.2E+4 & 94\\
+
+% \bottomrule
+% \end{tabular}
+% \end{table*}
+
+
+% \begin{table}[!bth]
+% \centering
+% \caption{ % Overview of 
+% Summary of the performance in rank percentile across 9 Kaggle competitions.
+% }
+% \label{tab:kaggle}
+
+% \begin{tabular}{ll}
+% \toprule
+% \textbf{Competition} & \textbf{PR}  \\
+% \midrule
+% house-prices-advanced-regression-techniques &  77\\
+% mercedes-benz-greener-manufacturing & 89 \\
+% santander-value-prediction-challenge &  3 \\
+% allstate-claims-severity & 34 \\
+% santander-customer-transaction-prediction & 27 \\
+% santander-customer-satisfaction & 32 \\
+% porto-seguro-safe-driver-prediction & 59 \\
+% % ieee-fraud-detection &  99 \\
+% bnp-paribas-cardif-claims-management & 22 \\ 
+% % walmart-recruiting-trip-type-classification & 99 \\
+% otto-group-product-classification-challenge & 66 \\
+
+% \bottomrule
+% \end{tabular}
+% \end{table}
+
+
+\begin{figure}[t!]
+  \centering
+  \includegraphics[width=1\linewidth]{LegendPlotStar-pdf.png}
+  \includegraphics[width=1\linewidth]{KaggleAbsolutePercentilePlot_4hStar.pdf}
+  \vspace{-20pt}
+  \caption{Summary of the performance in rank percentile on Leaderboard across 9 Kaggle competitions compared to other well known automl tools.}
+  \label{fig:kaggle}
+  \vspace{-10pt}
+\end{figure}
+
+\vspace{-10pt}
+\section{Experimental Results}
+For the experiment, we opted for the widely used Kaggle benchmark, which is prominent in automl research literature. We selected 9 tabular datasets from recent Kaggle competitions to represent contemporary applications. These competitions encompass a range of tasks, including regression and (binary/multiclass) classification. The competition organizers have tailored different metrics to evaluate the predictive performance based on the specific problem at hand.
+Every dataset is processed by AutoML-GPT in a four instruction sequence though the LLM (1) Explore the dataset (2) Process the dataset (3) Select the model (4) Fine tune the parameters. In our experiment, we will be using single model without any ensemble technique. The results reported in Figure~\ref{fig:kaggle} are the rank percentile on the kaggle competition leader board. Note that each of the result is a one-shot submission to kaggle without any fine-tune after local development.
+
+\bibliography{example_paper}
+\bibliographystyle{icml2023}
+
+
+
+
+
+\end{document}
+

sample/sample_abstract.tex

@@ -0,0 +1,8 @@
+
+\begin{abstract}
+With the emerging trend of GPT models, we establish a framework, AutoML-GPT, integrates with a comprehensive set of tools and libraries, granting access to a wide range of data preprocessing techniques, feature engineering methods, and model selection algorithms. Users can specify their requirements, constraints, and evaluation metrics through a conversational interface.
+Throughout the process, AutoML-GPT employs advanced techniques for hyperparameter optimization, and model selection, ensuring that the resulting model achieves optimal performance. The system effectively manages the complexity of the machine learning pipeline, guiding users towards the best choices without requiring deep domain knowledge.
+Through our experimental results on diverse datasets, we demonstrate that AutoML-GPT significantly reduces the time and effort required for machine learning tasks. Its ability to leverage the vast knowledge encoded in large language models enables it to provide valuable insights, identify potential pitfalls, and suggest effective solutions to common challenges faced during model training. Demo link: \url{https://youtu.be/QFoQ4pj9OHw}
+\end{abstract}
+
+

src/.ipynb_checkpoints/app-checkpoint.py

@@ -0,0 +1,68 @@
+import os
+import gradio as gr
+from suggest import Suggest
+from edit import Editor
+from config import configure_logging
+
+
+configure_logging()
+
+
+with gr.Blocks() as demo:
+    
+    title = gr.Button("PaperGPT", interactive=False)
+    key = gr.Textbox(label="openai_key", value=os.environ.get('OPENAI_API_KEY'))
+    
+    with gr.Tab("Edit"):
+        
+        handler = Editor()
+        txt_in = gr.Textbox(label="Input", lines=11, max_lines=11, value=handler.sample_content)
+        btn = gr.Button("Edit")
+        txt_out = gr.Textbox(label="Output", lines=11, max_lines=11, value="GPT will serve as your editor and modify the paragraph for you.")
+        btn.click(handler.generate, inputs=[txt_in, key], outputs=[txt_out])
+    
+    with gr.Tab("Suggest"):
+        
+        idea_list = []
+        max_ideas = 20
+        handler = Suggest(max_ideas)
+
+        def select(name: str):
+            global idea_list
+            for i in idea_list:
+                if i['title'] == name:
+                    return [
+                        gr.Textbox.update(value=i["thought"], label="thought", visible=True),
+                        gr.Textbox.update(value=i["action"], label="action", visible=True),
+                        gr.Textbox.update(value=i["original"], label="original", visible=True, max_lines=5, lines=5),
+                        gr.Textbox.update(value=i["improved"], label="improved", visible=True, max_lines=5, lines=5)
+                    ]
+
+        with gr.Row().style(equal_height=True):
+            with gr.Column(scale=0.95):
+                txt_in = gr.Textbox(label="Input", lines=11, max_lines=11, value=handler.sample_content[2048+2048+256-45:])
+            with gr.Column(scale=0.05):
+                upload = gr.File(file_count="single", file_types=["tex", ".pdf"])
+                btn = gr.Button("Analyze")
+                upload.change(handler.read_file, inputs=upload, outputs=txt_in)
+
+        textboxes = []
+        sug = gr.Textbox("GPT will give suggestions and help you improve the paper quality.", interactive=False, show_label=False).style(text_align="center")
+        with gr.Row():
+            with gr.Column(scale=0.4):
+                for i in range(max_ideas):
+                    t = gr.Button("", visible=False)
+                    textboxes.append(t)
+            with gr.Column(scale=0.6):
+                thought = gr.Textbox(label="thought", visible=False, interactive=False)
+                action = gr.Textbox(label="action", visible=False, interactive=False)
+                original = gr.Textbox(label="original", visible=False, max_lines=5, lines=5, interactive=False)
+                improved = gr.Textbox(label="improved", visible=False, max_lines=5, lines=5, interactive=False)
+
+        btn.click(handler.generate, inputs=[txt_in, key], outputs=[sug, btn, thought, action, original, improved] + textboxes)
+        for i in textboxes:
+            i.click(select, inputs=[i], outputs=[thought, action, original, improved])
+            
+
+    # demo.launch(server_name="0.0.0.0", server_port=7653, share=True, enable_queue=True)
+    demo.launch(enable_queue=True)

src/.ipynb_checkpoints/config-checkpoint.py

@@ -0,0 +1,17 @@
+import logging
+
+
+def configure_logging(logging_level: str = "INFO"):
+    logging_level = logging_level.upper()
+    numeric_level = getattr(logging, logging_level, None)
+
+    if not isinstance(numeric_level, int):
+        raise Exception(f"Invalid log level: {numeric_level}")
+
+    logging.basicConfig(
+        level=numeric_level,
+        datefmt="%Y-%m-%d %H:%M:%S",
+        format=
+        "[%(asctime)s] [%(process)s] [%(levelname)s] [%(module)s]: #%(funcName)s @%(lineno)d: %(message)s",
+    )
+    logging.info(f"Logging level: {logging_level}")

src/.ipynb_checkpoints/edit-checkpoint.py

@@ -0,0 +1,43 @@
+import logging
+import tiktoken
+import gradio as gr
+from langchain.text_splitter import CharacterTextSplitter
+from utils import fetch_chat
+from typing import List
+
+
+class Editor():
+    
+    def __init__(self, model: str = "gpt-3.5-turbo"):
+        self.encoder = tiktoken.encoding_for_model(model)
+        self.model = model
+        with open("./sample/sample_abstract.tex", "r") as f:
+            self.sample_content = f.read()
+            
+    def split_chunk(self, text, chunk_size: int = 2000) -> List[str]:
+        text_splitter = CharacterTextSplitter.from_tiktoken_encoder(
+            chunk_size=100, chunk_overlap=0
+        )
+        text_list = text_splitter.split_text(text)
+        return text_list
+            
+    def generate(self, text: str, openai_key: str):
+        
+        logging.info("start editing")
+        
+        try:
+            prompt = f"""
+            I am a computer science student.
+            I am writing my research paper.
+            You are my editor.
+            Your goal is to improve my paper quality at your best.
+            Please edit the following paragraph and return the modified paragraph.
+            If the paragraph is written in latex, return the modified paragraph in latex.
+
+            ```
+            {text}
+            ```
+            """
+            return fetch_chat(prompt, openai_key, model=self.model)
+        except Exception as e:
+            raise gr.Error(str(e))

src/.ipynb_checkpoints/papergpt-checkpoint.ipynb

@@ -0,0 +1,491 @@
+{
+ "cells": [
+  {
+   "cell_type": "raw",
+   "id": "b77c4818-9d92-4581-a2fb-2b38da776a8b",
+   "metadata": {},
+   "source": [
+    "# python >= 3.8\n",
+    "import sys\n",
+    "!{sys.executable} -m pip insatll langchain, gradio, tiktoken, unstructured"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "id": "80b2033d-b985-440d-a01f-e7f8547a6801",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.8) or chardet (5.1.0)/charset_normalizer (2.0.12) doesn't match a supported version!\n",
+      "  warnings.warn(\"urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported \"\n",
+      "/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/tqdm/auto.py:21: TqdmWarning: IProgress not found. Please update jupyter and ipywidgets. See https://ipywidgets.readthedocs.io/en/stable/user_install.html\n",
+      "  from .autonotebook import tqdm as notebook_tqdm\n"
+     ]
+    }
+   ],
+   "source": [
+    "# from langchain.text_splitter import LatexTextSplitter\n",
+    "from langchain.text_splitter import RecursiveCharacterTextSplitter\n",
+    "from typing import Any\n",
+    "import requests\n",
+    "import logging\n",
+    "import json\n",
+    "import tiktoken\n",
+    "import gradio as gr\n",
+    "from langchain.document_loaders import UnstructuredPDFLoader"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 2,
+   "id": "720927dd-848e-47ff-a847-4e1097768561",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [],
+   "source": [
+    "turbo_encoding = tiktoken.encoding_for_model(\"gpt-3.5-turbo\")\n",
+    "with open(\"sample.tex\", \"r\") as f:\n",
+    "    content = f.read()"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 3,
+   "id": "13bc48fd-a048-4635-99c4-79ddb62d5c4d",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [],
+   "source": [
+    "class LatexTextSplitter(RecursiveCharacterTextSplitter):\n",
+    "    \"\"\"Attempts to split the text along Latex-formatted layout elements.\"\"\"\n",
+    "\n",
+    "    def __init__(self, **kwargs: Any):\n",
+    "        \"\"\"Initialize a LatexTextSplitter.\"\"\"\n",
+    "        separators = [\n",
+    "            # First, try to split along Latex sections\n",
+    "            \"\\chapter{\",\n",
+    "            \"\\section{\",\n",
+    "            \"\\subsection{\",\n",
+    "            \"\\subsubsection{\",\n",
+    "\n",
+    "            # Now split by environments\n",
+    "            \"\\begin{\"\n",
+    "            # \"\\n\\\\begin{enumerate}\",\n",
+    "            # \"\\n\\\\begin{itemize}\",\n",
+    "            # \"\\n\\\\begin{description}\",\n",
+    "            # \"\\n\\\\begin{list}\",\n",
+    "            # \"\\n\\\\begin{quote}\",\n",
+    "            # \"\\n\\\\begin{quotation}\",\n",
+    "            # \"\\n\\\\begin{verse}\",\n",
+    "            # \"\\n\\\\begin{verbatim}\",\n",
+    "\n",
+    "            ## Now split by math environments\n",
+    "            # \"\\n\\\\begin{align}\",\n",
+    "            # \"$$\",\n",
+    "            # \"$\",\n",
+    "\n",
+    "            # Now split by the normal type of lines\n",
+    "            \" \",\n",
+    "            \"\",\n",
+    "        ]\n",
+    "        super().__init__(separators=separators, **kwargs)\n",
+    "\n",
+    "\n",
+    "def json_validator(text: str, openai_key: str, retry: int = 3):\n",
+    "    for _ in range(retry):\n",
+    "        try:\n",
+    "            return json.loads(text)\n",
+    "        except Exception:\n",
+    "            \n",
+    "            try:\n",
+    "                prompt = f\"Modify the following into a valid json format:\\n{text}\"\n",
+    "                prompt_token_length = len(turbo_encoding.encode(prompt))\n",
+    "\n",
+    "                data = {\n",
+    "                    \"model\": \"text-davinci-003\",\n",
+    "                    \"prompt\": prompt,\n",
+    "                    \"max_tokens\": 4097 - prompt_token_length - 64\n",
+    "                }\n",
+    "                headers = {\n",
+    "                    \"Content-Type\": \"application/json\",\n",
+    "                    \"Authorization\": f\"Bearer {openai_key}\"\n",
+    "                }\n",
+    "                for _ in range(retry):\n",
+    "                    response = requests.post(\n",
+    "                        'https://api.openai.com/v1/completions',\n",
+    "                        json=data,\n",
+    "                        headers=headers,\n",
+    "                        timeout=300\n",
+    "                    )\n",
+    "                    if response.status_code != 200:\n",
+    "                        logging.warning(f'fetch openai chat retry: {response.text}')\n",
+    "                        continue\n",
+    "                    text = response.json()['choices'][0]['text']\n",
+    "                    break\n",
+    "            except:\n",
+    "                return response.json()['error']\n",
+    "            \n",
+    "    return text"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 9,
+   "id": "a34bf526-fb0c-4b5e-8c3d-bab7a13e5fe7",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [],
+   "source": [
+    "def analyze(latex_whole_document: str, openai_key: str, progress):\n",
+    "    \n",
+    "    logging.info(\"start analysis\")\n",
+    "    \n",
+    "    output_format = \"\"\"\n",
+    "\n",
+    "    ```json\n",
+    "    [\n",
+    "        \\\\ Potential point for improvement 1\n",
+    "        {{\n",
+    "            \"title\": string \\\\ What this modification is about\n",
+    "            \"thought\": string \\\\ The reason why this should be improved\n",
+    "            \"action\": string \\\\ how to make improvement\n",
+    "            \"original\": string \\\\ the original latex snippet that can be improved\n",
+    "            \"improved\": string \\\\ the improved latex snippet which address your point\n",
+    "        }},\n",
+    "        {{}}\n",
+    "    ]\n",
+    "    ```\n",
+    "    \"\"\"\n",
+    "    \n",
+    "    chunk_size = 1000\n",
+    "    # for _ in range(5):\n",
+    "    #     try:\n",
+    "    #         latex_splitter = LatexTextSplitter(\n",
+    "    #             chunk_size=min(chunk_size, len(latex_whole_document)),\n",
+    "    #             chunk_overlap=0,\n",
+    "    #         )\n",
+    "    #         docs = latex_splitter.create_documents([latex_whole_document])\n",
+    "    #         break\n",
+    "    #     except:\n",
+    "    #         chunk_size // 2\n",
+    "\n",
+    "    latex_splitter = LatexTextSplitter(\n",
+    "        chunk_size=min(chunk_size, len(latex_whole_document)),\n",
+    "        chunk_overlap=0,\n",
+    "    )\n",
+    "    docs = latex_splitter.create_documents([latex_whole_document])\n",
+    "    \n",
+    "    progress(0.05)\n",
+    "    ideas = []\n",
+    "    for doc in progress.tqdm(docs):\n",
+    "\n",
+    "        prompt = f\"\"\"\n",
+    "        I'm a computer science student.\n",
+    "        You are my editor.\n",
+    "        Your goal is to improve my paper quality at your best.\n",
+    "        \n",
+    "        \n",
+    "        ```\n",
+    "        {doc.page_content}\n",
+    "        ```\n",
+    "        The above is a segment of my research paper. If the end of the segment is not complete, just ignore it.\n",
+    "        Point out the parts that can be improved.\n",
+    "        Focus on grammar, writing, content, section structure.\n",
+    "        Ignore comments and those that are outside the document environment.\n",
+    "        List out all the points with a latex snippet which is the improved version addressing your point.\n",
+    "        Same paragraph should be only address once.\n",
+    "        Output the response in the following valid json format:\n",
+    "        {output_format}\n",
+    "\n",
+    "        \"\"\"\n",
+    "        \n",
+    "        idea = fetch_chat(prompt, openai_key)\n",
+    "        if isinstance(idea, list):\n",
+    "            ideas += idea\n",
+    "            break\n",
+    "        else:\n",
+    "            raise gr.Error(idea)\n",
+    "\n",
+    "    logging.info('complete analysis')\n",
+    "    return ideas\n",
+    "\n",
+    "\n",
+    "def fetch_chat(prompt: str, openai_key: str, retry: int = 3):\n",
+    "    json = {\n",
+    "        \"model\": \"gpt-3.5-turbo-16k\",\n",
+    "        \"messages\": [{\"role\": \"user\", \"content\": prompt}]\n",
+    "    }\n",
+    "    headers = {\n",
+    "        \"Content-Type\": \"application/json\",\n",
+    "        \"Authorization\": f\"Bearer {openai_key}\"\n",
+    "    }\n",
+    "    for _ in range(retry):\n",
+    "        response = requests.post(\n",
+    "            'https://api.openai.com/v1/chat/completions',\n",
+    "            json=json,\n",
+    "            headers=headers,\n",
+    "            timeout=300\n",
+    "        )\n",
+    "        if response.status_code != 200:\n",
+    "            logging.warning(f'fetch openai chat retry: {response.text}')\n",
+    "            continue\n",
+    "        result = response.json()['choices'][0]['message']['content']\n",
+    "        return json_validator(result, openai_key)\n",
+    "    \n",
+    "    return response.json()[\"error\"]\n",
+    "    \n",
+    "    \n",
+    "def read_file(f: str):\n",
+    "    if f is None:\n",
+    "        return \"\"\n",
+    "    elif f.name.endswith('pdf'):\n",
+    "        loader = UnstructuredPDFLoader(f.name)\n",
+    "        pages = loader.load_and_split()\n",
+    "        return \"\\n\".join([p.page_content for p in pages])\n",
+    "    elif f.name.endswith('tex'):\n",
+    "        with open(f.name, \"r\") as f:\n",
+    "            return f.read()\n",
+    "    else:\n",
+    "        return \"Only support .tex & .pdf\""
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 11,
+   "id": "cec63e87-9741-4596-a3f1-a901830e3771",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/components/button.py:112: UserWarning: The `style` method is deprecated. Please set these arguments in the constructor instead.\n",
+      "  warnings.warn(\n",
+      "/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/layouts.py:80: UserWarning: The `style` method is deprecated. Please set these arguments in the constructor instead.\n",
+      "  warnings.warn(\n",
+      "/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/components/textbox.py:259: UserWarning: The `style` method is deprecated. Please set these arguments in the constructor instead.\n",
+      "  warnings.warn(\n"
+     ]
+    },
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Running on local URL:  http://0.0.0.0:7653\n",
+      "Running on public URL: https://73992a9ff20adf33a3.gradio.live\n",
+      "\n",
+      "This share link expires in 72 hours. For free permanent hosting and GPU upgrades, run `gradio deploy` from Terminal to deploy to Spaces (https://huggingface.co/spaces)\n"
+     ]
+    },
+    {
+     "data": {
+      "text/html": [
+       "<div><iframe src=\"https://73992a9ff20adf33a3.gradio.live\" width=\"100%\" height=\"500\" allow=\"autoplay; camera; microphone; clipboard-read; clipboard-write;\" frameborder=\"0\" allowfullscreen></iframe></div>"
+      ],
+      "text/plain": [
+       "<IPython.core.display.HTML object>"
+      ]
+     },
+     "metadata": {},
+     "output_type": "display_data"
+    },
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "WARNING:root:fetch openai chat retry: {\n",
+      "    \"error\": {\n",
+      "        \"message\": \"\",\n",
+      "        \"type\": \"invalid_request_error\",\n",
+      "        \"param\": null,\n",
+      "        \"code\": \"invalid_api_key\"\n",
+      "    }\n",
+      "}\n",
+      "\n",
+      "WARNING:root:fetch openai chat retry: {\n",
+      "    \"error\": {\n",
+      "        \"message\": \"\",\n",
+      "        \"type\": \"invalid_request_error\",\n",
+      "        \"param\": null,\n",
+      "        \"code\": \"invalid_api_key\"\n",
+      "    }\n",
+      "}\n",
+      "\n",
+      "WARNING:root:fetch openai chat retry: {\n",
+      "    \"error\": {\n",
+      "        \"message\": \"\",\n",
+      "        \"type\": \"invalid_request_error\",\n",
+      "        \"param\": null,\n",
+      "        \"code\": \"invalid_api_key\"\n",
+      "    }\n",
+      "}\n",
+      "\n",
+      "Traceback (most recent call last):\n",
+      "  File \"/tmp/ipykernel_22031/279099274.py\", line 14, in generate\n",
+      "    idea_list = analyze(txt, openai_key, progress)\n",
+      "  File \"/tmp/ipykernel_22031/3345783910.py\", line 69, in analyze\n",
+      "    raise gr.Error(idea)\n",
+      "gradio.exceptions.Error: {'message': '', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}\n",
+      "\n",
+      "During handling of the above exception, another exception occurred:\n",
+      "\n",
+      "Traceback (most recent call last):\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/routes.py\", line 437, in run_predict\n",
+      "    output = await app.get_blocks().process_api(\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/blocks.py\", line 1352, in process_api\n",
+      "    result = await self.call_function(\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/blocks.py\", line 1077, in call_function\n",
+      "    prediction = await anyio.to_thread.run_sync(\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/anyio/to_thread.py\", line 31, in run_sync\n",
+      "    return await get_asynclib().run_sync_in_worker_thread(\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/anyio/_backends/_asyncio.py\", line 937, in run_sync_in_worker_thread\n",
+      "    return await future\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/anyio/_backends/_asyncio.py\", line 867, in run\n",
+      "    result = context.run(func, *args)\n",
+      "  File \"/tmp/ipykernel_22031/279099274.py\", line 37, in generate\n",
+      "    raise gr.Error(str(e))\n",
+      "gradio.exceptions.Error: \"{'message': '', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}\"\n"
+     ]
+    }
+   ],
+   "source": [
+    "idea_list = []\n",
+    "max_ideas = 20\n",
+    "\n",
+    "\n",
+    "with gr.Blocks() as demo:\n",
+    "    \n",
+    "    def generate(txt: str, openai_key: str, progress=gr.Progress()):\n",
+    "        \n",
+    "        if not openai_key:\n",
+    "            raise gr.Error(\"Please provide openai key !\")\n",
+    "        \n",
+    "        try:\n",
+    "            global idea_list\n",
+    "            idea_list = analyze(txt, openai_key, progress)\n",
+    "            k = min(len(idea_list), max_ideas)\n",
+    "\n",
+    "            idea_buttons = [\n",
+    "                gr.Button.update(visible=True, value=i['title'])\n",
+    "                for e, i in enumerate(idea_list[:max_ideas])\n",
+    "            ]\n",
+    "            idea_buttons += [\n",
+    "                gr.Button.update(visible=False)\n",
+    "            ]*(max_ideas-len(idea_buttons))\n",
+    "\n",
+    "            idea_details = [\n",
+    "                gr.Textbox.update(value=\"\", label=\"thought\", visible=True),\n",
+    "                gr.Textbox.update(value=\"\", label=\"action\", visible=True),\n",
+    "                gr.Textbox.update(value=\"\", label=\"original\", visible=True, max_lines=5, lines=5),\n",
+    "                gr.Textbox.update(value=\"\", label=\"improved\", visible=True, max_lines=5, lines=5)\n",
+    "            ]\n",
+    "\n",
+    "            return [\n",
+    "                gr.Textbox.update(\"Suggestions\", interactive=False, show_label=False),\n",
+    "                gr.Button.update(visible=True, value=\"Analyze\")\n",
+    "            ] + idea_details + idea_buttons\n",
+    "        except Exception as e:\n",
+    "            raise gr.Error(str(e))\n",
+    "\n",
+    "    def select(name: str):\n",
+    "        global idea_list\n",
+    "        for i in idea_list:\n",
+    "            if i['title'] == name:\n",
+    "                return [\n",
+    "                    gr.Textbox.update(value=i[\"thought\"], label=\"thought\", visible=True),\n",
+    "                    gr.Textbox.update(value=i[\"action\"], label=\"action\", visible=True),\n",
+    "                    gr.Textbox.update(value=i[\"original\"], label=\"original\", visible=True, max_lines=5, lines=5),\n",
+    "                    gr.Textbox.update(value=i[\"improved\"], label=\"improved\", visible=True, max_lines=5, lines=5)\n",
+    "                ]\n",
+    "            \n",
+    "    title = gr.Button(\"PaperGPT\", interactive=False).style(size=10)\n",
+    "    key = gr.Textbox(label=\"openai_key\")\n",
+    "    with gr.Row().style(equal_height=True):\n",
+    "        with gr.Column(scale=0.95):\n",
+    "            txt_in = gr.Textbox(label=\"Input\", lines=11, max_lines=11, value=content[2048+2048+256-45:])\n",
+    "        with gr.Column(scale=0.05):\n",
+    "            upload = gr.File(file_count=\"single\", file_types=[\"tex\", \".pdf\"])\n",
+    "            btn = gr.Button(\"Analyze\")\n",
+    "            upload.change(read_file, inputs=upload, outputs=txt_in)\n",
+    "\n",
+    "    textboxes = []\n",
+    "    sug = gr.Textbox(\"Suggestions\", interactive=False, show_label=False).style(text_align=\"center\")\n",
+    "    with gr.Row():\n",
+    "        with gr.Column(scale=0.4):\n",
+    "            for i in range(max_ideas):\n",
+    "                t = gr.Button(\"\", visible=False)\n",
+    "                textboxes.append(t)\n",
+    "        with gr.Column(scale=0.6):\n",
+    "            thought = gr.Textbox(label=\"thought\", visible=False, interactive=False)\n",
+    "            action = gr.Textbox(label=\"action\", visible=False, interactive=False)\n",
+    "            original = gr.Textbox(label=\"original\", visible=False, max_lines=5, lines=5, interactive=False)\n",
+    "            improved = gr.Textbox(label=\"improved\", visible=False, max_lines=5, lines=5, interactive=False)\n",
+    "\n",
+    "    btn.click(generate, inputs=[txt_in, key], outputs=[sug, btn, thought, action, original, improved] + textboxes)\n",
+    "    for i in textboxes:\n",
+    "        i.click(select, inputs=[i], outputs=[thought, action, original, improved])\n",
+    "    demo.launch(server_name=\"0.0.0.0\", server_port=7653, share=True, enable_queue=True)"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 10,
+   "id": "8ac8aa92-f7a6-480c-a1b9-2f1c61426846",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Closing server running on port: 7653\n"
+     ]
+    }
+   ],
+   "source": [
+    "demo.close()"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "c9a19815-b8de-4a99-9fcf-0b1a0d3981a3",
+   "metadata": {},
+   "outputs": [],
+   "source": []
+  }
+ ],
+ "metadata": {
+  "kernelspec": {
+   "display_name": "Python 3 (ipykernel)",
+   "language": "python",
+   "name": "python3"
+  },
+  "language_info": {
+   "codemirror_mode": {
+    "name": "ipython",
+    "version": 3
+   },
+   "file_extension": ".py",
+   "mimetype": "text/x-python",
+   "name": "python",
+   "nbconvert_exporter": "python",
+   "pygments_lexer": "ipython3",
+   "version": "3.8.16"
+  }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 5
+}

src/.ipynb_checkpoints/suggest-checkpoint.py

@@ -0,0 +1,176 @@
+import requests
+import logging
+import json
+import tiktoken
+import gradio as gr
+from typing import Any, List
+from langchain.schema import Document
+from langchain.document_loaders import UnstructuredPDFLoader
+from langchain.text_splitter import RecursiveCharacterTextSplitter
+
+from utils import json_validator, fetch_chat
+
+
+class LatexTextSplitter(RecursiveCharacterTextSplitter):
+    """Attempts to split the text along Latex-formatted layout elements."""
+
+    def __init__(self, **kwargs: Any):
+        """Initialize a LatexTextSplitter."""
+        separators = [
+            # First, try to split along Latex sections
+            "\chapter{",
+            "\section{",
+            "\subsection{",
+            "\subsubsection{",
+
+            # Now split by environments
+            "\begin{"
+            # "\n\\begin{enumerate}",
+            # "\n\\begin{itemize}",
+            # "\n\\begin{description}",
+            # "\n\\begin{list}",
+            # "\n\\begin{quote}",
+            # "\n\\begin{quotation}",
+            # "\n\\begin{verse}",
+            # "\n\\begin{verbatim}",
+
+            ## Now split by math environments
+            # "\n\\begin{align}",
+            # "$$",
+            # "$",
+
+            # Now split by the normal type of lines
+            " ",
+            "",
+        ]
+        super().__init__(separators=separators, **kwargs)
+        
+
+class Suggest():
+    
+    def __init__(self, max_ideas: int, model: str = "gpt-3.5-turbo"):
+        self.max_ideas = max_ideas
+        self.encoder = tiktoken.encoding_for_model(model)
+        self.model = model
+        with open("./sample/sample.tex", "r") as f:
+            self.sample_content = f.read()
+            
+    def split_chunk(self, latex_whole_document: str, chunk_size: int = 2000, retry: int = 5) -> List[Document]:
+        
+        chunk_size = min(chunk_size, len(latex_whole_document))
+
+        for _ in range(retry):
+            try:
+                latex_splitter = LatexTextSplitter(
+                    chunk_size=chunk_size,
+                    chunk_overlap=0,
+                )
+                docs = latex_splitter.create_documents([latex_whole_document])
+                return docs
+            except:
+                chunk_size = chunk_size // 2
+
+        raise Exception("Latex document split check failed.")
+
+    def analyze(self, latex_whole_document: str, openai_key: str, progress: gr.Progress):
+
+        logging.info("start analysis")
+        docs = self.split_chunk(latex_whole_document)
+        progress(0.05)
+
+        output_format = """
+
+        ```json
+        [
+            \\ Potential point for improvement 1
+            {{
+                "title": string \\ What this modification is about
+                "thought": string \\ The reason why this should be improved
+                "action": string \\ how to make improvement
+                "original": string \\ the original latex snippet that can be improved
+                "improved": string \\ the improved latex snippet which address your point
+            }},
+            {{}}
+        ]
+        ```
+        """
+
+        ideas = []
+        for doc in progress.tqdm(docs):
+
+            prompt = f"""
+            I'm a computer science student.
+            You are my editor.
+            Your goal is to improve my paper quality at your best.
+
+
+            ```
+            {doc.page_content}
+            ```
+            The above is a segment of my research paper. If the end of the segment is not complete, just ignore it.
+            Point out the parts that can be improved.
+            Focus on grammar, writing, content, section structure.
+            Ignore comments and those that are outside the document environment.
+            List out all the points with a latex snippet which is the improved version addressing your point.
+            Same paragraph should be only address once.
+            Output the response in the following valid json format:
+            {output_format}
+
+            """
+
+            idea = fetch_chat(prompt, openai_key, model=self.model)
+            idea = json_validator(idea, openai_key)
+            if isinstance(idea, list):
+                ideas += idea
+                if len(ideas) >= self.max_ideas:
+                    break
+            else:
+                raise gr.Error(idea)
+
+        logging.info('complete analysis')
+        return ideas
+
+    def read_file(self, f: str):
+        if f is None:
+            return ""
+        elif f.name.endswith('pdf'):
+            loader = UnstructuredPDFLoader(f.name)
+            pages = loader.load_and_split()
+            return "\n".join([p.page_content for p in pages])
+        elif f.name.endswith('tex'):
+            with open(f.name, "r") as f:
+                return f.read()
+        else:
+            return "Only support .tex & .pdf"
+
+    def generate(self, txt: str, openai_key: str, progress=gr.Progress()):
+        
+        if not openai_key:
+            raise gr.Error("Please provide openai key !")
+        
+        try:
+            global idea_list
+            idea_list = self.analyze(txt, openai_key, progress)
+            k = min(len(idea_list), self.max_ideas)
+
+            idea_buttons = [
+                gr.Button.update(visible=True, value=i['title'])
+                for e, i in enumerate(idea_list[:self.max_ideas])
+            ]
+            idea_buttons += [
+                gr.Button.update(visible=False)
+            ] * (self.max_ideas - len(idea_buttons))
+
+            idea_details = [
+                gr.Textbox.update(value="", label="thought", visible=True),
+                gr.Textbox.update(value="", label="action", visible=True),
+                gr.Textbox.update(value="", label="original", visible=True, max_lines=5, lines=5),
+                gr.Textbox.update(value="", label="improved", visible=True, max_lines=5, lines=5)
+            ]
+
+            return [
+                gr.Textbox.update("Suggestions", interactive=False, show_label=False),
+                gr.Button.update(visible=True, value="Analyze")
+            ] + idea_details + idea_buttons
+        except Exception as e:
+            raise gr.Error(str(e))

src/.ipynb_checkpoints/utils-checkpoint.py

@@ -0,0 +1,79 @@
+import json
+import requests
+import tiktoken
+import logging
+
+
+def json_validator(
+    text: str,
+    openai_key: str,
+    retry: int = 3,
+    model: str = "text-davinci-003"
+):
+    
+    encoder = tiktoken.encoding_for_model(model)
+    
+    for _ in range(retry):
+        try:
+            return json.loads(text)
+        except Exception:
+            
+            try:
+                prompt = f"Modify the following into a valid json format:\n{text}"
+                prompt_token_length = len(encoder.encode(prompt))
+
+                data = {
+                    "model": model,
+                    "prompt": prompt,
+                    "max_tokens": 4097 - prompt_token_length - 64
+                }
+                headers = {
+                    "Content-Type": "application/json",
+                    "Authorization": f"Bearer {openai_key}"
+                }
+                for _ in range(retry):
+                    response = requests.post(
+                        'https://api.openai.com/v1/completions',
+                        json=data,
+                        headers=headers,
+                        timeout=300
+                    )
+                    if response.status_code != 200:
+                        logging.warning(f'fetch openai chat retry: {response.text}')
+                        continue
+                    text = response.json()['choices'][0]['text']
+                    break
+            except Exception:
+                return response.json()['error']
+            
+    return text
+
+
+def fetch_chat(
+    prompt: str,
+    openai_key: str,
+    retry: int = 3,
+    model: str = "gpt-3.5-turbo-16k"
+):
+    data = {
+        "model": model,
+        "messages": [{"role": "user", "content": prompt}]
+    }
+    headers = {
+        "Content-Type": "application/json",
+        "Authorization": f"Bearer {openai_key}"
+    }
+    for _ in range(retry):
+        response = requests.post(
+            'https://api.openai.com/v1/chat/completions',
+            json=data,
+            headers=headers,
+            timeout=300
+        )
+        if response.status_code != 200:
+            logging.warning(f'fetch openai chat retry: {response.text}')
+            continue
+        result = response.json()['choices'][0]['message']['content']
+        return result
+    
+    return response.json()["error"]

src/app.py

@@ -0,0 +1,68 @@
+import os
+import gradio as gr
+from suggest import Suggest
+from edit import Editor
+from config import configure_logging
+
+
+configure_logging()
+
+
+with gr.Blocks() as demo:
+    
+    title = gr.Button("PaperGPT", interactive=False)
+    key = gr.Textbox(label="openai_key", value=os.environ.get('OPENAI_API_KEY'))
+    
+    with gr.Tab("Edit"):
+        
+        handler = Editor()
+        txt_in = gr.Textbox(label="Input", lines=11, max_lines=11, value=handler.sample_content)
+        btn = gr.Button("Edit")
+        txt_out = gr.Textbox(label="Output", lines=11, max_lines=11, value="GPT will serve as your editor and modify the paragraph for you.")
+        btn.click(handler.generate, inputs=[txt_in, key], outputs=[txt_out])
+    
+    with gr.Tab("Suggest"):
+        
+        idea_list = []
+        max_ideas = 20
+        handler = Suggest(max_ideas)
+
+        def select(name: str):
+            global idea_list
+            for i in idea_list:
+                if i['title'] == name:
+                    return [
+                        gr.Textbox.update(value=i["thought"], label="thought", visible=True),
+                        gr.Textbox.update(value=i["action"], label="action", visible=True),
+                        gr.Textbox.update(value=i["original"], label="original", visible=True, max_lines=5, lines=5),
+                        gr.Textbox.update(value=i["improved"], label="improved", visible=True, max_lines=5, lines=5)
+                    ]
+
+        with gr.Row().style(equal_height=True):
+            with gr.Column(scale=0.95):
+                txt_in = gr.Textbox(label="Input", lines=11, max_lines=11, value=handler.sample_content[2048+2048+256-45:])
+            with gr.Column(scale=0.05):
+                upload = gr.File(file_count="single", file_types=["tex", ".pdf"])
+                btn = gr.Button("Analyze")
+                upload.change(handler.read_file, inputs=upload, outputs=txt_in)
+
+        textboxes = []
+        sug = gr.Textbox("GPT will give suggestions and help you improve the paper quality.", interactive=False, show_label=False).style(text_align="center")
+        with gr.Row():
+            with gr.Column(scale=0.4):
+                for i in range(max_ideas):
+                    t = gr.Button("", visible=False)
+                    textboxes.append(t)
+            with gr.Column(scale=0.6):
+                thought = gr.Textbox(label="thought", visible=False, interactive=False)
+                action = gr.Textbox(label="action", visible=False, interactive=False)
+                original = gr.Textbox(label="original", visible=False, max_lines=5, lines=5, interactive=False)
+                improved = gr.Textbox(label="improved", visible=False, max_lines=5, lines=5, interactive=False)
+
+        btn.click(handler.generate, inputs=[txt_in, key], outputs=[sug, btn, thought, action, original, improved] + textboxes)
+        for i in textboxes:
+            i.click(select, inputs=[i], outputs=[thought, action, original, improved])
+            
+
+    # demo.launch(server_name="0.0.0.0", server_port=7653, share=True, enable_queue=True)
+    demo.launch(enable_queue=True)

src/config.py

@@ -0,0 +1,17 @@
+import logging
+
+
+def configure_logging(logging_level: str = "INFO"):
+    logging_level = logging_level.upper()
+    numeric_level = getattr(logging, logging_level, None)
+
+    if not isinstance(numeric_level, int):
+        raise Exception(f"Invalid log level: {numeric_level}")
+
+    logging.basicConfig(
+        level=numeric_level,
+        datefmt="%Y-%m-%d %H:%M:%S",
+        format=
+        "[%(asctime)s] [%(process)s] [%(levelname)s] [%(module)s]: #%(funcName)s @%(lineno)d: %(message)s",
+    )
+    logging.info(f"Logging level: {logging_level}")

src/edit.py

@@ -0,0 +1,43 @@
+import logging
+import tiktoken
+import gradio as gr
+from langchain.text_splitter import CharacterTextSplitter
+from utils import fetch_chat
+from typing import List
+
+
+class Editor():
+    
+    def __init__(self, model: str = "gpt-3.5-turbo"):
+        self.encoder = tiktoken.encoding_for_model(model)
+        self.model = model
+        with open("./sample/sample_abstract.tex", "r") as f:
+            self.sample_content = f.read()
+            
+    def split_chunk(self, text, chunk_size: int = 2000) -> List[str]:
+        text_splitter = CharacterTextSplitter.from_tiktoken_encoder(
+            chunk_size=100, chunk_overlap=0
+        )
+        text_list = text_splitter.split_text(text)
+        return text_list
+            
+    def generate(self, text: str, openai_key: str):
+        
+        logging.info("start editing")
+        
+        try:
+            prompt = f"""
+            I am a computer science student.
+            I am writing my research paper.
+            You are my editor.
+            Your goal is to improve my paper quality at your best.
+            Please edit the following paragraph and return the modified paragraph.
+            If the paragraph is written in latex, return the modified paragraph in latex.
+
+            ```
+            {text}
+            ```
+            """
+            return fetch_chat(prompt, openai_key, model=self.model)
+        except Exception as e:
+            raise gr.Error(str(e))

src/papergpt.ipynb

@@ -0,0 +1,491 @@
+{
+ "cells": [
+  {
+   "cell_type": "raw",
+   "id": "b77c4818-9d92-4581-a2fb-2b38da776a8b",
+   "metadata": {},
+   "source": [
+    "# python >= 3.8\n",
+    "import sys\n",
+    "!{sys.executable} -m pip insatll langchain, gradio, tiktoken, unstructured"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "id": "80b2033d-b985-440d-a01f-e7f8547a6801",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.8) or chardet (5.1.0)/charset_normalizer (2.0.12) doesn't match a supported version!\n",
+      "  warnings.warn(\"urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported \"\n",
+      "/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/tqdm/auto.py:21: TqdmWarning: IProgress not found. Please update jupyter and ipywidgets. See https://ipywidgets.readthedocs.io/en/stable/user_install.html\n",
+      "  from .autonotebook import tqdm as notebook_tqdm\n"
+     ]
+    }
+   ],
+   "source": [
+    "# from langchain.text_splitter import LatexTextSplitter\n",
+    "from langchain.text_splitter import RecursiveCharacterTextSplitter\n",
+    "from typing import Any\n",
+    "import requests\n",
+    "import logging\n",
+    "import json\n",
+    "import tiktoken\n",
+    "import gradio as gr\n",
+    "from langchain.document_loaders import UnstructuredPDFLoader"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 2,
+   "id": "720927dd-848e-47ff-a847-4e1097768561",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [],
+   "source": [
+    "turbo_encoding = tiktoken.encoding_for_model(\"gpt-3.5-turbo\")\n",
+    "with open(\"sample.tex\", \"r\") as f:\n",
+    "    content = f.read()"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 3,
+   "id": "13bc48fd-a048-4635-99c4-79ddb62d5c4d",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [],
+   "source": [
+    "class LatexTextSplitter(RecursiveCharacterTextSplitter):\n",
+    "    \"\"\"Attempts to split the text along Latex-formatted layout elements.\"\"\"\n",
+    "\n",
+    "    def __init__(self, **kwargs: Any):\n",
+    "        \"\"\"Initialize a LatexTextSplitter.\"\"\"\n",
+    "        separators = [\n",
+    "            # First, try to split along Latex sections\n",
+    "            \"\\chapter{\",\n",
+    "            \"\\section{\",\n",
+    "            \"\\subsection{\",\n",
+    "            \"\\subsubsection{\",\n",
+    "\n",
+    "            # Now split by environments\n",
+    "            \"\\begin{\"\n",
+    "            # \"\\n\\\\begin{enumerate}\",\n",
+    "            # \"\\n\\\\begin{itemize}\",\n",
+    "            # \"\\n\\\\begin{description}\",\n",
+    "            # \"\\n\\\\begin{list}\",\n",
+    "            # \"\\n\\\\begin{quote}\",\n",
+    "            # \"\\n\\\\begin{quotation}\",\n",
+    "            # \"\\n\\\\begin{verse}\",\n",
+    "            # \"\\n\\\\begin{verbatim}\",\n",
+    "\n",
+    "            ## Now split by math environments\n",
+    "            # \"\\n\\\\begin{align}\",\n",
+    "            # \"$$\",\n",
+    "            # \"$\",\n",
+    "\n",
+    "            # Now split by the normal type of lines\n",
+    "            \" \",\n",
+    "            \"\",\n",
+    "        ]\n",
+    "        super().__init__(separators=separators, **kwargs)\n",
+    "\n",
+    "\n",
+    "def json_validator(text: str, openai_key: str, retry: int = 3):\n",
+    "    for _ in range(retry):\n",
+    "        try:\n",
+    "            return json.loads(text)\n",
+    "        except Exception:\n",
+    "            \n",
+    "            try:\n",
+    "                prompt = f\"Modify the following into a valid json format:\\n{text}\"\n",
+    "                prompt_token_length = len(turbo_encoding.encode(prompt))\n",
+    "\n",
+    "                data = {\n",
+    "                    \"model\": \"text-davinci-003\",\n",
+    "                    \"prompt\": prompt,\n",
+    "                    \"max_tokens\": 4097 - prompt_token_length - 64\n",
+    "                }\n",
+    "                headers = {\n",
+    "                    \"Content-Type\": \"application/json\",\n",
+    "                    \"Authorization\": f\"Bearer {openai_key}\"\n",
+    "                }\n",
+    "                for _ in range(retry):\n",
+    "                    response = requests.post(\n",
+    "                        'https://api.openai.com/v1/completions',\n",
+    "                        json=data,\n",
+    "                        headers=headers,\n",
+    "                        timeout=300\n",
+    "                    )\n",
+    "                    if response.status_code != 200:\n",
+    "                        logging.warning(f'fetch openai chat retry: {response.text}')\n",
+    "                        continue\n",
+    "                    text = response.json()['choices'][0]['text']\n",
+    "                    break\n",
+    "            except:\n",
+    "                return response.json()['error']\n",
+    "            \n",
+    "    return text"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 9,
+   "id": "a34bf526-fb0c-4b5e-8c3d-bab7a13e5fe7",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [],
+   "source": [
+    "def analyze(latex_whole_document: str, openai_key: str, progress):\n",
+    "    \n",
+    "    logging.info(\"start analysis\")\n",
+    "    \n",
+    "    output_format = \"\"\"\n",
+    "\n",
+    "    ```json\n",
+    "    [\n",
+    "        \\\\ Potential point for improvement 1\n",
+    "        {{\n",
+    "            \"title\": string \\\\ What this modification is about\n",
+    "            \"thought\": string \\\\ The reason why this should be improved\n",
+    "            \"action\": string \\\\ how to make improvement\n",
+    "            \"original\": string \\\\ the original latex snippet that can be improved\n",
+    "            \"improved\": string \\\\ the improved latex snippet which address your point\n",
+    "        }},\n",
+    "        {{}}\n",
+    "    ]\n",
+    "    ```\n",
+    "    \"\"\"\n",
+    "    \n",
+    "    chunk_size = 1000\n",
+    "    # for _ in range(5):\n",
+    "    #     try:\n",
+    "    #         latex_splitter = LatexTextSplitter(\n",
+    "    #             chunk_size=min(chunk_size, len(latex_whole_document)),\n",
+    "    #             chunk_overlap=0,\n",
+    "    #         )\n",
+    "    #         docs = latex_splitter.create_documents([latex_whole_document])\n",
+    "    #         break\n",
+    "    #     except:\n",
+    "    #         chunk_size // 2\n",
+    "\n",
+    "    latex_splitter = LatexTextSplitter(\n",
+    "        chunk_size=min(chunk_size, len(latex_whole_document)),\n",
+    "        chunk_overlap=0,\n",
+    "    )\n",
+    "    docs = latex_splitter.create_documents([latex_whole_document])\n",
+    "    \n",
+    "    progress(0.05)\n",
+    "    ideas = []\n",
+    "    for doc in progress.tqdm(docs):\n",
+    "\n",
+    "        prompt = f\"\"\"\n",
+    "        I'm a computer science student.\n",
+    "        You are my editor.\n",
+    "        Your goal is to improve my paper quality at your best.\n",
+    "        \n",
+    "        \n",
+    "        ```\n",
+    "        {doc.page_content}\n",
+    "        ```\n",
+    "        The above is a segment of my research paper. If the end of the segment is not complete, just ignore it.\n",
+    "        Point out the parts that can be improved.\n",
+    "        Focus on grammar, writing, content, section structure.\n",
+    "        Ignore comments and those that are outside the document environment.\n",
+    "        List out all the points with a latex snippet which is the improved version addressing your point.\n",
+    "        Same paragraph should be only address once.\n",
+    "        Output the response in the following valid json format:\n",
+    "        {output_format}\n",
+    "\n",
+    "        \"\"\"\n",
+    "        \n",
+    "        idea = fetch_chat(prompt, openai_key)\n",
+    "        if isinstance(idea, list):\n",
+    "            ideas += idea\n",
+    "            break\n",
+    "        else:\n",
+    "            raise gr.Error(idea)\n",
+    "\n",
+    "    logging.info('complete analysis')\n",
+    "    return ideas\n",
+    "\n",
+    "\n",
+    "def fetch_chat(prompt: str, openai_key: str, retry: int = 3):\n",
+    "    json = {\n",
+    "        \"model\": \"gpt-3.5-turbo-16k\",\n",
+    "        \"messages\": [{\"role\": \"user\", \"content\": prompt}]\n",
+    "    }\n",
+    "    headers = {\n",
+    "        \"Content-Type\": \"application/json\",\n",
+    "        \"Authorization\": f\"Bearer {openai_key}\"\n",
+    "    }\n",
+    "    for _ in range(retry):\n",
+    "        response = requests.post(\n",
+    "            'https://api.openai.com/v1/chat/completions',\n",
+    "            json=json,\n",
+    "            headers=headers,\n",
+    "            timeout=300\n",
+    "        )\n",
+    "        if response.status_code != 200:\n",
+    "            logging.warning(f'fetch openai chat retry: {response.text}')\n",
+    "            continue\n",
+    "        result = response.json()['choices'][0]['message']['content']\n",
+    "        return json_validator(result, openai_key)\n",
+    "    \n",
+    "    return response.json()[\"error\"]\n",
+    "    \n",
+    "    \n",
+    "def read_file(f: str):\n",
+    "    if f is None:\n",
+    "        return \"\"\n",
+    "    elif f.name.endswith('pdf'):\n",
+    "        loader = UnstructuredPDFLoader(f.name)\n",
+    "        pages = loader.load_and_split()\n",
+    "        return \"\\n\".join([p.page_content for p in pages])\n",
+    "    elif f.name.endswith('tex'):\n",
+    "        with open(f.name, \"r\") as f:\n",
+    "            return f.read()\n",
+    "    else:\n",
+    "        return \"Only support .tex & .pdf\""
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 11,
+   "id": "cec63e87-9741-4596-a3f1-a901830e3771",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/components/button.py:112: UserWarning: The `style` method is deprecated. Please set these arguments in the constructor instead.\n",
+      "  warnings.warn(\n",
+      "/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/layouts.py:80: UserWarning: The `style` method is deprecated. Please set these arguments in the constructor instead.\n",
+      "  warnings.warn(\n",
+      "/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/components/textbox.py:259: UserWarning: The `style` method is deprecated. Please set these arguments in the constructor instead.\n",
+      "  warnings.warn(\n"
+     ]
+    },
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Running on local URL:  http://0.0.0.0:7653\n",
+      "Running on public URL: https://73992a9ff20adf33a3.gradio.live\n",
+      "\n",
+      "This share link expires in 72 hours. For free permanent hosting and GPU upgrades, run `gradio deploy` from Terminal to deploy to Spaces (https://huggingface.co/spaces)\n"
+     ]
+    },
+    {
+     "data": {
+      "text/html": [
+       "<div><iframe src=\"https://73992a9ff20adf33a3.gradio.live\" width=\"100%\" height=\"500\" allow=\"autoplay; camera; microphone; clipboard-read; clipboard-write;\" frameborder=\"0\" allowfullscreen></iframe></div>"
+      ],
+      "text/plain": [
+       "<IPython.core.display.HTML object>"
+      ]
+     },
+     "metadata": {},
+     "output_type": "display_data"
+    },
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "WARNING:root:fetch openai chat retry: {\n",
+      "    \"error\": {\n",
+      "        \"message\": \"\",\n",
+      "        \"type\": \"invalid_request_error\",\n",
+      "        \"param\": null,\n",
+      "        \"code\": \"invalid_api_key\"\n",
+      "    }\n",
+      "}\n",
+      "\n",
+      "WARNING:root:fetch openai chat retry: {\n",
+      "    \"error\": {\n",
+      "        \"message\": \"\",\n",
+      "        \"type\": \"invalid_request_error\",\n",
+      "        \"param\": null,\n",
+      "        \"code\": \"invalid_api_key\"\n",
+      "    }\n",
+      "}\n",
+      "\n",
+      "WARNING:root:fetch openai chat retry: {\n",
+      "    \"error\": {\n",
+      "        \"message\": \"\",\n",
+      "        \"type\": \"invalid_request_error\",\n",
+      "        \"param\": null,\n",
+      "        \"code\": \"invalid_api_key\"\n",
+      "    }\n",
+      "}\n",
+      "\n",
+      "Traceback (most recent call last):\n",
+      "  File \"/tmp/ipykernel_22031/279099274.py\", line 14, in generate\n",
+      "    idea_list = analyze(txt, openai_key, progress)\n",
+      "  File \"/tmp/ipykernel_22031/3345783910.py\", line 69, in analyze\n",
+      "    raise gr.Error(idea)\n",
+      "gradio.exceptions.Error: {'message': '', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}\n",
+      "\n",
+      "During handling of the above exception, another exception occurred:\n",
+      "\n",
+      "Traceback (most recent call last):\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/routes.py\", line 437, in run_predict\n",
+      "    output = await app.get_blocks().process_api(\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/blocks.py\", line 1352, in process_api\n",
+      "    result = await self.call_function(\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/gradio/blocks.py\", line 1077, in call_function\n",
+      "    prediction = await anyio.to_thread.run_sync(\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/anyio/to_thread.py\", line 31, in run_sync\n",
+      "    return await get_asynclib().run_sync_in_worker_thread(\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/anyio/_backends/_asyncio.py\", line 937, in run_sync_in_worker_thread\n",
+      "    return await future\n",
+      "  File \"/home/hsiao1229/.local/share/virtualenvs/chatGPT-yp18Rznv/lib/python3.8/site-packages/anyio/_backends/_asyncio.py\", line 867, in run\n",
+      "    result = context.run(func, *args)\n",
+      "  File \"/tmp/ipykernel_22031/279099274.py\", line 37, in generate\n",
+      "    raise gr.Error(str(e))\n",
+      "gradio.exceptions.Error: \"{'message': '', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}\"\n"
+     ]
+    }
+   ],
+   "source": [
+    "idea_list = []\n",
+    "max_ideas = 20\n",
+    "\n",
+    "\n",
+    "with gr.Blocks() as demo:\n",
+    "    \n",
+    "    def generate(txt: str, openai_key: str, progress=gr.Progress()):\n",
+    "        \n",
+    "        if not openai_key:\n",
+    "            raise gr.Error(\"Please provide openai key !\")\n",
+    "        \n",
+    "        try:\n",
+    "            global idea_list\n",
+    "            idea_list = analyze(txt, openai_key, progress)\n",
+    "            k = min(len(idea_list), max_ideas)\n",
+    "\n",
+    "            idea_buttons = [\n",
+    "                gr.Button.update(visible=True, value=i['title'])\n",
+    "                for e, i in enumerate(idea_list[:max_ideas])\n",
+    "            ]\n",
+    "            idea_buttons += [\n",
+    "                gr.Button.update(visible=False)\n",
+    "            ]*(max_ideas-len(idea_buttons))\n",
+    "\n",
+    "            idea_details = [\n",
+    "                gr.Textbox.update(value=\"\", label=\"thought\", visible=True),\n",
+    "                gr.Textbox.update(value=\"\", label=\"action\", visible=True),\n",
+    "                gr.Textbox.update(value=\"\", label=\"original\", visible=True, max_lines=5, lines=5),\n",
+    "                gr.Textbox.update(value=\"\", label=\"improved\", visible=True, max_lines=5, lines=5)\n",
+    "            ]\n",
+    "\n",
+    "            return [\n",
+    "                gr.Textbox.update(\"Suggestions\", interactive=False, show_label=False),\n",
+    "                gr.Button.update(visible=True, value=\"Analyze\")\n",
+    "            ] + idea_details + idea_buttons\n",
+    "        except Exception as e:\n",
+    "            raise gr.Error(str(e))\n",
+    "\n",
+    "    def select(name: str):\n",
+    "        global idea_list\n",
+    "        for i in idea_list:\n",
+    "            if i['title'] == name:\n",
+    "                return [\n",
+    "                    gr.Textbox.update(value=i[\"thought\"], label=\"thought\", visible=True),\n",
+    "                    gr.Textbox.update(value=i[\"action\"], label=\"action\", visible=True),\n",
+    "                    gr.Textbox.update(value=i[\"original\"], label=\"original\", visible=True, max_lines=5, lines=5),\n",
+    "                    gr.Textbox.update(value=i[\"improved\"], label=\"improved\", visible=True, max_lines=5, lines=5)\n",
+    "                ]\n",
+    "            \n",
+    "    title = gr.Button(\"PaperGPT\", interactive=False).style(size=10)\n",
+    "    key = gr.Textbox(label=\"openai_key\")\n",
+    "    with gr.Row().style(equal_height=True):\n",
+    "        with gr.Column(scale=0.95):\n",
+    "            txt_in = gr.Textbox(label=\"Input\", lines=11, max_lines=11, value=content[2048+2048+256-45:])\n",
+    "        with gr.Column(scale=0.05):\n",
+    "            upload = gr.File(file_count=\"single\", file_types=[\"tex\", \".pdf\"])\n",
+    "            btn = gr.Button(\"Analyze\")\n",
+    "            upload.change(read_file, inputs=upload, outputs=txt_in)\n",
+    "\n",
+    "    textboxes = []\n",
+    "    sug = gr.Textbox(\"Suggestions\", interactive=False, show_label=False).style(text_align=\"center\")\n",
+    "    with gr.Row():\n",
+    "        with gr.Column(scale=0.4):\n",
+    "            for i in range(max_ideas):\n",
+    "                t = gr.Button(\"\", visible=False)\n",
+    "                textboxes.append(t)\n",
+    "        with gr.Column(scale=0.6):\n",
+    "            thought = gr.Textbox(label=\"thought\", visible=False, interactive=False)\n",
+    "            action = gr.Textbox(label=\"action\", visible=False, interactive=False)\n",
+    "            original = gr.Textbox(label=\"original\", visible=False, max_lines=5, lines=5, interactive=False)\n",
+    "            improved = gr.Textbox(label=\"improved\", visible=False, max_lines=5, lines=5, interactive=False)\n",
+    "\n",
+    "    btn.click(generate, inputs=[txt_in, key], outputs=[sug, btn, thought, action, original, improved] + textboxes)\n",
+    "    for i in textboxes:\n",
+    "        i.click(select, inputs=[i], outputs=[thought, action, original, improved])\n",
+    "    demo.launch(server_name=\"0.0.0.0\", server_port=7653, share=True, enable_queue=True)"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 10,
+   "id": "8ac8aa92-f7a6-480c-a1b9-2f1c61426846",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Closing server running on port: 7653\n"
+     ]
+    }
+   ],
+   "source": [
+    "demo.close()"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "c9a19815-b8de-4a99-9fcf-0b1a0d3981a3",
+   "metadata": {},
+   "outputs": [],
+   "source": []
+  }
+ ],
+ "metadata": {
+  "kernelspec": {
+   "display_name": "Python 3 (ipykernel)",
+   "language": "python",
+   "name": "python3"
+  },
+  "language_info": {
+   "codemirror_mode": {
+    "name": "ipython",
+    "version": 3
+   },
+   "file_extension": ".py",
+   "mimetype": "text/x-python",
+   "name": "python",
+   "nbconvert_exporter": "python",
+   "pygments_lexer": "ipython3",
+   "version": "3.8.16"
+  }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 5
+}

src/suggest.py

@@ -0,0 +1,176 @@
+import requests
+import logging
+import json
+import tiktoken
+import gradio as gr
+from typing import Any, List
+from langchain.schema import Document
+from langchain.document_loaders import UnstructuredPDFLoader
+from langchain.text_splitter import RecursiveCharacterTextSplitter
+
+from utils import json_validator, fetch_chat
+
+
+class LatexTextSplitter(RecursiveCharacterTextSplitter):
+    """Attempts to split the text along Latex-formatted layout elements."""
+
+    def __init__(self, **kwargs: Any):
+        """Initialize a LatexTextSplitter."""
+        separators = [
+            # First, try to split along Latex sections
+            "\chapter{",
+            "\section{",
+            "\subsection{",
+            "\subsubsection{",
+
+            # Now split by environments
+            "\begin{"
+            # "\n\\begin{enumerate}",
+            # "\n\\begin{itemize}",
+            # "\n\\begin{description}",
+            # "\n\\begin{list}",
+            # "\n\\begin{quote}",
+            # "\n\\begin{quotation}",
+            # "\n\\begin{verse}",
+            # "\n\\begin{verbatim}",
+
+            ## Now split by math environments
+            # "\n\\begin{align}",
+            # "$$",
+            # "$",
+
+            # Now split by the normal type of lines
+            " ",
+            "",
+        ]
+        super().__init__(separators=separators, **kwargs)
+        
+
+class Suggest():
+    
+    def __init__(self, max_ideas: int, model: str = "gpt-3.5-turbo"):
+        self.max_ideas = max_ideas
+        self.encoder = tiktoken.encoding_for_model(model)
+        self.model = model
+        with open("./sample/sample.tex", "r") as f:
+            self.sample_content = f.read()
+            
+    def split_chunk(self, latex_whole_document: str, chunk_size: int = 2000, retry: int = 5) -> List[Document]:
+        
+        chunk_size = min(chunk_size, len(latex_whole_document))
+
+        for _ in range(retry):
+            try:
+                latex_splitter = LatexTextSplitter(
+                    chunk_size=chunk_size,
+                    chunk_overlap=0,
+                )
+                docs = latex_splitter.create_documents([latex_whole_document])
+                return docs
+            except:
+                chunk_size = chunk_size // 2
+
+        raise Exception("Latex document split check failed.")
+
+    def analyze(self, latex_whole_document: str, openai_key: str, progress: gr.Progress):
+
+        logging.info("start analysis")
+        docs = self.split_chunk(latex_whole_document)
+        progress(0.05)
+
+        output_format = """
+
+        ```json
+        [
+            \\ Potential point for improvement 1
+            {{
+                "title": string \\ What this modification is about
+                "thought": string \\ The reason why this should be improved
+                "action": string \\ how to make improvement
+                "original": string \\ the original latex snippet that can be improved
+                "improved": string \\ the improved latex snippet which address your point
+            }},
+            {{}}
+        ]
+        ```
+        """
+
+        ideas = []
+        for doc in progress.tqdm(docs):
+
+            prompt = f"""
+            I'm a computer science student.
+            You are my editor.
+            Your goal is to improve my paper quality at your best.
+
+
+            ```
+            {doc.page_content}
+            ```
+            The above is a segment of my research paper. If the end of the segment is not complete, just ignore it.
+            Point out the parts that can be improved.
+            Focus on grammar, writing, content, section structure.
+            Ignore comments and those that are outside the document environment.
+            List out all the points with a latex snippet which is the improved version addressing your point.
+            Same paragraph should be only address once.
+            Output the response in the following valid json format:
+            {output_format}
+
+            """
+
+            idea = fetch_chat(prompt, openai_key, model=self.model)
+            idea = json_validator(idea, openai_key)
+            if isinstance(idea, list):
+                ideas += idea
+                if len(ideas) >= self.max_ideas:
+                    break
+            else:
+                raise gr.Error(idea)
+
+        logging.info('complete analysis')
+        return ideas
+
+    def read_file(self, f: str):
+        if f is None:
+            return ""
+        elif f.name.endswith('pdf'):
+            loader = UnstructuredPDFLoader(f.name)
+            pages = loader.load_and_split()
+            return "\n".join([p.page_content for p in pages])
+        elif f.name.endswith('tex'):
+            with open(f.name, "r") as f:
+                return f.read()
+        else:
+            return "Only support .tex & .pdf"
+
+    def generate(self, txt: str, openai_key: str, progress=gr.Progress()):
+        
+        if not openai_key:
+            raise gr.Error("Please provide openai key !")
+        
+        try:
+            global idea_list
+            idea_list = self.analyze(txt, openai_key, progress)
+            k = min(len(idea_list), self.max_ideas)
+
+            idea_buttons = [
+                gr.Button.update(visible=True, value=i['title'])
+                for e, i in enumerate(idea_list[:self.max_ideas])
+            ]
+            idea_buttons += [
+                gr.Button.update(visible=False)
+            ] * (self.max_ideas - len(idea_buttons))
+
+            idea_details = [
+                gr.Textbox.update(value="", label="thought", visible=True),
+                gr.Textbox.update(value="", label="action", visible=True),
+                gr.Textbox.update(value="", label="original", visible=True, max_lines=5, lines=5),
+                gr.Textbox.update(value="", label="improved", visible=True, max_lines=5, lines=5)
+            ]
+
+            return [
+                gr.Textbox.update("Suggestions", interactive=False, show_label=False),
+                gr.Button.update(visible=True, value="Analyze")
+            ] + idea_details + idea_buttons
+        except Exception as e:
+            raise gr.Error(str(e))

src/utils.py

@@ -0,0 +1,79 @@
+import json
+import requests
+import tiktoken
+import logging
+
+
+def json_validator(
+    text: str,
+    openai_key: str,
+    retry: int = 3,
+    model: str = "text-davinci-003"
+):
+    
+    encoder = tiktoken.encoding_for_model(model)
+    
+    for _ in range(retry):
+        try:
+            return json.loads(text)
+        except Exception:
+            
+            try:
+                prompt = f"Modify the following into a valid json format:\n{text}"
+                prompt_token_length = len(encoder.encode(prompt))
+
+                data = {
+                    "model": model,
+                    "prompt": prompt,
+                    "max_tokens": 4097 - prompt_token_length - 64
+                }
+                headers = {
+                    "Content-Type": "application/json",
+                    "Authorization": f"Bearer {openai_key}"
+                }
+                for _ in range(retry):
+                    response = requests.post(
+                        'https://api.openai.com/v1/completions',
+                        json=data,
+                        headers=headers,
+                        timeout=300
+                    )
+                    if response.status_code != 200:
+                        logging.warning(f'fetch openai chat retry: {response.text}')
+                        continue
+                    text = response.json()['choices'][0]['text']
+                    break
+            except Exception:
+                return response.json()['error']
+            
+    return text
+
+
+def fetch_chat(
+    prompt: str,
+    openai_key: str,
+    retry: int = 3,
+    model: str = "gpt-3.5-turbo-16k"
+):
+    data = {
+        "model": model,
+        "messages": [{"role": "user", "content": prompt}]
+    }
+    headers = {
+        "Content-Type": "application/json",
+        "Authorization": f"Bearer {openai_key}"
+    }
+    for _ in range(retry):
+        response = requests.post(
+            'https://api.openai.com/v1/chat/completions',
+            json=data,
+            headers=headers,
+            timeout=300
+        )
+        if response.status_code != 200:
+            logging.warning(f'fetch openai chat retry: {response.text}')
+            continue
+        result = response.json()['choices'][0]['message']['content']
+        return result
+    
+    return response.json()["error"]