Convert an image containing a formula to corresponding LaTeX code.
There is a User Interface written with PyQt5
See here for performance information.
InstallAs of right now you have to use a Python environment with PyTorch to use the model.
If you get an error, try to install PyTorch first.
pip install pix2tex[gui]
For more information go to the GitHub repository.
A standalone version is planned. For Linux an AppImage is in development (PR).
TroubleshootingIf you run into problems, please see if you can find the solution in the issues-tab. If not open a new issue.
ContributingI would love some help for further development of the project. If you want to contribute, there are many areas that need to be improved.
If you want to help with any of the above or any other point, feel free to fork the repository and submit a pull request.
Use CROHME, Im2Latex-Handwritten and maybe https://www.kaggle.com/aidapearson/ocr-data
Find better hyperparameters
I haven't tried out many sets of hyperparameters. Could potentially improve performance drastically.
Tweak model structure
Attention tricks, backbone model etc.
Introduce more of the DeiT approach.
Fix equation extraction (regex) and collect more data.
Using torchscript or ONNX. Useful for standalone application.
Never done anything with Qt. Help wanted!