ONNX-converted version of the model

#1
by asofter - opened

We decided to add this model for the Anonymize Scanner in llm-guard with your model.

To have faster inference, we use ONNX models converted using Optimum from HuggingFace.

Example of the repo with ONNX built-in: https://huggingface.co/laiyer/deberta-v3-base-prompt-injection

Similar PR: https://huggingface.co/philomath-1209/programming-language-identification/discussions/1

dslim changed pull request status to merged

Sign up or log in to comment