Amazing work there. This technique is quite eye opening really ^^
A quick comment on the title of the post though, at first, I believed that this post was about training sentence embedding model faster, not about training sentence embedding models that have a faster inference time. Just for you guys to knoew.