- tiny size
- pack all by docker
- supporting custom-op
- exporting only C api
- compatibility TF-Serving and Serving RESTful API
- compatibility with Could and Edge usage
- supporting multi graphs inference
- supporting multi modal application, e.g KWS(Edge) + ASR(Could)
How to compile
Compile TF-Serving with custom Ops.
go to wraper DELTA-NN supporting HTTP/HTTPS protocal.
DELTA-NN using mbedtls as SSL/TLS library.
It's an OpenSSL alternative libraray, which has many features:
- Fully featured SSL/TLS and cryptography library
- Easy integration with a small memory footprint
- Easy to understand and use with a clean API
- Easy to reduce and expand the code
- Easy to build with no external dependencies
- Extremely portable