DELTA-NN architecture¶
- features
- compile
- package
- TF-Serving
- Serving
- Embedding
- Client
Features¶
- tiny size
- pack all by docker
- supporting custom-op
- exporting only C api
- compatibility TF-Serving and Serving RESTful API
- compatibility with Could and Edge usage
- supporting multi graphs inference
- supporting multi modal application, e.g KWS(Edge) + ASR(Could)
Compile¶
How to compile delta-nn
.
Serving¶
Using go
to wraper DELTA-NN supporting HTTP/HTTPS protocal.
Support Engines¶
- TF
- TFTRT
REST API¶
Compatibility with TF-Serving RESTful API.
- input tensors in row format
- input tensors in column format
Client¶
Support Engines¶
- TF
- TFTRT
- TFLite
HTTP/HTTPS Client¶
DELTA-NN using mbedtls as SSL/TLS library.
It's an OpenSSL alternative libraray, which has many features:
- Fully featured SSL/TLS and cryptography library
- Easy integration with a small memory footprint
- Easy to understand and use with a clean API
- Easy to reduce and expand the code
- Easy to build with no external dependencies
- Extremely portable