Framework for performance-efficient prediction.
- Increases the throughput of your machine learning-based service
- Uses shared memory for instantaneous transfer of large amounts of data between processes
- All optimizations in one library
Install using pip
:
pip install aqueduct
Moreover, aqueduct has "optional extras"
numpy
- support types from numpy in shared memoryaiohttp
- extension for aiohttp support(see more in examples)
- Videos about aqueduct
- Getting started
- Batching
- F.A.Q.
- Logging
- Metrics
- Additional features
Feel free to ask questions in Telegram: t.me/avito-ml