cranelift

rust jit wasm webassembly runtime wasi cranelift sandbox wasmtime

Andrew Brown 770c5d0f3f wasi-nn: add named models (#6854 ) * wasi-nn: add [named models] This change adds a way to retrieve preloaded ML models (i.e., "graphs" in wasi-nn terms) from a registry. The wasi-nn specification includes a new function, `load_by_name`, that can be used to access these models more efficiently than before; previously, a user's only option was to read/download/etc. all of the bytes of an ML model and pass them to the `load` function. [named models]: https://github.com/WebAssembly/wasi-nn/issues/36 In Wasmtime's implementation of wasi-nn, we call the registry that holds the models a `GraphRegistry`. We include a simplistic `InMemoryRegistry` for use in the Wasmtime CLI (more on this later) but the idea is that production use will involve some more complex caching and thus a new implementation of a registry--a `Box<dyn GraphRegistry>`--passed into the wasi-nn context. Note that, because we now must be able to `clone` a graph out of the registry and into the "used graphs" table, the OpenVINO `BackendGraph` is updated to be easier to copy around. To allow experimentation with this "preload a named model" functionality, this change also adds a new Wasmtime CLI flag: `--graph <encoding>:<host dir>`. Wasmtime CLI users can now preload a model from a directory; the directory `basename` is used as the model name. Loading models from a directory is probably not desired in Wasmtime embeddings so it is cordoned off into a separate `BackendFromDir` extension trait. * wasi-nn: add "named model" test Add a new example crate which loads a model by name and performs image classification. It uses the same MobileNet model as the existing test but a new version of the Rust bindings. The new crate is built and run with the new CLI flag in the `ci/run-wasi-nn-example.sh` script. prtest:full * review: rename `--graph` to `--wasi-nn-graph`		1 year ago
..
docker	add riscv64 backend for cranelift. (#4271)	2 years ago
RELEASES-template.md	Add a two-week delay to Wasmtime's release process (#3955)	3 years ago
build-src-tarball.sh	Fix name of tarballs for patch releases (#6295)	2 years ago
build-tarballs.sh	Fix name of tarballs for patch releases (#6295)	2 years ago
build-test-matrix.js	riscv64: Initial SIMD Vector Implementation (#6240)	2 years ago
build-wasi-preview1-component-adapter.sh	Update adapter build (#6573)	1 year ago
ensure_deterministic_build.sh	Cranelift: do not check in generated ISLE code; regenerate on every compile. (#4143)	3 years ago
find-latest-release.rs	Fix the release process's latest step (#4055)	3 years ago
print-current-version.sh	Add a two-week delay to Wasmtime's release process (#3955)	3 years ago
qemu-cpuinfo.patch	CI: upgrade to qemu 8.0.4. (#6849)	1 year ago
run-tests.sh	Refactor Wasmtime CLI to support components (#6836)	1 year ago
run-wasi-nn-example.sh	wasi-nn: add named models (#6854)	1 year ago
update-release-date.rs	Fix the release process's latest step (#4055)	3 years ago
wasmtime.wxs	Remove the old wast and wasm2obj commands. (#1372)	5 years ago