github
/
cranelift
mirror of https://github.com/bytecodealliance/wasmtime.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
13484 Commits
49 Branches
140 Tags
128 MiB
 
 
 
Tree: 71d552f2e2
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '71d552f2e2'
${ noResults }
cranelift/crates/wasi-nn
Alex Crichton 83029e3fb0
Add `rust-version.workspace = true` to all crates (#9112) 		3 months ago
..
examples Rename the `wasm32-wasi` target to `wasm32-wasip1` (#8867) 3 months ago
src Add FP16 and I64 support for wasi-nn WinML backend. (#8964) 3 months ago
tests Enforce `uninlined_format_args` for the workspace (#9065) 3 months ago
wit wasi-nn: track upstream specification (#9056) 3 months ago
witx wasi-nn: remove Git submodule (#8519) 6 months ago
Cargo.toml Add `rust-version.workspace = true` to all crates (#9112) 3 months ago
LICENSE Add an initial wasi-nn implementation for Wasmtime (#2208) 4 years ago
README.md Rename the `wasm32-wasi` target to `wasm32-wasip1` (#8867) 3 months ago
build.rs wasi-nn: remove Git submodule (#8519) 6 months ago

README.md

wasmtime-wasi-nn

This crate enables support for the wasi-nn API in Wasmtime. Currently it contains an implementation of wasi-nn using OpenVINO™ but in the future it could support multiple machine learning backends. Since the wasi-nn API is expected to be an optional feature of WASI, this crate is currently separate from the wasi-common crate. This crate is experimental and its API, functionality, and location could quickly change.

Use

Use the Wasmtime APIs to instantiate a Wasm module and link in the wasi-nn implementation as follows:

let wasi_nn = WasiNnCtx::new()?;
wasmtime_wasi_nn::witx::add_to_linker(...);

Build

$ cargo build

To use the WIT-based ABI, compile with --features component-model and use wasmtime_wasi_nn::wit::add_to_linker.

Example

An end-to-end example demonstrating ML classification is included in examples: examples/classification-example contains a standalone Rust project that uses the wasi-nn APIs and is compiled to the wasm32-wasip1 target using the high-level wasi-nn bindings.