Trait InferenceBackend 

pub trait InferenceBackend: Send + Sync {
    // Required methods
    fn name(&self) -> &str;
    fn create_session(
        &self,
        source: &ModelSource,
        options: &SessionOptions,
    ) -> AiResult<Box<dyn ModelSession>>;
}

Stable interface implemented by inference engines.

Required Methods

fn name(&self) -> &str

Stable backend identifier such as onnxruntime-cpu.

fn create_session( &self, source: &ModelSource, options: &SessionOptions, ) -> AiResult<Box<dyn ModelSession>>

Loads one model and returns an independent mutable session.

Implementors

impl InferenceBackend for MockInferenceBackend

impl InferenceBackend for OnnxRuntimeBackend