pub struct JitBackend {
inner: Arc<BackendInner>,
}Expand description
JIT compilation backend with O(1) compiled-function lookup.
Created via JitBackend::new or JitBackend::disabled.
This type is cheaply clonable (backed by Arc).
All clones share the same backend thread, resident map, and statistics.
Fields§
§inner: Arc<BackendInner>Implementations§
Source§impl JitBackend
impl JitBackend
Sourcepub fn disabled() -> Self
pub fn disabled() -> Self
Creates a disabled backend that performs no compilation and spawns no threads.
All lookup calls return LookupDecision::Interpret(Disabled).
Call set_enabled to lazily spawn the backend thread with
a default RuntimeConfig.
Sourcepub fn new(config: RuntimeConfig) -> Result<Self>
pub fn new(config: RuntimeConfig) -> Result<Self>
Creates a backend from the given config.
If enabled is true, the backend thread is spawned
immediately and AOT artifacts are preloaded. Otherwise, both are deferred until the
first set_enabled(true) call.
Sourcepub fn lookup(&self, req: LookupRequest) -> LookupDecision
pub fn lookup(&self, req: LookupRequest) -> LookupDecision
Looks up a compiled function for the given request.
In normal mode this never blocks. In blocking mode,
a miss triggers synchronous JIT compilation and the call blocks until it completes.
Sourcepub fn get_compiled(
&self,
code_hash: B256,
spec_id: SpecId,
) -> Option<Arc<CompiledProgram>>
pub fn get_compiled( &self, code_hash: B256, spec_id: SpecId, ) -> Option<Arc<CompiledProgram>>
Checks the resident map for a compiled program without enqueuing an event.
Sourcepub fn get_compiled_tracked(
&self,
code_hash: B256,
spec_id: SpecId,
) -> Option<Arc<CompiledProgram>>
pub fn get_compiled_tracked( &self, code_hash: B256, spec_id: SpecId, ) -> Option<Arc<CompiledProgram>>
Like get_compiled, but also records hit/miss stats.
Sourcepub fn lookup_blocking(&self, req: LookupRequest) -> LookupDecision
pub fn lookup_blocking(&self, req: LookupRequest) -> LookupDecision
Looks up a compiled function, blocking until compilation completes if not yet ready.
If the function is already compiled, returns it immediately. Otherwise, enqueues
a synchronous JIT compilation request and blocks until the result is available.
Returns LookupDecision::Interpret if the bytecode is ineligible for
compilation (see RuntimeTuning::should_compile) or compilation fails.
Sourcepub fn compile_jit(&self, req: LookupRequest)
pub fn compile_jit(&self, req: LookupRequest)
Enqueues an explicit JIT compilation request for the given bytecode.
Blocks if the command channel is full to guarantee delivery.
Sourcepub fn compile_jit_sync(&self, req: LookupRequest) -> Result<()>
pub fn compile_jit_sync(&self, req: LookupRequest) -> Result<()>
Enqueues a JIT compilation request and blocks until the compilation completes.
Returns Ok(()) when the compiled function is available in the resident map,
or when the compilation fails. Use get_compiled to
retrieve the result after this returns.
Sourcepub fn prepare_aot(&self, req: AotRequest)
pub fn prepare_aot(&self, req: AotRequest)
Enqueues a single AOT preparation request.
This is enqueue-only and returns immediately. The compilation happens
asynchronously on the worker pool. The resulting artifact is persisted
via ArtifactStore::store and loaded into the resident map.
Sourcepub fn prepare_aot_batch(&self, reqs: Vec<AotRequest>)
pub fn prepare_aot_batch(&self, reqs: Vec<AotRequest>)
Enqueues a batch of AOT preparation requests.
Blocks if the command channel is full to guarantee delivery.
Sourcepub fn clear_resident(&self)
pub fn clear_resident(&self)
Clears the in-memory resident compiled map.
All compiled programs are removed from the map. Active references held by callers remain valid until dropped.
Sourcepub fn clear_persisted(&self)
pub fn clear_persisted(&self)
Clears persisted artifacts from the artifact store.
Sourcepub fn set_enabled(&self, enabled: bool) -> Result<()>
pub fn set_enabled(&self, enabled: bool) -> Result<()>
Sets whether the runtime is enabled, spawning the backend thread on first enable.
When enabled is true and the backend thread has not been spawned yet, this
lazily starts it using the config provided at construction time.
Sourcepub fn stats(&self) -> RuntimeStatsSnapshot
pub fn stats(&self) -> RuntimeStatsSnapshot
Returns a point-in-time snapshot of runtime statistics.
Sourcefn ensure_started(&self) -> Result<()>
fn ensure_started(&self) -> Result<()>
Spawns the backend thread if it hasn’t been started yet.
Sourcefn preload_aot(
store: Option<&dyn ArtifactStore>,
) -> Result<Vec<(RuntimeCacheKey, Arc<CompiledProgram>)>>
fn preload_aot( store: Option<&dyn ArtifactStore>, ) -> Result<Vec<(RuntimeCacheKey, Arc<CompiledProgram>)>>
Preloads AOT artifacts from the store as Arc<CompiledProgram>s ready to insert.
Sourcefn load_artifact(
key: &ArtifactKey,
stored: &StoredArtifact,
) -> Result<CompiledProgram>
fn load_artifact( key: &ArtifactKey, stored: &StoredArtifact, ) -> Result<CompiledProgram>
Loads a single artifact: dlopens the dylib path and resolves the symbol.
Trait Implementations§
Source§impl Clone for JitBackend
impl Clone for JitBackend
Source§fn clone(&self) -> JitBackend
fn clone(&self) -> JitBackend
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreAuto Trait Implementations§
impl Freeze for JitBackend
impl !RefUnwindSafe for JitBackend
impl Send for JitBackend
impl Sync for JitBackend
impl Unpin for JitBackend
impl UnsafeUnpin for JitBackend
impl !UnwindSafe for JitBackend
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Conv for T
impl<T> Conv for T
§impl<T> FmtForward for T
impl<T> FmtForward for T
§fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
self to use its Binary implementation when Debug-formatted.§fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
self to use its Display implementation when
Debug-formatted.§fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
self to use its LowerExp implementation when
Debug-formatted.§fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
self to use its LowerHex implementation when
Debug-formatted.§fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
self to use its Octal implementation when Debug-formatted.§fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
self to use its Pointer implementation when
Debug-formatted.§fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
self to use its UpperExp implementation when
Debug-formatted.§fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
self to use its UpperHex implementation when
Debug-formatted.§fn fmt_list(self) -> FmtList<Self>where
&'a Self: for<'a> IntoIterator,
fn fmt_list(self) -> FmtList<Self>where
&'a Self: for<'a> IntoIterator,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read more§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read more§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R,
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
self, then passes self.as_ref() into the pipe function.§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
self, then passes self.as_mut() into the pipe
function.§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
self, then passes self.deref() into the pipe function.§impl<T> Pointable for T
impl<T> Pointable for T
§impl<T> Tap for T
impl<T> Tap for T
§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Borrow<B> of a value. Read more§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
BorrowMut<B> of a value. Read more§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
AsRef<R> view of a value. Read more§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
AsMut<R> view of a value. Read more§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Deref::Target of a value. Read more§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Deref::Target of a value. Read more§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
.tap() only in debug builds, and is erased in release builds.§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
.tap_mut() only in debug builds, and is erased in release
builds.§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
.tap_borrow() only in debug builds, and is erased in release
builds.§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
.tap_borrow_mut() only in debug builds, and is erased in release
builds.§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
.tap_ref() only in debug builds, and is erased in release
builds.§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
.tap_ref_mut() only in debug builds, and is erased in release
builds.§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
.tap_deref() only in debug builds, and is erased in release
builds.§impl<T> TryConv for T
impl<T> TryConv for T
§impl<T> WithSubscriber for T
impl<T> WithSubscriber for T
§fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>where
S: Into<Dispatch>,
fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>where
S: Into<Dispatch>,
§fn with_current_subscriber(self) -> WithDispatch<Self>
fn with_current_subscriber(self) -> WithDispatch<Self>
Layout§
Note: Most layout information is completely unstable and may even differ between compilations. The only exception is types with certain repr(...) attributes. Please see the Rust Reference's “Type Layout” chapter for details on type layout guarantees.
Size: 8 bytes