@ondeinference / onde / commits / 6a929de

Switch mistralrs deps to published onde-mistralrs 0.9.1 crates

The 1.2.0 tag failed the crates.io publish because cargo publish rejects git dependencies. The fork is now published as onde-mistralrs{,-core} 0.9.1 (backed by onde-candle-{core,nn} 0.11.0 for the pinned candle snapshot), so all platform targets can resolve from the registry. Documents the expanded 14-crate publish flow in the sdk-regressions skill.

keypair34 committed Jul 20, 2026 at 08:17 UTC 6a929dedf74fcc182a1c987a44f35c71b75135a9
5 files changed +1399 -1324
.agents/skills/sdk-regressions/SKILL.md
+58 -4
@@ -414,6 +414,41 @@ target first.
414
415 ---
416
417 +### Step 0 — check if the candle snapshot needs an `onde-candle-*` publish
418 +
419 +Since 0.9.x, upstream mistral.rs pins `candle` to a git rev past the latest
420 +released candle (e.g. rev `27f20fea`, 19 commits past `0.11.0`, adding
421 +`QTensor::indexed_gemv`, `gemv_fused_shared_lhs`, `BarrierPool::execute_chunked`).
422 +`cargo publish` strips git pins, so publish verification resolves candle from
423 +crates.io and fails with E0599 "method not found" if the pinned rev has APIs the
424 +released candle lacks.
425 +
426 +When that happens, publish the pinned rev under `onde-candle-*` names from the
427 +local candle checkout (`~/Repositories/candle`, branch pattern
428 +`onde/candle-<version>-<rev>`):
429 +
430 +```bash
431 +# Which candle crates actually diverged from the released version?
432 +git diff --stat <release-bump-commit> <pinned-rev> -- candle-core candle-nn candle-metal-kernels
433 +
434 +# Rename ONLY the diverged crates (0.11.0 era: candle-core + candle-nn; the
435 +# rest are byte-identical, official crates serve them). candle-nn must be
436 +# republished whenever candle-core is, even if unchanged, or the official
437 +# candle-nn drags the official candle-core into the graph -> two candle-core
438 +# crates -> type mismatch.
439 +cargo publish -p onde-candle-core
440 +cargo publish -p onde-candle-nn
441 +```
442 +
443 +Then in the mistral.rs fork workspace `Cargo.toml`:
444 +
445 +```toml
446 +candle-core = { version = "0.11.0", package = "onde-candle-core" }
447 +candle-nn = { version = "0.11.0", package = "onde-candle-nn" }
448 +candle-flash-attn-v3 = { version = "0.11.0" } # unchanged at rev -> official
449 +candle-metal-kernels = { version = "0.11.0" } # unchanged at rev -> official
450 +```
451 +
452 ### Step 1 — check if `onde-mistralrs` needs a new publish
453
454 First, see how far the fork has drifted from upstream:
@@ -425,22 +460,41 @@ curl -s "https://api.github.com/repos/setoelkahfi/mistral.rs/compare/EricLBuehle
460
461 If there are new commits since the last `onde-mistralrs` publish, or if
462 upstream cut a new release that the fork has rebased onto, bump the workspace
428 -version in the fork and publish. Sub-crates must go in dependency order:
463 +version in the fork and publish. As of 0.9.1 the set is **12 crates** (upstream
464 +split out flash-attn/metal-compile/code-exec/sandbox, and vision/audio/mcp must
465 +be onde-published too because crates.io only has upstream's old versions).
466 +The rename lives in the workspace dep table (`package = "onde-..."` on each
467 +entry, local dep keys unchanged so imports stay `mistralrs_*`).
468
469 ```bash
470 # 1. Edit the root Cargo.toml in setoelkahfi/mistral.rs
432 -# bump version, e.g. 0.8.1 → 0.8.2
471 +# bump version, e.g. 0.9.0 → 0.9.1
472
434 -# 2. Publish in order — each one depends on the previous:
473 +# 2. Publish in dependency order (leaves first):
474 cargo publish -p onde-mistralrs-macros
475 +cargo publish -p onde-mistralrs-metal-compile
476 +cargo publish -p onde-mistralrs-sandbox
477 +cargo publish -p onde-mistralrs-flash-attn
478 +cargo publish -p onde-mistralrs-vision
479 +cargo publish -p onde-mistralrs-audio
480 +cargo publish -p onde-mistralrs-mcp
481 cargo publish -p onde-mistralrs-paged-attn
482 cargo publish -p onde-mistralrs-quant
483 +cargo publish -p onde-mistralrs-code-exec
484 cargo publish -p onde-mistralrs-core
485 cargo publish -p onde-mistralrs
486
441 -# 3. Give the index ~30 s to propagate before moving on.
487 +# 3. cargo waits for index propagation automatically after each publish.
488 ```
489
490 +Known publish-verification snags (hit during 0.9.1):
491 +
492 +| Error | Fix |
493 +|-------|-----|
494 +| E0599 on candle APIs (`indexed_gemv`, ...) | Step 0 — publish `onde-candle-*` and repoint |
495 +| `dependency tqdm does not specify a version` | git dep needs a registry fallback: `version = "0.8.0"` alongside `git =` |
496 +| `core2 0.4.0 is yanked` | `cargo update -p bitstream-io` (4.10.0 dropped core2) |
497 +
498 ---
499
500 ### Step 2 — update `onde/Cargo.toml`
Cargo.lock
+440 -431
@@ -598,39 +598,11 @@ dependencies = [
598 "serde_core",
599 ]
600
601 -[[package]]
602 -name = "candle-core"
603 -version = "0.11.0"
604 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
605 -dependencies = [
606 - "byteorder",
607 - "candle-metal-kernels",
608 - "candle-ug",
609 - "float8",
610 - "gemm 0.19.0",
611 - "half",
612 - "libc",
613 - "libm",
614 - "memmap2",
615 - "num-traits",
616 - "num_cpus",
617 - "objc2-foundation",
618 - "objc2-metal",
619 - "rand 0.9.5",
620 - "rand_distr 0.5.1",
621 - "rayon",
622 - "safetensors 0.8.0",
623 - "thiserror 2.0.19",
624 - "tokenizers 0.22.2",
625 - "yoke 0.8.3",
626 - "zerocopy",
627 - "zip",
628 -]
629 -
601 [[package]]
602 name = "candle-metal-kernels"
603 version = "0.11.0"
633 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
604 +source = "registry+https://github.com/rust-lang/crates.io-index"
605 +checksum = "242e83c6acf639bb273c929d73c67a882bb4dd08a140f121096e19ba2f213d3e"
606 dependencies = [
607 "block2",
608 "half",
@@ -642,27 +614,11 @@ dependencies = [
614 "tracing",
615 ]
616
645 -[[package]]
646 -name = "candle-nn"
647 -version = "0.11.0"
648 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
649 -dependencies = [
650 - "candle-core",
651 - "candle-metal-kernels",
652 - "half",
653 - "libc",
654 - "num-traits",
655 - "objc2-metal",
656 - "rayon",
657 - "safetensors 0.8.0",
658 - "serde",
659 - "thiserror 2.0.19",
660 -]
661 -
617 [[package]]
618 name = "candle-ug"
619 version = "0.11.0"
665 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
620 +source = "registry+https://github.com/rust-lang/crates.io-index"
621 +checksum = "257411c33abf7d898a31ac20d80813dfe96ff09e23a73039e22ab293aea9b871"
622 dependencies = [
623 "ug",
624 "ug-metal",
@@ -899,15 +855,6 @@ dependencies = [
855 "unicode-segmentation",
856 ]
857
902 -[[package]]
903 -name = "convert_case"
904 -version = "0.10.0"
905 -source = "registry+https://github.com/rust-lang/crates.io-index"
906 -checksum = "633458d4ef8c78b72454de2d54fd6ab2e60f9e02be22f3c6104cdc8a4e0fceb9"
907 -dependencies = [
908 - "unicode-segmentation",
909 -]
910 -
858 [[package]]
859 name = "core-foundation"
860 version = "0.9.4"
@@ -999,17 +946,15 @@ checksum = "61803da095bee82a81bb1a452ecc25d3b2f1416d1897eb86430c6159ef717c17"
946
947 [[package]]
948 name = "crossterm"
1002 -version = "0.29.0"
949 +version = "0.25.0"
950 source = "registry+https://github.com/rust-lang/crates.io-index"
1004 -checksum = "d8b9f2e4c67f833b660cdb0a3523065869fb35570177239812ed4c905aeff87b"
951 +checksum = "e64e6c0fbe2c17357405f7c758c1ef960fce08bdfb2c03d88d2a18d7e09c4b67"
952 dependencies = [
1006 - "bitflags 2.13.1",
953 + "bitflags 1.3.2",
954 "crossterm_winapi",
1008 - "derive_more",
1009 - "document-features",
1010 - "mio",
955 + "libc",
956 + "mio 0.8.11",
957 "parking_lot",
1012 - "rustix",
958 "signal-hook",
959 "signal-hook-mio",
960 "winapi",
@@ -1275,7 +1220,6 @@ version = "2.1.1"
1220 source = "registry+https://github.com/rust-lang/crates.io-index"
1221 checksum = "799a97264921d8623a957f6c3b9011f3b5492f557bbb7a5a19b7fa6d06ba8dcb"
1222 dependencies = [
1278 - "convert_case 0.10.0",
1223 "proc-macro2",
1224 "quote",
1225 "rustc_version",
@@ -1361,15 +1305,6 @@ version = "1.1.1"
1305 source = "registry+https://github.com/rust-lang/crates.io-index"
1306 checksum = "c2db04e74f0a9a93103b50e90b96024c9b2bdca8bce6a632ec71b88736d3d359"
1307
1364 -[[package]]
1365 -name = "document-features"
1366 -version = "0.2.12"
1367 -source = "registry+https://github.com/rust-lang/crates.io-index"
1368 -checksum = "d4b8a88685455ed29a21542a33abd9cb6510b6b129abadabdcef0f4c55bc8f61"
1369 -dependencies = [
1370 - "litrs",
1371 -]
1372 -
1308 [[package]]
1309 name = "dotenvy"
1310 version = "0.15.7"
@@ -2860,12 +2795,6 @@ version = "0.8.2"
2795 source = "registry+https://github.com/rust-lang/crates.io-index"
2796 checksum = "92daf443525c4cce67b150400bc2316076100ce0b3686209eb8cf3c31612e6f0"
2797
2863 -[[package]]
2864 -name = "litrs"
2865 -version = "1.0.0"
2866 -source = "registry+https://github.com/rust-lang/crates.io-index"
2867 -checksum = "11d3d7f243d5c5a8b9bb5d6dd2b1602c0cb0b9db1621bafc7ed66e35ff9fe092"
2868 -
2798 [[package]]
2799 name = "llguidance"
2800 version = "1.7.6"
@@ -3119,290 +3048,25 @@ dependencies = [
3048
3049 [[package]]
3050 name = "mio"
3122 -version = "1.2.2"
3051 +version = "0.8.11"
3052 source = "registry+https://github.com/rust-lang/crates.io-index"
3124 -checksum = "30d65c71f1ce40ab09135ce117d742b9f8a19ff91a41a8b57ed50bc2de59c427"
3053 +checksum = "a4a650543ca06a924e8b371db273b2756685faae30f8487da1b56505a8f78b0c"
3054 dependencies = [
3055 "libc",
3056 "log",
3057 "wasi",
3129 - "windows-sys 0.61.2",
3130 -]
3131 -
3132 -[[package]]
3133 -name = "mistralrs"
3134 -version = "0.9.0"
3135 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3136 -dependencies = [
3137 - "anyhow",
3138 - "candle-core",
3139 - "candle-nn",
3140 - "clap 4.6.2",
3141 - "either",
3142 - "futures",
3143 - "image",
3144 - "indexmap 2.14.0",
3145 - "mistralrs-core",
3146 - "mistralrs-macros",
3147 - "rand 0.9.5",
3148 - "reqwest 0.13.4",
3149 - "schemars 1.2.1",
3150 - "serde",
3151 - "serde_json",
3152 - "thiserror 2.0.19",
3153 - "tokio",
3154 - "tracing",
3155 - "tracing-subscriber",
3156 - "walkdir",
3157 -]
3158 -
3159 -[[package]]
3160 -name = "mistralrs-audio"
3161 -version = "0.9.0"
3162 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3163 -dependencies = [
3164 - "anyhow",
3165 - "apodize",
3166 - "hound",
3167 - "symphonia",
3168 -]
3169 -
3170 -[[package]]
3171 -name = "mistralrs-code-exec"
3172 -version = "0.9.0"
3173 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3174 -dependencies = [
3175 - "anyhow",
3176 - "base64 0.22.1",
3177 - "image",
3178 - "libc",
3179 - "mistralrs-mcp",
3180 - "mistralrs-sandbox",
3181 - "serde",
3182 - "serde_json",
3183 - "tempfile",
3184 - "tokio",
3185 - "tracing",
3186 - "uuid 1.24.0",
3187 -]
3188 -
3189 -[[package]]
3190 -name = "mistralrs-core"
3191 -version = "0.9.0"
3192 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3193 -dependencies = [
3194 - "ahash",
3195 - "akin",
3196 - "anyhow",
3197 - "apodize",
3198 - "as-any",
3199 - "async-trait",
3200 - "base64 0.22.1",
3201 - "bm25",
3202 - "bytemuck",
3203 - "bytemuck_derive",
3204 - "candle-core",
3205 - "candle-metal-kernels",
3206 - "candle-nn",
3207 - "cfgrammar",
3208 - "chrono",
3209 - "clap 4.6.2",
3210 - "csv",
3211 - "derive-new",
3212 - "derive_more",
3213 - "dirs",
3214 - "either",
3215 - "float8",
3216 - "futures",
3217 - "galil-seiferas",
3218 - "half",
3219 - "hashbrown 0.16.1",
3220 - "hf-hub",
3221 - "hound",
3222 - "html2text",
3223 - "http",
3224 - "image",
3225 - "indexmap 2.14.0",
3226 - "indicatif 0.18.6",
3227 - "interprocess",
3228 - "itertools",
3229 - "libc",
3230 - "llguidance",
3231 - "lrtable",
3232 - "mime_guess",
3233 - "minijinja",
3234 - "minijinja-contrib",
3235 - "mistralrs-audio",
3236 - "mistralrs-code-exec",
3237 - "mistralrs-mcp",
3238 - "mistralrs-paged-attn",
3239 - "mistralrs-quant",
3240 - "mistralrs-sandbox",
3241 - "mistralrs-vision",
3242 - "num-traits",
3243 - "objc",
3244 - "objc2-metal",
3245 - "openai-harmony",
3246 - "ordered-float",
3247 - "parking_lot",
3248 - "radix_trie",
3249 - "rand 0.9.5",
3250 - "rand_distr 0.5.1",
3251 - "rand_isaac",
3252 - "rayon",
3253 - "regex",
3254 - "regex-automata",
3255 - "reqwest 0.13.4",
3256 - "rubato",
3257 - "rust-mcp-schema",
3258 - "rustc-hash 2.1.3",
3259 - "rustfft",
3260 - "safetensors 0.8.0",
3261 - "schemars 1.2.1",
3262 - "scraper",
3263 - "serde",
3264 - "serde-big-array",
3265 - "serde-saphyr",
3266 - "serde_json",
3267 - "serde_plain",
3268 - "statrs",
3269 - "strum 0.27.2",
3270 - "symphonia",
3271 - "sysinfo",
3272 - "thiserror 2.0.19",
3273 - "tokenizers 0.21.4",
3274 - "tokio",
3275 - "tokio-rayon",
3276 - "tokio-tungstenite",
3277 - "toktrie",
3278 - "toktrie_hf_tokenizers",
3279 - "toml",
3280 - "tqdm",
3281 - "tracing",
3282 - "tracing-subscriber",
3283 - "urlencoding",
3284 - "uuid 1.24.0",
3285 - "variantly",
3286 - "vob",
3287 -]
3288 -
3289 -[[package]]
3290 -name = "mistralrs-macros"
3291 -version = "0.9.0"
3292 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3293 -dependencies = [
3294 - "darling 0.23.0",
3295 - "proc-macro2",
3296 - "quote",
3297 - "syn 2.0.119",
3058 + "windows-sys 0.48.0",
3059 ]
3060
3061 [[package]]
3301 -name = "mistralrs-mcp"
3302 -version = "0.9.0"
3303 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3304 -dependencies = [
3305 - "anyhow",
3306 - "async-trait",
3307 - "futures-util",
3308 - "http",
3309 - "image",
3310 - "reqwest 0.13.4",
3311 - "rust-mcp-schema",
3312 - "serde",
3313 - "serde_json",
3314 - "tokio",
3315 - "tokio-tungstenite",
3316 - "tracing",
3317 - "utoipa",
3318 - "uuid 1.24.0",
3319 -]
3320 -
3321 -[[package]]
3322 -name = "mistralrs-metal-compile"
3323 -version = "0.9.0"
3324 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3325 -dependencies = [
3326 - "candle-metal-kernels",
3327 - "objc2-metal",
3328 -]
3329 -
3330 -[[package]]
3331 -name = "mistralrs-paged-attn"
3332 -version = "0.9.0"
3333 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3334 -dependencies = [
3335 - "anyhow",
3336 - "candle-core",
3337 - "candle-metal-kernels",
3338 - "dispatch2",
3339 - "float8",
3340 - "half",
3341 - "mistralrs-metal-compile",
3342 - "objc2-foundation",
3343 - "objc2-metal",
3344 - "thiserror 2.0.19",
3345 -]
3346 -
3347 -[[package]]
3348 -name = "mistralrs-quant"
3349 -version = "0.9.0"
3350 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3351 -dependencies = [
3352 - "byteorder",
3353 - "candle-core",
3354 - "candle-metal-kernels",
3355 - "candle-nn",
3356 - "dispatch2",
3357 - "float8",
3358 - "futures",
3359 - "half",
3360 - "hf-hub",
3361 - "indicatif 0.18.6",
3362 - "lazy_static",
3363 - "libc",
3364 - "memmap2",
3365 - "mistralrs-metal-compile",
3366 - "objc2-foundation",
3367 - "objc2-metal",
3368 - "paste",
3369 - "rayon",
3370 - "regex",
3371 - "safetensors 0.8.0",
3372 - "serde",
3373 - "serde_json",
3374 - "sysinfo",
3375 - "thiserror 2.0.19",
3376 - "tokio",
3377 - "tracing",
3378 - "yoke 0.8.3",
3379 -]
3380 -
3381 -[[package]]
3382 -name = "mistralrs-sandbox"
3383 -version = "0.9.0"
3384 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3062 +name = "mio"
3063 +version = "1.2.2"
3064 +source = "registry+https://github.com/rust-lang/crates.io-index"
3065 +checksum = "30d65c71f1ce40ab09135ce117d742b9f8a19ff91a41a8b57ed50bc2de59c427"
3066 dependencies = [
3386 - "anyhow",
3387 - "itoa",
3388 - "landlock",
3067 "libc",
3390 - "nix",
3391 - "seccompiler",
3392 - "serde",
3393 - "thiserror 2.0.19",
3394 - "tokio",
3395 - "tracing",
3396 -]
3397 -
3398 -[[package]]
3399 -name = "mistralrs-vision"
3400 -version = "0.9.0"
3401 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3402 -dependencies = [
3403 - "candle-core",
3404 - "image",
3405 - "rayon",
3068 + "wasi",
3069 + "windows-sys 0.61.2",
3070 ]
3071
3072 [[package]]
@@ -3631,125 +3295,460 @@ dependencies = [
3295 ]
3296
3297 [[package]]
3634 -name = "num_cpus"
3635 -version = "1.17.0"
3298 +name = "num_cpus"
3299 +version = "1.17.0"
3300 +source = "registry+https://github.com/rust-lang/crates.io-index"
3301 +checksum = "91df4bbde75afed763b708b7eee1e8e7651e02d97f6d5dd763e89367e957b23b"
3302 +dependencies = [
3303 + "hermit-abi 0.5.2",
3304 + "libc",
3305 +]
3306 +
3307 +[[package]]
3308 +name = "number_prefix"
3309 +version = "0.4.0"
3310 +source = "registry+https://github.com/rust-lang/crates.io-index"
3311 +checksum = "830b246a0e5f20af87141b25c173cd1b609bd7779a4617d6ec582abaf90870f3"
3312 +
3313 +[[package]]
3314 +name = "objc"
3315 +version = "0.2.7"
3316 +source = "registry+https://github.com/rust-lang/crates.io-index"
3317 +checksum = "915b1b472bc21c53464d6c8461c9d3af805ba1ef837e1cac254428f4a77177b1"
3318 +dependencies = [
3319 + "malloc_buf",
3320 +]
3321 +
3322 +[[package]]
3323 +name = "objc2"
3324 +version = "0.6.4"
3325 +source = "registry+https://github.com/rust-lang/crates.io-index"
3326 +checksum = "3a12a8ed07aefc768292f076dc3ac8c48f3781c8f2d5851dd3d98950e8c5a89f"
3327 +dependencies = [
3328 + "objc2-encode",
3329 +]
3330 +
3331 +[[package]]
3332 +name = "objc2-core-foundation"
3333 +version = "0.3.2"
3334 +source = "registry+https://github.com/rust-lang/crates.io-index"
3335 +checksum = "2a180dd8642fa45cdb7dd721cd4c11b1cadd4929ce112ebd8b9f5803cc79d536"
3336 +dependencies = [
3337 + "bitflags 2.13.1",
3338 + "dispatch2",
3339 + "objc2",
3340 +]
3341 +
3342 +[[package]]
3343 +name = "objc2-encode"
3344 +version = "4.1.0"
3345 +source = "registry+https://github.com/rust-lang/crates.io-index"
3346 +checksum = "ef25abbcd74fb2609453eb695bd2f860d389e457f67dc17cafc8b8cbc89d0c33"
3347 +
3348 +[[package]]
3349 +name = "objc2-foundation"
3350 +version = "0.3.2"
3351 +source = "registry+https://github.com/rust-lang/crates.io-index"
3352 +checksum = "e3e0adef53c21f888deb4fa59fc59f7eb17404926ee8a6f59f5df0fd7f9f3272"
3353 +dependencies = [
3354 + "bitflags 2.13.1",
3355 + "block2",
3356 + "libc",
3357 + "objc2",
3358 + "objc2-core-foundation",
3359 +]
3360 +
3361 +[[package]]
3362 +name = "objc2-io-kit"
3363 +version = "0.3.2"
3364 +source = "registry+https://github.com/rust-lang/crates.io-index"
3365 +checksum = "33fafba39597d6dc1fb709123dfa8289d39406734be322956a69f0931c73bb15"
3366 +dependencies = [
3367 + "libc",
3368 + "objc2-core-foundation",
3369 +]
3370 +
3371 +[[package]]
3372 +name = "objc2-metal"
3373 +version = "0.3.2"
3374 +source = "registry+https://github.com/rust-lang/crates.io-index"
3375 +checksum = "a0125f776a10d00af4152d74616409f0d4a2053a6f57fa5b7d6aa2854ac04794"
3376 +dependencies = [
3377 + "bitflags 2.13.1",
3378 + "block2",
3379 + "dispatch2",
3380 + "objc2",
3381 + "objc2-core-foundation",
3382 + "objc2-foundation",
3383 +]
3384 +
3385 +[[package]]
3386 +name = "once_cell"
3387 +version = "1.21.4"
3388 +source = "registry+https://github.com/rust-lang/crates.io-index"
3389 +checksum = "9f7c3e4beb33f85d45ae3e3a1792185706c8e16d043238c593331cc7cd313b50"
3390 +
3391 +[[package]]
3392 +name = "once_cell_polyfill"
3393 +version = "1.70.2"
3394 +source = "registry+https://github.com/rust-lang/crates.io-index"
3395 +checksum = "384b8ab6d37215f3c5301a95a4accb5d64aa607f1fcb26a11b5303878451b4fe"
3396 +
3397 +[[package]]
3398 +name = "onde"
3399 +version = "1.2.0"
3400 +dependencies = [
3401 + "anyhow",
3402 + "cc",
3403 + "dotenvy",
3404 + "hf-hub",
3405 + "home",
3406 + "log",
3407 + "onde-mistralrs",
3408 + "onde-mistralrs-core",
3409 + "reqwest 0.12.28",
3410 + "serde",
3411 + "serde_json",
3412 + "smbcloud-gresiq-sdk",
3413 + "thiserror 2.0.19",
3414 + "tokio",
3415 + "tsync",
3416 + "uniffi",
3417 +]
3418 +
3419 +[[package]]
3420 +name = "onde-candle-core"
3421 +version = "0.11.0"
3422 +source = "registry+https://github.com/rust-lang/crates.io-index"
3423 +checksum = "b9a5abf45ac6260975d5ff1a5b62c900dafa36f501e6f644c6a571da14a91812"
3424 +dependencies = [
3425 + "byteorder",
3426 + "candle-metal-kernels",
3427 + "candle-ug",
3428 + "float8",
3429 + "gemm 0.19.0",
3430 + "half",
3431 + "libc",
3432 + "libm",
3433 + "memmap2",
3434 + "num-traits",
3435 + "num_cpus",
3436 + "objc2-foundation",
3437 + "objc2-metal",
3438 + "rand 0.9.5",
3439 + "rand_distr 0.5.1",
3440 + "rayon",
3441 + "safetensors 0.8.0",
3442 + "thiserror 2.0.19",
3443 + "tokenizers 0.22.2",
3444 + "yoke 0.8.3",
3445 + "zerocopy",
3446 + "zip",
3447 +]
3448 +
3449 +[[package]]
3450 +name = "onde-candle-nn"
3451 +version = "0.11.0"
3452 +source = "registry+https://github.com/rust-lang/crates.io-index"
3453 +checksum = "3fd746f8118fa485d55c7409b20e2f95637758ec07e9a4d8f35d89f6ec9d8288"
3454 +dependencies = [
3455 + "candle-metal-kernels",
3456 + "half",
3457 + "libc",
3458 + "num-traits",
3459 + "objc2-metal",
3460 + "onde-candle-core",
3461 + "rayon",
3462 + "safetensors 0.8.0",
3463 + "serde",
3464 + "thiserror 2.0.19",
3465 +]
3466 +
3467 +[[package]]
3468 +name = "onde-mistralrs"
3469 +version = "0.9.1"
3470 +source = "registry+https://github.com/rust-lang/crates.io-index"
3471 +checksum = "a2dcdc7fec0ca910266f80af80a62a29c82713483b83f269705aa058a94af790"
3472 +dependencies = [
3473 + "anyhow",
3474 + "clap 4.6.2",
3475 + "either",
3476 + "futures",
3477 + "image",
3478 + "indexmap 2.14.0",
3479 + "onde-candle-core",
3480 + "onde-candle-nn",
3481 + "onde-mistralrs-core",
3482 + "onde-mistralrs-macros",
3483 + "rand 0.9.5",
3484 + "reqwest 0.13.4",
3485 + "schemars 1.2.1",
3486 + "serde",
3487 + "serde_json",
3488 + "thiserror 2.0.19",
3489 + "tokio",
3490 + "tracing",
3491 + "tracing-subscriber",
3492 + "walkdir",
3493 +]
3494 +
3495 +[[package]]
3496 +name = "onde-mistralrs-audio"
3497 +version = "0.9.1"
3498 source = "registry+https://github.com/rust-lang/crates.io-index"
3637 -checksum = "91df4bbde75afed763b708b7eee1e8e7651e02d97f6d5dd763e89367e957b23b"
3499 +checksum = "d03d9e9811c0af0f276f4a007a8f7700f4e2b91761c0afac62cb4dbceed2cbfd"
3500 dependencies = [
3639 - "hermit-abi 0.5.2",
3640 - "libc",
3501 + "anyhow",
3502 + "apodize",
3503 + "hound",
3504 + "symphonia",
3505 ]
3506
3507 [[package]]
3644 -name = "number_prefix"
3645 -version = "0.4.0"
3646 -source = "registry+https://github.com/rust-lang/crates.io-index"
3647 -checksum = "830b246a0e5f20af87141b25c173cd1b609bd7779a4617d6ec582abaf90870f3"
3648 -
3649 -[[package]]
3650 -name = "objc"
3651 -version = "0.2.7"
3508 +name = "onde-mistralrs-code-exec"
3509 +version = "0.9.1"
3510 source = "registry+https://github.com/rust-lang/crates.io-index"
3653 -checksum = "915b1b472bc21c53464d6c8461c9d3af805ba1ef837e1cac254428f4a77177b1"
3511 +checksum = "e79e8a929e71298b08a32a87401cc851e803df14f487b30f728bc0ef9628688f"
3512 dependencies = [
3655 - "malloc_buf",
3513 + "anyhow",
3514 + "base64 0.22.1",
3515 + "image",
3516 + "libc",
3517 + "onde-mistralrs-mcp",
3518 + "onde-mistralrs-sandbox",
3519 + "serde",
3520 + "serde_json",
3521 + "tempfile",
3522 + "tokio",
3523 + "tracing",
3524 + "uuid 1.24.0",
3525 ]
3526
3527 [[package]]
3659 -name = "objc2"
3660 -version = "0.6.4"
3528 +name = "onde-mistralrs-core"
3529 +version = "0.9.1"
3530 source = "registry+https://github.com/rust-lang/crates.io-index"
3662 -checksum = "3a12a8ed07aefc768292f076dc3ac8c48f3781c8f2d5851dd3d98950e8c5a89f"
3531 +checksum = "19893d8ec2a91c772aab1ef551600cf39a03ae4d8f07af96ed9af1307dba3c27"
3532 dependencies = [
3664 - "objc2-encode",
3533 + "ahash",
3534 + "akin",
3535 + "anyhow",
3536 + "apodize",
3537 + "as-any",
3538 + "async-trait",
3539 + "base64 0.22.1",
3540 + "bm25",
3541 + "bytemuck",
3542 + "bytemuck_derive",
3543 + "candle-metal-kernels",
3544 + "cfgrammar",
3545 + "chrono",
3546 + "clap 4.6.2",
3547 + "csv",
3548 + "derive-new",
3549 + "derive_more",
3550 + "dirs",
3551 + "either",
3552 + "float8",
3553 + "futures",
3554 + "galil-seiferas",
3555 + "half",
3556 + "hashbrown 0.16.1",
3557 + "hf-hub",
3558 + "hound",
3559 + "html2text",
3560 + "http",
3561 + "image",
3562 + "indexmap 2.14.0",
3563 + "indicatif 0.18.6",
3564 + "interprocess",
3565 + "itertools",
3566 + "libc",
3567 + "llguidance",
3568 + "lrtable",
3569 + "mime_guess",
3570 + "minijinja",
3571 + "minijinja-contrib",
3572 + "num-traits",
3573 + "objc",
3574 + "objc2-metal",
3575 + "onde-candle-core",
3576 + "onde-candle-nn",
3577 + "onde-mistralrs-audio",
3578 + "onde-mistralrs-code-exec",
3579 + "onde-mistralrs-mcp",
3580 + "onde-mistralrs-paged-attn",
3581 + "onde-mistralrs-quant",
3582 + "onde-mistralrs-sandbox",
3583 + "onde-mistralrs-vision",
3584 + "openai-harmony",
3585 + "ordered-float",
3586 + "parking_lot",
3587 + "radix_trie",
3588 + "rand 0.9.5",
3589 + "rand_distr 0.5.1",
3590 + "rand_isaac",
3591 + "rayon",
3592 + "regex",
3593 + "regex-automata",
3594 + "reqwest 0.13.4",
3595 + "rubato",
3596 + "rust-mcp-schema",
3597 + "rustc-hash 2.1.3",
3598 + "rustfft",
3599 + "safetensors 0.8.0",
3600 + "schemars 1.2.1",
3601 + "scraper",
3602 + "serde",
3603 + "serde-big-array",
3604 + "serde-saphyr",
3605 + "serde_json",
3606 + "serde_plain",
3607 + "statrs",
3608 + "strum 0.27.2",
3609 + "symphonia",
3610 + "sysinfo",
3611 + "thiserror 2.0.19",
3612 + "tokenizers 0.21.4",
3613 + "tokio",
3614 + "tokio-rayon",
3615 + "tokio-tungstenite",
3616 + "toktrie",
3617 + "toktrie_hf_tokenizers",
3618 + "toml",
3619 + "tqdm",
3620 + "tracing",
3621 + "tracing-subscriber",
3622 + "urlencoding",
3623 + "uuid 1.24.0",
3624 + "variantly",
3625 + "vob",
3626 ]
3627
3628 [[package]]
3668 -name = "objc2-core-foundation"
3669 -version = "0.3.2"
3629 +name = "onde-mistralrs-macros"
3630 +version = "0.9.1"
3631 source = "registry+https://github.com/rust-lang/crates.io-index"
3671 -checksum = "2a180dd8642fa45cdb7dd721cd4c11b1cadd4929ce112ebd8b9f5803cc79d536"
3632 +checksum = "98ac14c14c8d54d2b9068dc8e2a8f892018d1ff15922e1bf2ed79abade164fe1"
3633 dependencies = [
3673 - "bitflags 2.13.1",
3674 - "dispatch2",
3675 - "objc2",
3634 + "darling 0.23.0",
3635 + "proc-macro2",
3636 + "quote",
3637 + "syn 2.0.119",
3638 ]
3639
3640 [[package]]
3679 -name = "objc2-encode"
3680 -version = "4.1.0"
3681 -source = "registry+https://github.com/rust-lang/crates.io-index"
3682 -checksum = "ef25abbcd74fb2609453eb695bd2f860d389e457f67dc17cafc8b8cbc89d0c33"
3683 -
3684 -[[package]]
3685 -name = "objc2-foundation"
3686 -version = "0.3.2"
3641 +name = "onde-mistralrs-mcp"
3642 +version = "0.9.1"
3643 source = "registry+https://github.com/rust-lang/crates.io-index"
3688 -checksum = "e3e0adef53c21f888deb4fa59fc59f7eb17404926ee8a6f59f5df0fd7f9f3272"
3644 +checksum = "347ebf2dedbc51f9867b6ecd657bc5e31a35cebf8c75b0a7d1b870836404e36a"
3645 dependencies = [
3690 - "bitflags 2.13.1",
3691 - "block2",
3692 - "libc",
3693 - "objc2",
3694 - "objc2-core-foundation",
3646 + "anyhow",
3647 + "async-trait",
3648 + "futures-util",
3649 + "http",
3650 + "image",
3651 + "reqwest 0.13.4",
3652 + "rust-mcp-schema",
3653 + "serde",
3654 + "serde_json",
3655 + "tokio",
3656 + "tokio-tungstenite",
3657 + "tracing",
3658 + "utoipa",
3659 + "uuid 1.24.0",
3660 ]
3661
3662 [[package]]
3698 -name = "objc2-io-kit"
3699 -version = "0.3.2"
3663 +name = "onde-mistralrs-metal-compile"
3664 +version = "0.9.1"
3665 source = "registry+https://github.com/rust-lang/crates.io-index"
3701 -checksum = "33fafba39597d6dc1fb709123dfa8289d39406734be322956a69f0931c73bb15"
3666 +checksum = "22e0810702e48f8e3e868b977d6820812b778722f7174da6197792b9f1674eb0"
3667 dependencies = [
3703 - "libc",
3704 - "objc2-core-foundation",
3668 + "candle-metal-kernels",
3669 + "objc2-metal",
3670 ]
3671
3672 [[package]]
3708 -name = "objc2-metal"
3709 -version = "0.3.2"
3673 +name = "onde-mistralrs-paged-attn"
3674 +version = "0.9.1"
3675 source = "registry+https://github.com/rust-lang/crates.io-index"
3711 -checksum = "a0125f776a10d00af4152d74616409f0d4a2053a6f57fa5b7d6aa2854ac04794"
3676 +checksum = "c981780845e62178b1bb4b7a4615ef33aa40ff46f3f15552f70fb5c9daa43073"
3677 dependencies = [
3713 - "bitflags 2.13.1",
3714 - "block2",
3678 + "anyhow",
3679 + "candle-metal-kernels",
3680 "dispatch2",
3716 - "objc2",
3717 - "objc2-core-foundation",
3681 + "float8",
3682 + "half",
3683 "objc2-foundation",
3684 + "objc2-metal",
3685 + "onde-candle-core",
3686 + "onde-mistralrs-metal-compile",
3687 + "thiserror 2.0.19",
3688 ]
3689
3690 [[package]]
3722 -name = "once_cell"
3723 -version = "1.21.4"
3691 +name = "onde-mistralrs-quant"
3692 +version = "0.9.1"
3693 source = "registry+https://github.com/rust-lang/crates.io-index"
3725 -checksum = "9f7c3e4beb33f85d45ae3e3a1792185706c8e16d043238c593331cc7cd313b50"
3694 +checksum = "c381c2af74c2708dd7c8b3cb3fef41fcbcd7602a60983dc42ffcf03a9a771bcc"
3695 +dependencies = [
3696 + "byteorder",
3697 + "candle-metal-kernels",
3698 + "dispatch2",
3699 + "float8",
3700 + "futures",
3701 + "half",
3702 + "hf-hub",
3703 + "indicatif 0.18.6",
3704 + "lazy_static",
3705 + "libc",
3706 + "memmap2",
3707 + "objc2-foundation",
3708 + "objc2-metal",
3709 + "onde-candle-core",
3710 + "onde-candle-nn",
3711 + "onde-mistralrs-metal-compile",
3712 + "paste",
3713 + "rayon",
3714 + "regex",
3715 + "safetensors 0.8.0",
3716 + "serde",
3717 + "serde_json",
3718 + "sysinfo",
3719 + "thiserror 2.0.19",
3720 + "tokio",
3721 + "tracing",
3722 + "yoke 0.8.3",
3723 +]
3724
3725 [[package]]
3728 -name = "once_cell_polyfill"
3729 -version = "1.70.2"
3726 +name = "onde-mistralrs-sandbox"
3727 +version = "0.9.1"
3728 source = "registry+https://github.com/rust-lang/crates.io-index"
3731 -checksum = "384b8ab6d37215f3c5301a95a4accb5d64aa607f1fcb26a11b5303878451b4fe"
3732 -
3733 -[[package]]
3734 -name = "onde"
3735 -version = "1.2.0"
3729 +checksum = "9a7467bc5b587a96bdb0af5cb48ad75546cee88cd18285e4dbc844bdda749ffe"
3730 dependencies = [
3731 "anyhow",
3738 - "cc",
3739 - "dotenvy",
3740 - "hf-hub",
3741 - "home",
3742 - "log",
3743 - "mistralrs",
3744 - "mistralrs-core",
3745 - "reqwest 0.12.28",
3732 + "itoa",
3733 + "landlock",
3734 + "libc",
3735 + "nix",
3736 + "seccompiler",
3737 "serde",
3747 - "serde_json",
3748 - "smbcloud-gresiq-sdk",
3738 "thiserror 2.0.19",
3739 "tokio",
3751 - "tsync",
3752 - "uniffi",
3740 + "tracing",
3741 +]
3742 +
3743 +[[package]]
3744 +name = "onde-mistralrs-vision"
3745 +version = "0.9.1"
3746 +source = "registry+https://github.com/rust-lang/crates.io-index"
3747 +checksum = "2d38f84085733aa0585f4f5bf9dfc8d7e7763fbe9a33a4231cffc87531ebebb0"
3748 +dependencies = [
3749 + "image",
3750 + "onde-candle-core",
3751 + "rayon",
3752 ]
3753
3754 [[package]]
@@ -5208,7 +5207,7 @@ source = "registry+https://github.com/rust-lang/crates.io-index"
5207 checksum = "b75a19a7a740b25bc7944bdee6172368f988763b744e3d4dfe753f6b4ece40cc"
5208 dependencies = [
5209 "libc",
5211 - "mio",
5210 + "mio 0.8.11",
5211 "signal-hook",
5212 ]
5213
@@ -6073,7 +6072,7 @@ checksum = "d988bcd52dbe076d3d46903332f58c912b87a2c49b1428419a5845154762ffee"
6072 dependencies = [
6073 "bytes",
6074 "libc",
6076 - "mio",
6075 + "mio 1.2.2",
6076 "parking_lot",
6077 "pin-project-lite",
6078 "signal-hook-registry",
@@ -6252,7 +6251,8 @@ checksum = "8df9b6e13f2d32c91b9bd719c00d1958837bc7dec474d94952798cc8e69eeec3"
6251 [[package]]
6252 name = "tqdm"
6253 version = "0.8.0"
6255 -source = "git+https://github.com/setoelkahfi/tqdm?branch=deps%2Fbump-crossterm#41e4182829136e6dadbdd1c36af824d19219147a"
6254 +source = "registry+https://github.com/rust-lang/crates.io-index"
6255 +checksum = "b316d5c2ac649ca856dacd487d0ebb94f3b746bada51355d93dd2c007ab62a2e"
6256 dependencies = [
6257 "anyhow",
6258 "crossterm",
@@ -6342,7 +6342,7 @@ version = "2.2.1"
6342 source = "registry+https://github.com/rust-lang/crates.io-index"
6343 checksum = "4fc20a25899c5ae43735253244214f3d5eb75dd28d9cc8491732294a985adb8c"
6344 dependencies = [
6345 - "convert_case 0.6.0",
6345 + "convert_case",
6346 "proc-macro2",
6347 "quote",
6348 "state",
@@ -7163,6 +7163,15 @@ dependencies = [
7163 "windows-link 0.2.1",
7164 ]
7165
7166 +[[package]]
7167 +name = "windows-sys"
7168 +version = "0.48.0"
7169 +source = "registry+https://github.com/rust-lang/crates.io-index"
7170 +checksum = "677d2418bec65e3338edb076e806bc1ec15693c5d0104683f2efe857f61056a9"
7171 +dependencies = [
7172 + "windows-targets 0.48.5",
7173 +]
7174 +
7175 [[package]]
7176 name = "windows-sys"
7177 version = "0.52.0"
Cargo.toml
+22 -28
@@ -26,51 +26,51 @@ crate-type = ["lib", "cdylib", "staticlib"]
26 # in the Android sandbox).
27 [target.'cfg(target_os = "android")'.dependencies]
28 hf-hub = { version = "0.4", features = ["tokio", "rustls-tls"], default-features = false }
29 -mistralrs = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs", features = [] }
30 -mistralrs-core = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs-core", features = [] }
29 +mistralrs = { version = "0.9.1", package = "onde-mistralrs", features = [] }
30 +mistralrs-core = { version = "0.9.1", package = "onde-mistralrs-core", features = [] }
31
32 # iOS: Metal-accelerated inference; hf-hub + mistralrs-core needed for
33 # GLOBAL_HF_CACHE sandbox workaround (~/.cache is outside the container).
34 [target.'cfg(target_os = "ios")'.dependencies]
35 hf-hub = { version = "0.4", features = ["tokio", "rustls-tls"], default-features = false }
36 -mistralrs = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs", features = ["metal"] }
37 -mistralrs-core = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs-core", features = ["metal"] }
36 +mistralrs = { version = "0.9.1", package = "onde-mistralrs", features = ["metal"] }
37 +mistralrs-core = { version = "0.9.1", package = "onde-mistralrs-core", features = ["metal"] }
38
39 # Linux: CPU-only baseline (no GPU features).
40 # For NVIDIA GPU builds, patch this to features = ["cuda"] in CI before building.
41 [target.'cfg(target_os = "linux")'.dependencies]
42 -mistralrs = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs" }
42 +mistralrs = { version = "0.9.1", package = "onde-mistralrs" }
43
44 # macOS: Metal-accelerated inference.
45 [target.'cfg(target_os = "macos")'.dependencies]
46 -mistralrs = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs", features = ["metal"] }
46 +mistralrs = { version = "0.9.1", package = "onde-mistralrs", features = ["metal"] }
47
48 # tvOS: Metal-accelerated inference (Apple TV has Apple GPU); hf-hub +
49 # mistralrs-core needed for GLOBAL_HF_CACHE sandbox workaround.
50 [target.'cfg(target_os = "tvos")'.dependencies]
51 hf-hub = { version = "0.4", features = ["tokio", "rustls-tls"], default-features = false }
52 -mistralrs = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs", features = ["metal"] }
53 -mistralrs-core = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs-core", features = ["metal"] }
52 +mistralrs = { version = "0.9.1", package = "onde-mistralrs", features = ["metal"] }
53 +mistralrs-core = { version = "0.9.1", package = "onde-mistralrs-core", features = ["metal"] }
54
55 # visionOS: Metal-accelerated inference (Apple Vision Pro has M2 GPU);
56 # hf-hub + mistralrs-core needed for GLOBAL_HF_CACHE sandbox workaround.
57 [target.'cfg(target_os = "visionos")'.dependencies]
58 hf-hub = { version = "0.4", features = ["tokio", "rustls-tls"], default-features = false }
59 -mistralrs = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs", features = ["metal"] }
60 -mistralrs-core = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs-core", features = ["metal"] }
59 +mistralrs = { version = "0.9.1", package = "onde-mistralrs", features = ["metal"] }
60 +mistralrs-core = { version = "0.9.1", package = "onde-mistralrs-core", features = ["metal"] }
61
62 # watchOS: Metal-accelerated inference (Apple Watch Series 4+ has Apple GPU);
63 # hf-hub + mistralrs-core needed for GLOBAL_HF_CACHE sandbox workaround.
64 # Memory constrained — default to 1.5B model.
65 [target.'cfg(target_os = "watchos")'.dependencies]
66 hf-hub = { version = "0.4", features = ["tokio", "rustls-tls"], default-features = false }
67 -mistralrs = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs", features = ["metal"] }
68 -mistralrs-core = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs-core", features = ["metal"] }
67 +mistralrs = { version = "0.9.1", package = "onde-mistralrs", features = ["metal"] }
68 +mistralrs-core = { version = "0.9.1", package = "onde-mistralrs-core", features = ["metal"] }
69
70 # Windows: CPU-only baseline (no GPU features).
71 # For NVIDIA GPU builds, patch this to features = ["cuda"] in CI before building.
72 [target.'cfg(target_os = "windows")'.dependencies]
73 -mistralrs = { git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes", package = "mistralrs" }
73 +mistralrs = { version = "0.9.1", package = "onde-mistralrs" }
74
75 [dependencies]
76 anyhow = "1"
@@ -101,21 +101,15 @@ dotenvy = "0.15"
101 # Required for UniFFI scaffolding code generation at build time.
102 uniffi = { version = "=0.31.0", features = ["build"] }
103
104 -# ── mistral.rs fork deps ─────────────────────────────────────────────────────
105 -#
106 -# The target-conditional mistralrs deps above are temporarily pointed at the
107 -# git fork (fix/all-platform-fixes, synced with upstream 0.8.23) instead of
108 -# the published onde-mistralrs 0.8.2 crates.
109 -#
110 -# NOTE: a [patch.crates-io] entry CANNOT rename a package, so patching
111 -# `onde-mistralrs` with the fork's `mistralrs` package silently never applies
112 -# — cargo keeps using the registry crate. That is why the dependencies are
113 -# switched to `git = ...` directly.
114 -#
115 -# Before the next crates.io release: publish onde-mistralrs{,-core} 0.8.23
116 -# from the fork, then flip these deps back to registry form
117 -# (`version = "0.8.23", package = "onde-mistralrs"`), because `cargo publish`
118 -# rejects git dependencies.
104 +# The target-conditional mistralrs deps above resolve to the published
105 +# onde-mistralrs{,-core} 0.9.1 crates (setoelkahfi/mistral.rs fork,
106 +# fix/all-platform-fixes, synced with upstream 0.9.x). Those in turn pull
107 +# onde-candle-{core,nn} 0.11.0 (candle rev 27f20fea published under new names;
108 +# upstream mistral.rs needs post-0.11.0 candle APIs no released candle has).
109 +# For local dev against the fork, point them back at
110 +# git = "https://github.com/setoelkahfi/mistral.rs", branch = "fix/all-platform-fixes"
111 +# with package = "onde-mistralrs{,-core}" (the fork's crates carry the onde names
112 +# now); flip to registry form before publishing, cargo publish rejects git deps.
113
114 # Patch sysctl with watchOS support until upstream merges it.
115 # PR: https://github.com/johalun/sysctl-rs/pull/74
sdk/dart/rust/Cargo.lock
+439 -430
@@ -652,39 +652,11 @@ dependencies = [
652 "serde_core",
653 ]
654
655 -[[package]]
656 -name = "candle-core"
657 -version = "0.11.0"
658 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
659 -dependencies = [
660 - "byteorder",
661 - "candle-metal-kernels",
662 - "candle-ug",
663 - "float8",
664 - "gemm 0.19.0",
665 - "half",
666 - "libc",
667 - "libm",
668 - "memmap2",
669 - "num-traits",
670 - "num_cpus",
671 - "objc2-foundation",
672 - "objc2-metal",
673 - "rand 0.9.5",
674 - "rand_distr 0.5.1",
675 - "rayon",
676 - "safetensors 0.8.0",
677 - "thiserror 2.0.18",
678 - "tokenizers 0.22.2",
679 - "yoke 0.8.2",
680 - "zerocopy",
681 - "zip",
682 -]
683 -
655 [[package]]
656 name = "candle-metal-kernels"
657 version = "0.11.0"
687 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
658 +source = "registry+https://github.com/rust-lang/crates.io-index"
659 +checksum = "242e83c6acf639bb273c929d73c67a882bb4dd08a140f121096e19ba2f213d3e"
660 dependencies = [
661 "block2",
662 "half",
@@ -696,27 +668,11 @@ dependencies = [
668 "tracing",
669 ]
670
699 -[[package]]
700 -name = "candle-nn"
701 -version = "0.11.0"
702 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
703 -dependencies = [
704 - "candle-core",
705 - "candle-metal-kernels",
706 - "half",
707 - "libc",
708 - "num-traits",
709 - "objc2-metal",
710 - "rayon",
711 - "safetensors 0.8.0",
712 - "serde",
713 - "thiserror 2.0.18",
714 -]
715 -
671 [[package]]
672 name = "candle-ug"
673 version = "0.11.0"
719 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
674 +source = "registry+https://github.com/rust-lang/crates.io-index"
675 +checksum = "257411c33abf7d898a31ac20d80813dfe96ff09e23a73039e22ab293aea9b871"
676 dependencies = [
677 "ug",
678 "ug-metal",
@@ -958,15 +914,6 @@ dependencies = [
914 "unicode-segmentation",
915 ]
916
961 -[[package]]
962 -name = "convert_case"
963 -version = "0.10.0"
964 -source = "registry+https://github.com/rust-lang/crates.io-index"
965 -checksum = "633458d4ef8c78b72454de2d54fd6ab2e60f9e02be22f3c6104cdc8a4e0fceb9"
966 -dependencies = [
967 - "unicode-segmentation",
968 -]
969 -
917 [[package]]
918 name = "core-foundation"
919 version = "0.9.4"
@@ -1049,17 +996,15 @@ checksum = "d0a5c400df2834b80a4c3327b3aad3a4c4cd4de0629063962b03235697506a28"
996
997 [[package]]
998 name = "crossterm"
1052 -version = "0.29.0"
999 +version = "0.25.0"
1000 source = "registry+https://github.com/rust-lang/crates.io-index"
1054 -checksum = "d8b9f2e4c67f833b660cdb0a3523065869fb35570177239812ed4c905aeff87b"
1001 +checksum = "e64e6c0fbe2c17357405f7c758c1ef960fce08bdfb2c03d88d2a18d7e09c4b67"
1002 dependencies = [
1056 - "bitflags 2.11.0",
1003 + "bitflags 1.3.2",
1004 "crossterm_winapi",
1058 - "derive_more",
1059 - "document-features",
1060 - "mio",
1005 + "libc",
1006 + "mio 0.8.11",
1007 "parking_lot",
1062 - "rustix",
1008 "signal-hook",
1009 "signal-hook-mio",
1010 "winapi",
@@ -1359,7 +1304,6 @@ version = "2.1.1"
1304 source = "registry+https://github.com/rust-lang/crates.io-index"
1305 checksum = "799a97264921d8623a957f6c3b9011f3b5492f557bbb7a5a19b7fa6d06ba8dcb"
1306 dependencies = [
1362 - "convert_case 0.10.0",
1307 "proc-macro2",
1308 "quote",
1309 "rustc_version",
@@ -1445,15 +1389,6 @@ version = "1.1.1"
1389 source = "registry+https://github.com/rust-lang/crates.io-index"
1390 checksum = "c2db04e74f0a9a93103b50e90b96024c9b2bdca8bce6a632ec71b88736d3d359"
1391
1448 -[[package]]
1449 -name = "document-features"
1450 -version = "0.2.12"
1451 -source = "registry+https://github.com/rust-lang/crates.io-index"
1452 -checksum = "d4b8a88685455ed29a21542a33abd9cb6510b6b129abadabdcef0f4c55bc8f61"
1453 -dependencies = [
1454 - "litrs",
1455 -]
1456 -
1392 [[package]]
1393 name = "dotenvy"
1394 version = "0.15.7"
@@ -3032,12 +2967,6 @@ version = "0.8.2"
2967 source = "registry+https://github.com/rust-lang/crates.io-index"
2968 checksum = "92daf443525c4cce67b150400bc2316076100ce0b3686209eb8cf3c31612e6f0"
2969
3035 -[[package]]
3036 -name = "litrs"
3037 -version = "1.0.0"
3038 -source = "registry+https://github.com/rust-lang/crates.io-index"
3039 -checksum = "11d3d7f243d5c5a8b9bb5d6dd2b1602c0cb0b9db1621bafc7ed66e35ff9fe092"
3040 -
2970 [[package]]
2971 name = "llguidance"
2972 version = "1.7.0"
@@ -3301,290 +3230,25 @@ dependencies = [
3230
3231 [[package]]
3232 name = "mio"
3304 -version = "1.2.0"
3233 +version = "0.8.11"
3234 source = "registry+https://github.com/rust-lang/crates.io-index"
3306 -checksum = "50b7e5b27aa02a74bac8c3f23f448f8d87ff11f92d3aac1a6ed369ee08cc56c1"
3235 +checksum = "a4a650543ca06a924e8b371db273b2756685faae30f8487da1b56505a8f78b0c"
3236 dependencies = [
3237 "libc",
3238 "log",
3239 "wasi",
3311 - "windows-sys 0.61.2",
3312 -]
3313 -
3314 -[[package]]
3315 -name = "mistralrs"
3316 -version = "0.9.0"
3317 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3318 -dependencies = [
3319 - "anyhow",
3320 - "candle-core",
3321 - "candle-nn",
3322 - "clap 4.6.0",
3323 - "either",
3324 - "futures",
3325 - "image",
3326 - "indexmap 2.13.1",
3327 - "mistralrs-core",
3328 - "mistralrs-macros",
3329 - "rand 0.9.5",
3330 - "reqwest 0.13.2",
3331 - "schemars 1.2.1",
3332 - "serde",
3333 - "serde_json",
3334 - "thiserror 2.0.18",
3335 - "tokio",
3336 - "tracing",
3337 - "tracing-subscriber",
3338 - "walkdir",
3339 -]
3340 -
3341 -[[package]]
3342 -name = "mistralrs-audio"
3343 -version = "0.9.0"
3344 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3345 -dependencies = [
3346 - "anyhow",
3347 - "apodize",
3348 - "hound",
3349 - "symphonia",
3350 -]
3351 -
3352 -[[package]]
3353 -name = "mistralrs-code-exec"
3354 -version = "0.9.0"
3355 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3356 -dependencies = [
3357 - "anyhow",
3358 - "base64 0.22.1",
3359 - "image",
3360 - "libc",
3361 - "mistralrs-mcp",
3362 - "mistralrs-sandbox",
3363 - "serde",
3364 - "serde_json",
3365 - "tempfile",
3366 - "tokio",
3367 - "tracing",
3368 - "uuid 1.23.0",
3369 -]
3370 -
3371 -[[package]]
3372 -name = "mistralrs-core"
3373 -version = "0.9.0"
3374 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3375 -dependencies = [
3376 - "ahash",
3377 - "akin",
3378 - "anyhow",
3379 - "apodize",
3380 - "as-any",
3381 - "async-trait",
3382 - "base64 0.22.1",
3383 - "bm25",
3384 - "bytemuck",
3385 - "bytemuck_derive",
3386 - "candle-core",
3387 - "candle-metal-kernels",
3388 - "candle-nn",
3389 - "cfgrammar",
3390 - "chrono",
3391 - "clap 4.6.0",
3392 - "csv",
3393 - "derive-new",
3394 - "derive_more",
3395 - "dirs",
3396 - "either",
3397 - "float8",
3398 - "futures",
3399 - "galil-seiferas",
3400 - "half",
3401 - "hashbrown 0.16.1",
3402 - "hf-hub",
3403 - "hound",
3404 - "html2text",
3405 - "http",
3406 - "image",
3407 - "indexmap 2.13.1",
3408 - "indicatif 0.18.4",
3409 - "interprocess",
3410 - "itertools",
3411 - "libc",
3412 - "llguidance",
3413 - "lrtable",
3414 - "mime_guess",
3415 - "minijinja",
3416 - "minijinja-contrib",
3417 - "mistralrs-audio",
3418 - "mistralrs-code-exec",
3419 - "mistralrs-mcp",
3420 - "mistralrs-paged-attn",
3421 - "mistralrs-quant",
3422 - "mistralrs-sandbox",
3423 - "mistralrs-vision",
3424 - "num-traits",
3425 - "objc",
3426 - "objc2-metal",
3427 - "openai-harmony",
3428 - "ordered-float",
3429 - "parking_lot",
3430 - "radix_trie",
3431 - "rand 0.9.5",
3432 - "rand_distr 0.5.1",
3433 - "rand_isaac",
3434 - "rayon",
3435 - "regex",
3436 - "regex-automata",
3437 - "reqwest 0.13.2",
3438 - "rubato",
3439 - "rust-mcp-schema",
3440 - "rustc-hash 2.1.2",
3441 - "rustfft",
3442 - "safetensors 0.8.0",
3443 - "schemars 1.2.1",
3444 - "scraper",
3445 - "serde",
3446 - "serde-big-array",
3447 - "serde-saphyr",
3448 - "serde_json",
3449 - "serde_plain",
3450 - "statrs",
3451 - "strum 0.27.2",
3452 - "symphonia",
3453 - "sysinfo",
3454 - "thiserror 2.0.18",
3455 - "tokenizers 0.21.4",
3456 - "tokio",
3457 - "tokio-rayon",
3458 - "tokio-tungstenite",
3459 - "toktrie",
3460 - "toktrie_hf_tokenizers",
3461 - "toml",
3462 - "tqdm",
3463 - "tracing",
3464 - "tracing-subscriber",
3465 - "urlencoding",
3466 - "uuid 1.23.0",
3467 - "variantly",
3468 - "vob",
3469 -]
3470 -
3471 -[[package]]
3472 -name = "mistralrs-macros"
3473 -version = "0.9.0"
3474 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3475 -dependencies = [
3476 - "darling 0.23.0",
3477 - "proc-macro2",
3478 - "quote",
3479 - "syn 2.0.117",
3480 -]
3481 -
3482 -[[package]]
3483 -name = "mistralrs-mcp"
3484 -version = "0.9.0"
3485 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3486 -dependencies = [
3487 - "anyhow",
3488 - "async-trait",
3489 - "futures-util",
3490 - "http",
3491 - "image",
3492 - "reqwest 0.13.2",
3493 - "rust-mcp-schema",
3494 - "serde",
3495 - "serde_json",
3496 - "tokio",
3497 - "tokio-tungstenite",
3498 - "tracing",
3499 - "utoipa",
3500 - "uuid 1.23.0",
3501 -]
3502 -
3503 -[[package]]
3504 -name = "mistralrs-metal-compile"
3505 -version = "0.9.0"
3506 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3507 -dependencies = [
3508 - "candle-metal-kernels",
3509 - "objc2-metal",
3510 -]
3511 -
3512 -[[package]]
3513 -name = "mistralrs-paged-attn"
3514 -version = "0.9.0"
3515 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3516 -dependencies = [
3517 - "anyhow",
3518 - "candle-core",
3519 - "candle-metal-kernels",
3520 - "dispatch2",
3521 - "float8",
3522 - "half",
3523 - "mistralrs-metal-compile",
3524 - "objc2-foundation",
3525 - "objc2-metal",
3526 - "thiserror 2.0.18",
3240 + "windows-sys 0.48.0",
3241 ]
3242
3243 [[package]]
3530 -name = "mistralrs-quant"
3531 -version = "0.9.0"
3532 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3533 -dependencies = [
3534 - "byteorder",
3535 - "candle-core",
3536 - "candle-metal-kernels",
3537 - "candle-nn",
3538 - "dispatch2",
3539 - "float8",
3540 - "futures",
3541 - "half",
3542 - "hf-hub",
3543 - "indicatif 0.18.4",
3544 - "lazy_static",
3545 - "libc",
3546 - "memmap2",
3547 - "mistralrs-metal-compile",
3548 - "objc2-foundation",
3549 - "objc2-metal",
3550 - "paste",
3551 - "rayon",
3552 - "regex",
3553 - "safetensors 0.8.0",
3554 - "serde",
3555 - "serde_json",
3556 - "sysinfo",
3557 - "thiserror 2.0.18",
3558 - "tokio",
3559 - "tracing",
3560 - "yoke 0.8.2",
3561 -]
3562 -
3563 -[[package]]
3564 -name = "mistralrs-sandbox"
3565 -version = "0.9.0"
3566 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3244 +name = "mio"
3245 +version = "1.2.0"
3246 +source = "registry+https://github.com/rust-lang/crates.io-index"
3247 +checksum = "50b7e5b27aa02a74bac8c3f23f448f8d87ff11f92d3aac1a6ed369ee08cc56c1"
3248 dependencies = [
3568 - "anyhow",
3569 - "itoa",
3570 - "landlock",
3249 "libc",
3572 - "nix",
3573 - "seccompiler",
3574 - "serde",
3575 - "thiserror 2.0.18",
3576 - "tokio",
3577 - "tracing",
3578 -]
3579 -
3580 -[[package]]
3581 -name = "mistralrs-vision"
3582 -version = "0.9.0"
3583 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3584 -dependencies = [
3585 - "candle-core",
3586 - "image",
3587 - "rayon",
3250 + "wasi",
3251 + "windows-sys 0.61.2",
3252 ]
3253
3254 [[package]]
@@ -3824,124 +3488,459 @@ dependencies = [
3488 ]
3489
3490 [[package]]
3827 -name = "number_prefix"
3828 -version = "0.4.0"
3829 -source = "registry+https://github.com/rust-lang/crates.io-index"
3830 -checksum = "830b246a0e5f20af87141b25c173cd1b609bd7779a4617d6ec582abaf90870f3"
3831 -
3832 -[[package]]
3833 -name = "objc"
3834 -version = "0.2.7"
3491 +name = "number_prefix"
3492 +version = "0.4.0"
3493 +source = "registry+https://github.com/rust-lang/crates.io-index"
3494 +checksum = "830b246a0e5f20af87141b25c173cd1b609bd7779a4617d6ec582abaf90870f3"
3495 +
3496 +[[package]]
3497 +name = "objc"
3498 +version = "0.2.7"
3499 +source = "registry+https://github.com/rust-lang/crates.io-index"
3500 +checksum = "915b1b472bc21c53464d6c8461c9d3af805ba1ef837e1cac254428f4a77177b1"
3501 +dependencies = [
3502 + "malloc_buf",
3503 +]
3504 +
3505 +[[package]]
3506 +name = "objc2"
3507 +version = "0.6.4"
3508 +source = "registry+https://github.com/rust-lang/crates.io-index"
3509 +checksum = "3a12a8ed07aefc768292f076dc3ac8c48f3781c8f2d5851dd3d98950e8c5a89f"
3510 +dependencies = [
3511 + "objc2-encode",
3512 +]
3513 +
3514 +[[package]]
3515 +name = "objc2-core-foundation"
3516 +version = "0.3.2"
3517 +source = "registry+https://github.com/rust-lang/crates.io-index"
3518 +checksum = "2a180dd8642fa45cdb7dd721cd4c11b1cadd4929ce112ebd8b9f5803cc79d536"
3519 +dependencies = [
3520 + "bitflags 2.11.0",
3521 + "dispatch2",
3522 + "objc2",
3523 +]
3524 +
3525 +[[package]]
3526 +name = "objc2-encode"
3527 +version = "4.1.0"
3528 +source = "registry+https://github.com/rust-lang/crates.io-index"
3529 +checksum = "ef25abbcd74fb2609453eb695bd2f860d389e457f67dc17cafc8b8cbc89d0c33"
3530 +
3531 +[[package]]
3532 +name = "objc2-foundation"
3533 +version = "0.3.2"
3534 +source = "registry+https://github.com/rust-lang/crates.io-index"
3535 +checksum = "e3e0adef53c21f888deb4fa59fc59f7eb17404926ee8a6f59f5df0fd7f9f3272"
3536 +dependencies = [
3537 + "bitflags 2.11.0",
3538 + "block2",
3539 + "libc",
3540 + "objc2",
3541 + "objc2-core-foundation",
3542 +]
3543 +
3544 +[[package]]
3545 +name = "objc2-io-kit"
3546 +version = "0.3.2"
3547 +source = "registry+https://github.com/rust-lang/crates.io-index"
3548 +checksum = "33fafba39597d6dc1fb709123dfa8289d39406734be322956a69f0931c73bb15"
3549 +dependencies = [
3550 + "libc",
3551 + "objc2-core-foundation",
3552 +]
3553 +
3554 +[[package]]
3555 +name = "objc2-metal"
3556 +version = "0.3.2"
3557 +source = "registry+https://github.com/rust-lang/crates.io-index"
3558 +checksum = "a0125f776a10d00af4152d74616409f0d4a2053a6f57fa5b7d6aa2854ac04794"
3559 +dependencies = [
3560 + "bitflags 2.11.0",
3561 + "block2",
3562 + "dispatch2",
3563 + "objc2",
3564 + "objc2-core-foundation",
3565 + "objc2-foundation",
3566 +]
3567 +
3568 +[[package]]
3569 +name = "object"
3570 +version = "0.37.3"
3571 +source = "registry+https://github.com/rust-lang/crates.io-index"
3572 +checksum = "ff76201f031d8863c38aa7f905eca4f53abbfa15f609db4277d44cd8938f33fe"
3573 +dependencies = [
3574 + "memchr",
3575 +]
3576 +
3577 +[[package]]
3578 +name = "once_cell"
3579 +version = "1.21.4"
3580 +source = "registry+https://github.com/rust-lang/crates.io-index"
3581 +checksum = "9f7c3e4beb33f85d45ae3e3a1792185706c8e16d043238c593331cc7cd313b50"
3582 +
3583 +[[package]]
3584 +name = "once_cell_polyfill"
3585 +version = "1.70.2"
3586 +source = "registry+https://github.com/rust-lang/crates.io-index"
3587 +checksum = "384b8ab6d37215f3c5301a95a4accb5d64aa607f1fcb26a11b5303878451b4fe"
3588 +
3589 +[[package]]
3590 +name = "onde"
3591 +version = "1.2.0"
3592 +dependencies = [
3593 + "anyhow",
3594 + "cc",
3595 + "dotenvy",
3596 + "hf-hub",
3597 + "home",
3598 + "log",
3599 + "onde-mistralrs",
3600 + "onde-mistralrs-core",
3601 + "reqwest 0.12.28",
3602 + "serde",
3603 + "serde_json",
3604 + "smbcloud-gresiq-sdk 0.4.7",
3605 + "thiserror 2.0.18",
3606 + "tokio",
3607 + "tsync",
3608 + "uniffi",
3609 +]
3610 +
3611 +[[package]]
3612 +name = "onde-candle-core"
3613 +version = "0.11.0"
3614 +source = "registry+https://github.com/rust-lang/crates.io-index"
3615 +checksum = "b9a5abf45ac6260975d5ff1a5b62c900dafa36f501e6f644c6a571da14a91812"
3616 +dependencies = [
3617 + "byteorder",
3618 + "candle-metal-kernels",
3619 + "candle-ug",
3620 + "float8",
3621 + "gemm 0.19.0",
3622 + "half",
3623 + "libc",
3624 + "libm",
3625 + "memmap2",
3626 + "num-traits",
3627 + "num_cpus",
3628 + "objc2-foundation",
3629 + "objc2-metal",
3630 + "rand 0.9.5",
3631 + "rand_distr 0.5.1",
3632 + "rayon",
3633 + "safetensors 0.8.0",
3634 + "thiserror 2.0.18",
3635 + "tokenizers 0.22.2",
3636 + "yoke 0.8.2",
3637 + "zerocopy",
3638 + "zip",
3639 +]
3640 +
3641 +[[package]]
3642 +name = "onde-candle-nn"
3643 +version = "0.11.0"
3644 +source = "registry+https://github.com/rust-lang/crates.io-index"
3645 +checksum = "3fd746f8118fa485d55c7409b20e2f95637758ec07e9a4d8f35d89f6ec9d8288"
3646 +dependencies = [
3647 + "candle-metal-kernels",
3648 + "half",
3649 + "libc",
3650 + "num-traits",
3651 + "objc2-metal",
3652 + "onde-candle-core",
3653 + "rayon",
3654 + "safetensors 0.8.0",
3655 + "serde",
3656 + "thiserror 2.0.18",
3657 +]
3658 +
3659 +[[package]]
3660 +name = "onde-mistralrs"
3661 +version = "0.9.1"
3662 +source = "registry+https://github.com/rust-lang/crates.io-index"
3663 +checksum = "a2dcdc7fec0ca910266f80af80a62a29c82713483b83f269705aa058a94af790"
3664 +dependencies = [
3665 + "anyhow",
3666 + "clap 4.6.0",
3667 + "either",
3668 + "futures",
3669 + "image",
3670 + "indexmap 2.13.1",
3671 + "onde-candle-core",
3672 + "onde-candle-nn",
3673 + "onde-mistralrs-core",
3674 + "onde-mistralrs-macros",
3675 + "rand 0.9.5",
3676 + "reqwest 0.13.2",
3677 + "schemars 1.2.1",
3678 + "serde",
3679 + "serde_json",
3680 + "thiserror 2.0.18",
3681 + "tokio",
3682 + "tracing",
3683 + "tracing-subscriber",
3684 + "walkdir",
3685 +]
3686 +
3687 +[[package]]
3688 +name = "onde-mistralrs-audio"
3689 +version = "0.9.1"
3690 source = "registry+https://github.com/rust-lang/crates.io-index"
3836 -checksum = "915b1b472bc21c53464d6c8461c9d3af805ba1ef837e1cac254428f4a77177b1"
3691 +checksum = "d03d9e9811c0af0f276f4a007a8f7700f4e2b91761c0afac62cb4dbceed2cbfd"
3692 dependencies = [
3838 - "malloc_buf",
3693 + "anyhow",
3694 + "apodize",
3695 + "hound",
3696 + "symphonia",
3697 ]
3698
3699 [[package]]
3842 -name = "objc2"
3843 -version = "0.6.4"
3700 +name = "onde-mistralrs-code-exec"
3701 +version = "0.9.1"
3702 source = "registry+https://github.com/rust-lang/crates.io-index"
3845 -checksum = "3a12a8ed07aefc768292f076dc3ac8c48f3781c8f2d5851dd3d98950e8c5a89f"
3703 +checksum = "e79e8a929e71298b08a32a87401cc851e803df14f487b30f728bc0ef9628688f"
3704 dependencies = [
3847 - "objc2-encode",
3705 + "anyhow",
3706 + "base64 0.22.1",
3707 + "image",
3708 + "libc",
3709 + "onde-mistralrs-mcp",
3710 + "onde-mistralrs-sandbox",
3711 + "serde",
3712 + "serde_json",
3713 + "tempfile",
3714 + "tokio",
3715 + "tracing",
3716 + "uuid 1.23.0",
3717 ]
3718
3719 [[package]]
3851 -name = "objc2-core-foundation"
3852 -version = "0.3.2"
3720 +name = "onde-mistralrs-core"
3721 +version = "0.9.1"
3722 source = "registry+https://github.com/rust-lang/crates.io-index"
3854 -checksum = "2a180dd8642fa45cdb7dd721cd4c11b1cadd4929ce112ebd8b9f5803cc79d536"
3723 +checksum = "19893d8ec2a91c772aab1ef551600cf39a03ae4d8f07af96ed9af1307dba3c27"
3724 dependencies = [
3856 - "bitflags 2.11.0",
3857 - "dispatch2",
3858 - "objc2",
3725 + "ahash",
3726 + "akin",
3727 + "anyhow",
3728 + "apodize",
3729 + "as-any",
3730 + "async-trait",
3731 + "base64 0.22.1",
3732 + "bm25",
3733 + "bytemuck",
3734 + "bytemuck_derive",
3735 + "candle-metal-kernels",
3736 + "cfgrammar",
3737 + "chrono",
3738 + "clap 4.6.0",
3739 + "csv",
3740 + "derive-new",
3741 + "derive_more",
3742 + "dirs",
3743 + "either",
3744 + "float8",
3745 + "futures",
3746 + "galil-seiferas",
3747 + "half",
3748 + "hashbrown 0.16.1",
3749 + "hf-hub",
3750 + "hound",
3751 + "html2text",
3752 + "http",
3753 + "image",
3754 + "indexmap 2.13.1",
3755 + "indicatif 0.18.4",
3756 + "interprocess",
3757 + "itertools",
3758 + "libc",
3759 + "llguidance",
3760 + "lrtable",
3761 + "mime_guess",
3762 + "minijinja",
3763 + "minijinja-contrib",
3764 + "num-traits",
3765 + "objc",
3766 + "objc2-metal",
3767 + "onde-candle-core",
3768 + "onde-candle-nn",
3769 + "onde-mistralrs-audio",
3770 + "onde-mistralrs-code-exec",
3771 + "onde-mistralrs-mcp",
3772 + "onde-mistralrs-paged-attn",
3773 + "onde-mistralrs-quant",
3774 + "onde-mistralrs-sandbox",
3775 + "onde-mistralrs-vision",
3776 + "openai-harmony",
3777 + "ordered-float",
3778 + "parking_lot",
3779 + "radix_trie",
3780 + "rand 0.9.5",
3781 + "rand_distr 0.5.1",
3782 + "rand_isaac",
3783 + "rayon",
3784 + "regex",
3785 + "regex-automata",
3786 + "reqwest 0.13.2",
3787 + "rubato",
3788 + "rust-mcp-schema",
3789 + "rustc-hash 2.1.2",
3790 + "rustfft",
3791 + "safetensors 0.8.0",
3792 + "schemars 1.2.1",
3793 + "scraper",
3794 + "serde",
3795 + "serde-big-array",
3796 + "serde-saphyr",
3797 + "serde_json",
3798 + "serde_plain",
3799 + "statrs",
3800 + "strum 0.27.2",
3801 + "symphonia",
3802 + "sysinfo",
3803 + "thiserror 2.0.18",
3804 + "tokenizers 0.21.4",
3805 + "tokio",
3806 + "tokio-rayon",
3807 + "tokio-tungstenite",
3808 + "toktrie",
3809 + "toktrie_hf_tokenizers",
3810 + "toml",
3811 + "tqdm",
3812 + "tracing",
3813 + "tracing-subscriber",
3814 + "urlencoding",
3815 + "uuid 1.23.0",
3816 + "variantly",
3817 + "vob",
3818 ]
3819
3820 [[package]]
3862 -name = "objc2-encode"
3863 -version = "4.1.0"
3821 +name = "onde-mistralrs-macros"
3822 +version = "0.9.1"
3823 source = "registry+https://github.com/rust-lang/crates.io-index"
3865 -checksum = "ef25abbcd74fb2609453eb695bd2f860d389e457f67dc17cafc8b8cbc89d0c33"
3824 +checksum = "98ac14c14c8d54d2b9068dc8e2a8f892018d1ff15922e1bf2ed79abade164fe1"
3825 +dependencies = [
3826 + "darling 0.23.0",
3827 + "proc-macro2",
3828 + "quote",
3829 + "syn 2.0.117",
3830 +]
3831
3832 [[package]]
3868 -name = "objc2-foundation"
3869 -version = "0.3.2"
3833 +name = "onde-mistralrs-mcp"
3834 +version = "0.9.1"
3835 source = "registry+https://github.com/rust-lang/crates.io-index"
3871 -checksum = "e3e0adef53c21f888deb4fa59fc59f7eb17404926ee8a6f59f5df0fd7f9f3272"
3836 +checksum = "347ebf2dedbc51f9867b6ecd657bc5e31a35cebf8c75b0a7d1b870836404e36a"
3837 dependencies = [
3873 - "bitflags 2.11.0",
3874 - "block2",
3875 - "libc",
3876 - "objc2",
3877 - "objc2-core-foundation",
3838 + "anyhow",
3839 + "async-trait",
3840 + "futures-util",
3841 + "http",
3842 + "image",
3843 + "reqwest 0.13.2",
3844 + "rust-mcp-schema",
3845 + "serde",
3846 + "serde_json",
3847 + "tokio",
3848 + "tokio-tungstenite",
3849 + "tracing",
3850 + "utoipa",
3851 + "uuid 1.23.0",
3852 ]
3853
3854 [[package]]
3881 -name = "objc2-io-kit"
3882 -version = "0.3.2"
3855 +name = "onde-mistralrs-metal-compile"
3856 +version = "0.9.1"
3857 source = "registry+https://github.com/rust-lang/crates.io-index"
3884 -checksum = "33fafba39597d6dc1fb709123dfa8289d39406734be322956a69f0931c73bb15"
3858 +checksum = "22e0810702e48f8e3e868b977d6820812b778722f7174da6197792b9f1674eb0"
3859 dependencies = [
3886 - "libc",
3887 - "objc2-core-foundation",
3860 + "candle-metal-kernels",
3861 + "objc2-metal",
3862 ]
3863
3864 [[package]]
3891 -name = "objc2-metal"
3892 -version = "0.3.2"
3865 +name = "onde-mistralrs-paged-attn"
3866 +version = "0.9.1"
3867 source = "registry+https://github.com/rust-lang/crates.io-index"
3894 -checksum = "a0125f776a10d00af4152d74616409f0d4a2053a6f57fa5b7d6aa2854ac04794"
3868 +checksum = "c981780845e62178b1bb4b7a4615ef33aa40ff46f3f15552f70fb5c9daa43073"
3869 dependencies = [
3896 - "bitflags 2.11.0",
3897 - "block2",
3870 + "anyhow",
3871 + "candle-metal-kernels",
3872 "dispatch2",
3899 - "objc2",
3900 - "objc2-core-foundation",
3873 + "float8",
3874 + "half",
3875 "objc2-foundation",
3876 + "objc2-metal",
3877 + "onde-candle-core",
3878 + "onde-mistralrs-metal-compile",
3879 + "thiserror 2.0.18",
3880 ]
3881
3882 [[package]]
3905 -name = "object"
3906 -version = "0.37.3"
3883 +name = "onde-mistralrs-quant"
3884 +version = "0.9.1"
3885 source = "registry+https://github.com/rust-lang/crates.io-index"
3908 -checksum = "ff76201f031d8863c38aa7f905eca4f53abbfa15f609db4277d44cd8938f33fe"
3886 +checksum = "c381c2af74c2708dd7c8b3cb3fef41fcbcd7602a60983dc42ffcf03a9a771bcc"
3887 dependencies = [
3910 - "memchr",
3888 + "byteorder",
3889 + "candle-metal-kernels",
3890 + "dispatch2",
3891 + "float8",
3892 + "futures",
3893 + "half",
3894 + "hf-hub",
3895 + "indicatif 0.18.4",
3896 + "lazy_static",
3897 + "libc",
3898 + "memmap2",
3899 + "objc2-foundation",
3900 + "objc2-metal",
3901 + "onde-candle-core",
3902 + "onde-candle-nn",
3903 + "onde-mistralrs-metal-compile",
3904 + "paste",
3905 + "rayon",
3906 + "regex",
3907 + "safetensors 0.8.0",
3908 + "serde",
3909 + "serde_json",
3910 + "sysinfo",
3911 + "thiserror 2.0.18",
3912 + "tokio",
3913 + "tracing",
3914 + "yoke 0.8.2",
3915 ]
3916
3917 [[package]]
3914 -name = "once_cell"
3915 -version = "1.21.4"
3916 -source = "registry+https://github.com/rust-lang/crates.io-index"
3917 -checksum = "9f7c3e4beb33f85d45ae3e3a1792185706c8e16d043238c593331cc7cd313b50"
3918 -
3919 -[[package]]
3920 -name = "once_cell_polyfill"
3921 -version = "1.70.2"
3918 +name = "onde-mistralrs-sandbox"
3919 +version = "0.9.1"
3920 source = "registry+https://github.com/rust-lang/crates.io-index"
3923 -checksum = "384b8ab6d37215f3c5301a95a4accb5d64aa607f1fcb26a11b5303878451b4fe"
3924 -
3925 -[[package]]
3926 -name = "onde"
3927 -version = "1.2.0"
3921 +checksum = "9a7467bc5b587a96bdb0af5cb48ad75546cee88cd18285e4dbc844bdda749ffe"
3922 dependencies = [
3923 "anyhow",
3930 - "cc",
3931 - "dotenvy",
3932 - "hf-hub",
3933 - "home",
3934 - "log",
3935 - "mistralrs",
3936 - "mistralrs-core",
3937 - "reqwest 0.12.28",
3924 + "itoa",
3925 + "landlock",
3926 + "libc",
3927 + "nix",
3928 + "seccompiler",
3929 "serde",
3939 - "serde_json",
3940 - "smbcloud-gresiq-sdk 0.4.7",
3930 "thiserror 2.0.18",
3931 "tokio",
3943 - "tsync",
3944 - "uniffi",
3932 + "tracing",
3933 +]
3934 +
3935 +[[package]]
3936 +name = "onde-mistralrs-vision"
3937 +version = "0.9.1"
3938 +source = "registry+https://github.com/rust-lang/crates.io-index"
3939 +checksum = "2d38f84085733aa0585f4f5bf9dfc8d7e7763fbe9a33a4231cffc87531ebebb0"
3940 +dependencies = [
3941 + "image",
3942 + "onde-candle-core",
3943 + "rayon",
3944 ]
3945
3946 [[package]]
@@ -5411,7 +5410,7 @@ source = "registry+https://github.com/rust-lang/crates.io-index"
5410 checksum = "b75a19a7a740b25bc7944bdee6172368f988763b744e3d4dfe753f6b4ece40cc"
5411 dependencies = [
5412 "libc",
5414 - "mio",
5413 + "mio 0.8.11",
5414 "signal-hook",
5415 ]
5416
@@ -6288,7 +6287,7 @@ checksum = "2bd1c4c0fc4a7ab90fc15ef6daaa3ec3b893f004f915f2392557ed23237820cd"
6287 dependencies = [
6288 "bytes",
6289 "libc",
6291 - "mio",
6290 + "mio 1.2.0",
6291 "parking_lot",
6292 "pin-project-lite",
6293 "signal-hook-registry",
@@ -6467,7 +6466,8 @@ checksum = "8df9b6e13f2d32c91b9bd719c00d1958837bc7dec474d94952798cc8e69eeec3"
6466 [[package]]
6467 name = "tqdm"
6468 version = "0.8.0"
6470 -source = "git+https://github.com/setoelkahfi/tqdm?branch=deps%2Fbump-crossterm#41e4182829136e6dadbdd1c36af824d19219147a"
6469 +source = "registry+https://github.com/rust-lang/crates.io-index"
6470 +checksum = "b316d5c2ac649ca856dacd487d0ebb94f3b746bada51355d93dd2c007ab62a2e"
6471 dependencies = [
6472 "anyhow",
6473 "crossterm",
@@ -6557,7 +6557,7 @@ version = "2.2.1"
6557 source = "registry+https://github.com/rust-lang/crates.io-index"
6558 checksum = "4fc20a25899c5ae43735253244214f3d5eb75dd28d9cc8491732294a985adb8c"
6559 dependencies = [
6560 - "convert_case 0.6.0",
6560 + "convert_case",
6561 "proc-macro2",
6562 "quote",
6563 "state",
@@ -7436,6 +7436,15 @@ dependencies = [
7436 "windows-targets 0.42.2",
7437 ]
7438
7439 +[[package]]
7440 +name = "windows-sys"
7441 +version = "0.48.0"
7442 +source = "registry+https://github.com/rust-lang/crates.io-index"
7443 +checksum = "677d2418bec65e3338edb076e806bc1ec15693c5d0104683f2efe857f61056a9"
7444 +dependencies = [
7445 + "windows-targets 0.48.5",
7446 +]
7447 +
7448 [[package]]
7449 name = "windows-sys"
7450 version = "0.52.0"
sdk/react-native/rust/Cargo.lock
+440 -431
@@ -588,39 +588,11 @@ dependencies = [
588 "serde_core",
589 ]
590
591 -[[package]]
592 -name = "candle-core"
593 -version = "0.11.0"
594 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
595 -dependencies = [
596 - "byteorder",
597 - "candle-metal-kernels",
598 - "candle-ug",
599 - "float8",
600 - "gemm 0.19.0",
601 - "half",
602 - "libc",
603 - "libm",
604 - "memmap2",
605 - "num-traits",
606 - "num_cpus",
607 - "objc2-foundation",
608 - "objc2-metal",
609 - "rand 0.9.5",
610 - "rand_distr 0.5.1",
611 - "rayon",
612 - "safetensors 0.8.0",
613 - "thiserror 2.0.18",
614 - "tokenizers 0.22.2",
615 - "yoke 0.8.2",
616 - "zerocopy",
617 - "zip",
618 -]
619 -
591 [[package]]
592 name = "candle-metal-kernels"
593 version = "0.11.0"
623 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
594 +source = "registry+https://github.com/rust-lang/crates.io-index"
595 +checksum = "242e83c6acf639bb273c929d73c67a882bb4dd08a140f121096e19ba2f213d3e"
596 dependencies = [
597 "block2",
598 "half",
@@ -632,27 +604,11 @@ dependencies = [
604 "tracing",
605 ]
606
635 -[[package]]
636 -name = "candle-nn"
637 -version = "0.11.0"
638 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
639 -dependencies = [
640 - "candle-core",
641 - "candle-metal-kernels",
642 - "half",
643 - "libc",
644 - "num-traits",
645 - "objc2-metal",
646 - "rayon",
647 - "safetensors 0.8.0",
648 - "serde",
649 - "thiserror 2.0.18",
650 -]
651 -
607 [[package]]
608 name = "candle-ug"
609 version = "0.11.0"
655 -source = "git+https://github.com/huggingface/candle.git?rev=27f20fea993c81ea6d32ce44018f42b68466525e#27f20fea993c81ea6d32ce44018f42b68466525e"
610 +source = "registry+https://github.com/rust-lang/crates.io-index"
611 +checksum = "257411c33abf7d898a31ac20d80813dfe96ff09e23a73039e22ab293aea9b871"
612 dependencies = [
613 "ug",
614 "ug-metal",
@@ -884,15 +840,6 @@ dependencies = [
840 "unicode-segmentation",
841 ]
842
887 -[[package]]
888 -name = "convert_case"
889 -version = "0.10.0"
890 -source = "registry+https://github.com/rust-lang/crates.io-index"
891 -checksum = "633458d4ef8c78b72454de2d54fd6ab2e60f9e02be22f3c6104cdc8a4e0fceb9"
892 -dependencies = [
893 - "unicode-segmentation",
894 -]
895 -
843 [[package]]
844 name = "core-foundation"
845 version = "0.9.4"
@@ -975,17 +922,15 @@ checksum = "d0a5c400df2834b80a4c3327b3aad3a4c4cd4de0629063962b03235697506a28"
922
923 [[package]]
924 name = "crossterm"
978 -version = "0.29.0"
925 +version = "0.25.0"
926 source = "registry+https://github.com/rust-lang/crates.io-index"
980 -checksum = "d8b9f2e4c67f833b660cdb0a3523065869fb35570177239812ed4c905aeff87b"
927 +checksum = "e64e6c0fbe2c17357405f7c758c1ef960fce08bdfb2c03d88d2a18d7e09c4b67"
928 dependencies = [
982 - "bitflags 2.11.0",
929 + "bitflags 1.3.2",
930 "crossterm_winapi",
984 - "derive_more",
985 - "document-features",
986 - "mio",
931 + "libc",
932 + "mio 0.8.11",
933 "parking_lot",
988 - "rustix",
934 "signal-hook",
935 "signal-hook-mio",
936 "winapi",
@@ -1252,7 +1197,6 @@ version = "2.1.1"
1197 source = "registry+https://github.com/rust-lang/crates.io-index"
1198 checksum = "799a97264921d8623a957f6c3b9011f3b5492f557bbb7a5a19b7fa6d06ba8dcb"
1199 dependencies = [
1255 - "convert_case 0.10.0",
1200 "proc-macro2",
1201 "quote",
1202 "rustc_version",
@@ -1338,15 +1282,6 @@ version = "1.1.1"
1282 source = "registry+https://github.com/rust-lang/crates.io-index"
1283 checksum = "c2db04e74f0a9a93103b50e90b96024c9b2bdca8bce6a632ec71b88736d3d359"
1284
1341 -[[package]]
1342 -name = "document-features"
1343 -version = "0.2.12"
1344 -source = "registry+https://github.com/rust-lang/crates.io-index"
1345 -checksum = "d4b8a88685455ed29a21542a33abd9cb6510b6b129abadabdcef0f4c55bc8f61"
1346 -dependencies = [
1347 - "litrs",
1348 -]
1349 -
1285 [[package]]
1286 name = "dotenvy"
1287 version = "0.15.7"
@@ -2867,12 +2802,6 @@ version = "0.8.2"
2802 source = "registry+https://github.com/rust-lang/crates.io-index"
2803 checksum = "92daf443525c4cce67b150400bc2316076100ce0b3686209eb8cf3c31612e6f0"
2804
2870 -[[package]]
2871 -name = "litrs"
2872 -version = "1.0.0"
2873 -source = "registry+https://github.com/rust-lang/crates.io-index"
2874 -checksum = "11d3d7f243d5c5a8b9bb5d6dd2b1602c0cb0b9db1621bafc7ed66e35ff9fe092"
2875 -
2805 [[package]]
2806 name = "llguidance"
2807 version = "1.7.0"
@@ -3126,290 +3055,25 @@ dependencies = [
3055
3056 [[package]]
3057 name = "mio"
3129 -version = "1.2.0"
3058 +version = "0.8.11"
3059 source = "registry+https://github.com/rust-lang/crates.io-index"
3131 -checksum = "50b7e5b27aa02a74bac8c3f23f448f8d87ff11f92d3aac1a6ed369ee08cc56c1"
3060 +checksum = "a4a650543ca06a924e8b371db273b2756685faae30f8487da1b56505a8f78b0c"
3061 dependencies = [
3062 "libc",
3063 "log",
3064 "wasi",
3136 - "windows-sys 0.61.2",
3137 -]
3138 -
3139 -[[package]]
3140 -name = "mistralrs"
3141 -version = "0.9.0"
3142 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3143 -dependencies = [
3144 - "anyhow",
3145 - "candle-core",
3146 - "candle-nn",
3147 - "clap 4.6.0",
3148 - "either",
3149 - "futures",
3150 - "image",
3151 - "indexmap 2.14.0",
3152 - "mistralrs-core",
3153 - "mistralrs-macros",
3154 - "rand 0.9.5",
3155 - "reqwest 0.13.2",
3156 - "schemars 1.2.1",
3157 - "serde",
3158 - "serde_json",
3159 - "thiserror 2.0.18",
3160 - "tokio",
3161 - "tracing",
3162 - "tracing-subscriber",
3163 - "walkdir",
3164 -]
3165 -
3166 -[[package]]
3167 -name = "mistralrs-audio"
3168 -version = "0.9.0"
3169 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3170 -dependencies = [
3171 - "anyhow",
3172 - "apodize",
3173 - "hound",
3174 - "symphonia",
3175 -]
3176 -
3177 -[[package]]
3178 -name = "mistralrs-code-exec"
3179 -version = "0.9.0"
3180 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3181 -dependencies = [
3182 - "anyhow",
3183 - "base64 0.22.1",
3184 - "image",
3185 - "libc",
3186 - "mistralrs-mcp",
3187 - "mistralrs-sandbox",
3188 - "serde",
3189 - "serde_json",
3190 - "tempfile",
3191 - "tokio",
3192 - "tracing",
3193 - "uuid 1.23.0",
3194 -]
3195 -
3196 -[[package]]
3197 -name = "mistralrs-core"
3198 -version = "0.9.0"
3199 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3200 -dependencies = [
3201 - "ahash",
3202 - "akin",
3203 - "anyhow",
3204 - "apodize",
3205 - "as-any",
3206 - "async-trait",
3207 - "base64 0.22.1",
3208 - "bm25",
3209 - "bytemuck",
3210 - "bytemuck_derive",
3211 - "candle-core",
3212 - "candle-metal-kernels",
3213 - "candle-nn",
3214 - "cfgrammar",
3215 - "chrono",
3216 - "clap 4.6.0",
3217 - "csv",
3218 - "derive-new",
3219 - "derive_more",
3220 - "dirs",
3221 - "either",
3222 - "float8",
3223 - "futures",
3224 - "galil-seiferas",
3225 - "half",
3226 - "hashbrown 0.16.1",
3227 - "hf-hub",
3228 - "hound",
3229 - "html2text",
3230 - "http",
3231 - "image",
3232 - "indexmap 2.14.0",
3233 - "indicatif 0.18.4",
3234 - "interprocess",
3235 - "itertools",
3236 - "libc",
3237 - "llguidance",
3238 - "lrtable",
3239 - "mime_guess",
3240 - "minijinja",
3241 - "minijinja-contrib",
3242 - "mistralrs-audio",
3243 - "mistralrs-code-exec",
3244 - "mistralrs-mcp",
3245 - "mistralrs-paged-attn",
3246 - "mistralrs-quant",
3247 - "mistralrs-sandbox",
3248 - "mistralrs-vision",
3249 - "num-traits",
3250 - "objc",
3251 - "objc2-metal",
3252 - "openai-harmony",
3253 - "ordered-float",
3254 - "parking_lot",
3255 - "radix_trie",
3256 - "rand 0.9.5",
3257 - "rand_distr 0.5.1",
3258 - "rand_isaac",
3259 - "rayon",
3260 - "regex",
3261 - "regex-automata",
3262 - "reqwest 0.13.2",
3263 - "rubato",
3264 - "rust-mcp-schema",
3265 - "rustc-hash 2.1.2",
3266 - "rustfft",
3267 - "safetensors 0.8.0",
3268 - "schemars 1.2.1",
3269 - "scraper",
3270 - "serde",
3271 - "serde-big-array",
3272 - "serde-saphyr",
3273 - "serde_json",
3274 - "serde_plain",
3275 - "statrs",
3276 - "strum 0.27.2",
3277 - "symphonia",
3278 - "sysinfo",
3279 - "thiserror 2.0.18",
3280 - "tokenizers 0.21.4",
3281 - "tokio",
3282 - "tokio-rayon",
3283 - "tokio-tungstenite",
3284 - "toktrie",
3285 - "toktrie_hf_tokenizers",
3286 - "toml",
3287 - "tqdm",
3288 - "tracing",
3289 - "tracing-subscriber",
3290 - "urlencoding",
3291 - "uuid 1.23.0",
3292 - "variantly",
3293 - "vob",
3294 -]
3295 -
3296 -[[package]]
3297 -name = "mistralrs-macros"
3298 -version = "0.9.0"
3299 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3300 -dependencies = [
3301 - "darling 0.23.0",
3302 - "proc-macro2",
3303 - "quote",
3304 - "syn 2.0.117",
3305 -]
3306 -
3307 -[[package]]
3308 -name = "mistralrs-mcp"
3309 -version = "0.9.0"
3310 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3311 -dependencies = [
3312 - "anyhow",
3313 - "async-trait",
3314 - "futures-util",
3315 - "http",
3316 - "image",
3317 - "reqwest 0.13.2",
3318 - "rust-mcp-schema",
3319 - "serde",
3320 - "serde_json",
3321 - "tokio",
3322 - "tokio-tungstenite",
3323 - "tracing",
3324 - "utoipa",
3325 - "uuid 1.23.0",
3326 -]
3327 -
3328 -[[package]]
3329 -name = "mistralrs-metal-compile"
3330 -version = "0.9.0"
3331 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3332 -dependencies = [
3333 - "candle-metal-kernels",
3334 - "objc2-metal",
3335 -]
3336 -
3337 -[[package]]
3338 -name = "mistralrs-paged-attn"
3339 -version = "0.9.0"
3340 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3341 -dependencies = [
3342 - "anyhow",
3343 - "candle-core",
3344 - "candle-metal-kernels",
3345 - "dispatch2",
3346 - "float8",
3347 - "half",
3348 - "mistralrs-metal-compile",
3349 - "objc2-foundation",
3350 - "objc2-metal",
3351 - "thiserror 2.0.18",
3065 + "windows-sys 0.48.0",
3066 ]
3067
3068 [[package]]
3355 -name = "mistralrs-quant"
3356 -version = "0.9.0"
3357 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3358 -dependencies = [
3359 - "byteorder",
3360 - "candle-core",
3361 - "candle-metal-kernels",
3362 - "candle-nn",
3363 - "dispatch2",
3364 - "float8",
3365 - "futures",
3366 - "half",
3367 - "hf-hub",
3368 - "indicatif 0.18.4",
3369 - "lazy_static",
3370 - "libc",
3371 - "memmap2",
3372 - "mistralrs-metal-compile",
3373 - "objc2-foundation",
3374 - "objc2-metal",
3375 - "paste",
3376 - "rayon",
3377 - "regex",
3378 - "safetensors 0.8.0",
3379 - "serde",
3380 - "serde_json",
3381 - "sysinfo",
3382 - "thiserror 2.0.18",
3383 - "tokio",
3384 - "tracing",
3385 - "yoke 0.8.2",
3386 -]
3387 -
3388 -[[package]]
3389 -name = "mistralrs-sandbox"
3390 -version = "0.9.0"
3391 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3069 +name = "mio"
3070 +version = "1.2.0"
3071 +source = "registry+https://github.com/rust-lang/crates.io-index"
3072 +checksum = "50b7e5b27aa02a74bac8c3f23f448f8d87ff11f92d3aac1a6ed369ee08cc56c1"
3073 dependencies = [
3393 - "anyhow",
3394 - "itoa",
3395 - "landlock",
3074 "libc",
3397 - "nix",
3398 - "seccompiler",
3399 - "serde",
3400 - "thiserror 2.0.18",
3401 - "tokio",
3402 - "tracing",
3403 -]
3404 -
3405 -[[package]]
3406 -name = "mistralrs-vision"
3407 -version = "0.9.0"
3408 -source = "git+https://github.com/setoelkahfi/mistral.rs?branch=fix%2Fall-platform-fixes#0b45c1c8e976c22de5e88f2acc13bc30889d5ae2"
3409 -dependencies = [
3410 - "candle-core",
3411 - "image",
3412 - "rayon",
3075 + "wasi",
3076 + "windows-sys 0.61.2",
3077 ]
3078
3079 [[package]]
@@ -3639,125 +3303,460 @@ dependencies = [
3303 ]
3304
3305 [[package]]
3642 -name = "num_cpus"
3643 -version = "1.17.0"
3306 +name = "num_cpus"
3307 +version = "1.17.0"
3308 +source = "registry+https://github.com/rust-lang/crates.io-index"
3309 +checksum = "91df4bbde75afed763b708b7eee1e8e7651e02d97f6d5dd763e89367e957b23b"
3310 +dependencies = [
3311 + "hermit-abi 0.5.2",
3312 + "libc",
3313 +]
3314 +
3315 +[[package]]
3316 +name = "number_prefix"
3317 +version = "0.4.0"
3318 +source = "registry+https://github.com/rust-lang/crates.io-index"
3319 +checksum = "830b246a0e5f20af87141b25c173cd1b609bd7779a4617d6ec582abaf90870f3"
3320 +
3321 +[[package]]
3322 +name = "objc"
3323 +version = "0.2.7"
3324 +source = "registry+https://github.com/rust-lang/crates.io-index"
3325 +checksum = "915b1b472bc21c53464d6c8461c9d3af805ba1ef837e1cac254428f4a77177b1"
3326 +dependencies = [
3327 + "malloc_buf",
3328 +]
3329 +
3330 +[[package]]
3331 +name = "objc2"
3332 +version = "0.6.4"
3333 +source = "registry+https://github.com/rust-lang/crates.io-index"
3334 +checksum = "3a12a8ed07aefc768292f076dc3ac8c48f3781c8f2d5851dd3d98950e8c5a89f"
3335 +dependencies = [
3336 + "objc2-encode",
3337 +]
3338 +
3339 +[[package]]
3340 +name = "objc2-core-foundation"
3341 +version = "0.3.2"
3342 +source = "registry+https://github.com/rust-lang/crates.io-index"
3343 +checksum = "2a180dd8642fa45cdb7dd721cd4c11b1cadd4929ce112ebd8b9f5803cc79d536"
3344 +dependencies = [
3345 + "bitflags 2.11.0",
3346 + "dispatch2",
3347 + "objc2",
3348 +]
3349 +
3350 +[[package]]
3351 +name = "objc2-encode"
3352 +version = "4.1.0"
3353 +source = "registry+https://github.com/rust-lang/crates.io-index"
3354 +checksum = "ef25abbcd74fb2609453eb695bd2f860d389e457f67dc17cafc8b8cbc89d0c33"
3355 +
3356 +[[package]]
3357 +name = "objc2-foundation"
3358 +version = "0.3.2"
3359 +source = "registry+https://github.com/rust-lang/crates.io-index"
3360 +checksum = "e3e0adef53c21f888deb4fa59fc59f7eb17404926ee8a6f59f5df0fd7f9f3272"
3361 +dependencies = [
3362 + "bitflags 2.11.0",
3363 + "block2",
3364 + "libc",
3365 + "objc2",
3366 + "objc2-core-foundation",
3367 +]
3368 +
3369 +[[package]]
3370 +name = "objc2-io-kit"
3371 +version = "0.3.2"
3372 +source = "registry+https://github.com/rust-lang/crates.io-index"
3373 +checksum = "33fafba39597d6dc1fb709123dfa8289d39406734be322956a69f0931c73bb15"
3374 +dependencies = [
3375 + "libc",
3376 + "objc2-core-foundation",
3377 +]
3378 +
3379 +[[package]]
3380 +name = "objc2-metal"
3381 +version = "0.3.2"
3382 +source = "registry+https://github.com/rust-lang/crates.io-index"
3383 +checksum = "a0125f776a10d00af4152d74616409f0d4a2053a6f57fa5b7d6aa2854ac04794"
3384 +dependencies = [
3385 + "bitflags 2.11.0",
3386 + "block2",
3387 + "dispatch2",
3388 + "objc2",
3389 + "objc2-core-foundation",
3390 + "objc2-foundation",
3391 +]
3392 +
3393 +[[package]]
3394 +name = "once_cell"
3395 +version = "1.21.4"
3396 +source = "registry+https://github.com/rust-lang/crates.io-index"
3397 +checksum = "9f7c3e4beb33f85d45ae3e3a1792185706c8e16d043238c593331cc7cd313b50"
3398 +
3399 +[[package]]
3400 +name = "once_cell_polyfill"
3401 +version = "1.70.2"
3402 +source = "registry+https://github.com/rust-lang/crates.io-index"
3403 +checksum = "384b8ab6d37215f3c5301a95a4accb5d64aa607f1fcb26a11b5303878451b4fe"
3404 +
3405 +[[package]]
3406 +name = "onde"
3407 +version = "1.2.0"
3408 +dependencies = [
3409 + "anyhow",
3410 + "cc",
3411 + "dotenvy",
3412 + "hf-hub",
3413 + "home",
3414 + "log",
3415 + "onde-mistralrs",
3416 + "onde-mistralrs-core",
3417 + "reqwest 0.12.28",
3418 + "serde",
3419 + "serde_json",
3420 + "smbcloud-gresiq-sdk",
3421 + "thiserror 2.0.18",
3422 + "tokio",
3423 + "tsync",
3424 + "uniffi",
3425 +]
3426 +
3427 +[[package]]
3428 +name = "onde-candle-core"
3429 +version = "0.11.0"
3430 +source = "registry+https://github.com/rust-lang/crates.io-index"
3431 +checksum = "b9a5abf45ac6260975d5ff1a5b62c900dafa36f501e6f644c6a571da14a91812"
3432 +dependencies = [
3433 + "byteorder",
3434 + "candle-metal-kernels",
3435 + "candle-ug",
3436 + "float8",
3437 + "gemm 0.19.0",
3438 + "half",
3439 + "libc",
3440 + "libm",
3441 + "memmap2",
3442 + "num-traits",
3443 + "num_cpus",
3444 + "objc2-foundation",
3445 + "objc2-metal",
3446 + "rand 0.9.5",
3447 + "rand_distr 0.5.1",
3448 + "rayon",
3449 + "safetensors 0.8.0",
3450 + "thiserror 2.0.18",
3451 + "tokenizers 0.22.2",
3452 + "yoke 0.8.2",
3453 + "zerocopy",
3454 + "zip",
3455 +]
3456 +
3457 +[[package]]
3458 +name = "onde-candle-nn"
3459 +version = "0.11.0"
3460 +source = "registry+https://github.com/rust-lang/crates.io-index"
3461 +checksum = "3fd746f8118fa485d55c7409b20e2f95637758ec07e9a4d8f35d89f6ec9d8288"
3462 +dependencies = [
3463 + "candle-metal-kernels",
3464 + "half",
3465 + "libc",
3466 + "num-traits",
3467 + "objc2-metal",
3468 + "onde-candle-core",
3469 + "rayon",
3470 + "safetensors 0.8.0",
3471 + "serde",
3472 + "thiserror 2.0.18",
3473 +]
3474 +
3475 +[[package]]
3476 +name = "onde-mistralrs"
3477 +version = "0.9.1"
3478 +source = "registry+https://github.com/rust-lang/crates.io-index"
3479 +checksum = "a2dcdc7fec0ca910266f80af80a62a29c82713483b83f269705aa058a94af790"
3480 +dependencies = [
3481 + "anyhow",
3482 + "clap 4.6.0",
3483 + "either",
3484 + "futures",
3485 + "image",
3486 + "indexmap 2.14.0",
3487 + "onde-candle-core",
3488 + "onde-candle-nn",
3489 + "onde-mistralrs-core",
3490 + "onde-mistralrs-macros",
3491 + "rand 0.9.5",
3492 + "reqwest 0.13.2",
3493 + "schemars 1.2.1",
3494 + "serde",
3495 + "serde_json",
3496 + "thiserror 2.0.18",
3497 + "tokio",
3498 + "tracing",
3499 + "tracing-subscriber",
3500 + "walkdir",
3501 +]
3502 +
3503 +[[package]]
3504 +name = "onde-mistralrs-audio"
3505 +version = "0.9.1"
3506 source = "registry+https://github.com/rust-lang/crates.io-index"
3645 -checksum = "91df4bbde75afed763b708b7eee1e8e7651e02d97f6d5dd763e89367e957b23b"
3507 +checksum = "d03d9e9811c0af0f276f4a007a8f7700f4e2b91761c0afac62cb4dbceed2cbfd"
3508 dependencies = [
3647 - "hermit-abi 0.5.2",
3648 - "libc",
3509 + "anyhow",
3510 + "apodize",
3511 + "hound",
3512 + "symphonia",
3513 ]
3514
3515 [[package]]
3652 -name = "number_prefix"
3653 -version = "0.4.0"
3654 -source = "registry+https://github.com/rust-lang/crates.io-index"
3655 -checksum = "830b246a0e5f20af87141b25c173cd1b609bd7779a4617d6ec582abaf90870f3"
3656 -
3657 -[[package]]
3658 -name = "objc"
3659 -version = "0.2.7"
3516 +name = "onde-mistralrs-code-exec"
3517 +version = "0.9.1"
3518 source = "registry+https://github.com/rust-lang/crates.io-index"
3661 -checksum = "915b1b472bc21c53464d6c8461c9d3af805ba1ef837e1cac254428f4a77177b1"
3519 +checksum = "e79e8a929e71298b08a32a87401cc851e803df14f487b30f728bc0ef9628688f"
3520 dependencies = [
3663 - "malloc_buf",
3521 + "anyhow",
3522 + "base64 0.22.1",
3523 + "image",
3524 + "libc",
3525 + "onde-mistralrs-mcp",
3526 + "onde-mistralrs-sandbox",
3527 + "serde",
3528 + "serde_json",
3529 + "tempfile",
3530 + "tokio",
3531 + "tracing",
3532 + "uuid 1.23.0",
3533 ]
3534
3535 [[package]]
3667 -name = "objc2"
3668 -version = "0.6.4"
3536 +name = "onde-mistralrs-core"
3537 +version = "0.9.1"
3538 source = "registry+https://github.com/rust-lang/crates.io-index"
3670 -checksum = "3a12a8ed07aefc768292f076dc3ac8c48f3781c8f2d5851dd3d98950e8c5a89f"
3539 +checksum = "19893d8ec2a91c772aab1ef551600cf39a03ae4d8f07af96ed9af1307dba3c27"
3540 dependencies = [
3672 - "objc2-encode",
3541 + "ahash",
3542 + "akin",
3543 + "anyhow",
3544 + "apodize",
3545 + "as-any",
3546 + "async-trait",
3547 + "base64 0.22.1",
3548 + "bm25",
3549 + "bytemuck",
3550 + "bytemuck_derive",
3551 + "candle-metal-kernels",
3552 + "cfgrammar",
3553 + "chrono",
3554 + "clap 4.6.0",
3555 + "csv",
3556 + "derive-new",
3557 + "derive_more",
3558 + "dirs",
3559 + "either",
3560 + "float8",
3561 + "futures",
3562 + "galil-seiferas",
3563 + "half",
3564 + "hashbrown 0.16.1",
3565 + "hf-hub",
3566 + "hound",
3567 + "html2text",
3568 + "http",
3569 + "image",
3570 + "indexmap 2.14.0",
3571 + "indicatif 0.18.4",
3572 + "interprocess",
3573 + "itertools",
3574 + "libc",
3575 + "llguidance",
3576 + "lrtable",
3577 + "mime_guess",
3578 + "minijinja",
3579 + "minijinja-contrib",
3580 + "num-traits",
3581 + "objc",
3582 + "objc2-metal",
3583 + "onde-candle-core",
3584 + "onde-candle-nn",
3585 + "onde-mistralrs-audio",
3586 + "onde-mistralrs-code-exec",
3587 + "onde-mistralrs-mcp",
3588 + "onde-mistralrs-paged-attn",
3589 + "onde-mistralrs-quant",
3590 + "onde-mistralrs-sandbox",
3591 + "onde-mistralrs-vision",
3592 + "openai-harmony",
3593 + "ordered-float",
3594 + "parking_lot",
3595 + "radix_trie",
3596 + "rand 0.9.5",
3597 + "rand_distr 0.5.1",
3598 + "rand_isaac",
3599 + "rayon",
3600 + "regex",
3601 + "regex-automata",
3602 + "reqwest 0.13.2",
3603 + "rubato",
3604 + "rust-mcp-schema",
3605 + "rustc-hash 2.1.2",
3606 + "rustfft",
3607 + "safetensors 0.8.0",
3608 + "schemars 1.2.1",
3609 + "scraper",
3610 + "serde",
3611 + "serde-big-array",
3612 + "serde-saphyr",
3613 + "serde_json",
3614 + "serde_plain",
3615 + "statrs",
3616 + "strum 0.27.2",
3617 + "symphonia",
3618 + "sysinfo",
3619 + "thiserror 2.0.18",
3620 + "tokenizers 0.21.4",
3621 + "tokio",
3622 + "tokio-rayon",
3623 + "tokio-tungstenite",
3624 + "toktrie",
3625 + "toktrie_hf_tokenizers",
3626 + "toml",
3627 + "tqdm",
3628 + "tracing",
3629 + "tracing-subscriber",
3630 + "urlencoding",
3631 + "uuid 1.23.0",
3632 + "variantly",
3633 + "vob",
3634 ]
3635
3636 [[package]]
3676 -name = "objc2-core-foundation"
3677 -version = "0.3.2"
3637 +name = "onde-mistralrs-macros"
3638 +version = "0.9.1"
3639 source = "registry+https://github.com/rust-lang/crates.io-index"
3679 -checksum = "2a180dd8642fa45cdb7dd721cd4c11b1cadd4929ce112ebd8b9f5803cc79d536"
3640 +checksum = "98ac14c14c8d54d2b9068dc8e2a8f892018d1ff15922e1bf2ed79abade164fe1"
3641 dependencies = [
3681 - "bitflags 2.11.0",
3682 - "dispatch2",
3683 - "objc2",
3642 + "darling 0.23.0",
3643 + "proc-macro2",
3644 + "quote",
3645 + "syn 2.0.117",
3646 ]
3647
3648 [[package]]
3687 -name = "objc2-encode"
3688 -version = "4.1.0"
3689 -source = "registry+https://github.com/rust-lang/crates.io-index"
3690 -checksum = "ef25abbcd74fb2609453eb695bd2f860d389e457f67dc17cafc8b8cbc89d0c33"
3691 -
3692 -[[package]]
3693 -name = "objc2-foundation"
3694 -version = "0.3.2"
3649 +name = "onde-mistralrs-mcp"
3650 +version = "0.9.1"
3651 source = "registry+https://github.com/rust-lang/crates.io-index"
3696 -checksum = "e3e0adef53c21f888deb4fa59fc59f7eb17404926ee8a6f59f5df0fd7f9f3272"
3652 +checksum = "347ebf2dedbc51f9867b6ecd657bc5e31a35cebf8c75b0a7d1b870836404e36a"
3653 dependencies = [
3698 - "bitflags 2.11.0",
3699 - "block2",
3700 - "libc",
3701 - "objc2",
3702 - "objc2-core-foundation",
3654 + "anyhow",
3655 + "async-trait",
3656 + "futures-util",
3657 + "http",
3658 + "image",
3659 + "reqwest 0.13.2",
3660 + "rust-mcp-schema",
3661 + "serde",
3662 + "serde_json",
3663 + "tokio",
3664 + "tokio-tungstenite",
3665 + "tracing",
3666 + "utoipa",
3667 + "uuid 1.23.0",
3668 ]
3669
3670 [[package]]
3706 -name = "objc2-io-kit"
3707 -version = "0.3.2"
3671 +name = "onde-mistralrs-metal-compile"
3672 +version = "0.9.1"
3673 source = "registry+https://github.com/rust-lang/crates.io-index"
3709 -checksum = "33fafba39597d6dc1fb709123dfa8289d39406734be322956a69f0931c73bb15"
3674 +checksum = "22e0810702e48f8e3e868b977d6820812b778722f7174da6197792b9f1674eb0"
3675 dependencies = [
3711 - "libc",
3712 - "objc2-core-foundation",
3676 + "candle-metal-kernels",
3677 + "objc2-metal",
3678 ]
3679
3680 [[package]]
3716 -name = "objc2-metal"
3717 -version = "0.3.2"
3681 +name = "onde-mistralrs-paged-attn"
3682 +version = "0.9.1"
3683 source = "registry+https://github.com/rust-lang/crates.io-index"
3719 -checksum = "a0125f776a10d00af4152d74616409f0d4a2053a6f57fa5b7d6aa2854ac04794"
3684 +checksum = "c981780845e62178b1bb4b7a4615ef33aa40ff46f3f15552f70fb5c9daa43073"
3685 dependencies = [
3721 - "bitflags 2.11.0",
3722 - "block2",
3686 + "anyhow",
3687 + "candle-metal-kernels",
3688 "dispatch2",
3724 - "objc2",
3725 - "objc2-core-foundation",
3689 + "float8",
3690 + "half",
3691 "objc2-foundation",
3692 + "objc2-metal",
3693 + "onde-candle-core",
3694 + "onde-mistralrs-metal-compile",
3695 + "thiserror 2.0.18",
3696 ]
3697
3698 [[package]]
3730 -name = "once_cell"
3731 -version = "1.21.4"
3699 +name = "onde-mistralrs-quant"
3700 +version = "0.9.1"
3701 source = "registry+https://github.com/rust-lang/crates.io-index"
3733 -checksum = "9f7c3e4beb33f85d45ae3e3a1792185706c8e16d043238c593331cc7cd313b50"
3702 +checksum = "c381c2af74c2708dd7c8b3cb3fef41fcbcd7602a60983dc42ffcf03a9a771bcc"
3703 +dependencies = [
3704 + "byteorder",
3705 + "candle-metal-kernels",
3706 + "dispatch2",
3707 + "float8",
3708 + "futures",
3709 + "half",
3710 + "hf-hub",
3711 + "indicatif 0.18.4",
3712 + "lazy_static",
3713 + "libc",
3714 + "memmap2",
3715 + "objc2-foundation",
3716 + "objc2-metal",
3717 + "onde-candle-core",
3718 + "onde-candle-nn",
3719 + "onde-mistralrs-metal-compile",
3720 + "paste",
3721 + "rayon",
3722 + "regex",
3723 + "safetensors 0.8.0",
3724 + "serde",
3725 + "serde_json",
3726 + "sysinfo",
3727 + "thiserror 2.0.18",
3728 + "tokio",
3729 + "tracing",
3730 + "yoke 0.8.2",
3731 +]
3732
3733 [[package]]
3736 -name = "once_cell_polyfill"
3737 -version = "1.70.2"
3734 +name = "onde-mistralrs-sandbox"
3735 +version = "0.9.1"
3736 source = "registry+https://github.com/rust-lang/crates.io-index"
3739 -checksum = "384b8ab6d37215f3c5301a95a4accb5d64aa607f1fcb26a11b5303878451b4fe"
3740 -
3741 -[[package]]
3742 -name = "onde"
3743 -version = "1.2.0"
3737 +checksum = "9a7467bc5b587a96bdb0af5cb48ad75546cee88cd18285e4dbc844bdda749ffe"
3738 dependencies = [
3739 "anyhow",
3746 - "cc",
3747 - "dotenvy",
3748 - "hf-hub",
3749 - "home",
3750 - "log",
3751 - "mistralrs",
3752 - "mistralrs-core",
3753 - "reqwest 0.12.28",
3740 + "itoa",
3741 + "landlock",
3742 + "libc",
3743 + "nix",
3744 + "seccompiler",
3745 "serde",
3755 - "serde_json",
3756 - "smbcloud-gresiq-sdk",
3746 "thiserror 2.0.18",
3747 "tokio",
3759 - "tsync",
3760 - "uniffi",
3748 + "tracing",
3749 +]
3750 +
3751 +[[package]]
3752 +name = "onde-mistralrs-vision"
3753 +version = "0.9.1"
3754 +source = "registry+https://github.com/rust-lang/crates.io-index"
3755 +checksum = "2d38f84085733aa0585f4f5bf9dfc8d7e7763fbe9a33a4231cffc87531ebebb0"
3756 +dependencies = [
3757 + "image",
3758 + "onde-candle-core",
3759 + "rayon",
3760 ]
3761
3762 [[package]]
@@ -5210,7 +5209,7 @@ source = "registry+https://github.com/rust-lang/crates.io-index"
5209 checksum = "b75a19a7a740b25bc7944bdee6172368f988763b744e3d4dfe753f6b4ece40cc"
5210 dependencies = [
5211 "libc",
5213 - "mio",
5212 + "mio 0.8.11",
5213 "signal-hook",
5214 ]
5215
@@ -6030,7 +6029,7 @@ checksum = "f66bf9585cda4b724d3e78ab34b73fb2bbaba9011b9bfdf69dc836382ea13b8c"
6029 dependencies = [
6030 "bytes",
6031 "libc",
6033 - "mio",
6032 + "mio 1.2.0",
6033 "parking_lot",
6034 "pin-project-lite",
6035 "signal-hook-registry",
@@ -6209,7 +6208,8 @@ checksum = "8df9b6e13f2d32c91b9bd719c00d1958837bc7dec474d94952798cc8e69eeec3"
6208 [[package]]
6209 name = "tqdm"
6210 version = "0.8.0"
6212 -source = "git+https://github.com/setoelkahfi/tqdm?branch=deps%2Fbump-crossterm#41e4182829136e6dadbdd1c36af824d19219147a"
6211 +source = "registry+https://github.com/rust-lang/crates.io-index"
6212 +checksum = "b316d5c2ac649ca856dacd487d0ebb94f3b746bada51355d93dd2c007ab62a2e"
6213 dependencies = [
6214 "anyhow",
6215 "crossterm",
@@ -6299,7 +6299,7 @@ version = "2.2.1"
6299 source = "registry+https://github.com/rust-lang/crates.io-index"
6300 checksum = "4fc20a25899c5ae43735253244214f3d5eb75dd28d9cc8491732294a985adb8c"
6301 dependencies = [
6302 - "convert_case 0.6.0",
6302 + "convert_case",
6303 "proc-macro2",
6304 "quote",
6305 "state",
@@ -7178,6 +7178,15 @@ dependencies = [
7178 "windows-targets 0.42.2",
7179 ]
7180
7181 +[[package]]
7182 +name = "windows-sys"
7183 +version = "0.48.0"
7184 +source = "registry+https://github.com/rust-lang/crates.io-index"
7185 +checksum = "677d2418bec65e3338edb076e806bc1ec15693c5d0104683f2efe857f61056a9"
7186 +dependencies = [
7187 + "windows-targets 0.48.5",
7188 +]
7189 +
7190 [[package]]
7191 name = "windows-sys"
7192 version = "0.52.0"