   Compiling libc v0.2.184
   Compiling log v0.4.29
   Compiling futures-util v0.3.32
   Compiling num-traits v0.2.19
   Compiling stable_deref_trait v1.2.1
   Compiling llama-cpp-sys-2 v0.1.145
   Compiling regex-automata v0.4.14
   Compiling hashbrown v0.15.5
   Compiling sketches-ddsketch v0.3.1
   Compiling yoke v0.8.2
   Compiling tracing v0.1.44
   Compiling zerovec v0.11.6
   Compiling zerotrie v0.2.4
   Compiling ureq-proto v0.6.0
   Compiling libsql-sqlite3-parser v0.13.0
   Compiling tinystr v0.8.3
   Compiling potential_utf v0.1.5
   Compiling icu_locale_core v2.2.0
   Compiling errno v0.3.14
   Compiling parking_lot_core v0.9.12
   Compiling signal-hook-registry v1.4.8
   Compiling mio v1.2.0
   Compiling parking_lot v0.12.5
   Compiling socket2 v0.6.3
   Compiling tokio v1.51.0
   Compiling getrandom v0.2.17
   Compiling ring v0.17.14
   Compiling security-framework-sys v2.17.0
   Compiling getrandom v0.3.4
   Compiling getrandom v0.4.2
   Compiling core-foundation v0.9.4
   Compiling core-foundation v0.10.1
   Compiling icu_provider v2.2.0
   Compiling icu_collections v2.2.0
   Compiling ahash v0.8.12
   Compiling security-framework v3.7.0
   Compiling rand_core v0.6.4
   Compiling rustls-webpki v0.103.10
   Compiling rustix v1.1.4
   Compiling system-configuration-sys v0.6.0
   Compiling rand_chacha v0.3.1
   Compiling system-configuration v0.7.0
   Compiling icu_normalizer v2.2.0
   Compiling icu_properties v2.2.0
   Compiling rustls v0.23.37
   Compiling tempfile v3.27.0
   Compiling socket2 v0.5.10
   Compiling idna_adapter v1.2.1
   Compiling native-tls v0.2.18
   Compiling rand v0.8.5
   Compiling idna v1.1.0
   Compiling hashbrown v0.14.5
   Compiling url v2.5.8
   Compiling tokio-util v0.7.18
   Compiling tower v0.5.3
   Compiling tokio-stream v0.1.18
   Compiling h2 v0.4.13
   Compiling h2 v0.3.27
   Compiling tower v0.4.13
   Compiling tower-http v0.6.8
   Compiling tokio-io-timeout v1.2.1
   Compiling futures-executor v0.3.32
   Compiling axum-core v0.3.4
   Compiling uuid v1.23.0
   Compiling rand_core v0.9.5
   Compiling rand_chacha v0.9.0
   Compiling futures v0.3.32
   Compiling hashlink v0.8.4
   Compiling tokio-native-tls v0.3.1
   Compiling tokio-rustls v0.26.4
   Compiling rustls-webpki v0.102.8
   Compiling dirs-sys v0.5.0
   Compiling console v0.16.3
   Compiling socks v0.3.4
   Compiling ureq v3.3.0
   Compiling indicatif v0.18.4
   Compiling dirs v6.0.0
   Compiling rustls v0.22.4
   Compiling hyper v1.9.0
   Compiling hyper v0.14.32
   Compiling rustls-platform-verifier v0.6.2
   Compiling hyper-util v0.1.20
   Compiling libsql-rusqlite v0.9.30
   Compiling rand v0.9.2
   Compiling security-framework v2.11.1
   Compiling chrono v0.4.44
   Compiling cpufeatures v0.2.17
   Compiling rustls-native-certs v0.7.3
   Compiling hyper-rustls v0.27.7
   Compiling hyper-tls v0.6.0
   Compiling reqwest v0.13.2
   Compiling reqwest v0.12.28
   Compiling libsql-sys v0.9.30
   Compiling axum v0.6.20
   Compiling hyper-timeout v0.4.1
   Compiling aes v0.8.4
   Compiling tokio-rustls v0.25.0
   Compiling autoagents-protocol v0.3.7 (/Users/jamessheen/Documents/Projects/Ideas/oss/AutoAgents/crates/autoagents-protocol)
   Compiling tower-http v0.4.4
   Compiling regex v1.12.3
   Compiling num-integer v0.1.46
   Compiling num-complex v0.4.6
   Compiling dirs-sys v0.4.1
   Compiling num_cpus v1.17.0
   Compiling dirs v5.0.1
   Compiling hf-hub v0.5.0
   Compiling ndarray v0.17.2
   Compiling autoagents-llm v0.3.7 (/Users/jamessheen/Documents/Projects/Ideas/oss/AutoAgents/crates/autoagents-llm)
   Compiling tonic v0.11.0
   Compiling hyper-rustls v0.25.0
   Compiling tonic-web v0.11.0
   Compiling libsql_replication v0.9.30
   Compiling rand v0.10.1
   Compiling libsql v0.9.30
   Compiling ort v2.0.0-rc.12
   Compiling zspell v0.5.5
   Compiling tokenizers v0.22.2
   Compiling metrics v0.24.3
   Compiling ordered-float v4.6.0
   Compiling quanta v0.12.6
   Compiling metrics-util v0.18.0
   Compiling llama-cpp-2 v0.1.145
   Compiling autoagents-llamacpp v0.3.7 (/Users/jamessheen/Documents/Projects/Ideas/oss/AutoAgents/crates/autoagents-llamacpp)
   Compiling temporal-spike v0.1.0 (/Users/jamessheen/Documents/Projects/Ideas/ai-meeting-transcription/rql-spike)
    Finished `release` profile [optimized] target(s) in 3m 00s
     Running tests/model_comparison.rs (/Users/jamessheen/.cargo-shared-target/kaironiq/release/deps/model_comparison-1238d4cb13964449)

running 1 test
test model_comparison_tests::test_model_comparison ... 
============================================================
  MODEL COMPARISON — Entity Recall Benchmark
============================================================

  SKIP: NuExtract-4B (template) (RQL_NUEXTRACT_MODEL_PATH not set)

  SKIP: NuExtract-4B (grounded) (RQL_NUEXTRACT_MODEL_PATH not set)

  SKIP: Phi-4-mini (3-stage) (RQL_PHI4_MODEL_PATH not set)

  SKIP: Phi-4-mini (3-stage-nogrm) (RQL_PHI4_MODEL_PATH not set)

  SKIP: Qwen-3B (template) (RQL_QWEN3B_MODEL_PATH not set)

  SKIP: Qwen-3B (3-stage) (RQL_QWEN3B_MODEL_PATH not set)

  Loading: Gemma-4-E2B (3-stage) (/Users/jamessheen/Documents/Projects/Ideas/ai-meeting-transcription/models/gemma-4-E2B-it-Q4_K_M.gguf)
  Running fixtures for: Gemma-4-E2B (3-stage)
    Mock Interview — R:90% P:53% F1:67% (9/10 found, 17 extracted) in 12.4s  miss=["ziad"]
    Tech Standup — R:100% P:42% F1:59% (13/13 found, 31 extracted) in 23.4s  miss=[]
warn: skipping fact (Priya Sharma -> works for -> Marine Biology Institute at Stanford University): database error: SQLite failure: `FOREIGN KEY constraint failed`
    Podcast Interview — R:100% P:31% F1:47% (15/15 found, 49 extracted) in 24.6s  miss=[]
    Sales Call — R:100% P:32% F1:48% (12/12 found, 38 extracted) in 22.8s  miss=[]
    Legal Deposition — R:88% P:24% F1:37% (14/16 found, 59 extracted) in 23.9s  miss=["clifford reeves", "february 14, 2024"]
    Medical Consultation — R:93% P:43% F1:59% (13/14 found, 30 extracted) in 22.6s  miss=["st. catherine's general hospital"]
warn: skipping fact (Ferdinand de Saussure -> foundational_claim_in -> Course in General Linguistics): database error: SQLite failure: `FOREIGN KEY constraint failed`
warn: skipping fact (Ferdinand de Saussure -> contributed_to -> structural linguistics): database error: SQLite failure: `FOREIGN KEY constraint failed`
    Academic Lecture — R:95% P:54% F1:69% (21/22 found, 39 extracted) in 17.1s  miss=["mit"]
    Customer Support — R:100% P:28% F1:44% (9/9 found, 32 extracted) in 21.7s  miss=[]
    Board Meeting — R:94% P:23% F1:37% (16/17 found, 69 extracted) in 25.7s  miss=["niall o'brien"]
warn: skipping fact (Meridian Systems (Organisation) -> sponsors -> Meridian Cloud Services (Organisation)): database error: SQLite failure: `FOREIGN KEY constraint failed`
    News Article — R:100% P:41% F1:58% (16/16 found, 39 extracted) in 27.7s  miss=[]
    Slack Thread — R:100% P:50% F1:67% (12/12 found, 24 extracted) in 25.8s  miss=[]
warn: skipping fact (Zephyr Audio Connect app -> has_feature -> clunky equaliser UI): database error: SQLite failure: `FOREIGN KEY constraint failed`
warn: skipping fact (Sony Headphones Connect app -> handles_feature -> automatic volume levelling feature): database error: SQLite failure: `FOREIGN KEY constraint failed`
warn: skipping fact (Zephyr Audio ZA-900 Pro -> has_feature -> ANC): database error: SQLite failure: `FOREIGN KEY constraint failed`
    Product Review — R:80% P:40% F1:53% (8/10 found, 20 extracted) in 18.0s  miss=["za-800", "active noise cancellation"]
    Short Snippet — R:100% P:44% F1:62% (4/4 found, 9 extracted) in 8.0s  miss=[]
warn: skipping fact (NEXAGEN CORPORATION -> delivered revenues -> $312.4 million in Q3 FY2024): database error: SQLite failure: `FOREIGN KEY constraint failed`
    Long Report — R:95% P:40% F1:56% (36/38 found, 90 extracted) in 31.5s  miss=["münchener rückversicherungs-gesellschaft", "columbus, ohio"]

  Loading: Gemma-4-E2B (3-stage-nogrm) (/Users/jamessheen/Documents/Projects/Ideas/ai-meeting-transcription/models/gemma-4-E2B-it-Q4_K_M.gguf)
  Running fixtures for: Gemma-4-E2B (3-stage-nogrm)
    Mock Interview — R:90% P:53% F1:67% (9/10 found, 17 extracted) in 12.2s  miss=["ziad"]
    Tech Standup — R:100% P:42% F1:59% (13/13 found, 31 extracted) in 28.4s  miss=[]
warn: skipping fact (Priya Sharma -> works for -> Marine Biology Institute at Stanford University): database error: SQLite failure: `FOREIGN KEY constraint failed`
    Podcast Interview — R:100% P:31% F1:47% (15/15 found, 49 extracted) in 28.3s  miss=[]
    Sales Call — R:100% P:32% F1:48% (12/12 found, 38 extracted) in 23.2s  miss=[]
    Legal Deposition — R:88% P:24% F1:37% (14/16 found, 59 extracted) in 24.4s  miss=["clifford reeves", "february 14, 2024"]
    Medical Consultation — R:93% P:43% F1:59% (13/14 found, 30 extracted) in 22.3s  miss=["st. catherine's general hospital"]
warn: skipping fact (Ferdinand de Saussure -> foundational_claim_in -> Course in General Linguistics): database error: SQLite failure: `FOREIGN KEY constraint failed`
warn: skipping fact (Ferdinand de Saussure -> contributed_to -> structural linguistics): database error: SQLite failure: `FOREIGN KEY constraint failed`
    Academic Lecture — R:95% P:54% F1:69% (21/22 found, 39 extracted) in 17.0s  miss=["mit"]
    Customer Support — R:100% P:28% F1:44% (9/9 found, 32 extracted) in 26.6s  miss=[]
    Board Meeting — R:94% P:23% F1:37% (16/17 found, 69 extracted) in 68.0s  miss=["niall o'brien"]
warn: skipping fact (Meridian Systems (Organisation) -> sponsors -> Meridian Cloud Services (Organisation)): database error: SQLite failure: `FOREIGN KEY constraint failed`
    News Article — R:100% P:41% F1:58% (16/16 found, 39 extracted) in 73.2s  miss=[]
    Slack Thread — R:100% P:50% F1:67% (12/12 found, 24 extracted) in 67.0s  miss=[]
warn: skipping fact (Zephyr Audio Connect app -> has_feature -> clunky equaliser UI): database error: SQLite failure: `FOREIGN KEY constraint failed`
warn: skipping fact (Sony Headphones Connect app -> handles_feature -> automatic volume levelling feature): database error: SQLite failure: `FOREIGN KEY constraint failed`
    Product Review — R:80% P:40% F1:53% (8/10 found, 20 extracted) in 42.3s  miss=["za-800", "active noise cancellation"]
warn: skipping fact (appointment -> announced_by -> James Whitfield): database error: SQLite failure: `FOREIGN KEY constraint failed`
    Short Snippet — R:100% P:44% F1:62% (4/4 found, 9 extracted) in 22.5s  miss=[]
warn: skipping fact (NEXAGEN CORPORATION -> delivered revenues -> $312.4 million in Q3 FY2024): database error: SQLite failure: `FOREIGN KEY constraint failed`
    Long Report — R:95% P:40% F1:56% (36/38 found, 90 extracted) in 79.8s  miss=["münchener rückversicherungs-gesellschaft", "columbus, ohio"]

  Loading: Gemma-4-E2B (template) (/Users/jamessheen/Documents/Projects/Ideas/ai-meeting-transcription/models/gemma-4-E2B-it-Q4_K_M.gguf)
  Running fixtures for: Gemma-4-E2B (template)
