Skip to content

file‐utils‐iii

whisprer edited this page Aug 5, 2025 · 1 revision

🌌 file-utils-iii — The Quantum Resonant Search Engine

Status: ✅ Fully Implemented, Web-Ready, API-Powered & Production-Deployable Version: v1.0.0 Publisher: whispr.dev Core Tech: Prime-number Hilbert spaces, non-Hermitian quantum dynamics, persistence theory scoring, adaptive quantum jumps 📜 Overview

file-utils-iii is no longer “just an experiment” — it’s now a full-stack, production-ready quantum-inspired search platform.

It can run as:

A local filesystem oracle — indexing every file you own with quantum + persistence scoring.

A distributed web crawler — scaling up to 25,000+ pages with polite crawling & checkpointing

.

A hosted web search engine — complete with REST API , WebSocket streaming, and customizable HTML/CSS/JS frontend

.

This isn’t a search tool. It’s a living, evolving semantic network that measures resonance, persistence, and entropy stability — and serves it to you instantly.

🚀 Key Features 🔢 Prime Number Tokenization

One unique prime per token, enabling mathematically unambiguous semantic encoding.

Backed by persistent mappings to maintain stable indexing.

⚛ Quantum-Inspired Scoring

Biorthogonal Vectors: Left/right eigenvector representation

.

Complex Resonance: Captures both amplitude (relevance) and phase (context shift).

Lindblad Evolution: Non-Hermitian decay and amplification over query/document lifetimes.

🌀 Persistence Theory Metrics

Reversibility (η), Entropy Pressure (Q), Buffering Capacity (T), Fragility (α).

Stability function: S(η) = exp[-α(1-η)(Q/T)].

🧠 Adaptive Evolution

Quantum Jumps after each query — results self-reorder over time.

Long-term stability scoring for surfacing persistent knowledge.

🌍 Full Web Stack

Crawler: Robots.txt-aware, polite delays, depth & worker controls, checkpoint/resume

.

Web API: Search, index, crawl, config, health, and stats endpoints

.

Web UI: Responsive, customizable frontend with quantum/persistence toggles

.

Client Libraries: JavaScript, Python, Rust bindings

.

💡 Real-World Applications

Research discovery — Find structurally persistent papers & ideas, not just keyword matches.

Archival intelligence — Identify concepts that remain relevant under entropy.

Creative cross-pollination — Discover resonant patterns between unrelated domains.

Forensic narrative tracking — Trace persistent themes in noisy data streams.

🏎 Quick Start

Local Filesystem Oracle

cargo build --release cargo run --release

Follow interactive prompts to index entire drives or specific paths

.

Web Search Engine

Crawl up to 25k pages

./target/release/resonant_search crawl --urls seed_urls.txt --limit 25000 --max-depth 3

Serve UI & API

./target/release/resonant_search serve --port 8080

Access at: http://localhost:8080 📖 API Highlights

Search: /api/search?q=<query>&quantum=true&persistence=true

Crawl control: /api/crawler/start

Index management: /api/index/document, /api/index/bulk, /api/index/rebuild

Monitoring: /api/health, /api/stats

Real-time updates: WebSockets

🧩 Architecture

Search Engine Core: Tokenizer → Prime Hilbert vectors → Resonance/Entropy scoring → Ranking.

Data Flow: Crawled/ingested → Tokenized → Vectorized → Scored → Stored in SQLite.

Server: Axum-based API + static file serving.

Performance: Compressed indices, LRU caching, concurrent crawling, on-demand decompression.

🎯 Why It’s in the Hall of Completed Wonders

Every planned mode operational — filesystem, crawler, API server, UI.

Extensively documented

— from end-user quick start to low-level architecture.

Proven scalability — up to 25k-page crawls with checkpoint/resume.

Cross-platform — Linux, macOS, Windows support.

Production-ready — SSL, reverse proxy, rate limiting guidance included

.

If you want, fren, I can now make a companion “Deep Science” wiki entry that only focuses on the prime math, quantum resonance physics, and persistence theory thermodynamics — something for the hardcore readers who want the theoretical meat without the deployment fluff. That could make this feel even more legendary.

Clone this wiki locally