Epistemology

A private open source platform for your local text AI

Language learning models are powerful tools you should feel in control of. This project was created to be a middle ground between bare bones CLI usage of llama.cpp and AI interfaces that are so complex or black boxes they feel untrustworthy. It offers a number of ways it aims to be private that may appeal to you:

Never writes your prompts out anywhere in logs or consoles
Runs only on http://localhost:8080 to never have network access outside your machine
Has extremely simple code so that you can understand and analyze every aspect
Has no stateful configuration or data other than what you initalize it with
It wraps `llama.cpp` and executes it with the most minimal exposing settings possible
Constrain output to only what to you want it to output with AI grammers
Zero intentions of ever commercializing or collecting data or directing downloads to third party services
Open source so you can modify to your values and needs

Local HTTP GET/POST API

Unlock seamless integration with a local HTTP API designed for your needs. Build your AI tools upon APIs using your preferred technology, backed by a fully transparent and understandable backend. The API's clarity and simplicity ensure complete visibility into every aspect of its operation.

Bring your own static UI

Epistemology comes with a default UI for text completion, but makes it easy to replace with your own personal web frontend.

JSON schema support

Constraining AI outputs using grammars is very powerful, Epistemology natively supports using JSON schema files as grammars so you can get useful structured output for programmatic interfaces.

Getting Started

Install llama.cpp

Download a GGUF model such as TheBloke/phi-2-GGUF

Install binaries (macOS, Linux, Windows)

Build from

        cargo install epistemology

Run the server

        epistemology -p ~/llama.cpp/main -e ~/Downloads/phi-2.Q2_K.gguf

        Listening with GET and POST on http://localhost:8080/api/text-completion
        Examples:
            * http://localhost:8080/api/text-completion?prompt=famous%20qoute:
            * curl -X POST -d "famous quote:" http://localhost:8080/api/text-completion

Find more details by running

    epistemology --help

or visiting the project page at https://github.com/richardanaya/epistemology/.

Be in control of your AI.
Powered by Rust.
MIT licensed.
Github.