# --- Optional: local ML inference stack --- # Nothing in synapse/ imports any of this — Ollama handles all inference over # HTTP. Only install this if you're doing local model work outside Ollama # (fine-tuning, direct transformers inference, etc). Skipping it is what keeps # the default install light and out of a multi-GB torch download. # # This file has no --index-url of its own, so torch resolves as CPU-only # unless you combine it with the GPU overlay that sets one: # pip install -r requirements-amd.txt -r requirements-ml.txt # ROCm # pip install -r requirements-nvidia.txt -r requirements-ml.txt # CUDA # pip install -r requirements-ml.txt # CPU only transformers accelerate bitsandbytes safetensors sentencepiece torch torchaudio torchvision