Large Language Model Text Generation Inference
-
Updated
Mar 21, 2026 - Python
Large Language Model Text Generation Inference
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
An open-source and enterprise-level monitoring system.
Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.
Free, open-source SQL client for Windows and Mac 🦅
A familiar HTTP Service Framework for Python.
A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.
LLM Finetuning with peft
A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.
🦙 Integrating LLMs into structured NLP pipelines
🩹Editing large language models within 10 seconds⚡
The simplest way to serve AI/ML models in production
🤖 A PyTorch library of curated Transformer models and their composable components
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
The only real free CLI agent. Harvests your Gemini (guest, no login) · Claude.ai · Claude Code · Kimi · Qwen · DeepSeek browser session and turns it into a tool-calling agent — reads & edits files, runs Bash, greps your repo, browses the web, ships commits, all from your terminal. Frontier IA driving real work at $0
FastOpenAPI is a library for generating and integrating OpenAPI schemas using Pydantic v2 and various frameworks (AioHttp, Django, Falcon, Flask, Quart, Sanic, Starlette, Tornado).
PowerShell for CrowdStrike's OAuth2 APIs
Add a description, image, and links to the falcon topic page so that developers can more easily learn about it.
To associate your repository with the falcon topic, visit your repo's landing page and select "manage topics."