Lexers, tokenizers, parsers, compilers, renderers, stringifiers... What's the difference, and how do they work?
-
Updated
Apr 26, 2017
#
token-stream
Here are 6 public repositories matching this topic...
A versatile token stream for handwritten parsers.
-
Updated
Aug 3, 2023 - Python
OpenAI VoiceStream: Real-time text-to-speech library for processing text and token streams using the OpenAI API. Supports multiple voices and thread-safe audio generation.
audio python api machine-learning text-to-speech real-time ai multithreading audio-player speech-synthesis openai audio-processing voice-assistant streaming-audio token-stream openai-api token-streaming text-to-speech-converter gpt-4o real-timespeech-synthesis
-
Updated
Jun 1, 2024 - Python
A lightweight, security-first Rust toolkit for syntax parsing, procedural macros, and code generation. Designed around explicit validation, bounded resource use, zero third-party dependencies, and a no_std-capable core.
rust syntax security parsing metaprogramming rust-lang developer-tools memory-safety code-generation rust-library hacktoberfest no-std procedural-macros source-transformation lighweight token-stream zero-dependencies rust-parser derive-macro attribute-macros
-
Updated
Sep 25, 2026 - Shell
-
Updated
Oct 1, 2026 - Python
Add this topic to your repo
To associate your repository with the token-stream topic, visit your repo's landing page and select "manage topics."