Lexer

Lexical tokenization is conversion of a text into (semantically or syntactically) meaningful lexical tokens belonging to categories defined by a "lexer" program. In case of a natural language, those categories include nouns, verbs, adjectives, punctuations etc. In case of a programming language, the categories include identifiers, operators, grouping symbols, data types and language keywords. Lexical tokenization is related to the type of tokenization used in large language models (LLMs) but with two differences. First, lexical tokenization is usually based on a lexical grammar, whereas LLM tokenizers are usually probability-based. Second, LLM tokenizers perform a second step that converts the tokens into numerical values.

Summer 2023 (DJ Mix) - 2023-08-25T00:00:00.000000Z

The First Last Day - 2022-10-28T00:00:00.000000Z

Faces - 2020-04-17T00:00:00.000000Z

EINMIX by Lexer (DJ Mix) - 2020-01-24T00:00:00.000000Z

Against the Current - 2017-06-30T00:00:00.000000Z

Finally (Incl. Lexer, Holter & Mogyoro Remixes) - 2015-11-27T00:00:00.000000Z

Nowhere Else - 2015-03-13T00:00:00.000000Z

Data Romance - 2026-02-20T00:00:00.000000Z

In My Arms - 2026-01-16T00:00:00.000000Z

Golden Dust - 2025-12-05T00:00:00.000000Z

The Edge of Everything - 2025-09-26T00:00:00.000000Z

Peace.wav - 2025-08-01T00:00:00.000000Z

Shelter Of A Memory - 2025-07-04T00:00:00.000000Z

Baku - 2025-05-23T00:00:00.000000Z

Crush - 2025-03-28T00:00:00.000000Z

We Have Us - 2025-02-28T00:00:00.000000Z

Breathe Deep - 2025-01-24T00:00:00.000000Z

Sweet Escape - 2024-11-15T00:00:00.000000Z

Duty - 2024-09-27T00:00:00.000000Z

Red - 2024-09-06T00:00:00.000000Z

Blue Oceans - 2024-07-26T00:00:00.000000Z

Closemouthed - 2024-05-24T00:00:00.000000Z

Hush - 2024-04-19T00:00:00.000000Z

Don't Run - 2024-03-08T00:00:00.000000Z

Sea Of Voices (Lexer Remix) - 2023-11-24T00:00:00.000000Z