Want to become a Vibe Coder? Join Vibe Coding Training here
x
C# Corner
Tech
News
Videos
Forums
Jobs
Books
Events
More
Interviews
Live
Learn
Training
Career
Members
Blogs
Challenges
Certification
Contribute
Article
Blog
Video
Ebook
Interview Question
Collapse
Feed
Dashboard
Wallet
Learn
Achievements
Network
Refer
Rewards
SharpGPT
Premium
Contribute
Article
Blog
Video
Ebook
Interview Question
Register
Login
Tags
No tag found
Content Filter
Articles
Videos
Blogs
Resources
News
Forums
Interviews
Complexity Level
Beginner
Intermediate
Advanced
Refine by Author
[Clear]
Jitendra Mesavaniya(1)
Ashish Bhatnagar(1)
Muhammad Hassan (1)
paul 0(1)
gary sun(1)
Jean Paul(1)
David Lloyd(1)
Resources
No resource found
Additional Tokenizer Support in ML.NET
Jun 03, 2024.
Tokenization is a fundamental component in the preprocessing of natural language text for AI models. Tokenizers are responsible for breaking down a string of text into smaller, often referred to as tokens. The process is crucial for understanding costs and managing context when using services like Azure OpenAI.
Stream Tokenizer Class in Java
Jun 27, 2023.
Stream Tokenizer class helps in identifying the patterns in the input stream.
Email Tokenizer For AngularJS Directive
Apr 04, 2015.
This article explains the AngularJS directive for valid email tokenizer.
Java Like StringTokenizer in C#
Jun 11, 2003.
The StringTokenizer class is yet another implementation of a java-like StringTokenizer in C#.
C# Tokenizer
Aug 27, 2001.
A simple tokenizer in csharp without using regex or MatchCollections.
Interpreter Pattern in .NET
Jan 19, 2012.
The Interpreter Pattern in .NET facilitates language interpretation by defining grammar and providing a framework to interpret expressions. It's ideal for implementing domain-specific languages or complex rule-based systems with ease and extensibility.
C# Versions of Java's StringTokernizer
Jan 13, 2003.
Here is another C# version of the Java StringTokenizer Class from the version posted August last year on your site. Given a string and a set of delimiters, the class return an enumeration of substrings based on the delimeters passed in.