Describes general lexer interface. Lexers turn string source input which is obtained via ISourceText implementation (i.e. FileSource,WebSource...) into tokenized stream. Some lexer implementations may support lazy analysis, that is - source text analysis which is done in chunks when lexer is iterated over, others may lex the whole source text at once

public interface ILexer : ICodeProcessor

public interface ILexer : ICodeProcessor

Public Interface ILexer 
	Inherits ICodeProcessor

Public Interface ILexer 
	Inherits ICodeProcessor

public interface class ILexer : ICodeProcessor

public interface class ILexer : ICodeProcessor

type ILexer =  
    interface 
        interface ICodeProcessor 
    end

type ILexer =  
    interface 
        interface ICodeProcessor 
    end