Lexer TToken  MembersNFX Class Library

[This is preliminary documentation and is subject to change.]

The Lexer TToken  type exposes the following members.
Constructors

  NameDescription
Protected methodLexer TToken (ISourceText, MessageList, Boolean)
Protected methodLexer TToken (IAnalysisContext, SourceCodeRef, ISourceText, MessageList, Boolean)
Back to Top
Methods

  NameDescription
Public methodAnalyzeAll
If lexer supports lazy analysis, forces analysis of the whole source
Protected methodDoLexingChunk
Lexes more source and returns true when EOF has been reached. Depending on particular implementation, a chunk may contain more than one token. Tokens are added into m_Tokens
Protected methodEmitMessage(MessageType, Int32, SourcePosition, Token, String, Exception) (Inherited from SourceRefCommonCodeProcessor.)
Protected methodEmitMessage(MessageType, Int32, SourceCodeRef, Nullable SourcePosition , Token, String, Exception) (Inherited from CommonCodeProcessor.)
Public methodOnlineEquals
Determines whether the specified object is equal to the current object.
(Inherited from OnlineObject.)
Protected methodOnlineFinalize
Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.
(Inherited from OnlineObject.)
Public methodGetEnumerator
Public methodOnlineGetHashCode
Serves as the default hash function.
(Inherited from OnlineObject.)
Public methodOnlineGetType
Gets the OnlineType of the current instance.
(Inherited from OnlineObject.)
Protected methodOnlineMemberwiseClone
Creates a shallow copy of the current OnlineObject.
(Inherited from OnlineObject.)
Public methodMessageCodeToString
Returns string representation of message code which is output by this processor
(Inherited from CommonCodeProcessor.)
Public methodToString (Overrides OnlineObject ToString .)
Back to Top
Extension Methods

  NameDescription
Public Extension MethodAsBool (Defined by ObjectValueConversion.)
Public Extension MethodAsByte (Defined by ObjectValueConversion.)
Public Extension MethodAsChar (Defined by ObjectValueConversion.)
Public Extension MethodAsDateTime Overloaded. (Defined by ObjectValueConversion.)
Public Extension MethodAsDateTime(DateTime, ConvertErrorHandling)Overloaded. (Defined by ObjectValueConversion.)
Public Extension MethodAsDecimal (Defined by ObjectValueConversion.)
Public Extension MethodAsDouble (Defined by ObjectValueConversion.)
Public Extension MethodAsEnum TEnum  (Defined by ObjectValueConversion.)
Public Extension MethodAsFloat (Defined by ObjectValueConversion.)
Public Extension MethodAsGDID Overloaded. (Defined by ObjectValueConversion.)
Public Extension MethodAsGDID(GDID, ConvertErrorHandling)Overloaded. (Defined by ObjectValueConversion.)
Public Extension MethodAsGDIDSymbol Overloaded. (Defined by ObjectValueConversion.)
Public Extension MethodAsGDIDSymbol(GDIDSymbol, ConvertErrorHandling)Overloaded. (Defined by ObjectValueConversion.)
Public Extension MethodAsGUID (Defined by ObjectValueConversion.)
Public Extension MethodAsInt (Defined by ObjectValueConversion.)
Public Extension MethodAsJSONConfig (Defined by ObjectValueConversion.)
Public Extension MethodAsLaconicConfig (Defined by ObjectValueConversion.)
Public Extension MethodAsLong (Defined by ObjectValueConversion.)
Public Extension MethodAsLookAheadEnumerable TToken  (Defined by LookAheadExtensions.)
Public Extension MethodAsNonNullOrEmptyString (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableBool (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableByte (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableChar (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableDateTime (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableDecimal (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableDouble (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableEnum TEnum  (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableFloat (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableGDID (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableGDIDSymbol (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableGUID (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableInt (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableLong (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableSByte (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableShort (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableTimeSpan (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableUInt (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableULong (Defined by ObjectValueConversion.)
Public Extension MethodAsNullableUShort (Defined by ObjectValueConversion.)
Public Extension MethodAsSByte (Defined by ObjectValueConversion.)
Public Extension MethodAsShort (Defined by ObjectValueConversion.)
Public Extension MethodAsString (Defined by ObjectValueConversion.)
Public Extension MethodAsTimeSpan Overloaded. (Defined by ObjectValueConversion.)
Public Extension MethodAsTimeSpan(TimeSpan, ConvertErrorHandling)Overloaded. (Defined by ObjectValueConversion.)
Public Extension MethodAsUInt (Defined by ObjectValueConversion.)
Public Extension MethodAsULong (Defined by ObjectValueConversion.)
Public Extension MethodAsUri (Defined by ObjectValueConversion.)
Public Extension MethodAsUShort (Defined by ObjectValueConversion.)
Public Extension MethodAsXMLConfig (Defined by ObjectValueConversion.)
Public Extension MethodDistinct TToken, TKey  (Defined by CollectionUtils.)
Public Extension MethodFirstMax TToken, TComparand (Func TToken, TComparand )Overloaded. (Defined by CollectionUtils.)
Public Extension MethodFirstMax TToken, TComparand (Func TToken, TComparand , TComparand )Overloaded. (Defined by CollectionUtils.)
Public Extension MethodFirstMin TToken, TComparand (Func TToken, TComparand )Overloaded. (Defined by CollectionUtils.)
Public Extension MethodFirstMin TToken, TComparand (Func TToken, TComparand , TComparand )Overloaded. (Defined by CollectionUtils.)
Public Extension MethodFirstOrAnyOrDefault TToken 
Tries to find the first element that matches the predicate and returns it, otherwise returns the first element found or default (i.e. null)
(Defined by CollectionUtils.)
Public Extension MethodForEach TToken (Action TToken )Overloaded.
Runs some method over each element of src sequence
(Defined by CollectionUtils.)
Public Extension MethodForEach TToken (Action TToken, Int32 )Overloaded.
Runs some method over each element of src sequence
(Defined by CollectionUtils.)
Public Extension MethodLazyFSM TToken ( LazyFSMPredicate TToken  )Overloaded.
Makes finite state machine fed from IEnumerable(Token) only considering primary language tokens
(Defined by PatternSearch.)
Public Extension MethodLazyFSM TToken (Boolean,  LazyFSMPredicate TToken  )Overloaded.
Makes finite state machine fed from IEnumerable(Token)
(Defined by PatternSearch.)
Public Extension MethodLazyFSM TToken (Boolean, LazyFSMState TToken  ,  LazyFSMPredicate TToken  )Overloaded.
Makes finite state machine fed from IEnumerable(Token)
(Defined by PatternSearch.)
Public Extension MethodSkipLast TToken  Overloaded.
Takes all elements except for last element from the given source
(Defined by CollectionUtils.)
Public Extension MethodSkipLast TToken (Int32)Overloaded.
Takes all but last N elements from the source
(Defined by CollectionUtils.)
Public Extension MethodToErlObject Overloaded.
Try to convert .NET native object type to corresponding Erlang term. Throw exception if conversion is not possible
(Defined by ErlObject.)
Public Extension MethodToErlObject(ErlTypeOrder, Boolean)Overloaded.
Try to convert .NET native object type to corresponding Erlang term of given type. Throw exception if conversion is not possible
(Defined by ErlObject.)
Public Extension MethodToJSON(JSONWritingOptions)Overloaded.
Serializes object into JSON string
(Defined by JSONExtensions.)
Public Extension MethodToJSON(TextWriter, JSONWritingOptions)Overloaded.
Serializes object into JSON format using provided TextWriter
(Defined by JSONExtensions.)
Public Extension MethodToJSON(Stream, JSONWritingOptions, Encoding)Overloaded.
Serializes object into JSON format using provided stream and optional encoding
(Defined by JSONExtensions.)
Back to Top
Fields

  NameDescription
Protected fieldm_AllAnalyzed
Protected fieldm_Tokens
Back to Top
Properties

  NameDescription
Public propertyAllAnalyzed
Returns true when the whole input source has been analyzed. This property is always true for lexers that do not support lazy analysis
Public propertyContext
Returns context that this processor operates under - an entity that retains state during analysis, such as: module compiler, project compiler, code unit translator etc. This entity may also contain compiler/parser/lexer options etc.
(Inherited from CommonCodeProcessor.)
Public propertyLanguage
Returns language that this processor is capable of processing
(Inherited from CommonCodeProcessor.)
Public propertyMessages
References message list that lexer emitts messages into. May be null
(Inherited from CommonCodeProcessor.)
Public propertySource
References source code text that was lexed
Public propertySourceCodeReference
References source code that is processed
(Inherited from SourceRefCommonCodeProcessor.)
Public propertyThrowErrors
When true, throws an exception on the first error even when MessageList is set. When MessageList is not set any lexing error is always thrown regardless of this parameter
(Inherited from CommonCodeProcessor.)
Public propertyTokens
Returns tokenized source as indexable list. Accessing this property causes lexical analysis to complete on the whole source if it has not been completed yet
Public propertyTokenStream
Enumerates Token stream - depending on implementation enumeration may do lexical analysis token-by-token or in chunks with every enumerator advance
Back to Top
Explicit Interface Implementations

  NameDescription
Explicit interface implemetationPrivate methodIEnumerable GetEnumerator
Back to Top
See Also