DataTypes represent mappings between the ResponseHeader 'Content-type:' and the type to be used by SQL for Full-text indexing. If you find that content you wish to crawl isn't being crawled, check the table 'DisallowedAbsoluteUris'. If you see 'Disallowed by unassigned DataType', add the DataType to table 'AllowedDataTypes'.
ArachnodeDAO Class | Arachnode.DataAccess Namespace