Import / Export large datasets with .net

Question

has experience in importing and exporting large collections (from the database in this case) with .net.

Using database export alone is not possible, since several database backends are supported, and I need this for my independent export / import on the platform.

The problem is that the XmlSerializer or DataContractSerializer classes fully read the data for deserialization, but since the data sets can be extremely large, this is not possible. Are there any solutions that rely on the existing serialization infrastructure but support iterative file reading?

thanks

Answer 1

Take a look at FileHelpers . I used this library in the past, and it read and checked (through the attributes attached to my members of the import class) about 25 thousand records in a couple of seconds.