http://www.codeproject.com/Articles/543789/How-to-parse-chunk-by-chunk-a... to parse chunk by chunk a large CSV file and bulk insert to a database - CodeProject
How to parse chunk by chunk a large CSV file and bulk insert to a database - CodeProject
In this article I will demonstrate how to read a large csv file chunk by chunk (line basis) and populate DataTable object and bulk insert to database.; Author: S. M. Ahasan Habib; Updated: 11 Feb 2013; Section: String handling; Chapter: General Programming; Updated: 11 Feb 2013

tarek.jubaer's picture

in case of MS SQL, i think DTS is the best way to handle large CSV file. Simple and very very fast.

habib's picture

if you use dts then you can not chunk wise read. So if multiple user do the same operation then memory will be overflow. We faced that problem. Another things is validation problem, if you want to though custom exception message based on that file then it is not possible. But in custom code you can do it.

Add new comment

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.