Best method to retrieve millions of records using LINQ?

Question

Could you please explain what are the best methods to retrieve millions of recors from sqlserver using linq?

Shahriar Nikkhah · Answer

You mentioned the words "getting" "Millions"... To me you need a " Incremental load mechanism " you need to ... Study/understand your source table and manlys it data patern Find a field or fields that can play a role of a point in time One field example: a field with identity Multiple fields example: CreateDate, ModifyDate Use that field as an incremental loading process save you last record load from the above field for the next load so you won't have to do a reload of millions of record. Good luck

Ramesh Palanivel · Answer

Instead of Passing all the records, Pass graph values only,like Name : "Admins" ,count : 12 Name : "Super Admin", count :13 If you are trying to get millions of records from linq, definetly it will get more time, Still if you want to get all records, Please go with below methods, 1. Stored Procedure to get all the records, 2. Use Dapper which faster the entity framework, 3. Send only graph required values

Sasi Rekha · Answer

Hi, Generating graph using retrieved values

Ramesh Palanivel · Answer

After retrieving what you are doing with that records? Depends on that I can provide the solution.

Sasi Rekha · Answer

not showing try to retrieve the records

Ramesh Palanivel · Answer

Are you showing records on Page? or Downloading records?

Sasi Rekha · Answer

hi, not related to paging ,its related to performance issue

Ramesh Palanivel · Answer

Hi Sasi Rekha, The Best method is, Showing 10 records per the page. when you navigation get next 10 records. To know more about , please visit the below link https://www.c-sharpcorner.com/article/using-datatables-grid-with-asp-net-mvc/

Best method to retrieve millions of records using LINQ?

Answers (8)