SharePoint List Throttling Issue in JSOM- Check Your CAML

Where

_lastReply is the id of the latest comment being posted on the news article.

_discussionTopic.get_item('ID') gives us the id of the discussion topic corresponding to the current news article. (Note that a separate site collection holds discussion board list that contain the comments for news pages in specific news site.)

Our analysis revealed that _lastReply variable was undefined for some reason for the first page load and it was working well when we tried to post two or more comments in the same browser session. And when we assigned a value to it in the debug mode during the first load (IE + F12 - you know it ), it worked well.

Challenge

So, the challenge was what would be the right value for this variable? After so much thinking , I concluded that the value for this variable has to be the Id of the discussion topic for the current news page. There is a specific reason for this: our code created a new discussion topic when a user first commented on the page and all the comments were added as a discussion item under this discussion topic in the corresponding discussion board.

Solution

Our solution was based on our architecture itself. Comments for each news page were stored under a separate discussion topic for the page. So if the page had only one comment for example, the design is such that the JavaScript would create a discussion topic and the comment itself where the discussion topic would be created first and then the actual comment would be added as a discussion item in the corresponding discussion board. Since both the discussion topic and the message are the items in the same list (they ave their own content types Discussion and Message respectively), discussion topic would always have a smaller Id than all the discussion items under it.

This was it! we capitalized on this and designed a solution for the issue.

We changed the query to the following:

We needed an additional variable, named as _controlVariable to be used in query, this variable actually helped us to keep the number of items below the list threshold limit. Additionally, we also limited the results to only return the items with Message content type.
This worked like a charm! Another option would be to use set_folderServerRelativeUrl method of the query object, we would discuss about that in a separate post.

Conclusion

Always use <RowLimit> in CAML and look for clues in your implementation that would help you device some logic like we did with _controlVariable.