[Core] Buffering Response on Larger Datasets

[vibhatha]

We need to come up with a buffering mechanism where if the table is too big, the data must be sent in some kind of a paginated way.
Users can pass limits but if it is not passed, it must be automatically paginated.

Look into an efficient approach for this.