You are viewing a single comment's thread:
I ran into this same problem with Hive Engine Tools and now Hive Analytics.
The easy solution is fetch by ID then use last id rather than offset pagination.
Right now Hive Analytics just uses offset, but when I refactor it, it will pull entire list then use server side sorting from cache.
Thanks for mentioning this method. It sped up the smaller tokens tremendously and moderately improved the mid-sized queries, the large token counts still take a long time, but it is substantially better.
Thanks, I'll probably implement that until if/when that pr goes through.
Right now Hive Analytics just does offset and gets the top 500 by balance, but if you sort by staked, it will only sort among those 500 user which are not the top 500 staked. This will be resolved later as the main point was for balance rich list.
View more