My insert/select is completed but why don’t I see all of the documents yet?
In Rockset, we are only eventually consistent, so the insert select completing just tells you that we have accepted the data to be processed, not that it is queryable yet.
To further elaborate,
INSERT ... SELECT is only timing the query process and not the indexing process. The indexing process happens asynchronously and allows for an eventual consistency model. For large batch inserts like this, a shared VI has limited bandwidth on the ingestion process at 1MB/s. Larger VIs scale the index ingestion bandwidth.