Large Data Volumes (LDV) and Skuid

We are increasingly working with customers that have VLDV  (Very large data volumes).  So we are building a set of anectdotal best practices.  However, we do need to formalize these and document them in a number of venues…  Thanks for the encouragement.  Consider the challenge accepted. 

Bump.

Hi Irvin,

Quick clarifying question.  Are you talking about using Skuid in orgs that have millions of rows, but only pulling up a few records at a time, or are you talking about actually pulling in large data volumes (say 100,000 rows) directly into a Skuid model in one particular instance of a page.  Or both.

Or using aggregate models.

Hi Ben,

Pulling 100K rows into the client is probably not a good idea. 🙂

I am thinking it would nice to understand what sort of VLDV testing Skuid performs, maybe share your metrics, and of course publish best practices. 

Does Skuid have customers with VLDV?  Perhaps a case study or two could be shared.

BTW I think in terms of millions of rows not just 100K rows.

Thanks,
Irvin

Ok, that makes sense.  

Skuid does have VLDV customers, but Skuid software isn’t really what deals with those issues.  For the most part, Skuid just generates SOQL queries, sends them to the Salesforce SOQL black box, and gets a response.  So in essence our VLDV best practices would be exactly the same as Salesforce’s VLDV best practices.  (Use indexed fieids when you can, don’t do contains searches on large objects, make your queries selective, etc.)  In the past few releases we’ve added some features to help VLDV customers in certain instances.  Allowing SOSL on searches, allowing you to pick which fields are used in table and reference searches, and deferring filter execution until the user clicks the “Apply” button are three of those features.

I do agree however that we should have some kind of document that describes this.  (Even if it is quite similar to the SOQL best practices)

Thanks for the response.  I ask that you keep in mind that when selling Skuid these questions will come up (certainly if the party is informed and probably been burned in the past with very large objects and governor limits).  Any guidance, talking points and anecdotal evidence is appreciated.