Calgary Questions

Question

Experts!

I made a Calgary database from a .yxdb file, about 35M records.  I made only one index on a varchar value (member_id).

Now when I go to query this database with a list of 2K member_ids, it takes forever.  If I query 50 member ids or less the response time is acceptable but anything beyond that basically doesn't work.

When I say "query" I mean via using a Calgary join with an input file.

What am I missing here?

Thanks!

KGT · Answer

Is your Member_id field unique or close to? The index will allow searchability in a faster fashion due to being able to locate the records faster, but if the field is almost unique, then I'm not entirely sure how much faster it would be.

I would compare against yxdb with Join and see how much time is saved, if the calgary takes longer, then there is probably something that can be done, but if it's still quicker than the yxdb on this type of query, then there might not be anything left to speed it up but a member category index for instance might be faster.