Google Drive Input - Record limit?

Question

I'm using a Google Drive Input tool (version 1.3.4) to pull in a map from a g-sheet that has about 15K records across 10 columns.  For some reason it's only pulling in 13,926 records.  I have looked at the g-sheet and there's no blanks, and nothing significant about the 13,926 record.  I've also re-sorted and it still stops that that record. I've also tried adding in a # of records to retrieve, and still no luck.

Is there a limit to how much data g-drive connection can handle?  Is there any other way around this?

ccanterman · Answer

I ran into this awhile ago with xlsx files. What was weird was that the limit varied, so your file stopped at 13,296 but mine stopped at 16,234 (picking a number) and a different file of mine stopped at 9,123. I thought they fixed it (and I don't have access to that Case anymore)

As @apathetichell said, try #4 and see if you run into the same issue. Do you run into this issue with other large GSheets?

What I had to do as a workaround was, in the GDrive Tool, I selected "download locally" or "download for later processing" in the bottom left of the GDrive Config window (I don't have it installed on this machine so I can't tell you the exact wording). This creates a copy in the Temp folder. Then the GDrive Tool was fine reading in the file, from the local download while I waited for the fix. I'm not sure if this will work with a .GSheet

This is different than testing behavior with the downloaded GSheet -> xlsx file that was suggested above.

apathetichell · Answer

Hey ---> so a few questions ---> 1) can you share a gsheet publicly with the information in row 13927. 2) what version of gdrive/alteryx are you using. 3) can you confirm you are bringing in the data exactly one time? 4) what happens if you download the file first as an excel file via the gdrive tool --> and then try to bring in the data.

so there is a single call to gsheets api limit of 200,000 cells. You could be hitting that. I'd hope that Alteryx had implemented logic to work around that.