SharePoint Input Record Limit

[BMaisel]

When I run the SharePoint Input for a list I got an error 'list object has no attribute columns'. The tool works for one list, but not the other. The one that does not work has 50K records. Is there a limit to this tool and if so is there a workaround?

[FláviaB]

Hi @BMaisel! Were you able to solve this? I came across this Knowledge Base article that may answer your question. And based on this thread, it seems like there is a limit of 5k records.  

Hope that helps!

Flávia

[jtmoll]

I've been able to overcome the limit by using a macro that uses the REST API, it basically batches the results per page then gives me one output.

[Gaurav_Dhama_]

You can setup a python code that will fetch this list for you. It has worked for me in past, and its fast enough when running on gallery.

[BMaisel]

Thanks @Gaurav_Dhama_  I tried doing python code, but couldn't get it to work. Do you have an example of code that worked for you to download from a SharePoint List.

[Gaurav_Dhama_]

Hi @BMaisel 

Recently Microsoft has changed the way you will authenticate to SharePoint, so my old code had to be updated.

I had to get the app registration done on Azure portal with Graph API permissions:

I used msal library to get authenticate and access SharePoint.

 app = msal.ConfidentialClientApplication(
        "your_client_id_goes_here", 
        authority = "authority_goes_here",
        "client_secret_goes_here"
    )

result = app.acquire_token_for_client(scopes="https://graph.microsoft.com/.default")

then below URL gets the items inside the SP List

https://graph.microsoft.com/v1.0/sites/{site_id}/lists/{list_id}/items

[aatalai]

@BMaisel have you tried to download the data and use the green input tool to read the data? See this article, it should help