Advent of Code is now back for a limited time only! Complete as many challenges as you can to earn those badges you may have missed in December. Learn more about how to participate here!
community Alteryx IO MyAlteryx
alteryx Community
Search
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Close
Start Free Trial

Alteryx Machine Learning Discussions

Find answers, ask questions, and share expertise about Alteryx Machine Learning.
Getting Started

Start your learning journey with Alteryx Machine Learning Interactive Lessons

Go to Lessons

Big Data Files

BlueJean
5 - Atom
‎06-06-2023 02:40 PM

In my first DS project. Newbie for sure.

 

I have two datasets with over a million points each. Can anyone tell me if there is a way to convert or compress those .csv files so that they run more smoothly in Python? Any help would be greatly appreciated. 

 

Thanks in advance. 

Labels:
Reply
0 Likes
1 REPLY 1
acarter881
12 - Quasar
‎06-23-2023 09:56 AM

Hello, @BlueJean.

 

Are you reading the files into Alteryx? Is it slow? If so, have you tried caching the Input Data tools? This will convert those to a temporary yxdb so the workflow run time will be significantly reduced.

 

Attached are a few other suggestions related to Python.

Preview file
77 KB
Preview file
34 KB
Reply
0 Likes
Christmas in July Blog
Alteryx Auto Insights Community Live