Sample Data Extraction

Question

I have a file which has millions of records. If i wish to see only a sample of i I can use the Sample node under Preparation, but it reads the entire data and then gives an output.

What if i want to see the first 10000 records from the file without entire file being processed?

Is there a way to stop reading the data when it reaches the required limit?

Federica_FF · Accepted Answer

Are you using a Input tool?

Look at the first option of the Input tool configurations window: "Record limits". You can set a X number and read only the first X records.

jdunkerley79 · Accepted Answer

The Input Tool has the ability to limit the amount of records that are read in: