Error in Append field

[sriniprad08]

Hi Team,

Hope you are doing well.

Can you please let me know what's the error is? Its in the append field which says have 16 more records,

Thanks,

[gawa · Accepted solution]

hi @sriniprad08 When you have more than 16 records at Source input anchor, you need to change configuration of Appendix Fields tool as below( select "Allow All Appends").

Appendix Fields operation is called Cross Join in SQL, that will generate all of combination of 2 data stream: Cross join of m records and n records will generate m x n records. If number of m and/or n is too large, it will generate uncountable records, that would slow down the performance and occupy unnecessary storage volume.(imagine what happens if cross join 10,000 records x 10,000 records)

[caltang · Accepted solution]

To illustrate @gawa 's point:

Usually works well when you have 1-to-many or many-to-1 so it can be tidy and matching accordingly. The moment that changes, you'll be in a world of pain to reconfigure or re-run... sometimes it can grow up to 10GB+ of effort/rows in your workflow, then your PC crashes lol. So do be careful!

[gawa]

@caltang Nice write up!