Eliminating a column if it has a null value
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hello,
Due to company policy I cannot post workflows or data. I have PDF of the workflow at the relevant point.
If you see a null in the column it's because it failed a criteria. I need to eliminate those columns. I originally tried to use Auto-field to reduce to the smallest data size and then eliminate those, but that only eliminated entities that didn't match a list. The two rows at the bottom may have information in them that makes the whole column INT16 or INT32.
I also thought about a filter but I can't have a filter that lists all columns because there are too many and they will also change in number.
Any help is appreciated.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
@AngelosPachis 2020.4 X64
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
The data cleansing tool will actually profile and remove any column/row that is entirely null if you check off the option.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
@echuong1 Will this work if there is data in the column, but it also has nulls?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
This will only remove a column that is entirely null.
For example, the below will have Field2 removed, but not Field3.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Nope @dogregory ,
If there is at least a single column that has a value for a particular record, then no columns will be removed for that record
I was asking about the version you are in so I can suggest using the Data Cleansing tool, because this feature was introduced in version 2020.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
@echuong1 oh well. I need it to remove a column if it has any nulls, but may still have data. Thanks for the assistance.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Can you give a better example of what you are after @dogregory so @echuong1 and I could help (or any other person in the community).
You are looking for a way to remove rows which are null for all your columns right? What's the reason that will make the data cleansing tool not to work in this instance?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
