Append latest data in target using date field in source

[Agarwal_Yash91]

Hi,

I am trying to append latest data basis latest date in source table.

For ex: Max(date) in source: 10/12/2020

Max(date) in target:11/12/2020.

first i want to check max date in both tables and if max date in source is greater than max date in target then append latest date data in target table.

[grazitti_sapna]

Hi @Agarwal_Yash91 , do you have sample data in order to achieve this?

Other way around can be filtering the data on the basis of date and then append it to the existing table.

Thanks.

[Agarwal_Yash91]

Sample Data

Date	Amount
9/12/2020	6
9/12/2020	7
9/12/2020	10
9/12/2020	11
9/12/2020	15
10/12/2020	20
10/12/2020	25
10/12/2020	30
10/12/2020	40
10/12/2020	50

Target

Target
Date	Amount
9/12/2020	6
9/12/2020	7
9/12/2020	10
9/12/2020	11
9/12/2020	15

I want to insert data for 10/12/2020 in my target table. 

[Qiu]

@Agarwal_Yash91 
Is something like this?

[grazitti_sapna]

Hi @Agarwal_Yash91 , give this workflow a try.

I have tested some scenarios where data is input after a day and other is after few days it is working for me. Kindly test and let me know if you need anything else from my side.

Also, if this helps kindly mark this post as solution.

Thanks.

[Agarwal_Yash91]

Hi @Qiu ,

i am looking for something like this but using INdb operations as my source and target are database tables and we dont have join by position and append fields tool available for in-DB operations

[Agarwal_Yash91]

@grazitti_sapna i am looking for inDB opoerations and we dont have append fields tool available for in-DB operations.

[AngelosPachis]

Hi @Agarwal_Yash91 ,

There are those two tools in the In-Database category that allow you to stream from/to an In-DB stream to a standard workflow

So you can use a "Data Sream Out" to convert your In-DB stream to a standard workflow stream, make the data prep proposed by @Qiu or @grazitti_sapna and then convert it back to an In-DB form.

Hope that will help you overcome that In-DB/standard workflow barrier.

Cheers,

Angelos

[Qiu]

@Agarwal_Yash91 
Sorry did not fully understand your question.

Hope someelse can help you out.😁

[Agarwal_Yash91]

@Qiu @grazitti_sapna before appending data i want to compare dates between source and target and dates which are not present in source we should read only those.