Questions from AB testing Udacity free course

Question

Hi

I was studying AB testing Udacity free course. Below is the course link. (You will need an account to see the course.)

https://classroom.udacity.com/courses/ud979

I recreated the workflow for lesson "Matched Pair Practice".

I have two questions:

1. Why is 68 weeks used in the model? I saw question 3 from concept 8 of this lesson uses 64 weeks, which is consistent with the Alteryx instructions:  https://help.alteryx.com/2018.3/AB_Trend.htm

" In the case of performance measures that are reported on a weekly basis, our rule of thumb is to use 12 weeks."

52 weeks + 12 weeks=64 weeks

2. I encountered the following error. Where did I go wrong?

Attached is the workflows for your reference. Thank you very much for your help.

Happy new year!

Alteryx AB testing.zip

Gualigee · Answer

regarding the 68 weeks question,

I found the side notes in the course:

Note: It does say in the video 1 year plus a minimum of 6 periods, but if you look at the AB Trends tool documentation it indicates the rule of thumb is actually 12 periods (in addition to the year) if you are measuring weekly. Keep this in mind as we move forwards.

If the course uses the minimum of 6 periods, we should use 52+6=58 weeks, why did the they use 68 weeks?

Gualigee · Answer

https://community.alteryx.com/t5/Alteryx-Designer-Discussions/Browse-tool-error-AB-aTesting/m-p/603904?lightbox-message-images-576098=114602i5428EFFDD22DB52C#M135149

I found the solution to interactive report issue. My firm's Alteryx is not the most updated one!

It's so fun to play with myself.

Gualigee · Answer

I checked with the instruction in the course again.

I found I used "does not contain" instead of "does not equal" in the filter tools of the second workflow.

After I changed it back to "does not equal", the error messages disappeared.

I don't know why this change can fix the issue, but it solved one issue anyway.

The new question is why there is no information in the interactive output.

The interactive output is where I can make recommendations.

Thanks