Bring your best ideas to the AI Use Case Contest! Enter to win 40 hours of expert engineering support and bring your vision to life using the powerful combination of Alteryx + AI. Learn more now, or go straight to the submission form.
Start Free Trial

Alteryx Designer Cloud Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Cloud.
SOLVED

Job when run in Spark Engine it fails with below error ERROR spark.Transformer: Transformer error: java.lang.RuntimeException: Expected only partition pruning predicates: upper(NUMBER_OF_MONTHS#19) IN (NOVEMBER 2018).toString()

Photon Job is successful

1 REPLY 1
Trifacta_Alumni
Alteryx Alumni (Retired)

Hello Vijay,

 

The error is due to Hive Partition columns are case-sensitive as in https://issues.apache.org/jira/browse/SPARK-19490, please change the column name (NUMBER_OF_MONTHS) to lower case and run the job again.

 

Thanks,

Pavan