2022-09-29 17:25:19,342 - root - INFO - INFO: Starting CloudMLPredict tool with AMP Provider. 2022-09-29 17:25:23,229 - ayx_python_sdk.providers.amp_provider.amp_driver - INFO - Loaded and init user plugin 2022-09-29 17:25:42,299 - CloudMLPredict.0 - ERROR - Error occurred on Alteryx Machine Learning: 2022-09-29 20:25:37,963 (9/MainThread) newrelic.core.agent INFO - New Relic Python Agent (8.0.0.179) 2022-09-29 20:25:37,962 INFO tempojobs.cli.utils - Running pipeline-predict 2022-09-29 20:25:37,965 INFO tempojobs.cli.utils - run_sync run() 2022-09-29 20:25:37,974 INFO /opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/config.py - Config : {"jobId": "68f102d8-429a-4f9d-a855-6df5086a310c", "inputs": {"json": [{"data": {}, "type": "json"}], "pipeline": [{"id": "4101f4de-1f7d-40a4-9925-dcf4125d0ea2", "url": "file:///opt/docker/4101f4de-1f7d-40a4-9925-dcf4125d0ea2", "contentLength": 896023, "displayName": "pipeline_8", "contentType": "application/octet-stream", "source": {"type": "memory"}, "type": "asset"}], "parameters": [{"id": "d82a7d6b-7f2c-4cef-9601-ba6138594816", "url": "file:///opt/docker/d82a7d6b-7f2c-4cef-9601-ba6138594816", "contentLength": 3861, "displayName": "featureEngineeringParameters", "contentType": "application/json", "source": {"type": "memory"}, "type": "asset"}], "features": [{"id": "0f5f697f-9245-4cea-886b-8dbbcd841b20", "url": "file:///opt/docker/0f5f697f-9245-4cea-886b-8dbbcd841b20", "contentLength": 20705, "displayName": "entitysetFeatures", "contentType": "application/json", "source": {"type": "memory"}, "type": "asset"}], "data": [{"data": {"displayName": "temp-file-631042aa-6913-40d8-9ed2-b7e52e99e126.csv", "createdById": "4002da9a-ea3f-45e9-9522-3ad57c4296ab", "data": {"inputAssetId": "4b311663-de5e-45b9-bb5b-4fcc5837224a", "contentAssetId": "d0fa6b08-f0ea-47ed-840b-ab6b616025c6"}, "sourceName": "temp-file-631042aa-6913-40d8-9ed2-b7e52e99e126.csv", "version": 1, "ownerId": "4002da9a-ea3f-45e9-9522-3ad57c4296ab", "id": "55162dad-6c6e-4de8-b94a-3cf5e27cd893", "meta": {"count": 100, "projectId": "d0010cba-c9c7-46a9-b4ad-4837e5bc49a0"}, "schema": {"fields": [{"displayName": "gender", "physicalType": "string", "tags": [], "internalName": "f_0", "sourceName": "gender", "parserName": "categoricalParser", "ordinal": 0, "logicalType": "categorical", "id": "a1a92d4a-6ee8-4bdd-9451-5427c0646902", "meta": {}}, {"displayName": "SeniorCitizen", "physicalType": "string", "tags": [], "internalName": "f_1", "sourceName": "SeniorCitizen", "parserName": "categoricalParser", "ordinal": 1, "logicalType": "categorical", "id": "ae85559b-0781-47aa-ba5d-d83807abdc09", "meta": {}}, {"displayName": "Partner", "physicalType": "string", "tags": [], "internalName": "f_2", "sourceName": "Partner", "parserName": "categoricalParser", "ordinal": 2, "logicalType": "categorical", "id": "28bce881-1f06-473b-b802-edaebf1a4c8c", "meta": {}}, {"displayName": "Dependents", "physicalType": "string", "tags": [], "internalName": "f_3", "sourceName": "Dependents", "parserName": "categoricalParser", "ordinal": 3, "logicalType": "categorical", "id": "9a7aefa5-aea5-4382-8262-9bcd8036cb8c", "meta": {}}, {"displayName": "tenure", "physicalType": "long", "tags": [], "internalName": "f_4", "sourceName": "tenure", "parserName": "integerParser", "ordinal": 4, "logicalType": "integer", "id": "b4f5897b-db3e-4358-b658-feac03dab1e0", "meta": {}}, {"displayName": "PhoneService", "physicalType": "string", "tags": [], "internalName": "f_5", "sourceName": "PhoneService", "parserName": "categoricalParser", "ordinal": 5, "logicalType": "categorical", "id": "e21d5c20-cea8-4336-94fe-c0a3574a49c9", "meta": {}}, {"displayName": "MultipleLines", "physicalType": "string", "tags": [], "internalName": "f_6", "sourceName": "MultipleLines", "parserName": "categoricalParser", "ordinal": 6, "logicalType": "categorical", "id": "e3bcfa19-3227-4488-8ca0-810a8560583f", "meta": {}}, {"displayName": "InternetService", "physicalType": "string", "tags": [], "internalName": "f_7", "sourceName": "InternetService", "parserName": "categoricalParser", "ordinal": 7, "logicalType": "categorical", "id": "f25a1e3d-5156-4770-88be-b0745e3a4c9a", "meta": {}}, {"displayName": "OnlineSecurity", "physicalType": "string", "tags": [], "internalName": "f_8", "sourceName": "OnlineSecurity", "parserName": "categoricalParser", "ordinal": 8, "logicalType": "categorical", "id": "ee21354c-86ca-4965-b065-187efbd39c43", "meta": {}}, {"displayName": "OnlineBackup", "physicalType": "string", "tags": [], "internalName": "f_9", "sourceName": "OnlineBackup", "parserName": "categoricalParser", "ordinal": 9, "logicalType": "categorical", "id": "3e720d3e-9344-4591-9c5f-e1db4aa488be", "meta": {}}, {"displayName": "DeviceProtection", "physicalType": "string", "tags": [], "internalName": "f_10", "sourceName": "DeviceProtection", "parserName": "categoricalParser", "ordinal": 10, "logicalType": "categorical", "id": "dcdcc6cf-2408-4154-abc6-bb72adf38416", "meta": {}}, {"displayName": "TechSupport", "physicalType": "string", "tags": [], "internalName": "f_11", "sourceName": "TechSupport", "parserName": "categoricalParser", "ordinal": 11, "logicalType": "categorical", "id": "d4b18fde-6d22-41f3-9cf8-ff6666094fdc", "meta": {}}, {"displayName": "StreamingTV", "physicalType": "string", "tags": [], "internalName": "f_12", "sourceName": "StreamingTV", "parserName": "categoricalParser", "ordinal": 12, "logicalType": "categorical", "id": "63767f96-691d-436a-8645-1f63da02505d", "meta": {}}, {"displayName": "StreamingMovies", "physicalType": "string", "tags": [], "internalName": "f_13", "sourceName": "StreamingMovies", "parserName": "categoricalParser", "ordinal": 13, "logicalType": "categorical", "id": "87e558ae-d790-4aed-a4d3-b552c46546cc", "meta": {}}, {"displayName": "Contract", "physicalType": "string", "tags": [], "internalName": "f_14", "sourceName": "Contract", "parserName": "categoricalParser", "ordinal": 14, "logicalType": "categorical", "id": "d4cccd50-27e7-4745-b044-b8558af4cd07", "meta": {}}, {"displayName": "PaperlessBilling", "physicalType": "string", "tags": [], "internalName": "f_15", "sourceName": "PaperlessBilling", "parserName": "categoricalParser", "ordinal": 15, "logicalType": "categorical", "id": "f1f4421e-f0c8-4816-98f8-6834dcf598f7", "meta": {}}, {"displayName": "PaymentMethod", "physicalType": "string", "tags": [], "internalName": "f_16", "sourceName": "PaymentMethod", "parserName": "categoricalParser", "ordinal": 16, "logicalType": "categorical", "id": "cc470bf8-a226-4ffe-b86d-6c4421a8c4a3", "meta": {}}, {"displayName": "MonthlyCharges", "physicalType": "double", "tags": [], "internalName": "f_17", "sourceName": "MonthlyCharges", "parserName": "doubleParser", "ordinal": 17, "logicalType": "double", "id": "eedb3216-1fcb-4afc-9dca-b2a507bf6635", "meta": {}}, {"displayName": "TotalCharges", "physicalType": "double", "tags": [], "internalName": "f_18", "sourceName": "TotalCharges", "parserName": "doubleParser", "ordinal": 18, "logicalType": "double", "id": "42fde2dd-47d9-434b-ab48-07b43e12af54", "meta": {}}]}, "dateCreated": "2022-09-29T20:25:28.123831Z", "isDeleted": false, "kindVersion": "1.0.0", "siteId": "aaec4472-bd74-79d0-05ce-89903ab58856", "kind": "datatable", "dateUpdated": "2022-09-29T20:25:30.735014Z", "type": "datatable"}, "type": "json"}, {"id": "d0fa6b08-f0ea-47ed-840b-ab6b616025c6", "url": "file:///opt/docker/d0fa6b08-f0ea-47ed-840b-ab6b616025c6", "contentLength": 7800, "displayName": "data", "contentType": "application/parquet", "source": {"type": "memory"}, "meta": {"stat": {"count": 100}}, "type": "asset"}]}, "general": {"defaultDataFormat": "parquet", "defaultParseFailureBehavior": {"name": "error"}, "dirCleanup": true, "profiling": false, "maxJobCompletionResends": 60}, "resources": {"requests": {"mem": {"byteCount": 12000000000, "src": "12G"}, "cpu": {"fractionalCpu": 1.0, "src": "1"}}, "limits": {"mem": {"byteCount": 16000000000, "src": "16G"}, "cpu": {"fractionalCpu": 4.0, "src": "4"}}}, "meta": {"site": "ayx-platform", "siteId": "aaec4472-bd74-79d0-05ce-89903ab58856", "arguments": {"concat": {"value": false}}}, "messaging": {"url": "http://100.127.205.234:8081/v1/exec/68f102d8-429a-4f9d-a855-6df5086a310c/messaging"}, "tracing": {"enabled": false, "serviceName": "ps-server/com.alteryx.tempojobs/1.38.0", "reporterQueueCapacity": 1000, "localAgent": {"reportingHost": "all-in-one-agent.jaeger.svc.cluster.local", "reportingPort": 5775}, "logging": false, "sampler": {"type": "const", "param": 1}}, "trace": {}} 2022-09-29 20:25:37,974 INFO jaeger_tracing - Initializing Jaeger Tracer with UDP reporter 2022-09-29 20:25:37,975 INFO jaeger_tracing - Using sampler ConstSampler(True) 2022-09-29 20:25:37,975 INFO jaeger_tracing - opentracing.tracer initialized to [app_name=ps-server/com.alteryx.tempojobs/1.38.0] 2022-09-29 20:25:37,976 INFO /opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/utils/tracing.py - initializing tracing context 2022-09-29 20:25:38,239 INFO /opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/automl/predict.py - input_data columns before conversion = ['f_0', 'f_1', 'f_2', 'f_3', 'f_4', 'f_5', 'f_6', 'f_7', 'f_8', 'f_9', 'f_10', 'f_11', 'f_12', 'f_13', 'f_14', 'f_15', 'f_16', 'f_17', 'f_18'] 2022-09-29 20:25:38,239 INFO /opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/automl/predict.py - target_internal_name = f_20 2022-09-29 20:25:38,239 INFO /opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/automl/predict.py - use_input_internal_col_names = False 2022-09-29 20:25:38,239 INFO /opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/automl/utils.py - f_0 is not present in your training data. You may need to rerun the modeling process before making new predictions 2022-09-29 20:25:38,240 INFO /opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/automl/predict.py - expecting columns = ['f_1', 'f_2', 'f_3', 'f_4', 'f_5', 'f_6', 'f_7', 'f_8', 'f_9', 'f_10', 'f_11', 'f_12', 'f_13', 'f_14', 'f_15', 'f_16', 'f_17', 'f_18', 'f_19'] 2022-09-29 20:25:38,240 INFO /opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/utils/write_utils.py - Writing JSON to /opt/docker/output/manifest.json 2022-09-29 20:25:38,264 INFO /opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/utils/tracing.py - closing tracing context 2022-09-29 20:25:38,269 INFO jaeger_tracing - Span publisher exited 2022-09-29 20:25:38,269 INFO /opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/utils/tracing.py - Tracer shutdown time: 0.004920005798339844 2022-09-29 20:25:38,269 ERROR tempojobs.cli.utils - Fatal error in pipeline-predict job Traceback (most recent call last): File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/cli/utils.py", line 127, in wrapper io_loop.run_sync( File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tornado/ioloop.py", line 530, in run_sync return future_cell[0].result() File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/cli/utils.py", line 80, in run returned = function(config, output) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/cli/commands/pipeline_predict.py", line 36, in pipeline_predict return _pipeline_predict(config, output) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/cli/commands/pipeline_predict.py", line 101, in _pipeline_predict scored_data, internal_to_display_predictions = predict( File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/automl/predict.py", line 165, in predict input_df.columns = columns File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/pandas/core/generic.py", line 5596, in __setattr__ return object.__setattr__(self, name, value) File "pandas/_libs/properties.pyx", line 70, in pandas._libs.properties.AxisProperty.__set__ File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/pandas/core/generic.py", line 769, in _set_axis self._mgr.set_axis(axis, labels) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/pandas/core/internals/managers.py", line 214, in set_axis self._validate_set_axis(axis, new_labels) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/pandas/core/internals/base.py", line 69, in _validate_set_axis raise ValueError( ValueError: Length mismatch: Expected axis has 18 elements, new values have 19 elements Traceback (most recent call last): File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/runpy.py", line 87, in _run_code exec(code, run_globals) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/__main__.py", line 66, in cli() File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/click/core.py", line 1128, in __call__ return self.main(*args, **kwargs) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/click/core.py", line 1053, in main rv = self.invoke(ctx) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/click/core.py", line 1659, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/click/core.py", line 1395, in invoke return ctx.invoke(self.callback, **ctx.params) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/click/core.py", line 754, in invoke return __callback(*args, **kwargs) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/cli/utils.py", line 127, in wrapper io_loop.run_sync( File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tornado/ioloop.py", line 530, in run_sync return future_cell[0].result() File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/cli/utils.py", line 80, in run returned = function(config, output) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/cli/commands/pipeline_predict.py", line 36, in pipeline_predict return _pipeline_predict(config, output) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/cli/commands/pipeline_predict.py", line 101, in _pipeline_predict scored_data, internal_to_display_predictions = predict( File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/tempojobs/automl/predict.py", line 165, in predict input_df.columns = columns File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/pandas/core/generic.py", line 5596, in __setattr__ return object.__setattr__(self, name, value) File "pandas/_libs/properties.pyx", line 70, in pandas._libs.properties.AxisProperty.__set__ File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/pandas/core/generic.py", line 769, in _set_axis self._mgr.set_axis(axis, labels) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/pandas/core/internals/managers.py", line 214, in set_axis self._validate_set_axis(axis, new_labels) File "/opt/docker/environments/venv_featuretools/env/lib/python3.8/site-packages/pandas/core/internals/base.py", line 69, in _validate_set_axis raise ValueError( ValueError: Length mismatch: Expected axis has 18 elements, new values have 19 elements 2022-09-29 20:25:38,272 (9/MainThread) newrelic.core.agent INFO - New Relic Python Agent Shutdown PYTHON_PATH=/opt/docker/environments/venv_featuretools/env/bin/python TIME_PATH=/usr/bin/time JQ_PATH=jq Found resource usage output: ./output/resources.json {"command": "/opt/docker/environments/venv_featuretools/env/bin/newrelic-admin run-program /opt/docker/environments/venv_featuretools/env/bin/python -m tempojobs pipeline-predict", "real": 4.81, "sys": 0.97, "user": 4.46, "cpu": 112, "mem": 434548, "exit": 1} Found job output manifest: ./output/manifest.json Adding ./output/resources.json to ./output/manifest.json as an asset Generating resources asset (id=c28a6ce3-7ddb-4cce-a31d-49f5670b806d) [ { "contentType": "application/json", "displayName": "resources", "id": "c28a6ce3-7ddb-4cce-a31d-49f5670b806d", "meta": { "raw": { "command": "/opt/docker/environments/venv_featuretools/env/bin/newrelic-admin run-program /opt/docker/environments/venv_featuretools/env/bin/python -m tempojobs pipeline-predict", "real": 4.81, "sys": 0.97, "user": 4.46, "cpu": 112, "mem": 434548, "exit": 1 } }, "type": "asset", "url": "file:///opt/docker/output/resources.json" } ] 2022-09-29 17:25:42,516 - CloudMLPredict.0 - ERROR - Unexpected error occurred on Alteryx Machine Learning, please see log file: C:\Users\ferna\AppData\Local\Alteryx\Log\PythonSDK.log