Encoding Error in R tool

Toshi92

I want to use R-tools for files in Japanese, encode is Shift-JIS.

I think I have to use encoding='cp932' parameter in R script.

But it doesn't work by my trials...

I attached my flow.

Would someone please check my workflow?

Thanks,

Toshi

EncodingError.yxzp

SydneyF

Hi @Toshi92

It looks like you have backslashes in your working directory path - R only accepts front slashes. Can you please try pasting following code into the R Tool in your workflow and let me know if it works for you?

#set wd to read from/write to
setwd("C:/Test/EncodingError_WorkAround")

# helper function to install R packages. source_location optional
install_package <- function(package_name, source_location = FALSE) {
	# grab the alteryx repo
	altx.repo <- getOption("repos")
	# set your primary repo if you haven't already
	altx.repo["CRAN"] <- "http://cran.rstudio.com"  
	options(repos = altx.repo)
	#check to see if the package we want is already installed
	# if it is, we will just load it, otherwise we will install it
	if(package_name %in% rownames(installed.packages())==FALSE){ 
		if(source_location==FALSE) {
			install.packages(package_name)
		} else {
			install.packages(source_location, repos = NULL, type = "source")
		}
	}
	require(package_name, character.only=TRUE)
}

# install readr
install_package("readr")

library(readr)

X <- as.matrix(read_csv("japanesetest.csv"), locale = locale(encoding = "UTF-8"))
X[is.na(X)] <- 0
n_rows <- nrow(X)
iota <- matrix(1, nrow = 1, ncol = n_rows)
XtX <- t(X) %*% X
Y <- iota %*% X

# Calculate the similarity or distance matrix
the_matrix <- XtX/(sqrt(t(Y) %*% Y))

the_matrix <- cbind(colnames(the_matrix), the_matrix)

colnames(the_matrix)[1] <- "rownames"

write_csv(as.data.frame(the_matrix), "outputtest.csv")

Thanks!