JR's R code from a friend

[Lasagna and tears of failure]

there is a better way of doing the above with an array and a loop, but still figuring out R syntax

[Deleted]

Oct 29, 2020 14:53:12 GMT -8 Lasagna and tears of failure said:

to run it first you have to install R
all of this is on Windows, anything else, if you cant find it let me know and I'll find the links for you

mirror.las.iastate.edu/CRAN/

(download hyper mirror.las.iastate.edu/CRAN/bin/windows/base/R-4.0.3-win.exe )

once you install that open it and install the vrest package, choose "install package"




you will get a HUGE list scroll down and double click on it


Download and install R Studio


rstudio.com/products/rstudio/download/#download

open it and past this code and hit enter



rm(list=ls())
options(stringsAsFactors = FALSE)
options(digits=3)
library('rvest')

path <- "https://bballsim2020.com/"

# ADD YEAR PLUS / FOR PAST SEASONS

teams <- c("Celtics", "Heat", "Nets", "Knicks", "Magic", "76ers", "Wizards",
"Hawks", "Hornets", "Bulls", "Cavaliers", "Pistons", "Pacers",
"Bucks", "Raptors", "Mavericks", "Nuggets", "Rockets",
"Timberwolves", "Spurs", "Jazz", "Grizzlies", "Warriors",
"Clippers", "Lakers", "Suns", "Trail Blazers", "Kings",
"SuperSonics")

colMax <- function(data) sapply(data, max, na.rm = TRUE)

get_player_stats <- function(player, team, start=1, end=200, per36=F){

stats <- c()

for(i in 1:length(team)){
index <- which(team[i] == teams)
url <- paste(path, "/rosters/roster", index, "sched.htm", sep="")
webpage <- read_html(url)
links <- html_attr(html_nodes(webpage, "a"), "href")
links <- links[10:(length(links)-1)]

for(j in 1:length(links)){
url <- paste(path, substr(links[j], 3, nchar(links[j])), sep="")
day <- as.numeric(substr(url, gregexpr("boxes/", url)[[1]][1]+6, gregexpr("-", url)[[1]][1]-1))

if(day >= start & day <= end){
full_box <- html_table(read_html(url), header=TRUE, fill=TRUE)

if(colnames(full_box[[2]])[1] == team[i]){
my_team_index <- 2
opp_team_index <- 3
} else{
my_team_index <- 3
opp_team_index <- 2
}

box <- full_box[[my_team_index]]
box_team <- box[1:(nrow(box)-2), 1:(ncol(box)-1)]
box_team[,3:16] <- lapply(box_team[,3:16], as.numeric)
colnames(box_team)[6:7] <- c("X3P", "X3PA")
if(colnames(box_team)[1] == team[i]){
index <- which(box_team[,1] == player)
if(length(index) > 0){
colnames(box_team)[1] <- "Team"
stats <- rbind(stats, box_team[index,])
}
}
}
}
}

if(is.null(stats)){
cat("No stats found.\n")
} else if(nrow(stats) == 0){
cat("No stats found.\n")
} else{

stats <- cbind.data.frame(GM=nrow(stats), stats[, 3:16])

cat("AVERAGES\n")
averages <- colMeans(stats)

print(round(averages, digits=1))

if(per36 == TRUE){
cat("\nPER 36\n")
constant <- (36 / averages[2])
for(i in 2:length(averages)){
averages[i] <- constant * averages[i]
}
print(round(averages, digits=1))
}

cat("\nPERCENTAGES\n")
print(c(sum(stats$FG) / sum(stats$FGA), sum(stats$X3P) / sum(stats$X3PA),
sum(stats$FT) / sum(stats$FTA)))
}
}

get_team_stats <- function(team){
for(i in 1:length(team)){
cat(team[i])
cat("\n")
get_player_stats(team[i], deparse(substitute(team)), start = 1)
cat("\n")
}
}then


paste this at the ">"


get_player_stats("LeBron James", "Jazz", start = 36, end = 45)
substitute player name and team, with day numbers for start and end.  in my testing much over 10 days times out because web pages close connections over a certain amount of time. 

what is this for?

[Lasagna and tears of failure]

@cmart

it allows you to scrape the box scores for a set of day that you determine to see how players do

[Go Niners]

I have mac

[Lasagna and tears of failure]

Dec 19, 2020 19:54:35 GMT -8 Go Niners said:

I have mac

R for iOS

cran.r-project.org/bin/macosx/


R studio for iOS

download1.rstudio.org/desktop/macos/RStudio-1.3.1093.dmg

[Go Niners]

Which one better?

[Lasagna and tears of failure]

@sargo iOS links above

[Go Niners]

Oh I gotta download both

[Go Niners]

Dec 19, 2020 21:13:03 GMT -8 Lasagna and tears of failure said:

@sargo iOS links above

iOS?!

the original michael

[Lasagna and tears of failure]

Dec 19, 2020 21:12:56 GMT -8 Go Niners said:

Which one better?

you need both, you have to install "R" for "R studio" to work

[Go Niners]

You mean OS X right?

[Go Niners]

Imagine trying to do this on iPhone

[Go Niners]

Guess iPad makes sense

[Go Niners]

I need to do it tho

[Lasagna and tears of failure]

Dec 19, 2020 21:13:52 GMT -8 Go Niners said:

You mean OS X right?

yes 

[Go Niners]

Dec 19, 2020 21:15:21 GMT -8 Lasagna and tears of failure said:

Dec 19, 2020 21:13:52 GMT -8 Go Niners said:

You mean OS X right?

yes 

PERFECT!

[Go Niners]

I'll do it once I'm done spamming

[Lasagna and tears of failure]

Dec 19, 2020 21:16:25 GMT -8 Go Niners said:

I'll do it once I'm done spamming

did you get everything installed?

[Lasagna and tears of failure]

gotta say the programming change I did last night... so amazing... gotta figure out the array loop to make it better though

[JR]

Dec 20, 2020 9:03:57 GMT -8 Lasagna and tears of failure said:

gotta say the programming change I did last night... so amazing... gotta figure out the array loop to make it better though

What you do?

[Lasagna and tears of failure]

Dec 20, 2020 9:04:46 GMT -8 JR said:

Dec 20, 2020 9:03:57 GMT -8 Lasagna and tears of failure said:

gotta say the programming change I did last night... so amazing... gotta figure out the array loop to make it better though

What you do?

bbs2020.proboards.com/post/310103/thread

so with one command it spits out your entire team


> get_team_stats(start = 81)
Michael Kidd-Gilchrist
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 35.7  8.0 19.3  1.1  2.4  2.4  3.1  5.7  1.7  1.6  1.4  1.6  0.9 19.6

PERCENTAGES
[1] 0.415 0.471 0.773

Otto Porter
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 32.1  5.4 15.3  1.1  3.6  3.7  5.1  8.0  3.0  1.6  1.0  2.0  0.1 15.7

PERCENTAGES
[1] 0.355 0.320 0.722

DeJuan Blair
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 34.4  6.4 15.3  0.0  0.0  3.4  5.7 11.1  2.0  2.3  0.7  2.1  1.0 16.3

PERCENTAGES
[1] 0.421   NaN 0.600

Mike Scott
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 29.6  4.1  9.9  0.0  0.6  0.9  1.3  4.3  3.0  1.0  0.4  1.6  0.6  9.1

PERCENTAGES
[1] 0.420 0.000 0.667

Paccelis Morlende
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 36.7  1.9  3.7  0.0  0.0  1.0  1.1  9.1  2.0  2.4  2.0  0.9  3.6  4.7

PERCENTAGES
[1] 0.500   NaN 0.875

Chandler Parsons
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 12.1  1.6  3.7  0.3  1.1  1.3  1.4  1.6  1.0  0.7  0.6  0.6  0.0  4.7

PERCENTAGES
[1] 0.423 0.250 0.900

Dennis Schroder
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 34.1  6.3 11.7  1.0  1.7  0.4  0.7  2.3  6.3  3.9  0.6  1.9  0.0 14.0

PERCENTAGES
[1] 0.537 0.583 0.600

John Henson
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 13.6  1.6  4.6  0.0  0.0  0.1  0.4  4.3  0.4  1.3  0.1  0.4  0.4  3.3

PERCENTAGES
[1] 0.344   NaN 0.333

Mason Plumlee
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 11.6  0.6  3.4  0.0  0.0  0.6  1.3  2.4  0.1  1.4  0.4  0.1  0.3  1.7

PERCENTAGES
[1] 0.167   NaN 0.444

Ronny Turiaf
No stats found.

[Go Niners]

Dec 20, 2020 9:03:14 GMT -8 Lasagna and tears of failure said:

Dec 19, 2020 21:16:25 GMT -8 Go Niners said:

I'll do it once I'm done spamming

did you get everything installed?

Got lazy, gonna try it later

[ashes]

oh

[Lasagna and tears of failure]

Dec 20, 2020 14:53:01 GMT -8 ashes said:

oh

later tonight, I'll work on the looping array to make it even more friendly to update season to season 

[Lasagna and tears of failure]

ashes JR nybombers3 Go Niners

I got the loop to work, now all you have to do is populate the array for get_team_stats

[Lasagna and tears of failure]

rm(list=ls())
options(stringsAsFactors = FALSE)
options(digits=3)
library('rvest')

path <- "https://bballsim2020.com/"

# ADD YEAR PLUS / FOR PAST SEASONS

teams <- c("Celtics", "Heat", "Nets", "Knicks", "Magic", "76ers", "Wizards",
"Hawks", "Hornets", "Bulls", "Cavaliers", "Pistons", "Pacers",
"Bucks", "Raptors", "Mavericks", "Nuggets", "Rockets",
"Timberwolves", "Spurs", "Jazz", "Grizzlies", "Warriors",
"Clippers", "Lakers", "Suns", "Trail Blazers", "Kings",
"SuperSonics")

colMax <- function(data) sapply(data, max, na.rm = TRUE)

get_player_stats <- function(player, team, start=1, end=200, per36=F){

stats <- c()

for(i in 1:length(team)){
index <- which(team[i] == teams)
url <- paste(path, "/rosters/roster", index, "sched.htm", sep="")
webpage <- read_html(url)
links <- html_attr(html_nodes(webpage, "a"), "href")
links <- links[10:(length(links)-1)]

for(j in 1:length(links)){
url <- paste(path, substr(links[j], 3, nchar(links[j])), sep="")
day <- as.numeric(substr(url, gregexpr("boxes/", url)[[1]][1]+6, gregexpr("-", url)[[1]][1]-1))

if(day >= start & day <= end){
full_box <- html_table(read_html(url), header=TRUE, fill=TRUE)

if(colnames(full_box[[2]])[1] == team[i]){
my_team_index <- 2
opp_team_index <- 3
} else{
my_team_index <- 3
opp_team_index <- 2
}

box <- full_box[[my_team_index]]
box_team <- box[1:(nrow(box)-2), 1:(ncol(box)-1)]
box_team[,3:16] <- lapply(box_team[,3:16], as.numeric)
colnames(box_team)[6:7] <- c("X3P", "X3PA")
if(colnames(box_team)[1] == team[i]){
index <- which(box_team[,1] == player)
if(length(index) > 0){
colnames(box_team)[1] <- "Team"
stats <- rbind(stats, box_team[index,])
}
}
}
}
}

if(is.null(stats)){
cat("No stats found.\n")
} else if(nrow(stats) == 0){
cat("No stats found.\n")
} else{

stats <- cbind.data.frame(GM=nrow(stats), stats[, 3:16])

cat("AVERAGES\n")
averages <- colMeans(stats)

print(round(averages, digits=1))

if(per36 == 1){
cat("\nPER 36\n")
constant <- (36 / averages[2])
for(i in 2:length(averages)){
averages[i] <- constant * averages[i]
}
print(round(averages, digits=1))
}

cat("\nPERCENTAGES\n")
print(c(sum(stats$FG) / sum(stats$FGA), sum(stats$X3P) / sum(stats$X3PA),
sum(stats$FT) / sum(stats$FTA)))
}
}

get_team_stats <- function(start=1, end=200, per36=F){
team_N <- "Celtics"
player_N <- c("Michael Kidd-Gilchrist", "Otto Porter","DeJuan Blair" ,"Ronny Turiaf", "Mason Plumlee" , "John Henson" , "Marko Todorovic" , "Mike Scott" , "Chandler Parsons" , "Dennis Schroder", "Paccelis Morlende")

for (i in player_N) {
print(i)
get_player_stats(i, team_N , start , end)
cat("\n")
cat("\n")
}


}

[Lasagna and tears of failure]

the key changes are to this function


get_team_stats <- function(start=1, end=200, per36=F){
team_N <- "Celtics"
player_N <- c("Michael Kidd-Gilchrist", "Otto Porter","DeJuan Blair" ,"Ronny Turiaf", "Mason Plumlee" , "John Henson" , "Marko Todorovic" , "Mike Scott" , "Chandler Parsons" , "Dennis Schroder", "Paccelis Morlende")

for (i in player_N) {
print(i)
get_player_stats(i, team_N , start , end)
cat("\n")
cat("\n")
}

[Lasagna and tears of failure]

oh heck yeah, finally got the per/36 part of the program to work too

[1] "Chandler Parsons"
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 12.1  1.6  3.7  0.3  1.1  1.3  1.4  1.6  1.0  0.7  0.6  0.6  0.0  4.7

PER 36
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 36.0  4.7 11.0  0.8  3.4  3.8  4.2  4.7  3.0  2.1  1.7  1.7  0.0 14.0

PERCENTAGES
[1] 0.423 0.250 0.900

[Lasagna and tears of failure]

[hf]

Dec 20, 2020 21:45:53 GMT -8 Lasagna and tears of failure said:

oh heck yeah, finally got the per/36 part of the program to work too

[1] "Chandler Parsons"
AVERAGES
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 12.1  1.6  3.7  0.3  1.1  1.3  1.4  1.6  1.0  0.7  0.6  0.6  0.0  4.7

PER 36
 GM  MIN   FG  FGA  X3P X3PA   FT  FTA  REB    A   PF   ST   TO   BL  PTS
7.0 36.0  4.7 11.0  0.8  3.4  3.8  4.2  4.7  3.0  2.1  1.7  1.7  0.0 14.0

PERCENTAGES
[1] 0.423 0.250 0.900

Oh that’s niceeee