scale out R server/service in MS SQL 2016 and later

marrowyung
marrowyung used Ask the Experts™
on
hi,

Anyone know how to scale out R server/service in MS SQL 2016 and later?
Comment
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
Raja Jegan RSQL Server DBA & Architect, EE Solution Guide
Awarded 2009
Distinguished Expert 2018

Commented:
Haven't heard anyone Scaling out in MS SQL 2016, but R Server has the capabilities to support Scaling as mentioned below..
https://rviews.rstudio.com/2016/12/21/r-for-enterprise-how-to-scale-your-analytics-using-r/
Vitor MontalvãoIT Engineer
Distinguished Expert 2017

Commented:
Add more CPUs as you can't distribute a Windows service to run in multiple servers.
marrowyungSenior Technical architecture (Data)

Author

Commented:
Victor,
 
This is scale up ! this is highly depends on if that motherboard is allowed to have that CPU.
Ensure you’re charging the right price for your IT

Do you wonder if your IT business is truly profitable or if you should raise your prices? Learn how to calculate your overhead burden using our free interactive tool and use it to determine the right price for your IT services. Start calculating Now!

marrowyungSenior Technical architecture (Data)

Author

Commented:
it seems we can use R server pro from R studio.

load balancing.
Vitor MontalvãoIT Engineer
Distinguished Expert 2017

Commented:
If you're going to use R Studio then you're not using R Services.
marrowyungSenior Technical architecture (Data)

Author

Commented:
hi,

you mean can't use both and I must turn off R service, right?
Raja Jegan RSQL Server DBA & Architect, EE Solution Guide
Awarded 2009
Distinguished Expert 2018

Commented:
To be clear, R is an independent language available..
Starting from SQL Server 2016, Microsoft packaged it along with SQL Server as it is open source.
As mentioned above, I haven't heard about scaling options for the one that is bundled with SQL Server.
But from RStudio, you have the options as I've mentioned in the link provided.
Hope this clarifies.
marrowyungSenior Technical architecture (Data)

Author

Commented:
"As mentioned above, I haven't heard about scaling options for the one that is bundled with SQL Server."

yes, that's why I am wondering. seem matlab has ?

R server pro only has load balancing.

from your link, it seems high performance cluster (HPC) is the closest answer to that.
SQL Server DBA & Architect, EE Solution Guide
Awarded 2009
Distinguished Expert 2018
Commented:
Yes, that's correct.
Kindly let us know for more details..
marrowyungSenior Technical architecture (Data)

Author

Commented:
high performance cluster (HPC) can be easily install ? on Windows ?
Raja Jegan RSQL Server DBA & Architect, EE Solution Guide
Awarded 2009
Distinguished Expert 2018

Commented:
Yes, it is.. you can get lot of documents if you google for R on HPC Windows..
Vitor MontalvãoIT Engineer
Distinguished Expert 2017
Commented:
you mean can't use both and I must turn off R service, right?
You don't need to turn off R Service. What I said is that if you're going to use R Studio to run R scripts then what you'll run in R Service? Both can co-exist but in a point in time you'll need to decide which scripts you will run from R Studio and which ones from R Service.
Vitor MontalvãoIT Engineer
Distinguished Expert 2017

Commented:
seem matlab has ?
Matlab isn't R. Matlab's architecture allows you to have more than one server  (workers) to run Matlab models.
R has some libraries that allows you to create a cluster of machines to offload processes. The one that I've used is the snow package. It works better on Linux but I've tested in Windows and also worked.
marrowyungSenior Technical architecture (Data)

Author

Commented:
" It works better on Linux but I've tested in Windows and also worked."

Seems Linux always faster than Windows. :):)

"Matlab isn't R"

i know it is not R, I mean it does work better, right?

" you'll need to decide which scripts you will run from R Studio and which ones from R Service."

yeah, but they can offer service all together so that it can load balance better,right ?

"R has some libraries that allows you to create a cluster of machines to offload processes"

it seems the new microservice also help on that, right ?
Vitor MontalvãoIT Engineer
Distinguished Expert 2017

Commented:
Seems Linux always faster than Windows. :):)
Isn't a performance matter but how Windows is really bad when coming to parallelize processes through many servers.

i know it is not R, I mean it does work better, right?
I don't have experience in Matlab but people are moving to R for some reason. Maybe because is free and Matlab's licensing is really too expensive.

yeah, but they can offer service all together so that it can load balance better,right ?
I don't think you can load balance R scripts in R Service for SQL Server.

it seems the new microservice also help on that, right ?
Which microservice?
marrowyungSenior Technical architecture (Data)

Author

Commented:
"I don't think you can load balance R scripts in R Service for SQL Server."

yes. that's why I am looking for scale out solution , seems only R server can do it, the R server pro.

"Isn't a performance matter but how Windows is really bad when coming to parallelize processes through many servers.

did you try Windows server 2016 ? can it do it ?

The SSD storage solutions already can scale out, do sth like Oracle ASM and ASM only serve DB tier, for micosoft SSD can do for everything need scale out and clustered smarts software storage solution.
marrowyungSenior Technical architecture (Data)

Author

Commented:
"I don't have experience in Matlab but people are moving to R for some reason. Maybe because is free and Matlab's licensing is really too expensive."

R can talk to all other AI language, I think this is why . learn one language and do a lot of thing.

"Which microservice?"

a new concerpt that scale out AI model , which we can put diff model on diff server, VMware also re-architecture that.
Raja Jegan RSQL Server DBA & Architect, EE Solution Guide
Awarded 2009
Distinguished Expert 2018

Commented:
Hi Marrowyung, kindly let us know whether your questions related to R is clarified or not. For Matlab related questions you can raise a new question with appropriate topics so that Matlab experts can guide you accordingly.
marrowyungSenior Technical architecture (Data)

Author

Commented:
tks both.

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial