scale out R server/service in MS SQL 2016 and later

hi,

Anyone know how to scale out R server/service in MS SQL 2016 and later?
LVL 1
marrowyungSenior Technical architecture (Data)Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Raja Jegan RSQL Server DBA & Architect, EE Solution GuideCommented:
Haven't heard anyone Scaling out in MS SQL 2016, but R Server has the capabilities to support Scaling as mentioned below..
https://rviews.rstudio.com/2016/12/21/r-for-enterprise-how-to-scale-your-analytics-using-r/
Vitor MontalvãoMSSQL Senior EngineerCommented:
Add more CPUs as you can't distribute a Windows service to run in multiple servers.
marrowyungSenior Technical architecture (Data)Author Commented:
Victor,
 
This is scale up ! this is highly depends on if that motherboard is allowed to have that CPU.
Your Guide to Achieving IT Business Success

The IT Service Excellence Tool Kit has best practices to keep your clients happy and business booming. Inside, you’ll find everything you need to increase client satisfaction and retention, become more competitive, and increase your overall success.

marrowyungSenior Technical architecture (Data)Author Commented:
it seems we can use R server pro from R studio.

load balancing.
Vitor MontalvãoMSSQL Senior EngineerCommented:
If you're going to use R Studio then you're not using R Services.
marrowyungSenior Technical architecture (Data)Author Commented:
hi,

you mean can't use both and I must turn off R service, right?
Raja Jegan RSQL Server DBA & Architect, EE Solution GuideCommented:
To be clear, R is an independent language available..
Starting from SQL Server 2016, Microsoft packaged it along with SQL Server as it is open source.
As mentioned above, I haven't heard about scaling options for the one that is bundled with SQL Server.
But from RStudio, you have the options as I've mentioned in the link provided.
Hope this clarifies.
marrowyungSenior Technical architecture (Data)Author Commented:
"As mentioned above, I haven't heard about scaling options for the one that is bundled with SQL Server."

yes, that's why I am wondering. seem matlab has ?

R server pro only has load balancing.

from your link, it seems high performance cluster (HPC) is the closest answer to that.
Raja Jegan RSQL Server DBA & Architect, EE Solution GuideCommented:
Yes, that's correct.
Kindly let us know for more details..

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
marrowyungSenior Technical architecture (Data)Author Commented:
high performance cluster (HPC) can be easily install ? on Windows ?
Raja Jegan RSQL Server DBA & Architect, EE Solution GuideCommented:
Yes, it is.. you can get lot of documents if you google for R on HPC Windows..
Vitor MontalvãoMSSQL Senior EngineerCommented:
you mean can't use both and I must turn off R service, right?
You don't need to turn off R Service. What I said is that if you're going to use R Studio to run R scripts then what you'll run in R Service? Both can co-exist but in a point in time you'll need to decide which scripts you will run from R Studio and which ones from R Service.
Vitor MontalvãoMSSQL Senior EngineerCommented:
seem matlab has ?
Matlab isn't R. Matlab's architecture allows you to have more than one server  (workers) to run Matlab models.
R has some libraries that allows you to create a cluster of machines to offload processes. The one that I've used is the snow package. It works better on Linux but I've tested in Windows and also worked.
marrowyungSenior Technical architecture (Data)Author Commented:
" It works better on Linux but I've tested in Windows and also worked."

Seems Linux always faster than Windows. :):)

"Matlab isn't R"

i know it is not R, I mean it does work better, right?

" you'll need to decide which scripts you will run from R Studio and which ones from R Service."

yeah, but they can offer service all together so that it can load balance better,right ?

"R has some libraries that allows you to create a cluster of machines to offload processes"

it seems the new microservice also help on that, right ?
Vitor MontalvãoMSSQL Senior EngineerCommented:
Seems Linux always faster than Windows. :):)
Isn't a performance matter but how Windows is really bad when coming to parallelize processes through many servers.

i know it is not R, I mean it does work better, right?
I don't have experience in Matlab but people are moving to R for some reason. Maybe because is free and Matlab's licensing is really too expensive.

yeah, but they can offer service all together so that it can load balance better,right ?
I don't think you can load balance R scripts in R Service for SQL Server.

it seems the new microservice also help on that, right ?
Which microservice?
marrowyungSenior Technical architecture (Data)Author Commented:
"I don't think you can load balance R scripts in R Service for SQL Server."

yes. that's why I am looking for scale out solution , seems only R server can do it, the R server pro.

"Isn't a performance matter but how Windows is really bad when coming to parallelize processes through many servers.

did you try Windows server 2016 ? can it do it ?

The SSD storage solutions already can scale out, do sth like Oracle ASM and ASM only serve DB tier, for micosoft SSD can do for everything need scale out and clustered smarts software storage solution.
marrowyungSenior Technical architecture (Data)Author Commented:
"I don't have experience in Matlab but people are moving to R for some reason. Maybe because is free and Matlab's licensing is really too expensive."

R can talk to all other AI language, I think this is why . learn one language and do a lot of thing.

"Which microservice?"

a new concerpt that scale out AI model , which we can put diff model on diff server, VMware also re-architecture that.
Raja Jegan RSQL Server DBA & Architect, EE Solution GuideCommented:
Hi Marrowyung, kindly let us know whether your questions related to R is clarified or not. For Matlab related questions you can raise a new question with appropriate topics so that Matlab experts can guide you accordingly.
marrowyungSenior Technical architecture (Data)Author Commented:
tks both.
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Statistical Packages

From novice to tech pro — start learning today.