asked on

Webconsole inaccessible BES Express 5.0.2 and SBS 2011

I have just installed BES Express on a fresh SBS 2011 server.

Install went fine, and most services are up, but the two services:

Blackberry Administration Service - Application Server
and
Blackberry Administration Service - Native Code Container

are not running despite being set to Automatic.

Attempts to access webconsole using the Admin service
https://server1.rod.local:3443/webconsole/login just give "Cannot display the web page"
presumably because the admin server is down.

The other processes look fine, and I think it would work if only I could log in to configure it!

Application Event Log has errors:

Faulting application name: BAS-AS.exe, version: 1.2.3.0, time stamp: 0x3f1e456d
Faulting module name: ntdll.dll, version: 6.1.7601.17514, time stamp: 0x4ce7ba58
Exception code: 0xc0000005
Fault offset: 0x0002dfc4
Faulting process id: 0x35b8
Faulting application start time: 0x01cbeecbea7b0e40
Faulting application path: C:\Program Files (x86)\Research In Motion\BlackBerry Enterprise Server\BAS\External\Bin\BAS-AS.exe
Faulting module path: C:\Windows\SysWOW64\ntdll.dll
Report Id: 2ebf9620-5abf-11e0-9499-001ec92a4dab

ALso:

Faulting application name: BAS-NCC.exe, version: 1.2.3.0, time stamp: 0x3f1e456d
Faulting module name: ntdll.dll, version: 6.1.7601.17514, time stamp: 0x4ce7ba58
Exception code: 0xc0000005
Fault offset: 0x0002dfc4
Faulting process id: 0x3218
Faulting application start time: 0x01cbeecbe4551c90
Faulting application path: C:\Program Files (x86)\Research In Motion\BlackBerry Enterprise Server\BAS\External\Bin\BAS-NCC.exe
Faulting module path: C:\Windows\SysWOW64\ntdll.dll
Report Id: 2892edb0-5abf-11e0-9499-001ec92a4dab

These restart on a regular basis.

Help!

Hi ChopperChap,

Have a look at this BlackBerry article. It describes several scenarios that could lead to your problem:

http://www.blackberry.com/btsc/microsites/search.do?cmd=displayKC&docType=kc&externalId=KB18185

Let me know how you get on.

ASKER

Thanks for the reply.

There are about 10 files in the log, none contain contents like those in the article.

Contents vary, but an example is:

(03/30 11:44:12:190):{main} [com.arjuna.ats.jbossatx.jta.TransactionManagerService] [INFO] JBossTS Transaction Service (JTA version) - JBoss Inc.
(03/30 11:44:12:191):{main} [com.arjuna.ats.jbossatx.jta.TransactionManagerService] [INFO] Setting up property manager MBean and JMX layer
(03/30 11:44:12:559):{main} [com.arjuna.ats.jbossatx.jta.TransactionManagerService] [INFO] Starting recovery manager
(03/30 11:44:12:719):{main} [com.arjuna.ats.jbossatx.jta.TransactionManagerService] [INFO] Recovery manager started
(03/30 11:44:12:720):{main} [com.arjuna.ats.jbossatx.jta.TransactionManagerService] [INFO] Binding TransactionManager JNDI Reference

Doesn't appear to be in error.

I'm going to trawl through some of the other logs to see if anything shows up.

Regards

ASKER

No other errors apparent in the files :(

Can you see the BAS-AS and BAS-NCC services running in Task Manager? Roughly how much memory are they using?

Also, you might want to try this:

Click Start, click Run, type regedit, and then click OK.
Locate and then click the following subkey:
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Servic es\Tcpip\Parameters
Right-click ReservedPorts, and then click Modify.
Paste the following at the bottom
48855-48858
45588-45588
49955-49955
45599-45599

ASKER

Hi, thanks for the reply

BAS-AS and BAS-NCC terminate shortly after starting, and this happens repeatedly.

I have made the suggested changes and rebooted the server, unfortunately the problem persists.

Regards

Which BlackBerry log files are being constantly regenerated, please? <install path>\Research in Motion\BlackBerry Enterprise Server\Logs\<date>

Can you post the information from each of the regenerating logs, please?

Are there any warnings or errors in the Windows Application log file?

ASKER

Hi

Application log file errors are in the first email.

FIles attached SERVER1-BBAS-NCC-01-20110331-002.txt

ASKER

Plus AS FIle:
SERVER1-BBAS-AS-01-20110331-0004.txt

OK, this looks familiar. Do you ave either of these two MS updates on your server? KB979538 or KB981852?

If so, remove them, reboot and try again. Let me know how you get on.

ASKER

Directory listing showing files being regenerated:

Doc1.docx

ASKER

Thanks!

KB979538 is in the update list, but failed. When I look at Installed updates, I don't see it. The failure detail of the update is attached.

KB981852 doesn't appear in the update history list.

If they were the cause, I don't know if they are superceded or embedded in SBS 2011

Regards

Doc1.docx

Have you rebooted the server at all since applying the port reservations? Can you arrange a reboot?

ASKER

Yes, rebooted the server after applying the port reservations.

OK, check for another MS update: KB2393802

This one can also break the BAS console.

ASKER

Hi

That one was installed, I've removed it, then rebooted the server, but unfortunately the problem persists.

Thanks for the help - it's appreciated.

Regards

Sorry ChopperChap, I mistyped the first KB update to check for, it should have been KB979683 (not 538). Apologies for that.

Also, have a look at the path to the java installation on your system. Check that it matches the registry entries for BAS-AS and BAS-NCC:

HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\BAS-NCC\Parameters

JVM Library - C:\Program Files\Java\jre6\bin\client\jvm.dll

and

HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\BAS-AS\Parameters

JVM Library - C:\Program Files\Java\jre6\bin\client\jvm.dll

You may need to repoint them if Java is installed elsewhere.

ASKER

Thanks

KB979683 isn't installed.

The Java libraries are correct.

Regards

Morning ChopperChap,

Can you zip up a full day of log files, please? There is probably a pointer to the underlying problem elsewhere.

Also, did you check in the Windows Event Viewer to see if there were any alerts in there?

ASKER

Thanks for the reply

I've zipped up the log files, and also exported warnings/errors/critical events from the App and system event logs

Please rename the event logs to file extensio .evtx

Regards

Logs.zip
Filtered-App-Log.txt
System-log-filtered.txt

SQL.

Are you using a static or dynamic port?

Set it to static and use BlackBerry Server Config tool to get BES to look for that static port. Make sure there are no port conflicts.

ASKER

I'm not sure quite how to do that.

I allowed BESx to install SQL server 2005 express. I have never administered SQL. Checked the SQL Server configuration manager - where do I do this change?

Thanks

Do you have the SQL Server Configuration Manager tool? Look in there for TCP/IP configuration. I can get more detail if you need it.

ASKER

I have the tool

TCP/IP properties show IP1 to IP7 and IPAll.

Ipall has property 'TCP Dynamic Ports' set to 25412, and TCP Port is Blank.

IP1 - IP7 all have Properties as follows:
Active: Yes
Enables: No
IP Address: Varies, IP4 and IP 6 addresses, with IP4 as ::1, IP 5 is 127.0.0.1, IP3 is the server IPv4 address
TCP Dynamic Porst: all set to 0
TCP Port all Blank

Which do I set?

Thanks

Set the server's IPv4 address. If no other SQL installation is on there, the standard port is 1433. You might want to pick something else, though, e.g. 11433/21433/etc.

Once set, use the BlackBerry Server Configuration tool to set BlackBerry to look for that port.

I think we are almost there :-)

ASKER

I must have screwed up the IP port - I don't think it's connecting to the database - just going to check.

Ok, detailed guide:

Open the SQL Server Configuration Manager > SQL Server Network Configuration and click on the SQL instance for your BES database.

In the right hand window, right click on TCP/IP and Select Properties. Scroll down to IPAll and Set TCP Dynamic Ports to <blank> and TCP Port to your static port.

Now open BlackBerry Server Configuration, remove the tick from Use Dynamic Ports and enter the same static port.

You will need to restart the SQL Server instance and all BlackBerry Services after changing this.

ASKER

Nope - can't seem to make this happen.

Getting an event log file error that the blackberry database failed to connect on the port I specified.

I've tried rebooting, hasn't worked.

I'll have to take this offline for a few hours and come back to it - I'll repost when I figure out what I've done (or not done) to make the dedicated port not work!

Regards

If necessary, set all Dynamic ports to blank in the SQL Server Network Configuration for your BES instance and TCP Port to your static port of choice.

I have heard that doing a JAVA update will result on a mess, did you updated it?

Have you added in the windows hosts file your server?
192.168.1.1 server.domain.local

Once I solved this issue with the hosts file.

ASKER

Miketherelic: Finally managed to get the SQL server running on dedicated port 11433 and Blackberry connected to it.

Unfortunately the problem with the admin server remains.

Marpanet: I'm on Java 6, Update 20, I think. Tried the hosts file change, unfortunately also didn't help.

I don't think I'm alone with this issue on SBS 2011.

Regards

Now that you've got SQL sorted out, can you post another set of log files, please?

ASKER

Blackberry log files for today.
20110404.zip

ASKER

Event Logs (App). Please open the zip and rename the txt file to evtx.

Regards
110404-Event-Log.zip

The database is still the problem. There aren't any BAS-AS logs to check, but this is an extract from the Dispatcher log:

[30058] (04/04 06:36:02.426):{0x18B4} Starting Database
[30000] (04/04 06:36:02.526):{0x18B4} ADO ConnectionTimeout value = 30s
[30000] (04/04 06:36:02.526):{0x18B4} ADO ConnectionTimeout for re-initalizing the pool = 45s
[25137] (04/04 06:36:35.102):{0x18B4} {ConnectionItem::ConnectToDB} Failed to connect. Connection string is Provider=SQLOLEDB.1;Server=SERVER1\BLACKBERRY,11433;Database=BESMgmt;Network=dbmssocn;Trusted_Connection=Yes
[25000] (04/04 06:36:35.102):{0x18B4} ConnectionItem::ConnectToDB: COM Error 0x80004005 - Unspecified error - Source: "Microsoft OLE DB Provider for SQL Server" - Description "Microsoft OLE DB Provider for SQL Server" - Command "ConnectionItem::ConnectToDB"
[35028] (04/04 06:36:35.195):{0x18B4} {ConnectionPool::Connect()} Pool Initialization failed for attempt 1 of 5
[25137] (04/04 06:37:18.141):{0x18B4} {ConnectionItem::ConnectToDB} Failed to connect. Connection string is Provider=SQLOLEDB.1;Server=SERVER1\BLACKBERRY,11433;Database=BESMgmt;Network=dbmssocn;Trusted_Connection=Yes
[35029] (04/04 06:37:18.141):{0x18B4} {ConnectionPool::Connect()} Pool Initialization failed because timeout of 60 seconds was exceeded
[20652] (04/04 06:37:18.156):{0x18B4} OpenDB: OPEN_DB failed
[20645] (04/04 06:37:18.156):{0x18B4} DBInit: OpenDB failed - 0
[30255] (04/04 06:37:18.156):{0x18B4} SCS - Call to DBInterface::DBInit failed
[50105] (04/04 06:37:18.156):{0x18B4} Stopping BlackBerry Dispatcher

I'll do some digging and come back to you.

ASKER

Hi

I only fixed the database at about 08:45, so maybe later in the logs?

Regards

ASKER

Just as an indication, several more people with similar problem here (final posts)

http://social.technet.microsoft.com/Forums/en-US/smallbusinessserver/thread/fea08927-8b33-4458-ae8d-7c1bb17902ae/

Regards

Hi Chopper,

Can you restart all BES services, give it five minutes to settle down then post some more logs, please?

ASKER

20110404--2-.zip
110404-Event-Log-2.zip

Hi Chopper

I did a clean install on SBS2011 aswell and encountered the same problem. I spent days banging my head against a wall, researching and getting nowhere untill I stumbelled across an obscure article somewhere (didnt save it to credit the author unfortunately...)
It comes down to SQL not communicating with the BAS, even though a test in BlackBerry Server Configuration confirms that it can connect to SQL.
My problems were solved by manually setting all ports to 1433 in both the SQL configuration and BlackBerry Server Configuration. I understand that this relates to IPv6.

One issue I havent worked past is the BlackBerry MDS - it just refuses to work. In the meantime I have set the user's devices to use "Internet Browser" rather than "BlackBerry Browser". I assume this is an incompatibility with 2011. When I get the time I am going to trial an install on a dedicated Hyper-V Server 2008 instance to see if it makes a difference.

ASKER

lbellew

Thanks for this. I had set the system up to use 11433, but as I've made a number of changes now, I'm going to uninstall BES / Re=install and try again, setting ports to 1433 as you suggest.

There are quite a few ports in the SQL server - did you disable dynamic ports?

Did you let the Blackberry software install SQL express 2005 Express?

Thanks

Hi Chopper
I installed with dynamic but ended up disabling all the dynamic ports and just used static. Yes it was using SQL express as included with the install. I've done quite a few BESX installs for clients, even with existing SQL 2008 etc and used the included 2005 as it seems to work flawlessly.

ASKER

Well - uninstalled, re-installed, definitely have the SQL express on 1433 static port, but exactly the same problem.

BlackBerry Server Configuration confirms that it can connect to SQL.

Everything looks fine, it just will not connect, and I can't find a log file that shows anything useful!

Having the same issue here. Did you ever find a solution?

Hi Matt,

Can you post some recent log files from your BES server. It may shed some more light on the issue.

Thanks,

Mike

In the process of trying a re-installation with the port selected instead of dynamic. About to perform the reboot to complete the installation and I'll let everyone know the out come after that.

Okay, so re-installation after modifying SQL Server Browser service to start automatically I'm now able to access the web interface.

ASKER

When you say 'with the port selected' where do you select it - during the BES install?

Regards

Yes that was during the installation. Although I'm really not sure how that caused our Web interface not to load because it has more to do with not being able to access the database for creating user accounts... However, it should be near the beginning of the installation you have the option of connecting to SQL via dynamic ports or specify SQL port. You may want to also download SQL server management studio from Microsoft so that you can verify the ports and permissions of the BlackBerry SQL database. I think I also had to manually add the BESAdmin account in their with all of the appropriate permissions. Under Security/Logins/BESAdmin right click and select Properties, click on Server Roles and make sure they have dbcreator, serveradmin, and sysadmin rights. Then under User Mapping make sure BESMgmt is checked with db_owner and public checked.

Hope this helps.

I just installed BES on SBS 2011 tonight and had the same problem. As many people have suggested I changed the ports in the SQL Server Configuration Manager from dynamic to a specific port and then changed it in the BlackBerry Server Configuration as well. That still didn't fix it. Finally I started looking around in the IP addresses tab of the TCP/IP properties in the SQL Server Configuration Manager and noticed that I had seven sections there but none of them were marked with Yes in the Enabled field. So I made sure that each section had the TCP Dynamic Ports field blank and the TCP Port field to 1433. Then I set the Enabled field on the section with my local IPv4 address to be Yes. I also set the Enabled field in the section with the IPv4 loop back address )127.0.0.1 to Yes. Then I restarted the whole server just for kicks. I think this is what finally fixed it for me. FYI, I had already changed the SQL port to 1433 in the BlackBerry Server Configuration as well.

ASKER

I did manage to set up the ports as above, but with no success. I decided to uninstall and start again.

However, I am well - truly stuck now!

Attempts to uninstall BES 5.0.2 result in the uninstall task bar just vanishing after about 60 seconds of 'gathering requirements'. I've uninstalled SQL server seperately, that was fine.

Attempts to re-install BES 5.0.2 over the top of the existing installation result in a message 'initialize failed', and setup exits.

So I can't get rid of it, and can't put in a new instance.

What a pile of poo this software is!

Looks like the only way out may be a complete rebuild of the server, which is (at the moment) a little impractical.

ChopperChap, are you logged in with your BES account when doing the uninstallation. I've seen that issue before if someone hasn't fully finished the installation under the BES account and you login with the Administrator account you can be locked out of some of those settings and could possibly be locked out of uninstalling as well.

ASKER

Hi

Tried removing as both administrator and BESAdmin. Neither works, both give the same conclusion: the task completion bar just disappears after reaching about 75% on 'gathering requirements'.

Are all of the BES services running?..and you uninstalled SQL separately? That may be why it fails to uninstall as it may be looking to remove the BlackBerry SQL instance. Any way to restore back to prior to uninstalling SQL?

ASKER

None of the BES services are running. The inability to uninstall was occurring well before SQL instance was removed, and that as done in an attempt to resolve the issue.

I don't have any way back.

What happens when you start the BES services? Have you tried reinstalling SQL and recreating the BlackBerry SQL instance?

When you tried to reinstall where you installing to the same location as the original installation? Can you try installing to a different drive?

ASKER

Thanks for the help.

The blackberry services no longer appear in the services list, so the first uninstall must have got that far.

I am unable to reinstall anything off the Blackberry BESE 5.0.2, as the initial 'setup' program simply gives an error 'fails to initialize'. I was using the Blackberry-provided SQL Express 2005.

Is there a command string I can give to the setup program to install elsewhere?

:) good to hear about the services being removed. Have you tried to download BESE 5.0.2 again to see if maybe part of the original download was corrupt?

It's not until you get the into the installation that you select the drive locations for the data and database. and I'm not sure if there is a way to preset those items.

ASKER

I tried with a new download, unfortunately no better.

It may require a manual registry edit, but as it's installed on an unsupported platform (SBS 2011), I can't get support help from Blackberry.

Have you restarted the server since making all of these configuration changes? The setup program wouldn't have required them but there will be incomplete configuration issues if you haven't restarted.

ASKER

I've rebooted many times trying to get rid of the software!

Regards

Hi ChopperChap,

Sorry for asking that question. I get all sorts of answers when I ask it so don't like to assume.

Have a look in your BlackBerry Logs folder (Usually c:\Program Files (x86)\Research In Motion\BlackBerry\Logs). Is there a folder called 'Installer'? If so, is there anything up to date in there that relates to the problems you've been having with the installation and uninstallation?

Mike

ASKER

Unfortunately there is no 'Logs' directory.

It looks like the first uninstall must have half-completed, as the services have stopped, and this directory is gone...

Regards

OK, try running the installation application again. Even if it fails it should start to create a log file. The log file is called 'install_log.txt'. Search the system for it and see if it puts it into a non-standard location.

Additionally, do the Windows Event logs come up with any errors during the installation process? I would expect to see something in the Application logs.

ASKER

There's nothing in the Event Log

Running setup.exe in the "c:\research in motion" extraction directory brings up the Blackberry logo in a black windowfor about 30 seconds, then a dialog box saying "Error Initializing system" with an <ok> button. Press OK and it exits.

No messages appear in any of the event logs, Setup, Application or System.

A search on all drives reveals no file with that name.

It's not great, is it!

It's good fun, isn't it?

Note: Back up the registry before making any modifications.

Click Start > Run.
Type regedit.
Navigate to the following location depending on the version of Windows Server®:
If you are running a 32-bit version of Windows, navigate to HKEY_LOCAL_MACHINE\SOFTWARE\Research In Motion\BlackBerry Enterprise Server.
If you are running a 64-bit version of Windows, navigate to HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Research In Motion\BlackBerry Enterprise Server.
Remove the Database registry key.
Navigate to the following location depending on the version of Windows Server:
If you are running a 32-bit or a 64-bit version of Windows, navigate to HKEY_CURRENT_USER\SOFTWARE\Research In Motion\BlackBerry Enterprise Server.
Remove the Database registry key.
Restart the setup.exe application and complete the installation.

ASKER

Thanks

I have removed the key, but running the Setup.exe still gives a message 'error initializing system'

Missed one registry key:

HKEY_CURRENT_USER\SOFTWARE\Wow6432Node\Research In Motion\BlackBerry Enterprise Server

Remove the Database key.

ASKER

ok, that did it! Setup now runs again.

I'll have to get in as BESadmin to run it, which I can only do from home, so next update in about 4 hours.

Many thanks for the help so far!

No problem. There's no way that I'm going to let this one beat me now :-)

ASKER

OK: I installed, to the reboot point, then uninstalled. Installed again (with SQLE 2005), did reboot.

Continued re-installation, selected a fixed IP (3443). It couldn't connect to the database server, so ran database administration, set all 'dynamic' ports to blank, all ports to 3443, set only server IP address and loopback port to enabled/active.

Database connection then worked, but database creation failed with an SQL error. Set database name to BESMgmt1 (rather than BESmgmt) and it worked - there must have been some residual remnant of the old database somewhere in the system.

Completed installation, and the same problem as before persists with the two admin processes stopping and restarting.

Tried rebooting the server, problem persists.

Ran Blackberry Server configuration, tested SQL connection, it is working correctly on fixed port 1433.

Hi all
I have the cowards way out!
About a week ago after a reboot I started experiencing issues with BAS again, being unable to access to manage users etc. This combined with our increasing requirements for access to our intranet, I uninstalled BESX 5.0.2 off the x3500 SBS2011 box and fired up an old x236 we had, installed our 2008R2 MAPS licence, rolled into the domain and installed BESX 5.0.3.
Installation went without a hitch and three hours after I started we have a fully functional BESX server on our SBS2011 domain.
This may not be of much help, but if you get to the end of your tether like I did there is certainly an alternative solution that works (if you have the resources available).

ASKER

I wish! sadly this is an SBS and the only machine at the site that runs 24x7, but I appreciate the suggestion - "do it on a non-SBS-2011 box". I have another instance working in another office on SBS-2008 with exchange 2007. Wish I hadn't put in SBS 2011 now, but I've done a load of other work on the server and am reluctant to downgrade now...

Hi ChopperChap,

Are you using v5.0.2 or v5.0.3?

According to RIM, this problem was identified in the former and fixed in the latter according to:

http://www.blackberry.com/btsc/dynamickc.do?externalId=KB23927&sliceID=1&command=show&forward=nonthreadedKC&kcId=KB23927

Although this does relate to Server 2008.

Now that you have an installed BES, can you post a new set of log files, please? I'll have another browse through them.

ASKER

BESE is at 5.0.2, I don't believe there is a 5.0.3 for Express.

One thing that page does suggest is the installation of an administration node on an alternate machine.

If I need to administer, I always have a Windows 7 machine available, it just doesn't run 24x7 to allow the blackberrys to function, but if the only purpose of that node is to do configuration against the BESE server running on the 2011 machine, that would be a good solution.

Can the BAS-AS and BAS-NCC services run on an alternate windows 7 machine?

Log files attached: server was last restarted late last night. Blackberry log files for two days, and 24 hrs of sys logs and app logs: for the app/sys logs please extract the two .txt files and rename to .evtx to view.

20110510.zip
Win-Logs-24hr.zip

Out of curiosity, can you stop the BAS-NCC and BAS-AS service, then stop the DNS Server and DNS Client services, start the BAS-AS service (which should start the BAS-NCC service) and see if the services start without crashing?

The DNS server conflict is an old problem and I'm not expecting it to work but it's worth checking.

ASKER

I Disabled BAS-AS and BAS-NCC, stopped DNS server and DNS client services, then re-enabled BAS-AS and BAS-NCC, starting them both.

They stopped again almost immediately.

I have now re-started DNS server, DNS client had restarted itself.

ASKER

Anyone care to comment on how I would go about setting up a remote administration node for BES Express 5.0.2 running the BAS and NCC services, on a Windows 7 machine, connecting through the network to the main Blackberry server on my SBS 2011 machine?

I can load up BES express on the Win7 machine, but I don't know how to go about only using it for administration... the only installations I've done are standalone.

Thanks

Do you have another Windows server license? I was thinking you could load up Hyper-V on the new server through up another 2008 standard server or whatever you have a license for and then try installing on it.

Just a thought.

ASKER

Nice thought... it's only an SBS on a small Dell T105 with 8GB of memory, so I don't know how much memory that would consume? It is a 64 bit OS. Does BES Express require installation on a Windows Server machine only?

http://us.blackberry.com/apps-software/business/server/express/RIM1365+System+Requirements_v4-HR.PDF
So you could through up a 32-bit Windows 2003/2008 Hyper-V server with 1.25GB of RAM and then install BES Express on that.

ASKER

Matt: Thanks for that: I have no experience of setting up a virtual machine, but if I can't get anywhere with the software, that may be an option.

ASKER CERTIFIED SOLUTION

membership

Create a free account to see this answer

Signing up is free and takes 30 seconds. No credit card required.

No problem. Sorry we couldn't get to the root of the problem before losing the race to the product cycle :-)

ASKER

Found this myself when searching for information about 5.0.2, just released this week by Blackberry.