Go Premium for a chance to win a PS4. Enter to Win

x
?
Solved

RHEL 5 : Can only log in as root

Posted on 2016-09-14
6
Medium Priority
?
56 Views
Last Modified: 2016-09-21
I rebooted my RHEL5 server today.  After discovering I couldn't remote in using ssh, I checked the console and it appeared the system was in runlevel 1 for some reason.  I rebooted again, watched the boot process and couldn't see anything significant.  I checked the runlevel, set the default runlevel to 3 and rebooted again with no effect.  I can log in to the console as root.  But, I cannot log in as any other existing user.  The login fails with no feedback.  If I try to "su - " to the user, I get a "permission" denied to the user's home directory and a "permission denied" to "/bin/bash".  I have tried to troubleshoot by adding a new user and logging in.  Same effect.

The "runlevel" command yields "N 3" which I am pretty sure means it thinks it is running in level 3 now.

All mounts seem to be OK.  I have rebooted with "-F" to force fsck, no problems.  I can navigate to all mounted volumes and access files on all of them.

I'm stumped.  The system was running and accessible when I rebooted earlier.  It is possible I mucked something up earlier when I was working on something else.  But, I am not sure what that might be.

I have crept around the web and there is rarely any mention of this problem.  When I find something, the suggestion of using "strace" is prevalent (did it, didn't reveal any permission issues that I can tell)  or some version of reinstall OS is deployed.

Anybody have any suggestions?
0
Comment
Question by:ecsginc
6 Comments
 
LVL 11

Expert Comment

by:loftyworm
ID: 41798694
I am no *nix guru, but I got strong suspicions that you have rooted :(

Maybe check your root boot files and see if anything is amiss

My 2 cents
0
 
LVL 11

Expert Comment

by:Scott Silva
ID: 41798894
Is there any message about damaged initrd or anything? If you have damaged boot files a system will usually drop to a minimal root session if it can get that far...
0
 

Author Comment

by:ecsginc
ID: 41801768
All boot of the errors are permissions issues similar to the su errors.  I am now thinking that somehow some uid, gid or permission got inadvertently change.  At this point I am now keying in on the sticky bit.  Does anyone have a list of standard system directories and or files where the sticky bit needs to be set?
0
What does it mean to be "Always On"?

Is your cloud always on? With an Always On cloud you won't have to worry about downtime for maintenance or software application code updates, ensuring that your bottom line isn't affected.

 

Accepted Solution

by:
ecsginc earned 0 total points
ID: 41802028
FYI - I solved my problem.  After scouring permissions and ownership until my eyes bled (all errors in /var/logs/dmesg and /ver/log/messages aligned with permissions issues) I threw a Hail Mary and executed "chmod 755 /".  prior to this it was more of 744.  That did the trick.

I am not sure why or how the permissions got changed (I am suspecting and errant scripting inadvertently executed as su/root with empty environment variables yielding "/" on a chmod operation).

Regardless, if anyone should end up on this thread with their own issues, changing the permissions on the root directory ("/") did the trick for me.
0
 

Author Closing Comment

by:ecsginc
ID: 41808401
I discovered the apparent cause of my original issue.
0
 
LVL 40

Expert Comment

by:omarfarid
ID: 41808426
If you have a backup for system taken before issue, then you can restore and you will get the old perms
0

Featured Post

Free Tool: Site Down Detector

Helpful to verify reports of your own downtime, or to double check a downed website you are trying to access.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

How many times have you wanted to quickly do the same thing to a list but found yourself typing it again and again? I first figured out a small time saver with the up arrow to recall the last command but that can only get you so far if you have a bi…
In part one, we reviewed the prerequisites required for installing SQL Server vNext. In this part we will explore how to install Microsoft's SQL Server on Ubuntu 16.04.
This demo shows you how to set up the containerized NetScaler CPX with NetScaler Management and Analytics System in a non-routable Mesos/Marathon environment for use with Micro-Services applications.
How to Install VMware Tools in Red Hat Enterprise Linux 6.4 (RHEL 6.4) Step-by-Step Tutorial
Suggested Courses
Course of the Month10 days, 2 hours left to enroll

927 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question