Avatar of farzanj
farzanjFlag for Canada asked on

Huge file systems on Linux (Experienced Admin Please)

My company just had a terriable experience with an XFS file system with more than 13 TB of data.  I need the advise of the most experienced Admins, which file system should I use?  We probably will have to recreate the filesystem so it is time to find the options, pros and cons.
LinuxLinux NetworkingStorage

Avatar of undefined
Last Comment
farzanj

8/22/2022 - Mon
SOLUTION
zgiuffria

Log in or sign up to see answer
Become an EE member today7-DAY FREE TRIAL
Members can start a 7-Day Free trial then enjoy unlimited access to the platform
Sign up - Free for 7 days
or
Learn why we charge membership fees
We get it - no one likes a content blocker. Take one extra minute and find out why we block content.
See how we're fighting big data
Not exactly the question you had in mind?
Sign up for an EE membership and get your own personalized solution. With an EE membership, you can ask unlimited troubleshooting, research, or opinion questions.
ask a question
SOLUTION
torque_200bc

Log in or sign up to see answer
Become an EE member today7-DAY FREE TRIAL
Members can start a 7-Day Free trial then enjoy unlimited access to the platform
Sign up - Free for 7 days
or
Learn why we charge membership fees
We get it - no one likes a content blocker. Take one extra minute and find out why we block content.
See how we're fighting big data
Not exactly the question you had in mind?
Sign up for an EE membership and get your own personalized solution. With an EE membership, you can ask unlimited troubleshooting, research, or opinion questions.
ask a question
SOLUTION
Log in to continue reading
Log In
Sign up - Free for 7 days
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
ASKER
farzanj

We have lots of files and directories.  Files are not large at all.  Not whole lot of concurrent access.

Read/Write ratio is almost equal.  We are creating backups in and out of this filesystem so the ratios are equal.
SOLUTION
Log in to continue reading
Log In
Sign up - Free for 7 days
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
ASKER CERTIFIED SOLUTION
Log in to continue reading
Log In
Sign up - Free for 7 days
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
Gerald Connolly

what problems did you have with xfs?
SOLUTION
Log in to continue reading
Log In
Sign up - Free for 7 days
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
ASKER
farzanj

Problem with XFS:  It was unstable and got corrupted.  Moreover, we tried to recover it but it did not.  Initially it was not even showing the file system.  When e.g. I did ls -l and it would show question marks.  Then we tried to run file system repair command and it stopped every time in the middle with segmentation fault.  We just lost confidence on XFS and wanted a stable and recoverable and stable filesystem.
All of life is about relationships, and EE has made a viirtual community a real community. It lifts everyone's boat
William Peck
ASKER
farzanj

Reason for a large filesystem:  The server is used for backups and also for transfer of backups.  I am new in the organization and there is little in my control.  It appears that they have NetApps which has snapshots.  This system takes local backups--it is located in the same data center as the NetApps and other source computers.  Then the data is moved to another location -- remote backup.  That is done through this computer too.  Things are not done the ideal way and so is the situation with most organizations that I have consulted with.  But I want to learn the correct ways and strive to work on ideal practices that is why I pick brains of experts like all of you.  I really appreciate participation of all of you!!
David

go with solaris and ZFS INSTEAD
SOLUTION
Log in to continue reading
Log In
Sign up - Free for 7 days
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
SOLUTION
Log in to continue reading
Log In
Sign up - Free for 7 days
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
SOLUTION
Log in to continue reading
Log In
Sign up - Free for 7 days
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
SOLUTION
Log in to continue reading
Log In
Sign up - Free for 7 days
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.
ASKER
farzanj

Thank you all, seniors.  I appreciate everyone's help.  There may be small difference of opinions but you were all trying to help me and I am grateful for that.
Get an unlimited membership to EE for less than $4 a week.
Unlimited question asking, solutions, articles and more.