VMware Training
Jay Ashworth
jra at baylink.com
Thu Feb 20 03:46:22 UTC 2014
Why bother with a clustering FS, then, if you cannot actually /use it/ as one?
- jra
On February 19, 2014 10:44:22 PM EST, Jimmy Hess <mysidia at gmail.com> wrote:
>On Wed, Feb 19, 2014 at 2:06 PM, Jay Ashworth <jra at baylink.com> wrote:
>
>> ----- Original Message -----
>> > From: "Eugeniu Patrascu" <eugen at imacandi.net>
>> [snip]
>> My understanding of "cluster-aware filesystem" was "can be mounted at
>the
>> physical block level by multiple operating system instances with
>complete
>> safety". That seems to conflict with what you suggest, Eugeniu; am I
>> missing something (as I often do)?
>>
>
>When one of the hosts has a virtual disk file open for write access on
>a
>VMFS cluster-aware filesystem, it is locked to that particular host,
> and a process on a different host is denied the ability write to the
>file, or even open the file for read access.
>
>Another host cannot even read/write metadata about the file's directory
>entry.
>Attempts to do so, get rejected with an error.
>
>So you don't really have to worry all that much about "as long you
>don't
>access the same files", although: certainly you should not try to,
>either.
>
>Only the software in ESXi can access the VMFS --- there is no ability
>to
>run arbitrary applications.
>
>(Which is also, why I like NFS more than shared block storage; you can
>conceptually use the likes of a storage array feature such as
>FlexClone
>to make a copy-on-write clone of a file, take a storage level
>snapshot,
>and then do a granular restore of a specific VM; without having to
>restore the entire volume as a unit.
>
>You can't pull that off with a clustered filesystem on a block target!)
>
>
>Also, the VMFS filesystem is cluster aware by method of exclusion
>(SCSI
>Reservations) and separate journaling.
>
>Metadata locks are global in the VMFS cluster-aware filesystem. Only
>one
>host is allowed to write to
>any of the metadata -on the entire volume a- time, unless you have
>VAAI
>VMFS extensions, and your storage vendor supports the ATS (atomic
>test
>and set),
>resulting in a performance bottleneck.
>
>For that reason, while VMFS is cluster aware, you cannot necessarily
>have
>a large number of cluster nodes,
>or more than a few dozen open files, before performance degrades due
>to
>the metadata bottleneck.
>
>
>Another consideration is that; in the event that you have a power
>outage
>which simultaneously impacts your storage array and all your hosts:
>you
> may very well be unable to regain access to any of your files,
>until the specific host that had that file locked comes back up, or
>you
>wait out a ~30 to ~60 minute timeout period.
>
>
>
>
>> Cheers,
>> -- jra
>>
>--
>-JH
--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
More information about the NANOG
mailing list