Jump to content
Welcome to our new Citrix community!
  • 0

No Local Storage Repository after clean install, can't create neither


birduser birduser

Question

Hello,

 

Here some data first:

- clean Xen 6.5, all Updates installed

- 1. HDD is for XEN system, 128.0 GByte

- 2. Storage is a RAID 5 (Controller: serveRaid m5110), 23999.9 GByte. This should be the local storage for the virtual machines.

- Local storage should be thin provisioned 

 

When installing I checked the RAID as storage and enabled thin provisioning but the local storage is not visible. When trying to create one I always get the following error:

 


Error code: SR_BACKEND_FAILURE_57

Error parameters: , Logical Volume filesystem creation error [opterr=mkfs failed error 1], 

 

 

cat /proc/partitions gives me


major minor  #blocks  name

 

   7        0      57296 loop0

   8        0  125034840 sda

   8        1    4193297 sda1

   8        2    4193297 sda2

   8       16 23437498368 sdb

 253        0 23437484032 dm-0

 

ll /dev/disk/by-id


lrwxrwxrwx 1 root root  9 24. Feb 00:22 scsi-3600605b008c1a5501e5917f849850cf8 -> ../../sdb

lrwxrwxrwx 1 root root  9 24. Feb 00:22 scsi-SATA_SanDisk_SD8SBAT154651402416 -> ../../sda

lrwxrwxrwx 1 root root 10 24. Feb 00:22 scsi-SATA_SanDisk_SD8SBAT154651402416-part1 -> ../../sda1

lrwxrwxrwx 1 root root 10 24. Feb 00:22 scsi-SATA_SanDisk_SD8SBAT154651402416-part2 -> ../../sda2

 

fdisk -l


WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk doesn't support GPT. Use GNU Parted.

 

 

Platte /dev/sda: 128.0 GByte, 128035676160 Byte

256 heads, 63 sectors/track, 15505 cylinders

Einheiten = Zylinder von 16128 × 512 = 8257536 Bytes

 

   Gerät  boot.     Anfang        Ende     Blöcke   Id  System

/dev/sda1   *           1       15506   125034839+  ee  EFI GPT

 

WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk doesn't support GPT. Use GNU Parted.

 

 

Platte /dev/sdb: 23999.9 GByte, 23999998328832 Byte

255 heads, 63 sectors/track, 2917833 cylinders

Einheiten = Zylinder von 16065 × 512 = 8225280 Bytes

 

Festplatte /dev/sdb enthält keine gültige Partitionstabelle

(translated: Device /dev/sdb doesn't contain a valid partition table)

 

For creating a new local storage repository I use:

xe sr-create content-type=user device-config:device=/dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8 host-uuid=c24b2f70-3841-4232-94a1-161da19f0993 name-label="Local Storage" shared=false type=ext

 

Result is:


Error code: SR_BACKEND_FAILURE_57

Error parameters: , Logical Volume filesystem creation error [opterr=mkfs failed error 1], 

 

When trying again I get:


The SR operation cannot be performed because a device underlying the SR is in use by the host.

 

cat /etc/firstboot.d/log/10-prepare-storage.log gives me


+ set -eu

+ CONFIGURATION=/etc/firstboot.d/data/default-storage.conf

+ . /opt/xensource/lib/storage-creation-utils.sh

++ DISKPREP=/opt/xensource/bin/diskprep

++ . /etc/xensource-inventory

+++ BUILD_NUMBER=90233c

+++ PLATFORM_VERSION=1.9.0

+++ DOM0_VCPUS=4

+++ INSTALLATION_UUID=c24b2f70-3841-4232-94a1-161da19f0993

+++ LINUX_KABI_VERSION=3.10.0+2

+++ MANAGEMENT_ADDRESS_TYPE=IPv4

+++ PRODUCT_VERSION_TEXT_SHORT=6.5

+++ BRAND_CONSOLE=XenCenter

+++ PRIMARY_DISK=/dev/disk/by-id/scsi-SATA_SanDisk_SD8SBAT154651402416

+++ PRODUCT_BRAND=XenServer

+++ INSTALLATION_DATE='2016-02-21 13:30:59.874612'

+++ PLATFORM_NAME=XCP

+++ COMPANY_NAME_SHORT=Citrix

+++ PRODUCT_VERSION_TEXT=6.5

+++ BACKUP_PARTITION=/dev/disk/by-id/scsi-SATA_SanDisk_SD8SBAT154651402416-part2

+++ PRODUCT_VERSION=6.5.0

+++ XEN_VERSION=4.4.1

+++ KERNEL_VERSION=3.10.41

+++ MANAGEMENT_INTERFACE=xenbr1

+++ DOM0_MEM=3072

+++ COMPANY_NAME='Citrix Systems, Inc.'

+++ PRODUCT_NAME=xenenterprise

+++ CONTROL_DOMAIN_UUID=7319ecb7-cf5a-43af-8051-656760fa9573

++ TAG=storage-creation-utils

+ UPGRADE=false

+ '[' -r /etc/firstboot.d/data/host.conf ']'

+ case $1 in

+ start

+ '[' false = true ']'

+ vgchange -a n

  No volume groups found

+ '[' -e /etc/firstboot.d/data/default-storage.conf ']'

+ source /etc/firstboot.d/data/default-storage.conf

++ XSPARTITIONS=/dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8

++ XSTYPE=ext

++ PARTITIONS=/dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8

++ TYPE=ext

+ case "$TYPE" in

+ mk_ext_sr /dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8

+ local partitions=/dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8

+ for p in '$partitions'

+ /opt/xensource/bin/diskprep -f /dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8

/dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8 is a symlink, de-referencing to /dev/sdb

Initialising disk /dev/sdb...

* Erasing start of volume

Complete.

++ echo /dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8

++ sed 's/ /,/g'

+ local partitions_cs=/dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8

+ sr_create 'Local storage' '' ext user local-storage '' device-config:device=/dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8

+ local 'name_label=Local storage'

+ local name_description=

+ local type=ext

+ local content_type=user

+ local i18n_key=local-storage

+ local i18n_index=

+ shift 6

+ wait_for_sm_plugin ext

+ local type=ext

+ shift 1

+ MAX_RETRIES=300

+ RETRY=0

+ logger -t storage-creation-utils 'Waiting for SM plugin ext to be registered'

+ '[' 0 -lt 300 ']'

++ /opt/xensource/bin/xe sm-list type=ext params=uuid --minimal

+ uuid=0c82b07d-3b22-0999-37bb-f99a6d854c0f

+ '[' '!' -z 0c82b07d-3b22-0999-37bb-f99a6d854c0f ']'

+ logger -t storage-creation-utils 'detected SM plugin ext complete after 0 / 300 s'

+ return 0

++ /opt/xensource/bin/xe sr-create 'name-label=Local storage' type=ext content-type=user host-uuid=c24b2f70-3841-4232-94a1-161da19f0993 device-config:device=/dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8

Error code: SR_BACKEND_FAILURE_57

Error parameters: , Logical Volume filesystem creation error [opterr=mkfs failed error 1], 

+ local sr_uuid=

+ '[' '!' '' ']'

+ echo 'SR creation failed.'

SR creation failed.

+ exit 1

 

Any Ideas why I can't create a thin provisioned local Storage with the RAID?

 

I already saw this topic, but it didn't helped:

http://discussions.citrix.com/topic/339274-xenserver-62-on-ibm-x3650-7954-m3-with-serveraid-m1015/

 

Thanks!

Link to comment

6 answers to this question

Recommended Posts

  • 0

Have you tried this using /dev/sdb instead of the /dev/disk/by-id/ path? Also, what kind of RAID controller is this? XenServer does not support software RAID. Also, did you try this with type=lvm just to see if that succeeds instead of with ext ?

Finally, did you unplug and destroy any remnants of the old local SR?

-=Tobias

Link to comment
  • 0

Hey Tobias, thanks for your reply!

 

As RAID controller we use an IBM ServeRaid 5100 which is identical in construction with a LSI Megaraid 9266-8i, it is a hardware RAID.

I already tried using /dev/sdb instead of the /dev/disk/by-id/ path which results in the same error but I also tried it with type=lvm and it worked, so it seems to be a problem with ext3.

 

Then I read, that ext3 with 4kb block size is limited to 16TB, so perhaps there is the problem. So I created a new partition manually on the RAID which contains all the space (23TB) an changed the block size to 8kb with:

/sbin/mkfs.ext3 /dev/sdb1 -b 8192

 

My fdisk -l is now:

WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk doesn't support GPT. Use GNU Parted.

 

 

Platte /dev/sda: 128.0 GByte, 128035676160 Byte

256 heads, 63 sectors/track, 15505 cylinders

Einheiten = Zylinder von 16128 × 512 = 8257536 Bytes

 

   Gerät  boot.     Anfang        Ende     Blöcke   Id  System

/dev/sda1   *           1       15506   125034839+  ee  EFI GPT

 

WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk doesn't support GPT. Use GNU Parted.

 

 

WARNING: The size of this disk is 24.0 TB (23999998328832 bytes).

DOS partition table format can not be used on drives for volumes

larger than 2.2 TB (2199023255040 bytes). Use parted(1) and GUID 

partition table format (GPT).

 

 

Platte /dev/sdb: 23999.9 GByte, 23999998328832 Byte

256 heads, 63 sectors/track, 2906435 cylinders

Einheiten = Zylinder von 16128 × 512 = 8257536 Bytes

 

   Gerät  boot.     Anfang        Ende     Blöcke   Id  System

/dev/sdb1               1      266306  2147483647+  ee  EFI GPT

 

And ll /dev/disk/by-id gives me:

lrwxrwxrwx 1 root root  9 24. Feb 03:33 scsi-3600605b008c1a5501e5917f849850cf8 -> ../../sdb

lrwxrwxrwx 1 root root 10 24. Feb 04:10 scsi-3600605b008c1a5501e5917f849850cf8-part1 -> ../../sdb1

lrwxrwxrwx 1 root root  9 24. Feb 03:33 scsi-SATA_SanDisk_SD8SBAT154651402416 -> ../../sda

lrwxrwxrwx 1 root root 10 24. Feb 03:33 scsi-SATA_SanDisk_SD8SBAT154651402416-part1 -> ../../sda1

lrwxrwxrwx 1 root root 10 24. Feb 03:33 scsi-SATA_SanDisk_SD8SBAT154651402416-part2 -> ../../sda2

 

Then I Use the sdb1 instead of sdb:

xe sr-create content-type=user device-config:device=/dev/disk/by-id/scsi-3600605b008c1a5501e5917f849850cf8-part1 host-uuid=c24b2f70-3841-4232-94a1-161da19f0993 name-label="Local Storage" shared=false type=ext

 

But it still results in the same error:

Error code: SR_BACKEND_FAILURE_57

Error parameters: , Logical Volume filesystem creation error [opterr=mkfs failed error 1], 

 

Finally  xe sr-list gives me:

uuid ( RO)                : d551a193-1ad3-d865-1277-02d5ef407073

          name-label ( RW): DVD drives

    name-description ( RW): Physical DVD drives

                host ( RO): xserver02

                type ( RO): udev

        content-type ( RO): iso

 

 

uuid ( RO)                : a7557484-3cff-9a19-eb6f-a418f91dd3fc

          name-label ( RW): Removable storage

    name-description ( RW): 

                host ( RO): xserver02

                type ( RO): udev

        content-type ( RO): disk

 

 

uuid ( RO)                : 2bd93aae-7506-aab5-a8b3-0b235548ec1a

          name-label ( RW): XenServer Tools

    name-description ( RW): XenServer Tools ISOs

                host ( RO): xserver02

                type ( RO): iso

        content-type ( RO): iso

 

So it doesn't seems like there are any remnants of the old local SR, should be OK.

 

Any Ideas?

 

P.S. pvdisplay gives me:

 --- Physical volume ---

  PV Name               /dev/sdb1

  VG Name               XSLocalEXT-4d1b9ce2-9875-dc0b-c280-9e50f5601a78

  PV Size               21,83 TB / not usable 12,98 MB

  Allocatable           yes (but full)

  PE Size (KByte)       4096

  Total PE              5722042

  Free PE               0

  Allocated PE          5722042

  PV UUID               nh8cxm-ja9c-5rsc-3acW-RKxF-zrZ3-Vtu0Ny

 

Link to comment

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...