![]() |
HowTo.Raid1onUnslung5 HistoryHide minor edits - Show changes to markup June 03, 2007, at 10:33 AM
by -- Additional troubleshooting
Added lines 308-311:
failed to RUN_ARRAY: When you try to create the raid array if you get an error message that says "mdadm: failed to add /dev/sdb2 to /dev/md2: Invalid argument mdadm: failed to RUN_ARRAY /dev/md2: Invalid argument " then the problem could be that you forgot to kill the usb_detect process and the slug has mounted the /dev/sd[ab][12] partitions. Unmount these and try again. May 29, 2006, at 02:19 PM
by -- Added Remark about RAID1 swap
Added lines 8-11:
RemarkI'm just curious about the use of mirrored swap partitions. I would basically set up swap in striped mode (Raid0) for performance. But if you take a look at http://linas.org/linux/Software-RAID/Software-RAID-8.html (Question 18) you'll see that you don't need to set up Raid0 for swap because the linux kernel is doing this automatically. March 06, 2006, at 12:16 AM
by --
Changed line 184 from:
to:
January 22, 2006, at 12:38 PM
by -- last comment was for rc.1 not rc.sysinit
Changed lines 146-147 from:
to:
January 22, 2006, at 12:36 PM
by -- Added comment about /root link in rc.sysinit
Added lines 146-147:
January 22, 2006, at 11:42 AM
by -- Add mknod call to linuxrc
Changed lines 122-123 from:
to:
/bin/mknod /dev/md4 b 9 4 2>/dev/null
October 27, 2005, at 03:59 AM
by -- detail addition
Changed line 226 from:
Edit to:
Edit October 26, 2005, at 05:01 AM
by -- added neccessary steps after fdisk-required reboot, changed order for partitioning unslung drive.
Changed lines 58-59 from:
Now use ' to:
Now use ' If fdisk requests a reboot for the changes to the partition table to become effective, do so. After rebooting, re-enabling telnet and logging in, don't forget to install the kernel modules again: # /sbin/insmod md.o # /sbin/insmod raid1.o Changed lines 172-174 from:
to:
While still running the slug from the second drive, prepare the partitions on the unslung drive in exactly the same way as it was done for the second drive before: Added lines 174-181:
Now the array can be prepared to use both disks:
Changed lines 183-184 from:
to:
September 02, 2005, at 08:04 AM
by --
Changed lines 54-55 from:
/dev/sdb4 173 36483 292872951 fd Linux raid autodetect to:
/dev/sdb4 173 36483 291668107+ fd Linux raid autodetect September 02, 2005, at 07:40 AM
by -- replaced copy with move in initrd
Changed line 288 from:
to:
September 02, 2005, at 07:30 AM
by -- Changed copy from initrd instructions
Changed line 240 from:
# cp /opt/sbin/mdadm /unslung/mdadm
to:
# mv /opt/sbin/mdadm /unslung/mdadm
Changed lines 243-244 from:
# /usr/bin/find . -name md.o -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /unslung
# /usr/bin/find . -name raid1.o -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /unslung
to:
# mv /lib/modules/2.4.22-xfs/kernel/drivers/md/md.o /unslung/md.o
# mv /lib/modules/2.4.22-xfs/kernel/drivers/md/raid1.o /unslung/raid1.o
September 01, 2005, at 03:41 PM
by -- Stopping the swap on /dev/md3 so we can umount it.
Added lines 145-146:
# swapoff /dev/md3
September 01, 2005, at 03:15 PM
by -- Adding the location of the kernel modules.
Changed line 126 from:
to:
September 01, 2005, at 10:56 AM
by -- Formatting Changes
Changed lines 141-144 from:
# cd / # umount /share/flash/conf # umount /share/flash/data/public # umount /share/flash/data to:
# cd /
# umount /share/flash/conf
# umount /share/flash/data/public
# umount /share/flash/data
Changed lines 146-149 from:
# /opt/sbin/mdadm -S /dev/md4 # /opt/sbin/mdadm -S /dev/md3 # /opt/sbin/mdadm -S /dev/md2 # /opt/sbin/mdadm -S /dev/md1 to:
# /opt/sbin/mdadm -S /dev/md4
# /opt/sbin/mdadm -S /dev/md3
# /opt/sbin/mdadm -S /dev/md2
# /opt/sbin/mdadm -S /dev/md1
Changed lines 184-186 from:
@@# cat /proc/mdstat
@@Personalities : [raid1]
@@read_ahead 1024 sectors
to:
# cat /proc/mdstat
Personalities : [raid1]
read_ahead 1024 sectors
Changed lines 216-219 from:
/unslung/mdadm -A /dev/md4 -R /dev/sdb4 /unslung/mdadm -A /dev/md3 -R /dev/sdb3 /unslung/mdadm -A /dev/md2 -R /dev/sdb2 /unslung/mdadm -A /dev/md1 -R /dev/sdb1 to:
/unslung/mdadm -A /dev/md4 -R /dev/sdb4
/unslung/mdadm -A /dev/md3 -R /dev/sdb3
/unslung/mdadm -A /dev/md2 -R /dev/sdb2
/unslung/mdadm -A /dev/md1 -R /dev/sdb1
Changed lines 221-222 from:
/unslung/mdadm --assemble --scan --config=/unslung/mdadm.conf /bin/sleep 140 to:
/unslung/mdadm --assemble --scan --config=/unslung/mdadm.conf
/bin/sleep 140
Changed lines 234-242 from:
# /usr/bin/ipkg-cl update
# /usr/bin/ipkg-cl install mdadm
# /usr/bin/ipkg-cl install kernel-module-md
# /usr/bin/ipkg-cl install kernel-module-raid1
# cp /opt/sbin/mdadm /unslung/mdadm
# chmod 755 /unslung/mdadm
# cd /
# /usr/bin/find . -name md.o -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /unslung
# /usr/bin/find . -name raid1.o -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /unslung
to:
# /usr/bin/ipkg-cl update
# /usr/bin/ipkg-cl install mdadm
# /usr/bin/ipkg-cl install kernel-module-md
# /usr/bin/ipkg-cl install kernel-module-raid1
# cp /opt/sbin/mdadm /unslung/mdadm
# chmod 755 /unslung/mdadm
# cd /
# /usr/bin/find . -name md.o -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /unslung
# /usr/bin/find . -name raid1.o -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /unslung
Changed lines 246-251 from:
# /sbin/insmod /unslung/md.o
# /sbin/insmod /unslung/raid1.o
# /unslung/mdadm -A /dev/md4 -R /dev/sdb4
# /unslung/mdadm -A /dev/md3 -R /dev/sdb3
# /unslung/mdadm -A /dev/md2 -R /dev/sdb2
# /unslung/mdadm -A /dev/md1 -R /dev/sdb1
to:
# /sbin/insmod /unslung/md.o
# /sbin/insmod /unslung/raid1.o
# /unslung/mdadm -A /dev/md4 -R /dev/sdb4
# /unslung/mdadm -A /dev/md3 -R /dev/sdb3
# /unslung/mdadm -A /dev/md2 -R /dev/sdb2
# /unslung/mdadm -A /dev/md1 -R /dev/sdb1
Changed line 253 from:
# /bin/mount -t ext3 /dev/md1 /share/hdd/data
to:
# /bin/mount -t ext3 /dev/md1 /share/hdd/data
Changed lines 259-264 from:
# cd /
# /bin/umount /share/hdd/data
# /unslung/mdadm -S /dev/md4
# /unslung/mdadm -S /dev/md3
# /unslung/mdadm -S /dev/md2
# /unslung/mdadm -S /dev/md1
to:
# cd /
# /bin/umount /share/hdd/data
# /unslung/mdadm -S /dev/md4
# /unslung/mdadm -S /dev/md3
# /unslung/mdadm -S /dev/md2
# /unslung/mdadm -S /dev/md1
Changed lines 266-269 from:
# /unslung/mdadm --zero-superblock /dev/sdb4
# /unslung/mdadm --zero-superblock /dev/sdb3
# /unslung/mdadm --zero-superblock /dev/sdb2
# /unslung/mdadm --zero-superblock /dev/sdb1
to:
# /unslung/mdadm --zero-superblock /dev/sdb4
# /unslung/mdadm --zero-superblock /dev/sdb3
# /unslung/mdadm --zero-superblock /dev/sdb2
# /unslung/mdadm --zero-superblock /dev/sdb1
Changed lines 282-285 from:
# /usr/bin/ipkg-cl update
# /usr/bin/ipkg-cl install mdadm
# /usr/bin/ipkg-cl install kernel-module-md
# /usr/bin/ipkg-cl install kernel-module-raid1
to:
# /usr/bin/ipkg-cl update
# /usr/bin/ipkg-cl install mdadm
# /usr/bin/ipkg-cl install kernel-module-md
# /usr/bin/ipkg-cl install kernel-module-raid1
September 01, 2005, at 10:50 AM
by -- Formatiing changes
Changed lines 15-19 from:
# ipkg update
# ipkg install busybox-base
# ipkg install mdadm
# ipkg install kernel-module-md
# ipkg install kernel-module-raid1
to:
# ipkg update
# ipkg install busybox-base
# ipkg install mdadm
# ipkg install kernel-module-md
# ipkg install kernel-module-raid1
Changed lines 21-23 from:
# /sbin/insmod md.o
# /sbin/insmod raid1.o
to:
# /sbin/insmod md.o
# /sbin/insmod raid1.o
Changed line 85 from:
Now we create the file systems on each of the three partitions, starting with the swap partition: to:
Now we create the file systems on each of the four partitions, starting with the swap partition: Changed line 116 from:
# cp /initrd/linuxrc /initrd/linuxrc.orig
to:
# cp /initrd/linuxrc /initrd/linuxrc.orig
Changed lines 118-125 from:
/sbin/insmod /unslung/md.o
/sbin/insmod /unslung/raid1.o
/unslung/mdadm -A /dev/md4 -R /dev/sdb4
/unslung/mdadm -A /dev/md3 -R /dev/sdb3
/unslung/mdadm -A /dev/md2 -R /dev/sdb2
/unslung/mdadm -A /dev/md1 -R /dev/sdb1
/bin/sleep 5
/bin/mount -rt ext3 /dev/md1 /mnt
to:
/sbin/insmod /unslung/md.o
/sbin/insmod /unslung/raid1.o
/unslung/mdadm -A /dev/md4 -R /dev/sdb4
/unslung/mdadm -A /dev/md3 -R /dev/sdb3
/unslung/mdadm -A /dev/md2 -R /dev/sdb2
/unslung/mdadm -A /dev/md1 -R /dev/sdb1
/bin/sleep 5
/bin/mount -rt ext3 /dev/md1 /mnt
Changed lines 128-132 from:
# ls -l /initrd/unslung
-rw-rw-r-- 1 root root 53392 Jul 19 22:15 md.o
-rwxrwxr-x 1 root root 121368 Jul 19 22:15 mdadm
-rw-rw-r-- 1 root root 20192 Jul 19 22:15 raid1.o
to:
# ls -l /initrd/unslung
-rw-rw-r-- 1 root root 53392 Jul 19 22:15 md.o
-rwxrwxr-x 1 root root 121368 Jul 19 22:15 mdadm
-rw-rw-r-- 1 root root 20192 Jul 19 22:15 raid1.o
Changed lines 134-139 from:
# ls -l /share/flash/data/unslung
-rw-r--r-- 1 root root 1902 Aug 29 11:34 rc.1
-rw-r--r-- 1 root root 1488 Aug 29 14:50 rc.halt
-rw-r--r-- 1 root root 1140 Aug 29 14:50 rc.reboot
-rw-r--r-- 1 root root 1437 Aug 29 11:37 rc.sysinit
to:
# ls -l /share/flash/data/unslung
-rw-r--r-- 1 root root 1902 Aug 29 11:34 rc.1
-rw-r--r-- 1 root root 1488 Aug 29 14:50 rc.halt
-rw-r--r-- 1 root root 1140 Aug 29 14:50 rc.reboot
-rw-r--r-- 1 root root 1437 Aug 29 11:37 rc.sysinit
Changed lines 172-176 from:
# mknod /dev/md4 b 9 4 2>/dev/null
# /unslung/mdadm -A /dev/md4 -R /dev/sdb4
# /unslung/mdadm -A /dev/md3 -R /dev/sdb3
# /unslung/mdadm -A /dev/md2 -R /dev/sdb2
# /unslung/mdadm -A /dev/md1 -R /dev/sdb1
to:
# mknod /dev/md4 b 9 4 2>/dev/null
# /unslung/mdadm -A /dev/md4 -R /dev/sdb4
# /unslung/mdadm -A /dev/md3 -R /dev/sdb3
# /unslung/mdadm -A /dev/md2 -R /dev/sdb2
# /unslung/mdadm -A /dev/md1 -R /dev/sdb1
Changed lines 178-181 from:
# /unslung/mdadm -a /dev/md3 /dev/sda3
# /unslung/mdadm -a /dev/md2 /dev/sda2
# /unslung/mdadm -a /dev/md1 /dev/sda1
# /unslung/mdadm -a /dev/md4 /dev/sda4
to:
# /unslung/mdadm -a /dev/md3 /dev/sda3
# /unslung/mdadm -a /dev/md2 /dev/sda2
# /unslung/mdadm -a /dev/md1 /dev/sda1
# /unslung/mdadm -a /dev/md4 /dev/sda4
Changed lines 184-197 from:
# cat /proc/mdstat
Personalities : [raid1]
read_ahead 1024 sectors
md1 : active raid1 scsi/host1/bus0/target0/lun0/part1[2] sdb1[0]
1204736 blocks [2/2] [UU]
md2 : active raid1 scsi/host1/bus0/target0/lun0/part2[1] sdb2[0]
120384 blocks [2/2] [UU]
md3 : active raid1 scsi/host1/bus0/target0/lun0/part3[1] sdb3[0]
56128 blocks [2/2] [UU]
md4 : active raid1 scsi/host1/bus0/target0/lun0/part4[2] sdb4[0]
291668032 blocks [2/1] [U_]
[>....................] recovery = 0.0% (25664/291668032) finish=569.7min speed=8554K/sec
unused devices: <none>
to:
@@# cat /proc/mdstat
@@Personalities : [raid1]
@@read_ahead 1024 sectors
md1 : active raid1 scsi/host1/bus0/target0/lun0/part1[2] sdb1[0]
1204736 blocks [2/2] [UU]
md2 : active raid1 scsi/host1/bus0/target0/lun0/part2[1] sdb2[0]
120384 blocks [2/2] [UU]
md3 : active raid1 scsi/host1/bus0/target0/lun0/part3[1] sdb3[0]
56128 blocks [2/2] [UU]
md4 : active raid1 scsi/host1/bus0/target0/lun0/part4[2] sdb4[0]
291668032 blocks [2/1] [U_]
[>....................] recovery = 0.0% (25664/291668032) finish=569.7min speed=8554K/sec
unused devices: <none>
September 01, 2005, at 10:44 AM
by --
Changed lines 54-55 from:
/dev/sdb1 173 36483 292872951 fd Linux raid autodetect to:
/dev/sdb4 173 36483 292872951 fd Linux raid autodetect September 01, 2005, at 10:21 AM
by -- Fixed important error in \"/opt/sbin/mdadm --create\" statements
Changed lines 64-69 from:
# /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md4 /dev/sda4 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md3 /dev/sda3 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md2 /dev/sda2 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md1 /dev/sda1 missing to:
# /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md4 /dev/sdb4 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md3 /dev/sdb3 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md2 /dev/sdb2 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md1 /dev/sdb1 missing September 01, 2005, at 10:16 AM
by --
Added lines 56-57:
The sizes of the first three partitions should match this table exactly, the size of the fourth partition will depend on the size of the hard drive. My hard drive is 300GB. September 01, 2005, at 09:51 AM
by --
Changed lines 221-222 from:
Then switch off the slug and switch it back on again. to:
I picked 140 seconds as that is enough time for my (overclocked) slug to resync the boot (1GB) partition. Switch off the slug and switch it back on again, telnet/ssh in and run Changed line 226 from:
Reboot Failed: If you were getting to:
Reboot with one drive attached failed: If you were getting Changed lines 231-240 from:
to:
# /usr/bin/ipkg-cl update
# /usr/bin/ipkg-cl install mdadm
# /usr/bin/ipkg-cl install kernel-module-md
# /usr/bin/ipkg-cl install kernel-module-raid1
# cp /opt/sbin/mdadm /unslung/mdadm
# chmod 755 /unslung/mdadm
# cd /
# /usr/bin/find . -name md.o -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /unslung
# /usr/bin/find . -name raid1.o -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /unslung
September 01, 2005, at 09:39 AM
by --
Changed lines 229-230 from:
to:
September 01, 2005, at 09:32 AM
by -- Added to power loss troubleshooting
Added line 60:
Added line 67:
Changed lines 198-199 from:
If you prematurely switch off the slug while this resync is writing to the disks nasty things can happen. I lost one of my harddrives by switching the slug off this way (I got impatient). Luckily I didn't lose any data as the other drive was ok but the damaged drive was rendered useless. to:
If you prematurely switch off the slug while this resync is writing to the disks (drive lights flashing) nasty things can happen. I lost one of my harddrives by switching the slug off this way (I got impatient). Luckily I didn't lose any data as the other drive was ok but the damaged drive was rendered useless. Changed lines 278-279 from:
Power Loss: Raid 1 obviously won't help if you lose both drive simultaneously. Read http://www.tldp.org/HOWTO/Software-RAID-0.4x-HOWTO-4.html and follow steps 1 to 3 of method 2 and then repeat the steps in this howto starting at "Resyncing the RAID arrays".
PS The to:
Power Loss: Raid 1 obviously won't help if you lose both drives simultaneously but unless you're very unlucky you shouldn't lose any data. The worst that might happen is that one of the disks will have to be replaced if the slug was performing an I/O operation on it when the power went. After a power loss you must restart the slug with no drives attached and then repeat the steps in this howto starting at "Resyncing the RAID arrays". The reason that you cannot simply reboot is that all 4 raid arrays will try to resync and, because of the load on the CPU during startup, they will never finish the resync. If you suspect that the slug was performing a disk read or write operation when you lost power then the disks might be corrupted. Read http://www.tldp.org/HOWTO/Software-RAID-0.4x-HOWTO-4.html and follow steps 1 to 3 of method 2 before repeating the steps in this howto starting at "Resyncing the RAID arrays". PS The This leads to the obvious warning: Never switch the slug off while it is reading/writing to a raid array (Drive lights flashing). August 29, 2005, at 04:54 PM
by -- Using 4 partitions to avoid resync problem
Changed lines 4-6 from:
Diversion scripts have been written to start the raid array during the boot process and stop the array before shutdown. Initial Setupto:
Diversion scripts have been written to start the raid array during the boot process and stop the array before shutdown. Unfortunately it is not possible to stop the array that contains the root filesystem during the shutdown process. This means that that array is marked as 'dirty' on shutdown and it will resync when restarted. Resyncing can take hours for a large partition and no other process can run while the resyncing is happening. To get around this problem this howto splits the root partition into a small partition containing the system files and a much larger partition to hold public files. This howto uses custom partitions on the attached hardrives making it impossible to return to the normal Unslung setup without repartitioning the drives and wiping all data. (Of course you can transfer the data off the drives before re-partitioning). Initial SetupChanged lines 12-13 from:
to:
Changed line 16 from:
# ipkg install busybox
to:
# ipkg install busybox-base
Changed lines 24-27 from:
Change Partition TypesThe standard NSLU2-formatted disk has three partitions: A 50MB swap partition, a 100MB config partition (mounted as /share/hdd/conf) and the rest of the disk as a data partition (mounted as /share/hdd/data). This howto mirrors all three partitions but it is possible that mirroring the swap partition is a mistake and will have a performance cost when writing to disk. The files in the conf partition are used by Samba and the passwd utility so the conf partition must be mirrored if mirroring the data partition. In order for the RAID arrays to work on a reboot we need to change the partition types from to:
Change Hard Drive PartitionsThe standard NSLU2-formatted disk has three partitions: A 50MB swap partition, a 100MB config partition (mounted as /share/hdd/conf) and the rest of the disk as a data partition (mounted as /share/hdd/data). Unslung 5.5 also uses the data partition as the root filesystem. When the NSLU2 is switched off or reboots it will try to stop all the raid arrays. Any arrays that are not cleanly stopped will resync during the startup process. The resyncing process can take up to 10 hours for a 300GB harddrive and no other processes can run during that time. That would mean that your sytem is out of action for up to 10 hours everytime you reboot and to avoid this I split the data partition into a 1GB root partition and a 299GB data partition. This howto mirrors all four partitions. I had thought that mirroring the swap partition could have a performance cost when writing to disk (and indeed it does) but I believe there are more read operations (where there is a performance gain) than write operations on swap space. The files in the conf partition are used by Samba and the passwd utility so the conf partition must be mirrored if mirroring the data partition. In order for the RAID arrays to work on a reboot we also need to change the partition types from Changed lines 32-33 from:
Be careful to use ' to:
Be careful to use /dev/sdb, the repartitioning process wipes all existing data from the drive. Changed lines 44-50 from:
Now use option ' Device Boot Start End Blocks Id System /dev/sdb1 1 36461 292872951 fd Linux raid autodetect /dev/sdb2 36462 36476 120487+ fd Linux raid autodetect /dev/sdb3 36477 36483 56227+ fd Linux raid autodetect to:
Use option 'd' to delete all three partitions Now use option ' Now use option ' Device Boot Start End Blocks Id System /dev/sdb1 1 150 1204843+ fd Linux raid autodetect /dev/sdb2 151 165 120487+ fd Linux raid autodetect /dev/sdb3 166 172 56227+ fd Linux raid autodetect /dev/sdb1 173 36483 292872951 fd Linux raid autodetect Changed lines 59-63 from:
Create one array for each partition (three in total). The missing parameter indicates that the array is incomplete and that we will supply the second device later. This is referred to as starting the raid in 'degraded' mode. Descriptions of the option parameters can be found in the mdadm man page. # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md3 /dev/sdb3 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md2 /dev/sdb2 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md1 /dev/sdb1 missing to:
Create one array for each partition (four in total). The ' # mknod /dev/md4 b 9 4 2>/dev/null # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md4 /dev/sda4 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md3 /dev/sda3 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md2 /dev/sda2 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md1 /dev/sda1 missing Changed line 71 from:
292872832 blocks [2/1] [U_] to:
1204736 blocks [2/1] [U_] Added lines 76-77:
md4 : active raid1 scsi/host0/bus0/target0/lun0/part4[0]
291668032 blocks [2/1] [U_]
Changed line 84 from:
Then the to:
Then the Changed lines 87-88 from:
to:
# /usr/bin/mke2fs -j /dev/md4 Changed lines 92-96 from:
to:
# mkdir /share/flash/data/public # chown admin.everyone /share/flash/data/public # chmod 775 /share/flash/data/public # mount -t ext3 /dev/md4 /share/flash/data/public Changed line 98 from:
This code was nabbed from the to:
This code was nabbed from the Changed lines 102-104 from:
# /usr/bin/find / -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /share/flash/data The slug can manage about 10 MBytes?/sec at most so this last command could take a long time if you have a lot of data. There might be a quicker way using the dd command but this way works for me. to:
# /usr/bin/find . -path './public' -prune -o -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /share/flash/data # cd /public # /usr/bin/find ./ -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /share/flash/data/public The slug can manage about 10 Mbytes/sec at most so this last command could take a long time if you have a lot of data. There might be a quicker way using the dd command but this way works for me. (I have found the dd command useful for files that are too large for the cp command e.g. DVD ISO files) Changed lines 109-110 from:
In Unslung 5.5 the root filesystem is mounted on one of the harddrives on reboot. The script that actually does the mounting is called ' to:
In Unslung 5.5 the root filesystem is mounted on one of the harddrives on reboot. The script that actually does the mounting is called ' Changed line 113 from:
to:
Added line 116:
/unslung/mdadm -A /dev/md4 -R /dev/sdb4
Changed line 123 from:
to:
Changed lines 128-130 from:
-rw-r--r-- 1 root root 299 Aug 11 08:41 rc.halt
-rw-r--r-- 1 root root 242 Aug 11 08:16 rc.reboot
to:
Changed lines 131-135 from:
-rw-r--r-- 1 root root 2025 Aug 7 22:35 rc.1
-rw-r--r-- 1 root root 1258 Aug 11 08:41 rc.halt
-rw-r--r-- 1 root root 166 Aug 7 21:12 rc.local
-rw-r--r-- 1 root root 1395 Aug 11 07:56 rc.reboot
-rw-r--r-- 1 root root 406 Aug 7 21:12 rc.sysinit
to:
-rw-r--r-- 1 root root 1902 Aug 29 11:34 rc.1
-rw-r--r-- 1 root root 1488 Aug 29 14:50 rc.halt
-rw-r--r-- 1 root root 1140 Aug 29 14:50 rc.reboot
-rw-r--r-- 1 root root 1437 Aug 29 11:37 rc.sysinit
Changed line 147 from:
to:
Added lines 159-160:
This step in the process wipes all data from your unslung drive. If you're not confident about doing that for any reason then just perform these steps on another blank drive and leave your unslung drive untouched. That way, in order to return to your original configuration you just have to replace the original linuxrc file and reboot with the unslung drive attached. Added lines 168-169:
# mknod /dev/md4 b 9 4 2>/dev/null
# /unslung/mdadm -A /dev/md4 -R /dev/sdb4
Changed lines 177-178 from:
The order is important here: The /dev/md1 aray will take hours to resync so you should do the other two first. to:
# /unslung/mdadm -a /dev/md4 /dev/sda4
The order is important here: The /dev/md4 aray will take hours to resync so you should do the other three first. Changed lines 184-185 from:
292872832 blocks [2/1] [U_]
[>....................] recovery = 0.0% (25664/292872832) finish=569.7min speed=8554K/sec
to:
1204736 blocks [2/2] [UU]
Added lines 189-191:
md4 : active raid1 scsi/host1/bus0/target0/lun0/part4[2] sdb4[0]
291668032 blocks [2/1] [U_]
[>....................] recovery = 0.0% (25664/291668032) finish=569.7min speed=8554K/sec
Changed lines 194-201 from:
Yes, it really will take 569 minutes (almost 10 hours) to resync my two 300GB drives. For $70 you get 10MByte/sec throughput and that's it! While the disks are resyncing I don't touch the slug. I have found that if I try to perform any I/O tasks the speed of resyncing falls precipitiously and never rises back up so I just leave it alone (say, overnight) until it's finished. If anyone knows why this is I would appreciate it if they posted it here.
This is also the reason why the resyncing is done on the standard Linksys filesystem rather than the unslung filesystem: The slug is constantly writing to Once the resyncing has completed we stop the raid arrays, edit # /unslung/mdadm -S /dev/md3 # /unslung/mdadm -S /dev/md2 # /unslung/mdadm -S /dev/md1 to:
Yes, it really will take 569 minutes (almost 10 hours) to resync my two 300GB drives. For $70 you get 10MByte/sec throughput and that's it! While the disks are resyncing it's best not to touch the slug. I have found that if I try to perform any I/O tasks the speed of resyncing falls precipitiously and never rises back up so I just leave it alone (say, overnight) until it's finished. There are parameters that can be adjusted (Google for mdadm speed_limit_max) but i have found them to be ineffective.
This is also the reason why the resyncing is done on the standard Linksys filesystem rather than the unslung filesystem: The slug is constantly writing to Once the resyncing has completed we create a mdadm.conf file, then stop the raid arrays, edit # /bin/echo "DEVICE /dev/sd[ab][1234]" > /unslung/mdadm.conf # /unslung/mdadm --detail --scan >> /unslung/mdadm.conf Mount the new root filesystem and copy mdadm.conf into place: # mount -t ext3 /dev/md1 /share/hdd/data # cp /unslung/mdadm.conf /share/hdd/data/opt/etc/mdadm.conf # umount /share/hdd/data Stop the raid arrays: # /unslung/mdadm --stop --scan --config=/unslung/mdadm.conf Added line 212:
/unslung/mdadm -A /dev/md4 -R /dev/sdb4 Changed lines 217-219 from:
/unslung/mdadm -A /dev/md3 /dev/sdb3 /dev/sda3 /unslung/mdadm -A /dev/md2 /dev/sdb2 /dev/sda2 /unslung/mdadm -A /dev/md1 /dev/sdb1 /dev/sda1 to:
/unslung/mdadm --assemble --scan --config=/unslung/mdadm.conf /bin/sleep 140 Added line 233:
# /unslung/mdadm -A /dev/md4 -R /dev/sdb4
Changed line 237 from:
to:
Added line 246:
# /unslung/mdadm -S /dev/md4
Added line 251:
# /unslung/mdadm --zero-superblock /dev/sdb4
Changed line 255 from:
to:
Changed lines 257-258 from:
to:
August 12, 2005, at 08:03 AM
by --
Changed line 119 from:
to:
August 12, 2005, at 08:02 AM
by -- Corrected reference to diversion script page
Changed line 99 from:
to:
August 12, 2005, at 07:59 AM
by --
Changed lines 89-90 from:
# cp linuxrc linuxrc.orig
to:
# cp /initrd/linuxrc /initrd/linuxrc.orig
Changed lines 191-192 from:
to:
Added lines 208-222:
Slug doesn't reboot with no drives attached: This is probably caused by an error in the linuxrc script. To fix it you will need to flash the 5.5 firmware onto the slug again. No data should have been lost at this stage and you can still return to your original unslung configuration. This section will not work unless you were unslung on 5.x (or maybe 4.x at a pinch).
# /usr/bin/ipkg-cl update
# /usr/bin/ipkg-cl install mdadm
# /usr/bin/ipkg-cl install kernel-module-md
# /usr/bin/ipkg-cl install kernel-module-raid1
August 11, 2005, at 10:11 PM
by --
Added lines 1-211:
SummaryThis page describes setting up RAID 1 (mirror drives) on the NSLU2. The process starts with a blank drive and an unslung drive and ends up with two mirrored drives containing all the data stored on the originally-unslung drive. This is achieved by creating a raid array with just the blank second drive at first, copying the entire contents of the unslung drive onto it and then hotadding the unslung drive to the raid array. Diversion scripts have been written to start the raid array during the boot process and stop the array before shutdown. Initial Setup
# ipkg update
# ipkg install busybox
# ipkg install mdadm
# ipkg install kernel-module-md
# ipkg install kernel-module-raid1
# /sbin/insmod md.o
# /sbin/insmod raid1.o
Change Partition TypesThe standard NSLU2-formatted disk has three partitions: A 50MB swap partition, a 100MB config partition (mounted as /share/hdd/conf) and the rest of the disk as a data partition (mounted as /share/hdd/data). This howto mirrors all three partitions but it is possible that mirroring the swap partition is a mistake and will have a performance cost when writing to disk. The files in the conf partition are used by Samba and the passwd utility so the conf partition must be mirrored if mirroring the data partition. In order for the RAID arrays to work on a reboot we need to change the partition types from #/opt/bin/busybox fdisk /dev/sdb Be careful to use ' Then press ' Disk /dev/sdb: 300.0 GB, 300090728448 bytes 255 heads, 63 sectors/track, 36483 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdb1 1 36461 292872951 83 Linux /dev/sdb2 36462 36476 120487+ 83 Linux /dev/sdb3 36477 36483 56227+ 82 Linux swap Now use option ' Device Boot Start End Blocks Id System /dev/sdb1 1 36461 292872951 fd Linux raid autodetect /dev/sdb2 36462 36476 120487+ fd Linux raid autodetect /dev/sdb3 36477 36483 56227+ fd Linux raid autodetect Now use ' Create and Mount RAID arraysCreate one array for each partition (three in total). The missing parameter indicates that the array is incomplete and that we will supply the second device later. This is referred to as starting the raid in 'degraded' mode. Descriptions of the option parameters can be found in the mdadm man page. # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md3 /dev/sdb3 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md2 /dev/sdb2 missing # /opt/sbin/mdadm --create --level=1 --raid-devices=2 /dev/md1 /dev/sdb1 missing Run # cat /proc/mdstat
Personalities : [raid1]
read_ahead 1024 sectors
md1 : active raid1 scsi/host0/bus0/target0/lun0/part1[0]
292872832 blocks [2/1] [U_]
md2 : active raid1 scsi/host0/bus0/target0/lun0/part2[0]
120384 blocks [2/1] [U_]
md3 : active raid1 scsi/host0/bus0/target0/lun0/part3[0]
56128 blocks [2/1] [U_]
unused devices: <none>
There are other monitor functions that you can play around with such as " Now we create the file systems on each of the three partitions, starting with the swap partition: # /sbin/mkswap /dev/md3 # /sbin/swapon /dev/md3 Then the # /usr/bin/mke2fs -j /dev/md2 # /usr/bin/mke2fs -j /dev/md1 Mount the new partitions on the 'flash' directory temporarily. We will remount them to their rightful place (/share/hdd/data) on reboot. # mount -t ext3 /dev/md2 /share/flash/conf # mount -t ext3 /dev/md1 /share/flash/data Copy entire file system to RAID partitionsThis code was nabbed from the # cd /share/hdd/conf # /usr/bin/find ./ -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /share/flash/conf # cd / # /usr/bin/find / -print0 -mount | /usr/bin/cpio -p -0 -d -m -u /share/flash/data The slug can manage about 10 MBytes?/sec at most so this last command could take a long time if you have a lot of data. There might be a quicker way using the dd command but this way works for me. Diversion ScriptsIn Unslung 5.5 the root filesystem is mounted on one of the harddrives on reboot. The script that actually does the mounting is called '
# cp linuxrc linuxrc.orig
/sbin/insmod /unslung/md.o
/sbin/insmod /unslung/raid1.o
/unslung/mdadm -A /dev/md3 -R /dev/sdb3
/unslung/mdadm -A /dev/md2 -R /dev/sdb2
/unslung/mdadm -A /dev/md1 -R /dev/sdb1
/bin/sleep 5
/bin/mount -rt ext3 /dev/md1 /mnt
# ls -l /initrd/unslung
-rw-rw-r-- 1 root root 53392 Jul 19 22:15 md.o
-rwxrwxr-x 1 root root 121368 Jul 19 22:15 mdadm
-rw-rw-r-- 1 root root 20192 Jul 19 22:15 raid1.o
-rw-r--r-- 1 root root 299 Aug 11 08:41 rc.halt
-rw-r--r-- 1 root root 242 Aug 11 08:16 rc.reboot
# ls -l /share/flash/data/unslung
-rw-r--r-- 1 root root 2025 Aug 7 22:35 rc.1
-rw-r--r-- 1 root root 1258 Aug 11 08:41 rc.halt
-rw-r--r-- 1 root root 166 Aug 7 21:12 rc.local
-rw-r--r-- 1 root root 1395 Aug 11 07:56 rc.reboot
-rw-r--r-- 1 root root 406 Aug 7 21:12 rc.sysinit
Resyncing the RAID ArraysAt this stage we have a working RAID array containing just a single drive. The second drive is still unslung and you could still return to your original configuration. The next step is to add the unslung drive to the raid array to take it out of degraded mode.
# /unslung/mdadm -A /dev/md3 -R /dev/sdb3
# /unslung/mdadm -A /dev/md2 -R /dev/sdb2
# /unslung/mdadm -A /dev/md1 -R /dev/sdb1
# /unslung/mdadm -a /dev/md3 /dev/sda3
# /unslung/mdadm -a /dev/md2 /dev/sda2
# /unslung/mdadm -a /dev/md1 /dev/sda1
The order is important here: The /dev/md1 aray will take hours to resync so you should do the other two first.
# cat /proc/mdstat
Personalities : [raid1]
read_ahead 1024 sectors
md1 : active raid1 scsi/host1/bus0/target0/lun0/part1[2] sdb1[0]
292872832 blocks [2/1] [U_]
[>....................] recovery = 0.0% (25664/292872832) finish=569.7min speed=8554K/sec
md2 : active raid1 scsi/host1/bus0/target0/lun0/part2[1] sdb2[0]
120384 blocks [2/2] [UU]
md3 : active raid1 scsi/host1/bus0/target0/lun0/part3[1] sdb3[0]
56128 blocks [2/2] [UU]
unused devices: <none>
Yes, it really will take 569 minutes (almost 10 hours) to resync my two 300GB drives. For $70 you get 10MByte/sec throughput and that's it! While the disks are resyncing I don't touch the slug. I have found that if I try to perform any I/O tasks the speed of resyncing falls precipitiously and never rises back up so I just leave it alone (say, overnight) until it's finished. If anyone knows why this is I would appreciate it if they posted it here.
This is also the reason why the resyncing is done on the standard Linksys filesystem rather than the unslung filesystem: The slug is constantly writing to Once the resyncing has completed we stop the raid arrays, edit # /unslung/mdadm -S /dev/md3 # /unslung/mdadm -S /dev/md2 # /unslung/mdadm -S /dev/md1 Edit /unslung/mdadm -A /dev/md3 -R /dev/sdb3 /unslung/mdadm -A /dev/md2 -R /dev/sdb2 /unslung/mdadm -A /dev/md1 -R /dev/sdb1 With /unslung/mdadm -A /dev/md3 /dev/sdb3 /dev/sda3 /unslung/mdadm -A /dev/md2 /dev/sdb2 /dev/sda2 /unslung/mdadm -A /dev/md1 /dev/sdb1 /dev/sda1 Then switch off the slug and switch it back on again. Err... that's it! You should have a working raid 1 array. Troubleshooting:Reboot Failed: If you were getting
# /sbin/insmod /unslung/md.o
# /sbin/insmod /unslung/raid1.o
# /unslung/mdadm -A /dev/md3 -R /dev/sdb3
# /unslung/mdadm -A /dev/md2 -R /dev/sdb2
# /unslung/mdadm -A /dev/md1 -R /dev/sdb1
# /bin/mount -t ext3 /dev/md1 /share/hdd/data
Return to original unslung configuration:
# cd /
# /bin/umount /share/hdd/data
# /unslung/mdadm -S /dev/md3
# /unslung/mdadm -S /dev/md2
# /unslung/mdadm -S /dev/md1
# /unslung/mdadm --zero-superblock /dev/sdb3
# /unslung/mdadm --zero-superblock /dev/sdb2
# /unslung/mdadm --zero-superblock /dev/sdb1
Failed Drive: Repeat the steps in this howto starting at "Resyncing the RAID arrays". Power Loss: Raid 1 obviously won't help if you lose both drive simultaneously. Read http://www.tldp.org/HOWTO/Software-RAID-0.4x-HOWTO-4.html and follow steps 1 to 3 of method 2 and then repeat the steps in this howto starting at "Resyncing the RAID arrays".
PS The
view ·
edit ·
print ·
history ·
Last edited by nsc.
Based on work by PatrickSchneider, nsc, Torsten Bitz, and dcordes. Originally by nsc. Page last modified on June 03, 2007, at 10:33 AM
|