Sankofa/docs/ceph/MANUAL_VERIFICATION_STEPS.md

Manual Verification Steps for 250GB Drives on R630-01

Date: 2025-12-13
Purpose: Manual steps to verify 250GB drives when SSH access requires authentication

---

Quick Verification Commands

SSH to R630-01 (192.168.11.11) and run these commands:

Step 1: List All Block Devices

lsblk -o NAME,SIZE,TYPE,MOUNTPOINT,FSTYPE,MODEL,SERIAL

Look for: 6x drives around 250GB (232-260 GB range)

Step 2: List All Physical Disks

fdisk -l | grep -E "^Disk /dev/sd" | sort

Look for: Disks showing ~250GB or ~232-260 GB

Step 3: Check Current Ceph OSDs

ceph osd tree
ceph osd df
ceph health detail

Expected: Should show 2 OSDs currently

Step 4: Check Storage Pools

pvesm status

Look for: Storage pools and their usage

Step 5: Check Volume Groups

vgs
pvs

Look for: Which disks are in volume groups

---

One-Line Verification Script

Copy and paste this entire block into R630-01:

echo "=== R630-01 Disk Verification ===" && \
echo "" && \
echo "1. All Block Devices:" && \
lsblk -o NAME,SIZE,TYPE,MOUNTPOINT,FSTYPE,MODEL,SERIAL && \
echo "" && \
echo "2. All Physical Disks:" && \
fdisk -l 2>/dev/null | grep -E "^Disk /dev/sd" | sort && \
echo "" && \
echo "3. 250GB Drives (232-260 GB):" && \
for disk in /dev/sd[a-z]; do [ -b "$disk" ] && fdisk -l "$disk" 2>/dev/null | grep "^Disk $disk" | awk -v d="$disk" '{size=$3" "$4; if (size ~ /232|233|234|235|236|237|238|239|240|241|242|243|244|245|246|247|248|249|250|251|252|253|254|255|256|257|258|259|260/) print d": "size}'; done && \
echo "" && \
echo "4. Current Ceph OSDs:" && \
ceph osd tree 2>/dev/null && \
echo "" && \
echo "5. Ceph Health:" && \
ceph health 2>/dev/null && \
echo "" && \
echo "6. Storage Pools:" && \
pvesm status 2>/dev/null && \
echo "" && \
echo "7. Volume Groups:" && \
vgs 2>/dev/null && \
echo "" && \
echo "8. Physical Volumes:" && \
pvs 2>/dev/null

---

What to Look For

Expected Output

You should see something like:

NAME   SIZE TYPE MOUNTPOINT FSTYPE MODEL
sda    279G disk            ST9300653SS      # 300GB - Proxmox
sdb    279G disk            HUC106030CSS600  # 300GB - Ceph OSD
sdc    250G disk                               # 250GB - Available?
sdd    250G disk                               # 250GB - Available?
sde    250G disk                               # 250GB - Available?
sdf    250G disk                               # 250GB - Available?
sdg    250G disk                               # 250GB - Available?
sdh    250G disk                               # 250GB - Available?

Key Indicators

Available Drive (good for OSD):

• ✅ No MOUNTPOINT (empty)
• ✅ No FSTYPE (not formatted)
• ✅ Not in volume group (check pvs)
• ✅ Size around 232-260 GB

Drive in Use (not available):

• ❌ Has MOUNTPOINT (mounted)
• ❌ Has FSTYPE (formatted)
• ❌ In volume group (shows in pvs)

---

After Verification

Once you've identified available 250GB drives, share:

1. How many 250GB drives were found
2. Which device names (sdc, sdd, etc.)
3. Which ones are available (no mount, no partitions, not in VG)
4. Current Ceph OSD status

Then we can proceed with creating the third OSD!

---

Alternative: Copy Script to R630-01

If you have access to copy files:

# From your local machine
scp scripts/verify-r630-250gb-drives.sh root@192.168.11.11:/tmp/

# Then on R630-01
ssh root@192.168.11.11
bash /tmp/verify-r630-250gb-drives.sh

---

Last Updated: 2025-12-13