85 lines
1.7 KiB
Markdown
85 lines
1.7 KiB
Markdown
|
# OSD Creation Issue - Bootstrap Keyring
|
||
|
|
|
||
|
|
**Date**: 2025-12-13
|
||
|
|
**Status**: ⚠️ **OSD CREATION FAILED - BOOTSTRAP KEYRING MISSING**
|
||
|
|
|
||
|
|
---
|
||
|
|
|
||
|
|
## What Happened
|
||
|
|
|
||
|
|
✅ **Success**: All 6 drives (sdc-sdh) were successfully wiped
|
||
|
|
❌ **Failure**: OSD creation failed due to missing Ceph bootstrap keyring
|
||
|
|
|
||
|
|
### Error Messages
|
||
|
|
```
|
||
|
|
unable to find a keyring on /etc/pve/priv/ceph.client.bootstrap-osd.keyring
|
||
|
|
RADOS timed out (error connecting to the cluster)
|
||
|
|
RuntimeError: Unable to create a new OSD id
|
||
|
|
```
|
||
|
|
|
||
|
|
---
|
||
|
|
|
||
|
|
## Root Cause
|
||
|
|
|
||
|
|
The Ceph bootstrap keyring is missing or Ceph cluster is not accessible. This is needed to authenticate when creating new OSDs.
|
||
|
|
|
||
|
|
---
|
||
|
|
|
||
|
|
## Quick Fix
|
||
|
|
|
||
|
|
Run these commands on R630-01:
|
||
|
|
|
||
|
|
```bash
|
||
|
|
# 1. Check Ceph cluster connectivity
|
||
|
|
ceph health
|
||
|
|
ceph mon stat
|
||
|
|
|
||
|
|
# 2. Get bootstrap keyring from cluster
|
||
|
|
mkdir -p /var/lib/ceph/bootstrap-osd
|
||
|
|
ceph auth get client.bootstrap-osd -o /var/lib/ceph/bootstrap-osd/ceph.keyring
|
||
|
|
|
||
|
|
# 3. Verify keyring exists
|
||
|
|
ls -la /var/lib/ceph/bootstrap-osd/ceph.keyring
|
||
|
|
|
||
|
|
# 4. Create OSDs (drives are already wiped)
|
||
|
|
for drive in sdc sdd sde sdf sdg sdh; do
|
||
|
|
ceph-volume lvm create --data /dev/$drive
|
||
|
|
done
|
||
|
|
|
||
|
|
# 5. Verify
|
||
|
|
ceph osd tree
|
||
|
|
ceph health
|
||
|
|
```
|
||
|
|
|
||
|
|
---
|
||
|
|
|
||
|
|
## Alternative: Use pveceph
|
||
|
|
|
||
|
|
If you're using Proxmox's Ceph integration:
|
||
|
|
|
||
|
|
```bash
|
||
|
|
# Check if available
|
||
|
|
which pveceph
|
||
|
|
|
||
|
|
# Create OSDs
|
||
|
|
pveceph create /dev/sdc
|
||
|
|
pveceph create /dev/sdd
|
||
|
|
pveceph create /dev/sde
|
||
|
|
pveceph create /dev/sdf
|
||
|
|
pveceph create /dev/sdg
|
||
|
|
pveceph create /dev/sdh
|
||
|
|
```
|
||
|
|
|
||
|
|
---
|
||
|
|
|
||
|
|
## Status
|
||
|
|
|
||
|
|
- ✅ **Drives wiped**: All 6 drives ready
|
||
|
|
- ⚠️ **OSD creation**: Blocked by bootstrap keyring issue
|
||
|
|
- 🎯 **Next step**: Fix bootstrap keyring and retry OSD creation
|
||
|
|
|
||
|
|
---
|
||
|
|
|
||
|
|
**Last Updated**: 2025-12-13
|
||
|
|
|