storcli 是LSI公司官方提供的Raid卡管理工具，storcli已经基本代替了megacli，是一款比较简单易用的小工具。将命令写成一个个的小脚本，会将使用变得更方便。
安装简单，Windows系统下解压出来以后可以直接运行。
Linux系统默认位置在 /opt/MegaRAID/storcli下面，安装完成后可以按照个人使用习惯拷贝到/usr/bin和/usr/sbin下，也可以直接到安装目录运行。
下载地址
Broadcom官网：https://www.broadcom.com/site-search?q=storcli
百度云盘：
链接：https://pan.baidu.com/s/1c_PBmz5UoWSjT3h6cZG3Vw
提取码：long
安装步骤
| [root@localhost~]#unzip 007.1715.0000.0000_Unified_StorCLI-PUL.zip [root@localhost~]#cd Unified_storcli_all_os/ [root@localhost~]#cd Linuxrpm -ivhstorcli-007.1705.0000.0000-1.noarch.rpm [root@localhost~]# rpm -ivh storcli-007.1704.0000.0000-1.noarch.rpm warning:storcli-007.1704.0000.0000-1.noarch.rpm: Header V3 RSA/SHA256 Signature, key ID cb529165: NOKEY Preparing... ################################# [100%] Updating /installing... 1:storcli-007.1704.0000.0000-1 ###############################[100%] 查看安装是否成功 [root@localhost storcli]# ls /opt/MegaRAID/storcli/ install.log storcli64 storcli.log 拷贝到可执行文件目录 cp/opt/MegaRAID/storcli/storcli64 /usr/bin/ cp/opt/MegaRAID/storcli/storcli64 /usr/sbin/ |
获取帮助
storcli64 -h
storcli64 show all
1.对更换完的硬盘进行划分raid0，并开启ssdcache功能
storcli64 /c1 add vd r0 size=all divers = 18:10 cached（storcli64 /c1 add vd r0 drives=18:10，storcli64 /c1/v9 set iopolicy=Cached）
storcli64 /c1/v9 set ssdcaching=on
2.确认ok后，在对应的存储节点进行盘的检查。
3.通知停响应节点监控
4.osd的添加，执行相应脚本内容。（具体情况）
parted_new_disk.sh
add_osd.sh
Linux使用storcli工具查看服务器硬盘和raid组信息
1、简介
MegaCli 是LSI公司官方提供的SCSI卡管理工具，由于LSI被收购变成了现在的Broadcom，所以现在想下载MegaCli，
需要去Broadcom官网查找Legacy产品支持，搜索MegaRAID即可。
现在官方有storcli，storcli已经基本代替了megacli，整合了LSI和3ware所有产品。
安装方面比较简单，megacli还要Lib_Utils的支持，而storcli只用一个rpm包就可以下载，
去Broadcom官网去找就行了：Search Results
storcli支持json格式输出，信息解析更加方便。
我个人推荐使用这个软件，因为megacli 工具需要安装额外的软件包，有些服务器客户不允许安装其他的软件包，所以比较麻烦。
这个工具直接安装了之后就可以用。
1.1服务器信息：
1.2系统信息：
[root@localhost storcli]# cat /etc/redhat-release
Red Hat Enterprise Linux Server release 6.4 (Santiago)
1.3 安装storcli
rpm -ivh storcli-1.03.11-1.noarch.rpm
目录： /opt/Mega/storcli
注意版本问题
我这台服务器是DELL R720xd，2012年上线的，所以我用的是storcli.1.03.11版本。
我用的新版本安装之后，执行命令没有输出，所以这一点需要注意。
1.4一些参数定义：
/cx = Controller ID
/vx = Virtual Drive Number.
/ex = Enclosure ID
/sx = Slot ID
1.5为了管理方便，建立软连接
ln -s /opt/MegaRAID/storcli/storcli64 /bin/storcli
ln -s /opt/MegaRAID/storcli/storcli64 /sbin/storcli
如果不想建立软连接，就在/opt/MegaRAID/storcli 目录下 执行./storcli64 指令
2、查看当前设备raid控制器相关信息
[root@localhost storcli]# ./storcli64 show all 可以看到只有一个控制器
Status Code = 0
Status = Success
Description = None
Number of Controllers = 1
Host Name = localhost.localdomain
Operating System = Linux2.6.32-358.el6.x86_64
System Overview :
===============
------------------------------------------------------------
Ctl Model Ports PDs DGs DNOpt VDs VNOpt BBU sPR DS EHS ASOs
------------------------------------------------------------
0 Mini 8 14 3 0 3 0 Opt On 3 N 0 【只看到一个控制器】
------------------------------------------------------------
Ctl=Controller Index|DGs=Drive groups|VDs=Virtual drives|Fld=Failed
PDs=Physical drives|DNOpt=DG NotOptimal|VNOpt=VD NotOptimal|Opt=Optimal
Msng=Missing|Dgd=Degraded|NdAtn=Need Attention|Unkwn=Unknown
sPR=Scheduled Patrol Read|DS=DimmerSwitch|EHS=Emergency Hot Spare
Y=Yes|N=No|ASOs=Advanced Software Options|BBU=Battery backup unit
ASO :
===
----
Ctl
----
0
----
Cl=Cluster|MD=Max Disks|WC=Wide Cache|SS=Safe Store|FP=Fast Path|Re=Recovery
CR=CacheCade(Read)|RF=Reduced Feature Set|CO=Cache Offload
CW=CacheCade(Read/Write)|X=Not Available/Not Installed|U=Unlimited|T=Trial
3、查看控制器c0的相关信息
[root@localhost storcli]# ./storcli64 /c0 show
Controller = 0
Status = Success
Description = None
Product Name = PERC H710P Mini【控制器型号】
Serial Number = 26300UP
SAS Address = 5d4ae520a6bcbc00
Mfg. Date = 06/04/12
System Time = 05/22/2019 16:22:28
Controller Time = 05/22/2019 08:22:28
FW Package Build = 21.0.2-0001
BIOS Version = 5.30.00_4.12.05.00_0x05110000
FW Version = 3.130.05-1587
Driver Name = megaraid_sas
Driver Version = 06.504.01.00-rh1
Controller Bus Type = N/A
PCI Slot = N/A
PCI Bus Number = 2
PCI Device Number = 0
PCI Function Number = 0
Drive Groups = 3
TOPOLOGY :
========
--------------------------------------------------------------------------
DG Arr Row EID:Slot DID Type State BT Size PDC PI SED DS3 FSpace
--------------------------------------------------------------------------
0 - - - - RAID1 Optl N 278.875 GB dflt N N dflt N
0 0 - - - RAID1 Optl N 278.875 GB dflt N N dflt N
0 0 0 32:24 24 DRIVE Onln N 278.875 GB dflt N N dflt -
0 0 1 32:25 25 DRIVE Onln N 278.875 GB dflt N N dflt -
1 - - - - RAID5 Optl N 4.089 TB dflt N N dflt N
1 0 - - - RAID5 Optl N 4.089 TB dflt N N dflt N
1 0 0 32:0 0 DRIVE Onln N 837.75 GB dflt N N dflt -
1 0 1 32:1 1 DRIVE Onln N 837.75 GB dflt N N dflt -
1 0 2 32:2 2 DRIVE Onln N 837.75 GB dflt N N dflt -
1 0 3 32:3 3 DRIVE Onln N 837.75 GB dflt N N dflt -
1 0 4 32:4 4 DRIVE Onln N 837.75 GB dflt N N dflt -
1 0 5 32:5 5 DRIVE Onln N 837.75 GB dflt N N dflt -
2 - - - - RAID5 Optl N 4.089 TB dflt N N dflt N
2 0 - - - RAID5 Optl N 4.089 TB dflt N N dflt N
2 0 0 32:6 6 DRIVE Onln N 837.75 GB dflt N N dflt -
2 0 1 32:7 7 DRIVE Onln N 837.75 GB dflt N N dflt -
2 0 2 32:8 8 DRIVE Onln N 837.75 GB dflt N N dflt -
2 0 3 32:9 9 DRIVE Onln N 837.75 GB dflt N N dflt -
2 0 4 32:10 10 DRIVE Onln N 837.75 GB dflt N N dflt -
2 0 5 32:11 11 DRIVE Onln N 837.75 GB dflt N N dflt - 【可以看到服务器有几个RAID，每个RAID的级别和成员盘】
--------------------------------------------------------------------------
DG=Disk Group Index|Arr=Array Index|Row=Row Index|EID=Enclosure Device ID
DID=Device ID|Type=Drive Type|Onln=Online|Rbld=Rebuild|Dgrd=Degraded
Pdgd=Partially degraded|Offln=Offline|BT=Background Task Active
PDC=PD Cache|PI=Protection Info|SED=Self Encrypting Drive|Frgn=Foreign
DS3=Dimmer Switch 3|dflt=Default|Msng=Missing|FSpace=Free Space Present
Virtual Drives = 3【服务器有三个RAID，两个RAID5一个RAID1】
VD LIST :
=======
---------------------------------------------------------------
DG/VD TYPE State Access Consist Cache Cac sCC Size Name
---------------------------------------------------------------
0/0 RAID1 Optl RW Yes RaWBD R OFF 278.875 GB
1/1 RAID5 Optl RW Yes RaWBD R OFF 4.089 TB
2/2 RAID5 Optl RW Yes RaWBD R OFF 4.089 TB
---------------------------------------------------------------
Cac=CacheCade|Rec=Recovery|OfLn=OffLine|Pdgd=Partially Degraded|dgrd=Degraded
Optl=Optimal|RO=Read Only|RW=Read Write|B=Blocked|Consist=Consistent|
Ra=Read Ahead Adaptive|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack|
AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled
Check Consistency
Physical Drives = 14【十四个物理磁盘】
PD LIST :
=======
-------------------------------------------------------------------------
EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp
-------------------------------------------------------------------------
32:0 0 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:1 1 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:2 2 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:3 3 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:4 4 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:5 5 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:6 6 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:7 7 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:8 8 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:9 9 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:10 10 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:11 11 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:24 24 Onln 0 278.875 GB SAS HDD N N 512B ST9300603SS U
32:25 25 Onln 0 278.875 GB SAS HDD N N 512B ST9300605SS U
-------------------------------------------------------------------------
EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup
DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare
UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition|F-Foreign
BBU_Info :
========
------------------------------------------------------------
Model State RetentionTime Temp Mode MfgDate Next Learn
------------------------------------------------------------
BBU Optimal 0 hour(s) 30C 0 2011/07/18 None
------------------------------------------------------------
4、获取enclosure信息
硬盘大多是附在enclosure上不是直接附在controller上。
显示所有的enclosure信息，但是系统中只有一个enclosure ，EID:32.
[root@localhost storcli]# ./storcli64 /c0/eall show
Controller = 0
Status = Success
Description = None
Properties :
==========
-----------------------------------------------------------------------------
EID State Slots PD PS Fans TSs Alms SIM Port# ProdID VendorSpecific
-----------------------------------------------------------------------------
32 OK 26 14 0 0 0 0 0 Unavailable BP12G+EXP
-----------------------------------------------------------------------------
EID-Enclosure Device ID |PD-Physical drive count |PS-Power Supply count|
TSs-Temperature sensor count |Alms-Alarm count |SIM-SIM Count
获取单个enclosure ,e32详细信息
[root@localhost storcli]# ./storcli64 /c0/e32 show all
Controller = 0
Status = Success
Description = None
Enclosure /c0/e32 :
==================
Information :
===========
Device ID = 32
Position = 1
Connector Name = Unavailable
Enclosure Type = SES
Status = OK
FRU Part Number = N/A
Enclosure Serial Number = N/A
ESM Serial Number = N/A
Enclosure Zoning Mode = N/A
Partner Device ID = 65535
Inquiry Data :
============
Vendor Identification = DP
Product Identification = BP12G+EXP
Product Revision Level = 1.07
Properties :
==========
-----------------------------------------------------------------------------
EID State Slots PD PS Fans TSs Alms SIM Port# ProdID VendorSpecific
-----------------------------------------------------------------------------
32 OK 26 14 0 0 0 0 0 Unavailable BP12G+EXP
-----------------------------------------------------------------------------
EID-Enclosure Device ID |PD-Physical drive count |PS-Power Supply count|
TSs-Temperature sensor count |Alms-Alarm count |SIM-SIM Count
5、显示物理磁盘信息
语法：storcli64 /cx/eall/sall show 显示所有物理磁盘信息
[root@localhost storcli]# ./storcli64 /c0/e32/sall show 【显示e32上的所有物理硬盘】
[root@localhost storcli]# ./storcli64 /c0/eall/sall show【显示所有enclosure下的所有物理硬盘】
Controller = 0
Status = Success
Description = Show Drive Information Succeeded.
Drive Information :
=================
-------------------------------------------------------------------------
EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp
-------------------------------------------------------------------------
32:0 0 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:1 1 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:2 2 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:3 3 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:4 4 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:5 5 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:6 6 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:7 7 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:8 8 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:9 9 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:10 10 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:11 11 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U
32:24 24 Onln 0 278.875 GB SAS HDD N N 512B ST9300603SS U
32:25 25 Onln 0 278.875 GB SAS HDD N N 512B ST9300605SS U
-------------------------------------------------------------------------
EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup
DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare【表示有热备盘，DHS专有热备，GHS全局热备】
UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition|F-Foreign
从上面信息，可以看出：
-
只有一个控制器，id 为 0
-
EID，Enclosure Device ID ：32
-
Slot Number，能看到 0,1,2,3,4,5,6,7,8,9,10,11,24,25
-
DG：disk group，0,1,2
-
size：容量，磁盘容量
-
intf：接口，SAS
-
Med：介质，ssd 或 hdd
6、查看raid组详细信息
查看系统里面有几个raid组：
[root@localhost storcli]# ./storcli64 /c0/vall show 【查看c0控制下的所有RAID信息】
Controller = 0
Status = Success
Description = None
Virtual Drives :
==============
---------------------------------------------------------------
DG/VD TYPE State Access Consist Cache Cac sCC Size Name
---------------------------------------------------------------
0/0 RAID1 Optl RW Yes RaWBD R OFF 278.875 GB
1/1 RAID5 Optl RW Yes RaWBD R OFF 4.089 TB
2/2 RAID5 Optl RW Yes RaWBD R OFF 4.089 TB 【显示系统有三个raid组】
---------------------------------------------------------------
Cac=CacheCade|Rec=Recovery|OfLn=OffLine|Pdgd=Partially Degraded|dgrd=Degraded
Optl=Optimal|RO=Read Only|RW=Read Write|B=Blocked|Consist=Consistent|
Ra=Read Ahead Adaptive|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack|
AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled
Check Consistency
查看V0 （虚拟磁盘0） raid的详细信息
[root@localhost storcli]# ./storcli64 /c0/v0 show all
Controller = 0
Status = Success
Description = None
/c0/v0 :
======
---------------------------------------------------------------
DG/VD TYPE State Access Consist Cache Cac sCC Size Name
---------------------------------------------------------------
0/0 RAID1 Optl RW Yes RaWBD R OFF 278.875 GB 【V0为RAID1】
---------------------------------------------------------------
Cac=CacheCade|Rec=Recovery|OfLn=OffLine|Pdgd=Partially Degraded|dgrd=Degraded
Optl=Optimal|RO=Read Only|RW=Read Write|B=Blocked|Consist=Consistent|
Ra=Read Ahead Adaptive|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack|
AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled
Check Consistency
PDs for VD 0 :
============
-------------------------------------------------------------------------
EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp
-------------------------------------------------------------------------
32:24 24 Onln 0 278.875 GB SAS HDD N N 512B ST9300603SS U
32:25 25 Onln 0 278.875 GB SAS HDD N N 512B ST9300605SS U 【可以看到24号和25号盘组成了raid1】
-------------------------------------------------------------------------
EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup
DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare
UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition|F-Foreign
VD0 Properties :
==============
Strip Size = 64 KB
Span Depth = 1
Number of Drives Per Span = 2
Disk Cache Policy = Disk's Default
Encryption = None
Data Protection = None
Active Operations = None
Exposed to OS = Yes
Creation Date = 05-09-2012
Creation Time = 01:38:23 PM
Emulation type = None
7、磁盘状态设置
storcli64 /cx/ex/sx set good/offline/online/missing 设置某块磁盘的状态
good 空闲
online/offline 成员盘上下线
missing 设置磁盘为missing状态
磁盘热备
storcli64 /cx/ex/sx add hotsparedrive dgs=x 设置模块磁盘为diskgroup x 的热备盘
storcli64 /cx/ex/sx add hotsparedrive 设置全局热备
storcli64 /cx/ex/sx delete hotsparedrive
磁盘rebuild
storcli64 /cx/ex/sx show rebuild 查看rebild
storcli64 /cx/ex/sx start rebuild
storcli64 /cx/ex/sx stop rebuild
磁盘点灯
storcli64 /cx/ex/sx start locate
storcli64 /cx/ex/sx stop locate
磁盘擦除
快速擦除：
storcli64 /cx/ex/sx set good
storcli64 /cx/fall del|delete [securityKey = xxx]
完全擦除：
storcli /cx[/ex]/sx secureerase [force]
storcli /cx[/ex]/sx start erase [simple| normal| thorough | standard| threepass | crypto]
storcli /cx[/ex]/sx stop erase
storcli /cx[/ex]/sx show erase
8、获取rebuild速率
[root@localhost storcli]# ./storcli64 /c0 show rebuildrate
Controller = 0
Status = Success
Description = None
Controller Properties :
=====================
------------------
Ctrl_Prop Value
------------------
Rebuildrate 30%
------------------
storcli64 /c0 set rebuildrate=60 设置rebuild速率
9、清除缓存
清除raid卡，物理磁盘cache
storcli64 /c0 flushcache
