[OmniOS-discuss] LSI3108

[Fábio Rabelo]

Hi to all

I just did a try in google to find if recent LSI3108 are supported in
OmniOS, but did not find anuthing ..

Someone knows the answer ?

Recent SAS 12 GB/s LSI 3008 and 3108 works with OmniOS ?


Fábio Rabelo

[Martin Dojcak]

Hi,

look at illumos Hardware Compatibility List:

http://illumos.org/hcl/

there is support for LSI 3008 and 3108 hba

MD

Post by Fábio Rabelo
Hi to all
I just did a try in google to find if recent LSI3108 are supported in OmniOS, but did not
find anuthing ..
Someone knows the answer ?
Recent SAS 12 GB/s LSI 3008 and 3108 works with OmniOS ?
Fábio Rabelo
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Dan McDonald]

Post by Martin Dojcak
Hi,
http://illumos.org/hcl/
there is support for LSI 3008 and 3108 hba

Note that the 3108 is HW-RAID and uses the mr_sas(7D) driver, while 3008 (with IT firmware) is a simpler HBA and uses the mpt_sas(7D) driver.

Dan

[Fábio Rabelo]

OK, reading the manual for the controller ...

I do not found anything like "passthru"

What I did found was a fuction called "expose Hard Disk to Host" ...

And, looks like is is what I need ....

Coming back when I have the card in my hands ...

Thanks again ....


Fábio Rabelo

OK ..
So, I have to try it out at my own chance and risk ...
Not today, but soon ...
Thanks
Fábio Rabelo

If 3108 are RAID, I still can configure my "tipical" RAID Z3 using

each Hard Disk individualy ?

Or OmniOS will only "see" the RAID array ?

You'll have to use the MegaRAID BIOS crud to configure it to not HW-RAID
the drives. Some of these let you have "passthru" which presents the raw
SCSI device up to the OS. This is ideal. Older ones (e.g. 2108) would
only let you create HW-RAID groups of one disk. This adds a layer of
HW-RAID crap even though it's still a single drive.
I know the 2208 would let you passthru. I've never tried a 3108 board,
but I hope it's sane like the 2208.
Dan

[Andy Fiddaman]

On Thu, 3 Mar 2016, Dan McDonald wrote:

;
; > On Mar 3, 2016, at 9:17 AM, Martin Dojcak <***@dojcak.sk> wrote:
; >
; > Hi,
; >
; > look at illumos Hardware Compatibility List:
; >
; > http://illumos.org/hcl/
; >
; > there is support for LSI 3008 and 3108 hba
;
; Note that the 3108 is HW-RAID and uses the mr_sas(7D) driver, while 3008 (with IT firmware) is a simpler HBA and uses the mpt_sas(7D) driver.

We are running some Dell R730s with PERC H730s (using LSI 3108) in
pass-through mode with the mr_sas driver. No problems here but I'd still
recommend choosing something that works with mpt_sas as that has been
better maintained and is well tried and tested.

reaper# (132) megacli -AdpAllInfo -a0
...
Versions
================
Product Name : PERC H730 Mini
Serial No : 4CF00C5
FW Package Build: 25.2.2-0004
...
Direct PD Mapping : Yes

dmesg:

mr_sas0: 0x1000:0x5d 0x1028:0x1f49, irq:15 drv-ver:6.503.00.00ILLUMOS
mr_sas0: TBOLT device detected
mr_sas0: msi_enable = 1
mr_sas0: enable_fp = 1
mr_sas0: ctio_enable = 1
mr_sas0 PCI Express-device: pci1028,***@0, mr_sas0
mr_sas0 is /***@0,0/pci8086,***@1/pci1028,***@0
scsi: [ID 583861 kern.info] sd0 at mr_sas0: target 0 lun 1
mr_sas0: Phys. device found: tgt 0 dtype 0: SEAGATE ST300MP0005
scsi: [ID 583861 kern.info] sd1 at mr_sas0: target 1 lun 1
mr_sas0: Phys. device found: tgt 1 dtype 0: SEAGATE ST300MP0005
...

[Fábio Rabelo]

I am a long time user of the IBM 1015 ..

Problem :

I have a customer who wants to build a pure SSD Storage with Sandisk
12 Gb/s SAS interface !

Is will run several SQL VMs in it to replace an aging SUN Server .

Capicce ??

I do not have a choice to use 6 Gb/s HBAs ...

Thanks ...


Fábio Rabelo

Post by Andy Fiddaman
;
; >
; > Hi,
; >
; >
; > http://illumos.org/hcl/
; >
; > there is support for LSI 3008 and 3108 hba
;
; Note that the 3108 is HW-RAID and uses the mr_sas(7D) driver, while 3008 (with IT firmware) is a simpler HBA and uses the mpt_sas(7D) driver.
We are running some Dell R730s with PERC H730s (using LSI 3108) in
pass-through mode with the mr_sas driver. No problems here but I'd still
recommend choosing something that works with mpt_sas as that has been
better maintained and is well tried and tested.
reaper# (132) megacli -AdpAllInfo -a0
...
Versions
================
Product Name : PERC H730 Mini
Serial No : 4CF00C5
FW Package Build: 25.2.2-0004
...
Direct PD Mapping : Yes
mr_sas0: 0x1000:0x5d 0x1028:0x1f49, irq:15 drv-ver:6.503.00.00ILLUMOS
mr_sas0: TBOLT device detected
mr_sas0: msi_enable = 1
mr_sas0: enable_fp = 1
mr_sas0: ctio_enable = 1
scsi: [ID 583861 kern.info] sd0 at mr_sas0: target 0 lun 1
mr_sas0: Phys. device found: tgt 0 dtype 0: SEAGATE ST300MP0005
scsi: [ID 583861 kern.info] sd1 at mr_sas0: target 1 lun 1
mr_sas0: Phys. device found: tgt 1 dtype 0: SEAGATE ST300MP0005
...
--
Rock House Farm | Green Moor | Wortley | Sheffield | S35 7DQ
Registered in England and Wales | Company number 4899123
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Dan McDonald]

Post by Fábio Rabelo
I have a customer who wants to build a pure SSD Storage with Sandisk
12 Gb/s SAS interface !

Get an LSI 3008-based card. The 9300, for example.

Dan

[Richard Jahnel]

Speaking of which, does anyone have a diskmap.py that works with the sas3 lsi cards?

Richard Jahnel
Network Engineer
On-Site.com | Ellipse Design
866-266-7483 ext. 4408
Direct: 669-800-6270

-----Original Message-----
From: OmniOS-discuss [mailto:omnios-discuss-***@lists.omniti.com] On Behalf Of Dan McDonald
Sent: Thursday, March 03, 2016 12:54 PM
To: Fábio Rabelo <***@fabiorabelo.wiki.br>; Dan McDonald <***@omniti.com>
Cc: omnios-discuss <omnios-***@lists.omniti.com>
Subject: Re: [OmniOS-discuss] LSI3108

Post by Fábio Rabelo
I have a customer who wants to build a pure SSD Storage with Sandisk
12 Gb/s SAS interface !

Get an LSI 3008-based card. The 9300, for example.

Dan

_______________________________________________
OmniOS-discuss mailing list
OmniOS-***@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Matej Žerovnik]

I tried diskmap.py on a SAS3 LSI card today and it works, I just neede to change the path to sas ircu utils so it runs sas3ircu instead of sas2ircu.

Also, sas3ircu from lsi/avago page doesn’t work, you need an older version (5.00). You can find it on nexenta’s github: https://github.com/Nexenta/nza-userland/tree/master/nza-userland/components/sas3ircu/usr/sbin

lp, Matej

Post by Richard Jahnel
Speaking of which, does anyone have a diskmap.py that works with the sas3 lsi cards?
Richard Jahnel
Network Engineer
On-Site.com | Ellipse Design
866-266-7483 ext. 4408
Direct: 669-800-6270
-----Original Message-----
Sent: Thursday, March 03, 2016 12:54 PM
Subject: Re: [OmniOS-discuss] LSI3108

Post by Fábio Rabelo
I have a customer who wants to build a pure SSD Storage with Sandisk
12 Gb/s SAS interface !

Get an LSI 3008-based card. The 9300, for example.
Dan
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Richard Jahnel]

You’re the best :)

Richard Jahnel
Network Engineer
On-Site.com | Ellipse Design
866-266-7483 ext. 4408
Direct: 669-800-6270

-----Original Message-----
From: Matej Žerovnik [mailto:***@zunaj.si]
Sent: Friday, March 18, 2016 3:28 PM
To: Richard Jahnel <***@ellipseinc.com>
Cc: Dan McDonald <***@omniti.com>; Fábio Rabelo <***@fabiorabelo.wiki.br>; omnios-discuss <omnios-***@lists.omniti.com>
Subject: Re: [OmniOS-discuss] LSI3108

I tried diskmap.py on a SAS3 LSI card today and it works, I just neede to change the path to sas ircu utils so it runs sas3ircu instead of sas2ircu.

Also, sas3ircu from lsi/avago page doesn’t work, you need an older version (5.00). You can find it on nexenta’s github: https://github.com/Nexenta/nza-userland/tree/master/nza-userland/components/sas3ircu/usr/sbin

lp, Matej

Post by Richard Jahnel
Speaking of which, does anyone have a diskmap.py that works with the sas3 lsi cards?
Richard Jahnel
Network Engineer
On-Site.com | Ellipse Design
866-266-7483 ext. 4408
Direct: 669-800-6270
-----Original Message-----
Sent: Thursday, March 03, 2016 12:54 PM
Subject: Re: [OmniOS-discuss] LSI3108

Post by Fábio Rabelo
I have a customer who wants to build a pure SSD Storage with Sandisk
12 Gb/s SAS interface !

Get an LSI 3008-based card. The 9300, for example.
Dan
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Richard Skelton]

Hi,
I have SAS 9305-24i Host Bus Adapter but it not seen by OmniOS
Which driver should it use? Can it be configured?
Also the Intel X520-DA2 and the onboard X540 are also not recognised.
Both should use the ixgbe drive ?
What information do you need to add to a OmniOS r15018 system.

Post by Dan McDonald

Post by Fábio Rabelo
I have a customer who wants to build a pure SSD Storage with Sandisk
12 Gb/s SAS interface !

Get an LSI 3008-based card. The 9300, for example.
Dan
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Dan McDonald]

Post by Richard Skelton
Hi,
I have SAS 9305-24i Host Bus Adapter but it not seen by OmniOS
Which driver should it use? Can it be configured?

Sounds like it should be attachable via the mpt_sas driver. Can you utter "lspci" and find the HBA you have on your system? It's possible the PCI ID isn't in the list of known drivers.

Post by Richard Skelton
Also the Intel X520-DA2 and the onboard X540 are also not recognised.
Both should use the ixgbe drive ?

This is REALLY weird, as both should as well. Again, that "lspci" will help.

Post by Richard Skelton
What information do you need to add to a OmniOS r15018 system.

Everything you mention should already work. I'm puzzled.

Dan

[Fábio Rabelo]

Hi to all ...

You may need to flash the IT firmware :

http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-24i#downloads


Fábio Rabelo

Post by Richard Skelton
Hi,
I have SAS 9305-24i Host Bus Adapter but it not seen by OmniOS
Which driver should it use? Can it be configured?
Also the Intel X520-DA2 and the onboard X540 are also not recognised.
Both should use the ixgbe drive ?
What information do you need to add to a OmniOS r15018 system.
I have a customer who wants to build a pure SSD Storage with Sandisk
12 Gb/s SAS interface !
Get an LSI 3008-based card. The 9300, for example.
Dan
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Dan McDonald]

Post by Fábio Rabelo
Hi to all ...
http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-24i#downloads

And if you do, make sure it's version 19 or lower. The IT firmware > 19 is known to be flaky. Check the illumos list archives for details on why.

Dan

[Schweiss, Chip]

Post by Fábio Rabelo

Post by Fábio Rabelo
Hi to all ...

http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-24i#downloads
And if you do, make sure it's version 19 or lower. The IT firmware > 19
is known to be flaky. Check the illumos list archives for details on why.

That only on the 6G HBA. On the 12G HBA version 12 is the newest. I
haven't heard any preferred versions on these. I've been running v10 for
several months now without issue.

-Chip

Post by Fábio Rabelo
Dan
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Matej Žerovnik]

There is even an updated version of P20 that should eliminate the problems. I think the version number is 20.04.000 where the broken version was 20.02.000. I think I read about that on FreeNAS forum.

As far as 12G goes, I’m about to run P12. I did some tests and so far no problems apart from FW upload tce invalid warning when I run sas3ircu list
May 19 12:11:34 node scsi: [ID 107833 kern.warning] WARNING: /***@74,0/pci8086,***@3/pci1000,***@0 (mpt_sas8):
May 19 12:11:34 node FW Upload tce invalid!

Matej

Post by Dan McDonald

Post by Fábio Rabelo
Hi to all ...
http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-24i#downloads <http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-24i#downloads>

And if you do, make sure it's version 19 or lower. The IT firmware > 19 is known to be flaky. Check the illumos list archives for details on why.
That only on the 6G HBA. On the 12G HBA version 12 is the newest. I haven't heard any preferred versions on these. I've been running v10 for several months now without issue.
-Chip
Dan
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss <http://lists.omniti.com/mailman/listinfo/omnios-discuss>
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Richard Skelton]

Hi Matej,
How did you get the mpt_sas driver to attach to your card ?
Looks like your device id is pci1000,30a0.
From prtconf -d I see for my SAS 9305-24i :-
pci1000,31a0 (pciex1000,c4) [LSI Logic / Symbios Logic
SAS3224 PCI-Express Fusion-MPT SAS-3] (driver not attached)

lspci does not sow the card :-(

Post by Matej Žerovnik
There is even an updated version of P20 that should eliminate the
problems. I think the version number is 20.04.000 where the broken
version was 20.02.000. I think I read about that on FreeNAS forum.
As far as 12G goes, I’m about to run P12. I did some tests and so far
no problems apart from FW upload tce invalid warning when I run
sas3ircu list
May 19 12:11:34 node FW Upload tce invalid!
Matej

Post by Dan McDonald

On May 23, 2016, at 4:10 PM, Fábio Rabelo
Hi to all ...
http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-24i#downloads

And if you do, make sure it's version 19 or lower. The IT
firmware > 19 is known to be flaky. Check the illumos list
archives for details on why.
That only on the 6G HBA. On the 12G HBA version 12 is the newest.
I haven't heard any preferred versions on these. I've been running
v10 for several months now without issue.
-Chip
Dan
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

------------------------------------------------------------------------
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Matej Žerovnik]

Hey,

I just plugged in the card and it was recognized:) It’s a LSI SAS3008 card.
prtconf -d says:
pci1000,30a0 (pciex1000,97) [LSI Logic / Symbios Logic SAS3008 PCI-Express Fusion-MPT SAS-3], instance #8

On the other hand, lspci says different:
15:00.0 RAID bus controller: LSI Logic / Symbios Logic MegaRAID SAS-3 3108 [Invader] (rev 02)

prtconf gives the right info.

I run P12 IT firmware on it.

Matej

Post by Richard Skelton
Hi Matej,
How did you get the mpt_sas driver to attach to your card ?
Looks like your device id is pci1000,30a0.
From prtconf -d I see for my SAS 9305-24i :-
pci1000,31a0 (pciex1000,c4) [LSI Logic / Symbios Logic SAS3224 PCI-Express Fusion-MPT SAS-3] (driver not attached)
lspci does not sow the card :-(

Post by Matej Žerovnik
There is even an updated version of P20 that should eliminate the problems. I think the version number is 20.04.000 where the broken version was 20.02.000. I think I read about that on FreeNAS forum.
As far as 12G goes, I’m about to run P12. I did some tests and so far no problems apart from FW upload tce invalid warning when I run sas3ircu list
May 19 12:11:34 node FW Upload tce invalid!
Matej

Post by Dan McDonald

Post by Fábio Rabelo
Hi to all ...
http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-24i#downloads <http://www.avagotech.com/products/server-storage/host-bus-adapters/sas-9305-24i#downloads>

And if you do, make sure it's version 19 or lower. The IT firmware > 19 is known to be flaky. Check the illumos list archives for details on why.
That only on the 6G HBA. On the 12G HBA version 12 is the newest. I haven't heard any preferred versions on these. I've been running v10 for several months now without issue.
-Chip
Dan
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss <http://lists.omniti.com/mailman/listinfo/omnios-discuss>
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss <http://lists.omniti.com/mailman/listinfo/omnios-discuss>

_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss <http://lists.omniti.com/mailman/listinfo/omnios-discuss>

[Eric Sproul]

Post by Dan McDonald
And if you do, make sure it's version 19 or lower. The IT firmware > 19 is known to be flaky. Check the illumos list archives for details on why.

We may want to revisit that advice-- I've noticed that LSI/Avago have
revised v20 firmware several times, presumably to fix bugs. Their
support downloads currently show "20.00.07.00" available for download.
I haven't had a chance to try that one yet, but I do have some dev
systems running 20.00.04.00 without any apparent issues. These are
direct-attach configurations, i.e. no expanders.

Eric

[Linda Kateley]

I have worked with the 20.00.04.00 and it has worked very well. But the
07 has had problems. All on freebsd or freenas. Haven't tested with omni.

If anyone has the sata 6gb firmware sitting around version 20.00.04.00
would love to get my hands on it


linda

Post by Eric Sproul

Post by Dan McDonald
And if you do, make sure it's version 19 or lower. The IT firmware > 19 is known to be flaky. Check the illumos list archives for details on why.

We may want to revisit that advice-- I've noticed that LSI/Avago have
revised v20 firmware several times, presumably to fix bugs. Their
support downloads currently show "20.00.07.00" available for download.
I haven't had a chance to try that one yet, but I do have some dev
systems running 20.00.04.00 without any apparent issues. These are
direct-attach configurations, i.e. no expanders.
Eric
_______________________________________________
OmniOS-discuss mailing list
http://lists.omniti.com/mailman/listinfo/omnios-discuss

[Michael Rasmussen]

On Thu, 3 Mar 2016 15:46:15 -0300

Post by Fábio Rabelo
I do not have a choice to use 6 Gb/s HBAs ...

According to specs 3008 also provides 12 Gb/s SAS?
http://www.avagotech.com/products/server-storage/io-controllers/sas-3008
--
Hilsen/Regards
Michael Rasmussen

Get my public GnuPG keys:
michael <at> rasmussen <dot> cc
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xD3C9A00E
mir <at> datanom <dot> net
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE501F51C
mir <at> miras <dot> org
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE3E80917
--------------------------------------------------------------
/usr/games/fortune -es says:
It's better to be wanted for murder that not to be wanted at all.
-- Marty Winch