Intel P3700 blinking orange led

[GGil]

Hi All,

I've recently bought Intel's P3700 800GB SSD to our Lenovo x3650 M5 (E5-2630 v3 dual CPU) server, running Ubuntu.

Performance is not as high as it suppose to be - hdparm -tT --direct shows around 1.6GB/sec. The same drive on a friends PC shows the 2.8GB/sec it suppose to be.

While trying to debug it I've noticed that the first orange led is blinking steadily - half a second on, half a second off, etc... It is starting when Ubuntu is booting even when the drive is not mounted so there is no traffic.

I tried to shutdown the server and unplug the power sources - but no luck there.

After installing the disk i ran dd if=/dev/zero of=/dev/nvme0n1 bs=1M oflag=direct, like it suggested in the NVMe Driver Reference Guide - maybe I put the SSD is some kind of bad state?

Any other ideas? Maybe firmware? how do I find out which firmware I have? Unfortunately Intel does not support Ubuntu for the SSD Data Center Tool.

I'm do not know if the blinking causes the performance issue, but it is odd.

Thanks,

Gil.

[GGil]

Hi,

This is the spec for my current working server:

Ubuntu 14.04 with 4.2.0-27 Kernel

Processor Information

Socket Designation: Socket 1/2

Type: Central Processor

Family: Xeon

Manufacturer: Intel(R) Corporation

ID: F2 06 03 00 FF FB EB BF

Signature: Type 0, Family 6, Model 63, Stepping 2

Flags:

FPU (Floating-point unit on-chip)

VME (Virtual mode extension)

DE (Debugging extension)

PSE (Page size extension)

TSC (Time stamp counter)

MSR (Model specific registers)

PAE (Physical address extension)

MCE (Machine check exception)

CX8 (CMPXCHG8 instruction supported)

APIC (On-chip APIC hardware supported)

SEP (Fast system call)

MTRR (Memory type range registers)

PGE (Page global enable)

MCA (Machine check architecture)

CMOV (Conditional move instruction supported)

PAT (Page attribute table)

PSE-36 (36-bit page size extension)

CLFSH (CLFLUSH instruction supported)

DS (Debug store)

ACPI (ACPI supported)

MMX (MMX technology supported)

FXSR (FXSAVE and FXSTOR instructions supported)

SSE (Streaming SIMD extensions)

SSE2 (Streaming SIMD extensions 2)

SS (Self-snoop)

HTT (Multi-threading)

TM (Thermal monitor supported)

PBE (Pending break enabled)

Version: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz

Voltage: 1.6 V

External Clock: 100 MHz

Max Speed: 4000 MHz

Current Speed: 2400 MHz

Status: Populated, Enabled

Upgrade:

Serial Number: Not Specified

Asset Tag: Unknown

Part Number: Not Specified

Core Count: 8

Core Enabled: 8

Thread Count: 8

Characteristics:

64-bit capable

Multi-Core

Hardware Thread

Execute Protection

Enhanced Virtualization

Power/Performance Control

BIOS Information

Vendor: LENOVO

Version: -[TCE106KUS-1.10]-

Release Date: 04/17/2015

Address: 0xF0000

Runtime Size: 64 kB

ROM Size: 16384 kB

Characteristics:

PCI is supported

PNP is supported

BIOS is upgradeable

BIOS shadowing is allowed

Boot from CD is supported

Selectable boot is supported

EDD is supported

5.25"/1.2 MB floppy services are supported (int 13h)

3.5"/720 kB floppy services are supported (int 13h)

3.5"/2.88 MB floppy services are supported (int 13h)

Print screen service is supported (int 5h)

8042 keyboard services are supported (int 9h)

Serial services are supported (int 14h)

Printer services are supported (int 17h)

CGA/mono video services are supported (int 10h)

ACPI is supported

USB legacy is supported

LS-120 boot is supported

ATAPI Zip drive boot is supported

Function key-initiated network boot is supported

Targeted content distribution is supported

UEFI is supported

BIOS Revision: 1.10

Firmware Revision: 1.72

System Information

Manufacturer: LENOVO

Product Name: System x3650 M5: -[5462E4G]-

Base Board Information

Manufacturer: LENOVO

Product Name: 00YJ423

Version: SVT

Features:

Board is a hosting board

Board is replaceable

Location In Chassis: Rack-mount

Type: Motherboard

PCI Devices

00:03.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 3 (rev 02)

00:03.2 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 3 (rev 02)

00:05.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Address Map, VTd_Misc, System Management (rev 02)

00:05.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Hot Plug (rev 02)

00:05.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 RAS, Control Status and Global Errors (rev 02)

00:05.4 PIC: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 I/O APIC (rev 02)

00:11.0 Unassigned class [ff00]: Intel Corporation C610/X99 series chipset SPSR (rev 05)

00:14.0 USB controller: Intel Corporation C610/X99 series chipset USB xHCI Host Controller (rev 05)

00:16.0 Communication controller: Intel Corporation C610/X99 series chipset MEI Controller # 1 (rev 05)

00:16.1 Communication controller: Intel Corporation C610/X99 series chipset MEI Controller # 2 (rev 05)

00:1a.0 USB controller: Intel Corporation C610/X99 series chipset USB Enhanced Host Controller # 2 (rev 05)

00:1c.0 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root Port # 1 (rev d5)

00:1c.2 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root Port # 3 (rev d5)

00:1c.4 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root Port # 5 (rev d5)

00:1d.0 USB controller: Intel Corporation C610/X99 series chipset USB Enhanced Host Controller # 1 (rev 05)

00:1f.0 ISA bridge: Intel Corporation C610/X99 series chipset LPC Controller (rev 05)

00:1f.2 SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)

00:1f.3 SMBus: Intel Corporation C610/X99 series chipset SMBus Controller (rev 05)

00:1f.6 Signal processing controller: Intel Corporation C610/X99 series chipset Thermal Subsystem (rev 05)

10:00.0 Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)

7f:08.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0 (rev 02)

7f:08.2 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0 (rev 02)

7f:08.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0 (rev 02)

7f:0b.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring (rev 02)

7f:0b.1 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring (rev 02)

7f:0b.2 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring (rev 02)

7f:0c.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)

7f:0c.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)

7f:0c.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)

7f:0c.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)

7f:0c.4 System peripheral: I...

[GGil]

And some more info about the PCI devices:

00:00.0 Host bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DMI2 (rev 02)

Subsystem: Device 1d49:0a00

Flags: fast devsel

Capabilities: [90] Express Root Port (Slot-), MSI 00

Capabilities: [e0] Power Management version 3

Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>

Capabilities: [144] Vendor Specific Information: ID=0004 Rev=1 Len=03c <?>

Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>

Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>

Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>

00:01.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 1 (rev 02) (prog-if 00 [Normal decode])

Flags: bus master, fast devsel, latency 0

Bus: primary=00, secondary=01, subordinate=05, sec-latency=0

Capabilities: [40] Subsystem: Device 1d49:0a00

Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-

Capabilities: [90] Express Root Port (Slot+), MSI 00

Capabilities: [e0] Power Management version 3

Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>

Capabilities: [110] Access Control Services

Capabilities: [148] Advanced Error Reporting

Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>

Capabilities: [250] # 19

Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>

Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>

Kernel driver in use: pcieport

00:02.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 2 (rev 02) (prog-if 00 [Normal decode])

Flags: bus master, fast devsel, latency 0

Bus: primary=00, secondary=06, subordinate=0a, sec-latency=0

Capabilities: [40] Subsystem: Device 1d49:0a00

Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-

Capabilities: [90] Express Root Port (Slot+), MSI 00

Capabilities: [e0] Power Management version 3

Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>

Capabilities: [110] Access Control Services

Capabilities: [148] Advanced Error Reporting

Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>

Capabilities: [250] # 19

Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>

Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>

Kernel driver in use: pcieport

00:02.2 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 2 (rev 02) (prog-if 00 [Normal decode])

Flags: bus master, fast devsel, latency 0

Bus: primary=00, secondary=0b, subordinate=0f, sec-latency=0

Capabilities: [40] Subsystem: Device 1d49:0a00

Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-

Capabilities: [90] Express Root Port (Slot+), MSI 00

Capabilities: [e0] Power Management version 3

Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>

Capabilities: [110] Access Control Services

Capabilities: [148] Advanced Error Reporting

Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>

Capabilities: [250] # 19

Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>

Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>

Kernel driver in use: pcieport

00:03.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 3 (rev 02) (prog-if 00 [Normal decode])

Flags: bus master, fast devsel, latency 0

Bus: primary=00, secondary=10, subordinate=14, sec-latency=0

Memory behind bridge: 90200000-902fffff

Capabilities: [40] Subsystem: Device 1d49:0a00

Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-

Capabilities: [90] Express Root Port (Slot+), MSI 00

Capabilities: [e0] Power Management version 3

Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>

Capabilities: [110] Access Control Services

Capabilities: [148] Advanced Error Reporting

Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>

Capabilities: [250] # 19

Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>

Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>

Kernel driver in use: pcieport

00:03.2 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 3 (rev 02) (prog-if 00 [Normal decode])

Flags: bus master, fast devsel, latency 0

Bus: primary=00, secondary=15, subordinate=19, sec-latency=0

I/O behind bridge: 00002000-00002fff

Memory behind bridge: 90300000-904fffff

Capabilities: [40] Subsystem: Device 1d49:0a00

Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-

Capabilities: [90] Express Root Port (Slot+), MSI 00

Capabilities: [e0] Power Management version 3

Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>

Capabilities: [110] Access Control Services

Capabilities: [148] Advanced Error Reporting

Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>

Capabilities: [250] # 19

Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>

Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>

Kernel driver in use: pcieport

00:05.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Address Map, VTd_Misc, System Management (rev 02)

Subsystem: Device 1d49:0a00

Flags: fast devsel

Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Hot Plug (rev 02)

Subsystem: Device 1d49:0a00

Flags: fast devsel

Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit+

Capabilities: [100] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>

Capabilities: [110] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>

Capabilities: [120] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>

Capabilities: [130] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>

00:05.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 RAS, Control Status and Global Errors (rev 02)

Subsystem: Device 1d49:0a00

Flags: fast devsel

Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.4 PIC: In...

[idata]

Gilsho,

Thanks for providing the information. We would like to know, are the other servers you have tested also Lenovo* servers?If those are also Lenovo* we suggest you to contact them in order to verify the change on the speed since we do know the SSD works fine in one of them.Please keep us updated, we will be waiting.

[idata]

Gilsho,

We are following up this case and we would like to know if you contacted Lenovo* about the situation?We will be waiting for your response.NC

[GGil]

Hi,

I've posted a question on Lenovo forums, but no one answered.

https://forums.lenovo.com/t5/System-x-Rack-Servers/Lenovo-x3650-M5-and-Intel-P3700-SSD-Performance-I... Lenovo x3650 M5 and Intel P3700 SSD - Performance ... - Lenovo Community

I also trying to debug it on my own, but still on luck.