Enable use of Solid State Hybrid Drives

The following series enables the use of Solid State hybrid drives
ATA standard 3.2 defines the hybrid information feature, which provides a
means for the host driver to provide hints to the SSHDs to guide what to
place on the SSD/NAND portion and what to place on the magnetic media. 

This implementation allows user space applications to provide the cache
hints to the kernel using the existing ionice syscall.  

An application can pass a priority number coding up bits 11, 12, and 15 of
the ionice command to form a 3 bit field that encodes the following
priorities: 
	OPRIO_ADV_NONE,
	IOPRIO_ADV_EVICT, /* actively discard cached data */
	IOPRIO_ADV_DONTNEED, /* caching this data has little value */
	IOPRIO_ADV_NORMAL, /* best-effort cache priority (default) */
	IOPRIO_ADV_RESERVED1, /* reserved for future use */
	IOPRIO_ADV_RESERVED2,
	IOPRIO_ADV_RESERVED3,
	IOPRIO_ADV_WILLNEED, /* high temporal locality */

For example the following commands from the user space will make dd IOs to
be generated with a hint of IOPRIO_ADV_DONTNEED assuming the SSHD is
/dev/sdc. 

ionice -c2 -n4096 dd if=/dev/zero of=/dev/sdc bs=1M count=1024
ionice -c2 -n4096 dd if=/dev/sdc of=/dev/null bs=1M count=1024

Note that the class field indicates the best effort while the n field
identifies the io priority. Also note that these io priorities translate to
the SSHD hints that pass down the SATA link as follows IOPRIO_ADV_NONE
translates to 0x0 IOPRIO_ADV_EVICT translates to 0x20 IOPRIO_ADV_DONTNEED
translates to 0x21 IOPRIO_ADV_NORMAL translates to MAX PRI - 1
IOPRIO_ADV_NORMAL translates to MAX PRI 

MAX PRI is the maximum priority level supported by the SSHD

The translation from ionice cache hint to ATA hybrid hint is controlled
using a hybrid_translation_table. A default table is built-in to libata. 

This default table can be overridden with a new table through the
firmware_update. The new table can be applied on a per ata_device
basis. The reasoning is that the translation can be optimized for VendorA
SSHDs differently from VendorB SSHDs. A hybrid_information_table.bin could
override the ./firmware directory to update this table. 

The .config might be modified to build-in the new table
CONFIG_EXTRA_FIRMWARE="hybrid_information_table.bin" 
CONFIG_EXTRA_FIRMWARE_DIR="firmware"

To toggle enable/disable of the feature
echo 1 > /sys/class/ata_device/devX.0/hybrid

We ran performance tests with SSHDs from two different vendors and saw the
following results with default all-insert policy: 
	50% improvement in boot times
	45% improvment in App launch
	3x faster browser
	4x faster SQLite

The performance results also showed that host hinting using the above
default performed significantly better than the self hinting in using
benchmarks. 

We are looking for feedback on the cache hinting approach, as it seems
others are interested in this capability.  We're also looking for comments
on the libata implementation for supporting host hinted SSHDs. A patch to
sg3_utils for retrieving the Hybrid Information Log follows. Per the spec
host-hinted SSHDs revert to internal firmware hinted SSHDs if the log is
not read after a certain number of power cycles. 

---

Dan Williams (3):
      block, ioprio: include caching advice via ionice
      block: ioprio hint to low-level device drivers
      block: untangle ioprio from BLK_CGROUP and BLK_DEV_THROTTLING

Jason B. Akers (1):
      libata: Enabling Solid State Hybrid Drives (SSHDs) based on SATA 3.2 standard

Kapil Karkra (1):
      block, mm: Added the necessary plumbing to take ioprio hints down to block layer


 block/bio.c                    |   76 +++++++-----
 block/blk-throttle.c           |    5 +
 block/blk.h                    |    2 
 block/ioprio.c                 |   22 ++-
 drivers/ata/Makefile           |    2 
 drivers/ata/libata-core.c      |   13 ++
 drivers/ata/libata-eh.c        |   11 ++
 drivers/ata/libata-hybrid.c    |  261 ++++++++++++++++++++++++++++++++++++++++
 drivers/ata/libata-hybrid.h    |   14 ++
 drivers/ata/libata-scsi.c      |    4 -
 drivers/ata/libata-transport.c |   45 +++++++
 drivers/ata/libata.h           |    2 
 include/linux/ata.h            |    1 
 include/linux/bio.h            |   69 ++++++++++-
 include/linux/ioprio.h         |   32 ++++-
 include/linux/libata.h         |    4 +
 include/linux/page-flags.h     |   24 ++++
 mm/debug.c                     |    5 +
 mm/filemap.c                   |   18 +++
 19 files changed, 561 insertions(+), 49 deletions(-)
 create mode 100644 drivers/ata/libata-hybrid.c
 create mode 100644 drivers/ata/libata-hybrid.h

--
Thanks,
jba
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/