Helpful ReplyCached Hard Drive for Kontakt Libraries

Author
Glyn Barnes
Max Output Level: -0.3 dBFS
  • Total Posts : 7564
  • Joined: 2009/06/10 05:12:31
  • Location: A Stone's Throw from the Line
  • Status: offline
2016/10/18 10:25:25 (permalink)

Cached Hard Drive for Kontakt Libraries

I have been chasing down the cause of very long load times on some Kontakt Libraries.
 
For a couple of years I have been keeping most of my third party Kontakt libraries on a 1TB HD with an SSD Cache. Recently I encountered very long load times (see http://forum.cakewalk.com/FindPost/3499167 ) with the Embertone Mountain Dulcimer. Once I moved a copy of the library to my SSD drive it loaded very quickly.
 
It has been suggested on the NI forum that the cached drive may not be ideal for use with Kontakt. https://www.native-instruments.com/forum/threads/very-slow-loading-in-kontakt-5-6-1.310506/
 
Does anyone else here have good or bad experiences with a cached drive?

Intel i7 3770K @4.4GHz, 32GB RAM, 240GB SSD System disk, 2 x 2TB and 1 x 1TB (with SSD Cache) HDD. Windows 10,  Sonar Platinum. Roland Quad Capture. 
Music - Switchwater on Soundclick
Music - Goldry Bluszco on Soundcloud
#1
dcumpian
Max Output Level: -34 dBFS
  • Total Posts : 4124
  • Joined: 2005/11/03 15:50:51
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/18 16:42:43 (permalink)
The thing about cached (hybrid) drives is that the cache is not usually large enough to make a difference with the newer, larger sample libraries, so all of the loading is still from disk. An SSD is really the only "cure".
 
Regards,
Dan

Mixing is all about control.
 
My music:
http://dancumpian.bandcamp.com/ or https://soundcloud.com/dcumpian Studiocat Advanced Studio DAW (Intel i5 3550 @ 3.7GHz, Z77 motherboard, 16GB Ram, lots of HDDs), Sonar Plat, Mackie 1604, PreSonus Audiobox 44VSL, ESI 4x4 Midi Interface, Ibanez Bass, Custom Fender Mexi-Strat, NI S88, Roland JV-2080 & MDB-1, Komplete, Omnisphere, Lots o' plugins.    
#2
Glyn Barnes
Max Output Level: -0.3 dBFS
  • Total Posts : 7564
  • Joined: 2009/06/10 05:12:31
  • Location: A Stone's Throw from the Line
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/19 11:58:48 (permalink)
dcumpian
The thing about cached (hybrid) drives is that the cache is not usually large enough to make a difference with the newer, larger sample libraries, so all of the loading is still from disk. An SSD is really the only "cure".
 
Regards,
Dan


 
Makes sense but I run pretty big libraries off of it, the issue with the Embertone library was very strange, it was taking tens of minuets to load.
 
I notice the difference loading recently used libraries compared to ones you have not used for a while, as I would expect, but nothing chronic like this last experience.

Intel i7 3770K @4.4GHz, 32GB RAM, 240GB SSD System disk, 2 x 2TB and 1 x 1TB (with SSD Cache) HDD. Windows 10,  Sonar Platinum. Roland Quad Capture. 
Music - Switchwater on Soundclick
Music - Goldry Bluszco on Soundcloud
#3
dcumpian
Max Output Level: -34 dBFS
  • Total Posts : 4124
  • Joined: 2005/11/03 15:50:51
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/19 14:02:46 (permalink)
Glyn Barnes
dcumpian
The thing about cached (hybrid) drives is that the cache is not usually large enough to make a difference with the newer, larger sample libraries, so all of the loading is still from disk. An SSD is really the only "cure".
 
Regards,
Dan


Makes sense but I run pretty big libraries off of it, the issue with the Embertone library was very strange, it was taking tens of minuets to load.
 
I notice the difference loading recently used libraries compared to ones you have not used for a while, as I would expect, but nothing chronic like this last experience.




Maybe the new Embertone library packages it's samples differently than other libraries you have used. My understanding is that the hybrid drives will read-ahead to try and anticipate what the computer will access next. Do you see any packaging differences, like single large compressed files vs many smaller files?
 
Regards,
Dan

Mixing is all about control.
 
My music:
http://dancumpian.bandcamp.com/ or https://soundcloud.com/dcumpian Studiocat Advanced Studio DAW (Intel i5 3550 @ 3.7GHz, Z77 motherboard, 16GB Ram, lots of HDDs), Sonar Plat, Mackie 1604, PreSonus Audiobox 44VSL, ESI 4x4 Midi Interface, Ibanez Bass, Custom Fender Mexi-Strat, NI S88, Roland JV-2080 & MDB-1, Komplete, Omnisphere, Lots o' plugins.    
#4
bitflipper
01100010 01101001 01110100 01100110 01101100 01101
  • Total Posts : 26036
  • Joined: 2006/09/17 11:23:23
  • Location: Everett, WA USA
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/20 10:37:16 (permalink) ☄ Helpfulby Mitch_I 2016/10/20 10:51:31
The way any kind of caching works is that the drive searches the cache first, and if the file isn't found it then copies the file to the cache and re-tries. Every time it finds the file in the cache on the first try, it's called a "cache hit". Every time it doesn't, it's called a "cache miss". The ratio of hits and misses is called the "hit rate". As you can imagine, this actually slows things down when the hit rate is low. A sample library is going to have a very low hit rate when it first loads.


All else is in doubt, so this is the truth I cling to. 

My Stuff
#5
ampfixer
Max Output Level: -20 dBFS
  • Total Posts : 5508
  • Joined: 2010/12/12 20:11:50
  • Location: Ontario
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/20 14:25:43 (permalink)
I have a 250 gig SSD for all my Kontakt libraries and never an issue with load times. I can strongly recommend this solution as affordable and reliable. 

Regards, John 
 I want to make it clear that I am an Eedjit. I have no direct, or indirect, knowledge of business, the music industry, forum threads or the meaning of life. I know about amps.
WIN 10 Pro X64, I7-3770k 16 gigs, ASUS Z77 pro, AMD 7950 3 gig,  Steinberg UR44, A-Pro 500, Sonar Platinum, KRK Rokit 6 
#6
dcumpian
Max Output Level: -34 dBFS
  • Total Posts : 4124
  • Joined: 2005/11/03 15:50:51
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/20 14:40:20 (permalink)
ampfixer
I have a 250 gig SSD for all my Kontakt libraries and never an issue with load times. I can strongly recommend this solution as affordable and reliable. 




I use a 2TB Samsung SSD for Kontakt and BFD3 libraries. What a difference. I'll be adding a second one in November (on that dark day after Thanksgiving).
 
Still not sure why the OP is having slow load times with a single library and not any others though...
 
Regards,
Dan

Mixing is all about control.
 
My music:
http://dancumpian.bandcamp.com/ or https://soundcloud.com/dcumpian Studiocat Advanced Studio DAW (Intel i5 3550 @ 3.7GHz, Z77 motherboard, 16GB Ram, lots of HDDs), Sonar Plat, Mackie 1604, PreSonus Audiobox 44VSL, ESI 4x4 Midi Interface, Ibanez Bass, Custom Fender Mexi-Strat, NI S88, Roland JV-2080 & MDB-1, Komplete, Omnisphere, Lots o' plugins.    
#7
Glyn Barnes
Max Output Level: -0.3 dBFS
  • Total Posts : 7564
  • Joined: 2009/06/10 05:12:31
  • Location: A Stone's Throw from the Line
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/20 15:48:49 (permalink)
dcumpian
Maybe the new Embertone library packages it's samples differently than other libraries you have used. My understanding is that the hybrid drives will read-ahead to try and anticipate what the computer will access next. Do you see any packaging differences, like single large compressed files vs many smaller files?


Nothing seems unusual about this library. I also tried it on one of my hard drives, as expected slower than the SSD, but perfectly acceptable.

Intel i7 3770K @4.4GHz, 32GB RAM, 240GB SSD System disk, 2 x 2TB and 1 x 1TB (with SSD Cache) HDD. Windows 10,  Sonar Platinum. Roland Quad Capture. 
Music - Switchwater on Soundclick
Music - Goldry Bluszco on Soundcloud
#8
Glyn Barnes
Max Output Level: -0.3 dBFS
  • Total Posts : 7564
  • Joined: 2009/06/10 05:12:31
  • Location: A Stone's Throw from the Line
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/20 15:55:10 (permalink)
bitflipper
The way any kind of caching works is that the drive searches the cache first, and if the file isn't found it then copies the file to the cache and re-tries. Every time it finds the file in the cache on the first try, it's called a "cache hit". Every time it doesn't, it's called a "cache miss". The ratio of hits and misses is called the "hit rate". As you can imagine, this actually slows things down when the hit rate is low. A sample library is going to have a very low hit rate when it first loads.


Yes, my experience shows recently used libraries load quickly while those not used for a while take longer so normal behaviour is as expected. The Embertone dulcimer however did not show any noticeable improvement even after it had been loaded a couple of times.
 
I have been using this drive successfully for a couple of years and have never seen this problem before. I will need extra storage soon so I am looking at options.

Intel i7 3770K @4.4GHz, 32GB RAM, 240GB SSD System disk, 2 x 2TB and 1 x 1TB (with SSD Cache) HDD. Windows 10,  Sonar Platinum. Roland Quad Capture. 
Music - Switchwater on Soundclick
Music - Goldry Bluszco on Soundcloud
#9
TheSteven
Max Output Level: -55 dBFS
  • Total Posts : 2037
  • Joined: 2005/03/05 01:17:06
  • Location: Southern California
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/23 23:56:05 (permalink)
Not arguing with what was previously said.
But my impression was that the cache in a cached HD was mainly to improve boot up time.
My SSD made such a big change in everything I ran on my PC that at this point the difference between cached & uncached feels insignificant (though I still use them for back ups).
 
About your issue - 
How full is your drive?  (not an issue on SSD drives)
What's your fragmentation look like?
If your drive is fairly full then new additions may end up being badly fragmented.
 
Also is the cached drive a 5400 or 7200 rpm?
For a while (maybe still? haven't checked in the last 2 years) Seagate was putting out some 5400 cached drives where the rpm wasn't on the label.
At one point I was using one of these as my sample drive and chucked it for straight 7200.
 

"Time is a great teacher, but unfortunately it kills all its pupils" Loius-Hector Berlioz

www.AgitatedState.com MenuMagic - plug-in management powertools!
My Tunes
#10
BobF
Max Output Level: 0 dBFS
  • Total Posts : 8124
  • Joined: 2003/11/05 18:43:11
  • Location: Missouri - USA
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/24 09:03:57 (permalink)
Since this is only file with poor performance, it's possible part of that file is on marginal sectors.
 
A quick check of Event Logs might uncover something

Bob  --
Angels are crying because truth has died ...
Illegitimi non carborundum
--
Studio One Pro / i7-6700@3.80GHZ, 32GB Win 10 Pro x64
Roland FA06, LX61+, Fishman Tripleplay, FaderPort, US-16x08 + ARC2.5/Event PS8s 
Waves Gold/IKM Max/Nomad Factory IS3/K11U

#11
Vastman
Max Output Level: -50 dBFS
  • Total Posts : 2508
  • Joined: 2006/08/30 02:49:18
  • Location: Oakland, CA
  • Status: offline
Re: Cached Hard Drive for Kontakt Libraries 2016/10/27 02:03:39 (permalink)
If you haven't done a "batch resave" on that library... do it... it makes a huge difference in load times.  (it's in the cog dropdown)

Dana
We make the future... Climate Change Music
VastMaschine:SP4L/W10/i74930K/32GB/RME/CAD E100s; The Orchestra! NOVO!/Inspire/BohemianViolin&Cello, ARK1&2,/MinimalCapriccioMaximoSoto/OE1&2, Action&Emotive/Omni2/Tril/RMX/All OrangeTree/Falcon/APE Jugs/Alpha&Bravo/BFD3 & SD3
Gravity/DM307/AEON/DM/Damage/Diva/HZebra/Hive/Diversion/VC4/Serum/Alchemy/blablabla
Spitfire/8DIO/SL/KH/EW/NI; Shred1&2/AGF,G,M&T Torch&Res&Ren/GD-6; Ibanez SR1200&SR505
NOVAX FanFret Tele&Strat 
#12
Jump to:
© 2024 APG vNext Commercial Version 5.1