Helpful ReplyIs there a synth that can do this?

Author
davdud101
Max Output Level: -69 dBFS
  • Total Posts : 1058
  • Joined: 2010/07/15 13:30:44
  • Location: Detroit, MI
  • Status: offline
2018/04/07 13:33:14 (permalink)

Is there a synth that can do this?

I'm on the lookout - there are scores upon scores of fantabulous free and paid synths out there, so I'm sure someone knows what I want:
 
I'm looking for something in the vein of a combination of Dropzone (software that lets you load in your own sample, set loop points and stuff to make the sample loop properly), combined with a live audio-processing synth.
 
Essentially I want to send an audio signal thru a synth that can "reskin" the notes I'm playing with a sample in realtime - particularly a sample, not a synthesized sound. Best if it can take custom samples.
 
Is it out there? :)

 
Mics: MXL 990, MXL R80, 2 x MXL Tempo XLRs, Cobalt Co9, SM48, iSK Starlight
Cans: Hifiman HE4XX, AKG M220
Gear: Cakewalk BBL - PreSonus Firepod - Alesis Elevate 3 - Axiom 49
DAW: Win10, AMD FX-8300, 16GB DDR3
#1
abacab
Max Output Level: -30.5 dBFS
  • Total Posts : 4464
  • Joined: 2014/12/31 19:34:07
  • Status: offline
Re: Is there a synth that can do this? 2018/04/08 00:09:45 (permalink)
If I understood your question correctly, I'm not aware of anything that can play a different sample based on incoming audio (notes) in real-time.  MIDI yes, audio?
 
The only things I'm aware of so far in this regard is for using a synth as an effect, or as a vocoder, to re-synthesize incoming audio.  But as far as triggering new samples, that certainly sounds interesting, but don't know if that has been achieved yet.  I would see the initial challenge as doing the pitch detection, aka ARA Celemony Melodyne, and then substituting a sound.
 
If anybody can correct me, I am interested in this topic as well!

DAW: CbB; Sonar Platinum, and others ... 
#2
davdud101
Max Output Level: -69 dBFS
  • Total Posts : 1058
  • Joined: 2010/07/15 13:30:44
  • Location: Detroit, MI
  • Status: offline
Re: Is there a synth that can do this? 2018/04/08 02:15:46 (permalink)
abacab
If I understood your question correctly, I'm not aware of anything that can play a different sample based on incoming audio (notes) in real-time.  MIDI yes, audio?
 
The only things I'm aware of so far in this regard is for using a synth as an effect, or as a vocoder, to re-synthesize incoming audio.  But as far as triggering new samples, that certainly sounds interesting, but don't know if that has been achieved yet.  I would see the initial challenge as doing the pitch detection, aka ARA Celemony Melodyne, and then substituting a sound.
 
If anybody can correct me, I am interested in this topic as well!




The closest I've come to seeing it is with things like GCBS4. But I guess it needs to be quick/low-latency enough to take a note played live, detect the pitch and then convert that to MIDI all within a  reasonable enough amount of time that it feels more or less real-time (depending on the intended use).
After all, one could always just play the part on a MIDI keyboard or drop audio onto a MIDI track and let Melodyne or other software figure out the rest. But then that wouldn't be any fun, now would it??
 
My idea in the long-run being of course to be able to record some trumpet or 'bone, and then have the audio shuffled through a synth/sampling software that can vaguely emulate the sound of a saxophone with a little more natural expression that what you can get with standard MIDI playing on a keyboard by a fumbly semi-keyboardist like myself 

 
Mics: MXL 990, MXL R80, 2 x MXL Tempo XLRs, Cobalt Co9, SM48, iSK Starlight
Cans: Hifiman HE4XX, AKG M220
Gear: Cakewalk BBL - PreSonus Firepod - Alesis Elevate 3 - Axiom 49
DAW: Win10, AMD FX-8300, 16GB DDR3
#3
Kamikaze
Max Output Level: -45 dBFS
  • Total Posts : 3013
  • Joined: 2015/01/15 21:38:59
  • Location: Da Nang, Vietnam
  • Status: offline
Re: Is there a synth that can do this? 2018/04/08 02:55:57 (permalink)
I'd guess there are two aspects here, the transient and the tone. As you say "vaguely emulate the sound of a saxophone" then I maybe yu culd shape the transient real time with a transient shaper designed fr the task, in rea time. For the tone, you'd be looking to change the shape of the wave form and that would require mdifying the harmnic series in real time.

 
To do this would require real time pitch tracking, then Timbral shaping of the harmonic series. Autotune does real time tracking,  and melodyne timbral shaping, so I guess the technology is possible. How effective it would be I don't know. I haven't tried the timbral shaping on brass to make it sound like a reed in melodyne, but I have sample modelling's brass collection, it it allows shaping of the first 10 partials. But I can't get the brass sound any different than brass with it.

 
#4
Kamikaze
Max Output Level: -45 dBFS
  • Total Posts : 3013
  • Joined: 2015/01/15 21:38:59
  • Location: Da Nang, Vietnam
  • Status: offline
Re: Is there a synth that can do this? 2018/04/08 03:04:42 (permalink)

 
#5
sharke
Max Output Level: 0 dBFS
  • Total Posts : 13933
  • Joined: 2012/08/03 00:13:00
  • Location: NYC
  • Status: offline
Re: Is there a synth that can do this? 2018/04/08 03:17:35 (permalink)
It sounds like all you need is a realtime audio to MIDI converter. Once you have that conversion happening in real time then it's just a matter of routing the MIDI to whatever synth or sampler you like. I'm not sure but I think that Melda's free MTuner converts audio to MIDI notes in real time. I would think you'd just enable MIDI-out in the VST settings, then set MTuner as the input to the MIDI track that's playing the synth. Having said that, I don't know if it outputs velocity as well as pitch. That may or may not be an acceptable limitation for you. Melodyne outputs velocity, but of course that's not in real time. 

James
Windows 10, Sonar SPlat (64-bit), Intel i7-4930K, 32GB RAM, RME Babyface, AKAI MPK Mini, Roland A-800 Pro, Focusrite VRM Box, Komplete 10 Ultimate, 2012 American Telecaster!
#6
Kamikaze
Max Output Level: -45 dBFS
  • Total Posts : 3013
  • Joined: 2015/01/15 21:38:59
  • Location: Da Nang, Vietnam
  • Status: offline
Re: Is there a synth that can do this? 2018/04/08 03:45:47 (permalink)
Meldyne used to be able to output pitch too, but they removed that function with 4. I guess there were some issues, but I hope it returns in the future, and they add expression, maybe from RMS.

 
#7
abacab
Max Output Level: -30.5 dBFS
  • Total Posts : 4464
  • Joined: 2014/12/31 19:34:07
  • Status: offline
Re: Is there a synth that can do this? 2018/04/08 16:17:52 (permalink)
Maybe a MIDI guitar plugin?

DAW: CbB; Sonar Platinum, and others ... 
#8
eph221
Max Output Level: -28.5 dBFS
  • Total Posts : 4665
  • Joined: 2014/12/22 05:06:50
  • Status: offline
Re: Is there a synth that can do this? 2018/04/14 02:26:01 (permalink)
sharke
It sounds like all you need is a realtime audio to MIDI converter. Once you have that conversion happening in real time then it's just a matter of routing the MIDI to whatever synth or sampler you like. I'm not sure but I think that Melda's free MTuner converts audio to MIDI notes in real time. I would think you'd just enable MIDI-out in the VST settings, then set MTuner as the input to the MIDI track that's playing the synth. Having said that, I don't know if it outputs velocity as well as pitch. That may or may not be an acceptable limitation for you. Melodyne outputs velocity, but of course that's not in real time. 


Cub-ase has all this already (the audio to midi to note)

*Q-TIPS ARE FUZZY!!*
 Is a lumineer a new dental appliance?  
 
i7 2.5 ghz
32GB RAM
WINDOWS 10
My Ass
Cubase 9.5
 
#9
mettelus
Max Output Level: -22 dBFS
  • Total Posts : 5321
  • Joined: 2005/08/05 03:19:25
  • Location: Maryland, USA
  • Status: offline
Re: Is there a synth that can do this? 2018/04/14 05:58:49 (permalink)
I am not sure if I am understanding the OP correctly. Seems you want a sample editor that will then play samples to the pitch of each MIDI key and allow you access to underlying synth parameters? The first thing that comes to mind is iZotope's IRIS 2, which is worth checking out (free 10-day trial). The sample manipulation is pretty good with that, and the rest of the audio engine is synth-based (you can also layer up to 4 samples and determine loop points and how it is played (start to finish, back and forth, finish to start, etc.)). That goes on sale fairly regularly and has upgrade options too.

ASUS ROG Maximus X Hero (Wi-Fi AC), i7-8700k, 16GB RAM, GTX-1070Ti, Win 10 Pro, Saffire PRO 24 DSP, A-300 PRO, plus numerous gadgets and gizmos that make or manipulate sound in some way.
#10
abacab
Max Output Level: -30.5 dBFS
  • Total Posts : 4464
  • Joined: 2014/12/31 19:34:07
  • Status: offline
Re: Is there a synth that can do this? 2018/04/15 21:20:59 (permalink) ☄ Helpfulby davdud101 2018/04/16 02:22:57
Jam Origin has MIDI guitar and MIDI bass plugin demos, and they are working on MIDI violin.
 
I have heard that the plugins work well with the audio input from the instrument, without any special hardware, and can trigger a sampler.
http://www.jamorigin.com/products/
 

DAW: CbB; Sonar Platinum, and others ... 
#11
davdud101
Max Output Level: -69 dBFS
  • Total Posts : 1058
  • Joined: 2010/07/15 13:30:44
  • Location: Detroit, MI
  • Status: offline
Re: Is there a synth that can do this? 2018/04/16 02:25:07 (permalink)
abacab
Jam Origin has MIDI guitar and MIDI bass plugin demos, and they are working on MIDI violin.
 
I have heard that the plugins work well with the audio input from the instrument, without any special hardware, and can trigger a sampler.
http://www.jamorigin.com/products/



THIS, abacab, THIS is EXACTLY what I meant!!! Wow!! Jam Origin's software seems to be precisely, absolutely exactly what I had envisioned. And here I was thinking I had a novel concept on my hands
I'm gonna put in a few more hours gumming around in the software to get a sense for it's abilities and limitations.

 
Mics: MXL 990, MXL R80, 2 x MXL Tempo XLRs, Cobalt Co9, SM48, iSK Starlight
Cans: Hifiman HE4XX, AKG M220
Gear: Cakewalk BBL - PreSonus Firepod - Alesis Elevate 3 - Axiom 49
DAW: Win10, AMD FX-8300, 16GB DDR3
#12
abacab
Max Output Level: -30.5 dBFS
  • Total Posts : 4464
  • Joined: 2014/12/31 19:34:07
  • Status: offline
Re: Is there a synth that can do this? 2018/04/17 02:23:11 (permalink)
Looking forward to hearing how it all works out for you!  Was thinking about pulling my old Fender P-Bass out, and giving this a spin!

DAW: CbB; Sonar Platinum, and others ... 
#13
TheMaartian
Max Output Level: -47.5 dBFS
  • Total Posts : 2774
  • Joined: 2015/05/21 18:30:52
  • Location: Flagstaff, AZ
  • Status: offline
Re: Is there a synth that can do this? 2018/04/17 14:30:06 (permalink) ☄ Helpfulby abacab 2018/04/17 23:17:33
MIDIGuitar/MIDIBass are great. You're gonna love them.
 
Tip: practice to the patch
 
Some info and a great video by Chandler Guitar:
 
https://theproaudiofiles.com/jam-origins-midi-guitar-live-performance/
 
Must read! http://forum.cakewalk.com...g-SOLVED-m3648470.aspx
 


Intel i7 3.4GHz, 16 GB RAM, 2 TB HD Win10 Home 64-bit Tascam US-16x08
Studio One 4 Pro NotionMelodyne 4 Studio Acoustica 7 Guitar Pro 7
PreSonus FaderPort Nektar P6 M-Audio BX8 D2 Beyerdynamic DT 880 Pro
NI K9U XLN AK, AD2 AAS VS-2, GS-2, VA-2, EP-4, CP-2, OD Toontrack SD3, EZK
#14
TheMaartian
Max Output Level: -47.5 dBFS
  • Total Posts : 2774
  • Joined: 2015/05/21 18:30:52
  • Location: Flagstaff, AZ
  • Status: offline
Re: Is there a synth that can do this? 2018/04/17 14:32:31 (permalink)
MIDIBass is still included with the purchase of MIDIGuitar. I think their plan is to start selling MIDIBass separately when they add polyphony to it (v2?).
 

Intel i7 3.4GHz, 16 GB RAM, 2 TB HD Win10 Home 64-bit Tascam US-16x08
Studio One 4 Pro NotionMelodyne 4 Studio Acoustica 7 Guitar Pro 7
PreSonus FaderPort Nektar P6 M-Audio BX8 D2 Beyerdynamic DT 880 Pro
NI K9U XLN AK, AD2 AAS VS-2, GS-2, VA-2, EP-4, CP-2, OD Toontrack SD3, EZK
#15
davdud101
Max Output Level: -69 dBFS
  • Total Posts : 1058
  • Joined: 2010/07/15 13:30:44
  • Location: Detroit, MI
  • Status: offline
Re: Is there a synth that can do this? 2018/04/17 17:17:35 (permalink) ☄ Helpfulby abacab 2018/04/17 23:17:10
Lovely piece of software!
Is it able to run as a VSTi in SONAR? I'm certain its MIDI-out capabilities can be used in tandem with some virtual MIDI ports, I'll try that.
Perhaps it's possible to run, for example, Auto-tune or some scale-correcting MIDI-FX before the signal is sent to the synth? To make it easier to hit pitches and avoid notes that fall outside of a certain scale? Not sure. I've still got to put those few extra hours in to learn the software a bit deeper.
 
I like the tip of practicing to the patch. Some patches work great - glissy synths are awesome. Things like rhodes and keys require a lot more precision and then it's easier to get good results with an instrument like trumpet, for example (which is a LOT of fun - having to play trumpet but "think" like a keyboardist and execute what a keyboardist would play ON trumpet.)
 
I also dig the pitch bend abilities and stuff - THOSE are cool. I't s a load of fun doing silly stuff like playing a bass sample-patch while using an actual physical bass, or doing the same with a brass instrument, for example. For a moment, it FEELS like it's you playing - until you take off the headphones 
 
At $100, software this novel, yet THIS functional and powerful, is fully worth it - definitely going on my list of must-haves, as it fulfils every requirement and even more beyond what I was looking for in something like this!

 
Mics: MXL 990, MXL R80, 2 x MXL Tempo XLRs, Cobalt Co9, SM48, iSK Starlight
Cans: Hifiman HE4XX, AKG M220
Gear: Cakewalk BBL - PreSonus Firepod - Alesis Elevate 3 - Axiom 49
DAW: Win10, AMD FX-8300, 16GB DDR3
#16
abacab
Max Output Level: -30.5 dBFS
  • Total Posts : 4464
  • Joined: 2014/12/31 19:34:07
  • Status: offline
Re: Is there a synth that can do this? 2018/04/17 23:53:10 (permalink)
In Chandlers' video demo, he is using MIDI Guitar as a VST2 plugin in Sonar, then he demonstrates use of the standalone version with Overture connected via LoopMIDI virtual MIDI port.

DAW: CbB; Sonar Platinum, and others ... 
#17
Jump to:
© 2024 APG vNext Commercial Version 5.1