jpetersen
Noel Borthwick [Cakewalk]
That's not accurate - Landr uses Machine learning. If you look at the theory, machine learning is as accurate as the DATA its given rather than as intelligent as the programmer....our Vocal sync feature was designed using machine learning to understand how to analyze and extract data from a huge subset of vocals samples.
In the Vocal sync case I can see the mechanism behind analyzing many vocal examples to find out common characteristics in these files.
But with LANDR, what is it learning? Who is giving it feedback to say, "That sounds better, what you did this time is right"?
It wouldn't surprise me if it turns out all it does is figure out genre based on tempo, harmonic density, etc. and then applies a preset, possibly even on a commercially available mastering tool.
This is a gross oversimplification but machine learning, like classical numerical analysis takes an input, parametrizes it and then applies a transformation function to produce a new output.
I don't know the specifics of what Landr does obviously, but its quite likely the transform does a spectral analysis of the audio and then using that data maps the input parameters to multiple plugin parameters that reside in the mastering chain. I expect that the parameter mapping would be done dynamically using automation so as to react to changes in the audio content on the timeline. Its not simply applying a preset but dynamically changing the DSP to produce the final result, much like a human mastering engineer would do by listening to the audio and making decisions to correct the frequency balance or loudness.
The machine learning is what generates the mapping from the source data to the final parameters. Machine learning essentially builds a data driven algorithm. In the learning process you feed it thousands or more samples of human curated data sets of input and output data. The software learns from that data and generates the transform that predicts the mapping. The more data you feed it the closer to reality it gets.
It's exactly the same approach we used for vocal sync just applied to solve a different problem. If you aren't familiar with machine learning, its quite astonishing how accurate the results get over time especially as you give it more exception cases and boundary conditions.