Do the results of evaluating cutting-edge methods in an industrial setting constitute new knowledge? For example, suppose a new programming language is invented and some research regarding it is published, containing small, "toy" examples of its application. Suppose then that someone else takes this language and evaluates it in a real industrial case study, and reports on its usefulness and/or shortcomings.

My question about this second report is twofold:


Is it novel research (I suspect it probably is)
Would this kind of work be appropriate for a PhD thesis?
Science focuses on the acquisition of new knowledge.
"Does this really work outside the lab?" is a valid question on which to acquire knowledge.  Industry usage of a method often requires changes in scale and context which pose fundamentally new challenges to overcome.

Not all industrial evaluations, however, would be meaningful science.  The distinction is whether the information acquired by the evaluation constitutes a contribution to human knowledge or if it is just a recommendation for a decision by the company.  

For example, I saw a talk yesterday which included future work to evaluate a new membrane material in an industrial water-treatment facility.  Let's see some examples of how this evaluation might be science or not:


Science: When used at scale, is water quality maintained to appropriate standards? How well does the material hold up over time?
Not Science: Will this be easy to integrate into the current procedures of this particular plant?  What business and legal contracts will be necessary to switch suppliers?