The second paragraph in your last section is really where the crux of this argument lies. To be brief, better story IS the answer. But despite what many developers and publishers think, the Venn diagram of better story and high-end screenwriter has very little overlap. To dismiss better story so ...
