The language specification is the syntax, grammar, intended results, and model the language operates upon.
The programming language specification is the specifics of the syntax and the grammar used for the language. This may additionally include information about the intended behavior of the various operands and the model that the language operates on.
The syntax is often defined as a series of regular expressions (lexing) and a grammar (often context-free) that describes the valid structures within the language.