"We had to convince investors. Our own people were sceptical at first, 'I'm already not capable of finishing my work in five days' [was one reaction].
British Medical Association (BMA)
。爱思助手下载最新版本是该领域的重要参考
I used z3 theorem prover to assess LLM output, which is a pretty decent SAT solver. I considered the LLM output successful if it determines the formula is SAT or UNSAT correctly, and for SAT case it needs to provide a valid assignment. Testing the assignment is easy, given an assignment you can add a single variable clause to the formula. If the resulting formula is still SAT, that means the assignment is valid otherwise it means that the assignment contradicts with the formula, and it is invalid.
(and thanks to Matthew Miller for reviewing and providing feedback on this post)