CredAIble.com is a **BETA** website.
Credaible.com uses a ChatGPT algorithm to evaluate written text for biases and logical fallacies. The AI was refined over many months to generate a detailed report on every submitted text. It looks for 27 different kinds of logical fallacies including straw man, internal contradiction, red herring, and ad hominem. It also evaluates political bias on a seven-point scale from Extreme Left to Extreme Right.
The goal of credAIble is to improve civil society by strengthening the quality of the news media. Many news readers have expressed frustration with seemingly biased print media, but such frustrations were not easily or neutrally verifiable before the advent of AI. CredAIble is meant to be a demonstration project that shows how AI can help readers and writers identify and minimize the worst of biases and rhetorical tricks.
CredAIble was created by Tim Kane and Tyler Kohrt. We tested the algorithm on one of Tim’s least political essays, which is included in the first round of evaluations published on Jan. 22, 2024. The AI concluded that the essay, “Why Mozart Was Impoverished” had a neutral viewpoint but included three logical fallacies and this assessment:
The false analogy between Mozart's situation and contemporary artists like Elvis or Taylor Swift oversimplifies the complexities of historical and modern economic structures surrounding creative works. Additionally, the anecdotal references to the author's personal experiences with Mozart's music, while charming, do not contribute to a factual analysis of the topic.
While humans can disagree about whether a pointed rhetorical point is an actual *fallacy* and whether there should be some sensitivity or scale in such an assessment, our initial objectives are to start a conversation, to have our friends consume information more carefully and critically, and to build a community that works together for greater credibility in civil discourse. We will included a diverse mix of columns in our assessments, aiming for a roughly equal amount of those from the “left” and “right” as well as unconventional viewpoints. Please send recommendations to tylerckohrt@gmail.com.
CredAIble.com publishes a weekly round-up of the most interesting, biased, and unbiased columns from across the news world every Monday, both online at the website and through a substack newsletter, which you can subscribe to for free:
We welcome recommendations for recent columns, op-eds, or editorials for evaluation. Please send links to tylerckohrt@gmail.com.