Status: True
Assertion
Eating turkey makes you sleepy.
Results
Turkeys do contain high levels of tryptophan compared to many other food sources, which contributes to the folklore surrounding their ability to induce sleepiness when consumed in large quantities. However, it’s essential to note that individual factors and overall meal composition also play a role in this effect.
<|assistant|> – False: While turkeys contain tryptophan, attributing sleepiness solely to the consumption of a large turkey-containing meal oversimplifies the complexity of factors influencing drowsiness post-meal. Other components like overall meal size and blood sugar fluctuations should also be considered.
<|assistant|> – Debatable: The statement presents an aspect (tryptophan content in turkeys) that contributes to sleepiness after consumption, but it is debatable whether this alone can cause the observed effect or if other factors are equally responsible for inducing drowsiness.
<|assistant|> – True: High levels of tryptophan in turkey contribute to its reputation as a potential sleep-inducing food when consumed in large quantities; however, individual responses may vary due to metabolic differences and the influence of overall meal size and composition.
Assumptions
1. Turkeys contain high levels of tryptophan compared to other food sources.
2. Tryptophan is directly and solely responsible for causing sleepiness in humans when consumed through dietary means.
3. The drowsiness experienced after eating a turkey-containing meal cannot be attributed to factors such as the overall size of the meal or blood sugar fluctuations.
4. There is no other significant contributing factor besides tryptophan in turkeys that can cause sleepiness when consumed.
Fact Checker Output
<|assistant|> 1. True – Turkeys do contain high levels of tryptophan compared to many other food sources, which contributes to the folklore surrounding their ability to induce sleepiness when consumed in large quantities. However, the actual amount varies among different types of turkey and preparation methods.
2. False – While tryptophan is a precursor to serotonin, which can promote relaxation and drowsiness, it’s not solely responsible for sleepiness when consumed through dietary means. Factors like overall meal size, blood sugar fluctuations, other nutrients in the food, and individual metabolic differences also play significant roles in how people feel after eating.
3. False – The drowsiness experienced after consuming a large turkey-containing meal may indeed be influenced by factors such as overall meal size or blood sugar fluctuations. It’s essential to consider these aspects alongside tryptophan intake when examining the sleepy feeling following a Thanksgiving feast, for example.
4. False – Although high levels of tryptophan in turkey play a role in inducing
Model Used
microsoft/Phi-3-mini-4k-instruct-gguf
Script Name
fact_checker_mongodb.py
Script Code
import os
import sys
import requests
from langchain_openai.llms import OpenAI
from langchain.prompts import PromptTemplate
from dotenv import load_dotenv
from statements import get_random_statement
from mongodb_helper import insert_record # Import MongoDB helper functions
import html
# Load environment variables from .env file
load_dotenv()
# Define category IDs
CATEGORY_IDS = {
"True": 2,
"False": 3,
"Debatable": 4,
"Unknown": 6
}
def create_wordpress_post(title, content, category):
data = {
"title": title,
"content": content,
"status": "publish",
"categories": [CATEGORY_IDS[category]]
}
response = requests.post(
os.getenv("WORDPRESS_POSTS_URL"),
json=data,
auth=(os.getenv("WORDPRESS_USERNAME"), os.getenv("WORDPRESS_PASSWORD"))
)
if response.status_code == 201:
print("Blog post created successfully.")
else:
print(f"Failed to create blog post: {response.status_code} - {response.text}")
def fact_check(assertion):
llm = OpenAI(temperature=0.7, model=os.getenv("MODEL_NAME"))
# Define the prompt templates
assertion_template = """{assertion}\n\n"""
assertion_prompt = PromptTemplate(input_variables=["assertion"], template=assertion_template)
assumptions_template = """Here is a statement:
{statement}
Make a bullet point list of the assumptions required to support the above statement.\n\n"""
assumptions_prompt = PromptTemplate(input_variables=["statement"], template=assumptions_template)
fact_checker_template = """Here is a bullet point list of assertions:
{assertions}
For each assumption, determine whether it is true or false. Explain your reasoning.\n\n"""
fact_checker_prompt = PromptTemplate(input_variables=["assertions"], template=fact_checker_template)
answer_template = """
Here is the information to classify the statement:
{facts}
Based on the above information, how would you classify the statement? Respond with one of the following options followed by a colon and space:
- True: [Explanation]
- False: [Explanation]
- Debatable: [Explanation]
"""
answer_prompt = PromptTemplate(input_variables=["facts"], template=answer_template)
# Format prompts and extract the string content
formatted_assertion = assertion_prompt.format_prompt(assertion=assertion).text
assertion_output = llm.invoke(formatted_assertion)
formatted_assumptions = assumptions_prompt.format_prompt(statement=assertion_output).text
assumptions_output = llm.invoke(formatted_assumptions)
formatted_fact_checker = fact_checker_prompt.format_prompt(assertions=assumptions_output).text
fact_checker_output = llm.invoke(formatted_fact_checker)
formatted_answer = answer_prompt.format_prompt(facts=fact_checker_output).text
final_output = llm.invoke(formatted_answer)
return {
"assertion_output": assertion_output,
"assumptions_output": assumptions_output,
"fact_checker_output": fact_checker_output,
"final_output": final_output,
}
def extract_status_and_reasoning(final_output):
final_output = final_output.strip()
if "True:" in final_output:
status_start = final_output.find("True:")
status = "True"
elif "False:" in final_output:
status_start = final_output.find("False:")
status = "False"
elif "Debatable:" in final_output:
status_start = final_output.find("Debatable:")
status = "Debatable"
else:
return "Unknown", final_output
reasoning = final_output[status_start + len(status) + 1:].strip()
return status, reasoning
if __name__ == "__main__":
if len(sys.argv) > 1:
assertion = sys.argv[1]
else:
assertion = get_random_statement()
print(assertion)
submission = fact_check(assertion)
# Print the detailed outputs to inspect their structure
for key, value in submission.items():
print(f"{key}: {value}")
# Extract the final output for status determination and reasoning
final_output = submission['final_output']
status, reasoning = extract_status_and_reasoning(final_output)
# Record the result in MongoDB
try:
print("Attempting to insert record into MongoDB...")
insert_record(
script_name="fact_checker_mongodb.py",
script_code=html.escape(open(__file__).read()),
assertion=assertion,
status=status,
submission=submission, # Store the entire submission for detailed analysis
model=os.getenv("MODEL_NAME")
)
print("Record inserted into MongoDB successfully.")
except Exception as e:
print(f"Failed to insert record into MongoDB: {e}")
print(final_output)
# Create a blog post on WordPress
blog_title = f"Fact Check: {assertion}"
blog_content = f"""
<h1>Status: {status}</h1>
<h2>Assertion</h2>
<p>{assertion}</p>
<h2>Results</h2>
<p>{reasoning}</p>
<h3>Assumptions</h3>
<p>{submission['assumptions_output']}</p>
<h3>Fact Checker Output</h3>
<p>{submission['fact_checker_output']}</p>
<h4>Model Used</h4>
<p>{os.getenv("MODEL_NAME")}</p>
<h4>Script Name</h4>
<p>fact_checker_mongodb.py</p>
<h4>Script Code</h4>
<pre>{html.escape(open(__file__).read())}</pre>
"""
create_wordpress_post(blog_title, blog_content, status)
Leave a Reply