Status: Unknown
Assertion
The Earth revolves around the Sun.
Reasoning
Answer format should be as follows:
– Classification: [True/False/Debatable]; [Explanation]
– Response: – Classification: True; The statement is accurate based on established scientific knowledge, including Kepler’s laws of planetary motion. This aligns with the information provided in the fact-checking response which confirms that the statement adheres to recognized scientific understanding. Kepler’s laws describe how planets orbit around a star and are universally accepted as true within our current framework of physics, particularly regarding orbital mechanics.
Assumptions
<|assistant|> – The Sun exerts gravitational force, affecting celestial bodies within its vicinity.
– Our planet Earth is an orbiting body subjected to these forces.
– Orbital paths (in this case, elliptical orbits) are common for planets in our solar system.
– The concept of a year refers to the time it takes for one complete revolution around the Sun.
– Seasons on Earth occur due to its axial tilt relative to its orbital plane.
– Our understanding and observations align with established scientific principles, such as Kepler’s laws of planetary motion.
– The period mentioned (approximately 365.24 days) correlates with the length of a tropical year on Earth.
– Astronomical measurements and calculations are based on reliable data and observational evidence.
– Our solar system follows general patterns observed in other star systems, supporting our understanding of orbital mechanics.
– The elliptical nature of planetary orbits is supported by extensive astronomical research and observations.
– Earth’s axial tilt (23.5 degrees) plays a significant role in the occurrence of seasons on our planet.
Fact Checker Output
Response:
1. True – The Sun does exert gravitational force; this is well-established by Newton’s law of universal gravitation and observed through the motions of planets in our solar system.
2. True – Earth, being a planet within our solar system, orbits around the Sun due to this gravitational pull.
3. True – Most planets in our solar system have elliptical (oval-shaped) orbits rather than perfectly circular ones; Kepler’s first law describes this characteristic of orbital paths.
4. True – A year on Earth refers to the time it takes for Earth to complete one orbit around the Sun, which is approximately 365.24 days in a tropical year (ignoring leap years).
5. True – Seasons are caused by Earth’s axial tilt as it orbits the Sun; this tilt causes different hemispheres to receive varying amounts of sunlight throughout the year, leading to seasonal changes.
6. True – Our understanding aligns with Kepler’s laws of planetary motion and other scientific principles that describe how planets move in space.
7. True – The period mentioned is
Model Used
microsoft/Phi-3-mini-4k-instruct-gguf
Script Name
fact_checker_mongodb.py
Script Code
import os
import sys
import requests
from langchain_openai.llms import OpenAI
from langchain.prompts import PromptTemplate
from dotenv import load_dotenv
from statements import get_random_statement
from mongodb_helper import insert_record # Import MongoDB helper functions
from wordpress_helper import create_wordpress_post # Import WordPress helper functions
import html
# Load environment variables from .env file
load_dotenv()
def fact_check(assertion):
llm = OpenAI(temperature=0.7, model=os.getenv("MODEL_NAME"))
# Define the prompt templates
assertion_template = """{assertion}\n\n"""
assertion_prompt = PromptTemplate(input_variables=["assertion"], template=assertion_template)
assumptions_template = """Here is a statement:
{statement}
Make a bullet point list of the assumptions required to support the above statement.\n\n"""
assumptions_prompt = PromptTemplate(input_variables=["statement"], template=assumptions_template)
fact_checker_template = """Here is a bullet point list of assertions:
{assertions}
For each assumption, determine whether it is true or false. Explain your reasoning.\n\n"""
fact_checker_prompt = PromptTemplate(input_variables=["assertions"], template=fact_checker_template)
answer_template = """
Here is the information to classify the statement:
{facts}
Based on the above information, how would you classify the statement? Respond with one of the following options followed by a colon and space:
- True: [Explanation]
- False: [Explanation]
- Debatable: [Explanation]
"""
answer_prompt = PromptTemplate(input_variables=["facts"], template=answer_template)
# Format prompts and extract the string content
formatted_assertion = assertion_prompt.format_prompt(assertion=assertion).text
assertion_output = llm.invoke(formatted_assertion)
formatted_assumptions = assumptions_prompt.format_prompt(statement=assertion_output).text
assumptions_output = llm.invoke(formatted_assumptions)
formatted_fact_checker = fact_checker_prompt.format_prompt(assertions=assumptions_output).text
fact_checker_output = llm.invoke(formatted_fact_checker)
formatted_answer = answer_prompt.format_prompt(facts=fact_checker_output).text
final_output = llm.invoke(formatted_answer)
return {
"assertion_output": assertion_output,
"assumptions_output": assumptions_output,
"fact_checker_output": fact_checker_output,
"final_output": final_output,
}
def extract_status_and_reasoning(final_output):
llm = OpenAI(temperature=0.7, model=os.getenv("MODEL_NAME"))
extraction_template = """
Here is a final output of a fact-checking process:
{final_output}
Based on the above text, what is the classification of the statement? Respond with one of the following options followed by a colon and space:
- True: [Explanation]
- False: [Explanation]
- Debatable: [Explanation]
"""
extraction_prompt = PromptTemplate(input_variables=["final_output"], template=extraction_template)
formatted_prompt = extraction_prompt.format_prompt(final_output=final_output).text
extraction_output = llm.invoke(formatted_prompt).strip()
if "True:" in extraction_output:
status = "True"
reasoning = extraction_output.split("True:", 1)[1].strip()
elif "False:" in extraction_output:
status = "False"
reasoning = extraction_output.split("False:", 1)[1].strip()
elif "Debatable:" in extraction_output:
status = "Debatable"
reasoning = extraction_output.split("Debatable:", 1)[1].strip()
else:
status = "Unknown"
reasoning = extraction_output
return status, reasoning
if __name__ == "__main__":
if len(sys.argv) > 1:
assertion = sys.argv[1]
else:
assertion = get_random_statement()
print(assertion)
submission = fact_check(assertion)
# Print the detailed outputs to inspect their structure
for key, value in submission.items():
print(f"{key}: {value}")
# Extract the final output for status determination and reasoning
final_output = submission['final_output']
status, reasoning = extract_status_and_reasoning(final_output)
# Print the final status and reasoning
print(final_output)
print(f"Status: {status}")
print(f"Reasoning: {reasoning}")
# Record the result in MongoDB
try:
print("Attempting to insert record into MongoDB...")
insert_record(
script_name=__file__,
script_code=html.escape(open(__file__).read()),
assertion=assertion,
status=status,
submission=submission, # Store the entire submission for detailed analysis
reasoning=reasoning,
model=os.getenv("MODEL_NAME")
)
print("Record inserted into MongoDB successfully.")
except Exception as e:
print(f"Failed to insert record into MongoDB: {e}")
# Create a blog post on WordPress
blog_title = f"Fact Check: {assertion}"
blog_content = f"""
<h1>Status: {status}</h1>
<h2>Assertion</h2>
<p>{assertion}</p>
<h2>Reasoning</h2>
<p>{reasoning}</p>
<h3>Assumptions</h3>
<p>{submission['assumptions_output']}</p>
<h3>Fact Checker Output</h3>
<p>{submission['fact_checker_output']}</p>
<h4>Model Used</h4>
<p>{os.getenv("MODEL_NAME")}</p>
<h4>Script Name</h4>
<p>fact_checker_mongodb.py</p>
<h4>Script Code</h4>
<pre>{html.escape(open(__file__).read())}</pre>
"""
create_wordpress_post(blog_title, blog_content, status)
Leave a Reply