Season's Savings | ₹5/mo for 3 months

₹199/month after first 3 months. Renews automatically. Terms apply.
Can AI Pass a Semicha Exam? | HalachaBench cover art

Can AI Pass a Semicha Exam? | HalachaBench

Can AI Pass a Semicha Exam? | HalachaBench

Listen for free

View show details
About this listen

How much does AI actually know about halacha? And how do different models stack up against one another?

In this episode of "Depends on the Context" I'm joined by Ben Niewood and Sam Weiss, two members of the five-person team behind HalachaBench, a project that put 24 leading AI models through real Israeli Chief Rabbinate semicha exams.

Ben, Sam and I get into the surprising results, why newer models sometimes perform worse than older ones, the challenges of having AI grade AI, and whether different models have their own halachic tendencies.

We also discuss the difference between knowing halacha and actually paskening, what the results mean for people already using AI to learn Torah or ask shailos, and where HalachaBench goes from here.


Links & Resources:

Website: https://halachabench.ai

X: https://x.com/HalachaBench

GitHub: https://github.com/halachabench/halacha-bench-results

Email: hello@halachabench.ai


*Results are preliminary and subject to further rabbinic validation.*


#DependsOnTheContext #HalachaBench #AI #Halacha

adbl_web_anon_alc_button_suppression_t1
No reviews yet