📄 Optional Recommended Reading
Resources
- linkhttps://www.oreilly.com/radar/a-field-guide-to-rapidly-improving-ai-products/
- linkhttps://www.honeyhive.ai/post/avoiding-common-pitfalls-in-llm-evaluation
- linkhttps://www.sh-reya.com/blog/in-defense-ai-evals
- linkhttps://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-024-02709-7
- linkhttps://dl.acm.org/doi/10.1145/3729176.3729200
- linkhttps://github.com/anthropics/prompt-eng-interactive-tutorial
- linkhttps://cookbook.openai.com/
Notes
Channels
-
[
announcements
](/parlance-labs/evals/2025-3/channel?channelId=283916d6-d0ce-4b62-9af9-b308a8eceecf)
- [general
](/parlance-labs/evals/2025-3/channel?channelId=6aa0dbf0-46ed-47e7-9ae8-cbbb4db531c9)
- [intros
](/parlance-labs/evals/2025-3/channel?channelId=c4b50f08-c5b5-4f3f-a9bd-c9684d5c7b3d)
- [ðŸ’
questions
](/parlance-labs/evals/2025-3/channel?channelId=0458bb33-ed98-42cf-b593-4161ac4cd2cd)
Messages
Channels
-
[
announcements
](/parlance-labs/evals/2025-3/channel?channelId=283916d6-d0ce-4b62-9af9-b308a8eceecf)
- [general
](/parlance-labs/evals/2025-3/channel?channelId=6aa0dbf0-46ed-47e7-9ae8-cbbb4db531c9)
- [intros
](/parlance-labs/evals/2025-3/channel?channelId=c4b50f08-c5b5-4f3f-a9bd-c9684d5c7b3d)
- [ðŸ’
questions
](/parlance-labs/evals/2025-3/channel?channelId=0458bb33-ed98-42cf-b593-4161ac4cd2cd)
Messages
FAQ and Links
📄
Optional Recommended Reading
Lesson 2
Articles
-
A Field Guide To Rapidly Improving AI Products (Hamel Husain): https://www.oreilly.com/radar/a-field-guide-to-rapidly-improving-ai-products/
-
Avoiding Common Pitfalls in LLM Evaluation (HoneyHive): https://www.honeyhive.ai/post/avoiding-common-pitfalls-in-llm-evaluation
-
In Defense of AI Evals, For Everyone (Shreya Shankar): https://www.sh-reya.com/blog/in-defense-ai-evals
Case Studies
-
Medical: https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-024-02709-7
-
Evaluating AI-Generated EPICs: https://dl.acm.org/doi/10.1145/3729176.3729200
Prompting
-
Anthropic Prompt Engineering Interactive Tutorial: https://github.com/anthropics/prompt-eng-interactive-tutorial
-
OpenAI Cookbook: https://cookbook.openai.com/
[
Previous
](/parlance-labs/evals/2025-3/syllabus/modules/a83fde?item=rw9fwu0v20l)
CompleteComplete this lesson
0%
-
[
📄
Lesson 1
Frequently Asked Questions
](/parlance-labs/evals/2025-3/syllabus/modules/a83fde?item=rw9fwu0v20l)
- [📄
Lesson 2
Optional Recommended Reading
](/parlance-labs/evals/2025-3/syllabus/modules/a83fde?item=h4aytipthdg)
[
Home
](/parlance-labs/evals/2025-3/home)[
Community
](/parlance-labs/evals/2025-3)