๐ Optional Homework
Resources
Notes
Channels
-
[
announcements
](/parlance-labs/evals/2025-3/channel?channelId=283916d6-d0ce-4b62-9af9-b308a8eceecf)
- [general
](/parlance-labs/evals/2025-3/channel?channelId=6aa0dbf0-46ed-47e7-9ae8-cbbb4db531c9)
- [intros
](/parlance-labs/evals/2025-3/channel?channelId=c4b50f08-c5b5-4f3f-a9bd-c9684d5c7b3d)
- [๐ญ
questions
](/parlance-labs/evals/2025-3/channel?channelId=0458bb33-ed98-42cf-b593-4161ac4cd2cd)
Messages
Channels
-
[
announcements
](/parlance-labs/evals/2025-3/channel?channelId=283916d6-d0ce-4b62-9af9-b308a8eceecf)
- [general
](/parlance-labs/evals/2025-3/channel?channelId=6aa0dbf0-46ed-47e7-9ae8-cbbb4db531c9)
- [intros
](/parlance-labs/evals/2025-3/channel?channelId=c4b50f08-c5b5-4f3f-a9bd-c9684d5c7b3d)
- [๐ญ
questions
](/parlance-labs/evals/2025-3/channel?channelId=0458bb33-ed98-42cf-b593-4161ac4cd2cd)
Messages
Lesson 1: Fundamentals & Lifecycle of Application-Centric Evals
๐
Optional Homework
Lesson 8
Lesson 1โs homework is about building and prompting a Recipe Suggestion Bot. The botโs job is simple: given some ingredients or constraints from a user, it should suggest recipes that are safe, practical, and easy to follow. Think of it like a cooking assistant powered by an LLMโit takes user input (e.g., โI have chicken, rice, and broccoliโ) and returns a recipe idea with clear steps. Your task is to design the system prompt that makes the LLM behave like this assistant: define its role, decide what it must always do (give valid recipes, include ingredients, stay safe) and what it must never do (unsafe food advice, irrelevant chatter), how much creative freedom it has (stick to exact inputs or allow substitutions), and how the output should be formatted.
To get started, youโll need:
-
An **OpenAI API key** to run the model.
-
A **laptop** for coding and testing.
-
Basic **Python programming knowledge**.
-
**Git** installed to clone the homework repo.
If youโre new to programming, check out the #beginner-programming channel in Discord for help, including AI-assisted programming tips. Additionally, for those new to coding, Isaac Flath will be doing a three part mini-course during weeks 3-4 titled "Live coding workshop ... w/ Isaac Flath" for each of the homework assignments, where he will step through how to complete the homework assignments with AI assistance.
Repo link for instructions and scaffold code: hw1.
Remember, the homework is totally optional! It is meant for folks who want to get lots of hands-on practice. We estimate that this homework can take between 1 and 3 hours for folks who already know programming. You do not have to do the homework to get a lot of value out of the course.
[
Previous
](/parlance-labs/evals/2025-3/syllabus/modules/98b8aa?item=7aduv0awiub)
CompleteComplete this lesson
75%
-
[
๐
Lesson 1
Recorded Lecture: Fundamentals & Lifecycle of Application-Centric Evals
](/parlance-labs/evals/2025-3/syllabus/modules/98b8aa?item=thn3sz5snjo)
- [๐
Lesson 2 ยท COMPLETED
Chapter 1: Introduction
](/parlance-labs/evals/2025-3/syllabus/modules/98b8aa?item=371tmzxrnlq)
- [๐
Lesson 3 ยท COMPLETED
Chapter 2: What is LLM Evaluation?
](/parlance-labs/evals/2025-3/syllabus/modules/98b8aa?item=envz1om0ydn)
- [๐
Lesson 4 ยท COMPLETED
Chapter 3: Why is LLM Development So Hard?
](/parlance-labs/evals/2025-3/syllabus/modules/98b8aa?item=ps6co1qf9ah)
- [๐
Lesson 5 ยท COMPLETED
Chapter 4: The Evaluation Lifecycle
](/parlance-labs/evals/2025-3/syllabus/modules/98b8aa?item=69huwfj0ch8)
- [๐
Lesson 6 ยท COMPLETED
Chapter 5: Prompting Fundamentals
](/parlance-labs/evals/2025-3/syllabus/modules/98b8aa?item=4cnd4d93gmd)
- [๐
Lesson 7 ยท COMPLETED
Chapter 6: Preview of Error Analysis
](/parlance-labs/evals/2025-3/syllabus/modules/98b8aa?item=7aduv0awiub)
- [๐
Lesson 8
Optional Homework
](/parlance-labs/evals/2025-3/syllabus/modules/98b8aa?item=dwi4feytt3)
[
Home
](/parlance-labs/evals/2025-3/home)[
Community
](/parlance-labs/evals/2025-3)