Scribd
Upload
11 views

Functions, Calls, and Agents Short Course

Uploaded by

Shekhar Jyoti Nath
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
11 views

Functions, Calls, and Agents Short Course

Uploaded by

Shekhar Jyoti Nath
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 16

Functions, Tools and

Agents with
LangChain

Function Calling
Function Calling

● OpenAI has fine-tuned the


gpt-3.5-turbo-0613 and gpt-4-0613
models to:
1. Accept additional arguments through which
users can pass in descriptions of functions.
2. If it is relevant, return the name of the function
to use, along with a JSON object with the
appropriate input parameters.
Functions, Tools and
Agents with
LangChain

LangChain Expression
Language (LCEL)
LangChain Expression Language
(LCEL)
LangChain composes chains of components
LCEL and the runnable protocol define:
Means of modifying
parameters at
runtime
bind,…

prompt llm Parser

An allowed set of Required And output


input types methods: types
invoke
stream
batch
…
Composition can now use the Linux pipe syntax:

Chain = prompt | llm | OutputParser


Interface
● Components implement “Runnable” protocol
● Common methods include:
○ invoke [ainvoke]
○ stream [astream]
○ batch [abatch]
● Common properties
○ input_schema, output_schema
● Common I/O

Component Input Type Output Type


Prompt Dictionary Prompt Value

Retriever Single String List of Documents

LLM String, list of messages or String


Prompt Value
ChatModel String, list of messages or ChatMessage
Prompt Value
Tool String/Dictionary Tool dependent

Output Parser Output of LLM or ChatModel Parser dependent


LangChain Expression
Language (LCEL)

● Runnables support:
○ Async, Batch and Streaming Support

○ Fallbacks

○ Parallelism

■ LLM calls can be time consuming!

■ Any components that can be run in


parallel are!

○ Logging is built in
Functions, Tools and
Agents with
LangChain

OpenAI functions in
LangChain
Pydantic

Pydantic is a ‘data validation library’ for python.


● Works with python type annotations. But
rather than static type checking, they are
actively used at runtime for data validation
and conversion.
● Provides built-in methods to
serialize/deserialize models to/from JSON,
dictionaries, etc.
● LangChain leverages Pydantic to create
JSON Scheme describing function.
Pydantic

In normal python you would create a class like


this:

class User:
def __init__(self, name: str, age: int, email: str):
self.name = name
self.age = age
self.email = email

Using Pydantic, this is:

from pydantic import BaseModel,

class User(BaseModel):
name: str
age: int
email: EmailStr
Functions, Tools and
Agents with
LangChain

Tagging and Extraction


Tagging

● We have seen the LLM, given a function


description, select arguments from the input
text generate a structured output forming a
function call
● More generally, the LLM can evaluate the
input text and generate structured output.

LLM { …
sentiment: positive,
language: Spanish
structure … }
description
Extraction

● When given an input JSON schema, the LLM has


been fine tuned to find and fill in the parameters
of that schema.

● The capability is not limited to function schema.

● This can be used for general purpose extraction.

[{ …
first name: Lang,
LLM
last name: Chain,
language: Python
… },
structure …
description ]
Functions, Tools and
Agents with
LangChain

Tools and routing


Tools and routing

● Functions and services an LLM can utilize to


extend its capabilities are named “tools” in
LangChain
● LangChain has many tools available
○ Search tools
○ Math tools
○ SQL tools
○ …

In this lab you will:


○ Create your own tools
○ Build a tool based on an OpenAPI spec
■ Predating LLMs, the OpenAPI specification
is routinely used by service providers to
describe their APIs
○ Select from multiple possible tools – called
‘routing’
Functions, Tools and
Agents with
LangChain

Conversational Agent
Agent Basics

● Agents
○ are a combination of LLMs and code
○ LLMs reason about what steps to take and call
for actions.
● Agent loop
○ Choose a tool to use
○ Observe the output of the tool
○ Repeat until a stopping condition is met
● Stopping conditions can be:
○ LLM determined
○ Hardcoded rules

In this lab you will


○ Build some tools
○ Write your own agent loop using LCEL
○ Utilize agent_executor which:
■ Implements the agent loop
■ Adds error handling, early stopping,
tracing, etc

You might also like