Skip to content
agno
Sign Up
Changelog
SDKv2.4.6

Breaking change: website crawling uses per-page content hashes

Agno Team

January 28, 20261 min read

We changed the WebsiteReader deduplication model to compute content hashes per page. This aligns skip_if_exists with page-level updates and ensures accurate re-crawls.

Details:

  • Behavior change: Deduplication occurs at page granularity, not aggregate level
  • Action required: Clear existing website crawl entries before re-indexing to prevent duplicates
  • Benefits: Higher correctness, predictable re-crawls, and lower operational overhead

Who this is for: Engineering teams managing recurring website crawls and large content refreshes.

Shipped around the same time

January 28, 2026

Changelog

v2.4.6

Consistent async file reads: empty files now return no documents

Async text_reader.aread() now returns an empty list ([]) for empty files, aligning behavior with the sync API. This removes special-case handling and simplifies downstream pipelines.

Agno Team

1 min read

January 28, 2026

Changelog

v2.4.6

Learning agents work out of the box with default memory and clearer guidance

Learning is now simpler and more effective. When learning=True, user memory is enabled by default, and the LearnedKnowledgeStore captures organizational context (goals, constraints, policies) to guide…

Agno Team

1 min read

January 28, 2026

Changelog

v2.4.6

Reliable website deduplication with per-page content hashing

WebsiteReader now computes a unique content hash per crawled URL, fixing skip_if_exists for multi-page crawls.

Agno Team

1 min read