Merge pull request #923 from ScrapeGraphAI/pre/beta

VinciGit00 · web-flow · commit 5b67e976cb7c · 2025-02-15T09:57:03.000+01:00
Pre/beta
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -1,3 +1,15 @@
+## [1.38.1-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.38.0...v1.38.1-beta.1) (2025-02-13)
+
+
+### Bug Fixes
+
+* filter links ([04b9197](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/04b91972e88b69b722454d54c8635dfb49b38b44))
+
+
+### Test
+
+* Add coverage improvement test for tests/test_scrape_do.py ([4ce6d1b](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4ce6d1b94306d0ae94a74748726468a5132b7969))
+
 ## [1.38.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.37.1...v1.38.0) (2025-02-09)
 
 
diff --git a/pyproject.toml b/pyproject.toml
@@ -1,7 +1,7 @@
 [project]
 name = "scrapegraphai"
 
-version = "1.38.0"
+version = "1.38.1b1"
 
 
 description = "A web scraping library based on LangChain which uses LLM and direct graph logic to create scraping pipelines."
diff --git a/scrapegraphai/graphs/search_link_graph.py b/scrapegraphai/graphs/search_link_graph.py
@@ -77,6 +77,8 @@ def _create_graph(self) -> BaseGraph:
                 output=["parsed_doc"],
                 node_config={
                     "chunk_size": self.model_token,
+                    "filter_links": True,
+                    "filter_config": self.config.get("filter_config", {}),
                 },
             )
 

Original file line number	Diff line number	Diff line change
`@@ -77,6 +77,8 @@ def _create_graph(self) -> BaseGraph:`
`77`	`77`	`output=["parsed_doc"],`
`78`	`78`	`node_config={`
`79`	`79`	`"chunk_size": self.model_token,`
	`80`	`+ "filter_links": True,`
	`81`	`+ "filter_config": self.config.get("filter_config", {}),`
`80`	`82`	`},`
`81`	`83`	`)`
`82`	`84`