danmax/r34-scraper
1
2
Fork 3
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • 54ccc84719 add database main meme_man 2025-02-01 21:37:41 -05:00
  • 5eaff063f3 Update README.md danmax 2024-11-25 03:31:16 +01:00
  • ef1e502af1 Merge pull request 'fix' (#14) from ErrorNoInternet/r34-scraper:fix into main danmax 2024-11-25 03:29:35 +01:00
  • 1878807461 fix ErrorNoInternet 2024-11-24 21:28:26 -05:00
  • 20a3a8c4c6 Merge pull request 'update dependencies (plox sent me patch)' (#13) from ErrorNoInternet/r34-scraper:main into main danmax 2024-10-25 03:01:46 +02:00
  • 52fe7d5187 update dependencies Pickzelle 2024-10-24 20:57:49 -04:00
  • 2648b9c20e Merge pull request 'feat: capture SIGINT to avoid corrupting downloads' (#12) from ErrorNoInternet/r34-scraper:ctrlc into main danmax 2024-10-21 00:44:42 +02:00
  • 094b0b7412 feat: capture SIGINT to avoid corrupting downloads ErrorNoInternet 2024-10-20 18:27:53 -04:00
  • 351439034e Merge pull request 'refactor: minor nitpicks' (#11) from ErrorNoInternet/r34-scraper:main into main danmax 2024-10-21 00:00:43 +02:00
  • fe3c399c1d refactor: minor nitpicks ErrorNoInternet 2024-10-20 17:59:10 -04:00
  • 89830d6e1e update lock file danmax 2024-10-20 17:15:59 -04:00
  • 1b5608b014 Merge pull request 'bring back toolchain' (#10) from javalsai-changes into main danmax 2024-10-20 21:32:37 +02:00
  • a852c8bcc5 chore: bring back rust-toolchain.toml javalsai-changes javalsai 2024-10-20 21:31:27 +02:00
  • 235e13230b Merge branch 'main' into javalsai-changes javalsai 2024-10-20 21:31:03 +02:00
  • bd517ed0b5 chore: bump version to 1.0.0 danmax 2024-10-20 01:48:21 -04:00
  • 5f848be434 Merge pull request 'refactor: accept cli args only' (#9) from ErrorNoInternet/r34-scraper:cli-args-only into main danmax 2024-10-20 06:25:37 +02:00
  • 8723769429 refactor: accept cli args only ErrorNoInternet 2024-10-20 00:24:35 -04:00
  • 08ed5e51f2 Merge pull request 'feat(cli): add page argument to start scraping from a specific page' (#8) from ErrorNoInternet/r34-scraper:add-page-arg into main danmax 2024-10-20 06:17:35 +02:00
  • 3573f6ff5a feat(cli): add page argument to start scraping from a specific page ErrorNoInternet 2024-10-20 00:16:21 -04:00
  • ee0e938782 Update README.md danmax 2024-10-20 05:59:14 +02:00
  • ca6df90460 Merge pull request 'better imgae' (#7) from ErrorNoInternet/r34-scraper:main into main danmax 2024-10-20 05:52:20 +02:00
  • 325730bd37 better imgae ErrorNoInternet 2024-10-19 23:50:08 -04:00
  • 188b714741 added chunked downloads, added progress bars, cleaned up javalsai's bad code danmax 2024-10-19 23:38:52 -04:00
  • b5a70e3426 added a function to download images to current directory danmax 2024-10-19 22:24:30 -04:00
  • bcd349e36f cargo clippy 👍 javalsai 2024-10-19 21:50:54 +02:00
  • 137378beb3 Merge pull request 'javalsai-changes' (#6) from javalsai-changes into main danmax 2024-10-19 21:39:40 +02:00
  • 9c55ef19b8 add: license javalsai 2024-10-19 21:39:02 +02:00
  • 022352b554 feat: misc improvements javalsai 2024-10-19 21:37:31 +02:00
  • ace4ac2811 fix: conflicts & feat: multiline logger javalsai 2024-10-19 21:13:02 +02:00
  • af16bdbdfe fix merge conflicts (again) javalsai 2024-10-19 20:31:39 +02:00
  • 063acc97db merge master & misc feats javalsai 2024-10-19 20:22:49 +02:00
  • 6831aaf6ff Revert "Merge pull request 'Update gitignore, add taap, luv gaylord' (#5) from UwU/not-r34:main into main" danmax 2024-10-19 13:24:44 -04:00
  • 9744c81ef5 Merge pull request 'Update gitignore, add taap, luv gaylord' (#5) from UwU/not-r34:main into main danmax 2024-10-19 17:51:56 +02:00
  • c1d67c9d84 Update epilog cause it didnt offend anyone GayLord 2024-10-19 17:50:05 +02:00
  • 89fca9d0a3 Update gitignore, add taap, luv gaylord GayLord 2024-10-19 14:05:30 +02:00
  • eeee4f50b3 added multithreading danmax 2024-10-18 19:36:25 -04:00
  • abd91a6e95 Merge pull request 'chore(README): add example usage image' (#4) from grialion/r34-scraper:main into main danmax 2024-10-18 23:03:57 +02:00
  • 1a5fc75162 chore(README): add example usage image grialion 2024-10-18 23:00:26 +02:00
  • e5e586ca2a Merge branch 'main' into javalsai-changes javalsai 2024-10-18 23:00:05 +02:00
  • 722df4305d Merge pull request 'fix: img regex' (#3) from grialion/r34-scraper:main into main danmax 2024-10-18 22:56:07 +02:00
  • 91eff584cb fix: img regex grialion 2024-10-18 22:53:39 +02:00
  • 5ce292d1c2 chore: modularity & good code javalsai 2024-10-18 19:26:11 +02:00
  • e62d2cc186 feat: add arg parsing javalsai 2024-10-18 18:50:40 +02:00
  • 4acaf0308c chore: define rust channel (+ fmt) javalsai 2024-10-18 18:43:18 +02:00
  • 815c08cc36 fixed page pids danmax 2024-10-16 23:48:04 -04:00
  • 83f2bece96 updated regex danmax 2024-10-16 23:39:59 -04:00
  • 7e732c4a75 added exponential backoff danmax 2024-10-16 23:20:24 -04:00
  • c954cdeaea Merge pull request 'refactor: tidy main.rs' (#1) from ErrorNoInternet/r34-scraper:main into main danmax 2024-10-16 04:08:15 +02:00
  • 67e388bf81 chore(gitignore): ignore /target folder ErrorNoInternet 2024-10-15 18:49:58 -04:00
  • 9931bd8eaa refactor: tidy main.rs ErrorNoInternet 2024-10-15 18:47:17 -04:00
  • 75ad148f55 chore: add lock file ErrorNoInternet 2024-10-15 18:47:01 -04:00
  • 13a626a943 Update README.md danmax 2024-10-16 00:03:43 +02:00
  • da3575e905 fixed regex, now accepts formats with number on them danmax 2024-10-15 01:02:33 -04:00
  • 4116d8a8d4 added tag selector danmax 2024-10-15 00:35:29 -04:00
  • 36c0bfb0fe made scraper stop once there are no post urls danmax 2024-10-15 00:20:24 -04:00
  • 7b73c942b8 made scraper scrape all the pages danmax 2024-10-14 23:59:06 -04:00
  • 91568abea5 added a readme danmax 2024-10-14 22:36:13 -04:00
  • 6dd45a17fa done with basics danmax 2024-10-14 22:09:05 -04:00