danmax/r34-scraper
1
1
Fork 3
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
53 Commits 2 Branches 0 Tags
52fe7d5187d1d0ec11586a8e1a0ba0ded5d04253
Commit Graph

53 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
pickzelle 52fe7d5187 update dependencies 2024-10-24 20:58:18 -04:00
danmax 2648b9c20e Merge pull request 'feat: capture SIGINT to avoid corrupting downloads' (#12) from ErrorNoInternet/r34-scraper:ctrlc into main 
bro got no bitches
 2024-10-21 00:44:42 +02:00
ErrorNoInternet 094b0b7412 feat: capture SIGINT to avoid corrupting downloads 2024-10-20 18:43:05 -04:00
danmax 351439034e Merge pull request 'refactor: minor nitpicks' (#11) from ErrorNoInternet/r34-scraper:main into main 
Reviewed-on: https://git.javalsai.dynv6.net/danmax/r34-scraper/pulls/11
 2024-10-21 00:00:43 +02:00
ErrorNoInternet fe3c399c1d refactor: minor nitpicks 2024-10-20 17:59:10 -04:00
danmax 89830d6e1e update lock file 2024-10-20 17:15:59 -04:00
danmax 1b5608b014 Merge pull request 'bring back toolchain' (#10) from javalsai-changes into main 
Reviewed-on: https://git.javalsai.dynv6.net/danmax/r34-scraper/pulls/10
 2024-10-20 21:32:37 +02:00
javalsai a852c8bcc5 chore: bring back rust-toolchain.toml 2024-10-20 21:31:27 +02:00
javalsai 235e13230b Merge branch 'main' into javalsai-changes 2024-10-20 21:31:03 +02:00
danmax bd517ed0b5 chore: bump version to 1.0.0 2024-10-20 01:48:21 -04:00
danmax 5f848be434 Merge pull request 'refactor: accept cli args only' (#9) from ErrorNoInternet/r34-scraper:cli-args-only into main 
Reviewed-on: https://git.javalsai.dynv6.net/danmax/r34-scraper/pulls/9
 2024-10-20 06:25:37 +02:00
ErrorNoInternet 8723769429 refactor: accept cli args only 2024-10-20 00:24:35 -04:00
danmax 08ed5e51f2 Merge pull request 'feat(cli): add page argument to start scraping from a specific page' (#8) from ErrorNoInternet/r34-scraper:add-page-arg into main 
Reviewed-on: https://git.javalsai.dynv6.net/danmax/r34-scraper/pulls/8
 2024-10-20 06:17:35 +02:00
ErrorNoInternet 3573f6ff5a feat(cli): add page argument to start scraping from a specific page 2024-10-20 00:16:22 -04:00
danmax ee0e938782 Update README.md 2024-10-20 05:59:14 +02:00
danmax ca6df90460 Merge pull request 'better imgae' (#7) from ErrorNoInternet/r34-scraper:main into main 
👍
 2024-10-20 05:52:20 +02:00
ErrorNoInternet 325730bd37 better imgae 2024-10-19 23:50:08 -04:00
danmax 188b714741 added chunked downloads, added progress bars, cleaned up javalsai's bad code 
Co-authored-by: ErrorNoInternet <errornointernet@envs.net>
 2024-10-19 23:39:13 -04:00
danmax b5a70e3426 added a function to download images to current directory 2024-10-19 22:24:30 -04:00
javalsai bcd349e36f cargo clippy 👍 2024-10-19 21:50:54 +02:00
danmax 137378beb3 Merge pull request 'javalsai-changes' (#6) from javalsai-changes into main 
Reviewed-on: https://git.javalsai.dynv6.net/danmax/r34-scraper/pulls/6
 2024-10-19 21:39:40 +02:00
javalsai 9c55ef19b8 add: license 2024-10-19 21:39:02 +02:00
javalsai 022352b554 feat: misc improvements 2024-10-19 21:37:31 +02:00
javalsai ace4ac2811 fix: conflicts & feat: multiline logger 2024-10-19 21:13:02 +02:00
javalsai af16bdbdfe fix merge conflicts (again) 2024-10-19 20:31:39 +02:00
javalsai 063acc97db merge master & misc feats 2024-10-19 20:26:25 +02:00
danmax 6831aaf6ff Revert "Merge pull request 'Update gitignore, add taap, luv gaylord' (#5) from UwU/not-r34:main into main" 
This reverts commit 9744c81ef5, reversing
changes made to eeee4f50b3.
 2024-10-19 13:24:44 -04:00
danmax 9744c81ef5 Merge pull request 'Update gitignore, add taap, luv gaylord' (#5) from UwU/not-r34:main into main 
Reviewed-on: https://git.javalsai.dynv6.net/danmax/r34-scraper/pulls/5
 2024-10-19 17:51:56 +02:00
GayLord c1d67c9d84 Update epilog cause it didnt offend anyone 2024-10-19 17:50:05 +02:00
GayLord 89fca9d0a3 Update gitignore, add taap, luv gaylord 2024-10-19 14:05:30 +02:00
danmax eeee4f50b3 added multithreading 
Co-authored-by: ErrorNoInternet <errornointernet@envs.net>
 2024-10-18 19:36:25 -04:00
danmax abd91a6e95 Merge pull request 'chore(README): add example usage image' (#4) from grialion/r34-scraper:main into main 
Reviewed-on: https://git.javalsai.dynv6.net/danmax/r34-scraper/pulls/4
 2024-10-18 23:03:57 +02:00
grialion 1a5fc75162 chore(README): add example usage image 2024-10-18 23:00:26 +02:00
javalsai e5e586ca2a Merge branch 'main' into javalsai-changes 2024-10-18 23:00:05 +02:00
danmax 722df4305d Merge pull request 'fix: img regex' (#3) from grialion/r34-scraper:main into main 
Reviewed-on: https://git.javalsai.dynv6.net/danmax/r34-scraper/pulls/3
 2024-10-18 22:56:07 +02:00
grialion 91eff584cb fix: img regex 2024-10-18 22:53:39 +02:00
javalsai 5ce292d1c2 chore: modularity & good code 2024-10-18 19:26:11 +02:00
javalsai e62d2cc186 feat: add arg parsing 2024-10-18 18:50:40 +02:00
javalsai 4acaf0308c chore: define rust channel (+ fmt) 2024-10-18 18:43:18 +02:00
danmax 815c08cc36 fixed page pids 2024-10-16 23:48:04 -04:00
danmax 83f2bece96 updated regex 2024-10-16 23:39:59 -04:00
danmax 7e732c4a75 added exponential backoff 2024-10-16 23:20:24 -04:00
danmax c954cdeaea Merge pull request 'refactor: tidy main.rs' (#1) from ErrorNoInternet/r34-scraper:main into main 
Reviewed-on: https://git.javalsai.dynv6.net/danmax/r34-scraper/pulls/1
 2024-10-16 04:08:15 +02:00
ErrorNoInternet 67e388bf81 chore(gitignore): ignore /target folder 2024-10-15 18:49:58 -04:00
ErrorNoInternet 9931bd8eaa refactor: tidy main.rs 2024-10-15 18:49:36 -04:00
ErrorNoInternet 75ad148f55 chore: add lock file 2024-10-15 18:47:01 -04:00
danmax 13a626a943 Update README.md 2024-10-16 00:03:43 +02:00
danmax da3575e905 fixed regex, now accepts formats with number on them 2024-10-15 01:02:33 -04:00
danmax 4116d8a8d4 added tag selector 2024-10-15 00:35:29 -04:00
danmax 36c0bfb0fe made scraper stop once there are no post urls 2024-10-15 00:20:24 -04:00