Commit Graph

26 Commits

Author SHA1 Message Date
ErrorNoInternet fe3c399c1d refactor: minor nitpicks 2024-10-20 17:59:10 -04:00
danmax 5f848be434 Merge pull request 'refactor: accept cli args only' (#9) from ErrorNoInternet/r34-scraper:cli-args-only into main
Reviewed-on: https://git.javalsai.dynv6.net/danmax/r34-scraper/pulls/9
2024-10-20 06:25:37 +02:00
ErrorNoInternet 8723769429 refactor: accept cli args only 2024-10-20 00:24:35 -04:00
ErrorNoInternet 3573f6ff5a feat(cli): add page argument to start scraping from a specific page 2024-10-20 00:16:22 -04:00
danmax 188b714741 added chunked downloads, added progress bars, cleaned up javalsai's bad code
Co-authored-by: ErrorNoInternet <errornointernet@envs.net>
2024-10-19 23:39:13 -04:00
danmax b5a70e3426 added a function to download images to current directory 2024-10-19 22:24:30 -04:00
javalsai 022352b554 feat: misc improvements 2024-10-19 21:37:31 +02:00
javalsai ace4ac2811 fix: conflicts & feat: multiline logger 2024-10-19 21:13:02 +02:00
javalsai 063acc97db merge master & misc feats 2024-10-19 20:26:25 +02:00
GayLord c1d67c9d84 Update epilog cause it didnt offend anyone 2024-10-19 17:50:05 +02:00
GayLord 89fca9d0a3 Update gitignore, add taap, luv gaylord 2024-10-19 14:05:30 +02:00
danmax eeee4f50b3 added multithreading
Co-authored-by: ErrorNoInternet <errornointernet@envs.net>
2024-10-18 19:36:25 -04:00
javalsai e5e586ca2a Merge branch 'main' into javalsai-changes 2024-10-18 23:00:05 +02:00
grialion 91eff584cb fix: img regex 2024-10-18 22:53:39 +02:00
javalsai 5ce292d1c2 chore: modularity & good code 2024-10-18 19:26:11 +02:00
javalsai e62d2cc186 feat: add arg parsing 2024-10-18 18:50:40 +02:00
javalsai 4acaf0308c chore: define rust channel (+ fmt) 2024-10-18 18:43:18 +02:00
danmax 815c08cc36 fixed page pids 2024-10-16 23:48:04 -04:00
danmax 83f2bece96 updated regex 2024-10-16 23:39:59 -04:00
danmax 7e732c4a75 added exponential backoff 2024-10-16 23:20:24 -04:00
ErrorNoInternet 9931bd8eaa refactor: tidy main.rs 2024-10-15 18:49:36 -04:00
danmax da3575e905 fixed regex, now accepts formats with number on them 2024-10-15 01:02:33 -04:00
danmax 4116d8a8d4 added tag selector 2024-10-15 00:35:29 -04:00
danmax 36c0bfb0fe made scraper stop once there are no post urls 2024-10-15 00:20:24 -04:00
danmax 7b73c942b8 made scraper scrape all the pages 2024-10-14 23:59:06 -04:00
danmax 6dd45a17fa done with basics 2024-10-14 22:09:05 -04:00