v0.3.6

Changelog

• 0a30618 chore: update ci
• afd7cc0 docs: remove outdated todo
• d1262cf chore: update homepage
• 36ed714 chore: upgrade deps with go1.20
• 0f7e760 docs: add release badge
• 2c7066a fix: Incorrect conversion between integer types, CodeQL, rule: go/incorrect-integer-conversion
• 067bedd chore: upgrade goquery with go1.20
• a451966 chore: upgrade cache2go with go1.20
• 6f7213f chore: upgrade cascadia with go1.20
• 9ff6690 chore: upgrade html-to-markdown with go1.20
• 51dfa87 chore: update deps, go 1.20
• fb8b28d fix: fix codecov golang version
• 376000f test: improve logger coverage
• c7ca5b6 chore: remove unused dependencies
• 7665a6d chore: upgrade go1.20
• 30eacbd chore: upgrade deps for go1.19
• 14668b5 feat: yahoo rules
• 82389f9 feat: support cookies
• 705a637 chore: Persist container data
• 94686b9 docs: add dockerhub badge
• d07f072 chore: improve inspector
• bdd57c7 docs: update credits for html-element-picker
• 966d901 refactor: for Feed Creation Tool (#2)
• ece3112 refactor: improve ui
• 0c16984 refactor: improve ui
• f4bab96 refactor: load rules
• 8bb2cf5 refactor: io
• 52600ba chore: add fn GetFileContent
• 134eee2 chore: add fn GetFileSHA1
• 6c00e9a chore: update todo in code
• 856d743 chore: Avoid opening new pages in the app
• 9661559 refactor: jssdk, improve coverage
• 76a0146 feat: support set csr timeout by config, update default timeouts
• 894e6c9 refactor: jssdk use
• 3138d7d refactor: jssdk.GenerateCSRInjectParser
• c87b29f refactor: jssdk.GenerateGetConfigWithRule
• f9f271b rule: add hub.baai.ac.cn/hot
• b462f05 docs: fix blog link
• 265c58e docs: update docs for 0.3.5
• 34ddb5b feat: support set feed name by config
• 6b183a6 docs: add CODE_OF_CONDUCT.md
• e6d4f23 chore: update issue template for feature
• dac1850 chore: update issue template
• a1b6a41 chore: init issue templates
• 273ea29 docs: update docs for 0.3.4
• 16514ad docs: update credits for moment
• 2930bc4 refactor: jssdk use
• 3b8adf3 refactor: rule use fn.IsFile, fn.IsDir
• fe194a3 refactor: fn.ScanDirFiles
• b999a04 refactor: fn.ExpireBySecond
• 6f6d479 test: improve json stringify coverage
• ed17a2d refactor: simply task url check
• 27f079d refactor: fn.LinkResolveRelative
• d204bdf feat: support new config option proxy
• c77b892 chore: verify headless server addr is correct
• e25cef8 chore: update date time parser
• dbf6d26 chore: update date time parser (wip)
• 4f24a74 feat: date time parser (wip)
• d336659 refactor: combine jssdk and js sandbox
• 8b18064 docs: update docs for 0.3.3
• 40a2096 refactor: improve docker certs
• 54dcc8c Merge pull request #7 from kevin1sMe/fix-ca-certificates
• dce245e test: Avoid redis key not recycled
• eeff8ba test: Verify proxy host is correct
• 3530759 test: Verify headless host is correct
• 3ca504b fix: install ca-certificates
• 8107cd3 test: Verify redis host is correct
• e8a6b06 test: Verify host is correct
• 8444e67 chore: add fn IsVaildAddr
• ed5b4f1 chore: update go.mod
• 46006cf Merge pull request #6 from kevin1sMe/fix-dockerfile
• 2139236 refactor: parser expire from config as int
• 20ac161 fix: install ca-certificates in docker
• 526669b chore: update github action with redis
• d69b0c3 chore: update gin 1.8.2, crypto 0.4.0
• 8954eaf test: memory, redis
• 1663cd9 refactor: cacher/memory, add option -host
• 291dc21 docs: add codecov badge
• 34ded6b chore: update coverage cmd
• 77c654d chore: add codecov
• 31d4c4c chore: add todos
• 870e672 feat: new option host
• f5899b5 test: DetectContentEncoding
• c29700d refactor: json stringify
• a2a681c test: StringToPositiveInteger
• ef7e1ba test: full coverage for internal/fn/checker
• 688a13c test: full coverage for internal/cmd
• b991f74 test: UpdatePortOption
• 1c605e9 test: UpdateFeedPathOption
• 8925c89 test: UpdateLogOption
• 8d89375 test: UpdateStringOption
• bd00d0c test: UpdateNumberOption
• 9f126c5 test: TestUpdateBoolOption
• 6ef8b87 test: SantizeFeedPath
• f2c8cfc refactor: cmd
• 94e2012 refactor: Simplify feedpath option handling
• 8d6659a refactor: Simplify log option handling
• 0716005 refactor: Simplify string option handling
• d9f10b8 refactor: Simplify number option handling
• e1e1173 refactor: Simplify bool option handling
• 9312180 chore: update checker, number
• 5d01710 refactor: cmd ApplyFlags
• 143f047 test: full coverage for internal/define
• 649b4ec chore: use full html tag list
• cd72959 refactor: ParseConfigFromJSON
• 2328ef4 test: checker
• 7a60ea5 refactor: ssr parser
• b4ff060 refactor: checker
• c0e1eae test: improve js sandbox coverage
• 57eebea test: improve fn coverage
• b32adb5 test: i2t
• f29a347 test: markdown
• 980b468 refactor: Simplify markdown convert
• fc8971f test: base64 encode, decode
• f5171fa chore: update rule
• a86426a chore: update id prop, ssr parser
• 785810d feat: support extract id from dom prop, root dom container
• 8703ae9 fix: fix mix parser
• 5ccb07f chore: add dev compose
• 7e112d5 docs: update docs for 0.3.1
• e142fd9 feat: compose file
• 64b3c6a chore: release docker images with project rules
• 4e11715 fix: parse args & envs
• 52375bc chore: Adjust for browser environment
• 73d4425 chore: add AlienKevin/html-element-picker
• 577416b feat: feed creation tool (wip)
• ddfb32f feat: Faster client parsing
• 9a6aae9 fix: add noopener noreferrer to links, clean code scanning alert
• 7ecc9e1 docs: update docs todo list
• f817029 docs: update parameter, feed-path. allow custom feed web path
• 3ef49a6 docs: update how-to use
• d5460df docs: update project webui screenshots
• 5bffc86 feat: support feed list page
• 2720115 docs: update credits
• 2e35f26 chore: remove unused rss discovery
• b618f2e chore: update homepage with vars
• 3e0a6bf feat: support new homepage
• 9c46808 feat: support change default feed path
• 28f867f docs: update docs
• 37593e4 docs: add chinese docs
• a65875e docs: update usage, todos
• 566fde3 chore: fix docker tzdata
• 6a3cbdd chore: update build flags
• eec61a4 chore: update args support
• 7a0248b feat: support envs
• 5e8b515 chore: update cli desc
• 22a7094 feat: support cli parameters
• c58e0c1 chore: support cli parameter (wip)
• c6f8742 feat: support cli parameter (wip)
• 0008750 test: fix sandbox test
• 8c6d4d7 chore: use logger instead of fmt
• 494227c chore: update define and timeout
• 1cc4651 chore: update define, add int to time utils
• 4aa3c56 chore: disable debugMode in ci build
• cf3fd48 docs: update usage, todos
• 6f94156 chore: update dockerfiles
• a30a8d9 chore: update ci build config
• 9fdf73b chore: add dockerfiles
• bad8040 test: fix sandbox
• 084531e feat: enable ci build
• c95e931 feat: id extract by regexp
• e6bb8cb feat: add new hooks
• d7d2900 chore: id extract by regexp (wip)
• a64a47c docs: update plan todos
• 844ae77 chore: add todos
• 5b199a6 chore: combine pages content
• b62a6a7 feat: extract newpage content, add disable cache config"
• 7a52223 chore: update rule field content
• 6624397 chore: update expire
• 8c98530 feat: set expire time by config
• f87ae7f chore: update define
• 26d4574 chore: gofmt -s -w .
• 672d1bc feat: enable request cacher for CSR, reduce unnecessary frequent requests
• cf75a07 docs: update plan todos
• c0dfdd7 feat: enable request cacher, reduce unnecessary frequent requests
• f7e54fd chore: update define
• 5037e01 chore: update cacher
• 6d22e85 docs: update credits for go-redis
• f5b8528 chore: add redis cacher
• 290a2a0 docs: update credits for cache2go
• 0610a8d chore: add in-memory cacher
• 9dfe9a2 chore: remove unused file
• ae31db0 chore: add pkg muesli/cache2go
• a2ba583 chore: update feed api
• c183a19 chore: rename
• 3d7993b chore: update api routes
• f7b7305 chore: add version vars
• a74eb0d feat: add health check
• aca6f5b chore: Enhanced web server
• 196dba3 feat: update gin logger
• fba16e8 chore: support all GB* charsets
• 490bc0e chore: refactor server api
• e780773 docs: update plan todos
• 761d09d feat: Dynamic loading rules
• 0b22bec chore: update rule parser with new logger
• 1eb15b7 chore: Adjust the default application logLevel to reduce unnecessary log printing
• 136f50e feat: Independent logger, supports dynamic update log level
• 1c9435d chore: More efficient sdk loading
• aff4e31 chore: update todo in code
• 5fbe828 chore: split server const
• 99b76af chore: refactor parse mode define
• 847d001 chore: rm todo in code
• 73f518d chore: refactor charset import
• 1be19cf chore: refactor charset define
• 270abd4 docs: update plan todos
• 25fbf63 feat: auto detect remote document charset
• 17ad6c8 chore: gofmt -s -w .
• a8d4c96 chore: handle err GetRemoteDocumentAsMarkdown
• 33c234f chore: refactor rule
• 9833ecc chore: refactor csr, mix parser
• cc5914c chore: split mix parser
• a26e52b docs: update plan todos
• 6dd21c0 feat: support mix parser
• f5675fa chore: refactor parser
• 8a91273 chore: refactor parser
• d7e7baa chore: add body as GetRemoteDocumentAsMarkdown default selector
• dd48eb8 chore: handle err document -> markdown
• b5e4959 chore: refactor parser
• 9729f6c docs: update credits for html-to-markdown
• b2f540a chore: upgrade html-to-markdown deps to golang1.19
• 39c4d11 chore: add pkg html-to-markdown
• 593bfdc feat: extract subpage data to RSS results, handle relative link address
• d782538 chore: allow config contains empty field, but title must exists
• 5fa56b3 chore: update ssr parser
• 27d4747 chore: update ignore list
• 7369963 docs: update credits for jq
• e5bd38c docs: update credits for rod
• f9e206f docs: update plan todos
• fba4352 docs: update plan todos
• 109451c feat: add bilibili rules
• a0eba57 chore: update server api for csr
• 89ce1c4 chore: update jssdk for csr
• ce43d6c chore: update generate rss result
• 293ca31 chore: support csr parser
• 7adcc3c feat: support csr method
• 3a88c9a chore: update jssdk for csr
• 0924b92 docs: update plan todos
• e31e87a chore: enable dependabot
• 061678a feat: simple registration of RSS API based on rule directory name
• 11fe83c chore: auto fix incorrect rule option
• ad66884 chore: apply Mode option from rules, gofmt
• 7a8caf2 chore: fine-tuning the parser
• 58836ae chore: update ssr todos
• 9028ef1 chore: handle rules load failed
• aba870d chore: load rules from rulesDir, and convert to rss config
• 5bd1783 chore: use jssdk to generate rss feeds
• bc4cc8b chore: update jssdk for ssr
• c957851 feat: simple js sdk
• 9b17583 chore: split csr, ssr
• a1479fd chore: split api server
• 23465b7 chore: split feeds generator
• 2cfc1b3 chore: split ssr parser
• 2a785cd docs: update plan todos
• c7fb9e5 docs: update credits for gin
• 9f08704 chore: update code for blog-3
• 6609800 chore: generate RSS with remote website
• 3b76ce6 chore: update project image
• ed29786 chore: update rss generate example
• 9e59871 docs: update docs
• a7ee05b test: update ci ignore list
• 5ef1f75 docs: add badge for codeql, go report card A+
• 603e90e fix: Inclusion of functionality from an untrusted source
• 4b687de fix: Incorrect conversion between integer types
• b8bc768 chore: add dependabot.yml
• 43f8204 chore: create codeql.yml
• 0f7bc6c chore: create SECURITY.md
• df37338 docs: fix typo
• 9e47cfb docs: update plan todos
• ab42178 docs: update credits for gorilla/feeds
• dd009f2 chore: upgrade rss can deps
• 33e20ca chore: upgrade deps
• 37dcafe chore: generate feed test
• cf356ff chore: remove unused file
• ad3d9d5 chore: add pkg gorilla/feeds
• fb28a42 chore: update imports
• 2eee253 docs: update plans
• 3847d00 docs: update docs
• 235cd54 docs: update credits about v8go
• 7c0c3b1 docs: update credits about cascadia
• fbc405f docs: update credits about goquery
• 3e96cc1 chore: update js config parser
• e6bef10 chore: add json stringify fn
• 4f5f37f chore: update parser and request
• cee959c feat: parse page with network component
• a53d3e7 chore: handle exceptions for all request processes
• 2a36eb0 chore: update define
• 79282b3 test: add RunCode test for js sandbox
• 93a89b2 chore: centralize constant management
• 2d6ec0c chore: split js sandbox to internal
• 4af4319 fix: time.After memory leak
• bd04ba9 chore: add simple charset fn to decode remote body
• c6f6e82 chore: update docs and project image
• edd47f6 docs: add pkg project
• d5fdf7f feat: simple dynamic configuration
• 46c85d6 feat: add simple js config
• f04134a chore: update version display & run 'gofmt -s -w .'
• 53f78a3 chore: use local pkg instead of internet
• 96f24e0 docs: add pkg project
• 4368b3f chore: remove unused file
• c2b9acc chore: save to the pkg directory
• 42baef9 chore: use local pkg instead of internet
• 6730e1c chore: remove unused file
• 9a098ab docs: add version
• 8b077c7 chore: save to the pkg directory
• 54bb759 chore: csr info list demo with goquery
• 0091bbb docs: simple plan
• a9fe176 chore: init go project
• 5f4ebc4 Initial commit