Slack 自己幹的 Cron System
source link: https://blog.gslin.org/archives/2024/02/01/11629/slack-%e8%87%aa%e5%b7%b1%e5%b9%b9%e7%9a%84-cron-system/
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Slack 自己幹的 Cron System
在 HN 上看到「Executing Cron Scripts Reliably at Scale (slack.engineering)」，發現是去年九月的文章：「Executing Cron Scripts Reliably At Scale」(話說 Slack 的 engineering blog 可讀性變差好多，不過這又是另外一回事了...)。
夠大的組織的 cron job system 都會自己幹一套出來用，因為檯面上的都不好用 XD
Slack 的搞法是組合三個內部系統：
- 一個 container-based 管理實際執行資源的系統，基於 Bedrock，而 Bedrock 則是基於 k8s 上的系統。
- 一個 job queue 子系統，後面是 Kafka + Redis 組成的。
- 一組在 Vitess 上的表格，所以後面是 MySQL。
這樣的系統也注定這是 Slack-only 的系統了，看一下知道用什麼就好了...
Related
Amazon Aurora PostgreSQL 多支援了一些 extension
Amazon Aurora PostgreSQL 多支援了一些 extension，剛好看到一些對我還蠻有用的東西。 第一個是 pg_cron，就如同名字所說的，可以拿來安排 cron job：「Amazon Aurora PostgreSQL supports pg_cron extension for scheduling database jobs」。 第二個是 pg_proctab，可以拿來看系統狀態，這在 Aurora 裡面算是沒有 shell 的替代方案：「Amazon Aurora PostgreSQL Supports the pg_proctab Extension to access PostgreSQL system stats」。 第三個是 pg_partman，可以對 serial id 切到不同的 partition：「Amazon Aurora PostgreSQL supports the pg_partman extension for managing time…
June 21, 2021In "AWS"
Leave a Reply
Your email address will not be published. Required fields are marked *
Comment *
Name *
Email *
Website
Notify me of follow-up comments by email.
Notify me of new posts by email.
To respond on your own website, enter the URL of your response which should contain a link to this post's permalink URL. Your response will then appear (possibly after moderation) on this page. Want to update or remove your response? Update or delete your post and re-enter your post's URL again. (Learn More)
Post navigation
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK