@massimo_san@Adriksh It’s not just files though, it’s anything that has a file descriptor associated with it which can include sockets too. Generally databases especially high frequency analytics databases can easily run in to this.
@TrisH0x2A Also if you’re doing direct io you should open files with the O_DIRECT and O_SYNC flag. Since you’re not fsyncing something like this is not guaranteed to write to disk.
@TrisH0x2A Generally syscalls are expensive due to the user to kernel space context switch. This is why something like io_uring tends to perform well, you batch syscalls before switching from user to kernel space. Not only that it has zero copy buffers.
@sudo_goreng If you want to deep dive in to LSM compaction (definitely relevant to RocksDB). This is an excellent survey paper on the topic: vldb.org/pvldb/vol14/p2…
@johncrickett Database Internals and Designing Data Intensive Applications are two of my favorites I’ve read in the past. Right now I’m reading through Understanding Deep Learning.
@GeoffreyHuntley I’ve been thinking about checking out ocaml for some time, I noticed that Jane Street has a “learn ocaml” repository, but it’s several years old: github.com/janestreet/lea… I was thinking about going through it but I wonder if there are better options.
@claudeai Why wouldn’t I just have claude code run ‘gh pr diff <pull request #>’ locally? This seems like a dud idea when I already have the tooling to do it.
@lcamtuf I tend to use github.com/DrCatHicks/lea… when I want follow up questions from Claude. Most recently used it while learning about gradient descent. I also will often go out of my way to ensure Claude does not explicitly solve problems for me but instead act like a fancy rubber ducky.
@KatanaLarp Many people are highlighting that as a follow up you can use the models to improve performance. This is true. But also, I think that once a code base gets to a specific complexity it is very tedious to drive performance gains via targeted prompts and profiling. Great read!
37K Followers 1K FollowingA Python developer at day A Java developer at night PyCon China organizer @pythonhunter__ co-founder @containerd CTL maintainer. Super fan of @yurucamp_anime
19K Followers 1K FollowingCEO of the System Initiative, Co-Founder of Chef. Sustainable free and open source software communities. Music. He/Him. bluesky: @adamhjk.me
16K Followers 285 Following🐴Pwnie Award Winning & Nation State funded psyop featuring 6 AI Anime Waifus and a Pup™ singing about APTs, Grifters, & Snake Oil in InfoSec
🖤🩷💚💙💜🤍
2K Followers 845 FollowingSoftware Engineer (Storage) @supabase. Creator of https://t.co/p769oCRmDS. Co-organizer of https://t.co/JIJdxbc2gc. Peeling back the layers of abstraction.