SwayDB

Persistent and in-memory key-value storage engine for the JVM

[Simer @SimerPlaha]

@jetbrains has helped me a lot with a free open-source license for over 3 years for my work on @SwayDB. Can't imagine writing software being this fun without @intellijidea & @clion_ide. Today I got another open-source license for #JProfiler from #EJTech. #grateful. Thanks heaps!!

[Simer @SimerPlaha]

Been testing and I can move over 70% (all dynamic memory allocations) of @SwayDB in-memory allocation off-heap using sun.misc.Unsafe. On heavy write and read workloads JVM pauses is a painful penalty. Project-panama's foreign-mem-api is an option but we will be stuck with Java14+

[Simer @SimerPlaha]

Switched @SwayDB to use Apache License 2.0 https://t.co/PmndfXSEDr

[Simer @SimerPlaha]

Crossed 3000 commits! Last few weeks were
- Defer byte transfer directly to OS where possible (skip JVM heap)
- Higher compaction concurrency on each Level, each file and on each group of data within each file
- Controlled concurrency of compaction IO via a Scheduler @SwayDB

[Simer @SimerPlaha]

A blog post about a decentralised system's use-case and how we can defer the responsibility of ordering un-ordered requests to @SwayDB. https://t.co/h3slhS2V2z. #database #distributedcomputing #scala #java #storage

[Simer @SimerPlaha]

Release @SwayDB v0.16.2 with minor fixes. https://t.co/AbwUqvqS3g #scala #java #jvm #storage #database #opensource

[Simer @SimerPlaha]

Released @SwayDB v0.16.1 with improved write performance for sequential writes and added atomicity to in-memory SkipList types without copying (used internally). https://t.co/nlHl1ztBIg #scala #java #jvm #database #opensource

[Simer @SimerPlaha]

In process of updating the documentation. Initial serialisers documentation for Scala and Java. Using BooPickle and Custom - https://t.co/LxqriJtuM6 @SwayDB #scala #java #database

[Simer @SimerPlaha]

Released @SwayDB v0.16. This release was mainly focused on MultiMap & Compaction performance. Complete #Java API. Support for Boopickle (cc: @ochrons) serialisation. QA and usability testing. See release note. #scala #database #opensource # https://t.co/Jd87MKscfI

[Simer @SimerPlaha]

Released @SwayDB v0.14.5 with important fixes. https://t.co/z1JiQiddbq #storage #database #OpenSource #scala #java

[Simer @SimerPlaha]

Added new data-type MultiMap for creating Tables in @SwayDB
https://t.co/ZLE0MfbS3c
#scala #storage #database #java #kotlin

[Simer @SimerPlaha]

Released @SwayDB v0.14 with MultiMap data-type which allows creation of nested Map (Trees). This is basically to support segregating data similar Tables in SQL. Example - https://t.co/G9wKN7QlVu #scala #java $kotlin #opensource #database #storage

[Simer @SimerPlaha]

Created an issue for an implementation on processing large transactions - https://t.co/xBgsqbxuj5. #storage #transaction #scala #java #kotlin @SwayDB

[Simer @SimerPlaha]

Blogged about using Functions or any native JVM code for updating data. No query language. https://t.co/KgZjcao4SR #java #kotlin #scala #storage #database @SwayDB

[Simer @SimerPlaha]

Blogged Caching & IOStrategy - https://t.co/ASRnx6GiRr #java #kotlin #scala #storage #cache #IO @SwayDB

[Simer @SimerPlaha]

Blogged about Compression strategies in SwayDB.
https://t.co/YFmLIQOWBf. Applications can have different read, write & caching requirements and compression for these applications can be tuned accordingly. #java #kotlin #scala #storage #compression #swaydb #database

[Simer @SimerPlaha]

Documented configs for Segment & concurrent compaction https://t.co/8GER3o9hvj & https://t.co/9tqdGVCzUV #java #scala #kotlin #storage #database

[Simer @SimerPlaha]

Time-series, events or metric data like weather, electricity etc can have reoccurring duplicate values. This config allows detecting & eliminating these duplicates to save storage space. https://t.co/kchlL2HTGn #java #scala #kotlin #storage

[Simer @SimerPlaha]

BloomFilters are epic! Requires only 1% storage space but save a lot on IOPs, space & improve read perform by skipping files they do not require searching. https://t.co/hVaeuqI8SH #java #scala #kotlin #storage

[Simer @SimerPlaha]

Binary-search is essential for read performance but it can be disabled for cold storage. Caching, normalising bytes, partial indexing, concurrency & compression can all be configured accounting for available machine RAM and Disk space https://t.co/3UU10MFGGd #java #scala #storage