Eventstorage

Eventstorage - this is an event logger with high-speed recording and event reading capability. Supports log rotation.

Well suited for tasks where you need to make a lot of writes (tens of thousands per second) and sometimes read them for transmission somewhere. For example, to exchange data between several applications, storages, clusters, etc.

Benchmarks

cpu: Intel(R) Core(TM) i7-10700K CPU @ 3.80GHz  
BenchmarkWriteChar-16                        63323869       19.42 ns/op     4  B/op     0 allocs/op
BenchmarkEventStorage_ReadChar-16              323152        3665 ns/op     24 B/op     1 allocs/op
BenchmarkEventStorage_CharReadTo-16            331111        3637 ns/op      8 B/op     1 allocs/op
BenchmarkEventStorage_CharReadToOffset10000-16  43273       27300 ns/op      8 B/op     1 allocs/op

Installation

go get -u github.com/pankif/eventstorage

Examples

package main

import (
    "fmt"
    "time"
    "github.com/pankif/eventstorage"
)

func main()  {
    storage, err := eventstorage.New("./")
    defer storage.Shutdown()
	
    if err != nil {
        fmt.Println(err)
        return
    }
	
    storage.SetWriteFileMaxSize(10 * eventstorage.MB)
    storage.SetAutoFlushCount(1)
    _ = storage.SetAutoFlushTime(60 * time.Millisecond)

    _, _ = storage.Write([]byte("some data to write"))

    fmt.Println(storage.Read(1, 0)) 
}

More examples you can find into here.

Tests

• Coverage percent go test ./... -coverprofile=coverage.out && go tool cover -func=coverage.out
• Coverage map go test ./ -coverprofile c.out && go tool cover -html=c.out
• go test -bench=. --benchmem
• go test -bench=BenchmarkWriteChar -benchmem -cpuprofile profile.out
• go test -bench=BenchmarkWriteChar -benchmem -memprofile profile.out
• go tool pprof profile.out

github.com/pankif/eventstorage  0.162s  coverage: 95.0% of statements