f59da0e453
*:fix point-in-time backup
...
Backup process should be able to read all WALs until io.EOF to
generate a point-in-time backup.
Our WAL file is append-only. And the backup process will lock all
files before start reading, which can prevent the gc routine from
removing any files in the middle.
2015-06-15 11:12:28 -07:00
3dd6e0b88f
wal: fix missing import
2015-03-24 22:53:15 -07:00
6e6669d696
wal: releastTo should work with large release index
2015-03-24 22:34:26 -07:00
b66eb3d81c
wal: fix ReleaseLockTo
...
ReleaseLockTo should not release the lock on the WAL
segment that is right before the given index. When
restarting etcd, etcd needs to read from the WAL segment
that has a smaller index than the snapshot index.
The correct behavior is that ReleaseLockTo releases
the locks w is holding so that w only holds one lock
that has an index smaller than the given index.
2015-03-09 19:52:54 -07:00
86429264fb
wal: support auto-cut in wal
...
WAL should control the cut logic itself. We want to do falloc to
per allocate the space for a segmented wal file at the beginning
and cut it when it size reaches the limit.
2015-02-28 11:18:59 -08:00
92dca0af0f
*: remove shadowing of variables from etcd and add travis test
...
We've been bitten by this enough times that I wrote a tool so that
it never happens again.
2015-02-17 16:31:42 -05:00
f1ed69e883
*: switch to line comments for copyright
...
Build tags are not compatible with block comments.
Also adds copyright header to a few places it was missing.
2015-01-26 09:53:30 -08:00
9bdc343b7c
wal: add ReleaseLockTo test
2015-01-09 14:59:41 -08:00
270e67db84
wal: not export unnecessary public functions
2015-01-09 14:55:10 -08:00
6460e49a33
wal: save empty snapshot when create
...
So caller can open at empty snapshot to read all entries.
2015-01-06 19:48:21 -08:00
84f62f21ee
wal: record and check snapshot
2015-01-06 16:27:40 -08:00
53bf7e4b5e
wal: rename openAtIndex -> open; OpenAtIndexUntilUsing -> openNotInUse
2014-12-14 19:33:06 -08:00
ea94d19147
*: lock the in using files; do not purge locked the wal files
2014-12-14 19:27:22 -08:00
b9bf957c6d
wal: sync after writing data to disk in Cut function
2014-12-04 22:56:34 -08:00
af0f34c595
wal: save latest state into new WAL
...
So we could always read out state when open at valid index.
2014-12-04 12:19:21 -08:00
aa61009560
wal: not return ErrIndexNotFound in ReadAll
...
This IndexNotFound case is reasonable now because we don't write dummy
entries into wals any more.
2014-12-02 00:28:54 -08:00
ff1f5a9d57
wal: sync before returning from create
2014-11-03 14:28:59 -08:00
7a4d42166b
*: add license header to all source files
2014-10-17 15:41:22 -07:00
447caf1afc
etcdserver/wal: record info at the head of WAL file
2014-10-10 11:57:09 -07:00
8bbbaa88b2
*: raft related int64 -> uint64
2014-10-09 14:29:21 +08:00
1d5d2e3726
*: Id -> ID for protobuf types
...
We use ID instead of Id in this project based on golang conventions.
2014-09-26 11:49:30 -07:00
29f6d8a9e6
wal: add ErrFileNotFound and ErrIndexNotFound
2014-09-17 15:58:06 -07:00
7160b5ae26
wal: OpenFromIndex fails if it cannot find previous index
...
Example:
We save entry 1, 2, 3 to WAL.
If we try to open 100, it should fail.
2014-09-17 15:07:07 -07:00
023dc7cba2
etcdserver: add SYNC request
2014-09-16 13:42:03 -07:00
1d09c25f5f
wal: add walName function; cleanup test
2014-09-15 10:17:21 -07:00
1164c4b83d
wal: recover writting seq
2014-09-15 10:14:18 -07:00
21860bc017
wal: cut(i uint64) -> cut
2014-09-15 10:14:18 -07:00
a9af70c52b
raft: write entry 0 into log
2014-09-15 09:55:52 -07:00
2030ca202f
wal: change wal filename format
...
Make raftIndex section to be expected raftIndex of next entry.
It makes filename more intuitive and straight-forward.
The commit also adds comments for filename format.
2014-09-12 11:24:28 -07:00
884c702512
wal: wal.OpenFromIndex -> wal.OpenAtIndex
...
The first entry read from the wal should be the index provided. This
name makes that more clear.
2014-09-11 12:52:06 -07:00
24fd126822
*: stop using 0xBEEF
...
Using 0xBEEF is annoying in examples because it makes it makes it look
like the user can use ascii or something. In the Procfile use
0x0,0x1,0x2,etc and use 0xBAD0 in test.
2014-09-09 16:40:51 -07:00
6f06923e96
wal: test save empty state
2014-09-09 10:41:15 -07:00
9997c9488a
*: fix a few small issues identified by go vet
2014-09-08 23:52:36 -07:00
46a7a61b7d
wal: fix broken tests
2014-09-03 15:56:28 -07:00
bdb954b2f5
wal: fix wal
2014-09-03 15:10:15 -07:00
442cae6844
wal: support multiple files
2014-09-03 09:20:10 -07:00
659eb5fd2a
wal: make record a protobuf type
2014-09-03 09:20:03 -07:00
8e06333d45
raft: make State a protobuf type
2014-09-03 09:20:03 -07:00
d6c3ebb1a0
raft: make Info a protobuf type
2014-09-03 09:20:03 -07:00
38ec659cd6
raft: make Entry a protobuf type
2014-09-03 09:20:01 -07:00
28634fce47
wal: Flush -> Sync
2014-09-03 09:20:00 -07:00
a25cd45876
wal: add CoreOS copyright
2014-09-03 09:19:59 -07:00
5baefcce26
wal: cleanup
2014-09-03 09:19:59 -07:00
363e952551
wal: add Read
2014-09-03 09:19:59 -07:00
3c7935a21d
wal: check written data in tests
2014-09-03 09:19:59 -07:00
d1cdc02afc
wal: add tests for write
2014-09-03 09:19:59 -07:00
7b180d585e
wal: make new work
2014-09-03 09:19:58 -07:00
