8b4eed29e5
wal: fix the unexpectedEOF error in the last wal.
...
It is safe to repair the unexpectedEOF error in the last wal. raft
will not send out message before the entry successfully comitted
into wal. Thus we can safely truncate the last entry in the wal
to repair.
2015-03-28 21:08:14 -07:00
05e240b892
*: update protobuf
2015-03-25 10:14:35 -07:00
3dd6e0b88f
wal: fix missing import
2015-03-24 22:53:15 -07:00
6e6669d696
wal: releastTo should work with large release index
2015-03-24 22:34:26 -07:00
5e0077cc0c
etcdserver: print out extra files in data dir instead of erroring
2015-03-24 18:56:22 -07:00
b66eb3d81c
wal: fix ReleaseLockTo
...
ReleaseLockTo should not release the lock on the WAL
segment that is right before the given index. When
restarting etcd, etcd needs to read from the WAL segment
that has a smaller index than the snapshot index.
The correct behavior is that ReleaseLockTo releases
the locks w is holding so that w only holds one lock
that has an index smaller than the given index.
2015-03-09 19:52:54 -07:00
ab72c3ec88
wal: do not race reader and writer
2015-03-05 20:19:17 -08:00
86429264fb
wal: support auto-cut in wal
...
WAL should control the cut logic itself. We want to do falloc to
per allocate the space for a segmented wal file at the beginning
and cut it when it size reaches the limit.
2015-02-28 11:18:59 -08:00
84485643fe
*: expose wal metrics at /metrics
2015-02-28 11:06:11 -08:00
fb1a28c65d
*: vendor prometheus
2015-02-28 11:06:11 -08:00
9e63b1fb63
wal: record metrics
2015-02-28 10:12:35 -08:00
3fd9136740
migrate/starter: fix v2 data dir checking
2015-02-24 11:47:56 -08:00
92dca0af0f
*: remove shadowing of variables from etcd and add travis test
...
We've been bitten by this enough times that I wrote a tool so that
it never happens again.
2015-02-17 16:31:42 -05:00
fade9b6065
etcdserver: Refactor 2.0.1 directory rename into a proper migration
...
fix all instances
fix detection test
2015-02-12 11:53:19 -05:00
e966e565c4
etcdctl/backup_command: handle datadir with missed snapshot mark
...
This helps to recover from the data dir created in v2.0.0-rc1.
2015-01-29 13:32:59 -08:00
f1ed69e883
*: switch to line comments for copyright
...
Build tags are not compatible with block comments.
Also adds copyright header to a few places it was missing.
2015-01-26 09:53:30 -08:00
05e591f805
wal: remove unused encoder.buffered func
2015-01-09 14:59:46 -08:00
9bdc343b7c
wal: add ReleaseLockTo test
2015-01-09 14:59:41 -08:00
270e67db84
wal: not export unnecessary public functions
2015-01-09 14:55:10 -08:00
50c179ec1c
wal: add DetectVersion test
2015-01-09 14:55:05 -08:00
f08d1090d0
wal: refine parseWalName function
...
According to http://godoc.org/fmt#Scan , if scan number is less than the
number of arguments, err will report why. So we don't need to handle
this error case.
2015-01-08 14:56:21 -08:00
9532810f76
wal: remove unused max function
2015-01-08 14:49:14 -08:00
6460e49a33
wal: save empty snapshot when create
...
So caller can open at empty snapshot to read all entries.
2015-01-06 19:48:21 -08:00
78bb207bac
wal: update doc about snapshot
2015-01-06 19:33:57 -08:00
84f62f21ee
wal: record and check snapshot
2015-01-06 16:27:40 -08:00
1ec98cb795
pkg/fileutil: sort filenames during ReadDir
2014-12-18 16:36:11 -08:00
502396edd5
wal: fix wal doc
2014-12-14 19:36:37 -08:00
53bf7e4b5e
wal: rename openAtIndex -> open; OpenAtIndexUntilUsing -> openNotInUse
2014-12-14 19:33:06 -08:00
f538cba272
*: do not backup files still in use
2014-12-14 19:27:22 -08:00
ea94d19147
*: lock the in using files; do not purge locked the wal files
2014-12-14 19:27:22 -08:00
cf7690cb51
detect more cases of empty directories and actual errors
2014-12-11 13:37:32 -05:00
421fe128c3
Return Unknown instead of NotExist
...
Unless the data dir truly does not exist.
2014-12-11 13:09:50 -05:00
b9bf957c6d
wal: sync after writing data to disk in Cut function
2014-12-04 22:56:34 -08:00
af0f34c595
wal: save latest state into new WAL
...
So we could always read out state when open at valid index.
2014-12-04 12:19:21 -08:00
aa61009560
wal: not return ErrIndexNotFound in ReadAll
...
This IndexNotFound case is reasonable now because we don't write dummy
entries into wals any more.
2014-12-02 00:28:54 -08:00
d3db010190
*: support purging old wal/snap files
2014-12-01 11:50:17 -08:00
5139257b8d
Merge pull request #1743 from barakmich/auto_upgrade
...
etcdserver: autodetect v0.4 WALs and upgrade them to v0.5 automatically
2014-11-20 17:20:34 -05:00
59a0c64e9f
fix import loop, add set to types, and fix comments
2014-11-20 15:38:08 -05:00
78ea3335bf
etcdserver: autodetect v0.4 WALs and upgrade them to v0.5 automatically
2014-11-20 15:38:08 -05:00
d0dd205b0e
wal: add a bench for write entry
2014-11-20 12:07:17 -08:00
5a964f49a5
wal: propagate errors
2014-11-08 17:16:23 -08:00
791b2fd503
*: handle panic and fatal more consistently
...
1. etcd fatals if there is critical error in the system and operator should
do something for it
2. etcd panics if there happens something unexpected, and it should be
reported to us to debug.
2014-11-05 13:53:24 -08:00
075ab6415f
Merge pull request #1587 from xiangli-cmu/fix_wal
...
wal: sync before returning from create
2014-11-03 15:58:47 -08:00
ff1f5a9d57
wal: sync before returning from create
2014-11-03 14:28:59 -08:00
5da481213e
Merge pull request #1478 from unihorn/190
...
etcdserver: panic on storage error
2014-11-03 11:07:55 -08:00
433b4138c5
etcdserver: panic on storage error
...
It is a critical error to etcd, and etcd is not able to recover it now.
2014-11-03 10:46:04 -08:00
513c72ec8b
wal: update the docs to show the optional metadata field
2014-10-31 11:32:17 -07:00
aa50af1c69
*: clean log.Print
...
1. only log things by default that the operator of etcd may need to react to
2. put package name at the head of log lines
2014-10-30 18:15:53 -07:00
7a4d42166b
*: add license header to all source files
2014-10-17 15:41:22 -07:00
f98fbbfc14
*: proto refactoring
2014-10-14 21:07:23 +08:00
