mirrors/git
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Files
d42bab442d7ca6bcc38aefe384e94d4320565b77
git/builtin
History
Neeraj Singh 425d290ce5 unpack-objects: use the bulk-checkin infrastructure 
The unpack-objects functionality is used by fetch, push, and fast-import
to turn the transfered data into object database entries when there are
fewer objects than the 'unpacklimit' setting.

By enabling an odb-transaction when unpacking objects, we can take advantage
of batched fsyncs.

Here are some performance numbers to justify batch mode for
unpack-objects, collected on a WSL2 Ubuntu VM.

Fsync Mode | Time for 90 objects (ms)
-------------------------------------
       Off | 170
  On,fsync | 760
  On,batch | 230

Note that the default unpackLimit is 100 objects, so there's a 3x
benefit in the worst case. The non-batch mode fsync scales linearly
with the number of objects, so there are significant benefits even with
smaller numbers of objects.

Signed-off-by: Neeraj Singh <neerajsi@microsoft.com>
Signed-off-by: Junio C Hamano <gitster@pobox.com>
2022-04-06 13:13:26 -07:00
..
add.c
builtin/add: add ODB transaction around add_files_to_cache
2022-04-06 13:13:26 -07:00
am.c
Merge branch 'ab/date-mode-release'
2022-02-25 15:47:36 -08:00
annotate.c
…
apply.c
…
archive.c
use xopen() to handle fatal open(2) failures
2021-08-25 14:39:08 -07:00
bisect--helper.c
Merge branch 'ac/usage-string-fixups'
2022-03-06 21:25:32 -08:00
blame.c
Merge branch 'ja/i18n-common-messages'
2022-02-25 15:47:35 -08:00
branch.c
Merge branch 'gc/branch-recurse-submodules'
2022-02-18 13:53:29 -08:00
bugreport.c
hook-list.h: add a generated list of hooks, like config-list.h
2021-09-27 09:44:54 -07:00
bundle.c
bundle: call strvec_clear() on allocated strvec
2022-03-04 13:24:18 -08:00
cat-file.c
cat-file: add --batch-command mode
2022-02-18 11:21:46 -08:00
check-attr.c
…
check-ignore.c
dir.[ch]: replace dir_init() with DIR_INIT
2021-07-01 12:32:22 -07:00
check-mailmap.c
shortlog: remove unused(?) "repo-abbrev" feature
2021-01-12 14:04:42 -08:00
check-ref-format.c
…
checkout--worker.c
pkt-line.[ch]: remove unused packet_read_line_buf()
2021-10-15 13:09:40 -07:00
checkout-index.c
checkout-index: integrate with sparse index
2022-01-13 13:49:45 -08:00
checkout.c
Merge branch 'gc/parse-tree-indirect-errors'
2022-03-13 22:56:17 +00:00
clean.c
Merge branch 'vd/sparse-clean-etc'
2022-02-17 16:25:05 -08:00
clone.c
Merge branch 'gc/parse-tree-indirect-errors'
2022-03-13 22:56:17 +00:00
column.c
column: fix parsing of the '--nl' option
2021-08-26 14:36:27 -07:00
commit-graph.c
commit-graph: fix memory leak in misused string_list API
2022-03-04 13:24:18 -08:00
commit-tree.c
use xopen() to handle fatal open(2) failures
2021-08-25 14:39:08 -07:00
commit.c
Merge branch 'ab/date-mode-release'
2022-02-25 15:47:36 -08:00
config.c
urlmatch.c: add and use a *_release() function
2022-03-04 13:24:18 -08:00
count-objects.c
i18n: remove from i18n strings that do not hold translatable parts
2022-02-04 13:58:28 -08:00
credential-cache--daemon.c
unix-socket: add backlog size option to unix_stream_listen()
2021-03-15 14:32:51 -07:00
credential-cache.c
credential-cache: check for windows specific errors
2021-09-14 09:30:54 -07:00
credential-store.c
Use a better name for the function interpolating paths
2021-07-26 12:17:16 -07:00
credential.c
doc: fix git credential synopsis
2021-10-28 09:57:09 -07:00
describe.c
i18n: turn even more messages into "cannot be used together" ones
2022-01-05 13:31:00 -08:00
diff-files.c
Merge branch 'jc/diffcore-rotate'
2021-02-25 16:43:30 -08:00
diff-index.c
diff-index: restore -c/--cc options handling
2021-09-07 11:11:35 -07:00
diff-tree.c
i18n: refactor "foo and bar are mutually exclusive"
2022-01-05 13:29:23 -08:00
diff.c
builtin/diff.c: fix "git-diff" usage string typo
2022-02-02 11:30:53 -08:00
difftool.c
i18n: factorize more 'incompatible options' messages
2022-02-04 13:58:28 -08:00
env--helper.c
…
fast-export.c
i18n: fix some misformated placeholders in command synopsis
2022-02-04 13:58:28 -08:00
fast-import.c
core.fsync: introduce granular fsync control infrastructure
2022-03-10 15:10:22 -08:00
fetch-pack.c
connect, transport: encapsulate arg in struct
2021-02-05 13:49:54 -08:00
fetch.c
Merge branch 'ps/fetch-atomic'
2022-03-13 22:56:16 +00:00
fmt-merge-msg.c
merge: allow to pretend a merge is made into a different branch
2021-12-20 14:55:02 -08:00
for-each-ref.c
for-each-ref: delay parsing of --sort=<atom> options
2021-10-20 14:33:07 -07:00
for-each-repo.c
builtin/for-each-repo: remove unnecessary argv copy to plug leak
2021-07-26 12:19:20 -07:00
fsck.c
run-command API users: use strvec_pushl(), not argv construction
2021-11-25 22:15:07 -08:00
gc.c
Merge branch 'ab/config-based-hooks-2'
2022-02-09 14:21:00 -08:00
get-tar-commit-id.c
…
grep.c
Merge branch 'ab/grep-patterntype'
2022-02-25 15:47:36 -08:00
hash-object.c
Merge branch 'ja/i18n-common-messages'
2022-02-25 15:47:35 -08:00
help.c
Merge branch 'ab/help-fixes'
2022-03-09 13:38:24 -08:00
hook.c
git hook run: add an --ignore-missing flag
2022-01-07 15:19:34 -08:00
index-pack.c
Merge branch 'ns/core-fsyncmethod' into ns/batch-fsync
2022-04-06 13:01:54 -07:00
init-db.c
i18n: refactor "foo and bar are mutually exclusive"
2022-01-05 13:29:23 -08:00
interpret-trailers.c
…
log.c
Merge branch 'ab/grep-patterntype'
2022-02-25 15:47:36 -08:00
ls-files.c
ls-files: support --recurse-submodules --stage
2022-02-23 16:41:55 -08:00
ls-remote.c
ls-remote & transport API: release "struct transport_ls_refs_options"
2022-02-06 18:02:34 -08:00
ls-tree.c
built-ins: trust the "prefix" from run_builtin()
2022-02-15 18:00:50 -08:00
mailinfo.c
mailinfo: allow squelching quoted CRLF warning
2021-05-10 15:06:22 +09:00
mailsplit.c
use xopen() to handle fatal open(2) failures
2021-08-25 14:39:08 -07:00
merge-base.c
merge-base: free() allocated "struct commit **" list
2022-03-04 13:24:17 -08:00
merge-file.c
xdiff: implement a zealous diff3, or "zdiff3"
2021-12-01 14:45:58 -08:00
merge-index.c
merge-index: ensure full index
2021-04-14 13:47:21 -07:00
merge-ours.c
builtins + test helpers: use return instead of exit() in cmd_*
2021-06-09 09:15:58 +09:00
merge-recursive.c
…
merge-tree.c
xdiff users: use designated initializers for out_line
2021-05-11 12:47:31 +09:00
merge.c
Merge branch 'pw/use-in-process-checkout-in-rebase'
2022-02-18 13:53:27 -08:00
mktag.c
i18n: remove from i18n strings that do not hold translatable parts
2022-02-04 13:58:28 -08:00
mktree.c
i18n: remove from i18n strings that do not hold translatable parts
2022-02-04 13:58:28 -08:00
multi-pack-index.c
builtin/multi-pack-index.c: don't leak concatenated options
2021-10-28 15:32:14 -07:00
mv.c
mv: refuse to move sparse paths
2021-09-28 10:31:02 -07:00
name-rev.c
name-rev: replace --stdin with --annotate-stdin in synopsis
2022-02-15 17:37:43 -08:00
notes.c
i18n: remove from i18n strings that do not hold translatable parts
2022-02-04 13:58:28 -08:00
pack-objects.c
core.fsync: introduce granular fsync control infrastructure
2022-03-10 15:10:22 -08:00
pack-redundant.c
builtin/pack-redundant: avoid casting buffers to struct object_id
2021-04-27 16:31:38 +09:00
pack-refs.c
…
patch-id.c
patch-id: fix scan_hunk_header on diffs with 1 line of before/after
2022-02-02 11:24:23 -08:00
prune-packed.c
i18n: remove from i18n strings that do not hold translatable parts
2022-02-04 13:58:28 -08:00
prune.c
Merge branch 'ns/tmp-objdir'
2022-01-03 16:24:15 -08:00
pull.c
Merge branch 'ja/i18n-common-messages'
2022-02-25 15:47:35 -08:00
push.c
i18n: factorize "invalid value" messages
2022-02-04 13:58:28 -08:00
range-diff.c
column, range-diff: downcase option description
2021-03-29 14:06:08 -07:00
read-tree.c
Change unpack_trees' 'reset' flag into an enum
2021-09-27 13:38:37 -07:00
rebase.c
Merge branch 'ja/i18n-common-messages'
2022-02-25 15:47:35 -08:00
receive-pack.c
Merge branch 'cb/clear-quarantine-early-on-all-ref-update-errors'
2022-02-18 13:53:27 -08:00
reflog.c
Merge branch 'ac/usage-string-fixups'
2022-03-06 21:25:32 -08:00
remote-ext.c
…
remote-fd.c
…
remote.c
i18n: remove from i18n strings that do not hold translatable parts
2022-02-04 13:58:28 -08:00
repack.c
Merge branch 'ja/i18n-similar-messages'
2022-01-10 11:52:56 -08:00
replace.c
i18n: remove from i18n strings that do not hold translatable parts
2022-02-04 13:58:28 -08:00
rerere.c
xdiff users: use designated initializers for out_line
2021-05-11 12:47:31 +09:00
reset.c
Merge branch 'ab/diff-free-more'
2022-02-25 15:47:36 -08:00
rev-list.c
i18n: fix some misformated placeholders in command synopsis
2022-02-04 13:58:28 -08:00
rev-parse.c
refs: drop "broken" flag from for_each_fullref_in()
2021-09-27 12:36:45 -07:00
revert.c
Merge branch 'ds/mergies-with-sparse-index'
2021-09-20 15:20:45 -07:00
rm.c
Merge branch 'ja/i18n-similar-messages'
2022-01-10 11:52:56 -08:00
send-pack.c
i18n: factorize "invalid value" messages
2022-02-04 13:58:28 -08:00
shortlog.c
log: add a --no-graph option
2022-02-11 10:06:41 -08:00
show-branch.c
date API: create a date.h, split from cache.h
2022-02-16 09:40:00 -08:00
show-index.c
builtin/show-index: set the algorithm for object IDs
2021-04-27 16:31:39 +09:00
show-ref.c
refs: switch peel_ref() to peel_iterated_oid()
2021-01-21 15:51:31 -08:00
sparse-checkout.c
Merge branch 'ab/plug-random-leaks'
2022-03-13 22:56:18 +00:00
stash.c
stash: strip "refs/heads/" with skip_prefix
2022-02-24 11:06:18 -08:00
stripspace.c
i18n: remove from i18n strings that do not hold translatable parts
2022-02-04 13:58:28 -08:00
submodule--helper.c
Merge branch 'ab/plug-random-leaks'
2022-03-13 22:56:18 +00:00
symbolic-ref.c
symbolic-ref: don't leak shortened refname in check_symref()
2021-03-14 15:57:59 -07:00
tag.c
date API: create a date.h, split from cache.h
2022-02-16 09:40:00 -08:00
unpack-file.c
…
unpack-objects.c
unpack-objects: use the bulk-checkin infrastructure
2022-04-06 13:13:26 -07:00
update-index.c
update-index: use the bulk-checkin infrastructure
2022-04-06 13:13:26 -07:00
update-ref.c
update-ref: fix streaming of status updates
2021-09-03 11:35:15 -07:00
update-server-info.c
i18n: remove from i18n strings that do not hold translatable parts
2022-02-04 13:58:28 -08:00
upload-archive.c
upload-archive: use regular "struct child_process" pattern
2021-11-25 22:15:07 -08:00
upload-pack.c
upload-pack: document and rename --advertise-refs
2021-08-05 08:59:37 -07:00
var.c
var: add GIT_DEFAULT_BRANCH variable
2021-11-03 13:25:36 -07:00
verify-commit.c
…
verify-pack.c
…
verify-tag.c
…
worktree.c
Merge branch 'ds/worktree-docs'
2022-03-06 21:25:31 -08:00
write-tree.c
…