Geek Answers Handbook

Git forks deduplication on server

Is there a way to hard-link all duplicate objects in a folder containing multiple Git repositories?

Explanation:

I host a git server on my company’s server (on a Linux machine). The idea is to have a basic canonical repository, to which each user does not have forced access, but each user forks the canonical repository (clones the canonical into the user's home directory, thereby actually creating hard links).

/ canonical / Repo / Dev1 / Repo (objects tightly associated with / canonical / Repo during initial cloning) / Dev2 / Repo (objects related to / canonical / Repo during initial cloning)

This all works great. The problem occurs when:

Dev1: puts a huge commit in its fork on the server (/ Dev1 / Repo) Dev2: selects it on its local system, makes its own changes and puts it in its own fork on the server (/ Dev2 / Repo)

(Now the same "huge" file is located in both branches of the developer on the server. It does not automatically create a hard link.)

It swallows up my server space like crazy!

How can I create hard links between objects that are duplicate between two forks or canonical in this regard, so that server space is saved and each developer gets all the data when cloning from his fork on his local computer?

+6
2

:

 shared-objects-database.git/
foo.git/
  objects/info/alternate (will have ../../shared-objects-database.git/objects)
bar.git/
  objects/info/alternate (will have ../../shared-objects-database.git/objects)
baz.git/
  objects/info/alternate (will have ../../shared-objects-database.git/objects)

objects/info/alternates, .

, , .

:

  1. git init --bare shared-object-database.git

  2. , ( -), cronjob

    for r in list-of-forks
    do

    (cd "$ r" && git push../shared-objects-database.git "refs/: refs/remotes/$ r/" && echo../../shared-objects-database.git/objects> /info/alternates # "" )

"git gc" , , .

git repack -adl !

, , , .

gc.pruneExpire never . !

, , ! Git !

( - , ! ( !: P .)

+3

"" .

, Git 2.20 - -, -, , , , .,

fe0ac2f, 108f530, f64ba53 (16 2018 .) (chriscool).
peff: (peff) (pclouds).
. 9eb0986, 16d75fa, 28b8a73, c8d521f (16 2018 .) (peff).
peff: (peff) (pclouds).
( - gitster - f3504ea, 17 2018 .)

delta-islands.{c,h}

-, "" , , .

- , , .
.

, Git, , , .

, , , , , "-".
- , .

, " " - .

" delta-islands.{c,h} ", .

struct object_entry pack-objects.h.

. Documentation/git-pack-objects.txt: :

, pack-objects , . , , .

, , ( ). "" , . , - , .

.
, , . , , , .

, , .

, , "" GIT_NAMESPACE .

, , .
, , .

, refs/heads/ refs/tags/ (, refs/pull refs/changes refs/changes -). , , , .

, "".

Pack-objects , , A , A ( ), , - .

: . Git 2.23 (Q3 2019) .

. bdbdf42 (20 2019 .) (peff).
( Junio C Hamano - gitster - a4c8352, 09 2019 .)

delta-islands: progress

" Marked %d islands ", --no-progress stderr -tty.

progress load_delta_islands().
resolve_tree_islands().

+2

More articles:


All Articles