Jump to content

Git

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by Unixchris (talk | contribs) at 05:20, 28 October 2013 (Remove spurious comma in caption). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.
Original author(s)Linus Torvalds
Developer(s)Junio Hamano, Linus Torvalds, and many others
Initial releaseError: df must be either "yes" or "y" (help)
Repository
Written inC, Bourne Shell, Tcl, Perl[1]
Operating systemLinux, POSIX, Windows, OS X
TypeVersion control
LicenseGNU General Public License v2
Websitegit-scm.com

In software development, Git /ɡɪt/ is a distributed revision control and source code management (SCM) system with an emphasis on speed.[2] Git was initially designed and developed by Linus Torvalds for Linux kernel development in 2005. Based on a recent survey of Eclipse IDE users, Git is reported to have 30% adoption as of 2013.[3]

Every Git working directory is a full-fledged repository with complete history and full version tracking capabilities, not dependent on network access or a central server.

Git is free software distributed under the terms of the GNU General Public License version 2.

History

Git development began after many developers of the Linux kernel chose to give up access to BitKeeper, a proprietary SCM system that had previously been used to maintain the project.[4] The copyright holder of BitKeeper, Larry McVoy, had withdrawn free use of the product after he claimed that Andrew Tridgell had reverse-engineered the BitKeeper protocols.

Torvalds wanted a distributed system that he could use like BitKeeper, but none of the available free systems met his needs, particularly in terms of performance. Torvalds took an example of an SCM system requiring thirty seconds to apply a patch and update all associated metadata, and noted that this would not scale to the needs of Linux kernel development, where syncing with fellow maintainers could require 250 such actions at a time. His goal was for patches to take three seconds.[5] Torvalds had several other design criteria:

  • Take CVS as an example of what not to do; if in doubt, make the exact opposite decision.
  • Support a distributed, BitKeeper-like workflow.
  • Very strong safeguards against corruption, either accidental or malicious.[6][7]

These three criteria eliminated every then-existing version control system, except for Monotone. Considering performance as well excluded this too.[6] So, immediately after the 2.6.12-rc2 Linux kernel development release,[6] he set out to write his own.[6]

Torvalds has quipped about the name git, which is British English slang roughly equivalent to "unpleasant person". Torvalds said: "I'm an egotistical bastard, and I name all my projects after myself. First 'Linux', now 'git'."[8][9] The man page describes git as "the stupid content tracker".[10]

The development of Git began on 3 April 2005.[11] The project was announced on 6 April,[12] and became self-hosting as of 7 April.[11] The first merge of multiple branches was done on 18 April.[13] Torvalds achieved his performance goals; on 29 April, the nascent Git was benchmarked recording patches to the Linux kernel tree at the rate of 6.7 per second.[14] On 16 June, the kernel 2.6.12 release was managed by Git.[15] Torvalds turned over maintenance on 26 July 2005 to Junio Hamano, a major contributor to the project.[16] Hamano was responsible for the 1.0 release on 21 December 2005, and remains the project's maintainer.[17]

Design

Git's design was inspired by BitKeeper and Monotone.[18][19] Git was originally designed as a low-level version control system engine on top of which others could write front ends, such as Cogito or StGIT.[19] However, the core Git project has since become a complete version control system that is usable directly.[20] While strongly influenced by BitKeeper, Torvalds deliberately attempted to avoid conventional approaches, leading to a unique design.[21]

Characteristics

Git's design is a synthesis of Torvalds's experience with Linux in maintaining a large distributed development project, along with his intimate knowledge of file system performance gained from the same project and the urgent need to produce a working system in short order. These influences led to the following implementation choices:

Strong support for non-linear development
Git supports rapid branching and merging, and includes specific tools for visualizing and navigating a non-linear development history. A core assumption in Git is that a change will be merged more often than it is written, as it is passed around various reviewers. Branches in git are very lightweight: A branch in git is only a reference to a single commit. With its parental commits, the full branch structure can be constructed.
Distributed development
Like Darcs, BitKeeper, Mercurial, SVK, Bazaar and Monotone, Git gives each developer a local copy of the entire development history, and changes are copied from one such repository to another. These changes are imported as additional development branches, and can be merged in the same way as a locally developed branch.
Compatibility with existing systems/protocols
Repositories can be published via HTTP, FTP, rsync, or a Git protocol over either a plain socket, ssh or HTTP. Git also has a CVS server emulation, which enables the use of existing CVS clients and IDE plugins to access Git repositories. Subversion and svk repositories can be used directly with git-svn.
Efficient handling of large projects
Torvalds has described Git as being very fast and scalable,[22] and performance tests done by Mozilla showed it was an order of magnitude faster than some version control systems, and fetching version history from a locally stored repository can be one hundred times faster than fetching it from the remote server.[23] In particular, Git does not get slower as the project history grows larger.[citation needed]
Cryptographic authentication of history
The Git history is stored in such a way that the ID of a particular version (a commit in Git terms) depends upon the complete development history leading up to that commit. Once it is published, it is not possible to change the old versions without it being noticed. The structure is similar to a hash tree, but with additional data at the nodes as well as the leaves.[24] (Mercurial and Monotone also have this property.)
Toolkit-based design
Git was designed as a set of programs written in C, and a number of shell scripts that provide wrappers around those programs.[25] Although most of those scripts have since been rewritten in C for speed and portability, the design remains, and it is easy to chain the components together.[26]
Pluggable merge strategies
As part of its toolkit design, Git has a well-defined model of an incomplete merge, and it has multiple algorithms for completing it, culminating in telling the user that it is unable to complete the merge automatically and manual editing is required.
Garbage accumulates unless collected
Aborting operations or backing out changes will leave useless dangling objects in the database. These are generally a small fraction of the continuously growing history of wanted objects. Git will automatically perform garbage collection when enough loose objects have been created in the repository. Garbage collection can be called explicitly using git gc --prune.[27]
Periodic explicit object packing
Git stores each newly created object as a separate file. Although individually compressed, this takes a great deal of space and is inefficient. This is solved by the use of packs that store a large number of objects in a single file (or network byte stream) called packfile, delta-compressed among themselves. Packs are compressed using the heuristic that files with the same name are probably similar, but do not depend on it for correctness. A corresponding index file is created for each packfile, telling the offset of each object in the packfile. Newly created objects (newly added history) are still stored singly, and periodic repacking is required to maintain space efficiency. The process of packing the repository can be very computationally expensive. By allowing objects to exist in the repository in a loose, but quickly generated format, git allows the expensive pack operation to be deferred until later when time does not matter (e.g. the end of the work day). Git does periodic repacking automatically but manual repacking is also possible with the git gc command. For data integrity, both packfile and its index have SHA-1 checksum inside, and also the file name of packfile contains a SHA-1 checksum. To check integrity, run the git fsck command.

Another property of Git is that it snapshots directory trees of files. The earliest systems for tracking versions of source code, SCCS and RCS, worked on individual files and emphasized the space savings to be gained from interleaved deltas (SCCS) or delta encoding (RCS) the (mostly similar) versions. Later revision control systems maintained this notion of a file having an identity across multiple revisions of a project. However, Torvalds rejected this concept.[28] Consequently, Git does not explicitly record file revision relationships at any level below the source code tree.

Implicit revision relationships have some significant consequences:

  • It is slightly more expensive to examine the change history of a single file than the whole project.[29] To obtain a history of changes affecting a given file, Git must walk the global history and then determine whether each change modified that file. This method of examining history does, however, let Git produce with equal efficiency a single history showing the changes to an arbitrary set of files. For example, a subdirectory of the source tree plus an associated global header file is a very common case.
  • Renames are handled implicitly rather than explicitly. A common complaint with CVS is that it uses the name of a file to identify its revision history, so moving or renaming a file is not possible without either interrupting its history, or renaming the history and thereby making the history inaccurate. Most post-CVS revision control systems solve this by giving a file a unique long-lived name (a sort of inode number) that survives renaming. Git does not record such an identifier, and this is claimed as an advantage.[30][31] Source code files are sometimes split or merged as well as simply renamed,[32] and recording this as a simple rename would freeze an inaccurate description of what happened in the (immutable) history. Git addresses the issue by detecting renames while browsing the history of snapshots rather than recording it when making the snapshot.[33] (Briefly, given a file in revision N, a file of the same name in revision N−1 is its default ancestor. However, when there is no like-named file in revision N−1, Git searches for a file that existed only in revision N−1 and is very similar to the new file.) However, it does require more CPU-intensive work every time history is reviewed, and a number of options to adjust the heuristics.

Git implements several merging strategies; a non-default can be selected at merge time:[34]

  • resolve: the traditional three-way merge algorithm.
  • recursive: This is the default when pulling or merging one branch, and is a variant of the three-way merge algorithm.

    When there are more than one common ancestors that can be used for three-way merge, it creates a merged tree of the common ancestors and uses that as the reference tree for the three-way merge. This has been reported to result in fewer merge conflicts without causing mis-merges by tests done on actual merge commits taken from Linux 2.6 kernel development history. Additionally this can detect and handle merges involving renames.

    — Linus Torvalds[35]
  • octopus: This is the default when merging more than two heads.

Data structures

Git's primitives are not inherently a source code management (SCM) system. Torvalds explains,[36]

In many ways you can just see git as a filesystem — it is content-addressable, and it has a notion of versioning, but I really really designed it coming at the problem from the viewpoint of a filesystem person (hey, kernels is what I do), and I actually have absolutely zero interest in creating a traditional SCM system.

From this initial design approach, Git has developed the full set of features expected of a traditional SCM,[20] with features mostly being created as needed, then refined and extended over time.

Some data flows and storage levels in the Git revision control system.

Git has two data structures: a mutable index (also called stage or cache) that caches information about the working directory and the next revision to be committed; and an immutable, append-only object database.

The object database contains four types of objects:

  • A blob (binary large object) is the content of a file. Blobs have no file name, time stamps, or other metadata.
  • A tree object is the equivalent of a directory. It contains a list of file names, each with some type bits and the name of a blob or tree object that is that file, symbolic link, or directory's contents. This object describes a snapshot of the source tree.
  • A commit object links tree objects together into a history. It contains the name of a tree object (of the top-level source directory), a time stamp, a log message, and the names of zero or more parent commit objects.
  • A tag object is a container that contains reference to another object and can hold additional meta-data related to another object. Most commonly, it is used to store a digital signature of a commit object corresponding to a particular release of the data being tracked by Git.

The index serves as connection point between the object database and the working tree.

Each object is identified by a SHA-1 hash of its contents. Git computes the hash, and uses this value for the object's name. The object is put into a directory matching the first two characters of its hash. The rest of the hash is used as the file name for that object.

Git stores each revision of a file as a unique blob. The relationships between the blobs can be found through examining the tree and commit objects. Newly added objects are stored in their entirety using zlib compression. This can consume a large amount of disk space quickly, so objects can be combined into packs, which use delta compression to save space, storing blobs as their changes relative to other blobs.

Git servers typically listen on TCP port 9418.[37]

Implementations

Git is primarily developed on Linux, although it also supports most major operating systems including BSD, Solaris, OS X, and Microsoft Windows.[38]

The JGit implementation of Git is a pure Java software library, designed to be embedded in any Java application. JGit is used in the Gerrit code review tool and in EGit, a Git client for the Eclipse IDE.[39]

The Dulwich implementation of Git is a pure Python software component for Python 2.[40]

The libgit2 implementation of Git is an ANSI C software library with no other dependencies, which can be built on multiple platforms including Microsoft Windows, Linux, Mac OS X, and BSD.[41] It has bindings for many programming languages, including Ruby, Python and Haskell.[42][43][44] It is used as the underlying Git implementation in Microsoft's Team Foundation Service and Visual Studio.[45]

The Plastic SCM versioning system contains its own implementation of the Git protocol, to allow Plastic SCM clients to interoperate with remote Git repositories.[46]

The Perforce version management system also supports Git clients. Perforce can make its versioned content available as Git repositories using the git+ssh protocol, and these repositories can be used as Git remotes from any Git client.[47]

JS-Git is a JavaScript implementation of a subset of Git.[48]

Adoption

The Eclipse Foundation reported in its annual community survey that as of May 2013, more than 36% of professional software developers use Git as their primary source control system,[3] compared with 27.6% in 2012 and 12.8% in 2011.[49] Open source directory Ohloh reports a similar uptake among open source projects.[50]

The UK IT jobs website itjobswatch.co.uk reports that as of August 2013, approximately 14% of UK permanent software development job openings list Git as a requirement,[51] compared to 18.3% for Subversion,[52] 11% for Microsoft Team Foundation Server,[53] 2% for Visual SourceSafe,[54] and 1.3% for Mercurial.[55]

The following Web sites provide free source code hosting for Git repositories:[56]

See also

References

  1. ^ "git/git.git/tree". git.kernel.org. Retrieved 15 June 2009.
  2. ^ Torvalds, Linus (7 April 2005). "Re: Kernel SCM saga." linux-kernel (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help) "So I'm writing some scripts to try to track things a whole lot faster."
  3. ^ a b http://ianskerrett.wordpress.com/2013/06/12/eclipse-community-survey-results-for-2013/
  4. ^ Feature: No More Free BitKeeper | KernelTrap.org[dead link]
  5. ^ Torvalds, Linus (7 April 2005). "Re: Kernel SCM saga." linux-kernel (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  6. ^ a b c d Linus Torvalds (3 May 2007). Google tech talk: Linus Torvalds on git. Event occurs at 02:30. Retrieved 16 May 2007.
  7. ^ Torvalds, Linus (10 June 2007). "Re: fatal: serious inflate inconsistency". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help) A brief description of Git's data integrity design goals.
  8. ^ "GitFaq: Why the 'git' name?". Git.or.cz. Retrieved 14 July 2012.
  9. ^ "After controversy, Torvalds begins work on 'git'". PC World. 14 July 2012. Torvalds seemed aware that his decision to drop BitKeeper would also be controversial. When asked why he called the new software, "git", British slang meaning "a rotten person", he said. "I'm an egotistical bastard, so I name all my projects after myself. First Linux, now git"
  10. ^ "git(1) Manual Page". Retrieved 21 July 2012.
  11. ^ a b Torvalds, Linus (27 February 2007). "Re: Trivia: When did git self-host?". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  12. ^ Torvalds, Linus (6 April 2005). "Kernel SCM saga." linux-kernel (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  13. ^ Torvalds, Linus (17 April 2005). "First ever real kernel git merge!". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  14. ^ Mackall, Matt (29 April 2005). "Mercurial 0.4b vs git patchbomb benchmark". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  15. ^ Torvalds, Linus (17 June 2005). "Linux 2.6.12". git-commits-head (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  16. ^ Torvalds, Linus (27 July 2005). "Meet the new maintainer..." git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  17. ^ Hamano, Junio C. (21 December 2005). "Announce: Git 1.0.0". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  18. ^ Torvalds, Linus (5 May 2006). "Re: [ANNOUNCE] Git wiki". linux-kernel (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help) "Some historical background" on git's predecessors
  19. ^ a b Torvalds, Linus (8 April 2005). "Re: Kernel SCM saga". linux-kernel (Mailing list). Retrieved 20 February 2008. {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  20. ^ a b Torvalds, Linus (23 March 2006). "Re: Errors GITtifying GCC and Binutils". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  21. ^ Torvalds, Linus (20 October 2006). "Re: VCS comparison table". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help) A discussion of Git vs. BitKeeper
  22. ^ Torvalds, Linus (19 October 2006). "Re: VCS comparison table". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  23. ^ Dreier, Roland (13 November 2006). "Oh what a relief it is"., observing that "git log" is 100x faster than "svn log" because the latter has to contact a remote server.
  24. ^ "Trust". Git Concepts. Git User's Manual. 18 October 2006.
  25. ^ Torvalds, Linus. "Re: VCS comparison table". git (Mailing list). Retrieved 10 April 2009. {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help), describing Git's script-oriented design
  26. ^ iabervon (22 December 2005). "Git rocks!"., praising Git's scriptability
  27. ^ "Git User's Manual". 5 August 2007.
  28. ^ Torvalds, Linus (10 April 2005). "Re: more git updates." linux-kernel (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  29. ^ Haible, Bruno (11 February 2007). "how to speed up "git log"?". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  30. ^ Torvalds, Linus (1 March 2006). "Re: impure renames / history tracking". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  31. ^ Hamano, Junio C. (24 March 2006). "Re: Errors GITtifying GCC and Binutils". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  32. ^ Hamano, Junio C. (23 March 2006). "Re: Errors GITtifying GCC and Binutils". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  33. ^ Torvalds, Linus (28 November 2006). "Re: git and bzr". git (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help), on using git-blame to show code moved between source files
  34. ^ Torvalds, Linus (18 July 2007). "git-merge(1)".
  35. ^ Torvalds, Linus (18 July 2007). "CrissCrossMerge".
  36. ^ Torvalds, Linus (10 April 2005). "Re: more git updates..." linux-kernel (Mailing list). {{cite mailing list}}: Unknown parameter |mailinglist= ignored (|mailing-list= suggested) (help)
  37. ^ "Git Installation". git.wiki.kernel.org. Retrieved 25 January 2012.
  38. ^ "downloads". Retrieved 14 May 2012.
  39. ^ "JGit". Retrieved 24 August 2012.
  40. ^ "Dulwich". Retrieved 27 August 2012.
  41. ^ "libgit2". Retrieved 24 August 2012.
  42. ^ "rugged". Retrieved 24 August 2012.
  43. ^ "pygit2". Retrieved 24 August 2012.
  44. ^ "hlibgit2". Retrieved 30 April 2013.
  45. ^ "Microsoft embraces git with new TFS support, Visual Studio integration". Retrieved 1 February 2013.
  46. ^ "Direct push/pull from Plastic SCM to Git". Retrieved 29 October 2012.
  47. ^ "Perforce Aims to Bring Git to the Enterprise". Retrieved 1 February 2013.
  48. ^ https://github.com/creationix/js-git "js-git: a JavaScript implementation of Git." Retrieved 13 August 2013.
  49. ^ "Results of Eclipse Community Survey 2012".
  50. ^ "Ohloh: Compare Repositories".
  51. ^ http://www.itjobswatch.co.uk/jobs/uk/git%20%28software%29.do
  52. ^ http://www.itjobswatch.co.uk/jobs/uk/subversion.do
  53. ^ http://www.itjobswatch.co.uk/jobs/uk/team%20foundation%20server.do
  54. ^ http://www.itjobswatch.co.uk/jobs/uk/vss/sourcesafe.do
  55. ^ http://www.itjobswatch.co.uk/jobs/uk/mercurial.do
  56. ^ https://git.wiki.kernel.org/articles/g/i/t/GitHosting_2036.html
  57. ^ Bright, Peter (22 March 2012). "Microsoft brings git support to its CodePlex hosting service". Ars Technica. Retrieved 23 March 2012.

Further reading