Changelog of @hackage/git-annex 5.20140915

git-annex (5.20140915) unstable; urgency=medium

  • New annex.hardlink setting. Closes: #758593
  • init: Automatically detect when a repository was cloned with --shared, and set annex.hardlink=true, as well as marking the repository as untrusted.
  • Fix parsing of ipv6 address in git remote address when it was not formatted as an url.
  • The annex-rsync-transport configuration is now also used when checking if a key is present on a rsync remote, and when dropping a key from the remote.
  • Promote file not found warning message to an error.
  • Fix transfer lock file FD leak that could occur when two separate git-annex processes were both working to perform the same set of transfers.
  • sync: Ensure that pending changes to git-annex branch are committed before push when in direct mode. (Fixing a very minor reversion.)
  • WORM backend: Switched to include the relative path to the file inside the repository, rather than just the file's base name. Note that if you're relying on such things to keep files separate with WORM, you should really be using a better backend.
  • Rather than crashing when there's a problem with the requested bloomfilter capacity/accuracy, fall back to a reasonable default bloom filter size.
  • Fix build with optparse-applicative 0.10. Closes: #761484
  • webapp: Fixed visual glitch in xmpp pairing that was reported live by a user who tracked me down in front of a coffee cart in Portland. (New bug reporting method of choice?)

-- Joey Hess joeyh@debian.org Mon, 15 Sep 2014 10:45:00 -0400

git-annex (5.20140831) unstable; urgency=medium

  • Make --help work when not in a git repository. Closes: #758592
  • Ensure that all lock fds are close-on-exec, fixing various problems with them being inherited by child processes such as git commands.
  • When accessing a local remote, shut down git-cat-file processes afterwards, to ensure that remotes on removable media can be unmounted. Closes: #758630
  • Fix handing of autocorrection when running outside a git repository.
  • Fix stub git-annex test support when built without tasty.
  • Do not preserve permissions and acls when copying files from one local git repository to another. Timestamps are still preserved as long as cp --preserve=timestamps is supported. Closes: #729757

-- Joey Hess joeyh@debian.org Sun, 31 Aug 2014 12:30:08 -0700

git-annex (5.20140817) unstable; urgency=medium

  • New chunk= option to chunk files stored in special remotes. Supported by: directory, S3, webdav, gcrypt, rsync, and all external and hook special remotes.
  • Partially transferred files are automatically resumed when using chunked remotes!
  • The old chunksize= option is deprecated. Do not use for new remotes.
  • Legacy code for directory remotes using the old chunksize= option will keep them working, but more slowly than before.
  • webapp: Automatically install Konqueror integration scripts to get and drop files.
  • repair: Removing bad objects could leave fsck finding no more unreachable objects, but some branches no longer accessible. Fix this, including support for fixing up repositories that were incompletely repaired before.
  • Fix cost calculation for non-encrypted remotes.
  • Display exception message when a transfer fails due to an exception.
  • WebDAV: Sped up by avoiding making multiple http connections when storing a file.
  • WebDAV: Avoid buffering whole file in memory when uploading and downloading.
  • WebDAV: Dropped support for DAV before 1.0.
  • testremote: New command to test uploads/downloads to a remote.
  • Dropping an object from a bup special remote now deletes the git branch for the object, although of course the object's content cannot be deleted due to the nature of bup.
  • unlock: Better error handling; continue past files that are not available or cannot be unlocked due to disk space, and try all specified files.
  • Windows: Now uses actual inode equivilants in new direct mode repositories, for safer detection of eg, renaming of files with the same size and mtime.
  • direct: Fix ugly warning messages.
  • WORM backend: When adding a file in a subdirectory, avoid including the subdirectory in the key name.
  • S3, Glacier, WebDAV: Fix bug that prevented accessing the creds when the repository was configured with encryption=shared embedcreds=yes.
  • direct: Avoid leaving file content in misctemp if interrupted.
  • git-annex-shell sendkey: Don't fail if a remote asks for a key to be sent that already has a transfer lock file indicating it's being sent to that remote. The remote may have moved between networks, or reconnected.
  • Switched from the old haskell HTTP library to http-conduit.

-- Joey Hess joeyh@debian.org Sun, 17 Aug 2014 10:30:58 -0400

git-annex (5.20140717) unstable; urgency=high

  • Fix minor FD leak in journal code. Closes: #754608
  • direct: Fix handling of case where a work tree subdirectory cannot be written to due to permissions.
  • migrate: Avoid re-checksumming when migrating from hashE to hash backend.
  • uninit: Avoid failing final removal in some direct mode repositories due to file modes.
  • S3: Deal with AWS ACL configurations that do not allow creating or checking the location of a bucket, but only reading and writing content to it.
  • resolvemerge: New plumbing command that runs the automatic merge conflict resolver.
  • Deal with change in git 2.0 that made indirect mode merge conflict resolution leave behind old files.
  • sync: Fix git sync with local git remotes even when they don't have an annex.uuid set. (The assistant already did so.)
  • Set gcrypt-publish-participants when setting up a gcrypt repository, to avoid unncessary passphrase prompts. This is a security/usability tradeoff. To avoid exposing the gpg key ids who can decrypt the repository, users can unset gcrypt-publish-participants.
  • Install nautilus hooks even when ~/.local/share/nautilus/ does not yet exist, since it is not automatically created for Gnome 3 users.
  • Windows: Move .vbs files out of git\bin, to avoid that being in the PATH, which caused some weird breakage. (Thanks, divB)
  • Windows: Fix locking issue that prevented the webapp starting (since 5.20140707).

-- Joey Hess joeyh@debian.org Thu, 17 Jul 2014 11:27:25 -0400

git-annex (5.20140709) unstable; urgency=medium

  • Fix race in direct mode merge code that could cause all files in the repository to be removed. It should be able to recover repositories experiencing this bug without data loss. See: http://git-annex.branchable.com/bugs/bad_merge_commit_deleting_all_files/
  • Fix git version that supported --no-gpg-sign.
  • Fix bug in automatic merge conflict resolution, when one side is an annexed symlink, and the other side is a non-annexed symlink.
  • Really fix bug that caused the assistant to make many unncessary empty merge commits.

-- Joey Hess joeyh@debian.org Wed, 09 Jul 2014 15:28:03 -0400

git-annex (5.20140707) unstable; urgency=medium

  • assistant: Fix bug, introduced in last release, that caused the assistant to make many unncessary empty merge commits.
  • assistant: Fix one-way assistant->assistant sync in direct mode.
  • Fix bug in annex.queuesize calculation that caused much more queue flushing than necessary.
  • importfeed: When annex.genmetadata is set, metadata from the feed is added to files that are imported from it.
  • Support users who have set commit.gpgsign, by disabling gpg signatures for git-annex branch commits and commits made by the assistant.
  • Fix memory leak when committing millions of changes to the git-annex branch, eg after git-annex add has run on 2 million files in one go.
  • Support building with bloomfilter 2.0.0.
  • Run standalone install process when the assistant is started (was only being run when the webapp was opened).
  • Android: patch git to avoid fchmod, which fails on /sdcard.
  • Windows: Got rid of that pesky DOS box when starting the webapp.
  • Windows: Added Startup menu item so assistant starts automatically on login.
  • Windows: Fix opening file browser from webapp when repo is in a directory with spaces.
  • Windows: Assistant now logs to daemon.log.

-- Joey Hess joeyh@debian.org Mon, 07 Jul 2014 12:24:13 -0400

git-annex (5.20140613) unstable; urgency=medium

  • Ignore setsid failures.
  • Avoid leaving behind .tmp files when failing in some cases, including importing files to a disk that is full.
  • Avoid bad commits after interrupted direct mode sync (or merge).
  • Fix build with wai 0.3.0.
  • Deal with FAT's low resolution timestamps, which in combination with Linux's caching of higher res timestamps while a FAT is mounted, caused direct mode repositories on FAT to seem to have modified files after they were unmounted and remounted.
  • Windows: Fix opening webapp when repository is in a directory with spaces in the path.
  • Detect when Windows has lost its mind in a timezone change, and automatically apply a delta to the timestamps it returns, to get back to sane values.

-- Joey Hess joeyh@debian.org Fri, 13 Jun 2014 09:58:07 -0400

git-annex (5.20140606) unstable; urgency=medium

  • webapp: When adding a new local repository, fix bug that caused its group and preferred content to be set in the current repository, even when not combining.
  • webapp: Avoid stomping on existing description, group and preferred content settings when enabling or combining with an already existing remote.
  • assistant: Make sanity checker tmp dir cleanup code more robust.
  • unused: Avoid checking view branches for unused files.
  • webapp: Include ssh port in mangled hostname.
  • Windows: Fix bug introduced in last release that caused files in the git-annex branch to have lines teminated with \r.
  • Windows: Fix retrieving of files from local bare git repositories.

-- Joey Hess joeyh@debian.org Fri, 06 Jun 2014 12:54:06 -0400

git-annex (5.20140529) unstable; urgency=medium

  • Fix encoding of data written to git-annex branch. Avoid truncating unicode characters to 8 bits. Allow any encoding to be used, as with filenames (but utf8 is the sane choice). Affects metadata and repository descriptions, and preferred content expressions.
  • assistant: When there are multiple remotes giving different ways to access the same repository, honor remote cost settings and use the cheapest available.
  • webapp: More robust startup when annex directory is not a git repo.
  • initremote/enableremote: Basic support for using with regular git remotes; initremote stores the location of an already existing git remote, and enableremote setups up a remote using its stored location.
  • webapp: Support for enabling known git repositories on ssh servers. The repository must have been added using initremote.
  • webapp: When setting up a ssh remote, record it using initremote, so that it can be easily enabled elsewhere.
  • webapp: When setting up a ssh remote, if the user inputs ~/foo, normalize that to foo, since it's in the home directory by default.
  • Use exceptions in place of deprecated MonadCatchIO-transformers Thanks, Ben Gamari.
  • android: Run busybox install with -s, since some versions of Android prohibit making hard links.
  • Android webapp: Fix EvilSplicer bugs that mangled the css files, preventing icons from displaying, and also slightly broke the js files.

-- Joey Hess joeyh@debian.org Thu, 29 May 2014 14:41:56 -0400

git-annex (5.20140517) unstable; urgency=medium

  • webapp: Switched to bootstrap 3. Thanks, Sören Brunk.
  • Standalone builds now check gpg signatures before upgrading.
  • Simplified repository description line format. The remote name, if any, is always in square brackets after the description.
  • assistant: Clean up stale tmp files on startup.
  • webapp: Better ssh password prompting.
  • Depend on git-remote-gcrypt 0.20130908-6. Older versions fail when the assistant is run with no controlling tty.
  • Added ddar special remote. Thanks, Robie Basak.
  • webapp: Fixed drag and drop to reorder the list of remotes.
  • group: When no groups are specified to set, lists the current groups of a repository.
  • Add remote.$name.annex-shell configuration. Thanks, Fraser Tweedale
  • Support symlinking git-annex and git-annex-shell from the Linux standalone bundle into PATH. Thanks, jlebar.

-- Joey Hess joeyh@debian.org Sat, 17 May 2014 13:30:39 -0400

git-annex (5.20140421) unstable; urgency=medium

  • assistant: Now detects immediately when other repositories push changes to a ssh remote, and pulls. ** XMPP is no longer needed in this configuration! ** This requires the remote server have git-annex-shell with notifychanges support (>= 5.20140405)
  • webapp: Show a network signal icon next to ssh and xmpp remotes that it's currently connected with.
  • webapp: Rework xmpp nudge to prompt for either xmpp or a ssh remote to be set up.
  • sync, assistant, remotedaemon: Use ssh connection caching for git pushes and pulls.
  • remotedaemon: When network connection is lost, close all cached ssh connections.
  • Improve handling of monthly/yearly scheduling.
  • Avoid depending on shakespeare except for when building the webapp.
  • uninit: Avoid making unncessary copies of files.
  • info: Allow use in a repository where annex.uuid is not set.
  • reinit: New command that can initialize a new repository using the configuration of a previously known repository. Useful if a repository got deleted and you want to clone it back the way it was.
  • drop --from: When local repository is untrusted, its copy of a file does not count.
  • Bring back rsync -p, but only when git-annex is running on a non-crippled file system. This is a better approach to fix #700282 while not unncessarily losing file permissions on non-crippled systems.
  • webapp: Start even if the current directory is listed in ~/.config/git-annex/autostart but no longer has a git repository in it.
  • findref: New command, like find but shows files in a specified git ref.
  • webapp: Fix UI for removing XMPP connection.
  • When init detects that git is not configured to commit, and sets user.email to work around the problem, also make it set user.name.
  • webapp: Support using git-annex on a remote server, which was installed from the standalone tarball or OSX app, and so does not have git-annex in PATH (and may also not have git or rsync in PATH).
  • standalone tarball, OSX app: Install a ~/.ssh/git-annex-wrapper, which can be used to run git-annex, git, rsync, etc.

-- Joey Hess joeyh@debian.org Sun, 20 Apr 2014 19:43:14 -0400

git-annex (5.20140412) unstable; urgency=high

  • Last release didn't quite fix the high cpu issue in all cases, this should.

-- Joey Hess joeyh@debian.org Fri, 11 Apr 2014 17:14:38 -0400

git-annex (5.20140411) unstable; urgency=high

  • importfeed: Filename template can now contain an itempubdate variable. Needs feed 0.3.9.2.
  • Fix rsync progress parsing in locales that use comma in number display. Closes: #744148
  • assistant: Fix high CPU usage triggered when a monthly fsck is scheduled, and the last time the job ran was a day of the month > 12. This caused a runaway loop. Thanks to Anarcat for his assistance, and to Maximiliano Curia for identifying the cause of this bug.
  • Remove wget from OSX dmg, due to issues with cert paths that broke git-annex automatic upgrading. Instead, curl is used, unless the OSX system has wget installed, which will then be used.

-- Joey Hess joeyh@debian.org Fri, 11 Apr 2014 14:59:49 -0400

git-annex (5.20140405) unstable; urgency=medium

  • git-annex-shell: Added notifychanges command.
  • Improve display of dbus notifications. Thanks, Johan Kiviniemi.
  • Fix nautilus script installation to not crash when the nautilus script dir does not exist. Instead, only install scripts when the directory already exists.

-- Joey Hess joeyh@debian.org Sat, 05 Apr 2014 16:54:33 -0400

git-annex (5.20140402) unstable; urgency=medium

  • unannex, uninit: Avoid committing after every file is unannexed, for massive speedup.
  • --notify-finish switch will cause desktop notifications after each file upload/download/drop completes (using the dbus Desktop Notifications Specification)
  • --notify-start switch will show desktop notifications when each file upload/download starts.
  • webapp: Automatically install Nautilus integration scripts to get and drop files.
  • tahoe: Pass -d parameter before subcommand; putting it after the subcommand no longer works with tahoe-lafs version 1.10. (Thanks, Alberto Berti)
  • forget --drop-dead: Avoid removing the dead remote from the trust.log, so that if git remotes for it still exist anywhere, git annex info will still know it's dead and not show it.
  • git-annex-shell: Make configlist automatically initialize a remote git repository, as long as a git-annex branch has been pushed to it, to simplify setup of remote git repositories, including via gitolite.
  • add --include-dotfiles: New option, perhaps useful for backups.
  • Version 5.20140227 broke creation of glacier repositories, not including the datacenter and vault in their configuration. This bug is fixed, but glacier repositories set up with the broken version of git-annex need to have the datacenter and vault set in order to be usable. This can be done using git annex enableremote to add the missing settings. For details, see http://git-annex.branchable.com/bugs/problems_with_glacier/
  • Added required content configuration.
  • assistant: Improve ssh authorized keys line generated in local pairing or for a remote ssh server to set environment variables in an alternative way that works with the non-POSIX fish shell, as well as POSIX shells.

-- Joey Hess joeyh@debian.org Wed, 02 Apr 2014 16:42:53 -0400

git-annex (5.20140320) unstable; urgency=medium

  • Fix zombie leak and general inneficiency when copying files to a local git repo.
  • Fix ssh connection caching stop method to work with openssh 6.5p1, which broke the old method.
  • webapp: Added a "Sync now" item to each repository's menu.
  • webapp: Use securemem for constant time auth token comparisons.
  • copy --fast --to remote: Avoid printing anything for files that are already believed to be present on the remote.
  • Commands that allow specifying which repository to act on using the repository's description will now fail when multiple repositories match, rather than picking a repository at random. (So will --in=)
  • Better workaround for problem umasks when eg, setting up ssh keys.
  • "standard" can now be used as a first-class keyword in preferred content expressions. For example "standard or (include=otherdir/*)"
  • groupwanted can be used in preferred content expressions.
  • vicfg: Allows editing preferred content expressions for groups.
  • Improve behavior when unable to parse a preferred content expression (thanks, ion).
  • metadata: Add --get
  • metadata: Support --key option (and some other ones like --all)
  • For each metadata field, there's now an automatically maintained "$field-lastchanged" that gives the date of the last change to that field. Also the "lastchanged" field for the date of the last change to any of a file's metadata.
  • unused: In direct mode, files that are deleted from the work tree and so have no content present are no longer incorrectly detected as unused.
  • Avoid encoding errors when using the unused log file.
  • map: Fix crash when one of the remotes of a repo is a local directory that does not exist, or is not a git repo.
  • repair: Improve memory usage when git fsck finds a great many broken objects.
  • Windows: Fix some filename encoding bugs.
  • rsync special remote: Fix slashes when used on Windows.

-- Joey Hess joeyh@debian.org Thu, 20 Mar 2014 13:21:12 -0400

git-annex (5.20140306) unstable; urgency=high

  • sync: Fix bug in direct mode that caused a file that was not checked into git to be deleted when there was a conflicting merge with a remote.
  • webapp: Now supports HTTPS.
  • webapp: No longer supports a port specified after --listen, since it was buggy, and that use case is better supported by setting up HTTPS.
  • annex.listen can be configured, instead of using --listen
  • annex.startupscan can be set to false to disable the assistant's startup scan.
  • Probe for quvi version at run time.
  • webapp: Filter out from Switch Repository list any repositories listed in autostart file that don't have a git directory anymore. (Or are bare)
  • webapp: Refuse to start in a bare git repository.
  • assistant --autostart: Refuse to start in a bare git repository.
  • webapp: Don't list the public repository group when editing a git repository; it only makes sense for special remotes.
  • view, vfilter: Add support for filtering tags and values out of a view, using !tag and field!=value.
  • vadd: Allow listing multiple desired values for a field.
  • view: Refuse to enter a view when no branch is currently checked out.
  • metadata: To only set a field when it's not already got a value, use -s field?=value
  • Run .git/hooks/pre-commit-annex whenever a commit is made.
  • sync: Automatically resolve merge conflict between and annexed file and a regular git file.
  • glacier: Pass --region to glacier checkpresent.
  • webdav: When built with a new enough haskell DAV (0.6), disable the http response timeout, which was only 5 seconds.
  • webapp: Include no-pty in ssh authorized_keys lines.
  • assistant: Smarter log file rotation, which takes free disk space into account.

-- Joey Hess joeyh@debian.org Thu, 06 Mar 2014 12:28:04 -0400

git-annex (5.20140227) unstable; urgency=medium

  • metadata: Field names limited to alphanumerics and a few whitelisted punctuation characters to avoid issues with views, etc.
  • metadata: Field names are now case insensative.
  • When constructing views, metadata is available about the location of the file in the view's reference branch. Allows incorporating parts of the directory hierarchy in a view. For example git annex view tag=* podcasts/=* makes a view in the form tag/showname.
  • --metadata field=value can now use globs to match, and matches case insensatively, the same as git annex view field=value does.
  • annex.genmetadata can be set to make git-annex automatically set metadata (year and month) when adding files.
  • Make annex.web-options be used in several places that call curl.
  • Fix handling of rsync remote urls containing a username, including rsync.net.
  • Preserve metadata when staging a new version of an annexed file.
  • metadata: Support --json
  • webapp: Fix creation of box.com and Amazon S3 and Glacier repositories, broken in 5.20140221.
  • webdav: When built with DAV 0.6.0, use the new DAV monad to avoid locking files, which is not needed by git-annex's use of webdav, and does not work on Box.com.
  • webdav: Fix path separator bug when used on Windows.
  • repair: Optimise unpacking of pack files, and avoid repeated error messages about corrupt pack files.
  • Add build dep on regex-compat to fix build on mipsel, which lacks regex-tdfa.
  • Disable test suite on sparc, which is missing optparse-applicative.
  • Put non-object tmp files in .git/annex/misctmp, leaving .git/annex/tmp for only partially transferred objects.

-- Joey Hess joeyh@debian.org Thu, 27 Feb 2014 11:34:19 -0400

git-annex (5.20140221) unstable; urgency=medium

  • metadata: New command that can attach metadata to files.
  • --metadata can be used to limit commands to acting on files that have particular metadata.
  • Preferred content expressions can use metadata=field=value to limit them to acting on files that have particular metadata.
  • view: New command that creates and checks out a branch that provides a structured view of selected metadata.
  • vfilter, vadd, vpop, vcycle: New commands for operating within views.
  • pre-commit: Update metadata when committing changes to locations of annexed files within a view.
  • Add progress display for transfers to/from external special remotes.
  • unused: Fix to actually detect unused keys when in direct mode.
  • fsck: When run with --all or --unused, while .gitattributes annex.numcopies cannot be honored since it's operating on keys instead of files, make it honor the global numcopies setting, and the annex.numcopies git config setting.
  • trust, untrust, semitrust, dead: Warn when the trust level is overridden in .git/config.
  • glacier: Do not try to run glacier value create when an existing glacier remote is enabled.
  • fsck: Refuse to do anything if more than one of --incremental, --more, and --incremental-schedule are given, since it's not clear which option should win.
  • Windows webapp: Can set up box.com, Amazon S3, and rsync.net remotes
  • Windows webapp: Can create repos on removable drives.
  • Windows: Ensure HOME is set, as needed by bundled cygwin utilities.

-- Joey Hess joeyh@debian.org Fri, 21 Feb 2014 11:23:59 -0400

git-annex (5.20140210) unstable; urgency=medium

  • --in can now refer to files that were located in a repository at some past date. For example, --in="here@{yesterday}"
  • Fixed direct mode annexed content locking code, which is used to guard against recursive file drops.
  • This is the first beta-level release of the Windows port with important fixes (see below). (The webapp and assistant are still alpha-level on Windows.)
  • sync --content: Honor annex-ignore configuration.
  • sync: Don't try to sync with xmpp remotes, which are only currently supported when using the assistant.
  • sync --content: Re-pull from remotes after downloading content, since that can take a while and other changes may be pushed in the meantime.
  • sync --content: Reuse smart copy code from copy command, including handling and repairing out of date location tracking info. Closes: #737480
  • sync --content: Drop files from remotes that don't want them after getting them.
  • sync: Fix bug in automatic merge conflict resolution code when used on a filesystem not supporting symlinks, which resulted in it losing track of the symlink bit of annexed files.
  • Added ways to configure rsync options to be used only when uploading or downloading from a remote. Useful to eg limit upload bandwidth.
  • Fix initremote with encryption=pubkey to work with S3, glacier, webdav, and external special remotes.
  • Avoid building with DAV 0.6 which is badly broken (see #737902).
  • Fix dropping of unused keys with spaces in their name.
  • Fix build on platforms not supporting the webapp.
  • Document in man page that sshcaching uses ssh ControlMaster. Closes: #737476
  • Windows: It's now safe to run multiple git-annex processes concurrently on Windows; the lock files have been sorted out.
  • Windows: Avoid using unix-compat's rename, which refuses to rename directories.
  • Windows: Fix deletion of repositories by test suite and webapp.
  • Windows: Test suite 100% passes again.
  • Windows: Fix bug in symlink calculation code.
  • Windows: Fix handling of absolute unix-style git repository paths.
  • Android: Avoid crashing when unable to set file mode for ssh config file due to Android filesystem horribleness.

-- Joey Hess joeyh@debian.org Mon, 10 Feb 2014 12:54:57 -0400

git-annex (5.20140127) unstable; urgency=medium

  • sync --content: New option that makes the content of annexed files be transferred. Similar to the assistant, this honors any configured preferred content expressions.
  • Remove --json option from commands not supporting it.
  • status: Support --json.
  • list: Fix specifying of files to list.
  • Allow --all to be mixed with matching options like --copies and --in (but not --include and --exclude).
  • numcopies: New command, sets global numcopies value that is seen by all clones of a repository.
  • The annex.numcopies git config setting is deprecated. Once the numcopies command is used to set the global number of copies, any annex.numcopies git configs will be ignored.
  • assistant: Make the prefs page set the global numcopies.
  • Add lackingcopies, approxlackingcopies, and unused to preferred content expressions.
  • Client, transfer, incremental backup, and archive repositories now want to get content that does not yet have enough copies.
  • Client, transfer, and source repositories now do not want to retain unused file contents.
  • assistant: Checks daily for unused file contents, and when possible moves them to a repository (such as a backup repository) that wants to retain them.
  • assistant: annex.expireunused can be configured to cause unused file contents to be deleted after some period of time.
  • webapp: Nudge user to see if they want to expire old unused file contents when a lot of them seem to be piling up in the repository.
  • repair: Check git version at run time.
  • assistant: Run the periodic git gc in batch mode.
  • added annex.secure-erase-command config option.
  • test suite: Use tasty-rerun, and expose tasty command-line options.
  • Optimise non-bare http remotes; no longer does a 404 to the wrong url every time before trying the right url. Needs annex-bare to be set to false, which is done when initially probing the uuid of a http remote.
  • webapp: After upgrading a git repository to git-annex, fix bug that made it temporarily not be synced with.
  • whereis: Support --all.
  • All commands that support --all also support a --key option, which limits them to acting on a single key.

-- Joey Hess joeyh@debian.org Mon, 27 Jan 2014 13:43:28 -0400

git-annex (5.20140117) unstable; urgency=medium

  • Really fix FTBFS on mipsel and sparc due to test suite not being available on those architectures.

-- Joey Hess joeyh@debian.org Fri, 17 Jan 2014 14:46:27 -0400

git-annex (5.20140116) unstable; urgency=medium

  • Added tahoe special remote.
  • external special remote protocol: Added GETGITDIR, and GETAVAILABILITY.
  • Refuse to build with git older than 1.7.1.1, which is needed for git checkout -B
  • map: Fix display of v5 direct mode repos.
  • repair: Support old git versions from before git fsck --no-dangling was implemented.
  • Fix a long-standing bug that could cause the wrong index file to be used when committing to the git-annex branch, if GIT_INDEX_FILE is set in the environment. This typically resulted in git-annex branch log files being committed to the master branch and later showing up in the work tree. (These log files can be safely removed.)
  • assistant: Detect if .git/annex/index is corrupt at startup, and recover.
  • repair: Fix bug in packed refs file exploding code that caused a .gitrefs directory to be created instead of .git/refs
  • Fix FTBFS on mipsel and sparc due to test suite not being available on those architectures.
  • Android: Avoid passing --clobber to busybox wget.

-- Joey Hess joeyh@debian.org Thu, 16 Jan 2014 11:34:54 -0400

git-annex (5.20140107) unstable; urgency=medium

  • mirror: Support --all (and --unused).
  • external special remote protocol: Added GETUUID, GETWANTED, SETWANTED, SETSTATE, GETSTATE, DEBUG.
  • Windows: Fix bug in direct mode merge code that could cause files in subdirectories to go missing.
  • Windows: Avoid eating stdin when running ssh to add a authorized key, since this is used for password prompting.
  • Avoid looping if long-running git cat-file or git hash-object crashes and keeps crashing when restarted.
  • Assistant: Remove stale MERGE_HEAD files in lockfile cleanup.
  • Remotes can now be made read-only, by setting remote..annex-readonly
  • wanted, schedule: Avoid printing "ok" after requested value.
  • assistant: Ensure that .ssh/config and .ssh/authorized_keys are not group or world writable when writing to those files, as that can make ssh refuse to use them, if it allows another user to write to them.
  • addurl, importfeed: Honor annex.diskreserve as long as the size of the url can be checked.
  • add: Fix rollback when disk is completely full.
  • assistant: Fixed several minor memory leaks that manifested when adding a large number of files.
  • assistant: Start a new git-annex transferkeys process after a network connection change, so that remotes that use a persistent network connection are restarted.
  • Adjust Debian build deps to match current state of sparc, mipsel.

-- Joey Hess joeyh@debian.org Tue, 07 Jan 2014 12:22:18 -0400

git-annex (5.20131230) unstable; urgency=medium

  • Added new external special remote interface.
  • importfeed: Support youtube playlists.
  • Add tasty to build-depends, so that test suite builds again. (tasty was stuck in incoming.)
  • Fix typo in test suite.
  • Fix bug in Linux standalone build's shimming that broke git-annex-shell.
  • Include git-receive-pack, git-upload-pack, git, and git-shell wrappers in the Linux standalone build, and OSX app, so they will be available when it's added to PATH.
  • addurl, importfeed: Sanitize | and some other symbols and special characters.
  • Auto-upgrade v3 indirect repos to v5 with no changes. This also fixes a problem when a direct mode repo was somehow set to v3 rather than v4, and so the automatic direct mode upgrade to v5 was not done.
  • Android: Avoid trying to use Android's own ionice, which does not allow specifying a command to run. Fixes transferring files to/from android and probably a few other things.

-- Joey Hess joeyh@debian.org Mon, 30 Dec 2013 14:13:40 -0400

git-annex (5.20131221) unstable; urgency=low

  • assistant: Fix OSX-specific bug that caused the startup scan to try to follow symlinks to other directories, and add their contents to the annex.
  • assistant: Set StrictHostKeyChecking yes when creating ssh remotes, and add it to the configuration for any ssh remotes previously created by the assistant. This avoids repeated prompts by ssh if the host key changes, instead syncing with such a remote will fail. Closes: #732602
  • Fix test suite to cover lock --force change.
  • Add plumbing-level lookupkey and examinekey commands.
  • find --format: Added hashdirlower, hashdirmixed, keyname, and mtime format variables.
  • assistant: Always batch changes found in startup scan.
  • An armel Linux standalone build is now available, which includes the webapp.
  • Programs from Linux and OSX standalone builds can now be symlinked into a directory in PATH as an alternative installation method, and will use readlink to find where the build was unpacked.
  • Include man pages in Linux and OSX standalone builds.
  • Linux standalone build now includes its own glibc and forces the linker to use it, to remove dependence on the host glibc.

-- Joey Hess joeyh@debian.org Sat, 21 Dec 2013 12:00:17 -0400

git-annex (5.20131213) unstable; urgency=low

  • Avoid using git commit in direct mode, since in some situations it will read the full contents of files in the tree.
  • assistant: Batch jobs are now run with ionice and nocache, when those commands are available.
  • assistant: Run transferkeys as batch jobs.
  • Automatically fix up bad bare repositories created by versions 5.20131118 through 5.20131127.
  • rsync special remote: Fix fallback mode for rsync remotes that use hashDirMixed. Closes: #731142
  • copy --from, get --from: When --force is used, ignore the location log and always try to get the file from the remote.
  • Deal with box.com changing the url of their webdav endpoint.
  • Android: Fix SRV record lookups for XMPP to use android getprop command to find DNS server, since there is no resolv.conf.
  • import: Add --skip-duplicates option.
  • lock: Require --force. Closes: #731606
  • import: better handling of overwriting an existing file/directory/broken link when importing
  • Windows: assistant and webapp work! (very experimental)
  • Windows: Support annex.diskreserve.
  • Fix bad behavior in Firefox, which was caused by an earlier fix to bad behavior in Chromium.
  • repair: Improve repair of git-annex index file.
  • repair: Remove damaged git-annex sync branches.
  • status: Ignore new files that are gitignored.
  • Fix direct mode's handling when modifications to non-annexed files are pulled from a remote. A bug prevented the files from being updated in the work tree, and this caused the modification to be reverted.
  • OSX: Remove ssh and ssh-keygen from dmg as they're included in OSX by default.

-- Joey Hess joeyh@debian.org Fri, 13 Dec 2013 14:20:32 -0400

git-annex (5.20131130) unstable; urgency=low

  • init: Fix a bug that caused git annex init, when run in a bare repository, to set core.bare=false.

-- Joey Hess joeyh@debian.org Sat, 30 Nov 2013 16:32:35 -0400

git-annex (5.20131127.1) unstable; urgency=low

  • Rebuild that does not try to use quvi 0.9 from experimental.

-- Joey Hess joeyh@debian.org Thu, 28 Nov 2013 07:57:36 -0400

git-annex (5.20131127) unstable; urgency=low

  • webapp: Detect when upgrades are available, and upgrade if the user desires. (Only when git-annex is installed using the prebuilt binaries from git-annex upstream, not from eg Debian.)
  • assistant: Detect when the git-annex binary is modified or replaced, and either prompt the user to restart the program, or automatically restart it.
  • annex.autoupgrade configures both the above upgrade behaviors.
  • Added support for quvi 0.9. Slightly suboptimal due to limitations in its interface compared with the old version.
  • Bug fix: annex.version did not get set on automatic upgrade to v5 direct mode repo, so the upgrade was performed repeatedly, slowing commands down.
  • webapp: Fix bug that broke switching between local repositories that use the new guarded direct mode.
  • Android: Fix stripping of the git-annex binary.
  • Android: Make terminal app show git-annex version number.
  • Android: Re-enable XMPP support.
  • reinject: Allow to be used in direct mode.
  • Futher improvements to git repo repair. Has now been tested in tens of thousands of intentionally damaged repos, and successfully repaired them all.
  • Allow use of --unused in bare repository.

-- Joey Hess joeyh@debian.org Wed, 27 Nov 2013 18:41:44 -0400

git-annex (5.20131120) unstable; urgency=low

  • Fix Debian package to not try to run test suite, since haskell-tasty is not out of new or in Build-Depends yet.
  • dropunused, addunused: Allow "all" instead of a range to act on all unused data.
  • Ensure execute bit is set on directories when core.sharedrepository is set.
  • Ensure that core.sharedrepository is honored when creating the .git/annex directory.
  • Improve repair code in the case where the index file is corrupt, and this hides other problems from git fsck.

-- Joey Hess joeyh@debian.org Wed, 20 Nov 2013 12:54:18 -0400

git-annex (5.20131118) unstable; urgency=low

  • Direct mode repositories now have core.bare=true set, to prevent accidentally running git commands that try to operate on the work tree, and so do the wrong thing in direct mode.
  • annex.version is now set to 5 for direct mode repositories. This upgrade is handled fully automatically, no need to run git annex upgrade
  • The "status" command has been renamed to "info", to allow "git annex status" to be used in direct mode repositories, now that "git status" won't work in them.
  • The -c option now not only modifies the git configuration seen by git-annex, but it is passed along to every git command git-annex runs.
  • watcher: Avoid loop when adding a file owned by someone else fails in indirect mode because its permissions cannot be modified.
  • webapp: Avoid encoding problems when displaying the daemon log file.
  • webapp: Improve UI around remote that have no annex.uuid set, either because setup of them is incomplete, or because the remote git repository is not a git-annex repository.
  • Include ssh-keygen in standalone bundle.
  • Allow optionally configuring git-annex with -fEKG to enable awesome remote monitoring interfaceat http://localhost:4242/
  • Fix bug that caused bad information to be written to the git-annex branch when running describe or other commands with a remote that has no uuid.
  • Work around Android linker problem that had prevented git-annex from running on Android 4.3 and 4.4.
  • repair: Handle case where index file is corrupt, but all objects are ok.
  • assistant: Notice on startup when the index file is corrupt, and auto-repair.
  • Fix direct mode merge bug when a direct mode file was deleted and replaced with a directory. An ordering problem caused the directory to not get created in this case. Thanks to Tim for the test case.
  • Direct mode .git/annex/objects directories are no longer left writable, because that allowed writing to symlinks of files that are not present, which followed the link and put bad content in an object location. Thanks to Tim for the test case.
  • fsck: Fix up .git/annex/object directory permissions.
  • Switched to the tasty test framework.
  • Android: Adjust default .gitignore to ignore .thumbnails at any location in the tree, not just at its top.
  • webapp: Check annex.version.

-- Joey Hess joeyh@debian.org Mon, 18 Nov 2013 10:45:43 -0400

git-annex (4.20131106) unstable; urgency=low

  • Improve local pairing behavior when two computers both try to start the pairing process separately.
  • sync: Work even when the local git repository is new and empty, with no master branch.
  • gcrypt, bup: Fix bug that prevented using these special remotes with encryption=pubkey.
  • Fix enabling of gcrypt repository accessed over ssh; git-annex-shell gcryptsetup had a bug that caused it to fail with permission denied.
  • Fix zombie process that occurred when switching between repository views in the webapp.
  • map: Work when there are gcrypt remotes.
  • Fix build w/o webapp.
  • Fix exception handling bug that could cause .git/annex/index to be used for git commits outside the git-annex branch. Known to affect git-annex when used with the git shipped with Ubuntu 13.10.

-- Joey Hess joeyh@debian.org Wed, 06 Nov 2013 11:17:47 -0400

git-annex (4.20131101) unstable; urgency=low

  • The "git annex content" command is renamed to "git annex wanted".
  • New --want-get and --want-drop options which can be used to test preferred content settings. For example, "git annex find --in . --want-drop"
  • assistant: When autostarted, wait 5 seconds before running the startup scan, to avoid contending with the user's desktop login process.
  • webapp: When setting up a bare shared repository, enable non-fast-forward pushes.
  • sync: Show a hint about receive.denyNonFastForwards when a push fails.
  • directory, webdav: Fix bug introduced in version 4.20131002 that caused the chunkcount file to not be written. Work around repositories without such a file, so files can still be retreived from them.
  • assistant: Automatically repair damanged git repository, if it can be done without losing data.
  • assistant: Support repairing git remotes that are locally accessible (eg, on removable drives).
  • add: Fix reversion in 4.20130827 when adding unlocked files that have not yet been committed.
  • unannex: New, much slower, but more safe behavior: Copies files out of the annex. This avoids an unannex of one file breaking other files that link to the same content. Also, it means that the content remains in the annex using up space until cleaned up with "git annex unused". (The behavior of unannex --fast has not changed; it still hard links to content in the annex. --fast was not made the default because it is potentially unsafe; editing such a hard linked file can unexpectedly change content stored in the annex.)

-- Joey Hess joeyh@debian.org Fri, 01 Nov 2013 11:34:27 -0400

git-annex (4.20131024) unstable; urgency=low

  • webapp: Fix bug when adding a remote and git-remote-gcrypt is not installed.
  • The assitant can now run scheduled incremental fsck jobs on the local repository and remotes. These can be configured using vicfg or with the webapp.
  • repair: New command, which can repair damaged git repositories (even ones not using git-annex).
  • webapp: When git repository damange is detected, repairs can be done using the webapp UI.
  • Automatically and safely detect and recover from dangling .git/annex/index.lock files, which would prevent git from committing to the git-annex branch, eg after a crash.
  • assistant: Detect stale git lock files at startup time, and remove them.
  • addurl: Better sanitization of generated filenames.
  • Better sanitization of problem characters when generating URL and WORM keys.
  • The control socket path passed to ssh needs to be 17 characters shorter than the maximum unix domain socket length, because ssh appends stuff to it to make a temporary filename. Closes: #725512
  • status: Fix space leak in local mode, introduced in version 4.20130920.
  • import: Skip .git directories.
  • Remove bogus runshell loop check.
  • addurl: Improve message when adding url with wrong size to existing file.
  • Fixed handling of URL keys that have no recorded size.
  • status: Fix a crash if a temp file went away while its size was being checked for status.
  • Deal with git check-attr -z output format change in git 1.8.5.
  • Work around sed output difference that led to version containing a newline on OSX.
  • sync: Fix automatic resolution of merge conflicts where one side is an annexed file, and the other side is a non-annexed file, or a directory.
  • S3: Try to ensure bucket name is valid for archive.org.
  • assistant: Bug fix: When run in a subdirectory, files from incoming merges were wrongly added to that subdirectory, and removed from their original locations.
  • Windows: Deal with strange msysgit 1.8.4 behavior of not understanding DOS formatted paths for --git-dir and --work-tree.
  • Removed workaround for bug in git 1.8.4r0.
  • Added git-recover-repository command to git-annex source (not built by default; this needs to move to someplace else).
  • webapp: Move sidebar to the right hand side of the screen.

-- Joey Hess joeyh@debian.org Thu, 24 Oct 2013 12:59:55 -0400

git-annex (4.20131002) unstable; urgency=low

  • Note that the layout of gcrypt repositories has changed, and if you created one you must manually upgrade it. See http://git-annex.branchable.com/upgrades/gcrypt/
  • webapp: Support setting up and using encrypted git repositories on any ssh server, as well as on rsync.net.
  • git-annex-shell: Added support for operating inside gcrypt repositories.
  • Disable receive.denyNonFastForwards when setting up a gcrypt special remote, since gcrypt needs to be able to fast-forward the master branch.
  • import: Preserve top-level directory structure.
  • Use cryptohash rather than SHA for hashing when no external hash program is available. This is a significant speedup for SHA256 on OSX, for example.
  • Added SKEIN256 and SKEIN512 backends.
  • Android build redone from scratch, many dependencies updated, and entire build can now be done using provided scripts.
  • assistant: Clear the list of failed transfers when doing a full transfer scan. This prevents repeated retries to download files that are not available, or are not referenced by the current git tree.
  • indirect, direct: Better behavior when a file is not owned by the user running the conversion.
  • add, import, assistant: Better preserve the mtime of symlinks, when when adding content that gets deduplicated.
  • Send a git-annex user-agent when downloading urls. Overridable with --user-agent option. (Not yet done for S3 or WebDAV due to limitations of libraries used.)
  • webapp: Fixed a bug where when a new remote is added, one file may fail to sync to or from it due to the transferrer process not yet knowing about the new remote.
  • OSX: Bundled gpg upgraded, now compatible with config files written by MacGPG.
  • assistant: More robust inotify handling; avoid crashing if a directory cannot be read.
  • Moved list of backends and remote types from status to version command.

-- Joey Hess joeyh@debian.org Wed, 02 Oct 2013 16:00:39 -0400

git-annex (4.20130920) unstable; urgency=low

  • webapp: Initial support for setting up encrypted removable drives.
  • Recommend using my patched gcrypt, which fixes some bugs: https://github.com/joeyh/git-remote-gcrypt
  • Support hot-swapping of removable drives containing gcrypt repositories.
  • list: New command, displays a compact table of remotes that contain files. (Thanks, anarcat for display code and mastensg for inspiration.)
  • fsck: Fix detection and fixing of present direct mode files that are wrongly represented as standin symlinks on crippled filesystems.
  • sync: Fix bug that caused direct mode mappings to not be updated when merging files into the tree on Windows.
  • sync: Don't fail if the directory it is run in gets removed by the sync.
  • addurl: Fix quvi audodetection, broken in last release.
  • status: In local mode, displays information about variance from configured numcopies levels. (--fast avoids calculating these)
  • gcrypt: Ensure that signing key is set to one of the participants keys.
  • webapp: Show encryption information when editing a remote.
  • Avoid unnecessarily catting non-symlink files from git, which can be so large it runs out of memory.

-- Joey Hess joeyh@debian.org Fri, 20 Sep 2013 10:34:51 -0400

git-annex (4.20130911) unstable; urgency=low

  • Fix problem with test suite in non-unicode locale.

-- Joey Hess joeyh@debian.org Wed, 11 Sep 2013 12:14:16 -0400

git-annex (4.20130909) unstable; urgency=low

  • initremote: Syntax change when setting up an encrypted special remote. Now use keyid=\(KEYID rather than the old encryption=\)KEYID
  • forget: New command, causes git-annex branch history to be forgotten in a way that will spread to other clones of the repository. (As long as they're running this version or newer of git-annex.)
  • forget --drop-dead: Completely removes mentions of repositories that have been marked as dead from the git-annex branch.
  • sync, assistant: Force push of the git-annex branch. Necessary to ensure it gets pushed to remotes after being rewritten by forget.
  • Added gcrypt support. This combines a fully encrypted git repository (using git-remote-gcrypt) with an encrypted git-annex special remote.
  • sync: Support syncing with gcrypt remotes.
  • importfeed: Also ignore transient problems with downloading content from feeds.
  • Honor core.sharedrepository when receiving and adding files in direct mode.
  • enableremote: gpg keys can be removed from those a remote encrypts to by passing "keyid-=$KEYID". keyid+= is also provided. (Thanks, guilhem for the patch.)
  • Added encryption=pubkey scheme, which encrypts to public keys directly rather than the hybrid approach. See documentation for advantages and disadvantages, but encryption=hybrid is the recommended scheme still. (Thanks, guilhem for the patch.)
  • Fix Feeds display in build flags.
  • Remind user when annex-ignore is set for some remotes, if unable to get or drop a file, possibly because it's on an ignored remote.
  • gpg: Force --no-textmode in case the user has it turned on in config.
  • webapp: Improve javascript's handling of longpolling connection failures, by reloading the current page in this case. Works around chromium behavior where ajax connections to urls that were already accessed are denied after navigating back to a previous page.
  • Allow building without quvi support.

-- Joey Hess joeyh@debian.org Mon, 09 Sep 2013 09:47:02 -0400

git-annex (4.20130827) unstable; urgency=low

  • Youtube support! (And 53 other video hosts). When quvi is installed, git-annex addurl automatically uses it to detect when an page is a video, and downloads the video file.
  • web special remote: Also support using quvi, for getting files, or checking if files exist in the web.
  • unused: Is now a minimum of 30 times faster, and typically many more times than that (when a repository has several branches). (Thanks, guilhem for the patch.)
  • unused: Fix bugs in two edge cases involving manually staged changes. (Thanks, guilhem for the patch.)
  • Android: Fix bug in terminal app that caused it to spin using much CPU and battery. This problem was introduced in version 4.20130601.
  • sync, merge: Bug fix: Don't try to merge into master when in a bare repo.
  • import: Add options to control handling of duplicate files: --duplicate, --deduplicate, and --clean-duplicates
  • mirror: New command, makes two repositories contain the same set of files.
  • Set --clobber when running wget to ensure resuming works properly.
  • Unescape characters in 'file://...' URIs. (Thanks, guilhem for the patch.)
  • Better error message when trying to use a git remote that has annex.ignore set.
  • Fix bug that caused typechanged symlinks to be assumed to be unlocked files, so they were added to the annex by the pre-commit hook.
  • Debian: Run the builtin test suite as an autopkgtest.
  • Debian: Recommend ssh-askpass, which ssh will use when the assistant is run w/o a tty. Closes: #719832

-- Joey Hess joeyh@debian.org Tue, 27 Aug 2013 11:03:00 -0400

git-annex (4.20130815) unstable; urgency=low

  • assistant, watcher: .gitignore files and other git ignores are now honored, when git 1.8.4 or newer is installed. (Thanks, Adam Spiers, for getting the necessary support into git for this.)
  • importfeed: Ignores transient problems with feeds. Only exits nonzero when a feed has repeatedly had a problems for at least 1 day.
  • importfeed: Fix handling of dots in extensions.
  • Windows: Added support for encrypted special remotes.
  • Windows: Fixed permissions problem that prevented removing files from directory special remote. Directory special remotes now fully usable.

-- Joey Hess joeyh@debian.org Thu, 15 Aug 2013 10:14:33 +0200

git-annex (4.20130802) unstable; urgency=low

  • dropunused behavior change: Now refuses to drop the last copy of a file, unless you use the --force. This was the last place in git-annex that could remove data referred to by the git history, without being forced. Like drop, dropunused checks remotes, and honors the global annex.numcopies setting. (However, .gitattributes settings cannot apply to unused files.)
  • Fix inverted logic in last release's fix for data loss bug, that caused git-annex sync on FAT or other crippled filesystems to add symlink standin files to the annex.
  • importfeed can be used to import files from podcast feeds.
  • webapp: When setting up a dedicated ssh key to access the annex on a host, set IdentitiesOnly to prevent the ssh-agent from forcing use of a different ssh key. That could result in unncessary password prompts, or prevent git-annex-shell from being run on the remote host.
  • webapp: Improve handling of remotes whose setup has stalled.
  • Add status message to XMPP presence tag, to identify to others that the client is a git-annex client. Closes: #717652
  • webapp: When creating a repository on a removable drive, set core.fsyncobjectfiles, to help prevent data loss when the drive is yanked.
  • Always build with -threaded, to avoid a deadlock when communicating with gpg.
  • unused: No longer shows as unused tmp files that are actively being transferred.
  • assistant: Fix NetWatcher to not sync with remotes that have remote..annex-sync set to false.
  • assistant: Fix deadlock that could occur when adding a lot of files at once in indirect mode.
  • assistant: Fix bug that caused it to stall when adding a very large number of files at once (around 5 thousand).
  • OSX: Make git-annex-webapp run in the background, so that the app icon can be clicked on the open a new webapp when the assistant is already running.
  • Improve test suite on Windows; now tests git annex sync.
  • Fix a few bugs involving filenames that are at or near the filesystem's maximum filename length limit.
  • find: Avoid polluting stdout with progress messages. Closes: #718186
  • Escape ':' in file/directory names to avoid it being treated as a pathspec by some git commands. Closes: #718185
  • Slow and ugly work around for bug #718517 in git 1.8.4~rc0, which broke git-cat-file --batch for filenames containing spaces. (Will be reverted after next git pre-release fixes the problem.)

-- Joey Hess joeyh@debian.org Fri, 02 Aug 2013 11:35:16 -0400

git-annex (4.20130723) unstable; urgency=low

  • Fix data loss bug when adding an (uncompressed) tarball of a git-annex repository, or other file that begins with something that can be mistaken for a git-annex link. Closes: #717456
  • New improved version of the git-annex logo, contributed by John Lawrence.
  • Rsync.net have committed to support git-annex and offer a special discounted rate for git-annex users. Updated the webapp to reflect this. http://www.rsync.net/products/git-annex-pricing.html
  • Install XDG desktop icon files.
  • Support unannex and uninit in direct mode.
  • Support import in direct mode.
  • webapp: Better display of added files.
  • fix: Preserve the original mtime of fixed symlinks.
  • uninit: Preserve .git/annex/objects at the end, if it still has content, so that old versions of files and deleted files are not deleted. Print a message with some suggested actions.
  • When a transfer is already being run by another process, proceed on to the next file, rather than dying.
  • Fix checking when content is present in a non-bare repository accessed via http.
  • Display byte sizes with more precision.
  • watcher: Fixed a crash that could occur when a directory was renamed or deleted before it could be scanned.
  • watcher: Partially worked around a bug in hinotify, no longer crashes if hinotify cannot process a directory (but can't detect changes in it)
  • directory special remote: Fix checking that there is enough disk space to hold an object, was broken when using encryption.
  • webapp: Differentiate between creating a new S3/Glacier/WebDav remote, and initializing an existing remote. When creating a new remote, avoid conflicts with other existing (or deleted) remotes with the same name.
  • When an XMPP server has SRV records, try them, but don't then fall back to the regular host if they all fail.
  • For long hostnames, use a hash of the hostname to generate the socket file for ssh connection caching.

-- Joey Hess joeyh@debian.org Tue, 23 Jul 2013 10:46:05 -0400

git-annex (4.20130709) unstable; urgency=low

  • --all: New switch that makes git-annex operate on all data stored in the git annex, including old versions of files. Supported by fsck, get, move, copy.
  • --unused: New switch that makes git-annex operate on all data found by the last run of git annex unused. Supported by fsck, move, copy.
  • get, move, copy: Can now be run in a bare repository, like fsck already could. --all is enabled automatically in this case.
  • merge: Now also merges synced/master or similar branches, which makes it useful to put in a post-receive hook to make a repository automatically update its working copy when git annex sync or the assistant sync with it.
  • webapp: Fix ssh setup with nonstandard port, broken in last release.
  • init: Detect systems on which git commit fails due to not being able to determine the FQDN, and put in a workaround so committing to the git-annex branch works.
  • addurl --pathdepth: Fix failure when the pathdepth specified is deeper than the urls's path.
  • Windows: Look for .exe extension when searching for a command in path.
  • Pass -f to curl when downloading a file with it, so it propigates failure.
  • Windows: Fix url to object when using a http remote.
  • webapp: Fix authorized_keys line added when setting up a rsync remote on a server that also supports git-annex, to not force running git-annex-shell.
  • OSX Mountain Lion: Fixed gpg bundled in dmg to not fail due to a missing gpg-agent.
  • Android: gpg is built without --enable-minimal, so it interoperates better with other gpg builds that may default to using other algorithms for encryption.
  • dropunused, addunused: Complain when asked to operate on a number that does not correspond to any unused key.
  • fsck: Don't claim to fix direct mode when run on a symlink whose content is not present.
  • Make --numcopies override annex.numcopies set in .gitattributes.

-- Joey Hess joeyh@debian.org Tue, 09 Jul 2013 13:55:39 -0400

git-annex (4.20130627) unstable; urgency=low

  • assistant --autostart: Automatically ionices the daemons it starts.
  • assistant: Daily sanity check thread is run niced.
  • bup: Handle /~/ in bup remote paths. Thanks, Oliver Matthews
  • fsck: Ensures that direct mode is used for files when it's enabled.
  • webapp: Fix bug when setting up a remote ssh repo repeatedly on the same server.
  • webapp: Ensure that ssh keys generated for different directories on a server are always different.
  • webapp: Fix bug setting up ssh repo if the user enters "~/" at the start of the path.
  • assistant: Fix bug that prevented adding files written by gnucash, and more generally support adding hard links to files. However, other operations on hard links are still unsupported.
  • webapp: Fix bug that caused the webapp to hang when built with yesod 1.2.

-- Joey Hess joeyh@debian.org Thu, 27 Jun 2013 14:21:55 -0400

git-annex (4.20130621) unstable; urgency=low

  • Supports indirect mode on encfs in paranoia mode, and other filesystems that do not support hard links, but do support symlinks and other POSIX filesystem features.
  • Android: Add .thumbnails to .gitignore when setting up a camera repository.
  • Android: Make the "Open webapp" menu item open the just created repository when a new repo is made.
  • webapp: When the user switches to display a different repository, that repository becomes the default repository to be displayed next time the webapp gets started.
  • glacier: Better handling of the glacier inventory, which avoids duplicate uploads to the same glacier repository by git annex copy.
  • Direct mode: No longer temporarily remove write permission bit of files when adding them.
  • sync: Better support for bare git remotes. Now pushes directly to the master branch on such a remote, instead of to synced/master. This makes it easier to clone from a bare git remote that has been populated with git annex sync or by the assistant.
  • Android: Fix use of cp command to not try to use features present only on build system.
  • Windows: Fix hang when adding several files at once.
  • assistant: In direct mode, objects are now only dropped when all associated files are unwanted. This avoids a repreated drop/get loop of a file that has a copy in an archive directory, and a copy not in an archive directory. (Indirect mode still has some buggy behavior in this area, since it does not keep track of associated files.) Closes: #712060
  • status: No longer shows dead repositories.
  • annex.debug can now be set to enable debug logging by default. The webapp's debugging check box does this.
  • fsck: Avoid getting confused by Windows path separators
  • Windows: Multiple bug fixes, including fixing the data written to the git-annex branch.
  • Windows: The test suite now passes on Windows (a few broken parts are disabled).
  • assistant: On Linux, the expensive transfer scan is run niced.
  • Enable assistant and WebDAV support on powerpc and sparc architectures, which now have the necessary dependencies built.

-- Joey Hess joeyh@debian.org Fri, 21 Jun 2013 10:18:41 -0400

git-annex (4.20130601) unstable; urgency=medium

  • XMPP: Git push over xmpp made much more robust.
  • XMPP: Avoid redundant and unncessary pushes. Note that this breaks compatibility with previous versions of git-annex, which will refuse to accept any XMPP pushes from this version.
  • XMPP: Send pings and use them to detect when contact with the server is lost.
  • hook special remote: Added combined hook program support.
  • Android app: Avoid using hard links to app's lib directory, which is sometimes on a different filesystem than the data directory.
  • Fix bug in parsing of parens in some preferred content expressions. This fixes the behavior of the manual mode group.
  • assistant: Work around git-cat-file's not reloading the index after files are staged.
  • Improve error handling when getting uuid of http remotes to auto-ignore, like with ssh remotes.
  • content: New command line way to view and configure a repository's preferred content settings.
  • sync: Fix double merge conflict resolution handling.
  • XMPP: Fix a file descriptor leak.
  • Android: Added an "Open WebApp" item to the terminal's menu.
  • Android: Work around Android devices where the am command doesn't work.
  • Can now restart certain long-running git processes if they crash, and continue working.

-- Joey Hess joeyh@debian.org Sat, 01 Jun 2013 19:16:04 -0400

git-annex (4.20130521) unstable; urgency=low

  • Sanitize debian changelog version before putting it into cabal file. Closes: #708619
  • Switch to MonadCatchIO-transformers for better handling of state while catching exceptions.
  • Fix a zombie that could result when running a process like gpg to read and write to it.
  • Allow building with gpg2.
  • Disable building with the haskell threaded runtime when the webapp is not built. This may fix builds on mips, s390x and sparc, which are failing to link -lHSrts_thr
  • Temporarily build without webapp on kfreebsd-i386, until yesod is installable there again.
  • Direct mode bug fix: After a conflicted merge was automatically resolved, the content of a file that was already present could incorrectly be replaced with a symlink.
  • Fix a bug in the git-annex branch handling code that could cause info from a remote to not be merged and take effect immediately.
  • Direct mode is now fully tested by the test suite.
  • Detect bad content in ~/.config/git-annex/program and look in PATH instead.
  • OSX: Fixed gpg included in dmg.
  • Linux standalone: Back to being built with glibc 2.13 for maximum portability.

-- Joey Hess joeyh@debian.org Tue, 21 May 2013 13:10:26 -0400

git-annex (4.20130516) unstable; urgency=low

  • Android: The webapp is ported and working.
  • Windows: There is a very rough Windows port. Do not trust it with important data.
  • git-annex-shell: Ensure that received files can be read. Files transferred from some Android devices may have very broken permissions as received.
  • direct mode: Direct mode commands now work on files staged in the index, they do not need to be committed to git.
  • Temporarily add an upper bound to the version of yesod that can be built with, since yesod 1.2 has a great many changes that will require extensive work on the webapp.
  • Disable building with the haskell threaded runtime when the assistant is not built. This may fix builds on s390x and sparc, which are failing to link -lHSrts_thr
  • Avoid depending on regex-tdfa on mips, mipsel, and s390, where it fails to build.
  • direct: Fix a bug that could cause some files to be left in indirect mode.
  • When initializing a directory special remote with a relative path, the path is made absolute.
  • SHA: Add a runtime sanity check that sha commands output something that appears to be a real sha.
  • configure: Better checking that sha commands output in the desired format.
  • rsync special remotes: When sending from a crippled filesystem, use the destination's default file permissions, as the local ones can be arbitrarily broken. (Ie, ----rwxr-x for files on Android)
  • migrate: Detect if a file gets corrupted while it's being migrated.
  • Debian: Add a menu file.

-- Joey Hess joeyh@debian.org Thu, 16 May 2013 11:03:35 -0400

git-annex (4.20130501) unstable; urgency=low

  • sync, assistant: Behavior changes: Sync with remotes that have annex-ignore set, so that git remotes on servers without git-annex installed can be used to keep clients' git repos in sync.
  • assistant: Work around misfeature in git 1.8.2 that makes git commit --alow-empty -m "" run an editor.
  • sync: Bug fix, avoid adding to the annex the dummy symlinks used on crippled filesystems.
  • Add public repository group. (And inpreferreddir to preferred content expressions.)
  • webapp: Can now set up Internet Archive repositories.
  • S3: Dropping content from the Internet Archive doesn't work, but their API indicates it does. Always refuse to drop from there.
  • Automatically register public urls for files uploaded to the Internet Archive.
  • To enable an existing special remote, the new enableremote command must be used. The initremote command now is used only to create new special remotes.
  • initremote: If two existing remotes have the same name, prefer the one with a higher trust level.
  • assistant: Improved XMPP protocol to better support multiple repositories using the same XMPP account. Fixes bad behavior when sharing with a friend when you or the friend have multiple reposotories on an XMPP account. Note that XMPP pairing with your own devices still pairs with all repositories using your XMPP account.
  • assistant: Fix bug that could cause incoming pushes to not get merged into the local tree. Particularly affected XMPP pushes.
  • webapp: Display some additional information about a repository on its edit page.
  • webapp: Install FDO desktop menu file when started in standalone mode.
  • webapp: Don't default to making repository in cwd when started from within a directory containing a git-annex file (eg, standalone tarball directory).
  • Detect systems that have no user name set in GECOS, and also don't have user.name set in git config, and put in a workaround so that commits to the git-annex branch (and the assistant) will still succeed despite git not liking the system configuration.
  • webapp: When told to add a git repository on a remote server, and the repository already exists as a non-bare repository, use it, rather than initializing a bare repository in the same directory.
  • direct, indirect: Refuse to do anything when the assistant or git-annex watch daemon is running.
  • assistant: When built with git before 1.8.0, use git remote rm to delete a remote. Newer git uses git remote remove.
  • rmurl: New command, removes one of the recorded urls for a file.
  • Detect when the remote is broken like bitbucket is, and exits 0 when it fails to run git-annex-shell.
  • assistant: Several improvements to performance and behavior when performing bulk adds of a large number of files (tens to hundreds of thousands).
  • assistant: Sanitize XMPP presence information logged for debugging.
  • webapp: Now automatically fills in any creds used by an existing remote when creating a new remote of the same type. Done for Internet Archive, S3, Glacier, and Box.com remotes.
  • Store an annex-uuid file in the bucket when setting up a new S3 remote.
  • Support building with DAV 0.4.

-- Joey Hess joeyh@debian.org Wed, 01 May 2013 01:42:46 -0400

git-annex (4.20130417) unstable; urgency=low

  • initremote: Generates encryption keys with high quality entropy. This can be disabled using --fast to get the old behavior. The assistant still uses low-quality entropy when creating encrypted remotes, to avoid delays. (Thanks, guilhem for the patch.)
  • Bugfix: Direct mode no longer repeatedly checksums duplicated files.
  • assistant: Work around horrible, terrible, very bad behavior of gnome-keyring, by not storing special-purpose ssh keys in ~/.ssh/*.pub. Apparently gnome-keyring apparently will load and indiscriminately use such keys in some cases, even if they are not using any of the standard ssh key names. Instead store the keys in ~/.ssh/annex/, which gnome-keyring will not check.
  • addurl: Bugfix: Did not properly add file in direct mode.
  • assistant: Bug fix to avoid annexing the files that git uses to stand in for symlinks on FAT and other filesystem not supporting symlinks.
  • Adjust preferred content expressions so that content in archive directories is preferred until it has reached an archive or smallarchive repository.
  • webapp: New --listen= option allows running the webapp on one computer and connecting to it from another. (Note: Does not yet use HTTPS.)
  • Added annex.web-download-command setting.
  • Added per-remote annex-rsync-transport option. (guilhem again)
  • Ssh connection caching is now also used by rsync special remotes. (guilhem yet again)
  • The version number is now derived from git, unless built with VERSION_FROM_CHANGELOG.
  • assistant: Stop any transfers the assistant initiated on shutdown.
  • assistant: Added sequence numbers to XMPP git push packets. (Not yet used.)
  • addurl: Register transfer so the webapp can see it.
  • addurl: Automatically retry downloads that fail, as long as some additional content was downloaded.
  • webapp: Much improved progress bar display for downloads from encrypted remotes.
  • Avoid using runghc, as that needs ghci.
  • webapp: When a repository's group is changed, rescan for transfers.
  • webapp: Added animations.
  • webapp: Include the repository directory in the mangled hostname and ssh key name, so that a locked down ssh key for one repository is not re-used when setting up additional repositories on the same server.
  • Fall back to internal url downloader when built without curl.
  • fsck: Check content of direct mode files (only when the inode cache thinks they are unmodified).

-- Joey Hess joeyh@debian.org Wed, 17 Apr 2013 09:07:38 -0400

git-annex (4.20130405) unstable; urgency=low

  • Group subcommands into sections in usage. Closes: #703797
  • Per-command usage messages.
  • webapp: Fix a race that sometimes caused alerts or other notifications to be missed if they occurred while a page was loading.
  • webapp: Progess bar fixes for many types of special remotes.
  • Build debian package without using cabal, which writes to HOME. Closes: #704205
  • webapp: Run ssh server probes in a way that will work when the login shell is a monstrosity that should have died 25 years ago, such as csh.
  • New annex.largefiles setting, which configures which files git annex add and the assistant add to the annex.
  • assistant: Check small files into git directly.
  • Remotes can be configured to use other MAC algorithms than HMACSHA1 to encrypt filenames. Thanks, guilhem for the patch.
  • git-annex-shell: Passes rsync --bwlimit options on rsync. Thanks, guilhem for the patch.
  • webapp: Added UI to delete repositories. Closes: #689847
  • Adjust built-in preferred content expressions to make most types of repositories want content that is only located on untrusted, dead, and unwanted repositories.
  • drop --auto: Fix bug that prevented dropping files from untrusted repositories.
  • assistant: Fix bug that could cause direct mode files to be unstaged from git.
  • Update working tree files fully atomically.
  • webapp: Improved transfer queue management.
  • init: Probe whether the filesystem supports fifos, and if not, disable ssh connection caching.
  • Use lower case hash directories for storing files on crippled filesystems, same as is already done for bare repositories.

-- Joey Hess joeyh@debian.org Fri, 05 Apr 2013 10:42:18 -0400

git-annex (4.20130323) unstable; urgency=low

  • webapp: Repository list is now included in the dashboard, and other UI tweaks.
  • webapp: Improved UI for pairing your own devices together using XMPP.
  • webapp: Display an alert when there are XMPP remotes, and a cloud transfer repository needs to be configured.
  • Add incrementalbackup repository group.
  • webapp: Encourage user to install git-annex on a server when adding a ssh server, rather than just funneling them through to rsync.
  • xmpp: --debug now enables a sanitized dump of the XMPP protocol
  • xmpp: Try harder to detect presence of clients when there's a git push to send.
  • xmpp: Re-enable XA flag, since disabling it did not turn out to help with the problems Google Talk has with not always sending presence messages to clients.
  • map: Combine duplicate repositories, for a nicer looking map.
  • Fix several bugs caused by a bad Ord instance for Remote.
  • webapp: Switch all forms to POST.
  • assistant: Avoid syncing with annex-ignored remotes when reconnecting to the network, or connecting a drive.
  • assistant: Fix OSX bug that prevented committing changed files to a repository when in indirect mode.
  • webapp: Improved alerts displayed when syncing with remotes, and when syncing with a remote fails.
  • webapp: Force wrap long filenames in transfer display.
  • assistant: The ConfigMonitor left one zombie behind each time it checked for changes, now fixed.
  • get, copy, move: Display an error message when an identical transfer is already in progress, rather than failing with no indication why.
  • assistant: Several optimisations to file transfers.
  • OSX app and standalone Linux tarball now both support being added to PATH; no need to use runshell to start git-annex.
  • webapp: When adding a removable drive, you can now specify the directory inside it to use.
  • webapp: Confirm whether user wants to combine repositories when adding a removable drive that already has a repository on it.

-- Joey Hess joeyh@debian.org Fri, 22 Mar 2013 18:54:05 -0400

git-annex (4.20130314) unstable; urgency=low

  • Bugfix: git annex add, when ran without any file or directory specified, should add files in the current directory, but not act on unlocked files elsewhere in the tree.

  • Bugfix: drop --from an unavailable remote no longer updates the location log, incorrectly, to say the remote does not have the key.

  • Bugfix: If the UUID of a remote is not known, prevent --from, --to, and other ways of specifying remotes by name from selecting it, since it is not possible to sanely use it.

  • Bugfix: Fix bug in inode cache sentinal check, which broke copying to local repos if the repo being copied from had moved to a different filesystem or otherwise changed all its inodes

  • Switch from using regex-compat to regex-tdfa, as the C regex library is rather buggy.

  • status: Can now be run with a directory path to show only the status of that directory, rather than the whole annex.

  • Added remote..annex-gnupg-options setting. Thanks, guilhem for the patch.

  • addurl: Add --relaxed option.

  • addurl: Escape invalid characters in urls, rather than failing to use an invalid url.

  • addurl: Properly handle url-escaped characters in file:// urls.

  • assistant: Fix dropping content when a file is moved to an archive directory, and getting contennt when a file is moved back out.

  • assistant: Fix bug in direct mode that could occur when a symlink is moved out of an archive directory, and resulted in the file not being set to direct mode when it was transferred.

  • assistant: Generate better commits for renames.

  • assistant: Logs are rotated to avoid them using too much disk space.

  • assistant: Avoid noise in logs from git commit about typechanged files in direct mode repositories.

  • assistant: Set gc.auto=0 when creating repositories to prevent automatic commits from causing git-gc runs.

  • assistant: If gc.auto=0, run git-gc once a day, packing loose objects very non-aggressively.

  • assistant: XMPP git pull and push requests are cached and sent when presence of a new client is detected.

  • assistant: Sync with all git remotes on startup.

  • assistant: Get back in sync with XMPP remotes after network reconnection, and on startup.

  • assistant: Fix syncing after XMPP pairing.

  • assistant: Optimised handling of renamed files in direct mode, avoiding re-checksumming.

  • assistant: Detects most renames, including directory renames, and combines all their changes into a single commit.

  • assistant: Fix ~/.ssh/git-annex-shell wrapper to work when the ssh key does not force a command.

  • assistant: Be smarter about avoiding unncessary transfers.

  • webapp: Work around bug in Warp's slowloris attack prevention code, that caused regular browsers to stall when they reuse a connection after leaving it idle for 30 seconds. (See https://github.com/yesodweb/wai/issues/146)

  • webapp: New preferences page allows enabling/disabling debug logging at runtime, as well as configuring numcopies and diskreserve.

  • webapp: Repository costs can be configured by dragging repositories around in the repository list.

  • webapp: Proceed automatically on from "Configure jabber account" to pairing.

  • webapp: Only show up to 10 queued transfers.

  • webapp: DTRT when told to create a git repo that already exists.

  • webapp: Set locally paired repositories to a lower cost than other network remotes.

  • Run ssh with -T to avoid tty allocation and any login scripts that may do undesired things with it.

  • Several improvements to Makefile and cabal file. Thanks, Peter Simmons

  • Stop depending on testpack.

  • Android: Enable test suite.

-- Joey Hess joeyh@debian.org Thu, 14 Mar 2013 15:29:20 -0400

git-annex (4.20130227) unstable; urgency=low

  • annex.version is now set to 4 for direct mode repositories.
  • Should now fully support git repositories with core.symlinks=false; always using git's pseudosymlink files in such repositories.
  • webapp: Allow creating repositories on filesystems that lack support for symlinks.
  • webapp: Can now add a new local repository, and make it sync with the main local repository.
  • Android: Bundle now includes openssh.
  • Android: Support ssh connection caching.
  • Android: Assistant is fully working. (But no webapp yet.)
  • Direct mode: Support filesystems like FAT which can change their inodes each time they are mounted.
  • Direct mode: Fix support for adding a modified file.
  • Avoid passing -p to rsync, to interoperate with crippled filesystems. Closes: #700282
  • Additional GIT_DIR support bugfixes. May actually work now.
  • webapp: Display any error message from git init if it fails to create a repository.
  • Fix a reversion in matching globs introduced in the last release, where "*" did not match files inside subdirectories. No longer uses the Glob library.
  • copy: Update location log when no copy was performed, if the location log was out of date.
  • Makefile now builds using cabal, taking advantage of cabal's automatic detection of appropriate build flags.
  • test: The test suite is now built into the git-annex binary, and can be run at any time.

-- Joey Hess joeyh@debian.org Wed, 27 Feb 2013 14:07:24 -0400

git-annex (3.20130216) unstable; urgency=low

  • Now uses the Haskell uuid library, rather than needing a uuid program.
  • Now uses the Haskell Glob library, rather than pcre-light, avoiding the need to install libpcre. Currently done only for Cabal or when the Makefile is made to use -DWITH_GLOB
  • Android port now available (command-line only).
  • New annex.crippledfilesystem setting, allows use of git-annex repositories on FAT and even worse filesystems; avoiding use of hard links and locked down permissions settings. (Support is incomplete.)
  • init: Detect when the repository is on a filesystem that does not support hard links, or symlinks, or unix permissions, and set annex.crippledfilesystem, as well as annex.direct.
  • add: Improved detection of files that are modified while being added.
  • Fix a bug in direct mode, introduced in the previous release, where if a file was dropped and then got back, it would be stored in indirect mode.

-- Joey Hess joeyh@debian.org Sat, 16 Feb 2013 10:03:26 -0400

git-annex (3.20130207) unstable; urgency=low

  • webapp: Now allows restarting any threads that crash.
  • Adjust debian package to only build-depend on DAV on architectures where it is available.
  • addurl --fast: Use curl, rather than haskell HTTP library, to support https.
  • annex.autocommit: New setting, can be used to disable autocommit of changed files by the assistant, while it still does data syncing and other tasks.
  • assistant: Ignore .DS_Store on OSX.
  • assistant: Fix location log when adding new file in direct mode.
  • Deal with stale mappings for deleted file in direct mode.
  • pre-commit: Update direct mode mappings.
  • uninit, unannex --fast: If hard link creation fails, fall back to slow mode.
  • Clean up direct mode cache and mapping info when dropping keys.
  • dropunused: Clean up stale direct mode cache and mapping info not removed before.

-- Joey Hess joeyh@debian.org Thu, 07 Feb 2013 12:45:25 -0400

git-annex (3.20130124) unstable; urgency=low

  • Added source repository group, that only retains files until they've been transferred to another repository. Useful for things like repositories on cameras.
  • Added manual repository group. Use to prevent the assistant from downloading any file contents to keep things in sync. Instead git annex get, git annex drop etc can be used manually as desired.
  • webapp: More adjustments to longpoll code to deal with changes in variable quoting in different versions of shakespeare-js.
  • webapp: Avoid an error if a transfer is stopped just as it finishes. Closes: #698184
  • webapp: Now always logs to .git/annex/daemon.log
  • webapp: Has a page to view the log, accessed from the control menu.
  • webapp: Fix crash adding removable drive that has an annex directory in it that is not a git repository.
  • Deal with incompatability in gpg2, which caused prompts for encryption passphrases rather than using the supplied --passphrase-fd.
  • bugfix: Union merges involving two or more repositories could sometimes result in data from one repository getting lost. This could result in the location log data becoming wrong, and fsck being needed to fix it.
  • sync: Automatic merge conflict resolution now stages deleted files.
  • Depend on git 1.7.7.6 for --no-edit. Closes: #698399
  • Fix direct mode mapping code to always store direct mode filenames relative to the top of the repository, even when operating inside a subdirectory.
  • fsck: Detect and fix consistency errors in direct mode mapping files.
  • Avoid filename encoding errors when writing direct mode mappings.

-- Joey Hess joeyh@debian.org Tue, 22 Jan 2013 07:11:59 +1100

git-annex (3.20130114) unstable; urgency=low

  • Now handles the case where a file that's being transferred to a remote is modified in place, which direct mode allows. When this happens, the transfer now fails, rather than allow possibly corrupt data into the remote.
  • fsck: Better checking of file content in direct mode.
  • drop: Suggest using git annex move when numcopies prevents dropping a file.
  • webapp: Repo switcher filters out repos that do not exist any more (or are on a drive that's not mounted).
  • webapp: Use IP address, rather than localhost, since some systems may have configuration problems or other issues that prevent web browsers from connecting to the right localhost IP for the webapp.
  • webapp: Adjust longpoll code to work with recent versions of shakespeare-js.
  • assistant: Support new gvfs dbus names used in Gnome 3.6.
  • In direct mode, files with the same key are no longer hardlinked, as that would cause a surprising behavior if modifying one, where the other would also change.
  • webapp: Avoid illegal characters in hostname when creating S3 or Glacier remote.
  • assistant: Avoid committer crashing if a file is deleted at the wrong instant.

-- Joey Hess joeyh@debian.org Mon, 14 Jan 2013 15:25:18 -0400

git-annex (3.20130107) unstable; urgency=low

  • webapp: Add UI to stop and restart assistant.
  • committer: Fix a file handle leak.
  • assistant: Make expensive transfer scan work fully in direct mode.
  • More commands work in direct mode repositories: find, whereis, move, copy, drop, log, fsck, add, addurl.
  • sync: No longer automatically adds files in direct mode.
  • assistant: Detect when system is not configured with a user name, and set environment to prevent git from failing.
  • direct: Avoid hardlinking symlinks that point to the same content when the content is not present.
  • Fix transferring files to special remotes in direct mode.

-- Joey Hess joeyh@debian.org Mon, 07 Jan 2013 01:01:41 -0400

git-annex (3.20130102) unstable; urgency=low

  • direct, indirect: New commands, that switch a repository to and from direct mode. In direct mode, files are accessed directly, rather than via symlinks. Note that direct mode is currently experimental. Many git-annex commands do not work in direct mode. Some git commands can cause data loss when used in direct mode repositories.
  • assistant: Now uses direct mode by default when setting up a new local repository.
  • OSX assistant: Uses the FSEvents API to detect file changes. This avoids issues with running out of file descriptors on large trees, as well as allowing detection of modification of files in direct mode. Other BSD systems still use kqueue.
  • kqueue: Fix bug that made broken symlinks not be noticed.
  • vicfg: Quote filename. Closes: #696193
  • Bugfix: Fixed bug parsing transfer info files, where the newline after the filename was included in it. This was generally benign, but in the assistant, it caused unexpected dropping of preferred content.
  • Bugfix: Remove leading \ from checksums output by sha*sum commands, when the filename contains \ or a newline. Closes: #696384
  • fsck: Still accept checksums with a leading \ as valid, now that above bug is fixed.
  • SHA*E backends: Exclude non-alphanumeric characters from extensions.
  • migrate: Remove leading \ in SHA* checksums, and non-alphanumerics from extensions of SHA*E keys.

-- Joey Hess joeyh@debian.org Wed, 02 Jan 2013 13:21:34 -0400

git-annex (3.20121211) unstable; urgency=low

  • webapp: Defaults to sharing box.com account info with friends, allowing one-click enabling of the repository.
  • Fix broken .config/git-annex/program installed by standalone tarball.
  • assistant: Retrival from glacier now handled.
  • Include ssh in standalone tarball and OSX app.
  • watch: Avoid leaving hard links to files behind in .git/annex/tmp if a file is deleted or moved while it's being quarantined in preparation to being added to the annex.
  • Allow git annex drop --from web; of course this does not remove any file from the web, but it does make git-annex remove all urls associated with a file.
  • webapp: S3 and Glacier forms now have a select list of all currently-supported AWS regions.
  • webdav: Avoid trying to set props, avoiding incompatability with livedrive.com. Needs DAV version 0.3.
  • webapp: Prettify error display.
  • webapp: Fix bad interaction between required fields and modals.
  • webapp: Added help buttons and links next to fields that require explanations.
  • webapp: Encryption can be disabled when setting up remotes.
  • assistant: Avoid trying to drop content from remotes that don't have it.
  • assistant: Allow periods in ssh key comments.
  • get/copy --auto: Transfer data even if it would exceed numcopies, when preferred content settings want it.
  • drop --auto: Fix dropping content when there are no preferred content settings.
  • webapp: Allow user to specify the port when setting up a ssh or rsync remote.
  • assistant: Fix syncing to just created ssh remotes.
  • Enable WebDAV support in Debian package. Closes: #695532

-- Joey Hess joeyh@debian.org Tue, 11 Dec 2012 11:25:03 -0400

git-annex (3.20121127) unstable; urgency=low

  • Fix dirContentsRecursive, which had missed some files in deeply nested subdirectories. Could affect various parts of git-annex.
  • rsync: Fix bug introduced in last release that broke encrypted rsync special remotes.
  • The standalone builds now unset their special path and library path variables before running the system web browser.

-- Joey Hess joeyh@debian.org Tue, 27 Nov 2012 17:07:32 -0400

git-annex (3.20121126) unstable; urgency=low

  • New webdav and Amazon glacier special remotes.
  • Display a warning when a non-existing file or directory is specified.
  • webapp: Added configurator for Box.com.
  • webapp: Show error messages to user when testing XMPP creds.
  • Fix build of assistant without yesod.
  • webapp: The list of repositiories refreshes when new repositories are added, including when new repository configurations are pushed in from remotes.
  • OSX: Fix RunAtLoad value in plist file.
  • Getting a file from chunked directory special remotes no longer buffers it all in memory.
  • S3: Added progress display for uploading and downloading.
  • directory special remote: Made more efficient and robust.
  • Bugfix: directory special remote could loop forever storing a key when a too small chunksize was configured.
  • Allow controlling whether login credentials for S3 and webdav are committed to the repository, by setting embedcreds=yes|no when running initremote.
  • Added smallarchive repository group, that only archives files that are in archive directories. Used by default for glacier when set up in the webapp.
  • assistant: Fixed handling of toplevel archive directory and client repository group.
  • assistant: Apply preferred content settings when a new symlink is created, or a symlink gets renamed. Made archive directories work.

-- Joey Hess joeyh@debian.org Mon, 26 Nov 2012 11:37:49 -0400

git-annex (3.20121112) unstable; urgency=low

  • assistant: Can use XMPP to notify other nodes about pushes made to other repositories, as well as pushing to them directly over XMPP.
  • wepapp: Added an XMPP configuration interface.
  • webapp: Supports pairing over XMPP, with both friends, and other repos using the same account.
  • assistant: Drops non-preferred content when possible.
  • assistant: Notices, and applies config changes as they are made to the git-annex branch, including config changes pushed in from remotes.
  • git-annex-shell: GIT_ANNEX_SHELL_DIRECTORY can be set to limit it to operating on a specified directory.
  • webapp: When setting up authorized_keys, use GIT_ANNEX_SHELL_DIRECTORY.
  • Preferred content path matching bugfix.
  • Preferred content expressions cannot use "in=".
  • Preferred content expressions can use "present".
  • Fix handling of GIT_DIR when it refers to a git submodule.
  • Depend on and use the Haskell SafeSemaphore library, which provides exception-safe versions of SampleVar and QSemN. Thanks, Ben Gamari for an excellent patch set.
  • file:/// URLs can now be used with the web special remote.
  • webapp: Allow dashes in ssh key comments when pairing.
  • uninit: Check and abort if there are symlinks to annexed content that are not checked into git.
  • webapp: Switched to using the same multicast IP address that avahi uses.
  • bup: Don't pass - to bup-split to make it read stdin; bup 0.25 does not accept that.
  • bugfix: Don't fail transferring content from read-only repos. Closes: #691341
  • configure: Check that checksum programs produce correct checksums.
  • Re-enable dbus, using a new version of the library that fixes the memory leak.
  • NetWatcher: When dbus connection is lost, try to reconnect.
  • Use USER and HOME environment when set, and only fall back to getpwent, which doesn't work with LDAP or NIS.
  • rsync special remote: Include annex-rsync-options when running rsync to test a key's presence.
  • The standalone tarball's runshell now takes care of installing a ~/.ssh/git-annex-shell wrapper the first time it's run.
  • webapp: Make an initial, empty commit so there is a master branch
  • assistant: Fix syncing local drives.
  • webapp: Fix creation of rsync.net repositories.
  • webapp: Fix renaming of special remotes.
  • webapp: Generate better git remote names.
  • webapp: Ensure that rsync special remotes are enabled using the same name they were originally created using.
  • Bugfix: Fix hang in webapp when setting up a ssh remote with an absolute path.

-- Joey Hess joeyh@debian.org Mon, 12 Nov 2012 10:39:47 -0400

git-annex (3.20121017) unstable; urgency=low

  • Fix zombie cleanup reversion introduced in 3.20121009.
  • Additional fix to support git submodules.

-- Joey Hess joeyh@debian.org Tue, 16 Oct 2012 21:10:14 -0400

git-annex (3.20121016) unstable; urgency=low

  • vicfg: New file format, avoids ambiguity with repos that have the same description, or no description.
  • Bug fix: A recent change caused git-annex-shell to crash.
  • Better preferred content expression for transfer repos.
  • webapp: Repository edit form can now edit the name of a repository.
  • webapp: Make bare repositories on removable drives, as there is nothing to ensure non-bare repos get updated when syncing.
  • webapp: Better behavior when pausing syncing to a remote when a transfer scan is running and queueing new transfers for that remote.
  • The standalone binaries are now built to not use ssh connection caching, in order to work with old versions of ssh.
  • A relative core.worktree is relative to the gitdir. Now that this is handled correctly, git-annex can be used in git submodules.
  • Temporarily disable use of dbus, as the haskell dbus library blows up when losing connection, which will need to be fixed upstream.

-- Joey Hess joeyh@debian.org Tue, 16 Oct 2012 15:25:22 -0400

git-annex (3.20121010) unstable; urgency=low

  • Renamed --ingroup to --inallgroup.
  • Standard groups changed to client, transfer, archive, and backup. Each of these has its own standard preferred content setting.
  • dead: Remove dead repository from all groups.
  • Avoid unsetting HOME when running certian git commands. Closes: #690193
  • test: Fix threaded runtime hang.
  • Makefile: Avoid building with -threaded if the ghc threaded runtime does not exist.
  • webapp: Improve wording of intro display. Closes: #689848
  • webapp: Repositories can now be configured, to change their description, their group, or even to disable syncing to them.
  • git config remote.name.annex-sync can be used to control whether a remote gets synced.
  • Fix a crash when merging files in the git-annex branch that contain invalid utf8.
  • Automatically detect when a ssh remote does not have git-annex-shell installed, and set annex-ignore.

-- Joey Hess joeyh@debian.org Fri, 12 Oct 2012 13:45:21 -0400

git-annex (3.20121009) unstable; urgency=low

  • watch, assistant: It's now safe to git annex unlock files while the watcher is running, as well as modify files checked into git as normal files. Additionally, .gitignore settings are now honored. Closes: #689979
  • group, ungroup: N