Changelog of @hackage/git-annex 10.20241202

git-annex (10.20241202) upstream; urgency=medium

add: Consistently treat files in a dotdir as dotfiles, even when ran inside that dotdir.
add: When adding a dotfile as a non-large file, mention that it's a dotfile.
p2phttp: Added --directory option which serves multiple git-annex repositories located inside a directory.
When remote.name.annexUrl is an annex+http(s) url, that uses the same hostname as remote.name.url, which is itself a http(s) url, they are assumed to share a username and password. This avoids unnecessary duplicate password prompts.
git-remote-annex: Fix a reversion introduced in version 10.20241031 that broke cloning from a special remote.
git-remote-annex: Fix cloning from a special remote on a crippled filesystem.
git-remote-annex: Fix buggy behavior when annex.stalldetection is configured.
git-remote-annex: Require git version 2.31 or newer, since old ones had a buggy git bundle command.
S3: Support versioning=yes with a readonly bucket. (Needs aws-0.24.3)
S3: Send git-annex or other configured User-Agent. (Needs aws-0.24.3)
S3: Fix infinite loop and memory blowup when importing from an unversioned S3 bucket that is large enough to need pagination.
S3: Use significantly less memory when importing from a versioned S3 bucket.
vpop: Only update state after successful checkout.

-- Joey Hess id@joeyh.name Mon, 02 Dec 2024 12:31:08 -0400

git-annex (10.20241031) upstream; urgency=medium

Sped up proxied downloads from special remotes, by streaming.
Added GETORDERED request to external special remote protocol. When the external special remote responds with ORDERED, it can stream through a proxy.
p2phttp: Support serving unauthenticated users while requesting authentication for operations that need it. Eg, --unauth-readonly can be combined with --authenv.
p2phttp: Allow unauthenticated users to lock content by default.
p2phttp: Added --unauth-nolocking option to prevent unauthenticated users from locking content.
Allow enabling the servant build flag with older versions of stm, allowing building with ghc 9.0.2.
git-remote-annex: Fix bug that prevented using it with external special remotes, leading to protocol error messages involving "GITMANIFEST".
adjust: Allow any order of options when combining --hide-missing with options like --unlock.
Support P2P protocol version 4. This allows DATA-PRESENT to be sent after PUT (and in the HTTP P2P protocol, v4/put has a data-present parameter). When used with a proxy to a special remote like a S3 bucket, this allows a custom client to upload content to S3 itself, and then use the P2P protocol to inform the proxy that the content has been stored there, which will result in the same git-annex branch state updates as sending DATA via the proxy.
Fix hang when receiving a large file into a proxied special remote.

-- Joey Hess id@joeyh.name Thu, 31 Oct 2024 17:19:56 -0400

git-annex (10.20240927) upstream; urgency=medium

Detect when a preferred content expression contains "not present", which would lead to repeatedly getting and then dropping files, and make it never match. This also applies to "not balanced" and "not sizebalanced".
Fix --explain display of onlyingroup preferred content expression.
Allow maxsize to be set to 0 to stop checking maxsize for a repository.
Fix bug that prevented anything being stored in an empty repository whose preferred content expression uses sizebalanced.
sim: New command, can be used to simulate networks of repositories and see how preferred content and other configuration makes file content flow through it.

-- Joey Hess id@joeyh.name Mon, 30 Sep 2024 19:15:35 -0400

git-annex (10.20240831) upstream; urgency=medium

Special remotes configured with exporttree=yes annexobjects=yes can store objects in .git/annex/objects, as well as an exported tree.
Support proxying to special remotes configured with exporttree=yes annexobjects=yes, and allow such remotes to be used as cluster nodes.
post-retrieve: When proxying is enabled for an exporttree=yes special remote (or it is a cluster node) and the configured remote.name.annex-tracking-branch is received, the tree is exported to the special remote.
Support "balanced=", "fullybalanced=", "sizebalanced=" and "fullysizebalanced=" in preferred content expressions.
Added --rebalance option.
Added the annex.fullybalancedthreshhold git config.
maxsize: New command to tell git-annex how large the expected maximum size of a repository is, and to display repository sizes.
vicfg: Include maxsize configuration.
info: Improved speed by using new repository size tracking.
lookupkey: Allow using --ref in a bare repository.
export: Added --from option.
git-remote-annex: Store objects in exportree=yes special remotes in the same paths used by annexobjects=yes. This is a backwards compatible change.
updateproxy, updatecluster: Prevent using an exporttree=yes special remote that does not have annexobjects=yes, since it will not work.
The config versioning=true is now reserved for use by versioned special remotes. External special remotes should not use that config for their own purposes.

-- Joey Hess id@joeyh.name Sat, 31 Aug 2024 19:48:17 -0400

git-annex (10.20240808) upstream; urgency=medium

Remove debug output (to stderr) accidentially included in last version.
When getting from a P2P HTTP remote, prompt for credentials when required, instead of failing.
When proxying an upload to a special remote, verify the hash.
Avoid loading cluster log at startup.

-- Joey Hess id@joeyh.name Thu, 08 Aug 2024 15:26:26 -0400

git-annex (10.20240731) upstream; urgency=medium

New HTTP API that is equivilant to the P2P protocol.
New p2phttp command to serve the HTTP API.
annex+http and annex+https urls can be configured for remote.name.annexUrl to use the HTTP API to communicate with a server. This supports writable repositories, as well as accessing clusters and proxied remotes over HTTP.
When a http remote has annex.url set to an annex+http url in the git config file on the website, it will be copied into remote.name.annexUrl the first time git-annex uses the remote.
assistant: Fix a race condition that could cause a pointer file to get ingested into the annex.
Avoid potential data loss in unlikely situations where git-annex-shell or git-annex remotedaemon is killed while locking a key to prevent its removal.
When proxying a download from a special remote, avoid unncessary hashing.
When proxying an upload to a special remote, verify the hash.
Propagate --force to git-annex transferrer.
Added a build flag for servant, enabling annex+http urls and git-annex p2phttp.
Added a dependency on the haskell clock library.
Updated stack.yaml to nightly-2024-07-29.

-- Joey Hess id@joeyh.name Wed, 31 Jul 2024 14:02:21 -0400

git-annex (10.20240701) upstream; urgency=medium

git-annex remotes can now act as proxies that provide access to their remotes. Configure this with remote.name.annex-proxy and the git-annex update proxy command.
Clusters are now supported. These are collections of nodes that can be accessed as a single entity, accessed by one or more gateway repositories.
Added git-annex initcluster, updatecluster, and extendcluster commands.
Fix a bug where interrupting git-annex while it is updating the git-annex branch for an export could later lead to git fsck complaining about missing tree objects.
Tab completion of options like --from now includes special remotes, as well as proxied remotes and clusters.
Tab completion of many commands like info and trust now includes remotes.
P2P protocol version 2.
Fix Windows build with Win32 2.13.4+ Thanks, Oleg Tolmatcev
When --debugfilter or annex.debugfilter is set, avoid propigating debug output from git-annex-shell, since it cannot be filtered.

-- Joey Hess id@joeyh.name Mon, 01 Jul 2024 15:11:48 -0400

git-annex (10.20240531) upstream; urgency=medium

git-remote-annex: New program which allows pushing a git repo to a git-annex special remote, and cloning from a special remote. (Based on Michael Hanke's git-remote-datalad-annex.)
initremote, enableremote: Added --with-url to enable using git-remote-annex.
When building an adjusted unlocked branch, make pointer files executable when the annex object file is executable.
group: Added --list option.
fsck: Fix recent reversion that made it say it was checksumming files whose content is not present.
Avoid the --fast option preventing checksumming in some cases it was not supposed to.
testremote: Really fsck downloaded objects.
Typo fixes. Thanks, Yaroslav Halchenko

-- Joey Hess id@joeyh.name Fri, 31 May 2024 12:32:29 -0400

git-annex (10.20240430) upstream; urgency=medium

Bug fix: While redundant concurrent transfers were already prevented in most cases, it failed to prevent the case where two different repositories were sending the same content to the same repository.
addurl, importfeed: Added --verifiable option, which improves the safety of --fast or --relaxed by letting the content of annexed files be verified with a checksum that is calculated on a later download from the web. This will become the default later.
Added rclone special remote, which can be used without needing to install the git-annex-remote-rclone program. This needs a forthcoming version of rclone (1.67.0), which supports "rclone gitannex".
sync, assist, import: Allow -m option to be specified multiple times, to provide additional paragraphs for the commit message.
reregisterurl: New command that can change an url from being used by a special remote to being used by the web remote.
annex.maxextensions configuration controls how many filename extensions to preserve.
find: Fix --help for --copies. Thanks, Gergely Risko
Windows: Fix escaping output to terminal when using old versions of MinTTY.
Added dependency on unbounded-delays.

-- Joey Hess id@joeyh.name Tue, 30 Apr 2024 15:26:32 -0400

git-annex (10.20240227) upstream; urgency=medium

importfeed: Added --scrape option, which uses yt-dlp to screen scrape the equivilant of an RSS feed.
importfeed --force: Don't treat it as a failure when an already downloaded file exists. (Fixes a behavior change introduced in 10.20230626.)
importfeed --force: Avoid creating duplicates of existing already downloaded files when yt-dlp or a special remote was used.
addurl, importfeed: Added --raw-except option.
stack.yaml: Update to lts-22.9 and use crypton.
assistant, undo: When committing, let the usual git commit hooks run.
Added annex.commitmessage-command config.
pre-commit: Avoid committing the git-annex branch (except when a commit is made in a view, which changes metadata).
Pass --no-warnings to yt-dlp.

-- Joey Hess id@joeyh.name Tue, 27 Feb 2024 12:58:30 -0400

git-annex (10.20240129) upstream; urgency=medium

info: Added "annex sizes of repositories" table to the overall display.
import: Sped up import from special remotes.
import: Added --message/-m option.
Support using commands that implement the Stateless OpenPGP command line interface, as an alternative to gpg. Currently only supported for encryption=shared special remotes, when annex.shared-sop-command is configured.
test: Test a specified Stateless OpenPGP command when run with eg --test-git-config annex.shared-sop-command=sqop
Improve disk free space checking when transferring unsized keys to local git remotes.
Added configs annex.stalldetection-download, annex.stalldetection-upload, annex.bwlimit-download, annex.bwlimit-upload, and similar per-remote configs.
Improve annex.stalldetection to handle remotes that update progress less frequently than the configured time period.
external: Monitor file size when getting content from external special remotes and use that to update the progress meter, in case the external special remote program does not report progress.
Added --expected-present file matching option.
webapp: Added --port option, and annex.port config.
assistant: When generating a gpg secret key, avoid hardcoding the key algorithm and size.

-- Joey Hess id@joeyh.name Mon, 29 Jan 2024 13:12:00 -0400

git-annex (10.20231227) upstream; urgency=medium

migrate: Support distributed migrations by recording each migration, and adding a --update option that updates the local repository incrementally, hard linking annex objects to their new keys.
pull, sync: When operating on content, automatically handle distributed migrations.
Added annex.syncmigrations config that can be set to false to prevent pull and sync from migrating object content.
migrate: Added --apply option that (re)applies all recorded distributed migrations to the objects in repository.
migrate: Support adding size to URL keys that were added with --relaxed, by running eg: git-annex migrate --backend=URL foo
When importing from a special remote, support preferred content expressions that use terms that match on keys (eg "present", "copies=1"). Such terms are ignored when importing, since the key is not known yet. Before, such expressions caused the import to fail.
Support git-annex copy/move --from-anywhere --to remote.
Make git-annex get/copy/move --from foo override configuration of remote.foo.annex-ignore, as documented.
Lower precision of timestamps in git-annex branch, which can reduce the size of the branch by up to 8%.
sync: Fix locking problems during merge when annex.pidlock is set.
Avoid a problem with temp file names ending in "." on certian filesystems that have problems with such filenames.
sync, push: Avoid trying to send individual files to special remotes configured with importtree=yes exporttree=no, which would always fail.
Fix a crash opening sqlite databases when run in a non-unicode locale. (Needs persistent-sqlite 2.13.3.)

-- Joey Hess id@joeyh.name Wed, 27 Dec 2023 19:27:37 -0400

git-annex (10.20231129) upstream; urgency=medium

Fix bug in git-annex copy --from --to that skipped files that were locally present.
Make git-annex copy --from --to --fast actually fast.
Fix crash of enableremote when the special remote has embedcreds=yes.
Ignore directories and other unusual files in .git/annex/journal/
info: Added calculation of combined annex size of all repositories.
log: Added options --sizesof, --sizes and --totalsizes that display how the size of repositories changed over time.
log: Added options --interval, --bytes, --received, and --gnuplot to tune the output of the above added options.
findkeys: Support --largerthan and --smallerthan.
importfeed: Use caching database to avoid needing to list urls on every run, and avoid using too much memory.
Improve memory use of --all when using annex.private.
lookupkey: Sped up --batch.
Windows: Consistently avoid ending standard output lines with CR. This matches the behavior of git on Windows.
Windows: Fix CRLF handling in some log files.
Windows: When git-annex init is installing hook scripts, it will avoid ending lines with CR for portability. Existing hook scripts that do have CR line endings will not be changed.

-- Joey Hess id@joeyh.name Wed, 29 Nov 2023 15:59:20 -0400

git-annex (10.20230926) upstream; urgency=medium

Fix more breakage caused by git's fix for CVE-2022-24765, this time involving a remote (either local or ssh) that is a repository not owned by the current user.
Fix using git remotes that are bare when git is configured with safe.bareRepository = explicit.
Fix linker optimisation in linux standalone tarballs.
adb: Avoid some problems with unusual characters in exporttree filenames that confuse adb shell commands.
push: When on an adjusted branch, propagate changes to parent branch before updating export remotes.
lookupkey: Added --ref option.
enableremote: Avoid overwriting existing git remote when passed the uuid of a specialremote that was earlier initialized with the same name.
Support being built with crypton rather than the no-longer maintained cryptonite.
Removed the vendored git-lfs and the GitLfs build flag.

-- Joey Hess id@joeyh.name Tue, 26 Sep 2023 13:23:37 -0400

git-annex (10.20230828) upstream; urgency=medium

oldkeys: New command that lists the keys used by old versions of a file.
Fix behavior of onlyingroup.
info: Added --dead-repositories option.
Significant startup speed increase by avoiding repeatedly checking if some remote git-annex branch refs need to be merged.
Fix behavior when importing a tree from a directory remote when the directory does not exist. An empty tree was imported, rather than the import failing.
sync, assist, push, pull: Skip more types of remotes when they are not available due to eg being on a drive that is offline. (directory, borg, bup, ddar, gcrypt, rsync)
info: Added available to the info displayed for a remote.
Added AVAILABILITY UNAVAILABLE and the UNAVAILABLERESPONSE extension to the external special remote protocol.
The remote.name.annex-availability git config is no longer used.
Avoid using curl when annex.security.allowed-ip-addresses is set but neither annex.web-options nor annex.security.allowed-url-schemes is set to a value that needs curl.
Stop bundling curl in the OSX dmg and linux standalone image.
diffdriver: Added --get option.
diffdriver: Refuse to run when not in a git-annex repository.

-- Joey Hess id@joeyh.name Mon, 28 Aug 2023 12:40:37 -0400

git-annex (10.20230802) upstream; urgency=medium

satisfy: New command that gets/sends/drops content to satisfy preferred content settings. This is like to the --content part of git-annex sync.
--explain: New option to display explanations of what git-annex takes into account when deciding what to do. Including explaining matching of preferred content expressions, annex.largefiles, and annex.addunlocked.
reinject: Added --guesskeys option.
diffdriver: Added --text option for easy diffing of the contents of annexed text files.
assist: With --jobs, parallelize transferring content to/from remotes.
Bug fix: Re-running git-annex adjust or sync when in an adjusted branch would overwrite the original branch, losing any commits that had been made to it since the adjusted branch was created.
Bug fix: Fix behavior when git is configured with safe.bareRepository = explicit.
importfeed bug fix: When -J was used with multiple feeds, some feeds did not get their items downloaded.
importfeed: Add feedurl to the metadata (and allow it to be used in the --template)
Improve resuming interrupted download when using yt-dlp.
S3: Amazon S3 buckets created after April 2023 do not support ACLs, so public=yes cannot be used with them. Existing buckets configured with public=yes will keep working.
S3: Allow setting publicurl=yes without public=yes, to support buckets that are configured with a Bucket Policy that allows public access.
directory, gcrypt: Remove empty hash directories when dropping content.
dropunused: Support --jobs
Support "onlyingroup=" in preferred content expressions.
Support --onlyingroup= matching option.
Setup.hs: Stop installing man pages, desktop files, and the git-annex-shell and git-remote-tor-annex symlinks. Anything still relying on that, eg via cabal v1-install will need to change to using make install-home.
Support building with unix-compat 0.7
Support building with unix-2.8.0.
stack.yaml: Update to build with ghc-9.6.2 and aws-0.24. (For windows, stack-lts-18.13.yaml has to be used instead for now.)

-- Joey Hess id@joeyh.name Wed, 02 Aug 2023 13:55:30 -0400

git-annex (10.20230626) upstream; urgency=medium

Split out two new commands, git-annex pull and git-annex push. Those plus a git commit are equivalent to git-annex sync. (Note that the new commands default to syncing content, unless annex.synccontent is explicitly set to false.)
assist: New command, which is the same as git-annex sync but with new files added and content transferred by default.
sync: Started a transition to --content being enabled by default. When used without --content or --no-content, warn about the upcoming transition, and suggest using one of the options, or setting annex.synccontent.
sync: Added -g as a short option for --no-content.
Many commands now quote filenames that contain unusual characters the same way that git does, to avoid exposing control characters to the terminal.
Support core.quotePath, which can be set to false to display utf8 characters as-is in filenames.
Control characters in non-filename data coming from the repository or other possible untrusted sources are filtered out of the display of many commands. When the command output is intended for use in scripting, control characters are only filtered out when displaying to the terminal.
find, findkeys, examinekey: When outputting to a terminal and --format is not used, quote control characters. Output to a pipe is unchanged. (Similar to the behavior of GNU find.)
addurl --preserve-filename now rejects filenames that contain other control characters, besides the escape sequences it already rejected.
init: Avoid autoenabling special remotes that have control characters in their names.
Support core.sharedRepository=0xxx at long last.
Support --json and --json-error-messages in many more commands (addunused, configremote, dead, describe, dropunused, enableremote, expire, fix, importfeed, init, initremote, log, merge, migrate, reinit, reinject, rekey, renameremote, rmurl, semitrust, setpresentkey, trust, unannex, undo, uninit, untrust, unused, upgrade)
importfeed: Support -J
importfeed: Support --json-progress
httpalso: Support being used with special remotes that use chunking.
Several significant speedups to importing large trees from special remotes. Imports that took over an hour now take only a few minutes.
Cache negative lookups of global numcopies and mincopies. Speeds up eg git-annex sync --content by up to 50%.
Speed up sync in an adjusted branch by avoiding re-adjusting the branch unnecessarily, particularly when it is adjusted with --hide-missing or --unlock-present.
config: Added the --show-origin and --for-file options.
config: Support annex.numcopies and annex.mincopies.
whereused: Fix display of branch:file when run in a subdirectory.
enableremote: Support enableremote of a git remote (that was previously set up with initremote) when additional parameters such as autoenable= are passed.
configremote: New command, currently limited to changing autoenable= setting of a special remote.
Honor --force option when operating on a local git remote.
When a nonexistant file is passed to a command and --json-error-messages is enabled, output a JSON object indicating the problem. (But git ls-files --error-unmatch still displays errors about such files in some situations.)
Bug fix: Create .git/annex/, .git/annex/fsckdb, .git/annex/sentinal, .git/annex/sentinal.cache, and .git/annex/journal/* with permissions configured by core.sharedRepository.
Bug fix: Lock files were created with wrong modes for some combinations of core.sharedRepository and umask.
initremote: Avoid creating a remote that is not encrypted when gpg is broken.
log: When --raw-date is used, display only seconds from the epoch, as documented, omitting a trailing "s" that was included in the output before.
addunused: Displays the names of the files that it adds.
reinject: Fix support for operating on multiple pairs of files and keys.
sync: Fix buggy handling of --no-pull and --no-push when syncing --content. With --no-pull, avoid downloading content, and with --no-push avoid uploading content. This was done before, but inconsistently.
uninit: Avoid buffering the names of all annexed files in memory.
Fix bug in -z handling of trailing NUL in input.
version: Avoid error message when entire output is not read.
Fix excessive CPU usage when parsing yt-dlp (or youtube-dl) progress output fails.
Use --progress-template with yt-dlp to fix a failure to parse progress output when only an estimated total size is known.
When yt-dlp is available, default to using it in preference to youtube-dl. Using youtube-dl is now deprecated, and git-annex no longer tries to parse its output to display download progress
Improve resuming interrupted download when using yt-dlp or youtube-dl.
assistant: Add dotfiles to git by default, unless annex.dotfiles is configured, the same as git-annex add does.
assistant --autostop: Avoid crashing when ~/.config/git-annex/autostart lists a directory that it cannot chdir to.
Fix display when run with -J1.
assistant: Fix a crash when a small file is deleted immediately after being created.
repair: Fix handling of git ref names on Windows.
repair: Fix a crash when .git/annex/journal/ does not exist.
Support building with optparse-applicative 0.18.1 (Thanks, Peter Simons)

-- Joey Hess id@joeyh.name Mon, 26 Jun 2023 10:37:36 -0400

git-annex (10.20230407) upstream; urgency=medium

Fix laziness bug introduced in last release that breaks use of --unlock-present and --hide-missing adjusted branches.
Support user.useConfigOnly git config.
registerurl, unregisterurl: Added --remote option.
registerurl: When an url is claimed by a special remote other than the web, update location tracking for that special remote. (This was the behavior before version 6.20181011)
Sped up sqlite inserts 2x when built with persistent 2.14.5.0
git-annex.cabal: Prevent building with unix-compat 0.7 which removed System.PosixCompat.User.

-- Joey Hess id@joeyh.name Fri, 07 Apr 2023 13:36:23 -0400

git-annex (10.20230329) upstream; urgency=medium

sync: Fix parsing of gcrypt::rsync:// urls that use a relative path.
Avoid failure to update adjusted branch --unlock-present after git-annex drop when annex.adjustedbranchrefresh=1
Avoid leaving repo with a detached head when there is a failure checking out an updated adjusted branch.
view: Support annex.maxextensionlength when generating filenames for the view branch.
Windows: Support urls like "file:///c:/path"
addurl, importfeed: Fix failure when annex.securehashesonly is set.
Copy with a reflink when exporting a tree to a directory special remote.
Fix bug that caused broken protocol to be used with external remotes that use exporttree=yes. In some cases this could result in the wrong content being exported to, or retrieved from the remote.
Support VERSION 2 in the external special remote protocol, which is identical to VERSION 1, but avoids external remote programs needing to work around the above bug. External remote program that support exporttree=yes are recommended to be updated to send VERSION 2.

-- Joey Hess id@joeyh.name Wed, 29 Mar 2023 13:29:07 -0400

git-annex (10.20230321) upstream; urgency=medium

Using git-annex view in an adjusted branch, or git-annex adjust in a view branch, will enter an adjusted view branch.
sync: Fix a reversion that prevented sending files to exporttree=yes remotes when annex-tracking-branch was configured to branch:subdir (Introduced in version 10.20230214)
status: This command is deprecated because it was only needed in direct mode; git status --short is very similar.
Windows: Support long filenames in more (possibly all) of the code.
Added arm64 build for ancient kernels, needed to support Android phones whose kernels are too old to support kernels used by the current arm64 build.
importfeed: Display feed title.
init: Support being ran in a repository that has a newline in its path.
copy: When --from and --to are combined and the content is already present on the destination remote, update location tracking as necessary.
Fixed spelling of some messages and added a .codespellrc Thanks, Yaroslav Halchenko

-- Joey Hess id@joeyh.name Tue, 21 Mar 2023 16:13:46 -0400

git-annex (10.20230227) upstream; urgency=medium

Fix more breakage caused by git's fix for CVE-2022-24765, this time involving a remote that is a local bare repository not owned by the current user.
info: Fix reversion in last release involving handling of unsupported input by continuing to handle any other inputs, before exiting nonzero at the end.
git-annex.cabal: Move webapp build deps under the Assistant build flag so git-annex can be built again without yesod etc installed.
Improve error message when unable to read a sqlite database due to permissions problem.

-- Joey Hess id@joeyh.name Mon, 27 Feb 2023 12:23:12 -0400

git-annex (10.20230214) upstream; urgency=medium

sync: Fix a bug that caused files to be removed from an importtree=yes exporttree=yes special remote when the remote's annex-tracking-branch was not the currently checked out branch.
S3: Support a region= configuration useful for some non-Amazon S3 implementations. This feature needs git-annex to be built with aws-0.24.
view: New field?=glob and ?tag syntax that includes a directory "_" in the view for files that do not have the specified metadata set.
Added annex.viewunsetdirectory git config to change the name of the "_" directory in a view.
Changed the name of view branches to include the parent branch. Existing view branches checked out using an old name will still work.
sync: Avoid pushing view branches to remotes.
sync: When run in a view branch, refresh the view branch to reflect any changes that have been made to the parent branch or metadata.
sync: When run in a view branch, avoid updating synced/ branches, or trying to merge anything from remotes.
Support http urls that contain ":" that is not followed by a port number, the same as git does.
sync: Warn when the adjusted basis ref cannot be found, as happens eg when the user has renamed branches.
Sped up view branch construction by 50%.
info, enableremotemote, renameremote: Avoid a confusing message when more than one repository matches the user provided name.
info: Exit nonzero when the input is not supported.

-- Joey Hess id@joeyh.name Tue, 14 Feb 2023 14:07:11 -0400

git-annex (10.20230126) upstream; urgency=medium

Change --metadata comparisons < > <= and >= to fall back to lexicographical comparisons when one or both values being compared are not numbers.
Improve handling of some .git/annex/ subdirectories being on other filesystems, in the bittorrent special remote, and youtube-dl integration, and git-annex addurl.
Added --anything (and --nothing). Eg, git-annex find --anything will list all annexed files whether or not the content is present. This is slightly faster and clearer than --include=* or --exclude=*
Speed up git-annex upgrade (from v5) and init in a repository that has submodules.
Added libgcc_s.so.1 to the linux standalone build so pthread_cancel will work.
Speed up initial scanning for annexed files when built with persistent-2.14.4.1
Allow initremote of additional special remotes with type=web, in addition to the default web special remote. When --sameas=web is used, these provide additional names for the web special remote, and may also have their own additional configuration and cost.
web: Add urlinclude and urlexclude configuration settings.
Added an optional cost= configuration to all special remotes.
adb: Support the remote.name.cost and remote.name.cost-command configs.
findkeys: New command, very similar to git-annex find but operating on keys.
move, copy: Support combining --from and --to, which will send content from one remote across to another remote.

-- Joey Hess id@joeyh.name Thu, 26 Jan 2023 15:26:22 -0400

git-annex (10.20221212) upstream; urgency=medium

Fix a hang that occasionally occurred during commands such as move, when operating on unlocked files. (A bug introduced in 10.20220927)
When youtube-dl is not available in PATH, use yt-dlp instead.
Support parsing yt-dpl output to display download progress.
init: Avoid scanning for annexed files, which can be lengthy in a large repository. Instead that scan is done on demand.
Sped up the initial scan for annexed files by 21%.
test: Add --test-debug option.
Support quettabyte and yottabyte.

-- Joey Hess id@joeyh.name Mon, 12 Dec 2022 12:20:06 -0400

git-annex (10.20221104) upstream; urgency=medium

export: Fix a bug that left a file on a special remote when two files with the same content were both deleted in the exported tree.
S3: Support signature=anonymous to access a S3 bucket anonymously. This can be used, for example, with importtree=yes to import from a public bucket. This feature needs git-annex to be built with aws-0.23.

-- Joey Hess id@joeyh.name Thu, 03 Nov 2022 14:07:31 -0400

git-annex (10.20221103) upstream; urgency=medium

Doubled the speed of git-annex drop when operating on many files, and of git-annex get when operating on many tiny files.
trust, untrust, semitrust, dead: Fix behavior when provided with multiple repositories to operate on.
trust, untrust, semitrust, dead: When provided with no parameters, do not operate on a repository that has an empty name.
move: Fix openFile crash with -J (Fixes a reversion in 8.20201103)
S3: Speed up importing from a large bucket when fileprefix= is set, by only asking for files under the prefix.
When importing from versioned remotes, fix tracking of the content of deleted files.
More robust handling of ErrorBusy when writing to sqlite databases.
Avoid hanging when a suspended git-annex process is keeping a sqlite database locked.
Make --batch mode handle unstaged annexed files consistently whether the file is unlocked or not. Note that this changes the behavior of --batch when it is provided with locked files that are in the process of being added to the repository, but have not yet been staged in git.
Make git-annex enable-tor work when using the linux standalone build.

-- Joey Hess id@joeyh.name Thu, 03 Nov 2022 14:07:31 -0400

git-annex (10.20221003) upstream; urgency=medium

Avoid displaying warning about git-annex restage needing to be run in situations where it does not.
Fix the annex.adviceNoSshCaching config, which has never worked. Thanks, Reiko Asakura

-- Joey Hess id@joeyh.name Mon, 03 Oct 2022 12:38:48 -0400

git-annex (10.20220927) upstream; urgency=medium

Fix a bug in the last release that caused v8 repositories to upgrade immediately to v10, rather than taking the scheduled 1 year to do so.
annex.diskreserve default increased from 1 mb to 100 mb.
Include the assistant and webapp when building with cabal 3.4.1.0.
Merged the webapp build flag into the assistant build flag.
Optimise linker in linux standalone tarballs.
Fix crash importing from a directory special remote that contains a broken symlink.
When accessing a git remote over http needs a git credential prompt for a password, cache it for the lifetime of the git-annex process, rather than repeatedly prompting.
Use curl for downloads from git remotes when annex.url-options is set.
Fix a reversion that made dead keys not be skipped when operating on all keys via --all or in a bare repo. (Introduced in version 8.20200720)
vicfg: Include mincopies configuration.
Improve handling of directory special remotes with importtree=yes whose ignoreinode setting has been changed. When getting a file from such a remote, accept the content that would have been accepted with the previous ignoreinode setting.
directory, adb: Fixed a bug with importtree=yes and multiple files in the special remote have the same content, that caused it to refuse to get a file from the special remote, incorrectly complaining that it had changed, due to only accepting the inode+mtime of one file (that was since modified or deleted) and not accepting the inode+mtime of other duplicate files.
Fix a reversion that prevented git-annex from working in a repository when --git-dir or GIT_DIR is specified to relocate the git directory to somewhere else. (Introduced in version 10.20220525)
Improved handling of --time-limit when combined with -J
Fix updating git index file after getting an unlocked file when annex.stalldetection is set.
restage: New git-annex command, handles restaging unlocked files.
test: Added --test-git-config option.
Run annex.freezecontent-command and annex.thawcontent-command when on a crippled filesystem. Thanks, Reiko Asakura
enable-tor: Fix breakage caused by git's fix for CVE-2022-24765.
Let GIT_DIR and --git-dir override git's protection against operating in a repository owned by another user.
p2p: Pass wormhole the --appid option before the receive/send command, as it does not accept that option after the command
Support "inbackend" in preferred content expressions.

-- Joey Hess id@joeyh.name Tue, 27 Sep 2022 13:31:18 -0400

git-annex (10.20220822) upstream; urgency=medium

v8 repositories now automatically upgrade to v9, which will in turn automatically upgrade to v10 in a year's time. To avoid this upgrade, you can set annex.autoupgraderepository to false.
Now uses v10 by default for new repositories.
Fix a regression in 10.20220624 that caused git-annex add to crash when there was an unstaged deletion.
Added new matching options --want-get-by and --want-drop-by.
Allow find --branch to be used in a bare repository, the same as the deprecated findref can be.
add --dry-run: New option.
import: Avoid following symbolic links inside directories being imported.
Work around bug in git 2.37 that causes a segfault when core.untrackedCache is set, which broke git-annex init.
Added annex.dbdir config which can be used to move sqlite databases to a different filesystem than the git-annex repo, when the repo is on a filesystem that sqlite does not work well in.
Use curl when annex.security.allowed-url-schemes includes an url scheme not supported by git-annex internally, as long as annex.security.allowed-ip-addresses is configured to allow using curl.
Improve output when storing to bup.
When bup split fails, display its stderr.
Avoid running multiple bup split processes concurrently, since bup is not concurrency safe.
Avoid starting an unnecessary number of git hash-object processes when concurrency is enabled.

-- Joey Hess id@joeyh.name Mon, 22 Aug 2022 11:56:06 -0400

git-annex (10.20220724) upstream; urgency=medium

filter-process: Fix a bug involving handling of empty files, that caused git to kill git-annex filter-process.
add: Fix reversion when adding an annex link that has been moved to another directory. (Introduced in version 10.20220624)
Added annex.alwayscompact setting which can be unset to speed up writes to the git-annex branch in some cases. See its documentation for important notes on when it's appropariate to use.
adb: Added configuration setting oldandroid=true to avoid using find -printf, which was first supported in Android around 2019-2020. This may need to be enabled for old android devices that used to work without it being set, since version 10.20220222 started using find -printf.
--backend is no longer a global option, and is only accepted by commands that actually need it.
Improve handling of parallelization with -J when copying content from/to a git remote that is a local path.
S3: Avoid writing or checking the uuid file in the S3 bucket when importtree=yes or exporttree=yes.
Fix a reversion that prevented --batch commands (and the assistant) from noticing data written to the journal by other commands.
Fix building with the Assistant build flag disabled but the Webapp build flag enabled.

-- Joey Hess id@joeyh.name Mon, 25 Jul 2022 12:55:38 -0400

git-annex (10.20220624) upstream; urgency=medium

init: Added --no-autoenable option.
info: Added --autoenable option.
initremote: Improve handling of type=git special remotes. The location value no longer needs to match the url of an existing git remote, and locations not using ssh:// will work now, including both paths and host:/path
Fix retrival of an empty file that is stored in a special remote with chunking enabled. (Fixes a reversion in 8.20201103)
move: Improve resuming a move that succeeded in transferring the content, but where dropping failed due to eg a network problem, in cases where numcopies checks prevented the resumed move from dropping the object from the source repository.
add, fix, lock, rekey: When several files were being processed, replacing an annex symlink of a file that was already processed with a new large file could sometimes cause that large file to be added to git. These races have been fixed.
add: Also fix a similar race that could cause a large file be added to git when a small file was modified or overwritten while it was being added.
add --batch: Fix handling of a file that is skipped due to being gitignored.

-- Joey Hess id@joeyh.name Thu, 23 Jun 2022 13:31:22 -0400

git-annex (10.20220525) upstream; urgency=medium

Special remotes with importtree=yes or exporttree=yes are once again treated as untrusted, since files stored in them can be deleted or modified at any time. (Fixes a reversion in 8.20201129)
Added support for "megabit" and related bandwidth units in annex.stalldetection and everywhere else that git-annex parses data units. Note that the short form is "Mbit" not "Mb" because that differs from "MB" only in case, and git-annex parses units case-insensitively.
Special remotes using exporttree=yes and/or importtree=yes now checksum content while it is being retrieved, instead of in a separate pass at the end.
fsck: Fix situations where the annex object file is stored in a directory structure other than where annex symlinks point to.
Deal with git's recent changes to fix CVE-2022-24765, which prevent using git in a repository owned by someone else.
Improve an error message displayed in that situation.
Prevent git-annex init incorrectly reinitializing the repository in that situation.
test: When limiting tests to run with -p, work around tasty limitation by automatically including dependent tests.

-- Joey Hess id@joeyh.name Wed, 25 May 2022 13:44:46 -0400

git-annex (10.20220504) upstream; urgency=medium

Ignore annex.numcopies set to 0 in gitattributes or git config, or by git-annex numcopies or by --numcopies, since that configuration would make git-annex easily lose data. Same for mincopies.
assistant: When annex.autocommit is set, notice commits that the user makes manually, and push them out to remotes promptly.
multicast: Support uftp 5.0 by switching from aes256-cbc to aes256-gcm.
Fix test failure on NFS when cleaning up gpg temp directory.
Fix a build failure with ghc 9.2.2. Thanks, gnezdo for the patch.
rsync 3.2.4 broke backwards-compatability by preventing exposing filenames to the shell. Made the rsync and gcrypt special remotes detect this and disable shellescape. Closes: #1010397
repair: Avoid treating refs/annex/last-index or other refs that are not commit objects as evidence of repository corruption.

-- Joey Hess id@joeyh.name Wed, 04 May 2022 11:45:27 -0400

git-annex (10.20220322) upstream; urgency=medium

Directory special remotes with importtree=yes have changed to once more take inodes into account. This will cause extra work when importing from a directory on a FAT filesystem that changes inodes on every mount. To avoid that extra work, set ignoreinodes=yes when initializing a new directory special remote, or change the configuration of your existing remote: git-annex enableremote foo ignoreinodes=yes
add: Avoid unncessarily converting a newly unlocked file to be stored in git when it is not modified, even when annex.largefiles does not match it.
The above change to add fixes a reversion in version 10.20220222, where git-annex unlock followed by git-annex add, followed by git commit file could result in git thinking the file was modified after the commit.
Detect when an unlocked file whose content is not present has gotten some other content appended to it, and avoid treating it as a pointer file, so that appended content will not be checked into git, but will be annexed like any other file.
smudge: Warn when encountering a pointer file that has other content appended to it.
When annex.freezecontent-command is set, and the filesystem does not support removing write bits, avoid treating it as a crippled filesystem.
Run annex.thawcontent-command before deleting an object file, in case annex.freezecontent-command did something that would prevent deletion.
Fix propagation of nonzero exit status from git ls-files when a specified file does not exist, or a specified directory does not contain any files checked into git.
Fix build with aeson 2.0. Thanks, sternenseemann for the patch.
Avoid git-annex test being very slow when run from within the standalone linux tarball or OSX app.
test: Runs tests in parallel to speed up the test suite.
test: Added --jobs option.
Removed vendored copy of http-client-restricted, and removed the HttpClientRestricted build flag that avoided that dependency.
Removed the NetworkBSD build flag.

-- Joey Hess id@joeyh.name Tue, 22 Mar 2022 13:56:12 -0400

git-annex (10.20220222) upstream; urgency=medium

annex.skipunknown now defaults to false, so commands like git annex get foo* will not silently skip over files/dirs that are not checked into git.
info: Allow using matching options in more situations. File matching options like --include will be rejected in situations where there is no filename to match against.
adb: Avoid find failing with "Argument list too long"
Fix git-annex forget propagation between repositories. (reversion introduced in version 7.20190122)
registerurl, unregisterurl: Improved output when reading from stdin to be more like other batch commands.
registerurl, unregisterurl: Added --json and --json-error-messages options.
Avoid git status taking a long time after git-annex unlock of many files.
Pass --no-textconv when running git diff internally.

-- Joey Hess id@joeyh.name Tue, 22 Feb 2022 13:01:20 -0400

git-annex (10.20220127) upstream; urgency=medium

New v10 repository version (with v9 as a stepping-stone to it). v8 remains the default version for now.
In v10, object files are locked using separate lock files. This allows the object files to be kept non-writable even in repositories where core.sharedRepository is set.
The v10 upgrade will happen automatically, one year after the v9 upgrade, in order to allow time for any old git-annex processes that are not aware of the locking change to finish. Or git-annex upgrade can be used to upgrade to v10 immediately.
In v9 upgrade, set filter.annex.process. This makes git add/checkout faster when there are a lot of unlocked annexed files or non-annexed files, but can also make git add of large files to the annex somewhat slower. If this tradeoff does not work for your use case, you can still unset filter.annex.process.
export: When a non-annexed symlink is in the tree to be exported, skip it.
import: When the previously exported tree contained a non-annexed symlink, preserve it in the imported tree so it does not get deleted.
enableremote, renameremote: Better handling of the unusual case where multiple special remotes have been initialized with the same name.
Recover from corrupted content being received from a git remote, by deleting the temporary file when it fails to verify. This prevents a retry from failing again. (reversion introduced in version 8.20210903)
adb: Added ignorefinderror configuration parameter.
Avoid crashing when run in a bare git repo that somehow contains an index file.
Reject combinations of --batch (or --batch-keys) with options like --all or --key or with filenames.

-- Joey Hess id@joeyh.name Thu, 27 Jan 2022 13:25:19 -0400

git-annex (8.20211231) upstream; urgency=medium

Improved support for using git-annex in a read-only repository, git-annex branch information from remotes that cannot be merged into the git-annex branch will now not crash it, but will be merged in memory.
addurl, youtube-dl: When --check-raw prevents downloading an url, still continue with any downloads that come after it, rather than erroring out.
Fix locking problems when annex.pidlock is set and concurrency is enabled eg with -J.
Improve error message display when autoinit fails due to eg, a permissions problem.
export: Avoid unncessarily re-exporting non-annexed files that were already exported.
Improve git command queue flushing so that eg, addurl of several large files that take time to download will update the index for each file, rather than deferring the index updates to the end.
sync: Better error message when unable to export to a remote because remote.name.annex-tracking-branch is configured to a ref that does not exist.
Fix build with ghc 9.0.1
Fix build with old versions of feed library.

-- Joey Hess id@joeyh.name Fri, 31 Dec 2021 15:03:36 -0400

git-annex (8.20211123) upstream; urgency=medium

Bugfix: When -J was enabled, getting files could leak an ever-growing number of git cat-file processes.
Support git's new "ort" resolver, which became the default in git 2.34.0, and broke the test suite and automatic merge resolution of a conflict between an annexed file and a non-annexed file.
importfeed: Display url before starting youtube-dl download.

-- Joey Hess id@joeyh.name Tue, 23 Nov 2021 15:19:16 -0400

git-annex (8.20211117) upstream; urgency=medium

filter-process: New command that can make git add/checkout faster when there are a lot of unlocked annexed files or non-annexed files, but that also makes git add of large annexed files slower. Use it by running: git config filter.annex.process 'git-annex filter-process'
Fix a typo in the name of youtube-dl (reversion introduced in version 8.20210903)
git-lfs: Fix interoperability with gitlab's implementation of the git-lfs protocol, which requests Content-Encoding chunked.
importfeed: Fix a crash when used in a non-unicode locale.
migrate: New --remove-size option.
uninit: Avoid error message when no commits have been made to the repository yet.
uninit: Avoid error message when there is no git-annex branch.
metadata --batch: Avoid crashing when a non-annexed file is input, instead output a blank line like other batch commands do.
metadata --batch --json: Reject input whose "fields" does not consist of arrays of strings. Such invalid input used to be silently ignored.

-- Joey Hess id@joeyh.name Wed, 17 Nov 2021 12:18:49 -0400

git-annex (8.20211028) upstream; urgency=medium

Removed support for accessing git remotes that use versions of git-annex older than 6.20180312.
git-annex-shell: Removed several commands that were only needed to support git-annex versions older than 6.20180312.
Negotiate P2P protocol version with tor remotes, allowing use of protocol version 1. This negotiation is not supported by versions of git-annex older than 6.20180312.
Fix bug that caused stale git-annex branch information to read when annex.private or remote.name.annex-private is set.
git-annex get when run as the first git-annex command in a new repo did not populate all unlocked files. (Reversion in version 8.20210621)
Fix using lookupkey and info inside a subdirectory of the git repository. (Reversion in version 8.20211011)
Avoid some sqlite crashes on Windows SubSystem for Linux (WSL).
Call annex.freezecontent-command on the annex object file after it has been moved into place in annex/objects/. This allows the hook to freeze the file in ways that prevent moving it, such as removing the Windows delete permission. Thanks, Reiko Asakura.
addurl: Support adding the same url to multiple files at the same time when using -J with --batch --with-files.
When retrieval from a chunked remote fails, display the error that occurred when downloading the chunk, rather than the error that occurred when trying to download the unchunked content, which is less likely to actually be stored in the remote.
Avoid crashing tilde expansion on user who does not exist.
test: Put gpg temp home directory in system temp directory, not filesystem being tested.

-- Joey Hess id@joeyh.name Thu, 28 Oct 2021 11:58:29 -0400

git-annex (8.20211011) upstream; urgency=medium

Added annex.bwlimit and remote.name.annex-bwlimit config to limit the bandwidth of transfers. It works for git remotes and many but not all special remotes.
Bug fix: Git configs such as annex.verify were incorrectly overriding per-remote git configs such as remote.name.annex-verify. (Reversion in version 4.20130323)
borg: Significantly improved memory use when a borg repository contains many archives.
borg: Avoid trying to extract xattrs, ACLS, and bsdflags when retrieving from a borg repository.
Sped up git-annex smudge --clean by 25%.
Resume where it left off when copying a file to/from a local git remote was interrupted.
sync --content: Avoid a redundant checksum of a file that was incrementally verified, when used on NTFS and perhaps other filesystems.
reinject: Fix crash when reinjecting a file from outside the repository. (Reversion in version 8.20210621)
Avoid cursor jitter when updating progress display.

-- Joey Hess id@joeyh.name Mon, 11 Oct 2021 12:52:14 -0400

git-annex (8.20210903) upstream; urgency=medium

Deal with clock skew, both forwards and backwards, when logging information to the git-annex branch.
GIT_ANNEX_VECTOR_CLOCK can now be set to a fixed value (eg 1) rather than needing to be advanced each time a new change is made.
Misuse of GIT_ANNEX_VECTOR_CLOCK will no longer confuse git-annex.
add: When adding a dotfile, avoid treating its name as an extension.
rsync special remote: Stop displaying rsync progress, and use git-annex's own progress display.
Many special remotes now checksum content while it is being retrieved, instead of in a separate pass at the end. This is supported for all special remotes on Linux (except for bittorrent), and for many on other OS's (except for adb, external, gcrypt, hook, and rsync).
unused: Skip the refs/annex/last-index ref that git-annex recently started creating.
Fix test suite failure on Windows.
New --batch-keys option added to these commands: get, drop, move, copy, whereis
Added annex.youtube-dl-command config. This can be used to run some forks of youtube-dl.
Run cp -a with --no-preserve=xattr, to avoid problems with copied xattrs, including them breaking permissions setting on some NFS servers.
add, import: Detect when xattrs or perhaps ACLs prevent removing write permissions from an annexed file, and fail with an informative message.
Fix support for readonly git remotes. (Reversion in version 8.20210621)
When downloading urls fail, explain which urls failed for which reasons.
web: Avoid displaying a warning when downloading one url failed but another url later succeeded.

-- Joey Hess id@joeyh.name Fri, 03 Sep 2021 12:00:46 -0400

git-annex (8.20210803) upstream; urgency=medium

whereused: New command, finds what files use a key, or where a key was used historically.
Fix a bug that prevented getting content from a repository that started out as a bare repository, or had annex.crippledfilesystem set, and was converted to a non-bare repository.
Fix retrieval of content from borg repos accessed over ssh.
sync: When --quiet is used, run git commit, push, and pull without their ususual output.
merge: When --quiet is used, run git merge without its usual output.
sync, merge, post-receive: Avoid merging unrelated histories, which used to be allowed only to support direct mode repositories. (However, sync does still merge unrelated histories when importing trees from special remotes, and the assistant still merges unrelated histories.)
sync, merge: Added --allow-unrelated-histories option, which is the same as the git merge option.
Fix bug that caused some transfers to incorrectly fail with "content changed while it was being sent", when the content was not changed.
Fix bug that could prevent pointer files from being populated, in a repository that was upgraded from v7.
fsck: Detect and correct stale or missing inode caches.
Fix a rounding bug in display of data sizes.
git-annex get when run as the first git-annex command in a new repo did not populate unlocked files. (Reversion in version 8.20210621)

-- Joey Hess id@joeyh.name Tue, 03 Aug 2021 12:20:09 -0400

git-annex (8.20210714) upstream; urgency=medium

assistant: Avoid unnecessary git repository repair in a situation where git fsck gets confused about a commit that is made while it's running.
addurl: Avoid crashing when used on beegfs.
--debug output goes to stderr again, not stdout. (Reversion in version 8.20210428)
init: Fix misbehavior when core.sharedRepository = group that caused it to enter an adjusted branch and set annex.crippledfilesystem (Reversion in version 8.20210630)
assistant: When adding non-large files to git, honor annex.delayadd configuration. Also, don't add non-large files to git when they are still being written to.

-- Joey Hess id@joeyh.name Wed, 14 Jul 2021 12:22:55 -0400

git-annex (8.20210630) upstream; urgency=medium

Fixed bug that interrupting git-annex repair (or assistant) while it was fixing repository corruption would lose objects that were contained in pack files. Also the assistant might sometimes have crashed with the same result.
repair: Fix reversion in version 8.20200522 that prevented fetching missing objects from remotes.
sync: Partly work around github behavior that first branch to be pushed to a new repository is assumed to be the head branch, by not pushing synced/git-annex first.
Added annex.freezecontent-command and annex.thawcontent-command configs.
Improve display of errors when transfers fail.
Dropping an unused object with drop --unused or dropunused will mark it as dead, preventing fsck --all from complaining about it after it's been dropped from all repositories.
addurl, importfeed: Added --no-raw option that forces download with youtube-dl or a special remote. In particular this can avoid falling back to raw download when youtube-dl is blocked for some reason.

-- Joey Hess id@joeyh.name Wed, 30 Jun 2021 11:48:16 -0400

git-annex (8.20210621) upstream; urgency=medium

New matching options --excludesamecontent and --includesamecontent
When two files have the same content, and a required content expression matches one but not the other, dropping the latter file will fail as it would also remove the content of the required file.
drop, move, mirror: When two files have the same content, and different numcopies or requiredcopies values, use the higher value.
drop --auto: When two files have the same content, and a preferred content expression matches one but not the other, do not drop the content.
sync --content, assistant: When two unlocked files have the same content, and a preferred content expression matches one but not the other, do not drop the content. (This was already the case for locked files.)
sync --content, assistant: Fix an edge case where a file that is not preferred content did not get dropped.
filter-branch: New command, useful to produce a filtered version of the git-annex branch, eg when splitting a repository.
fromkey: Create an unlocked file when used in an adjusted branch where the file should be unlocked, or when configured by annex.addunlocked.
Fix behavior of several commands, including reinject, addurl, and rmurl when given an absolute path to an unlocked file, or a relative path that leaves and re-enters the repository.
smudge: Fix a case where an unlocked annexed file that annex.largefiles does not match could get its unchanged content checked into git, due to git running the smudge filter unecessarily.
reinject: Error out when run on a file that is not annexed, rather than silently skipping it.
assistant: Fix a crash on startup by avoiding using forkProcess.
init: When annex.commitmessage is set, use that message for the commit that creates the git-annex branch.
Added annex.adviceNoSshCaching config.
Added --size-limit option.
Future proof activity log parsing.
Fix an exponential slowdown when large numbers of duplicate files are being added in unlocked form.

-- Joey Hess id@joeyh.name Mon, 21 Jun 2021 12:17:24 -0400

git-annex (8.20210428) upstream; urgency=medium

New annex.private and remote.name.annex-private configs that can prevent storing information about a repository and remotes in the git-annex branch.
initremote: Added --private option to set up a private special remote.
importfeed: Made "checking known urls" phase run 12 times faster.
Added --debugfilter (and annex.debugfilter)
diffdriver: Support unlocked files.
forget: Preserve currently exported trees, avoiding problems with exporttree remotes in some unusual circumstances.
fsck: When downloading content from a remote, if the content is able to be verified during the transfer, skip checksumming it a second time.
directory: When cp supports reflinks, use it.
Avoid excess commits to the git-annex branch when stall detection is enabled.
git-annex-config: Allow setting annex.securehashesonly, which has otherwise been supported since 2019, but was missing from the list of allowed repo-global configs.
init: Fix a crash when the repo's was cloned from a repo that had an adjusted branch checked out, and the origin remote is not named "origin".
Fix some bugs that made git-annex not see recently recorded status information when configured with annex.alwayscommit=false.
When mincopies is set to a larger value than numcopies, make sure that mincopies is satisfied. Before, it assumed a sane configuration would have numcopies larger or equal to mincopies. It's still a good idea not to configure git-annex this way.
Avoid more than 1 gpg password prompt at the same time, which could happen occasionally before when concurrency is enabled.
Fix build with persistent-2.12.0.1

-- Joey Hess id@joeyh.name Wed, 28 Apr 2021 12:13:24 -0400

git-annex (8.20210330) upstream; urgency=medium

Behavior change: When autoenabling special remotes of type S3, weddav, or glacier, do not take login credentials from environment variables, as the user may not be expecting the autoenable to happen, or may have those set for other purposes and not intend git-annex to use them.
New annex.supportunlocked config that can be set to false to avoid some expensive things needed to support unlocked files, if you do not use them.
Fix bug importing from a special remote into a subdirectory more than one level deep, which generated unusual git trees that could confuse git merge.
borg: Fix a bug that prevented importing keys of type URL and WORM.
borg: Support importing files that are hard linked in the borg backup.
export: When a submodule is in the tree to be exported, skip it.
import: When the previously exported tree contained a submodule, preserve it in the imported tree so it does not get deleted.
export --json: Fill in the file field.
rmurl: When youtube-dl was used for an url, it no longer needs to be prefixed with "yt:" in order to be removed.
rmurl: If an url is both used by the web and also claimed by another special remote, fix a bug that caused the url to to not be removed.
unregisterurl: Fix a bug that caused an url to not be unregistered when it is claimed by a special remote other than the web.
whereis: Don't include yt: prefix when showing url to content retrieved with youtube-dl.
webdav: Work around some buggy webdav server behavior involving renaming files.
Make --debug also enable debugging in child git-annex processes.
fsck: When --from is used in combination with --all or similar options, do not verify required content, which can't be checked properly when operating on keys.
Sped up git-annex init in a clone of an existing repository.
Improved display of errors when accessing a git http remote fails.
Fix build with attoparsec-0.14.

-- Joey Hess id@joeyh.name Tue, 30 Mar 2021 13:01:17 -0400

git-annex (8.20210310) upstream; urgency=medium

When non-annexed files in a tree are exported to a special remote, importing from the special remote keeps the files non-annexed, as long as their content has not changed, rather than converting them to annexed files. (Such a conversion will still happen when importing from a remote an old git-annex exported such a tree to before; export the tree with the new git-annex before importing to avoid that.)
Added support for git-remote-gcrypt's rsync URIs, which access a remote using rsync over ssh, and which git pushes to much more efficiently than ssh urls.
unregisterurl: New command.
registerurl: Allow it to be used in a bare repository.
Prevent combinations of options such as --all with --include.
Fixed handling of --mimetype or --mimeencoding combined with options like --all or --unused.
Fix handling of --branch combined with --unlocked or --locked.
Fix support for local gcrypt repositories with a space in their URI.
uninit: Fix a small bug that left a lock file in .git/annex
Windows: Correct the path to the html help file for 64 bit build.
OSX dmg: Updated bundled git to 2.30.2 which fixes CVE-2021-21300.

-- Joey Hess id@joeyh.name Wed, 10 Mar 2021 13:58:15 -0400

git-annex (8.20210223) upstream; urgency=medium

annex.stalldetection can now be set to "true" to make git-annex do automatic stall detection when it detects a remote is updating its transfer progress consistently enough for stall detection to work.
When annex.stalldetection is not enabled and a likely stall is detected, display a suggestion to enable it.
Commands can be added to git-annex, by installing a program in PATH with a name starting with "git-annex-"
Fix a reversion that made import of a tree from a special remote result in a merge that deleted files that were not preferred content of that special remote.
Bugfix: fsck --from a ssh remote did not actually check that the content on the remote is not corrupted.
unannex, uninit: When an annexed file is modified, don't overwrite the modified version with an older version from the annex.
When adding files to an adjusted branch set up by --unlock-present, add them unlocked, not locked.
Fix an oddity in matching options and preferred content expressions such as "foo (bar or baz)", which was incorrectly handled as if it were "(foo or bar) and baz)" rather than the intended "foo and (bar or baz)"
Checksum as content is received from a remote git-annex repository, rather than doing it in a second pass.
Tahoe: Avoid verifying hash after download, since tahoe does sufficient verification itself.
unannex, uninit: Don't run git rm once per annexed file, for a large speedup.
When a git remote is configured with an absolute path, use that path, rather than making it relative.
get: Improve output when failing to get a file fails.
Fix build on openbsd. Thanks, James Cook for the patch.
Include libkqueue.h file needed to build the assistant on BSDs.

-- Joey Hess id@joeyh.name Tue, 23 Feb 2021 14:40:14 -0400

git-annex (8.20210127) upstream; urgency=medium

Added mincopies configuration. This is like numcopies, but is enforced even more strictly. While numcopies can be violated in concurrent drop situations involving special remotes that do not support locking, mincopies cannot be. The default value has always been 1, but now it can be set to higher values if desired.
Behavior change: When numcopies is set to 0, git-annex used to drop content without requiring any copies. Now to get that (highly unsafe) behavior, mincopies also needs to be set to 0.
Behavior change: git-annex trust now needs --force, since unconsidered use of trusted repositories can lead to data loss.
Behavior change: --trust and --trust-glacier options no longer overrides trust, since that can lead to data loss, which should never be enabled by an option other than --force.
add: Significantly speed up adding lots of non-large files to git, by disabling the annex smudge filter when running git add.
add --force-small: Run git add rather than updating the index itself, so any other smudge filters than the annex one that may be enabled will be used.
Fix --time-limit, which got broken in several ways by some optimisations in version 8.20201007.
When syncing changes back from an adjusted branch to the basis branch, include deletions of submodules. Thanks, Kyle Meyer for the patch.
Bug fix: export with -J could fail when two files had the same content.
Bug fix: Fix tilde expansion in ssh urls when the tilde is the last character in the url. Thanks, Grond for the patch.
Avoid crashing when there are remotes using unparseable urls. Including the non-standard URI form that git-remote-gcrypt uses for rsync.
Directory special remotes with importtree=yes now avoid unnecessary hashing when inodes of files have changed, as happens whenever a FAT filesystem gets remounted.
Fix a bug that prevented git-annex init from working in a submodule.
Fix a bug in view filename generation when a metadata value ended with "/" (or ":" or "" on Windows)
adjust: Fix some bad behavior when unlocked files use URL keys.
smudge: Fix some bad behavior when git add is run on an unlocked file that used an URL key.
Added GETGITREMOTENAME to external special remote protocol.
Windows: Work around win32 length limits when dealing with lock files.

-- Joey Hess id@joeyh.name Wed, 27 Jan 2021 11:09:25 -0400

git-annex (8.20201129) upstream; urgency=medium

New borg special remote. This is a new kind of remote, that examines borg backups of git-annex repositories, learns what files have been backed up, and can restore files from the backup and so on. As well as backups, it can be useful for archival storage, since borg can efficiently store many related versions of files.
New config annex.stalldetection, remote.name.annex-stalldetection, which can be used to deal with remotes that stall during transfers, or are sometimes too slow to want to use.
Support special remotes that are configured with importtree=yes but without exporttree=yes.
Fix bug that made the next download after an empty file from a ssh or tor remote fail.
Avoid spurious "verification of content failed" message when downloading content from a ssh or tor remote fails due to the remote no longer having a copy of the content.
Fix bug that matched include= and exclude= in preferred/required content expressions relative to the current directory, rather than the path from the top of the repository. (Reversion introduced in version 8.20201116.)
Fix hang on shutdown of external special remote using ASYNC protocol extension. (Reversion introduced in version 8.20201007.)
Guard against running in a repo where annex.uuid is set but annex.version is not set, or vice-versa.
Avoid autoinit when a repo does not have annex.version or annex.uuid set, but has a git-annex objects directory, suggesting it was used by git-annex before, and the git config may have been lost.
importfeed: Avoid using youtube-dl when a feed does not contain an enclosure, but only a link to an url which youtube-dl does not support.
initremote: Prevent enabling encryption with exporttree=yes or importtree=yes.
Windows: include= and exclude= containing '/' will also match filenames that are written using ''. (And vice-versa, but it's better to use '/' for portability.)
Fix a bug that could prevent getting files from an importtree=yes remote, because the imported tree was allowed to be garbage collected.
stack.yaml: Updated to lts-16.27.

-- Joey Hess id@joeyh.name Tue, 29 Dec 2020 12:52:58 -0400

git-annex (8.20201127) upstream; urgency=medium

adjust: New --unlock-present mode which locks files whose content is not present (so the broken symlink is visible), while unlocking files whose content is present.
Added annex.adjustedbranchrefresh git config to update adjusted branches set up by git-annex adjust --unlock-present/--hide-missing.
Fix hang when an external special remote program exited but the stderr pipe to it was left open, due to a daemon having inherited the file descriptor.
Fix a bug that could make resuming a download from the web fail when the entire content of the file is actually already present locally.
examinekey: Added a "file" format variable for consistency with find, and for easier scripting.
init: When writing hook scripts, set all execute bits, not only the user execute bit.
upgrade: Support an edge case upgrading a v5 direct mode repo where nothing had ever been committed to the head branch.
Made the test suite significantly less noisy, only displaying command output when something failed.
Fix building without the torrent library. Thanks, Kyle Meyer.
Fix build on Windows.
Prevent windows assistant from trying (and failing) to upgrade itself, which has never been supported on windows.

-- Joey Hess id@joeyh.name Fri, 27 Nov 2020 12:54:11 -0400

git-annex (8.20201116) upstream; urgency=medium

move: Fix a regression in the last release that made move --to not honor numcopies settings.
sync --content: Fix a bug where a file that was not preferred content could be transferred to a remote. This happened when the file got deleted after the sync started running.
Warn when adding a annex symlink or pointer file that uses a key that is not known to the repository, to prevent confusion if the user has copied it from some other repository.
examinekey: Added two new format variables: objectpath and objectpointer
examinekey: Added --migrate-to-backend

-- Joey Hess id@joeyh.name Mon, 16 Nov 2020 09:36:35 -0400

git-annex (8.20201103) upstream; urgency=medium

move: Improve resuming a move that was interrupted after the object was transferred, in cases where numcopies checks prevented the resumed move from dropping the object from the source repository.
When a special remote has chunking enabled, but no chunk sizes are recorded (or the recorded ones are not found), speculatively try chunks using the configured chunk size.
Fixed some problems that prevented this command from working: git submodule foreach git annex init
Improve shutdown process for external special remotes and external backends. Make sure to relay any remaining stderr from the process, and potentially avoid the process getting a SIGPIPE if it writes to stderr too late.
Fix a bug that prevented linux standalone bundle from working on a fresh install.
Windows build changed to one done by the datalad-extensions project using Github actions.
Windows build now includes libmagic, so mimetype and mimeencoding will work. Thanks to John Thorvald Wodder II and Yaroslav Halchenko for their work on this.
view: Avoid using ':' from metadata when generating a view, because it's a special character on Windows ("c:")
Fix a memory leak introduced in the last release.
add, import: Fix a reversion in 7.20191009 that broke handling of --largerthan and --smallerthan.
view: Fix a reversion in 8.20200522 that broke entering or changing views.
Fix build on Windows with network-3.
testremote: Display exceptions when tests fail, to aid debugging.

-- Joey Hess id@joeyh.name Tue, 03 Nov 2020 11:40:56 -0400

git-annex (8.20201007) upstream; urgency=medium

--json output now includes a new field "input" which is the input value (filename, url, etc) that caused a json object to be output.
--batch combined with -J now runs batch requests concurrently for many commands. Before, the combination was accepted, but did not enable concurrency. Since the output of batch requests can be in any order, --json with the new "input" field is recommended to be used, to determine which batch request each response corresponds to.
aws-0.22 improved its support for setting etags, which improves support for versioned S3 buckets.
Serialize use of C magic library, which is not thread safe. This fixes failures uploading to S3 when using -J.
add, addurl, importfeed, import: Added --no-check-gitignore option for finer grained control than using --force.
import: Check gitignores when importing trees from special remotes.
addunused: Don't check .gitignores when adding files.
Improve the "Try making some of these repositories available" message, with some hints for the user for what to do.
Improve --debug output to show pid of processes that are started and stopped.
sync --all: Sped up seeking to around twice as fast, by avoiding a pass over the worktree files when preferred content expressions of the local repo and remotes don't use include=/exclude=.
Sped up seeking for files to operate on, when using options like --copies or --in, by around 20%
import --no-content: Check annex.largefiles, and import small files into git, the same as is done when importing with content. If the largefiles expression needs the file content available (due to mimetype or mimeencoding being used), the import will fail.
sync: When run without --content, import without copying from importtree=yes directory special remotes. (Other special remotes may support this later as well.)
addurl: Avoid a redundant git ignores check for speed.
upgrade: Avoid an upgrade failure of a bare repo in unusual circumstances.
httpalso: Support being used with special remotes that do not have encryption= in their config.
Parse youtube-dl progress output, which lets progress be displayed when doing concurrent downloads.
Fix build with Benchmark build flag.
Enable building with git-annex benchmark by default, only turning it off when the criterion library is not installed.
runshell: Fix a edge case where rm errors were sent to stdout, which could confuse things parsing git-annex output.
runshell: Update files atomically when preparing to run git-annex.
Fix a build failure on Windows.

-- Joey Hess id@joeyh.name Wed, 07 Oct 2020 12:19:05 -0400

git-annex (8.20200908) upstream; urgency=medium

Added httpalso special remote, which is useful for accessing content stored on other remotes that is published by http.
The external special remote protocol got an ASYNC extension. This can be used by an external special remote to let a single process perform concurrent actions, rather than multiple processes being started, when that is more efficient.
Retry transfers to exporttree=yes remotes same as for other remotes.
import: Retry downloads that fail, same as is done for downloads generally.
Limit retrying of failed transfers when forward progress is being made to 5, to avoid some unusual edge cases where too much retrying could result in far more data transfer than makes sense.
Exposed annex.forward-retry git config, to configure the forward retry behavior that git-annex has had for a long time.
sync, assistant, merge: When merge.directoryRenames is not set, default it it to "false", which works better with automatic merge conflict resolution than git's ususual default of "conflict". (This is not done when automatic merge conflict resolution is disabled.)
resolvemerge: Improve cleanup of cruft left in the working tree by a conflicted merge.
Support git remotes where .git is a file, not a directory, eg when --separate-git-dir was used.
Fixed several cases where files were created without file mode bits that the umask would usually set. This included exports to the directory special remote, torrent files used by the bittorrent special remote, hooks written by git-annex init, and some log files in .git/annex/
Fix reversion in 7.20190322 that made addurl --file not be honored when youtube-dl was used to download media.
Fix reversion in 8.20200617 that made annex.pidlock being enabled result in some commands stalling, particularly those needing to autoinit.
Display warning when external special remote does not start up properly, or is not usable.
Display a message when git-annex has to wait for a pid lock file held by another process.
test: Stop gpg-agent daemons that are started for the test framework's gpg key.
Removed the S3 and WebDAV build flags so these special remotes are always supported.
stack.yaml: Updated to lts-16.10.

-- Joey Hess id@joeyh.name Tue, 08 Sep 2020 14:20:11 -0400

git-annex (8.20200814) upstream; urgency=medium

Added support for external backend programs. So if you want a hash that git-annex doesn't support, or something stranger, you can write a small program to implement it.
Fix a bug in find --branch in the previous version.
importfeed: Fix reversion that caused some '.' in filenames to be replaced with '_'
Fix a lock file descriptor leak that could occur when running commands like git-annex add with -J. Bug was introduced as part of a different FD leak fix in version 6.20160318.
Fix a hang when using git-annex with an old openssh 7.2p2, which had some weird inheriting of ssh FDs by sshd. Bug was introduced in git-annex version 7.20200202.7.
move, copy --to: Sped up seeking files by 2x.
drop: Sped up seeking files to drop by 2x, and also some performance improvements to checking numcopies.
Deal with unusual IFS settings in the shell scripts for linux standalone and OSX app. Thanks, Yaroslav Halchenko
Avoid complaining that a file with "is beyond a symbolic link" when the filepath is absolute and the symlink in question is not actually inside the git repository.
Slightly sped up the linux standalone bundle.
Support building with dlist-1.0

-- Joey Hess id@joeyh.name Mon, 10 Aug 2020 13:04:04 -0400

git-annex (8.20200720.1) upstream; urgency=medium

Fix a bug in find --batch in the previous version.

-- Joey Hess id@joeyh.name Mon, 20 Jul 2020 19:39:11 -0400

git-annex (8.20200720) upstream; urgency=medium

import: Added --no-content option, which avoids downloading files from a special remote. Currently only supported by the directory special remote.
Honor annex.largefiles when importing a tree from a special remote. (Except for when --no-content is used.)
Fix a deadlock that could occur after git-annex got an unlocked file, causing the command to hang indefinitely. Known to happen on vfat filesystems, possibly others.
Build with the http-client-restricted and git-lfs libraries when available, otherwise use the vendored copy as before.
testremote: Fix over-allocation of resources and bad caching, including starting up a large number of external special remote processes. (Regression introduced in version 8.20200501)
test: Fix some test cases that assumed git's default branch name.
importfeed: Added some additional --template variables: itempubyear, itempubmonth, itempubday, itempubhour, itempubminute, itempubsecond.
Made several special remotes support locking content on them, which allows dropping from other special remotes in some situations where it was not possible before. Supported special remotes: S3 (with versioning=yes), git-lfs, tahoe
Fix reversion that broke passing annex.* and remote..annex- git configs with -c. (Since version 8.20200330.)
Bring back git-annex branch read cache. This speeds up some operations, eg git-annex sync --content --all gets 20% faster.
Fix a recently introduced bug that could cause a "fork: resource exhausted" after getting several thousand files.
Sped up the --all option by 2x to 16x by using git cat-file --buffer. Thanks to Lukey for finding this optimisation.
Sped up seeking for annexed files to operate on by a factor of nearly 2x.
Sped up sync --content by 2x and other commands like fsck --fast and whereis by around 50%, by using git cat-file --buffer.
importfeed: Made checking known urls step around 15% faster.
fsck: Detect if WORM keys contain a carriage return, and recommend upgrading the key. (git-annex could have maybe created such keys back in 2013).
When on an adjust --hide-missing branch, fix handling of files that have been deleted but the deletion is not yet staged.

-- Joey Hess id@joeyh.name Mon, 20 Jul 2020 14:40:51 -0400

git-annex (8.20200617) upstream; urgency=medium

Added annex.skipunknown git config, that can be set to false to change the behavior of commands like git annex get foo*, to not skip over files/dirs that are not checked into git and are explicitly listed in the command line.
annex.skipunknown is planned to change to default to false in a git-annex release in early 2022. If you prefer the current behavior, you can explicitly set it to true.
Try to enable special remotes configured with autoenable=yes when git-annex auto-initialization happens in a new clone of an existing repo. Previously, git-annex init had to be explicitly run to enable them. Special remotes cannot display anything when autoenabled this way, to avoid interfering with the output of git-annex query commands.
export: Added options for json output.
import: Added --json-progress.
addurl: Make --preserve-filename also apply when eg a torrent contains multiple files.
Fix a crash or potentially not all files being exported when sync -J --content is used with an export remote.
export: Let concurrent transfers be done with -J or annex.jobs.
move --to, copy --to, mirror --to: When concurrency is enabled, run cleanup actions in separate job pool from uploads.
init: If lock probing stalls for a long time (eg a broken NFS server), display a message to let the user know what's taking so long.
init: When annex.pidlock is set, skip lock probing.
Fix file descriptor leak when importing from a directory special remote that is configured with exporttree=yes.
Note that external special remote programs should not block SIGINT or SIGTERM.
Avoid creating the keys database during init when there are no unlocked files, to prevent init failing when sqlite does not work in the filesystem.
import: Avoid using some strange names for temporary keys, which broke importing from a directory special remote onto a vfat filesystem.
S3: The REDUCED_REDUNDANCY storage class is no longer cheaper so stop documenting it, and stop offering it as a choice in the assistant.
Improve display of problems auto-initializing or upgrading local git remotes.
When a local git remote cannot be initialized because it has no git-annex branch or a .noannex file, avoid displaying a message about it.
checkpresentkey: When no remote is specified, try all remotes, not only ones that the location log says contain the key. This is what the documentation has always said it did.
Fix regression in external special remote handling: GETCONFIG did not return a value that was set with SETCONFIG immediately before. (Regression introduced in version 7.20200202.7)
Fix bug that made initremote of extrnal special remotes with embedcreds=yes or gpg encryption not store the creds in the git-annex branch. git-annex-remote-googledrive one was special remote affected by this bug. (Regression introduced in version 7.20200202.7)
Fix bug that made creds not be stored in git when a special remote was initialized with gpg encryption, but without an explicit embedcreds=yes. (Regression introduced in version 7.20200202.7)
Fix a annex.pidlock issue that made eg git-annex get of an unlocked file hang until the annex.pidlocktimeout and then fail.

-- Joey Hess id@joeyh.name Wed, 17 Jun 2020 15:58:59 -0400

git-annex (8.20200522) upstream; urgency=medium

Fix bug that made enableremote of S3 and webdav remotes, that have embedcreds=yes, fail to set up the embedded creds, so accessing the remotes failed. (Regression introduced in version 7.20200202.7)
addurl, importfeed: Avoid adding filenames with leading '.', instead it will be replaced with '_'.
addurl, importfeed: Allow '-' in filenames, as long as it's not the first character.
addurl --preserve-filename: New option, uses server-provided filename without any sanitization, but will fail if the filename has an obvious security problem like using an escape sequence or trying to escape the current directory.
whereis: Added --format option.
S3: Support signature=v4, to use S3 Signature Version 4. Some S3 services seem to require v4, while others may only support v2, which remains the default.
upgrade: When upgrade fails due to an exception, display it.
repair: Improve fetching from a remote with an url in host:path format.
git-lfs repos that encrypt the annexed content but not the git repo only need --force passed to initremote, allow enableremote and autoenable of such remotes without forcing again.
When accessing a remote fails, always display a reason why.
Display a warning message when a remote uses a protocol, such as git://, that git-annex does not support. Silently skipping such a remote was confusing behavior.
Also display a warning message when a remote, without a known uuid, is located in a directory that does not currently exist, to avoid silently skipping such a remote.
sync: Avoid an ugly error message when nothing has been committed to master yet and there is a synced master branch to merge from.
Display a warning message when asked to operate on a file inside a directory that's a symbolic link to elsewhere.
Support building with tasty-1.3.

-- Joey Hess id@joeyh.name Fri, 22 May 2020 12:05:01 -0400

git-annex (8.20200501) upstream; urgency=medium

Improve git-annex's ability to find the path to its program, especially when it needs to run itself in another repo to upgrade it.
adb: Better messages when the adb command is not installed.
Sped up query commands that read the git-annex branch by around 9%.
Various speed improvements gained by using ByteStrings for git refs and shas.
Fix a potential failure to parse git config.
Support boolean git configs that are represented by the name of the setting with no value, eg "core.bare" is the same as "core.bare = true".
When parsing git configs, support all the documented ways to write true and false, including "yes", "on", "1", etc.
Fix --batch commands (and git-annex info) to accept absolute filenames for unlocked files, which already worked for locked files.
Avoid repeatedly opening keys db when accessing a local git remote and -J is used.
Avoid running a large number of git cat-file child processes when run with a large -J value.
Avoid running with more git check-attr and check-ignore processes than there are CPU cores when run with a large -J value.
get --from, move --from: When used with a local git remote, these used to silently skip files that the location log thought were present on the remote, when the remote actually no longer contained them. Since that behavior could be surprising, now instead display a warning.
external special remotes: remote.name.annex-readonly=true no longer disables running the external special remote program. Instead, it just makes the remote operate in a readonly mode, same as any remote. To disable running the external special remote program, now need to set remote.name.annex-externaltype=readonly. That is done when git-annex enableremote is passed readonly=true.
Stop storing readonly=true in remote.log of external special remotes; it is a local setting only.
sync: When some remotes to sync with are specified, and --fast is too, pick the lowest cost of the specified remotes, do not sync with a faster remote that was not specified.
addurl: When run with --fast on an url that annex.security.allowed-ip-addresses prevents accessing, display a more useful message.
When the required content is set to "groupwanted", use whatever expression has been set in groupwanted as the required content of the repo, similar to how setting required content to "standard" already worked.
Avoid a test suite failure when the environment does not let gpg be tested due to eg, too long a path to the agent socket.
test: Include testremote tests, run on a directory special remote.

-- Joey Hess id@joeyh.name Fri, 01 May 2020 13:09:24 -0400

git-annex (8.20200330) upstream; urgency=medium

fsck: Fix reversion in 8.20200226 that made it incorrectly warn that hashed keys with an extension should be upgraded.
add --force-small: Fix a bug that, when adding a symbolic link, checked in the content of the file the symlink pointed to. Thanks, Kyle Meyer for the patch.
add --force-small: Fix failure when passed a modified submodule. Thanks, Kyle Meyer for the patch.
When syncing changes back from an adjusted branch to the basis branch, include changes to submodules. Thanks, Kyle Meyer for the patch.
webdav: Made exporttree remotes faster by caching connection to the server.
Fix a minor bug that caused options provided with -c to be passed multiple times to git.

-- Joey Hess id@joeyh.name Mon, 30 Mar 2020 12:14:50 -0400

git-annex (8.20200309) upstream; urgency=medium

Fix bug that caused unlocked annexed dotfiles to be added to git by the smudge filter when annex.dotfiles was not set.
Upgrade other repos than the current one by running git-annex upgrade inside them, which avoids problems with upgrade code making assumptions that the cwd will be inside the repo being upgraded. In particular, this fixes a problem where upgrading a v7 repo to v8 caused an ugly git error message.
Fix upgrade failure when a file has been deleted from the working tree.
Fix regression 1 month ago that prevented external special remotes from using GETCONFIG to query values like "name".
Improve behavior when a directory git-annex is writing to gets unmounted. Previously it could in some cases re-create the mount point and directory tree, and even write object contents to the wrong disk.
Don't ignore --debug when it is followed by -c.
whereis: If a remote fails to report on urls where a key is located, display a warning, rather than giving up and not displaying any information.
When external special remotes fail but neglect to provide an error message, say what request failed, which is better than displaying an empty error message to the user.
git-annex config: Only allow configs be set that are ones git-annex actually supports reading from repo-global config, to avoid confusion.
Avoid converting .git file in a worktree or submodule to a symlink when the repository is not a git-annex repository.
Linux standalone: Use md5sum to shorten paths in .cache/git-annex/locales
Fix build with ghc 8.8 (MonadFail) Thanks, Peter Simons
stack.yaml: Updated to lts-14.27.

-- Joey Hess id@joeyh.name Mon, 09 Mar 2020 17:04:08 -0400

git-annex (8.20200226) upstream; urgency=medium

New v8 repository version.
v7 upgrades automatically to v8. The upgrade deletes old sqlite databases, which may cause git-annex to need to do extra work to regenerate the databases or due to not having the information from the old databases available. Two notable cases are interrupted incremental fscks and interrupted exports, both of which will restart from the beginning.
Improved serialization of filenames and keys to the sqlite databases, avoiding encoding problems and speeding up operations on them.
Add some missing indexes to sqlite databases. This will speed up some things involving export and import remotes, and git-annex smudge. Microbenchmarks show around 10-25% speedup of sqlite database operations.
add: When adding a whole directory, any dotfiles found in it will not be skipped, but will be added to git by default. This behavior can be configured with annex.dotfiles.
add: Removed special case for explicitly passing dotfiles, that no longer adds them to the annex, but to git. This behavior can be configured with annex.dotfiles.
add: Removed the --include-dotfiles option.
initremote, enableremote: Set remote.name.skipFetchAll when the remote cannot be fetched from by git, so git fetch --all will not try to use it.
Fix some cases where handling of keys with extensions varied depending on the locale.
annex.maxextensionlength used to be the number of characters, not bytes, when in a utf-8 locale. It's now always the number of bytes.
Extended annex.security.allowed-ip-addresses to let specific ports of an IP address to be used, while denying use of other ports.
init --version: When the version given is one that automatically upgrades to a newer version, use the newer version instead.
Auto upgrades from older repo versions, like v5, now jump right to v8.
Makefile: Support newer versions of cabal that use the new-build system.

-- Joey Hess id@joeyh.name Wed, 26 Feb 2020 18:49:58 -0400

git-annex (7.20200226) upstream; urgency=high

Fix serious regression in gcrypt and encrypted git-lfs remotes. Since version 7.20200202.7, git-annex incorrectly stored content on those remotes without encrypting it. If your remotes are affected, you will want to make sure to delete any content that git-annex has stored on them that is not encrypted!
initremote: Fix regression in parsing the exporttree= parameter.
info: Fix display of the encryption value. (Some debugging junk had crept in.)
Bugfix to getting content from an export remote with -J, when the export database was not yet populated.
Bugfix: export --tracking (a deprecated option) set annex-annex-tracking-branch, instead of annex-tracking-branch.

-- Joey Hess id@joeyh.name Wed, 26 Feb 2020 17:18:16 -0400

git-annex (7.20200219) upstream; urgency=medium

Added sync --only-annex, which syncs the git-annex branch and annexed content but leaves managing the other git branches up to you.
Added annex.synconlyannex git config setting, which can also be set with git-annex config to configure sync in all clones of the repo.
fsck --from remote: Fix a concurrency bug that could make it incorrectly detect that content in the remote is corrupt, and remove it, resulting in data loss.
When git-annex is built with a ssh that does not support ssh connection caching, default annex.sshcaching to false, but let the user override it.
Improve warning messages further when ssh connection caching cannot be used, to clearly state why.
Avoid throwing fatal errors when asked to write to a readonly git remote on http.
Fix support for repositories tuned with annex.tune.branchhash1=true, including --all not working and git-annex log not displaying anything for annexed files.

-- Joey Hess id@joeyh.name Wed, 19 Feb 2020 12:44:43 -0400

git-annex (7.20200204) upstream; urgency=medium

Fix build with persistent-template 2.8.0.
Makefile: Really move the fish completion to the vendor_completions.d directory.

-- Joey Hess id@joeyh.name Tue, 04 Feb 2020 14:30:55 -0400

git-annex (7.20200202.7) upstream; urgency=medium

add: --force-large/--force-small options make it easier to override annex.largefiles configuration (and potentially safer as it avoids bugs like the smudge bug fixed in the last release).
reinject --known: Fix bug that prevented it from working in a bare repo.
Support being used in a git repository that uses sha256 rather than sha1.
initremote, enableremote: Be stricter about rejecting invalid configuration parameters for remotes, particularly things like foo=true when foo=yes is expected.
initremote, enableremote: Reject unknown configuration parameters provided to these commands.
initremote: Added --whatelse option, to show additional configuration parameters you might want to set. Eg: git annex initremote type=directory encryption=none --whatelse
Added LISTCONFIGS to external special remote protocol. Special remote programs that use GETCONFIG/SETCONFIG are recommended to implement it.
init: Avoid an ugly error message when http remote has no git-annex uuid configured.
Support git remotes that need http basic auth to be accessed, using git credential to get the password.
Display a warning when concurrency is enabled but ssh connection caching is not enabled or won't work due to a crippled filesystem.
Makefile: Move the fish completion to the vendor_completions.d directory.
Fixed a test suite failure when run in the C locale.

-- Joey Hess id@joeyh.name Sun, 02 Feb 2020 00:00:00 -0400

git-annex (7.20191230) upstream; urgency=medium

Optimised processing of many files, especially by commands like find and whereis that only report on the state of the repository. Commands like get also sped up in cases where they have to check a lot of files but only transfer a few files. Speedups range from 30-100%.
Added build dependency on the filepath-bytestring library.
Fixed an oversight that had always prevented annex.resolvemerge from being honored, when it was configured by git-annex config.
annex.largefiles can be configured by git-annex config, to more easily set a default that will also be used by clones, without needing to shoehorn the expression into the gitattributes file. The git config and gitattributes override that.
annex.addunlocked can be set to an expression with the same format used by annex.largefiles, when you want to default to unlocking some files but not others.
annex.addunlocked can be configured by git-annex config.
git-annex-config --set/--unset: No longer change the local git config setting, except for in the special case of annex.securehashesonly.
Improve file ordering behavior when one parameter is "." and other parameters are other directories.
smudge bugfix: When annex.largefiles=anything, files that were already stored in git, and have not been modified could sometimes be converted to being stored in the annex. Changes in 7.20191024 made this more of a problem. This case is now detected and prevented.

-- Joey Hess id@joeyh.name Mon, 30 Dec 2019 12:43:30 -0400

git-annex (7.20191218) upstream; urgency=medium

git-lfs: The url provided to initremote/enableremote will now be stored in the git-annex branch, allowing enableremote to be used without an url. initremote --sameas can be used to add additional urls.
git-lfs: When there's a git remote with an url that's known to be used for git-lfs, automatically enable the special remote.
sync, assistant: Pull and push from git-lfs remotes.
Fix bug that made bare repos be treated as non-bare when --git-dir was used.
inprogress: Support --key.
Sped up many git-annex commands that operate on many files, by avoiding reserialization of keys. find is 7% faster; whereis is 3% faster; and git-annex get when all files are already present is 5% faster
Stop displaying rsync progress, and use git-annex's own progress display for local-to-local repo transfers.
benchmark: Changed --databases to take a parameter specifiying the size of the database to benchmark.
benchmark --databases: Display size of the populated database.
benchmark --databases: Improve the "addAssociatedFile (new)" benchmark to really add new values, not overwriting old values.
Windows: Fix handling of changes to time zone. (Used to work but was broken in version 7.20181031.)

-- Joey Hess id@joeyh.name Wed, 18 Dec 2019 13:53:51 -0400

git-annex (7.20191114) upstream; urgency=medium

Added annex.allowsign option.
Make --json-error-messages capture more errors, particularly url download errors.
Fix a crash (STM deadlock) when -J is used with multiple files that point to the same key.
linuxstandalone: Fix a regression that broke git-remote-https.
OSX git-annex.app: Fix a problem that prevented using the bundled git-remote-https, git-remote-http, and git-shell.

-- Joey Hess id@joeyh.name Thu, 14 Nov 2019 21:57:59 -0400

git-annex (7.20191106) upstream; urgency=medium

init: Fix bug that lost modifications to unlocked files when init is re-ran in an already initialized repo.
benchmark: Add --databases to benchmark sqlite databases.

-- Joey Hess id@joeyh.name Wed, 06 Nov 2019 12:14:50 -0400

git-annex (7.20191024) upstream; urgency=medium

Changed git add/git commit -a default behavior back to what it was before v7; they add file contents to git, not to the annex. (However, if a file was annexed before, they will still add it to the annex, to avoid footgun.)
Configuring annex.largefiles overrides that; once git-annex has been told which files are large git add/git commit -a will annex them.
Added annex.gitaddtoannex configuration. Setting it to false prevents git add from adding files to the annex even when annex.largefiles is configured. (Unless the file was annexed before.)
smudge: Made git add smarter about renamed annexed files. It can tell when an annexed file was renamed, and will add it to the annex, and not to git, unless annex.largefiles tells it to do otherwise.
init: Fix a failure when used in a submodule on a crippled filesystem.
sync: Fix crash when there are submodules and an adjusted branch is checked out.
enable-tor: Deal with pkexec changing to root's home directory when running a command.

-- Joey Hess id@joeyh.name Fri, 25 Oct 2019 13:04:59 -0400

git-annex (7.20191017) upstream; urgency=medium

initremote: Added --sameas option, allows for two special remotes that access the same data store.
Note that due to complications of the sameas feature, any external special remotes that try to send SETSTATE or GETSTATE during INITREMOTE or EXPORTSUPPORTED will now get back an ERROR. That would be a very hackish thing for an external special remote to do, needing some kind of hard-coded key value to be used, so probably nothing will be affected.
forget --drop-dead: Remove several classes of git-annex log files when they become empty, further reducing the size of the git-annex branch.
OSX: Deal with symbolic link problem that caused git to not be included in the git-annex.dmg.
Fix build with persistent-2.10.

-- Joey Hess id@joeyh.name Thu, 17 Oct 2019 18:19:12 -0400

git-annex (7.20191009) upstream; urgency=medium

Fix bug in handling of annex.largefiles that use largerthan/smallerthan. When adding a modified file, it incorrectly used the file size of the old version of the file, not the current size.
Added --mimetype and --mimeencoding file matching options.
Added --unlocked and --locked file matching options.
Added adjust --lock, to enter an adjusted branch where files are locked.
git-lfs: Added support for http basic auth.
git-lfs: Only do endpoint discovery once when concurrency is enabled.
fsck --incremental/--more: Fix bug that prevented the incremental fsck information from being updated every 5 minutes as it was supposed to be; it was only updated after 1000 files were checked, which may be more files that are possible to fsck in a given fsck time window. Thanks to Peter Simons for help with analysis of this bug.
Test: Use more robust directory removal when built with directory-1.2.7.
Close sqlite databases more robustly.
remotedaemon: Don't list --stop in help since it's not supported.
enable-tor: Run kdesu with -c option.
enable-tor: Use pkexec to run command as root when gksu and kdesu are not available.
When dropping an unlocked file, preserve its mtime, which avoids git status unncessarily running the clean filter on the file.
uninit: Remove several git hooks that git-annex init sets up.
uninit: Remove the smudge and clean filters that git-annex init sets up.
Work around git cat-file --batch's odd stripping of carriage return from the end of the line (some windows infection), avoiding crashing when the repo contains a filename ending in a carriage return.
git-annex-standalone.rpm: Fix the git-annex-shell symlink.

-- Joey Hess id@joeyh.name Wed, 09 Oct 2019 12:31:31 -0400

git-annex (7.20190912) upstream; urgency=medium

Default to v7 for new repositories.
Automatically upgrade v5 repositories to v7.
Automatically convert direct mode repositories to v7 with adjusted unlocked branches and set annex.thin.
Added annex.autoupgraderepository configuration that can be set to false to prevent any automatic repository upgrades.
Refuse to upgrade direct mode repositories when git is older than 2.22, which fixed a memory leak that could cause an OOM during the upgrade.
Removed support for git versions older than 2.1.
assistant: When creating a new repository, no longer use direct mode, instead use v7 adjusted branches with annex.thin.
init: When run on a crippled filesystem with --version=5, will error out, since version 7 is needed for adjusted unlocked branch.
direct: This command always errors out as direct mode is no longer supported.
indirect: This command has become a deprecated noop.
proxy: This command is deprecated because it was only needed in direct mode. (But it continues to work.)
info: Removed the "repository mode" from its output (including the --json output) since with the removal of direct mode, there is no repository mode.
info: When file matching options are specified when getting info of something other than a directory, they won't have any effect, so error out to avoid confusion.
info: Display trust level when getting info on a uuid, same as a remote.
When upgrading a direct mode repo to v7 with adjusted unlocked branches, fix a bug that prevented annex.thin from taking effect for the files in working tree.
Avoid making a commit when upgrading from direct mode to v7.
init: Catch more exceptions when testing locking.
init: Fix a reversion that broke initialization on systems that need to use pid locking.
A git-annex-standalone rpm is now distributed along with the standalone tarball.
Added standalone/rpm/rpmbuild-from-standalone-tarball script.

-- Joey Hess id@joeyh.name Fri, 13 Sep 2019 12:53:06 -0400

git-annex (7.20190819) upstream; urgency=medium

New git-lfs special remote, which can be used to store data on any git-lfs server, including github, gitlab, and gogs.
Support fully encrypting all data sent to a git-lfs special remote, using a combination of gcrypt to encrypt the git data, and git-annex's encryption of its data.
Use the same optimisation for --in=here as has always been used for --in=. rather than the slow code path that unncessarily queries the git-annex branch.
Allow setting up a gcrypt special remote with encryption=shared.
Fix querying git for object type when operating on a file containing newlines.
merge: When run with a branch parameter, merges from that branch. This is especially useful when using an adjusted branch, because it applies the same adjustment to the branch before merging it.
init: Install working hook scripts when run on a crippled filesystem and on Windows. If your repository was set up by an old version of git-annex that omitted the hooks, you can simply re-run git-annex init to install them.
init: When the repo is already initialized, and --version requests a different version, error out rather than silently not changing the version.
S3: Fix encoding when generating public urls of S3 objects.
Make git-annex-standalone.deb include the shell completions again.
Makefile: Changed default zsh completion location to zsh default fpath. Systems such as Debian that have overridden the default fpath will need to set ZSH_COMPLETIONS_PATH.
test: Add pass using adjusted unlocked branch.
Fix intermittent failure of the test suite, where its repeated opening and writing to the sqlite database somehow caused inode cache information to occasionally be lost.
Fix several test suite failures on Windows.
Windows installer: Always install to 64 bit program files directory, since it needs 64 bit git now.
Build with silently-1.2.5.1 on Windows; the old one used "NUL" device which is not supported with recent versions of ghc.

-- Joey Hess id@joeyh.name Mon, 19 Aug 2019 12:23:16 -0400

git-annex (7.20190730) upstream; urgency=medium

Improved probing when CoW copies can be made between files on the same drive. Now supports CoW between BTRFS subvolumes. And, falls back to rsync instead of using cp when CoW won't work, eg copies between repos on the same EXT4 filesystem.
Add BLAKE2BP512 and BLAKE2BP512E backends, using a blake2 variant optimised for 4-way CPUs.
Support running v7 upgrade in a repo where there is no branch checked out, but HEAD is set directly to some other ref.
Windows build no longer ships with a copy of rsync, since that is only used any more to access rsync special remotes or remotes with a very old version of git-annex-shell.
Windows build is now 64 bit, and using it with the 64 bit git for Windows is fully supported.
Windows problems with long filenames should be fixed now, since the Windows build is made with a newer ghc version that works around the problems.
stack.yaml: Build with http-client-0.5.14 to get a bug fix to http header parsing.
Drop support for building with ghc older than 8.4.4, and with older versions of serveral haskell libraries.
Support building with socks-0.6 and persistant-template-2.7.
Corrected some license statements. Thanks, Sean Whitton.

-- Joey Hess id@joeyh.name Tue, 30 Jul 2019 12:22:25 -0400

git-annex (7.20190708) upstream; urgency=medium

Fix find --json to output json once more.

-- Joey Hess id@joeyh.name Mon, 08 Jul 2019 08:58:16 -0400

git-annex (7.20190626) upstream; urgency=medium

get, move, copy, sync: When -J or annex.jobs has enabled concurrency, checksum verification uses a separate job pool than is used for downloads, to keep bandwidth saturated.
Other commands also run their cleanup phase using a separate job pool than their perform phase, which may make some of them somewhat faster when running concurrently as well.
When downloading an url and the destination file exists but is empty, avoid using http range to resume, since a range "bytes=0-" is an unusual edge case that it's best to avoid relying on working. This is known to fix a case where importfeed downloaded a partial feed from such a server.
importfeed: When there's a problem parsing the feed, --debug will output the feed content that was downloaded.
init: Fix a reversion in the last release that prevented automatically generating and setting a description for the repository.
add: Display progress meter when hashing files.
add: Support --json-progress option.
The Linux standalone arm build now works again on CPU versions below arm6. Thanks to Emanuele Olivetti, Ilias Tsitsimpis, Bernhard Übelacker, and Adrian Bunk for fixing ghc in Debian (bug #928882).
OSX dmg: Put git-annex's version in the Info.plist file.

-- Joey Hess id@joeyh.name Wed, 26 Jun 2019 12:29:46 -0400

git-annex (7.20190615) upstream; urgency=medium

Fixed bug that caused git-annex to fail to add a file when another git-annex process cleaned up the temp directory it was using.
Makefile: Added install-completions to install target.
Added the ability to run one job per CPU (core), by setting annex.jobs=cpus, or using option --jobs=cpus or -Jcpus.
Honor preferred content of a special remote when exporting trees to it; unwanted files are filtered out of the tree that is exported.
Importing from a special remote honors its preferred content too; unwanted files are not imported. But, some preferred content expressions can't be checked before files are imported, and trying to import with such an expression will fail.
Don't try to import .git directories from special remotes, because git does not support storing git repositories inside a git repository.
Improve shape of commit tree when importing from unversioned special remotes.
init: When the repository already has a description, don't change it.
describe: When run with no description parameter it used to set the description to "", now it will error out.
Android: Improve installation process when the user's login shell is not bash.
When a remote is configured to be readonly, don't allow changing what's exported to it.
Renamed annex.security.allowed-http-addresses to annex.security.allowed-ip-addresses because it is not really specific to the http protocol, also limiting eg, git-annex's use of ftp. The old name for the config will still work.
Add back support for ftp urls, which was disabled as part of the fix for security hole CVE-2018-10857 (except for configurations which enabled curl and bypassed public IP address restrictions). Now it will work if allowed by annex.security.allowed-ip-addresses.
Avoid a delay at startup when concurrency is enabled and there are rsync or gcrypt special remotes, which was caused by git-annex opening a ssh connection to the remote too early.

-- Joey Hess id@joeyh.name Sat, 15 Jun 2019 12:38:25 -0400

git-annex (7.20190507) upstream; urgency=medium

Fix reversion in last release that caused wrong tree to be written to remote tracking branch after an export of a subtree.
Improved locking when multiple git-annex processes are writing to the .git/index file

-- Joey Hess id@joeyh.name Tue, 07 May 2019 13:05:33 -0400

git-annex (7.20190503) upstream; urgency=medium

adb special remote supports being configured with importtree=yes, to allow git-annex import of files from an Android device. This can be combined with exporttree=yes and git-annex export used to send changes back to the Android device.
S3 special remote supports being configured with importtree=yes, to allow git-annex import of files from a S3 bucket. This can be combined with exporttree=yes and git-annex export used to send changes back to the S3 bucket.
S3: When versioning is enabled on a bucket, importing from it will import old versions of files that were written to the bucket as well as the current versions. A git history is synthesized to reflect the way the bucket changed over time.
Fix bug that caused importing from a special remote to repeatedly download unchanged files when multiple files in the remote have the same content.
Made git-annex sync --content much faster when all the remotes it's syncing with are export/import remotes.
sync: When listing contents on an import remote fails, proceed with other syncing instead of aborting.
renameremote: New command, changes the name that is used to enable a special remote. Especially useful when you want to reuse the name of an old remote for something new.
Drop support for building with aws older than 0.14.
info: Show when a remote is configured with importtree.
Added mimeencoding= term to annex.largefiles expressions. This is probably mostly useful to match non-text files with eg "mimeencoding=binary"
git-annex matchexpression: Added --mimeencoding option.

-- Joey Hess id@joeyh.name Fri, 03 May 2019 12:47:41 -0400

git-annex (7.20190322) upstream; urgency=medium

New feature allows importing from special remotes, using git annex import branch:subdir --from remote
Directory special remote supports being configured with importree=yes, to allow git-annex import of files from the directory. This can be combined with exporttree=yes and git-annex export used to send changes back to the same directory.
Remote tracking branches are updated when importing and exporting to special remotes, in ways analagous to how git fetch and git push do.
export: Deprecated the --tracking option. Instead, users can configure remote..annex-tracking-branch themselves.
sync --content: When remote..annex-tracking-branch is configured, import from special remotes.
sync, assistant: --no-push and remote..annex-push prevent exporting trees to special remotes.
Fix storage of metadata values containing newlines. (Reversion introduced in version 7.20190122.)
Sped up git-annex export in repositories with lots of keys.
S3: Support enabling bucket versioning when built with aws-0.21.1.
stack.yaml: Build with aws-0.21.1
Fix cleanup of git-annex:export.log after git-annex forget --drop-dead.
Makefile: Added install-home target which installs git-annex into the HOME directory.
addurl --file: Fix a bug that made youtube-dl be used unneccessarily when adding an html url that does not contain any media.
Add -- before %f in the smudge/clean filter configuration, to support filenames starting with dashes. (To update the config of existing repositories, you can re-run git-annex init.)
fsck: Detect situations where annex.thin has caused data loss to the content of locked files.
Removed bundled gpg from the Linux standalone build and OSX dmg, because gpg now always wants to use gpg-agent, and shipping such a daemon in those is not a good idea.
import: Let --force overwrite symlinks, not only regular files.
Android: Fix typo of name of armv7l in installation script. Thanks, 4omecha.
S3: Added protocol= initremote setting, to allow https to be used on a non-standard port.

-- Joey Hess id@joeyh.name Fri, 22 Mar 2019 13:56:51 -0400

git-annex (7.20190219) upstream; urgency=medium

init: Fix bug when direct mode needs to be enabled on a crippled filesystem, that left the repository in indirect mode.
Fix false positive in export conflict detection, that occurred when the same tree was exported by multiple clones. Previous fix was incomplete.
When key-based retrieval from a S3 remote with exporttree=yes appendonly=yes fails, fall back to trying to retrieve from the exported tree. This allows downloads of files that were exported to such a remote before versioning was enabled on it.
Fix path separator bug on Windows that completely broke git-annex since version 7.20190122.
Improved speed of S3 remote by only loading S3 creds once.
Display progress bar when getting files from export remotes.
Fix race in cleanup of othertmp directory that could result in a failure attempting to access it.
fromkey: Made idempotent.
fromkey: Added --json.
fromkey --batch output changed to support using it with --json. The old output was not parseable for any useful information, so this is not expected to break anything.
Avoid performing repository fixups for submodules and git-worktrees when there's a .noannex file that will prevent git-annex from being used in the repository.
init: Don't let --force be used to override a .noannex file, instead the user can just delete the file.
webdav: Exporting files with '#' or '?' in their name won't work because urls get truncated on those. Fail in a better way in this case, and avoid failing when removing such files from the export, so after the user has renamed the problem files the export will succeed.
On Windows, avoid using rsync for local copies, since rsync is not always available there.
Added NetworkBSD build flag to deal with Network.BSD moving to a new package.

-- Joey Hess id@joeyh.name Tue, 19 Feb 2019 11:12:45 -0400

git-annex (7.20190129) upstream; urgency=medium

initremote S3: When configured with versioning=yes, either ask the user to enable bucket versioning, or auto-enable it when built with aws-0.22.
enableremote S3: Do not let versioning=yes be set on existing remote, because when git-annex lacks S3 version IDs for files stored in the bucket, deleting them would cause data loss.
S3: Detect when version=yes but an exported file lacks a S3 version ID, and refuse to delete it, to avoid data loss.
S3: Send a Content-Type header when storing objects in S3, so exports to public buckets can be linked to from web pages. (When git-annex is built with MagicMime support.)

-- Joey Hess id@joeyh.name Tue, 29 Jan 2019 15:09:20 -0400

git-annex (7.20190122) upstream; urgency=medium

sync --content: Fix dropping unwanted content from the local repository.
sync --content: Support dropping local content that has reached an exporttree remote that is not untrusted (currently only S3 remotes with versioning).
init: When --version=5 is passed on a crippled filesystem, use a v5 direct mode repo as requested, rather than upgrading to v7 adjusted unlocked. (Fixes test suite on crippled filesystems.)
Some optimisations, including a 10x faster timestamp parser, a 7x faster key parser, and improved parsing and serialization of git-annex branch data. Many commands will run 5-15% faster.
Stricter parser for keys doesn't allow doubled fields or out of order fields.
The benchmark command, which only had some old benchmarking of the sqlite databases before, now allows benchmarking any other git-annex commands.
Support being built with ghc 8.6.3 (MonadFail).
Removed old code that cleaned up after a bug in git-annex versions 3.20111105-3.20111110. In the unlikely event that a repo was last touched by that ancient git-annex version, the descriptions of remotes would appear missing when used with this version of git-annex.
Improve uuid.log parser to preserve whitespace in repo descriptions.
Improve activity.log parser to not remove unknown values, allowing for future expansion.
addunused, merge, assistant: Avoid creating work tree files in subdirectories in an edge case where the key contains "/".
testremote: Support testing readonly remotes with the --test-readonly option.
Switch to using .git/annex/othertmp for tmp files other than partial downloads, and make stale files left in that directory when git-annex is interrupted be cleaned up promptly by subsequent git-annex processes.
The .git/annex/misctmp directory is no longer used and git-annex will delete anything lingering in there after it's 1 week old.
Estimated time to completion display shortened from eg "1h1m1s" to "1h1m".
Fix doubled progress display when downloading an url when -J is used.
unused: Update suggested git log message to see where data was previously used so it will also work with v7 unlocked pointer files.
importfeed: Better error message when downloading the feed fails.
Make test suite work better when the temp directory is on NFS.
webapp: Remove configurator for box.com repository, since their webdav support is going away at the end of this January.
webapp: Remove configurator for gitlab, which stopped supporting git-annex some time ago.
Android: For armv71 architecture, use the armel build.
Windows: If 64 bit git is installed, use it when installing git-annex. (However, rsync still won't work and this is still not the documented way to install it.)

-- Joey Hess id@joeyh.name Tue, 22 Jan 2019 12:25:26 -0400

git-annex (7.20181211) upstream; urgency=medium

S3: Improve diagnostics when a remote is configured with exporttree and versioning, but no S3 version id has been recorded for a key.
findref: Support file matching options: --include, --exclude, --want-get, --want-drop, --largerthan, --smallerthan, --accessedwithin
Commands supporting --branch now apply file matching options --include, --exclude, --want-get, --want-drop to filenames from the branch. Previously, combining --branch with those would fail to match anything.
add, import, findref: Support --time-limit.
Add --branch option to git-annex find and mildly deprecate findref in favor of it.
webdav: When initializing, avoid trying to make a directory at the top of the webdav server, which could never accomplish anything and failed on nextcloud servers. (Reversion introduced in version 6.20170925.)
Fix a case where upgrade to v7 caused git to think that unlocked files were modified.
Fix bug upgrading from direct mode to v7: when files in the repository were already committed as v7 unlocked files elsewhere, and the content was present in the direct mode repository, the annexed files got their full content checked into git.
Fix bug that caused v7 unlocked files in a direct mode repository to get locked when committing.

-- Joey Hess id@joeyh.name Tue, 11 Dec 2018 16:33:10 -0400

git-annex (7.20181205) upstream; urgency=medium

Make bittorrent special remote work w/o btshowmetainfo installed when it was build with torrentparser. Thanks, Robert Schütz
When running youtube-dl to get a filename, pass --no-playlist.
Fix build without concurrent-output.
init: When a crippled filesystem causes an adjusted unlocked branch to be used, set repo version to 7, which it neglected to do before.
init: When on a crippled filesystem, and the git version is too old to use an adjusted unlocked branch, fall back to using direct mode.
info: When used with an exporttree remote, includes an "exportedtree" info, which is the tree last exported to the remote. During an export conflict, multiple values will be listed.
dropunused: When an unused object file has gotten modified, eg due to annex.thin being set, don't silently skip it, but display a warning and let --force drop it.
annex.cachecreds: New config to allow disabling of credentials caching for special remotes.

-- Joey Hess id@joeyh.name Wed, 05 Dec 2018 14:02:27 -0400

git-annex (7.20181121) upstream; urgency=medium

git-annex-shell: Fix hang when transferring the same objects to two different clients at the same time. (Or when annex.pidlock is used, two different objects.)
Fixed some other potential hangs in the P2P protocol.
Fix bash completion of "git annex" to propertly handle files with spaces and other problem characters. (Completion of "git-annex" already did.)
Fix resume of download of url when the whole file content is already actually downloaded.
When an export conflict prevents accessing a special remote, be clearer about what the problem is and how to resolve it.
export, sync --content: Avoid unnecessarily trying to upload files to an exporttree remote that already contains the files.
smudge: When passed a file located outside the working tree, eg by git diff, avoid erroring out.
drop -J: Avoid processing the same key twice at the same time when multiple annexed files use it.
When a command is operating on multiple files and there's an error with one, try harder to continue to the rest. (As was already done for many types of errors including IO errors.)
Fixed a crash when using -J with ssh password prompts in --quiet/--json mode. Thanks to Yaroslav Halchenko and the DataLad&ReproNim team for helping to track down this bug.
Remove esqueleto dependency to allow upgrading other dependencies to newer versions. Thanks Sean Parsons.
Fix build with persistent-sqlite older than 2.6.3.
Updated stack.yaml to lts-12.19; added stack-lts-9.9.yaml to support old versions of stack.

-- Joey Hess id@joeyh.name Wed, 21 Nov 2018 14:22:47 -0400

git-annex (7.20181105) upstream; urgency=medium

Fix test suite failure when git-annex test is not run inside a git repository.
Fix a P2P protocol hang.
importfeed: Avoid erroring out when a feed has been repeatedly broken, as that can leave other imported files not checked into git.
Increase minimum QuickCheck version.

-- Joey Hess id@joeyh.name Mon, 05 Nov 2018 13:31:09 -0400

git-annex (7.20181031) upstream; urgency=medium

Added v7 repository mode. v6 upgrades automatically to v7, but v5 is still the default for now. While v6 was always experimental to some degree, its successor v7 is ready for production use! http://git-annex.branchable.com/tips/unlocked_files/
Direct mode repositories are deprecated; they have many problems that v7 fixes, so upgrading them now is recommended (but not yet required): git annex upgrade --version=7
init: When in a crippled filesystem, initialize a v7 repository using an adjusted unlocked branch, instead of a direct mode repository.
At long last there's a way to hide annexed files whose content is missing from the working tree: git-annex adjust --hide-missing See https://git-annex.branchable.com/tips/hiding_missing_files/
When already in an adjusted branch, running git-annex adjust again will update the branch as needed. This is mostly useful with --hide-missing to hide/unhide files after their content has been dropped or received.
git-annex sync --content supports --hide-missing; it can be used to get the content of hidden files, and it updates the adjusted branch to hide/unhide files as necessary.
smudge: The smudge filter no longer provides git with annexed file content, to avoid a git memory leak, and because that did not honor annex.thin. Now git annex smudge --update has to be run after a checkout to update unlocked files in the working tree with annexed file contents.
v7 init, upgrade: Install git post-checkout and post-merge hooks that run git annex smudge --update.
precommit: Run git annex smudge --update, because the post-merge hook is not run when there is a merge conflict. So the work tree will be updated when a commit is made to resolve the merge conflict.
Note that git has no hooks run after git stash or git cherry-pick, so the user will have to manually run git annex smudge --update after such commands.
Removed the old Android app.
Removed support for building with very old ghc < 8.0.1, and with yesod < 1.4.3, and without concurrent-output, which were only being used for the Android cross build.
Webapp: Fix termux detection.
runshell: Use system locales when built with GIT_ANNEX_PACKAGE_INSTALL set. (For Neurodebian packages.)
Fix database inconsistency that could cause git-annex to get confused about whether a locked file's content was present.
Fix concurrency bug that occurred on the first download from an exporttree remote.
init --version=6 will still work, but the repository is auto-upgraded immediately to v7.
When annex.thin is set, allow hard links to be made between executable work tree files and annex objects.
addurl: Removed undocumented special case in handling of a CHECKURL-MULTI response with only a single file listed. Rather than ignoring the url that was in the response, use it.
webapp: Fixed a crash when adding a git remote. (Reversion introduced in version 6.20180112)
migrate: Fix failure to migrate from URL keys. (Reversion introduced in version 6.20180926)
Cache high-resolution mtimes for improved detection of modified files in v7 (and direct mode).

-- Joey Hess id@joeyh.name Wed, 31 Oct 2018 09:21:50 -0400

git-annex (6.20181011) upstream; urgency=medium

sync: Warn when a remote's export is not updated to the current tree because export tracking is not configured.
Improve display when git config download from a http remote fails.
Added annex.jobs setting, which is like using the -J option.
Fix reversion in support of annex.web-options.
rmurl: Fix a case where removing the last url left git-annex thinking content was still present in the web special remote.
SETURLPRESENT, SETURIPRESENT, SETURLMISSING, and SETURIMISSING used to update the presence information of the external special remote that called them; this was not documented behavior and is no longer done.
export: Fix false positive in export conflict detection, that occurred when the same tree was exported by multiple clones.
Fix potential crash in exporttree database due to failure to honor uniqueness constraint.
Fix crash when exporttree is set to a bad value.
Linux standalone: Avoid using bundled cp before envionment is fully set up.
Added arm64 Linux standalone build.
Improved termux installation process.

-- Joey Hess id@joeyh.name Thu, 11 Oct 2018 13:41:10 -0400

git-annex (6.20180926) upstream; urgency=medium

[ Joey Hess ]

Fixes a reversion in the last release that broke interoperation with older versions of git-annex-shell.
init: Improve generated post-receive hook, so it won't fail when run on a system whose git-annex is too old to support git-annex post-receive
init: Update the post-receive hook when re-run in an existing repository.
S3: Fix url construction bug when the publicurl has been set to an url that does not end with a slash.
--debug shows urls accessed by git-annex, like it used to do when git-annex used wget and curl.
Fix support for filenames containing newlines when querying git cat-file, though less efficiently than other filenames. This should make git-annex fully support filenames containing newlines as the rest of git's interface is used in newline-safe ways.
Added -z option to git-annex commands that use --batch, useful for supporting filenames containing newlines.
Added annex.maxextensionlength for use cases where extensions longer than 4 characters are needed.
Added remote.name.annex-security-allow-unverified-downloads, a per-remote setting for annex.security.allow-unverified-downloads.
More FreeBSD build fixes.

[ Yaroslav Halchenko ]

debian/control
- add netbase to Depends: since required for basic tcp interactions (see e.g. https://github.com/nipy/heudiconv/issues/260)

-- Joey Hess id@joeyh.name Wed, 26 Sep 2018 12:56:49 -0400

git-annex (6.20180913) upstream; urgency=medium

When --batch is used with matching options like --in, --metadata, etc, only operate on the provided files when they match those options. Otherwise, a blank line is output in the batch protocol. Affected commands: find, add, whereis, drop, copy, move, get
Make metadata --batch combined with matching options refuse to run, since it does not seem worth supporting that combination.
v6 add: Take advantage of improved SIGPIPE handler in git 2.5 to speed up the clean filter by not reading the file content from the pipe. This also avoids git buffering the whole file content in memory.
v6: After updating the worktree for an add/drop, update git's index, so git status will not show the files as modified.
v6: When annex.largefiles is not configured for a file, running git add or git commit, or otherwise using git to stage a file will add it to the annex if the file was in the annex before, and to git otherwise. This is to avoid accidental conversion. Note that git-annex add's behavior has not changed.
v6: Update associated files database when git has staged changes to pointer files.
v6: Fix some race conditions.
v6: Fix annex object file permissions when git-annex add is run on a modified unlocked file, and in some related cases.
v6: When a file is unlocked but has not been modified, and the unlocking is only staged, git-annex add did not lock it. Now it will, for consistency with how modified files are handled and with v5.
Fix git command queue to be concurrency safe.
linux standalone: When LOCPATH is already set, use it instead of the bundled locales. It can be set to an empty string to use the system locales too.
Stop using external hash programs, since cryptonite is faster.
Fix build on FreeBSD.
S3: Support buckets with versioning enabled. When a remote is configured with exporttree=yes versioning=yes, git-annex can download past versions of exported files from it.
S3: Multipart uploads are now only supported when git-annex is built with aws-0.16.0 or later, as earlier versions of the library don't support versioning with multipart uploads.
S3: Support AWS_SESSION_TOKEN.
Don't use GIT_PREFIX when GIT_WORK_TREE=. because it seems git does not intend GIT_WORK_TREE to be relative to GIT_PREFIX in that case, despite GIT_WORK_TREE=.. being relative to GIT_PREFIX.
Don't use GIT_PREFIX to fix up a relative GIT_DIR, because git 2.11 sets GIT_PREFIX to a path it's not relative to. and apparently GIT_DIR is never relative to GIT_PREFIX.
git-annex.cabal: Fix build without assistant, and some other refinements. Thanks fftehnik.

-- Joey Hess id@joeyh.name Thu, 13 Sep 2018 15:50:38 -0400

git-annex (6.20180807) upstream; urgency=medium

S3: Support credential-less download from remotes configured with public=yes exporttree=yes.
Fix reversion in display of http 404 errors.
Added remote.name.annex-speculate-present config that can be used to make cache remotes.
Added --accessedwithin matching option.
Added annex.commitmessage config that can specify a commit message for the git-annex branch instead of the usual "update".
Fix wrong sorting of remotes when using -J, it was sorting by uuid, rather than cost.
addurl: Include filename in --json-progress output.
Fix git-annex branch data loss that could occur after git-annex forget --drop-dead.

-- Joey Hess id@joeyh.name Tue, 07 Aug 2018 16:22:05 -0400

git-annex (6.20180719) upstream; urgency=medium

Support working trees set up by git-worktree.
Improve support for repositories created with --separate-git-dir.
Support configuring remote.web.annex-cost and remote.bittorrent.annex-cost
addurl: When security configuration prevents downloads with youtube-dl, still check if the url is one that it supports, and fail downloading it, instead of downloading the raw web page.
Send User-Agent and any configured annex.http-headers when downloading with http, fixes reversion introduced when switching to http-client.
Fix reversion introduced in version 6.20180316 that caused git-annex to stop processing files when unable to contact a ssh remote.
v6: Work around git bug that runs smudge/clean filters at the top of the repository while passing them a relative GIT_WORK_TREE that may point outside of the repository, by using GIT_PREFIX to get back to the subdirectory where a relative GIT_WORK_TREE is valid.
p2p --pair: Fix interception of the magic-wormhole pairing code, which since 0.8.2 it has sent to stderr rather than stdout.
info: Display uuid and description when a repository is identified by uuid, and for "here".
unused --from: Allow specifiying a repository by uuid or description.
linux standalone: Generate locale files in ~/.cache/git-annex/locales/ so they're available even when the standalone tarball is installed in a directory owned by root. Note that this prevents using the standalone bundle in environments where HOME is not writable.
Include uname command in standalone builds since git-annex uses it.
git-annex.cabal: Fix network version.

-- Joey Hess id@joeyh.name Thu, 19 Jul 2018 13:53:45 -0400

git-annex (6.20180626) upstream; urgency=high

Security fix release for CVE-2018-10857 and CVE-2018-10859 https://git-annex.branchable.com/security/CVE-2018-10857_and_CVE-2018-10859/

Refuse to download content, that cannot be verified with a hash, from encrypted special remotes (for CVE-2018-10859), and from all external special remotes and glacier (for CVE-2018-10857). In particular, URL and WORM keys stored on such remotes won't be downloaded. If this affects your files, you can run git-annex migrate on the affected files, to convert them to use a hash.
Added annex.security.allow-unverified-downloads, which can override the above.
Added annex.security.allowed-url-schemes setting, which defaults to only allowing http, https, and ftp URLs. Note especially that file:/ is no longer enabled by default.
Removed annex.web-download-command, since its interface does not allow supporting annex.security.allowed-url-schemes across redirects. If you used this setting, you may want to instead use annex.web-options to pass options to curl.
git-annex will refuse to download content from http servers on localhost, or any private IP addresses, to prevent accidental exposure of internal data. This can be overridden with the annex.security.allowed-http-addresses setting.
Local http proxies will not be used unless allowed by the annex.security.allowed-http-addresses setting.
Since the interfaces to curl and youtube-dl do not have a way to prevent them from accessing localhost or private IP addresses, they default to not being used for url downloads. Only when annex.security.allowed-http-addresses=all will curl and youtube-dl be used.

Non-security fix changes:

Fix build with ghc 8.4+, which broke due to the Semigroup Monoid change.
version: Show operating system and repository version list when run outside a git repo too.
Fix annex-checkuuid implementation, so that remotes configured that way can be used.
Fix problems accessing repositories over http when annex.tune.* is configured.
External special remotes can now add info to git annex info $remote, by replying to the GETINFO message.
adb: Android serial numbers are not all 16 characters long, so accept other lengths.
Display error messages that come from git-annex-shell when the p2p protocol is used, so that diskreserve messages, IO errors, etc from the remote side are visible again.
When content has been lost from an export remote and git-annex fsck --from remote has noticed it's gone, re-running git-annex export or git-annex sync --content will re-upload it.

-- Joey Hess id@joeyh.name Fri, 22 Jun 2018 10:36:22 -0400

git-annex (6.20180529) upstream; urgency=medium

Prevent haskell http-client from decompressing gzip files, so downloads of such files works the same as it used to with wget and curl.
Workaround for bug in an old version of cryptonite that broke https downloads, by using curl for downloads when git-annex is built with it.
view, vadd: Fix crash when a git submodule has a name starting with a dot.
Don't allow entering a view with staged or unstaged changes.
move: --force was accidentially enabling two unrelated behaviors since 6.20180427. The older behavior, which has never been well documented and seems almost entirely useless, has been removed.
copy: --force no longer does anything.
migrate: Fix bug in migration between eg SHA256 and SHA256E, that caused the extension to be included in SHA256 keys, and omitted from SHA256E keys. (Bug introduced in version 6.20170214)
migrate: Check for above bug when migrating from SHA256 to SHA256 (and same for SHA1 to SHA1 etc), and remove the extension that should not be in the SHA256 key.
fsck: Detect and warn when keys need an upgrade, either to fix up from the above migrate bug, or to add missing size information (a long ago transition), or because of a few other past key related bugs.
git-annex-shell: GIT_ANNEX_SHELL_APPENDONLY makes it allow writes, but not deletion of annexed content. Note that securing pushes to the git repository is left up to the user.
setpresentkey: Added --batch support.

-- Joey Hess id@joeyh.name Tue, 29 May 2018 13:05:26 -0400

git-annex (6.20180509) upstream; urgency=medium

The old git-annex Android app is now deprecated in favor of running git-annex in termux.
runshell: Use proot when running on Android, to work around Android 8's ill-advised seccomp filtering of system calls, including ones crucial for reliable thread locking. (This will only work with termux's version of proot.)
Fix bug in last release that crashes when using --all or running git-annex in a bare repository. May have also affected git-annex unused and git-annex info.
Fix bug in last release that prevented the webapp opening on non-Linux systems.
Support building with hinotify-0.3.10.
Display error message when http download fails.
Avoid forward retry when 0 bytes were received.

-- Joey Hess id@joeyh.name Wed, 09 May 2018 16:20:26 -0400

git-annex (6.20180427) upstream; urgency=medium

move: Now takes numcopies configuration, and required content configuration into account, and refuses to reduce the current number of copies of a file, or remove content that a repository requires. --force can override these checks. Note that it's still allowed to move the content of a file from one repository to another when numcopies is not satisfied, as long as the move does not result in there being fewer copies.
Fix mangling of --json output of utf-8 characters when not running in a utf-8 locale.
Fix build with yesod 1.6.
Clean up some build warnings with newer versions of ghc and haskell libraries.
runshell: Unset LD_PRELOAD since preloaded libraries from the host system may not get along with the bundled linker.
runshell: Added some tweaks to make git-annex work in termux on Android. The regular arm standalone tarball now works in termux.
Webapp: Support being run inside termux on Android, and offer to set up a repository on the sdcard.
Assistant: Integrate with Termux:Boot, so when it's installed, the assistant is autostarted on boot.
Assistant: Fix installation of menus, icons, etc when run from within runshell.
import: Avoid buffering all filenames to be imported in memory.
Improve memory use and speed of --all and git-annex info remote, by not buffering list of all keys.

-- Joey Hess id@joeyh.name Fri, 27 Apr 2018 12:36:20 -0400

git-annex (6.20180409) upstream; urgency=medium

Added adb special remote which allows exporting files to Android devices.
For url downloads, git-annex now defaults to using a http library, rather than wget or curl. But, if annex.web-options is set, it will use curl. To use the .netrc file, run: git config annex.web-options --netrc
git-annex no longer uses wget (and wget is no longer shipped with git-annex builds).
Enable HTTP connection reuse across multiple files for improved speed.
Fix calculation of estimated completion for progress meter.
OSX app: Work around libz/libPng/ImageIO.framework version skew by not bundling libz, assuming OSX includes a suitable libz.1.dylib.
Added annex.retry, annex.retry-delay, and per-remote versions to configure transfer retries.
Also do forward retrying in cases where no exception is thrown, but the transfer failed.
When adding a new version of a file, and annex.genmetadata is enabled, don't copy the data metadata from the old version of the file, instead use the mtime of the file.
Avoid running annex.http-headers-command more than once.
info: Added "combined size of repositories containing these files" stat when run on a directory.
info: Changed sorting of numcopies stats table, so it's ordered by the variance from the desired number of copies.
Fix resuming a download when using curl.

-- Joey Hess id@joeyh.name Mon, 09 Apr 2018 13:03:15 -0400

git-annex (6.20180316) upstream; urgency=medium

New protocol for communicating with git-annex-shell increases speed of operations involving ssh remotes. When not transferring large files, git-annex is between 200% and 400% faster using the new protocol, and it's just as fast as before when transferring large files. (When the remote has an old git-annex-shell, git-annex falls back to the old slower code. This fallback is planned to be removed after 5 years or so.)
Note that, due to not using rsync to transfer files over ssh any longer, permissions and other file metadata of annexed files will no longer be preserved when copying them to and from ssh remotes. Other remotes never supported preserving that information, so this is not considered a regression.
Fix data loss bug in content locking over tor, when the remote repository is in direct mode, it neglected to check that the content was actually present when locking it. This could cause git annex drop to remove the only copy of a file when it thought the tor remote had a copy.
Fix data loss bug when the local repository uses direct mode, and a locally modified file is dropped from a remote repsitory. The bug caused the modified file to be counted as a copy of the original file. (This is not a severe bug because in such a situation, dropping from the remote and then modifying the file is allowed and has the same end result.)
Some downloads will be verified, even when annex.verify=false. This is done in some edge cases where there's a likelyhood than an object was downloaded incorrectly.
Support exporttree=yes for rsync special remotes.
Added backends for the BLAKE2 family of hashes, when built with a new enough version of cryptonite.
Improve SHA*E extension extraction code to not treat parts of the filename that contain punctuation or other non-alphanumeric characters as extensions. Before, such characters were filtered out.
Better ssh connection warmup when using -J for concurrency. Avoids ugly messages when forced ssh command is not git-annex-shell.
Fix race condition in ssh warmup that caused git-annex to get stuck and never process some files when run with high levels of concurrency.
Fix reversion introduced in 6.20171214 that caused concurrent transfers to incorrectly fail with "transfer already in progress".
Note that Remote/Git.hs now contains AGPL licensed code, thus the license of git-annex as a whole is AGPL. This was already the case when git-annex was built with the webapp enabled.
Include amount of data transferred in progress display.
Dial back optimisation when building on arm, which prevents ghc and llc from running out of memory when optimising some files. (Unfortunately this fix is incomplete due to a ghc bug.)

-- Joey Hess id@joeyh.name Fri, 16 Mar 2018 12:10:40 -0400

git-annex (6.20180227) upstream; urgency=medium

inprogress: Avoid showing failures for files not in progress.
Added INFO to external special remote protocol.
Added EXTENSIONS to external special remote protocol.
datalad < 0.9.1 had a problem in its special remote protocol handling which is broken by EXTENSIONS. Make the debian git-annex package conflict with the problem version of datalad.
fsck: Warn when required content is not present in the repository that requires it.
Add gpg-agent to Build-Depends. Needed to run the test suite.
--json: When there are multiple lines of notes about a file, make the note field multiline, rather than the old behavior of only including the last line.
git-annex.cabal: Once more try to not build the assistant on the hurd, hopefully hackage finally recognises that OS.
Split Test.hs and avoid optimising it much, to need less memory to compile.
Fix behavior of --json-progress followed by --json, the latter option used to disable the former.
Added --json-error-messages option, which makes messages that would normally be output to standard error be included in the json output.
Remove temporary code added in 6.20160619 to prime the mergedrefs log.
importfeed: Fix a failure when downloading with youtube-dl and the destination subdirectory does not exist yet.
Added annex.merge-annex-branches config setting which can be used to disable automatic merge of git-annex branches.
tips/automatically_adding_metadata/pre-commit-annex: Fix to not silently skip filenames containing non-ascii characters.
sync: Fix bug that prevented pulling changes into direct mode repositories that were committed to remotes using git commit rather than git-annex sync.
Makefile: Remove chrpath workaround for bug in cabal, which is no longer needed.

-- Joey Hess id@joeyh.name Tue, 27 Feb 2018 12:04:52 -0400

git-annex (6.20180112) upstream; urgency=medium

Added inprogress command for accessing files as they are being downloaded.
Fix bug introduced in version 6.20171018 that caused some commands to print out "ok" twice after processing a file.
addurl: When the file youtube-dl will download is already an annexed file, don't download it again and fail to overwrite it, instead just do nothing, like it used to when quvi was used.
addurl: Fix encoding of filename queried from youtube-dl when in --fast mode.
Fix several places where files in .git/annex/ were written with modes that did not take the core.sharedRepository config into account.
Improve startup time for commands that do not operate on remotes, and for tab completion, by not unnessessarily statting paths to remotes, which used to cause eg, spin-up of removable drives.
Added remote..annex-checkuuid config, which can be set to false to disable the default checking of the uuid of remotes that point to directories. This can be useful to avoid unnecessary drive spin-ups and automounting.
git-annex.cabal: Add back custom-setup stanza, so cabal new-build works.
git-annex.cabal: Removed the testsuite build flag; test suite is always included.

-- Joey Hess id@joeyh.name Fri, 12 Jan 2018 15:45:48 -0400

git-annex (6.20171214) upstream; urgency=medium

Use youtube-dl rather than quvi to download media from web pages, since quvi is not being actively developed and youtube-dl supports many more sites.
addurl --relaxed got slower, since youtube-dl has to hit the network to check for embedded media. If you relied on --relaxed not hitting the network for speed reasons, using --relaxed --raw will get the old level of speed, but can't be used for urls with embedded videos.
importfeed now downloads things linked to by feeds, even when they are not media files.
Removed no longer needed dependency on yesod-default.
Allow exporttree remotes to be marked as dead.
initremote, enableremote: Really support gpg subkeys suffixed with an exclamation mark, which forces gpg to use a specific subkey. (Previous try had a bug.)
lookupkey: Support being given an absolute filename to a file within the current git repository.
A top-level .noannex file will prevent git-annex init from being used in a repository. This is useful for repositories that have a policy reason not to use git-annex. The content of the file will be displayed to the user who tries to run git-annex init.

-- Joey Hess id@joeyh.name Thu, 14 Dec 2017 11:50:48 -0400

git-annex (6.20171124) unstable; urgency=medium

Display progress meter when uploading a key without size information, getting the size by statting the content file.
Fix build with dns-3.0.

-- Joey Hess id@joeyh.name Fri, 24 Nov 2017 10:49:36 -0400

git-annex (6.20171109) unstable; urgency=medium

Fix export of subdir of a branch.
Fix exporting of non-annexed files to external special remotes.
unlock, lock: Support --json.
When there are multiple urls for a file, still treat it as being present in the web when some urls don't work, as long as at least one url does work.
Makefile improvement for sudo make install. Thanks, Eric Siegerman
Makefile improvement for BUILDER=stack, use stack to run ghc.
testremote: Test exporttree.
Fix directory special remote's cleanup of empty export directories.

-- Joey Hess id@joeyh.name Thu, 09 Nov 2017 12:21:49 -0400

git-annex (6.20171026) unstable; urgency=medium

Windows: Fix reversion that caused the path used to link to annexed content to include the drive letter and full path, rather than being relative. (git annex fix will fix up after this problem).
Windows build fixed, and changed to use stack for more reliable build environment.
Windows: Remove wget from bundle; it needs libraries that are not included, and git for windows includes curl which git-annex will use instead.
Add day to metadata when annex.genmetadata is enabled. Thanks, Sean T Parsons
stack.yaml: Added nix packages section. Thanks, Sean T Parsons

-- Joey Hess id@joeyh.name Thu, 26 Oct 2017 13:56:18 -0400

git-annex (6.20171018) unstable; urgency=medium

add: Replace work tree file atomically on systems supporting hard links. Avoids a window where interrupting an add could result in the file being moved into the annex, with no symlink yet created.
webdav: Avoid unncessisarily creating the collection at the top of the repository when storing files there, since that collection is created by initremote. (This seems to work around some brokenness of the box.com webdav server, which caused uploads to be very slow or sometimes fail.)
webdav: Make --debug show all webdav operations.
get -J/move -J/copy -J/mirror -J/sync -J: Avoid "transfer already in progress" errors when two files use the same key.
Konqueror desktop file location changed to one used by plasma 5. Thanks, Félix Sipma.
Avoid repeated checking that files passed on the command line exist.
Fix build with aws-0.17.
stack.yaml: Update to lts-9.9.

-- Joey Hess id@joeyh.name Wed, 18 Oct 2017 15:40:06 -0400

git-annex (6.20171003) unstable; urgency=medium

webdav: Improve error message for failed request to include the request method and path.
metadata: Added --remove-all.
Warn when metadata is inherited from a previous version of a file, to avoid the user being surprised in cases where that behavior is not desired or expected.
sync: Added --cleanup, which removes local and remote synced/ branches.
external: When the external special remote program crashed, a newline could be output, which messed up the expected output for --batch mode.
external: Avoid checking EXPORTSUPPORTED for special remotes that are not configured to use exports.
test: Fix reversion that made it only run inside a git repository.
copy, move: Behave same with --fast when sending to remotes located on a local disk as when sending to other remotes.
Fix process and file descriptor leak that was exposed when git-annex was built with ghc 8.2.1. Broke git-annex test on OSX due to running out of FDs, and may have also leaked in other situations.
info: Improve cleanup of stale transfer info files.

-- Joey Hess id@joeyh.name Tue, 03 Oct 2017 13:18:15 -0400

git-annex (6.20170925) unstable; urgency=medium

git-annex export: New command, can create and efficiently update exports of trees to special remotes.
Use git-annex initremote with exporttree=yes to set up a special remote for use by git-annex export.
Implemented export to directory, S3, and webdav special remotes.
External special remote protocol extended to support export. Developers of external special remotes should consider if export makes sense for them and add support.
sync, assistant: Update tracking exports.
Support building with feed-1.0, while still supporting older versions.
init: Display an additional message when it detects a filesystem that allows writing to files whose write bit is not set.
S3: Allow removing files from IA.
webdav: Checking if a non-existent file is present on Box.com triggered a bug in its webdav support that generates an infinite series of redirects. Deal with such problems by assuming such behavior means the file is not present.
webdav: Fix lack of url-escaping of filenames. Mostly impacted exports of filenames containing eg spaces.
webdav: Changed path used on webdav server for temporary files.

-- Joey Hess id@joeyh.name Mon, 25 Sep 2017 11:13:58 -0400

git-annex (6.20170818) unstable; urgency=high

Security fix: Disallow hostname starting with a dash, which would get passed to ssh and be treated an option. This could be used by an attacker who provides a crafted repository url to cause the victim to execute arbitrary code via -oProxyCommand. CVE-2017-12976 (The same class of security hole recently affected git itself.)
git-annex.cabal: Deal with breaking changes in Cabal 2.0.
Fix build with QuickCheck 2.10.
fsck: Support --json.
move, copy: Support --batch.
Added GIT_ANNEX_VECTOR_CLOCK environment variable, which can be used to override the default timestamps used in log files in the git-annex branch. This is a dangerous environment variable; use with caution.
Fix a git-annex test failure when run on NFS due to NFS lock files preventing directory removal.
test: Avoid most situations involving failure to delete test directories, by forking a worker process and only deleting the test directory once it exits.
Disable http-client's default 30 second response timeout when HEADing an url to check if it exists. Some web servers take quite a long time to answer a HEAD request.
Added remote configuration settings annex-ignore-command and annex-sync-command, which are dynamic equivilants of the annex-ignore and annex-sync configurations.
Prevent spaces from being embedded in the name of new WORM keys, as that handing spaces in keys would complicate things like the external special remote protocol.
migrate: WORM keys containing spaces will be migrated to not contain spaces anymore.
External special remotes will refuse to operate on keys with spaces in their names. That has never worked correctly due to the design of the external special remote protocol. Display an error message suggesting migration.
Fix incorrect external special remote documentation, which said that the filename parameter to the TRANSFER command could not contain spaces. It can in fact contain spaces. Special remotes implementors that relied on that may need to fix bugs in their special remotes.
Fix the external special remotes git-annex-remote-ipfs, git-annex-remote-torrent and the example.sh template to correctly support filenames with spaces.
Windows: Win32 package has subsumed Win32-extras; update dependency.

-- Joey Hess id@joeyh.name Fri, 18 Aug 2017 11:19:06 -0400

git-annex (6.20170520) unstable; urgency=medium

move --to=here moves from all reachable remotes to the local repository.
initremote, enableremote: Support gpg subkeys suffixed with an exclamation mark, which forces gpg to use a specific subkey.
Improve progress display when watching file size, in cases where a transfer does not resume.
Fix transfer log file locking problem when running concurrent transfers.
Avoid concurrent git-config setting problem when running concurrent threads.
metadata: When setting metadata of a file that did not exist, no error message was displayed, unlike getting metadata and most other git-annex commands. Fixed this oversight.
Added annex.resolvemerge configuration, which can be set to false to disable the usual automatic merge conflict resolution done by git-annex sync and the assistant.
sync: Added --no-resolvemerge option.
Avoid error about git-annex-shell not being found when syncing with -J with a git remote where git-annex-shell is not installed.
Fix bug that prevented transfer locks from working when run on SMB or other filesystem that does not support fcntl locks and hard links.
assistant: Merge changes from refs/remotes/foo/master into master. Previously, only sync branches were merged. This makes regular git push into a repository watched by the assistant auto-merge.
Makefile: Install completions for the fish and zsh shells when git-annex is built with optparse-applicative-0.14.
assistant: Don't trust OSX FSEvents's eventFlagItemModified to be called when the last writer of a file closes it; apparently that sometimes does not happen, which prevented files from being quickly added.

-- Joey Hess id@joeyh.name Mon, 12 Jun 2017 13:37:16 -0400

git-annex (6.20170519) unstable; urgency=medium

Ssh password prompting improved when using -J for concurrency. When ssh connection caching is enabled (and when GIT_ANNEX_USE_GIT_SSH is not set), only one ssh password prompt will be made per host, and only one ssh password prompt will be made at a time.
When built with concurrent-output 1.9, ssh password prompts will no longer interfere with the -J display.
Removed dependency on MissingH, instead depending on the split library.
Progress is displayed for transfers of files of unknown size.
Work around bug in git 2.13.0 involving GIT_COMMON_DIR that broke merging changes into adjusted branches.

-- Joey Hess id@joeyh.name Fri, 19 May 2017 10:37:57 -0400

git-annex (6.20170510) unstable; urgency=medium

When a http remote does not expose an annex.uuid config, only warn about it once, not every time git-annex is run.
multicast: New command, uses uftp to multicast annexed files, for eg a classroom setting.
Added remote..annex-push and remote..annex-pull which can be useful to make remotes that don't get fully synced with local changes.
Disable git-annex's support for GIT_SSH and GIT_SSH_COMMAND, unless GIT_ANNEX_USE_GIT_SSH=1 is also set in the environment. This is necessary because as feared, the extra -n parameter that git-annex passes breaks uses of these environment variables that expect exactly the parameters that git passes.
enableremote: When enabling a non-special remote, param=value parameters can't be used, so error out if any are provided.
enableremote: Fix re-enabling of special remotes that have a git url, so that eg, encryption key changes take effect. They were silently ignored, a reversion introduced in 6.20160527.
gcrypt: Support re-enabling to change eg, encryption parameters. This was never supported before.
git annex add -u now supported, analagous to git add -u
version: Added "dependency versions" line.
Keys marked as dead are now skipped by --all.
annex.backend is the new name for what was annex.backends, and takes a single key-value backend, rather than the unnecessary and confusing list. The old option still works if set.

-- Joey Hess id@joeyh.name Wed, 10 May 2017 15:05:22 -0400

git-annex (6.20170321) unstable; urgency=medium

Bugfix: Passing a command a filename that does not exist sometimes did not display an error, when a path to a directory was also passed.
status: Propigate nonzero exit code from git status.
Linux standalone builds put the bundled ssh last in PATH, so any system ssh will be preferred over it.
assistant: Add 1/200th second delay between checking each file in the full transfer scan, to avoid using too much CPU.
get -J: Improve distribution of jobs amoung remotes when there are more jobs than remotes.
fsck -q: When a file has bad content, include the name of the file in the warning message.
Windows: Improve handling of shebang in external special remote program, searching for the program in the PATH.
Drop support for building with old versions of dns, http-conduit, directory, feed, and http-types.
Windows: Fix bug in shell script shebang lookup code that caused a "delayed read on closed handle" error.
git-annex-shell: Fix bug when used with a recently cloned repository, where "merging" messages were included in the output of configlist (and perhaps other commands) and caused a "Failed to get annex.uuid configuration" error.
Support GIT_SSH and GIT_SSH_COMMAND, which are handled close the same as they are by git. However, unlike git, git-annex sometimes needs to pass the -n parameter when using these.
sync --content-of=path (-C path) added for when you want to sync only some files' contents, not the whole working tree.

-- Joey Hess id@joeyh.name Tue, 21 Mar 2017 11:27:38 -0400

git-annex (6.20170301.1) unstable; urgency=medium

Fix reversion in yesterday's release that made SHA1E and MD5E backends not work.

-- Joey Hess id@joeyh.name Wed, 01 Mar 2017 12:46:03 -0400

git-annex (6.20170301) unstable; urgency=medium

No changes from 6.20170228; a new version number was needed due to a problem with Hackage.

-- Joey Hess id@joeyh.name Wed, 01 Mar 2017 12:06:02 -0400

git-annex (6.20170228) unstable; urgency=medium

Cryptographically secure hashes can be forced to be used in a repository, by setting annex.securehashesonly. This does not prevent the git repository from containing links to insecure hashes, but it does prevent the content of such files from being added to .git/annex/objects by any method.
Tighten key parser to prevent SHA1 collision attacks generating two keys that have the same SHA1. (Only done for keys that contain a hash). This ensures that signed git commits of annexed files will remain secure, as long as git-annex is using a secure hashing backend.
fsck: Warn about any files whose content is present, that don't use secure hashes, when annex.securehashesonly is set.
init: When annex.securehashesonly has been set with git-annex config, copy that value to the annex.securehashesonly git config.
Added --securehash option to match files using a secure hash function, and corresponding securehash preferred content expression.
sync, merge: Fail when the current branch has no commits yet, instead of not merging in anything from remotes and appearing to succeed.
Run ssh with -n whenever input is not being piped into it, to avoid it consuming stdin that it shouldn't. This fixes git-annex-checkpresentkey --batch remote, which didn't output results for all keys passed into it. Other git-annex commands that communicate with a remote over ssh may also have been consuming stdin that they shouldn't have, which could have impacted using them in eg, shell scripts.
sync: Improve integration with receive.denyCurrentBranch=updateInstead, displaying error messages from the remote then it fails to update its checked out branch.
Added post-recieve hook, which makes updateInstead work with direct mode and adjusted branches.
init: Set up the post-receive hook.
sync: When syncing with a local repository located on a crippled filesystem, run the post-receive hook there, since it wouldn't get run otherwise. This makes pushing to repos on FAT-formatted removable drives update them when receive.denyCurrentBranch=updateInstead.
config group groupwanted numcopies schedule wanted required: Avoid displaying extraneous messages about repository auto-init, git-annex branch merging, etc, when being used to get information.
adjust: Fix behavior when used in a repository that contains submodules.
Run wget with -nv instead of -q, so it will display HTTP errors.
Run curl with -S, so HTTP errors are displayed, even when it's otherwise silent.
When downloading in --json or --quiet mode, use curl in preference to wget, since curl is able to display only errors to stderr, unlike wget.
status: Pass --ignore-submodules=when option on to git status.
config --set: As well as setting value in git-annex branch, set local gitconfig. This is needed especially for annex.securehashesonly, which is read only from local gitconfig and not the git-annex branch.
Removed support for building with the old cryptohash library. Building with that library made git-annex not support SHA3; it's time for that to always be supported in case SHA2 dominoes.
git-annex.cabal: Make crypto-api a dependency even when built w/o webapp and test suite.

-- Joey Hess id@joeyh.name Tue, 28 Feb 2017 14:39:47 -0400

git-annex (6.20170214) unstable; urgency=medium

Increase default cost for p2p remotes from 200 to 1000. This makes git-annex prefer transferring data from special remotes when possible.
Remove -j short option for --json-progress; that option was already taken for --json.
vicfg: Include the numcopies configuation.
config: New command for storing configuration in the git-annex branch.
annex.autocommit can be configured via git-annex config, to control the default behavior in all clones of a repository.
New annex.synccontent config setting, which can be set to true to make git annex sync default to --content. This may become the default at some point in the future. As well as being configuable by git config, it can be configured by git-annex config to control the default behavior in all clones of a repository.
stack.yaml: Update to lts-7.18.
Some optimisations to string splitting code.
unused: When large files are checked right into git, avoid buffering their contents in memory.
unused: Improved memory use significantly when there are a lot of differences between branches.
Wormhole pairing will start to provide an appid to wormhole on 2021-12-31. An appid can't be provided now because Debian stable is going to ship a older version of git-annex that does not provide an appid. Assumption is that by 2021-12-31, this version of git-annex will be shipped in a Debian stable release. If that turns out to not be the case, this change will need to be cherry-picked into the git-annex in Debian stable, or its wormhole pairing will break.
Fix build with aws 0.16. Thanks, aristidb.
assistant: Make --autostart --foreground wait for the children it starts. Before, the --foreground was ignored when autostarting.
initremote: When a uuid= parameter is passed, use the specified UUID for the new special remote, instead of generating a UUID. This can be useful in some situations, eg when the same data can be accessed via two different special remote backends.
import: Changed how --deduplicate, --skip-duplicates, and --clean-duplicates determine if a file is a duplicate. Before, only content known to be present somewhere was considered a duplicate. Now, any content that has been annexed before will be considered a duplicate, even if all annexed copies of the data have been lost. Note that --clean-duplicates and --deduplicate still check numcopies, so won't delete duplicate files unless there's an annexed copy.
import: --deduplicate and --skip-duplicates were implemented inneficiently; they unncessarily hashed each file twice. They have been improved to only hash once.
import: Added --reinject-duplicates.
Added git template directory to Linux standalone tarball and OSX app bundle.
Improve pid locking code to work on filesystems that don't support hard links.
S3: Fix check of uuid file stored in bucket, which was not working.
Work around sqlite's incorrect handling of umask when creating databases.

-- Joey Hess id@joeyh.name Tue, 14 Feb 2017 14:22:00 -0400

git-annex (6.20170101) unstable; urgency=medium

XMPP support has been removed from the assistant in this release. If your repositories used XMPP to keep in sync, that will no longer work, and you should enable some other remote to keep them in sync. A ssh server is one way, or use the new Tor pairing feature.
p2p --pair makes it easy to pair repositories, over Tor, using Magic Wormhole codes to find the other repository. See http://git-annex.branchable.com/tips/peer_to_peer_network_with_tor/
webapp: The "Share with a friend" and "Share with your other devices" pages have been changed to pair repositories using Tor and Magic Wormhole.
metadata --batch: Fix bug when conflicting metadata changes were made in the same batch run.
Pass annex.web-options to wget and curl after other options, so that eg --no-show-progress can be set by the user to disable the default --show-progress.
Revert ServerAliveInterval change in 6.20161111, which caused problems with too many old versions of ssh and unusual ssh configurations. It should have not been needed anyway since ssh is supposted to have TCPKeepAlive enabled by default.
Make all --batch input, as well as fromkey and registerurl stdin be processed without requiring it to be in the current encoding.
p2p: --link no longer takes a remote name, instead the --name option can be used.
Linux standalone: Improve generation of locale definition files, supporting locales such as en_GB.UTF-8.
rekey --force: Incorrectly marked the new key's content as being present in the local repo even when it was not.
enable-tor: Put tor sockets in /var/lib/tor-annex/, rather than in /etc/tor/hidden_service/.
enable-tor: No longer needs to be run as root.
enable-tor: When run as a regular user, also tests a connection back to the hidden service over tor.
Support all common locations of the torrc file.
Always use filesystem encoding for all file and handle reads and writes.
Fix build with directory-1.3.
Debian: Suggest tor and magic-wormhole.
Debian: Build webapp on armel.

-- Joey Hess id@joeyh.name Sat, 31 Dec 2016 15:11:04 -0400

git-annex (6.20161210) unstable; urgency=medium

Linux standalone: Updated ghc to fix its "unable to decommit memory" bug, which may have resulted in data loss when these builds were used with Linux kernels older than 4.5.
enable-tor: New command, enables tor hidden service for P2P syncing.
p2p: New command, allows linking repositories using a P2P network.
remotedaemon: Serve tor hidden service.
Added git-remote-tor-annex, which allows git pull and push to the tor hidden service.
remotedaemon: Fork to background by default. Added --foreground switch to enable old behavior.
addurl: Fix bug in checking annex.largefiles expressions using largerthan, mimetype, and smallerthan; the first two always failed to match, and the latter always matched.
Relicense 5 source files that are not part of the webapp from AGPL to GPL.
map: Run xdot if it's available in PATH. On OSX, the dot command does not support graphical display, while xdot does.
Debian: xdot is a better interactive viewer than dot, so Suggest xdot, rather than graphviz.
rmurl: Multiple pairs of files and urls can be provided on the command line.
rmurl: Added --batch mode.
fromkey: Accept multiple pairs of files and keys. Thanks, Daniel Brooks.
rekey: Added --batch mode.
add: Stage modified non-large files when running in indirect mode. (This was already done in v6 mode and direct mode.)
git-annex-shell, remotedaemon, git remote: Fix some memory DOS attacks.
Fix build with http-client 0.5. Thanks, Alper Nebi Yasak.

-- Joey Hess id@joeyh.name Sat, 10 Dec 2016 11:56:25 -0400

git-annex (6.20161118) unstable; urgency=medium

git-annex.cabal: Loosen bounds on persistent to allow 2.5, which on Debian has been patched to work with esqueleto. This may break cabal's resolver on non-Debian systems; if so, either use stack to build, or run cabal with --constraint='persistent ==2.2.4.1' Hopefully this mess with esqueleto will be resolved soon.
sync: Pass --allow-unrelated-histories to git merge when used with git git 2.9.0 or newer. This makes merging a remote into a freshly created direct mode repository work the same as it works in indirect mode.
Avoid backtraces on expected failures when built with ghc 8; only use backtraces for unexpected errors.
fsck --all --from was checking the existence and content of files in the local repository, rather than on the special remote. Oops.
Linux arm standalone: Build with a 32kb page size, which is needed on several ARM NAS devices, including Drobo 5N, and WD NAS.

-- Joey Hess id@joeyh.name Fri, 18 Nov 2016 11:43:14 -0400

git-annex (6.20161111) unstable; urgency=medium

Restarting a crashing git process could result in filename encoding issues when not in a unicode locale, as the restarted processes's handles were not read in raw mode.
Make .git/annex/ssh.config file work with versions of ssh older than 7.3, which don't support Include. When used with an older version of ssh, any ServerAliveInterval in ~/.ssh/config will be overridden by .git/annex/ssh.config.
S3: Support the special case endpoint needed for the cn-north-1 region.
Webapp: Don't list the Frankfurt S3 region, as this (and some other new regions) need V4 authorization which the aws library does not yet use.
reinject --known: Avoid second, unnecessary checksum of file.
OSX: Remove RPATHs from git-annex binary, which are not needed, slow down startup, and break the OSX Sierra linker.
webapp: Explicitly avoid checking for auth in static subsite requests. Yesod didn't used to do auth checks for that, but this may have changed.
Linux standalone: Avoid using hard links in the tarball so it can be untarred on eg, afs which does not support them.

-- Joey Hess id@joeyh.name Fri, 11 Nov 2016 14:46:39 -0400

git-annex (6.20161031) unstable; urgency=medium

Assistant, repair: Fix ignoring of git fsck errors due to duplicate file entries in tree objects.
Linux standalone: Fix location of locale files in the bundle.
Fix reversion in 6.20161012 that prevented adding files with a space in their name.

-- Joey Hess id@joeyh.name Mon, 31 Oct 2016 18:55:59 -0400

git-annex (6.20161027) unstable; urgency=medium

lock, smudge: Fix edge cases where data loss could occur in v6 mode when the keys database was not populated.
upgrade: Handle upgrade to v6 when the repository already contains v6 unlocked files whose content is already present.
Improve style of offline html build of website.
importfeed: Drop URL parameters from file extension. Thanks, James MacMahon.
Assistant, repair: Improved filtering out of git fsck lines about duplicate file entries in tree objects.
test: Deal with gpg-agent behavior change that broke the test suite.
Improve ssh socket cleanup code to skip over the cruft that NFS sometimes puts in a directory when a file is being deleted.
If a transfer fails for some reason, but some data managed to be sent, the transfer will be retried. (The assistant already did this.)
Run ssh with ServerAliveInterval 60, so that stalled transfers will be noticed within about 3 minutes. (Any setting in your ~/.ssh/config or /etc/ssh/ssh_config overrides this.)

-- Joey Hess id@joeyh.name Thu, 27 Oct 2016 15:21:58 -0400

git-annex (6.20161012) unstable; urgency=medium

Optimisations to time it takes git-annex to walk working tree and find files to work on. Sped up by around 18%.
Optimisations to git-annex branch query and setting, avoiding repeated copies of the environment. Speeds up commands like "git-annex find --in remote" by over 50%.
Optimised git-annex branch log file timestamp parsing.
Add "total-size" field to --json-progress output.
Make --json-progress output be shown even when the size of a object is not known.
Multiple external special remote processes for the same remote will be started as needed when using -J. This should not beak any existing external special remotes, because running multiple git-annex commands at the same time could already start multiple processes for the same external special remotes.
Linux standalone: Include locale files in the bundle, and generate locale definition files for the locales in use when starting runshell. (Currently only done for utf-8 locales.)
Avoid using a lot of memory when large objects are present in the git repository and have to be checked to see if they are a pointed to an annexed file. Cases where such memory use could occur included, but were not limited to:
- git commit -a of a large unlocked file (in v5 mode)
- git-annex adjust when a large file was checked into git directly
When auto-upgrading a v3 remote, avoid upgrading to version 6, instead keep it at version 5.
Support using v3 repositories without upgrading them to v5.
sync: Fix bug in adjusted branch merging that could cause recently added files to be lost when updating the adjusted branch.

-- Joey Hess id@joeyh.name Wed, 12 Oct 2016 09:37:41 -0400

git-annex (6.20160923) unstable; urgency=medium

Rate limit console progress display updates to 10 per second. Was updating as frequently as changes were reported, up to hundreds of times per second, which used unnecessary bandwidth when running git-annex over ssh etc.
Make --json and --quiet work when used with -J. Previously, -J override the other options.
addurl, get: Added --json-progress option, which adds progress objects to the json output.
Remove key:null from git-annex add --json output.
copy, move, mirror: Support --json and --json-progress.
Improve gpg secret key list parser to deal with changes in gpg 2.1.15. Fixes key name display in webapp.
info: Support being passed a treeish, and show info about the annexed files in it similar to how a directory is handled.
sync: Previously, when run in a branch with a slash in its name, such as "foo/bar", the sync branch was "synced/bar". That conflicted with the sync branch used for branch "bar", so has been changed to "synced/foo/bar".
Note that if you're using an old version of git-annex to sync with a branch with a slash in its name, it won't see some changes synced by this version, and this version won't see some changes synced by the older version. This is not a problem if there's a central bare repository, but may impact other configurations until git-annex is upgraded to this version.
adjust: Previously, when adjusting a branch with a slash in its name, such as "foo/bar", the adjusted branch was "adjusted/bar(unlocked)". That conflicted with the adjusted branch used for branch "bar", so has been changed to "adjusted/foo/bar(unlocked)"
Also, running sync in an adjusted branch did not correctly sync changes back to the parent branch when it had a slash in its name. This bug has been fixed.
addurl, importfeed: Improve behavior when file being added is gitignored.

-- Joey Hess id@joeyh.name Fri, 23 Sep 2016 09:43:26 -0400

git-annex (6.20160907) unstable; urgency=medium

Windows: Handle shebang in external special remote program.
Fix formatting of git-annex-smudge man page, and improve mdwn2man. Thanks, Jim Paris.
examimekey: Allow being run in a git repo that is not initialized by git-annex yet.
Android: Fix disabling use of cp --reflink=auto, curl, sha224, and sha384.
Make --json and --quiet suppress automatic init messages, and any other messages that might be output before a command starts. Fixes a reversion introduced in version 5.20150727.
Assistant, repair: Filter out git fsck lines about duplicate file entries in tree objects.
get -J, sync --content -J: Download different files from different remotes when the remotes have the same costs.

-- Joey Hess id@joeyh.name Wed, 07 Sep 2016 11:12:11 -0400

git-annex (6.20160808) unstable; urgency=medium

metadata --json output format has changed, adding a inner json object named "fields" which contains only the fields and their values. This should be easier to parse than the old format, which mixed up metadata fields with other keys in the json object. Any consumers of the old format will need to be updated.
Added metadata --batch option, which allows getting, setting, deleting, and modifying metadata for multiple files/keys.
Added --branch option to copy, drop, fsck, get, metadata, mirror, move, and whereis commands. This option makes git-annex operate on files that are included in a specified branch (or other treeish).
git-annex.cabal: Temporarily limit to http-conduit <2.2.0 since aws 0.14.0 is not compatible with the newer version.
git-annex.cabal: Temporarily limit to persistent <2.5 since esqueleto 2.4.3 is not compatible with the newer version.
Removed dependency on json library; all JSON is now handled by aeson.
When built with uuid-1.3.12, generate more random UUIDs than before. (However, this did not impact git-annex much, so a hard depedency has not been added on uuid-1.3.12.)
info: When run on a file now includes an indication of whether the content is present locally.
get, move, copy, mirror: Added --failed switch which retries failed copies/moves.
Re-enable accumulating transfer failure log files for command-line actions (disabled in 5.20150522), and remove the log files after successful transfers.

-- Joey Hess id@joeyh.name Mon, 08 Aug 2016 11:42:17 -0400

git-annex (6.20160619) unstable; urgency=medium

get, drop: Add --batch and --json options.
testremote: Fix crash when testing a freshly made external special remote.
Remove unnecessary rpaths in the git-annex binary, but only when it's built using make, not cabal. This speeds up git-annex startup time by around 50%.
Speed up startup time by caching the refs that have been merged into the git-annex branch. This can speed up git-annex commands by as much as a second, depending on the number of remotes.
fsck: Fix a reversion in direct mode fsck of a file that is present when the location log thinks it is not. Reversion introduced in version 5.20151208.
uninit: Fix crash due to trying to write to deleted keys db. Reversion introduced by v6 mode support, affects v5 too.
Fix a similar crash when the webapp is used to delete a repository.
Support checking presence of content at a http url that redirects to a ftp url.
log: Added --all option.
New url for git-remote-gcrypt, now maintained by spwhitton.
webapp: Don't allow deleting a remote that has syncing disabled, as such a deletion will never finish. Thanks, Farhan Kathawala.
webapp: Escape unusual characters in ssh hostnames when generating mangled hostnames. This allows IPv6 addresses to be used on filesystems not supporting : in filenames.
Avoid any access to keys database in v5 mode repositories, which are not supposed to use that database.
Remove the EKG build flag, since Gentoo for some reason decided to enable this flag, depsite it not being intended for production use and so disabled by default.

-- Joey Hess id@joeyh.name Tue, 19 Jul 2016 14:17:54 -0400

git-annex (6.20160613) unstable; urgency=medium

Improve SHA*E extension extraction code.
Windows: Avoid terminating git-annex branch lines with \r\n when union merging and performing transitions.
Remove Makefile from cabal tarball; man page building is now handled by a small haskell program.
sync --content: Fix bug that caused transfers of files to be made to a git remote that does not have a UUID. This particularly impacted clones from gcrypt repositories.
Pass -S to git commit-tree when commit.gpgsign is set and when making a non-automatic commit, in order to preserve current behavior when used with git 2.9, which has stopped doing this itself.
remotedaemon: Fixed support for notifications of changes to gcrypt remotes, which was never tested and didn't quite work before.
list: Do not include dead repositories.
move --to: Better behavior when system is completely out of disk space; drop content from disk before writing location log.
Avoid a crash if getpwuid does not work, when querying the user's full name.
Automatically enable v6 mode when initializing in a clone from a repo that has an adjusted branch checked out.
v6: Fix initialization of a bare clone of a repo that has an adjusted branch checked out.
v6: Fix bad automatic merge conflict resolution between an annexed file and a directory with the same name when in an adjusted branch.
v6: Fix bad merge in an adjusted branch that resulted in an empty tree.
v6: Fix bug in initialization of clone from a repo with an adjusted branch that had not been synced back to master. (This bug caused broken tree objects to get built by a later git annex sync.)
v6: Make lock and unlock work on files whose content is not present.
v6: Fix update of associated files db when unlocking a file.
v6: Make git clean filter preserve the backend that was used for a file.

-- Joey Hess id@joeyh.name Mon, 13 Jun 2016 14:57:38 -0400

git-annex (6.20160527) unstable; urgency=medium

Split lines in the git-annex branch on \r as well as \n, to deal with \r\n terminated lines written by some versions of git-annex on Windows. This fixes strange displays in some cases.
assistant: Fix bug that caused v6 pointer files to be annexed by the assistant.
assistant: Fix race in v6 mode that caused downloaded file content to sometimes not replace pointer files.
add: Adding a v6 pointer file used to annex it; now the pointer file is added to git as-is. (git add of a pointer file already did the right thing)
enableremote: Can now be used to explicitly enable git-annex to use git remotes. Using the command this way prevents other git-annex commands from probing new git remotes to auto-enable them.
enableremote: Remove annex-ignore configuration from a remote.
Change git annex info remote encryption description to use wording closer to what's used in initremote.
Pass the various gnupg-options configs to gpg in several cases where they were not before. Most notably, gnupg-decrypt-options is now passed when decrypting an encrypted cipher.
adjust: Add --fix adjustment, which is useful when the git directory is in a nonstandard place.
adjust: If the adjusted branch already exists, avoid overwriting it, since it might contain changes that have not yet been propigated to the original branch.
Work around git weirdness in handling of relative path to GIT_INDEX_FILE when in a subdirectory of the repository. This affected git annex view.
Fix crash when entering/changing view in a subdirectory of a repo that has a dotfile in its root.
webapp: Avoid confusing display of dead remotes.
Support building with ghc 8.0.1.
Updated cabal file explicitly lists source files. The tarball on hackage will include only the files needed for cabal install; it is NOT the full git-annex source tree.
debian/changelog, debian/NEWS, debian/copyright: Converted to symlinks to CHANGELOG, NEWS, and COPYRIGHT, which used to symlink to these instead.

-- Joey Hess id@joeyh.name Fri, 27 May 2016 11:48:36 -0400

git-annex (6.20160511) unstable; urgency=medium

Fix bug that sometimes prevented git-annex smudge --clean from consuming all its input, which resulted in git add bypassing git-annex.
Fix build with directory-1.2.6.2.
Improve behavior when a just added http remote is not available during uuid probe. Do not mark it as annex-ignore, so it will be tried again later.
Android: Icon refresh. Thanks, freewheelinfranks.
Added DIRHASH-LOWER to external special remote protocol.
git-annex.cabal: Add Setup-Depends.
stack.yaml: Enable explicit-setup-deps.
Windows: Fix several bugs in propigation of changes from the adjusted branch back to the master branch.
Windows: Fix an over-long temp directory name.
map: Hide dead repositories that are not connected to the graph.
map: Changed colors; red is used for untrusted repositories and grey for dead.
version: Display OS version and architecture too.
Propigate GIT_DIR and GIT_WORK_TREE environment to external special remotes.
Added annex.gnupg-decrypt-options and remote..annex-gnupg-decrypt-options, which are passed to gpg when it's decrypting data.
fsck: When a key is not previously known in the location log, record something so that reinject --known will work.
In the unusual configuration where annex.crippledfilesystem=true but core.symlinks=true, store object contents in mixed case hash directories so that symlinks will point to them.
Added new encryption=sharedpubkey mode for special remotes. This is useful for makking a special remote that anyone with a clone of the repo and your public keys can upload files to, but only you can decrypt the files stored in it.

-- Joey Hess id@joeyh.name Wed, 11 May 2016 12:41:42 -0400

git-annex (6.20160419) unstable; urgency=medium

Fix bug that prevented resuming of uploads to encrypted special remotes that used chunking.
That bug could also expose the names of keys to such remotes, so it is a minor security issue.
Fix duplicate progress meter display when downloading from a git remote over http with -J.
reinject: When src file's content cannot be verified, leave it alone, instead of deleting it.
reinject: Added new mode which can reinject known files into the annex. For example: git-annex reinject --known /mnt/backup/*
calckey: New plumbing command, calculates the key that would be used to refer to a file.
Fix bug that prevented annex.sshcaching=false configuration from taking effect when on a crippled filesystem. Thanks, divergentdave.
git 2.9.0 is going to prevent git merge from merging in unrelated branches. Since the webapp's pairing etc features often combine together repositories with unrelated histories, work around this behavior change when the assistant merges, by passing --allow-unrelated-histories. Note though that this is not done for git annex sync's merges, so it will follow git's default or configured behavior.
When git-annex is used with a git version older than 2.2.0, disable support for adjusted branches, since GIT_COMMON_DIR is needed to update them and was first added in that version of git.
Avoid setting LOCPATH in linux standalone builds that are built with a ghc that has been fixed to not hang when it cannot find locale files.
Isolate test suite from global git config settings.

-- Joey Hess id@joeyh.name Thu, 28 Apr 2016 09:31:14 -0400

git-annex (6.20160418) unstable; urgency=medium

smudge: Print a warning when annex.thin is set, as git's smudge interface does not allow honoring that configuration.
webapp: When $HOME is a git repository, and has been initialized for use by git-annex, opening the webapp went ahead and ran the assistant there, annexing all files. Since this is almost certianly not desirable, especially when the user is just opening the webapp from a dekstop menu which happens to run it in $HOME, the webapp will now not treat such a $HOME git repository as a git-annex repository.
webapp: Update url to add gitlab.com ssh key.
Fix bug in v6 mode that prevented treating unlocked executable files as annexed. If you have such files, run git annex init --version=6 to update the cache after upgrading to this version of git-annex.
Preserve execute bits of unlocked files in v6 mode.
fsck: Warn when core.sharedRepository is set and an annex object file's write bit is not set and cannot be set due to the file being owned by a different user.
Fix hang when dropping content needs to lock the content on a ssh remote, which occurred when the remote has git-annex version 5.20151019 or newer. (The bug was in the client side; the remote git-annex-shell does not need to be upgraded.)

-- Joey Hess id@joeyh.name Mon, 18 Apr 2016 18:33:52 -0400

git-annex (6.20160412) unstable; urgency=medium

adjust --unlock: Enters an adjusted branch in which all annexed files are unlocked. The v6 equivilant of direct mode, but much cleaner!
Upgrading a direct mode repository to v6 has changed to enter an adjusted unlocked branch. This makes the direct mode to v6 upgrade able to be performed in one clone of a repository without affecting other clones, which can continue using v5 and direct mode.
init --version=6: Automatically enter the adjusted unlocked branch when filesystem doesn't support symlinks.
ddar remote: fix ssh calls Thanks, Robie Basak
log: Display time with time zone.
log --raw-date: Use to display seconds from unix epoch.
v6: Close pointer file handles more quickly, to avoid problems on Windows.
sync: Show output of git commit.
annex.thin and annex.hardlink are now supported on Windows.
unannex --fast now makes hard links on Windows.
Fix bug in annex.largefiles mimetype= matching when git-annex is run in a subdirectory of the repository.
Fix build with ghc v7.11. Thanks, Gabor Greif.

-- Joey Hess id@joeyh.name Tue, 12 Apr 2016 14:53:22 -0400

git-annex (6.20160318) unstable; urgency=medium

metadata: Added -r to remove all current values of a field.
Fix data loss that can occur when annex.pidlock is set in a repository.
Fix bug preventing moving files to/from a repository with annex.pidlock set.
Fix shared lock file FD leak.
Fix metadata hook behavior when multiple files are added at once. Thanks, Klaus Ethgen.
Added dependencies on haskell mountpoints and disk-free-space libraries, removing FFI code from git-annex.
dropkey: Add --batch and --json.
Fix OSX dmg to include libraries needed by bundled gpg, lost in last release.
Always try to thaw content, even when annex.crippledfilesystem is set.
Correct git-annex info to include unlocked files in v6 repository.
Sped up git-annex add in direct mode and v6 by using git hash-object --stdin-paths.
Sped up git-annex merge by using git hash-object --stdin-paths.

-- Joey Hess id@joeyh.name Fri, 18 Mar 2016 11:30:36 -0400

git-annex (6.20160229) unstable; urgency=medium

Update perlmagick build dependency. Closes: #789225
Fix memory leak in last release, which affected commands like git-annex status when a large non-annexed file is present in the work tree.
fsck: When the only copy of a file is in a dead repository, mention the repository.
info: Mention when run in a dead repository.
Linux and OSX standalone builds put the bundled gpg last in PATH, so any system gpg will be preferred over it.
Avoid crashing when built with MagicMime support, but when the magic database cannot be loaded.
Include magic database in the linux and OSX standalone builds.
Fix memory leak when hashing files, which triggered during fsck when an external hash program was not used. (This leak was introduced in version 6.20160114.)
Support --metadata field<number, --metadata field>number etc to match ranges of numeric values.
Similarly, support preferred content expressions like metadata=fieldnumber
The pre-commit-annex hook script that automatically extracts metadata has been updated to also use exiftool. Thanks, Klaus Ethgen.

-- Joey Hess id@joeyh.name Mon, 29 Feb 2016 12:41:49 -0400

git-annex (6.20160217) unstable; urgency=medium

Support getting files from read-only repositories.
checkpresentkey: Allow to be run without an explicit remote.
checkpresentkey: Added --batch.
Work around problem with concurrent-output when in a non-unicode locale by avoiding use of it in such a locale. Instead -J will behave as if it was built without concurrent-output support in this situation.
Fix storing of filenames of v6 unlocked files when the filename is not representable in the current locale.
fsck: Detect and fix missing associated file mappings in v6 repositories.
fsck: Populate unlocked files in v6 repositories whose content is present in annex/objects but didn't reach the work tree.
When initializing a v6 repo on a crippled filesystem, don't force it into direct mode.
Windows: Fix v6 unlocked files to actually work.
add, addurl, import, importfeed: When in a v6 repository on a crippled filesystem, add files unlocked.
annex.addunlocked: New configuration setting, makes files always be added unlocked. (v6 only)
Improve format of v6 unlocked pointer files to support keys containing slashes.

-- Joey Hess id@joeyh.name Wed, 17 Feb 2016 14:48:51 -0400

git-annex (6.20160211) unstable; urgency=medium

annex.addsmallfiles: New option controlling what is done when adding files not matching annex.largefiles.
Fix reversion in lookupkey, contentlocation, and examinekey which caused them to sometimes output side messages.
webapp: Fix deletion of current repository directory.
Added "nothing" to preferred content expression syntax.
annex.largefiles can be configured in .gitattributes too; this is particulary useful for v6 repositories, since the .gitattributes configuration will apply in all clones of the repository.
Limit annex.largefiles parsing to the subset of preferred content expressions that make sense in its context. So, not "standard" or "lackingcopies", etc.
annex.largefiles: Add support for mimetype=text/* etc, when git-annex is linked with libmagic.
matchexpression: Added --largefiles option to parse an annex.largefiles expression.
Brought back the dbus and xmpp build flags, so build from source can be done without C libraries that may be hard to install.
init: Fix bugs in submodule .git symlink fixup, that occurred when initializing in a subdirectory of a submodule and a submodule of a submodule.
WebDAV: Set depth 1 in PROPFIND request, for better compatibility with some servers. Thanks, wzhd.
WebDAV: Remove a bogus trailing slash from the end of the url to the temporary store location for a key. Thanks, wzhd.
S3: Allow configuring with requeststyle=path to use path-style bucket access instead of the default DNS-style access.

-- Joey Hess id@joeyh.name Thu, 11 Feb 2016 11:42:19 -0400

git-annex (6.20160126) unstable; urgency=medium

Fix nasty reversion in the last release that broke sync --content's handling of many preferred content expressions.
whereis --json: Urls are now listed inside the remote that claims them, rather than all together at the end.
info, add, whereis, find: Support --batch mode.
Force output to be line-buffered, even when it's not connected to the terminal. This is particuarly important for commands with --batch output, which was not always being flushed at an appropriate time.
add, import: Support --json output.
addurl --json: Include field for added key (unless the file was added directly to git due to annex.largefiles configuration.) (Also done by add --json and import --json)
registerurl: Check if a remote claims the url, same as addurl does.
Bug fix: Git config settings passed to git-annex -c did not always take effect.
assistant: Use udisks2 dbus events to detect when disks are mounted, instead of relying on gnome/kde stuff that is not stable.
Fix build with QuickCheck 2.8.2
matchexpression: New plumbing command to check if a preferred content expression matches some data.
Removed the webapp-secure build flag, rolling it into the webapp build flag.
Removed the quvi, tahoe, feed, and tfds build flags, adding aeson feed and regex-tdfa to the core dependencies.
Roll the dns build flag into the assistant build flag.
Debian: Avoid building debug package, since gdb is not often useful to debug haskell programs.

-- Joey Hess id@joeyh.name Tue, 26 Jan 2016 14:57:42 -0400

git-annex (6.20160114) unstable; urgency=medium

"hexapodia as the key insight"

Added v6 repository mode, but v5 is still the default for now.
unlock, lock: In v6 mode, unlocking a file changes it from a symlink to a pointer file, and this change can be committed to the git repository. For details, see http://git-annex.branchable.com/tips/unlocked_files/
The upgrade to version 6 is not done fully automatically yet, because upgrading a direct mode repository to version 6 will prevent old versions of git-annex from working in other clones of that repository. For details, see http://git-annex.branchable.com/upgrades/
init: --version parameter added to control which supported repository version to use.
init, upgrade: Configure .git/info/attributes to use git-annex as a smudge filter. In v6 repository mode, this makes git add add files to the annex in unlocked mode, unless overridden by annex.largefiles configuration.
assistant: In v6 mode, adds files in unlocked mode, so they can continue to be modified.
Added annex.thin setting, which makes unlocked files in v6 repositories be hard linked to their content, instead of a copy. This saves disk space but means any modification of an unlocked file will lose the local (and possibly only) copy of the old version.
Enable annex.thin by default on upgrade from direct mode to v6, since direct mode made the same tradeoff.
fix: Adjusts unlocked files as configured by annex.thin.
persistent-sqlite is now a hard build dependency, since v6 repository mode needs it.
status: On crippled filesystems, was displaying M for all annexed files that were present. Probably caused by a change to what git status displays in this situation. Fixed by treating files git thinks are modified the same as typechanged files.
addurl: Added --batch and --with-files options.
addurl: Support --json, particularly useful in --batch mode.
addurl: Refuse to overwrite any existing, non-annexed file.
Debian: Adjust build dependencies for webapp, DAV. Now available on mips, mipsel, but temporarily removed armel since build is failing there.
info: Fix "backend usage" numbers, which were counting present keys twice.
info --json: Improve json for "backend usage", using a nested object with fields for each backend instead of the previous weird nested lists. This may break existing parsers of this json output, if there were any.
whereis --json: Make url list be included in machine-parseable form.
test: Added --keep-failures option.
unused: Bug fix when a new file was added to the annex, and then removed (but not git rmed). git still has the add staged in this case, so the content should not be unused and was wrongly treated as such.
migrate: Copy over metadata to new key.
rekey: No longer copies over urls from the old to the new key. It makes sense for migrate to do that, but not for this low-level (and little used) plumbing command to.
view: Fix crash in non-unicode capable locale when entering a view of metadata containing a slash or backslash.
When annex.http-headers is used to set the User-Agent header, avoid sending User-Agent: git-annex
Windows: Fix rsync cross-drive hack to work with msys2 rsync. Thanks, Pieter Kitslaar.

-- Joey Hess id@joeyh.name Thu, 14 Jan 2016 10:14:19 -0400

git-annex (5.20151218) unstable; urgency=medium

Add S3 features to git-annex version output.
webdav: When testing the WebDAV server, send a file with content. The empty file it was sending tickled bugs in some php WebDAV server.
fsck: Failed to honor annex.diskreserve when checking a remote.
Debian: Build depend on concurrent-output.
Fix insecure temporary permissions when git-annex repair is used in in a corrupted git repository.
Fix potential denial of service attack when creating temp dirs.

-- Joey Hess id@joeyh.name Fri, 18 Dec 2015 12:09:33 -0400

git-annex (5.20151208) unstable; urgency=medium

Build with -j1 again to get reproducible build.
Display progress meter in -J mode when copying from a local git repo, to a local git repo, and from a remote git repo.
Display progress meter in -J mode when downloading from the web.
map: Improve display of git remotes with non-ssh urls, including http and gcrypt.
When core.sharedRepository is set, annex object files are not made mode 444, since that prevents a user other than the file owner from locking them. Instead, a mode such as 664 is used in this case.
tahoe: Include tahoe capabilities in whereis display.
import: Changed to honor annex.largefiles settings.
addurl, importfeed: Changed to honor annex.largefiles settings, when the content of the url is downloaded. (Not when using --fast or --relaxed.)
webapp: Fix bugs that could result in a relative path such as "." being written to ~/.config/git-annex/autostart, and ignore any such relative paths in the file. This was a reversion caused by the relative path changes in 5.20150113.
dropunused: Make more robust when trying to drop an object that has already been dropped.
Fix reversion in handling of long filenames, particularly when using addurl/importfeed, which was introduced in the previous release.

-- Joey Hess id@joeyh.name Tue, 08 Dec 2015 11:14:03 -0400

git-annex (5.20151116) unstable; urgency=medium

Use concurrent-output library when configured with -fConcurrentOutput. This allows nicely displayed messages when using the -J flag.
Additional commands now support the -J flag: fsck, drop, add, addurl, import
import: Avoid very ugly error messages when the directory files are imported to is not a directort, but perhaps an annexed file.
Concurrent progress bars are now displayed when using -J with a command that moves file contents around.
Fix race that could result in an annexed file's symlink not being created, when eg, running concurrent git-annex adds.
add: Fix error recovery rollback to not move the injested file content out of the annex back to the file, because other files may point to that same content. Instead, copy the injected file content out to recover.
quvi may output utf-8 encoded data when the conifigured locale doesn't support that; avoid crashing on such invalid encoding.
runshell: Avoid failing when $HOME/.ssh does not exist and cannot be created.
Make the git-annex-standalone.deb prevent runshell from installing wrappers into $HOME/.ssh
Make git-annex-standalone.deb include the git-annex html documentation, desktop file, and base completion file, same as the regular git-annex.deb.
fsck: When fscking a dead repo, avoid incorrect "fixing location log" message, and display a warning about it being dead, since it's unusual to have access to a dead repo.
assistant: Pass ssh-options through 3 more git pull/push calls that were missed before.
Added annex.pidlock and annex.pidlocktimeout configuration to support filesystems where POSIX fcntl locks cannot be used.
init: Automatically enable annex.pidlock when necessary.

-- Joey Hess id@joeyh.name Mon, 16 Nov 2015 14:17:40 -0400

git-annex (5.20151102.1) unstable; urgency=medium

Avoid installing desktop file and program file if cabal install git-annex is run as root, since that is not a systemwide install, but to /root, and so generating a systemwide desktop file is not right.
When cabal install is run with the desktop file location not writable, display a warning, but continue successfully.

-- Joey Hess id@joeyh.name Tue, 03 Nov 2015 12:08:38 -0400

git-annex (5.20151102) unstable; urgency=medium

Use statvfs on OSX.
Symlink timestamp preservation code uses functions from unix-2.7.0 when available, which should be more portable.
enableremote: List uuids and descriptions of remotes that can be enabled, and accept either the uuid or the description in leu if the name.
Catch up with current git behavior when both repo and repo.git exist; it seems it now prefers repo in this case, although historically it may have preferred repo.git.
Fix failure to build with aws-0.13.0.
When built with aws-0.13.0, the S3 special remote can be used to create google nearline buckets, by setting storageclass=NEARLINE.

-- Joey Hess id@joeyh.name Mon, 02 Nov 2015 12:41:20 -0400

git-annex (5.20151019) unstable; urgency=medium

Fix a longstanding, but unlikely to occur bug, where dropping a file from a remote could race with other drops of the same file, and result in all copies of its content being lost.
git-annex-shell: Added lockcontent command, to prevent dropping of a key's content. This is necessary due to the above bugfix.
In some cases, the above bugfix changes what git-annex allows you to drop:
- When a file is present in several special remotes, but not in any accessible git repositories, dropping it from one of the special remotes will now fail. Instead, the file has to be moved from one of the special remotes to the git repository, and can then safely be dropped from the git repository.
- If a git remote has too old a version of git-annex-shell installed, git-annex won't trust it to hold onto a copy of a file when dropping that file from the local git repository.
Changed drop ordering when using git annex sync --content or the assistant, to drop from remotes first and from the local repo last. This works better with the behavior changes to drop in many cases.
Do verification of checksums of annex objects downloaded from remotes.
When annex objects are received into git repositories from other git repos, their checksums are verified then too.
To get the old, faster, behavior of not verifying checksums, set annex.verify=false, or remote..annex-verify=false.
setkey, rekey: These commands also now verify that the provided file matches the expected checksum of the key, unless annex.verify=false.
reinject: Already verified content; this can now be disabled by setting annex.verify=false.
sync, merge, assistant: When git merge failed for a reason other than a conflicted merge, such as a crippled filesystem not allowing particular characters in filenames, git-annex would make a merge commit that could omit such files or otherwise be bad. Fixed by aborting the whole merge process when git merge fails for any reason other than a merge conflict.
Allow building with S3 disabled again.
Ported disk free space checking code to work on Solaris.
Windows webapp: Fix support for entering password when setting up a ssh remote.
copy --auto was checking the wrong repo's preferred content. (--from was checking what --to should, and vice-versa.) Fixed this bug, which was introduced in version 5.20150727.
Avoid unnecessary write to the location log when a file is unlocked and then added back with unchanged content.
S3: Fix support for using https.
Avoid displaying network transport warning when a ssh remote does not yet have an annex.uuid set.
Debian: Add torrent library to build-depends as it's packaged now, and stop recommending bittornado | bittorrent.
Debian: Remove build dependency on transformers library, as it is now included in ghc.
Debian: Remove menu file, since a desktop file is provided and lintian says there can be only one.

-- Joey Hess id@joeyh.name Mon, 19 Oct 2015 13:59:01 -0400

git-annex (5.20150930) unstable; urgency=medium

Added new linux standalone "ancient" build to support kernels like 2.6.32.
info: Don't allow use in a non-git-annex repository, since it uses the git-annex branch and would create it if it were missing.
assistant: When updating ~/.ssh/config, preserve any symlinks.
webapp: Remove the "disable remote" feature from the UI.
S3: When built with aws-0.13.0, supports using more storage classes. In particular, storageclass=STANDARD_IA to use Amazon's new Infrequently Accessed storage, and storageclass=NEARLINE to use Google's NearLine storage.
Improve ~/.ssh/config modification code to not add trailing spaces to lines it cannot parse.
Fix a crash at direct mode merge time when .git/index doesn't exist yet. Triggered by eg, git-annex sync --no-commit in a fresh clone of a repository.
status: Show added but not yet committed files.
Added stack.yaml to support easy builds from source with stack.

-- Joey Hess id@joeyh.name Wed, 30 Sep 2015 14:31:52 -0400

git-annex (5.20150916) unstable; urgency=medium

Fix Windows build to work with ghc 7.10.
init: Fix reversion in detection of repo made with git clone --shared
info: Support querying info of individual files in direct mode.
unused: Fix reversion in 5.20150727 that broke parsing of the --unused-refspec option. Thanks, Øyvind A. Holm.
Make full option parsing be done when not in a git repo, so --help can be displayed for commands that require a git repo, etc.
fsck: Work around bug in persistent that broke display of problematically encoded filenames on stderr when using --incremental.
When gpg.program is configured, it's used to get the command to run for gpg. Useful on systems that have only a gpg2 command or want to use it instead of the gpg command.
Windows: Switched to using git for Windows, rather than msysgit. Using msysgit with git-annex is no longer supported.
Windows: Even when the user neglects to tell the git installer to add git to PATH, git-annex will still work from within the git bash shell, and the webapp can be used too.
sync: Add --no-commit, --no-pull, --no-push options to turn off parts of the sync process, as well as supporting --commit, --pull, --push, and --no-content options to specify the (current) default behavior.
annex.hardlink extended to also try to use hard links when copying from the repository to a remote.
Improve bash completion, so it completes names of remotes and backends in appropriate places.
Special remotes configured with autoenable=true will be automatically enabled when git-annex init is run.
Fix bug in combination of preferred and required content settings. When one was set to the empty string and the other set to some expression, this bug caused all files to be wanted, instead of only files matching the expression.

-- Joey Hess id@joeyh.name Wed, 16 Sep 2015 10:31:24 -0400

git-annex (5.20150824) unstable; urgency=medium

Sped up downloads of files from ssh remotes, reducing the non-data-transfer overhead 6x.
sync: Support --jobs
sync --content: Avoid unnecessary second pull from remotes when no file transfers are made.
External special remotes can now be built that can be used in readonly mode, where git-annex downloads content from the remote using regular http.
Added WHEREIS to external special remote protocol.
importfeed --relaxed: Avoid hitting the urls of items in the feed.
Fix reversion in init when ran as root, introduced in version 5.20150731.
Reorder declaration to fix build with yesod-core > 1.4.13. Thanks, Michael Alan Dorman.
Fix building without quvi and without database. Thanks, Ben Boeckel.
Avoid building the assistant on the hurd, since an inotify equivalent is not yet implemented in git-annex for the hurd.
--debug log messages are now timestamped with fractional seconds.
--debug is passed along to git-annex-shell when git-annex is in debug mode.
Makefile: Pass LDFLAGS, CFLAGS, and CPPFLAGS through ghc and on to ld, cc, and cpp.
As a result of the Makefile changes, the Debian package is built with various hardening options. Although their benefit to a largely haskell program is unknown.

-- Joey Hess id@joeyh.name Mon, 24 Aug 2015 14:11:05 -0700

git-annex (5.20150812) unstable; urgency=medium

Added support for SHA3 hashed keys (in 8 varieties), when git-annex is built using the cryptonite library.
metadata: Fix reversion introduced in 5.20150727 that caused recursive display of metadata to not work.
Windows: Fix bug that caused git-annex sync to fail due to missing environment variable.
Fix setting/setting/viewing metadata that contains unicode or other special characters, when in a non-unicode locale.
Simplify setup process for a ssh remote. Now it suffices to run git remote add, followed by git-annex sync. Now the remote is automatically initialized for use by git-annex, where before the git-annex branch had to manually be pushed before using git-annex sync. Note that this involved changes to git-annex-shell, so if the remote is using an old version, the manual push is still needed.
git-annex-shell: Don't let configlist auto-init repository when in readonly mode.
Perform a clean shutdown when --time-limit is reached. This includes running queued git commands, and cleanup actions normally run when a command is finished.
fsck: Commit incremental fsck database when --time-limit is reached. Previously, some of the last files fscked did not make it into the database when using --time-limit.
fsck: Commit incremental fsck database after every 1000 files fscked, or every 5 minutes, whichever comes first. Previously, commits were made every 1000 files fscked.
Linux standalone: Work around problem that prevented it from working properly if unpacked into a directory that contains ":" or ";" in its name.
proxy: Fix proxy git commit of non-annexed files in direct mode.
proxy: If a non-proxied git command, such as git revert would normally fail because of unstaged files in the work tree, make the proxied command fail the same way.
proxy: Fix removal of files deleted by the proxied command.
proxy: Fix behavior when run in subdirectory of git repo.
Improve Setup.hs file so that cabal copy --destdir works. Thanks, Magnus Therning.
Tighten dependency on optparse-applicative to 0.11.0.
Added back debian/cabal-wrapper, since it still seems needed after all.

-- Joey Hess id@joeyh.name Wed, 12 Aug 2015 11:14:58 -0400

git-annex (5.20150731) unstable; urgency=medium

webapp: Support enabling known gitlab.com remotes.
Fix rsync special remote to work when -Jn is used for concurrent uploads.
The last release accidentally removed a number of options from the copy command. (-J, file matching options, etc). These have been added back.
init: Detect when the filesystem is crippled such that it ignores attempts to remove the write bit from a file, and enable direct mode. Seen with eg, NTFS fuse on linux.
Fix man page installation by cabal install; all the new man pages are now installed.

-- Joey Hess id@joeyh.name Fri, 31 Jul 2015 11:34:36 -0400

git-annex (5.20150727) unstable; urgency=medium

Fix bug that prevented uploads to remotes using new-style chunking from resuming after the last successfully uploaded chunk.
Switched option parsing to use optparse-applicative. This was a very large and invasive change, and may have caused some minor behavior changes to edge cases of option parsing. (For example, the metadata command no longer accepts the combination of --get and --set, which never actually worked.)
Bash completion file is now included in the git-annex source tree, and installed into Debian package (and any other packages built using make install). This bash completion is generated by the option parser, so it covers all commands, all options, and will never go out of date!
As well as tab completing "git-annex" commands, "git annex" will also tab complete. However, git's bash completion script needs a patch, which I've submitted, for this to work prefectly.
version --raw now works when run outside a git repository.
assistant --startdelay now works when run outside a git repository.
dead now accepts multiple --key options.
addurl now accepts --prefix and --suffix options to adjust the filenames used.
sync --content: Fix bug that caused files to be uploaded to eg, more archive remotes than wanted copies, only to later be dropped to satisfy the preferred content settings.
importfeed: Improve detection of known items whose url has changed, and avoid adding redundant files. Where before this only looked at permalinks in rss feeds, it now also looks at guids.
importfeed: Look at not only permalinks, but now also guids to identify previously downloaded files.
Webapp: Now features easy setup of git-annex repositories on gitlab.com.
Adjust debian build deps: The webapp can now build on arm64, s390x and hurd-i386. WebDAV support is also available on those architectures.
Debian package now maintained by Richard Hartmann.
Support building without persistent database on for systems that lack TH. This removes support for incremental fsck.

-- Joey Hess id@joeyh.name Mon, 27 Jul 2015 12:24:49 -0400

git-annex (5.20150710) unstable; urgency=medium

add: Stage symlinks the same as git add would, even if they are not a link to annexed content.
sync: When annex.autocommit=false, avoid making any commit of local changes, while still merging with remote to the extent possible.
unused: --used-refspec can now be configured to look at refs in the reflog. This provides a way to not consider old versions of files to be unused after they have reached a specified age, when the old refs in the reflog expire.
log: Fix reversion introduced in version 5.20150528 that broke this command.
assistant --autostart: First stop any daemons that are already running, which might be left over from a previous login session and so unable to use the ssh agent of a new login session.
assistant: Fix local pairing to not include newline in ssh pubkey, which is rejected on the other end for security reasons.
assistant: Fix ANNEX_SHELL_DIR written to ~/.ssh/authorized_keys in local pairing to be the absolute path to the repository, not "." This was a reversion caused by the relative path changes in 5.20150113.
Brought back the setkey plumbing command that was removed in 2011, since we found a use case for it. Note that the command's syntax was changed for consistency.
bugfix: Pass --full-tree when using git ls-files to get a list of files on the git-annex branch, so it works when run in a subdirectory. This bug affected git-annex unused, and potentially also transitions running code and other things.
Support git's undocumented core.sharedRepository=2 value, which is equivalent to "world", and is set when a repo was created using git init --shared=world.
When building on linux, pass --as-needed to linker to avoid linking with unused shared libraries including libyaml.
import: Fix failure of cross-device import on Windows.
merge: Avoid creating the synced/master branch.
Removed support for optparse-applicative versions older than 0.10.

-- Joey Hess id@joeyh.name Fri, 10 Jul 2015 16:36:42 -0400

git-annex (5.20150617) unstable; urgency=medium

Now supports git annex sync --all --content to sync all versions of all files with all repos that want them.
Added new "anything" preferred content expression, which matches all versions of all files.
Standard preferred content for client, backup, incremental backup, and unwanted groups have been adjusted to work better when used with git annex sync --all --content.
fromkey, registerurl: Improve handling of urls that happen to also be parsable as strange keys.
sync, remotedaemon: Pass configured ssh-options even when annex.sshcaching is disabled.
assistant: Consume systemd-networkd dbus events to learn about changes to network connections, as was already done with network-manager and wicd. Thanks to Sebastian Reuße for the patches.
get --incomplete: New option to resume any interrupted downloads.
dead --key: Can be used to mark a key as dead.
fsck: Ignore keys that are known to be dead when running in --all/--unused/--key mode or a in a bare repo. Closes: #753888 Otherwise, still reports files with lost contents, even if the content is dead.
S3: Special remotes can be configured with public=yes to allow the public to access the bucket's content.
S