![@kannonboy
$ cat ~/.gitconfig
[filter "lfs"]
clean = git-lfs clean %f
smudge = git-lfs smudge %f
required = true](https://image.slidesharecdn.com/trackinggameassetswithgitlfs-161111090312/85/Tracking-large-game-assets-with-Git-LFS-35-320.jpg){kind=tracking}
![@kannonboy
POST .../repo.git
I need object cafebabe
@kannonboy
/info/lfs/objects/batch
{“objects”:[
{
“oid”: “cafebabe...”,
“size”: 40689401
}, ...
],
“operation”: “download”}](https://image.slidesharecdn.com/trackinggameassetswithgitlfs-161111090312/85/Tracking-large-game-assets-with-Git-LFS-44-320.jpg){kind=tracking}
![@kannonboy
$ git lfs lock <path>
$ git lfs unlock <path>
$ git lfs locks [-i id] [-p path]](https://image.slidesharecdn.com/trackinggameassetswithgitlfs-161111090312/85/Tracking-large-game-assets-with-Git-LFS-85-320.jpg){kind=tracking}
Ad
More Related Content
What's hot (20)
Similar to Tracking large game assets with Git LFS (20)
Ad
Recently uploaded (20)
![Minitab 22 Full Crack Plus Product Key Free Download [Latest] 2025](https://cdn.slidesharecdn.com/ss_thumbnails/avtpastoralvisits20252026-250407114051-0c8f0fbf-250407123507-bf8f5b04-250426175635-00bc6197-thumbnail.jpg?width=560&fit=bounds)
Ad
Tracking large game assets with Git LFS
- 1. TIM PETTERSEN • SENIOR DEVELOPER • ATLASSIAN • @KANNONBOY Tracking game assets with Git LFS
- 2. @kannonboy Photo: Le Monde en Vidéo @kannonboy
- 3. @kannonboy Photo: Le Monde en Vidéo @kannonboy
- 4. @kannonboy@kannonboy Photo: Le Monde en Vidéo
- 5. @kannonboy Git LFS! Git LOB! @kannonboy Photo: Le Monde en Vidéo
- 6. @kannonboy ! @kannonboy Photo: Le Monde en Vidéo Git LFS!
- 7. TIM PETTERSEN • SENIOR DEVELOPER • ATLASSIAN • @KANNONBOY Tracking game assets with Git LFS
- 8. @kannonboy GIT LFS THE PROBLEM WITH BIG FILES Agenda CONVERTING YOUR REPO TIPS FOR TEAMS
- 12. master 98ca9.. bab1e.. fad3d.. 434bb..tree bab1e..parent Tim P <kannonboy@…> 1455209277 -0800committer Tim P <kannonboy@…> 1455209277 -0800author My life is my commit message. git cat-file -p 98ca9$ @kannonboy
- 13. git cat-file -p 434bb ace23..100644 blob .gitignore dbdbd..100644 blob .gitattributes a0bc3..040000 tree Assets 33d33..040000 tree ProjectSettings b1de7..100755 blob build.sh 7011e..100755 blob README.md typefilemode SHA-1 master 98ca9.. bab1e.. fad3d.. $ 434bb.. @kannonboy
- 20. @kannonboy
- 21. @kannonboy
- 28. @kannonboy git pull$ LFS store Git host
- 29. @kannonboy git pull$ LFS store Git host ☞ ☞ ☞ dabad.. 98ca9.. bab1e.. fad3d.. 86753.. 434bb.. 4749d.. bdd12.. 778aa..
- 30. @kannonboy git pull$ LFS store Git host ☞ ☞ ☞ dabad.. 98ca9.. bab1e.. fad3d.. 86753.. 434bb.. 4749d.. bdd12.. 778aa..
- 31. @kannonboy git checkout bab1e$ LFS store Git host ☞ ☞ ☞ dabad.. 98ca9.. bab1e.. fad3d.. 86753.. 434bb.. 4749d.. bdd12.. 778aa.. HEAD
- 32. @kannonboy git checkout bab1e$ LFS store Git host ☞ ☞ ☞ dabad.. 98ca9.. bab1e.. fad3d.. 86753.. 434bb.. 4749d.. bdd12.. 778aa.. HEAD
- 33. @kannonboy https://git-lfs.github.com/spec/v1version sha256:325ddfb…oid 29342295size git cat-file -p 4749d$ ☞ ☞ ☞ dabad.. 98ca9.. bab1e.. fad3d.. 86753.. 434bb.. 4749d.. bdd12.. 778aa..
- 34. @kannonboy $ brew install git-lfs $ git lfs install
- 35. @kannonboy $ cat ~/.gitconfig [filter "lfs"] clean = git-lfs clean %f smudge = git-lfs smudge %f required = true
- 36. @kannonboy $ git lfs track “*.mp4” $ cat .gitattributes *.mp4 filter=lfs diff=lfs merge=lfs -text
- 37. @kannonboy massive_video.mp4 Work tree dev .git/lfs/objects Clean filter (git-lfs clean) ☞ Index massive_video.mp4 $ .git/objects git add
- 38. @kannonboy $ dev .git/lfs/objects Smudge filter (git-lfs smudge) Work tree massive_video.mp4 ☞ Commit tree massive_video.mp4 .git/objects LFS Store git checkout
- 41. @kannonboy $ git push Git LFS: (12 of 13 files, 1 skipped) 168.75 MB / 180.87 MB, 12.12 skipped Counting objects: 22, done. ...
- 42. @kannonboy $ git pull remote: Counting objects: 3, done. ... Downloading massive_video.mp4 (38.79 MB) ... 1 file changed, 2 insertions(+)
- 43. @kannonboy $ git clone ssh://git@bitbucke.. Cloning into ‘big_repo’ ... Downloading massive_video.mp4 (38.79 MB) ... Checking out files: 100% (13/13), done.
- 44. @kannonboy POST .../repo.git I need object cafebabe @kannonboy /info/lfs/objects/batch {“objects”:[ { “oid”: “cafebabe...”, “size”: 40689401 }, ... ], “operation”: “download”}
- 45. @kannonboy 200 OK {“objects”:[ {“oid”: “cafebabe…”, “size”: 40689401, “actions”: { “download”: { “href”: “https://…/lfs/cafebabe…”, @kannonboy cafebabe is over there } } ...
- 46. @kannonboy 200 OK {“objects”:[ {“oid”: “cafebabe…”, “size”: 40689401, “actions”: { “download”: { “href”: “https://…/lfs/cafebabe…”, @kannonboy cafebabe is over there “header”: { “Authorization”: “JWT eyJ0eXA…”, } } } ...
- 47. @kannonboy $ ssh git@bitbucket git-lfs-authenticate project/repo.git download where is the LFS API? @kannonboy
- 48. @kannonboy $ ssh git@bitbucket git-lfs-authenticate project/repo.git download { “href”: “https://…/lfs/objects/batch”, “header”: { “Authorization”: “JWT eyJ0eXA...” } } where is the LFS API? the LFS API is over there @kannonboy
- 49. @kannonboy $ ssh git@bitbucket git-lfs-authenticate project/repo.git download { “href”: “https://…/lfs/objects/batch”, “header”: { “Authorization”: “JWT eyJ0eXA...” } } where is the LFS API? the LFS API is over there @kannonboy
- 50. @kannonboy LFS aware Git server LFS storeDev git clone https://.. repo data POST /info/lfs/objects/batch LFS objects hypermedia GET …/<objectSHA> smudge filter happens once per file checked out
- 51. @kannonboy LFS storeDev git lfs clone https://.. repo data GET …/<objectSHA> batched smudge filter subtle difference! POST /info/lfs/objects/batch LFS objects hypermedia LFS aware Git server
- 52. @kannonboy # git pull with LFS disabled $ git -c filter.lfs.smudge= -c filter.lfs.required=false pull # fetch LFS objects as batch $ git lfs pull Speeding up pulls
- 53. @kannonboy # define a git alias $ git config --global alias.plfs "!git -c filter.lfs.smudge= -c filter.lfs.required=false pull && git lfs pull" # then simply... $ git plfs Speeding up pulls
- 54. @kannonboy Converting to Git LFS ☞
- 55. @kannonboy Converting to Git LFS ☞
- 56. 98ca9.. bab1e.. fad3d.. 100mb 150mb $ git lfs track “*.mp4”
- 57. 98ca9.. bab1e.. fad3d.. ☞ 100mb 150mb 150mb!?!? $ git lfs track “*.mp4”
- 58. @kannonboy git filter-branch $ git filter-branch --force --index-filter 'git rm --cached --ignore-unmatch big_video.mp4’ --prune-empty --tag-name-filter cat -- --all DON’T DO THIS!
- 59. @kannonboy $ git filter—branch --prune-empty --tree-filter ' git config -f .gitconfig lfs.url “https://bitbucket.example.com/team/repo.git” git lfs track "*.mp4" git add .gitattributes .gitconfig for file in $(git ls-files | xargs git check-attr filter | grep "filter: lfs" | sed -r "s/(.*): filter: lfs/1/"); do git rm -f --cached ${file} git add ${file} done' --tag-name-filter cat -- --all @kannonboy DON’T DO THIS EITHER!
- 61. @kannonboy BFG Repo-Cleaner @kannonboy 10-720x faster than filter-branch built to kill history Git LFS support by @rtyley
- 62. @kannonboy $ git filter—branch --prune-empty --tree-filter ' git config -f .gitconfig lfs.url “https://bitbucket.example.com/team/repo.git” git lfs track "*.mp4" git add .gitattributes .gitconfig for file in $(git ls-files | xargs git check-attr filter | grep "filter: lfs" | sed -r "s/(.*): filter: lfs/1/"); do git rm -f --cached ${file} git add ${file} done' --tag-name-filter cat -- --all @kannonboy DON’T DO THIS EITHER!
- 63. @kannonboy $ brew install bfg $ bfg —-convert-to-git-lfs “*.mp4” --no-blob-protection
- 64. @kannonboy What to track? Yes Maybe No SFX Music Textures Spritesheets FMV Code Fonts Materials Text Meshes Animations Scenes if they’re big or change frequently big stuff
- 65. @kannonboy $ 317352 angrybots 194424 angrybots/Assets 112884 angrybots/Assets/Textures 32220 angrybots/Assets/Sounds 24460 angrybots/Assets/Objects … du -k angrybots | sort -nr What to track?
- 68. @kannonboy $ a295ef4… 102437 95372 2cc7063… 152171 140443 blob SHA size on disk average blob size generate-larger-than 50000 Identifying large objects
- 69. @kannonboy , PNG, 512 x 512 , WAVE audio, 16 bit a295ef4… 102437 95372 2cc7063… 152171 140443 $ generate-larger-than 50000 | add-file-info Identifying large objects
- 70. @kannonboy …/ReBirth.png a295ef4… 102437 95372, PNG… …/bot_die.wav 2cc7063… 152171 140443, WAVE… $ generate-larger-than 50000 | add-file-info $ report-on-large-objects big-stuff.txt paths > big-stuff.txt Identifying large objects
- 71. @kannonboy …/bot_die.wav 2cc7063… 152171 140443, WAVE… …/ReBirth.png a295ef4… 102437 95372, PNG… $ generate-larger-than 50000 | add-file-info $ report-on-large-objects big-stuff.txt > big-stuff.txt Identifying large objects | sort -k3nr order by average blob size
- 72. @kannonboy $ bfg —-convert-to-git-lfs “*.wav” --no-blob-protection Identifying large objects $ bfg —-convert-to-git-lfs “*.png” --no-blob-protection run once per pattern
- 74. @kannonboy
- 75. @kannonboy
- 77. @kannonboyBeware merge conflicts @kannonboy
- 80. @kannonboy master feature0 feature1 File locking (single branch model) LAME
- 81. @kannonboy master feature0 feature1 File locking (multi branch model)
- 82. @kannonboy master feature0 feature1 File locking (multi branch model)
- 83. @kannonboy master feature0 feature1 File locking (multi branch model)
- 84. @kannonboy master feature0 feature1 File locking (multi branch model)
- 85. @kannonboy $ git lfs lock <path> $ git lfs unlock <path> $ git lfs locks [-i id] [-p path]
- 88. @kannonboy $ git lfs fetch master feature0 feature1
- 89. @kannonboy $ git lfs fetch master feature0 feature1 --recent
- 90. @kannonboy $ git lfs fetch master feature0 feature1 --recent T-minus 7 days
- 91. @kannonboy $ git config lfs.fetchrecentalways “true” lfs.fetchrecentrefsdays lfs.fetchrecentremoterefs lfs.fetchrecentcommitsdays (default = 7) (default = 0) $ git lfs fetch --recent (default = true)
- 94. @kannonboy lfs.pruneoffsetdays lfs.pruneverifyremotealways (default = 3) Set this! $ git lfs prune
- 96. @kannonboyFetch the bare necessitiesFetch the bare necessities @kannonboy © Disney
- 97. @kannonboy # for a build that just runs the unit tests $ git lfs fetch --exclude Assets/Textures/** # for an audio engineer $ git lfs fetch --include Assets/Sounds/** $ git config lfs.fetchexclude Assets/Textures/** $ git config lfs.fetchinclude Assets/Sounds/**
- 98. @kannonboyIDEs & GUI tools @kannonboy
- 99. @kannonboy
- 100. @kannonboy
- 102. @kannonboy version 4.3+ Bitbucket Server go.atlassian.com/git-lfs docs github.com/github/git-lfs source available now! bitbucket.org Looking for more? For occasional Git, JIRA & Bitbucket trivia
- 103. @kannonboy unlimited private and public repositories for teams of up to 5 Git LFS storage tier builds and deployments tier with Bitbucket Pipelines pull requests, branch controls, JIRA integration, etc go.atlassian.com/gaming FREE
- 104. @kannonboy Tweet your game or app with the hashtag #BuiltwithBitbucket for a chance to be featured on the Bitbucket gaming page