History

Add LFS Migration and Mirror (#14726)

* Implemented LFS client. * Implemented scanning for pointer files. * Implemented downloading of lfs files. * Moved model-dependent code into services. * Removed models dependency. Added TryReadPointerFromBuffer. * Migrated code from service to module. * Centralised storage creation. * Removed dependency from models. * Moved ContentStore into modules. * Share structs between server and client. * Moved method to services. * Implemented lfs download on clone. * Implemented LFS sync on clone and mirror update. * Added form fields. * Updated templates. * Fixed condition. * Use alternate endpoint. * Added missing methods. * Fixed typo and make linter happy. * Detached pointer parser from gogit dependency. * Fixed TestGetLFSRange test. * Added context to support cancellation. * Use ReadFull to probably read more data. * Removed duplicated code from models. * Moved scan implementation into pointer_scanner_nogogit. * Changed method name. * Added comments. * Added more/specific log/error messages. * Embedded lfs.Pointer into models.LFSMetaObject. * Moved code from models to module. * Moved code from models to module. * Moved code from models to module. * Reduced pointer usage. * Embedded type. * Use promoted fields. * Fixed unexpected eof. * Added unit tests. * Implemented migration of local file paths. * Show an error on invalid LFS endpoints. * Hide settings if not used. * Added LFS info to mirror struct. * Fixed comment. * Check LFS endpoint. * Manage LFS settings from mirror page. * Fixed selector. * Adjusted selector. * Added more tests. * Added local filesystem migration test. * Fixed typo. * Reset settings. * Added special windows path handling. * Added unit test for HTTPClient. * Added unit test for BasicTransferAdapter. * Moved into util package. * Test if LFS endpoint is allowed. * Added support for git:// * Just use a static placeholder as the displayed url may be invalid. * Reverted to original code. * Added "Advanced Settings". * Updated wording. * Added discovery info link. * Implemented suggestion. * Fixed missing format parameter. * Added Pointer.IsValid(). * Always remove model on error. * Added suggestions. * Use channel instead of array. * Update routers/repo/migrate.go * fmt Signed-off-by: Andrew Thornton <art27@cantab.net>

KN4CK3R committed 5 years ago

Commit c03e4881 parent f54441475 files · +2152 −704Browse files

Showing the changes to services/gitdiff/gitdiff.go (1 of 75 files). Show all

Unified · Split

services/gitdiff/gitdiff.go+5−4
@@ -25,6 +25,7 @@ import ( · 24 unmodified lines
25 "code.gitea.io/gitea/modules/charset"25 "code.gitea.io/gitea/modules/charset"
26 "code.gitea.io/gitea/modules/git"26 "code.gitea.io/gitea/modules/git"
27 "code.gitea.io/gitea/modules/highlight"27 "code.gitea.io/gitea/modules/highlight"
28 "code.gitea.io/gitea/modules/lfs"
28 "code.gitea.io/gitea/modules/log"29 "code.gitea.io/gitea/modules/log"
29 "code.gitea.io/gitea/modules/process"30 "code.gitea.io/gitea/modules/process"
30 "code.gitea.io/gitea/modules/setting"31 "code.gitea.io/gitea/modules/setting"
@@ -1077,12 +1078,12 @@ func parseHunks(curFile *DiffFile, maxLines, maxLineCharacters int, input *bufio · 1046 unmodified lines
1077 curSection.Lines[len(curSection.Lines)-1].Content = line1078 curSection.Lines[len(curSection.Lines)-1].Content = line
1078 1079
1079 // handle LFS1080 // handle LFS
1080 if line[1:] == models.LFSMetaFileIdentifier {1081 if line[1:] == lfs.MetaFileIdentifier {
1081 curFileLFSPrefix = true1082 curFileLFSPrefix = true
1082 } else if curFileLFSPrefix && strings.HasPrefix(line[1:], models.LFSMetaFileOidPrefix) {1083 } else if curFileLFSPrefix && strings.HasPrefix(line[1:], lfs.MetaFileOidPrefix) {
1083 oid := strings.TrimPrefix(line[1:], models.LFSMetaFileOidPrefix)1084 oid := strings.TrimPrefix(line[1:], lfs.MetaFileOidPrefix)
1084 if len(oid) == 64 {1085 if len(oid) == 64 {
1085 m := &models.LFSMetaObject{Oid: oid}1086 m := &models.LFSMetaObject{Pointer: lfs.Pointer{Oid: oid}}
1086 count, err := models.Count(m)1087 count, err := models.Count(m)
1087 1088
1088 if err == nil && count > 0 {1089 if err == nil && count > 0 {

Keyboard shortcuts

General

Show keyboard shortcuts
?
Focus the current search
/

Issues and pull requests

Open filters
f

Issues, pull requests and Inbox

Select next item
j↓
Select previous item
k↑
Open selected item
Enter
Dismiss filters or clear selection
Esc

Repository code

Go to file
t