Re: Fwd: ostree static-delta



> I will see how Giuseppe's patch improves the numbers and post them here later.


The improvement from static delta to patched static delta is 141.9 MB => 124.0 MB


> does tweaking --max-bsdiff-size make any difference?


I tried --min-fallback-size=0 (which as I understand means "always use bsdiff"): --min-fallback-size=0 + your patch = 115,2 MB


A new issue is that with libglnx update (https://github.com/ostreedev/ostree/commit/f3cbe86117d8e68e4dc02c597da59588be31f7e2) I am getting the following error message:


Writing objects: 1

error: Bad file descriptor



Also I run ostree pull with the --verbose command line argument to see where the time is spent:


OT: processing delta superblock for 785f7cd399e4e252959548b7427c692dedb87221390ec4f686ce81d2a6dabda2-c680e101ba0e73be93df53c1ab7c12119474a7352c3141b3eaf647786361f1d3
OT: queuing fetch of 2229cfceedd2cf84786108e65a24e987bb1c65b82f59901a07ee2b306ece1444.file
OT: queuing fetch of 577ea73b376d5f9f7ead1af3c92c2514d1bef1467ff4a314c60a96d79a64aa92.file
OT: queuing fetch of f57fec6e0330b7fd3aa682a950e7b8d7a32c3ad41504ad03cb68e15abf905033.file
OT: queuing fetch of a026310374e340b7a021198088765c39291cf099eb66060710730cf5ff6e151a.file
OT: queuing fetch of 1e520095165f512716c5ce0a1cdaf166905d8cf3f51c7e67e79057d8fefcec4a.file
OT: queuing fetch of 21e6347a81b18e66dabba2e9565e4433fbd2e491d65ee43f25870d01f2124f48.file
OT: queuing fetch of abfb2a74b62b7663dcf1965da6d755d9fae277c4775bcdbd531a5487c78dace2.file
OT: queuing fetch of 0896fad74101b07a1547835773617c0e07ae3802f2cf2a7c44ff18af6bec8d8c.file
OT: queuing fetch of 02b4dc7f5b3e364a4efde0b01e31b96802a4b38a8e93a0815aa630dc38edd69f.file
OT: queuing fetch of 70cb457aa46a00b90a3fa7404dc53b4269504b6b5c009cb595b33538a03492a2.file
OT: queuing fetch of cf54a66221bcd42d129019c7aff18eb925057b022532cc5047c37ac40da69d50.file
OT: queuing fetch of 395185f66b545bf59af16db1af13a2076e130412f9d7ad48f64927039ca20915.file
OT: queuing fetch of e37d8cc552c19f10d29bce64a8f35bbf281fc9642af4783655afa9ee4489cdd1.file
OT: queuing fetch of 9246499d23eebb389fc4d72ce04f1694434bce2ffade84dc4b6b42c23af13d4e.file
OT: write of c680e101ba0e73be93df53c1ab7c12119474a7352c3141b3eaf647786361f1d3.commit complete
OT: queuing fetch of c680e101ba0e73be93df53c1ab7c12119474a7352c3141b3eaf647786361f1d3.commit (detached)
OT: queuing fetch of bfe110ee6c0e6be93ef727d23e27649e6deda5ec7606b62aab95e1ca85365095.dirtree
Receiving delta parts: 0/12 6.4 MB/s 6.4 MB/141.9 MB 21 seconds remaining       OT: fetch of a026310374e340b7a021198088765c39291cf099eb66060710730cf5ff6e151a.file complete
Receiving delta parts: 0/12 5.9 MB/s 11.8 MB/141.9 MB 22 seconds remaining      OT: fetch of abfb2a74b62b7663dcf1965da6d755d9fae277c4775bcdbd531a5487c78dace2.file complete
Receiving delta parts: 0/12 5.0 MB/s 14.9 MB/141.9 MB 25 seconds remaining      OT: fetch of 21e6347a81b18e66dabba2e9565e4433fbd2e491d65ee43f25870d01f2124f48.file complete
Receiving delta parts: 0/12 4.5 MB/s 18.0 MB/141.9 MB 27 seconds remaining      OT: fetch of 2229cfceedd2cf84786108e65a24e987bb1c65b82f59901a07ee2b306ece1444.file complete
Receiving delta parts: 0/12 4.2 MB/s 20.8 MB/141.9 MB 29 seconds remaining      OT: fetch of 1e520095165f512716c5ce0a1cdaf166905d8cf3f51c7e67e79057d8fefcec4a.file complete
Receiving delta parts: 0/12 3.9 MB/s 23.4 MB/141.9 MB 30 seconds remaining      OT: fetch of 577ea73b376d5f9f7ead1af3c92c2514d1bef1467ff4a314c60a96d79a64aa92.file complete
OT: fetch of cf54a66221bcd42d129019c7aff18eb925057b022532cc5047c37ac40da69d50.file complete
Receiving delta parts: 0/12 3.3 MB/s 29.7 MB/141.9 MB 34 seconds remaining      OT: fetch of 395185f66b545bf59af16db1af13a2076e130412f9d7ad48f64927039ca20915.file complete
Receiving delta parts: 0/12 3.2 MB/s 31.8 MB/141.9 MB 34 seconds remaining      OT: write of cf54a66221bcd42d129019c7aff18eb925057b022532cc5047c37ac40da69d50.file complete
Receiving delta parts: 0/12 3.1 MB/s 34.5 MB/141.9 MB 34 seconds remaining      OT: fetch of 9246499d23eebb389fc4d72ce04f1694434bce2ffade84dc4b6b42c23af13d4e.file complete
OT: write of a026310374e340b7a021198088765c39291cf099eb66060710730cf5ff6e151a.file complete
Receiving delta parts: 0/12 3.1 MB/s 37.4 MB/141.9 MB 33 seconds remaining      OT: write of 395185f66b545bf59af16db1af13a2076e130412f9d7ad48f64927039ca20915.file complete
OT: write of 1e520095165f512716c5ce0a1cdaf166905d8cf3f51c7e67e79057d8fefcec4a.file complete
OT: write of 21e6347a81b18e66dabba2e9565e4433fbd2e491d65ee43f25870d01f2124f48.file complete
Receiving delta parts: 0/12 3.1 MB/s 40.5 MB/141.9 MB 32 seconds remaining      OT: write of 9246499d23eebb389fc4d72ce04f1694434bce2ffade84dc4b6b42c23af13d4e.file complete
Receiving delta parts: 0/12 3.2 MB/s 45.3 MB/141.9 MB 29 seconds remaining      OT: write of 2229cfceedd2cf84786108e65a24e987bb1c65b82f59901a07ee2b306ece1444.file complete
OT: write of 577ea73b376d5f9f7ead1af3c92c2514d1bef1467ff4a314c60a96d79a64aa92.file complete
OT: fetch of 70cb457aa46a00b90a3fa7404dc53b4269504b6b5c009cb595b33538a03492a2.file complete
Receiving delta parts: 0/12 3.3 MB/s 49.9 MB/141.9 MB 27 seconds remaining      OT: write of abfb2a74b62b7663dcf1965da6d755d9fae277c4775bcdbd531a5487c78dace2.file complete
Receiving delta parts: 0/12 3.4 MB/s 60.6 MB/141.9 MB 24 seconds remaining      OT: fetch static delta part a33d37295b07517db3a658237f4a34d6c28d6c52d6c4b3d7d12d433309d800dc complete
From here the next non-debug message takes about ~2min30sec, I would expect something like:
1/12
2/12
..
So "seconds remaining" here stays still for a long time.
OT: fetch of bfe110ee6c0e6be93ef727d23e27649e6deda5ec7606b62aab95e1ca85365095.dirtree complete
OT: fetch of c680e101ba0e73be93df53c1ab7c12119474a7352c3141b3eaf647786361f1d3.commit (detached) complete
OT: fetch static delta part 29e56fe45cbc02a65c0cb5e760c832a3625b6e688d04b10c487f282e869b5cd3 complete
OT: fetch static delta part 72b964ec3bbdbf40db9626656d1aac98ea787aa9a0e0ed3512b0f11f4455f1db complete
OT: fetch of e37d8cc552c19f10d29bce64a8f35bbf281fc9642af4783655afa9ee4489cdd1.file complete
OT: fetch of f57fec6e0330b7fd3aa682a950e7b8d7a32c3ad41504ad03cb68e15abf905033.file complete
OT: fetch static delta part 57bb59f1df4dd405a9a6279cf92c5881200f04ec6e17d4ccf3e2ee8637e09b64 complete
OT: fetch of 0896fad74101b07a1547835773617c0e07ae3802f2cf2a7c44ff18af6bec8d8c.file complete
OT: fetch static delta part 120e62b30865a10c641152d5409c4a96bbd9e161a3e417758bb2243d2899db3f complete
OT: write of 70cb457aa46a00b90a3fa7404dc53b4269504b6b5c009cb595b33538a03492a2.file complete
OT: fetch static delta part 01bfd32e94445d5d489817257d2ed27a4c49e1406f311bd742ee0fcd27a49504 complete
OT: fetch static delta part 8b59cb9f55d805b12505cd6686cd1347360a7e4654fecd8e6004e16f17498592 complete
OT: fetch static delta part 0fd661a263dc5bdf3de6401e8c1dd6618f7c309375512ffff67ff89879c89d64 complete
OT: fetch static delta part a5db5f7434d67806783081593f5f75cb098bac8f730025de934c18f72492c1c4 complete
OT: write of bfe110ee6c0e6be93ef727d23e27649e6deda5ec7606b62aab95e1ca85365095.dirtree complete
OT: fetch static delta part 2fba967bb280d3241c6a4f7752bcde51a12efa1fe36e3a75e0a166bc3c5d3121 complete
OT: fetch static delta part 202cd267ebe5637a82e1e78c8134323b6c9fb1bdf002b935e6bae9b083c9d830 complete
OT: fetch static delta part 090ba845ac63fce41d4d8b9725f6a2dfd8c2c7c0cb42e0ad16f7119006624f6d complete
OT: fetch of 02b4dc7f5b3e364a4efde0b01e31b96802a4b38a8e93a0815aa630dc38edd69f.file complete
OT: write of e37d8cc552c19f10d29bce64a8f35bbf281fc9642af4783655afa9ee4489cdd1.file complete
OT: execute static delta part 29e56fe45cbc02a65c0cb5e760c832a3625b6e688d04b10c487f282e869b5cd3 complete
OT: execute static delta part a33d37295b07517db3a658237f4a34d6c28d6c52d6c4b3d7d12d433309d800dc complete
OT: execute static delta part 72b964ec3bbdbf40db9626656d1aac98ea787aa9a0e0ed3512b0f11f4455f1db complete
OT: write of 0896fad74101b07a1547835773617c0e07ae3802f2cf2a7c44ff18af6bec8d8c.file complete
OT: execute static delta part 120e62b30865a10c641152d5409c4a96bbd9e161a3e417758bb2243d2899db3f complete
OT: write of f57fec6e0330b7fd3aa682a950e7b8d7a32c3ad41504ad03cb68e15abf905033.file complete
OT: execute static delta part 57bb59f1df4dd405a9a6279cf92c5881200f04ec6e17d4ccf3e2ee8637e09b64 complete
OT: execute static delta part 01bfd32e94445d5d489817257d2ed27a4c49e1406f311bd742ee0fcd27a49504 complete
OT: execute static delta part 8b59cb9f55d805b12505cd6686cd1347360a7e4654fecd8e6004e16f17498592 complete
OT: execute static delta part 0fd661a263dc5bdf3de6401e8c1dd6618f7c309375512ffff67ff89879c89d64 complete
OT: execute static delta part a5db5f7434d67806783081593f5f75cb098bac8f730025de934c18f72492c1c4 complete
OT: execute static delta part 2fba967bb280d3241c6a4f7752bcde51a12efa1fe36e3a75e0a166bc3c5d3121 complete
OT: execute static delta part 202cd267ebe5637a82e1e78c8134323b6c9fb1bdf002b935e6bae9b083c9d830 complete
Writing objects: 7                                                              OT: queuing fetch of 2be6288ba071eae36668d7aa0e69b5b86c36ac5a9b55d2081e23580bfeab05c0.file
OT: queuing fetch of 2c13bad7fa4dabfa7cda4a264938b05e3659618b171be9072611d3d1bd96f28b.file
OT: fetch of 2be6288ba071eae36668d7aa0e69b5b86c36ac5a9b55d2081e23580bfeab05c0.file complete
OT: fetch of 2c13bad7fa4dabfa7cda4a264938b05e3659618b171be9072611d3d1bd96f28b.file complete
OT: write of 2be6288ba071eae36668d7aa0e69b5b86c36ac5a9b55d2081e23580bfeab05c0.file complete
OT: write of 2c13bad7fa4dabfa7cda4a264938b05e3659618b171be9072611d3d1bd96f28b.file complete
OT: queuing fetch of b2cb39f0b022a765510bd9b1adc78dd7b8c4da9015fcf1ad9b17ccb1a029944d.file
OT: queuing fetch of baf41ae63404a8c55706a2ea712f52f010661c9b83b1c1c470604148ffbc888e.file
OT: queuing fetch of 4b0b35752d1f7733baf0f481d6c2713ebdbad1383dc4f8afed5802998917e534.file
OT: queuing fetch of a88fc159400cbee751b9f7263eaebcefeed98e7404250bd05ce4b232d2760f85.file
OT: queuing fetch of e7b891cb51d74b8c5ffc2359293c69992c8532ac535aca666378fff18a3c7394.file
OT: queuing fetch of 4498766141a64badcfd72bfe6827bfd8fba8f132474eeef83255f3841c6cbd56.file
OT: queuing fetch of 634dd214ed52aab5e913171f10b331f8d84d8cacdbc93be83dea611f20f228e4.file
OT: queuing fetch of 26b8d8b3de4911b77b98d856ccab2d3708e24e54d8144237990dcbca61d88346.file
OT: queuing fetch of 28229d03c5b049c4e094df96a298d73b0d6318869fb534105d694197d11f71ab.file
OT: queuing fetch of 9cb1915044cf65b9f6f90fcc6a15e088fea5354c1c47afcfeab288bdb70cec23.file
OT: queuing fetch of 874cb63f4bb1a870a6534e389354a76a5a87094cbc9a3c2479e6afd285a9f732.file
OT: queuing fetch of d6c8d2587361ded82ee59faf8524d9258c35542331282ef23ac98fd4a92f3ff1.file
OT: queuing fetch of 4be377e2e27a5c1fcd42d58bf3730335926c30f254ac03187141bfd32693ed5d.file
OT: queuing fetch of 78b8b454786f6347335278fba9c32c5916e9c7343f7a4930f966aff67a6facbe.file
OT: queuing fetch of 5ea3c5a608e13f99890dc72fe792d8661bd7f0eb0718ecb868736094528fb382.file
OT: queuing fetch of 5ba1d09a57b8d7d0ad7667af56ea21347210f66dd7fd15e5ec36855b75ec3f18.file
OT: queuing fetch of 8c4e8afd9764b7136f6ae2327ea4456d712f7982e09b411e867b569d9a20fa6f.file
OT: queuing fetch of 02d9e981c808be21d50a6cb70cd6f6e5155c794b894a2b0bf5debe6987a080a9.file
OT: queuing fetch of eb0a92c215dcd5eba2b3a56635532fe65a21f0b0a099de4836faec4b34e0ee71.file
OT: queuing fetch of 7cd4a6873a74b171365279e941a9b6705c89cf9aa5d755b007fab0a33c0ed021.file
OT: queuing fetch of 678339deb71a57e3e64b9ee0fffa78e57d272f5315fcef383b1a5f236af02433.file
OT: queuing fetch of 4aa58b82d3d9612bdbd17817ac6fe4c0d9149a866490f8adb1d83861938c72d1.file
OT: queuing fetch of 0e0c4e9017561a6598c8e827bd7e914f8e776a17da5235c68e050dd57db1f84a.file
OT: queuing fetch of 8e77374488f3571d7e43f9fdde5ab6f4bf9d5c833fca395d2b90098bf2130aa5.file
OT: queuing fetch of 7dd34de140b9208b71f3cbcfc817b2b583287d4775bf33f3f939db3b832181e6.file
OT: queuing fetch of 93874d785a7483db686eafd16e4bd8a5994e40932f5c1a908b03ed845bf7d3fd.file
OT: queuing fetch of 82f752393a99cab82b1aac878fd4eaa0e41a9965c10d7728b05f4edc9c60fc28.file
OT: fetch of b2cb39f0b022a765510bd9b1adc78dd7b8c4da9015fcf1ad9b17ccb1a029944d.file complete
The "seconds remaining" clearly wrong at this place.
Receiving delta parts: 12/12 780.1 kB/s 142.0 MB/141.9 MB 273679195 days 10 hours 18 minutes 46 seconds remainingOT: queuing fetch of 7516f6908f00a9b0da9a9a8b80326096043c1843b7660471661d215dc7d49dda.file
OT: write of b2cb39f0b022a765510bd9b1adc78dd7b8c4da9015fcf1ad9b17ccb1a029944d.file complete
OT: fetch of baf41ae63404a8c55706a2ea712f52f010661c9b83b1c1c470604148ffbc888e.file complete
OT: write of baf41ae63404a8c55706a2ea712f52f010661c9b83b1c1c470604148ffbc888e.file complete
OT: fetch of 4b0b35752d1f7733baf0f481d6c2713ebdbad1383dc4f8afed5802998917e534.file complete
OT: fetch of a88fc159400cbee751b9f7263eaebcefeed98e7404250bd05ce4b232d2760f85.file complete
OT: write of 4b0b35752d1f7733baf0f481d6c2713ebdbad1383dc4f8afed5802998917e534.file complete
OT: write of a88fc159400cbee751b9f7263eaebcefeed98e7404250bd05ce4b232d2760f85.file complete
OT: fetch of 28229d03c5b049c4e094df96a298d73b0d6318869fb534105d694197d11f71ab.file complete
OT: queuing fetch of 7cbd11e3a748e7f032c8343a7e024b7ed4ce3f30cf36961d1b1a5a4b6a362815.file
OT: queuing fetch of fc3e7d30382427461483266f504697f74f93cf77e8f0e2192d746d131e467cd9.file
OT: queuing fetch of 0405ce95431122a9d346f0cb31e3f9241d8219370cf118900f1adcd02a716025.file
OT: write of 28229d03c5b049c4e094df96a298d73b0d6318869fb534105d694197d11f71ab.file complete
OT: fetch of 26b8d8b3de4911b77b98d856ccab2d3708e24e54d8144237990dcbca61d88346.file complete
OT: fetch of 78b8b454786f6347335278fba9c32c5916e9c7343f7a4930f966aff67a6facbe.file complete
OT: fetch of 9cb1915044cf65b9f6f90fcc6a15e088fea5354c1c47afcfeab288bdb70cec23.file complete
OT: write of 78b8b454786f6347335278fba9c32c5916e9c7343f7a4930f966aff67a6facbe.file complete
OT: queuing fetch of f97fb2b777bece1b7d9a613a01a6a05f0500b5c29edce3d94d460204f9bd86f7.file
OT: fetch of 4be377e2e27a5c1fcd42d58bf3730335926c30f254ac03187141bfd32693ed5d.file complete
OT: queuing fetch of 2d914de35755fbedabe96bc3317f29925faf3db7df0b23e53770edc54ea66464.file
OT: queuing fetch of 9b37c23b32c078c1ed051bac6ce0bf565d966589a130a14f8c86e00ec8e7ffb8.file
OT: write of 26b8d8b3de4911b77b98d856ccab2d3708e24e54d8144237990dcbca61d88346.file complete
OT: fetch of 5ea3c5a608e13f99890dc72fe792d8661bd7f0eb0718ecb868736094528fb382.file complete
OT: write of 5ea3c5a608e13f99890dc72fe792d8661bd7f0eb0718ecb868736094528fb382.file complete
OT: write of 9cb1915044cf65b9f6f90fcc6a15e088fea5354c1c47afcfeab288bdb70cec23.file complete
OT: write of 4be377e2e27a5c1fcd42d58bf3730335926c30f254ac03187141bfd32693ed5d.file complete
Receiving delta parts: 12/12 781.8 kB/s 143.9 MB/141.9 MB 273087949 days 17 hours 39 minutes 14 seconds remainingOT: fetch of 4498766141a64badcfd72bfe6827bfd8fba8f132474eeef83255f3841c6cbd56.file complete
OT: fetch of eb0a92c215dcd5eba2b3a56635532fe65a21f0b0a099de4836faec4b34e0ee71.file complete
OT: write of eb0a92c215dcd5eba2b3a56635532fe65a21f0b0a099de4836faec4b34e0ee71.file complete
OT: fetch of 8c4e8afd9764b7136f6ae2327ea4456d712f7982e09b411e867b569d9a20fa6f.file complete
OT: fetch of d6c8d2587361ded82ee59faf8524d9258c35542331282ef23ac98fd4a92f3ff1.file complete
OT: fetch of 02d9e981c808be21d50a6cb70cd6f6e5155c794b894a2b0bf5debe6987a080a9.file complete
OT: write of d6c8d2587361ded82ee59faf8524d9258c35542331282ef23ac98fd4a92f3ff1.file complete
OT: fetch of 634dd214ed52aab5e913171f10b331f8d84d8cacdbc93be83dea611f20f228e4.file complete
OT: queuing fetch of 6ea16be02dd66f2a55ddaac4af36eb04b540cf6ee600e2b0e6416454f483a85f.file
OT: queuing fetch of 57d7478f4ebab662afb83226b981712e81d1ce81f82cb57fb01c3cd316ea395e.file
OT: queuing fetch of 1964f30425ef1a0d86920c3c77fc43d2bd8bc13ad0feeaf6a1017e23f005b4cc.file
OT: fetch of 874cb63f4bb1a870a6534e389354a76a5a87094cbc9a3c2479e6afd285a9f732.file complete
OT: fetch of 8e77374488f3571d7e43f9fdde5ab6f4bf9d5c833fca395d2b90098bf2130aa5.file complete
OT: write of 4498766141a64badcfd72bfe6827bfd8fba8f132474eeef83255f3841c6cbd56.file complete
OT: write of 8e77374488f3571d7e43f9fdde5ab6f4bf9d5c833fca395d2b90098bf2130aa5.file complete
OT: queuing fetch of 89a416d2669cd64475cc118b785f7fe0d868eda2360c43f254457331738dbc26.file
OT: queuing fetch of a827caf6fb8f9fa75d4b911bd32d1f08d4c9e3810793d59eeee6926ee6cfe926.file
OT: queuing fetch of d2d4dc302bfb0d90c58f605bf42e9c35f1057f3971da91da15cf396de1915214.file
OT: queuing fetch of c69445d3ef40b5c1a5d3b668109b237ad1809ba4c648c9f8b2c5972021ce8b3e.file
OT: queuing fetch of 10ce03b34374455f3cc675a29e0ddf73c16aaac59b39d9105140321d23b54db1.file
OT: queuing fetch of bfcf43176e0d8ca35dd5296dc285d44c189f4f51b3fbd26e7d3a31a64e949e59.file
OT: queuing fetch of 84fdb5e1f04d6c5ab9e6f39f3ea4dd5ef1b0868cc385dd23968d3a25fd9ee56e.file
OT: write of 8c4e8afd9764b7136f6ae2327ea4456d712f7982e09b411e867b569d9a20fa6f.file complete
OT: write of 02d9e981c808be21d50a6cb70cd6f6e5155c794b894a2b0bf5debe6987a080a9.file complete
Receiving delta parts: 12/12 787.9 kB/s 145.0 MB/141.9 MB 270974057 days 4 hours 55 minutes 12 seconds remainingOT: fetch of 7cd4a6873a74b171365279e941a9b6705c89cf9aa5d755b007fab0a33c0ed021.file complete
OT: queuing fetch of 07502f747fb2d2b131d12f5730ca1a32009c027296825e336f858a7f51630b82.file
OT: fetch of 7516f6908f00a9b0da9a9a8b80326096043c1843b7660471661d215dc7d49dda.file complete
OT: write of 7cd4a6873a74b171365279e941a9b6705c89cf9aa5d755b007fab0a33c0ed021.file complete
OT: write of 7516f6908f00a9b0da9a9a8b80326096043c1843b7660471661d215dc7d49dda.file complete
OT: fetch of 0e0c4e9017561a6598c8e827bd7e914f8e776a17da5235c68e050dd57db1f84a.file complete
OT: fetch of 7cbd11e3a748e7f032c8343a7e024b7ed4ce3f30cf36961d1b1a5a4b6a362815.file complete
OT: write of 874cb63f4bb1a870a6534e389354a76a5a87094cbc9a3c2479e6afd285a9f732.file complete
OT: write of 634dd214ed52aab5e913171f10b331f8d84d8cacdbc93be83dea611f20f228e4.file complete
OT: fetch of 0405ce95431122a9d346f0cb31e3f9241d8219370cf118900f1adcd02a716025.file complete
OT: fetch of fc3e7d30382427461483266f504697f74f93cf77e8f0e2192d746d131e467cd9.file complete
OT: write of 7cbd11e3a748e7f032c8343a7e024b7ed4ce3f30cf36961d1b1a5a4b6a362815.file complete
OT: write of 0405ce95431122a9d346f0cb31e3f9241d8219370cf118900f1adcd02a716025.file complete
OT: write of fc3e7d30382427461483266f504697f74f93cf77e8f0e2192d746d131e467cd9.file complete
OT: fetch of f97fb2b777bece1b7d9a613a01a6a05f0500b5c29edce3d94d460204f9bd86f7.file complete
OT: write of f97fb2b777bece1b7d9a613a01a6a05f0500b5c29edce3d94d460204f9bd86f7.file complete
OT: fetch of 2d914de35755fbedabe96bc3317f29925faf3db7df0b23e53770edc54ea66464.file complete
OT: write of 2d914de35755fbedabe96bc3317f29925faf3db7df0b23e53770edc54ea66464.file complete
Receiving delta parts: 12/12 791.4 kB/s 146.4 MB/141.9 MB 269767501 days 19 hours 34 minutes 40 seconds remainingOT: queuing fetch of 28ecd25ca48acf0454e98618a8dd147608c778a6eaead8668147c999fdec4ece.file
OT: write of 0e0c4e9017561a6598c8e827bd7e914f8e776a17da5235c68e050dd57db1f84a.file complete
OT: fetch of 82f752393a99cab82b1aac878fd4eaa0e41a9965c10d7728b05f4edc9c60fc28.file complete
OT: fetch of 9b37c23b32c078c1ed051bac6ce0bf565d966589a130a14f8c86e00ec8e7ffb8.file complete
OT: fetch of 5ba1d09a57b8d7d0ad7667af56ea21347210f66dd7fd15e5ec36855b75ec3f18.file complete
OT: fetch of 1964f30425ef1a0d86920c3c77fc43d2bd8bc13ad0feeaf6a1017e23f005b4cc.file complete
OT: fetch of 57d7478f4ebab662afb83226b981712e81d1ce81f82cb57fb01c3cd316ea395e.file complete
OT: write of 1964f30425ef1a0d86920c3c77fc43d2bd8bc13ad0feeaf6a1017e23f005b4cc.file complete
OT: write of 9b37c23b32c078c1ed051bac6ce0bf565d966589a130a14f8c86e00ec8e7ffb8.file complete
OT: write of 57d7478f4ebab662afb83226b981712e81d1ce81f82cb57fb01c3cd316ea395e.file complete
OT: fetch of a827caf6fb8f9fa75d4b911bd32d1f08d4c9e3810793d59eeee6926ee6cfe926.file complete
OT: write of a827caf6fb8f9fa75d4b911bd32d1f08d4c9e3810793d59eeee6926ee6cfe926.file complete
OT: fetch of 89a416d2669cd64475cc118b785f7fe0d868eda2360c43f254457331738dbc26.file complete
OT: fetch of c69445d3ef40b5c1a5d3b668109b237ad1809ba4c648c9f8b2c5972021ce8b3e.file complete
OT: write of c69445d3ef40b5c1a5d3b668109b237ad1809ba4c648c9f8b2c5972021ce8b3e.file complete
OT: write of 89a416d2669cd64475cc118b785f7fe0d868eda2360c43f254457331738dbc26.file complete
OT: write of 82f752393a99cab82b1aac878fd4eaa0e41a9965c10d7728b05f4edc9c60fc28.file complete
OT: fetch of 10ce03b34374455f3cc675a29e0ddf73c16aaac59b39d9105140321d23b54db1.file complete
OT: write of 10ce03b34374455f3cc675a29e0ddf73c16aaac59b39d9105140321d23b54db1.file complete
Receiving delta parts: 12/12 795.2 kB/s 147.9 MB/141.9 MB 268491261 days 2 hours 22 minutes 19 seconds remainingOT: fetch of 84fdb5e1f04d6c5ab9e6f39f3ea4dd5ef1b0868cc385dd23968d3a25fd9ee56e.file complete
OT: fetch of 07502f747fb2d2b131d12f5730ca1a32009c027296825e336f858a7f51630b82.file complete
OT: fetch of 4aa58b82d3d9612bdbd17817ac6fe4c0d9149a866490f8adb1d83861938c72d1.file complete
OT: fetch of 6ea16be02dd66f2a55ddaac4af36eb04b540cf6ee600e2b0e6416454f483a85f.file complete
OT: fetch of 28ecd25ca48acf0454e98618a8dd147608c778a6eaead8668147c999fdec4ece.file complete
OT: fetch of bfcf43176e0d8ca35dd5296dc285d44c189f4f51b3fbd26e7d3a31a64e949e59.file complete
OT: fetch of e7b891cb51d74b8c5ffc2359293c69992c8532ac535aca666378fff18a3c7394.file complete
OT: fetch of 678339deb71a57e3e64b9ee0fffa78e57d272f5315fcef383b1a5f236af02433.file complete
OT: fetch of 7dd34de140b9208b71f3cbcfc817b2b583287d4775bf33f3f939db3b832181e6.file complete
OT: fetch of 93874d785a7483db686eafd16e4bd8a5994e40932f5c1a908b03ed845bf7d3fd.file complete
OT: fetch of d2d4dc302bfb0d90c58f605bf42e9c35f1057f3971da91da15cf396de1915214.file complete
OT: write of 84fdb5e1f04d6c5ab9e6f39f3ea4dd5ef1b0868cc385dd23968d3a25fd9ee56e.file complete
OT: write of 07502f747fb2d2b131d12f5730ca1a32009c027296825e336f858a7f51630b82.file complete
OT: write of 4aa58b82d3d9612bdbd17817ac6fe4c0d9149a866490f8adb1d83861938c72d1.file complete
OT: write of 6ea16be02dd66f2a55ddaac4af36eb04b540cf6ee600e2b0e6416454f483a85f.file complete
OT: write of 28ecd25ca48acf0454e98618a8dd147608c778a6eaead8668147c999fdec4ece.file complete
OT: write of 678339deb71a57e3e64b9ee0fffa78e57d272f5315fcef383b1a5f236af02433.file complete
OT: write of d2d4dc302bfb0d90c58f605bf42e9c35f1057f3971da91da15cf396de1915214.file complete
OT: write of bfcf43176e0d8ca35dd5296dc285d44c189f4f51b3fbd26e7d3a31a64e949e59.file complete
Is there extra MB expected here?
Receiving delta parts: 12/12 795.8 kB/s 149.6 MB/141.9 MB 268277704 days 18 hours 14 minutes 18 seconds remainingOT: queuing fetch of 864d5549432e5db9f067429c1f1b40f826875bbe176635da4e76dd6141796561.file
OT: fetch of 864d5549432e5db9f067429c1f1b40f826875bbe176635da4e76dd6141796561.file complete
OT: write of 864d5549432e5db9f067429c1f1b40f826875bbe176635da4e76dd6141796561.file complete
OT: queuing fetch of 16a7499be9368c3bb1667b798801f1f868a03bc380b0e8cd2a9b2bd78600803c.file
OT: fetch of 16a7499be9368c3bb1667b798801f1f868a03bc380b0e8cd2a9b2bd78600803c.file complete
OT: write of 16a7499be9368c3bb1667b798801f1f868a03bc380b0e8cd2a9b2bd78600803c.file complete
OT: write of 5ba1d09a57b8d7d0ad7667af56ea21347210f66dd7fd15e5ec36855b75ec3f18.file complete
OT: write of 7dd34de140b9208b71f3cbcfc817b2b583287d4775bf33f3f939db3b832181e6.file complete
OT: write of 93874d785a7483db686eafd16e4bd8a5994e40932f5c1a908b03ed845bf7d3fd.file complete
OT: write of e7b891cb51d74b8c5ffc2359293c69992c8532ac535aca666378fff18a3c7394.file complete
Writing objects: 2                                                              OT: execute static delta part 090ba845ac63fce41d4d8b9725f6a2dfd8c2c7c0cb42e0ad16f7119006624f6d complete
Writing objects: 1                                                              OT: write of 02b4dc7f5b3e364a4efde0b01e31b96802a4b38a8e93a0815aa630dc38edd69f.file complete
OT: pull: idle, exiting mainloop
Seems to spent a significant amount here as well, about ~35sec

error: Bad file descriptor

real    5m21.931s
user    1m34.327s
sys    0m39.642s


From: Giuseppe Scrivano <gscrivan redhat com>
Sent: Friday, July 22, 2016 3:02:06 PM
To: Gatis Paeglis
Cc: Colin Walters; ostree-list gnome org
Subject: Re: Fwd: ostree static-delta
 
Hi Gatis,

Gatis Paeglis <Gatis Paeglis qt io> writes:

> It seems like these results were a fluke, as I can not reproduce 2/3 size improvement anymore. Today I am getting:
>
> 196612 KiB // no deltas
>
> 146121 KiB // with deltas

does tweaking --max-bsdiff-size make any difference?

Regards,
Giuseppe


[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]