weekly-builds 14.11.2011: apt-cdrom add fails

On Wed, Nov 16, 2011 at 11:54:00PM +0100, Andrey Gursky wrote:

Hi!

As with almost each weekly-build DVD I was about to update one of my
PCs not connected to internet. But this time it has failed:

# apt-cdrom add
Using CD-ROM mount point /media/cdrom/
Identifying.. [069340101a1adf7d86340ad21d1a4711-2]
Scanning disc for index files..
Found 2 package indexes, 0 source indexes, 39 translation indexes and
0 signatures
Found label 'Debian GNU/Linux testing _Wheezy_ - Official Snapshot
i386 DVD Binary-1 20111114-04:04'
This disc is called:
'Debian GNU/Linux testing _Wheezy_ - Official Snapshot i386 DVD
Binary-1 20111114-04:04'
Reading Package Indexes... Done
Reading Translation Indexes... Error!
E: Unable to parse package file
/media/cdrom/dists/wheezy/main/i18n/Translation-da.bz2 (1)
#

What could be the reason?

Looks like a bug in apt, as far as I can see - pkgTagFile::Resize()
has a hard-coded internal maximum buffer size of 1MiB, and
Translation-da.bz2 decompresses to 1134737 bytes. It's the first file
in dists/wheezy/main/i18n that crosses that threshold, hence it's the
one listed in the error message.

Andrey, you *may* be able to work around this problem by specifying
just the languages you want using Acquire::Languages in apt.conf. I've
not been able to test that myself yet.

Um, folks - I think this is likely to be a show-stopper for putting
translated description files on CD/DVD. Help! :-/ As to why we've not
seen this in the archive yet, I don't know...

Steve McIntyre, Cambridge, UK.
Who needs computer imagery when you've got Brian Blessed?


To UNSUBSCRIBE, email to
with a subject of "unsubscribe". Trouble? Contact
Archive: http://lists.debian.org/

On Thu, Nov 17, 2011 at 10:45:41AM +0100, Andrey Gursky wrote:

2011/11/17, Steve McIntyre :

Looks like a bug in apt, as far as I can see - pkgTagFile::Resize()
has a hard-coded internal maximum buffer size of 1MiB, and
Translation-da.bz2 decompresses to 1134737 bytes. It's the first file
in dists/wheezy/main/i18n that crosses that threshold, hence it's the
one listed in the error message.

Andrey, you *may* be able to work around this problem by specifying
just the languages you want using Acquire::Languages in apt.conf. I've
not been able to test that myself yet.

Steve, thanks for your quickly response! Here is the default config:

# apt-config dump | grep Acquire::Languages
Acquire::Languages "";
Acquire::Languages:: "en_US";
Acquire::Languages:: "en";
Acquire::Languages:: "none";
#

It seems no translations except English one should be acquired at all.
Even if I call

#apt-cdrom -oAcquire::Languages="en" add

I get the error. Could apt-cdrom ignore the option?

Not sure, I'm afraid.

Version:
apt 0.8.15.9 for i386 compiled on Oct 14 2011 11:44:58

Um, folks - I think this is likely to be a show-stopper for putting
translated description files on CD/DVD. Help! :-/ As to why we've not
seen this in the archive yet, I don't know...

I thought it would be the first time the translation file was updated
to be more than 1 MB, but not and there are even more bigger bz2 files
(-de, -it, -uk).
I haven't yet updated my amd64 DVD image (07.11.2011). There is no
dists/wheezy/i18n directory yet. So the last image is the first one
including the i18n.

This week's CDs/DVDs are the first to include the translated
description files, as I just implemented the support last weekend. :-)

Steve McIntyre, Cambridge, UK.
Armed with "Valor": "Centurion" represents quality of Discipline,
Honor, Integrity and Loyalty. Now you don't have to be a Caesar to
concord the digital world while feeling safe and proud.


To UNSUBSCRIBE, email to
with a subject of "unsubscribe". Trouble? Contact
Archive: http://lists.debian.org/

2011/11/17, Steve McIntyre :

On Wed, Nov 16, 2011 at 11:54:00PM +0100, Andrey Gursky wrote:

Hi!

As with almost each weekly-build DVD I was about to update one of my
PCs not connected to internet. But this time it has failed:

# apt-cdrom add
Using CD-ROM mount point /media/cdrom/
Identifying.. [069340101a1adf7d86340ad21d1a4711-2]
Scanning disc for index files..
Found 2 package indexes, 0 source indexes, 39 translation indexes and
0 signatures
Found label 'Debian GNU/Linux testing _Wheezy_ - Official Snapshot
i386 DVD Binary-1 20111114-04:04'
This disc is called:
'Debian GNU/Linux testing _Wheezy_ - Official Snapshot i386 DVD
Binary-1 20111114-04:04'
Reading Package Indexes... Done
Reading Translation Indexes... Error!
E: Unable to parse package file
/media/cdrom/dists/wheezy/main/i18n/Translation-da.bz2 (1)
#

What could be the reason?

Looks like a bug in apt, as far as I can see - pkgTagFile::Resize()
has a hard-coded internal maximum buffer size of 1MiB, and
Translation-da.bz2 decompresses to 1134737 bytes. It's the first file
in dists/wheezy/main/i18n that crosses that threshold, hence it's the
one listed in the error message.

Andrey, you *may* be able to work around this problem by specifying
just the languages you want using Acquire::Languages in apt.conf. I've
not been able to test that myself yet.

Steve, thanks for your quickly response! Here is the default config:

# apt-config dump | grep Acquire::Languages
Acquire::Languages "";
Acquire::Languages:: "en_US";
Acquire::Languages:: "en";
Acquire::Languages:: "none";
#

It seems no translations except English one should be acquired at all.
Even if I call

#apt-cdrom -oAcquire::Languages="en" add

I get the error. Could apt-cdrom ignore the option?

Version:
apt 0.8.15.9 for i386 compiled on Oct 14 2011 11:44:58

Um, folks - I think this is likely to be a show-stopper for putting
translated description files on CD/DVD. Help! :-/ As to why we've not
seen this in the archive yet, I don't know...

I thought it would be the first time the translation file was updated
to be more than 1 MB, but not and there are even more bigger bz2 files
(-de, -it, -uk).
I haven't yet updated my amd64 DVD image (07.11.2011). There is no
dists/wheezy/i18n directory yet. So the last image is the first one
including the i18n.

Andrey


To UNSUBSCRIBE, email to
with a subject of "unsubscribe". Trouble? Contact
Archive: http://lists.debian.org/

2011/11/17, Steve McIntyre :

On Thu, Nov 17, 2011 at 10:45:41AM +0100, Andrey Gursky wrote:

2011/11/17, Steve McIntyre :

Looks like a bug in apt, as far as I can see - pkgTagFile::Resize()
has a hard-coded internal maximum buffer size of 1MiB, and
Translation-da.bz2 decompresses to 1134737 bytes. It's the first file
in dists/wheezy/main/i18n that crosses that threshold, hence it's the
one listed in the error message.

Andrey, you *may* be able to work around this problem by specifying
just the languages you want using Acquire::Languages in apt.conf. I've
not been able to test that myself yet.

Steve, thanks for your quickly response! Here is the default config:

# apt-config dump | grep Acquire::Languages
Acquire::Languages "";
Acquire::Languages:: "en_US";
Acquire::Languages:: "en";
Acquire::Languages:: "none";
#

It seems no translations except English one should be acquired at all.
Even if I call

#apt-cdrom -oAcquire::Languages="en" add

I get the error. Could apt-cdrom ignore the option?

Not sure, I'm afraid.

Version:
apt 0.8.15.9 for i386 compiled on Oct 14 2011 11:44:58

Um, folks - I think this is likely to be a show-stopper for putting
translated description files on CD/DVD. Help! :-/ As to why we've not
seen this in the archive yet, I don't know...

I thought it would be the first time the translation file was updated
to be more than 1 MB, but not and there are even more bigger bz2 files
(-de, -it, -uk).
I haven't yet updated my amd64 DVD image (07.11.2011). There is no
dists/wheezy/i18n directory yet. So the last image is the first one
including the i18n.

This week's CDs/DVDs are the first to include the translated
description files, as I just implemented the support last weekend. :-)

Aha ;)
For now I've workarounded this with unionfs by removing the i18n.

Andrey


To UNSUBSCRIBE, email to
with a subject of "unsubscribe". Trouble? Contact
Archive: http://lists.debian.org/CABg52Hn8dx5WRqM-KNC5T=

On Thu, Nov 17, 2011 at 12:02:57AM +0000, Steve McIntyre wrote:

What could be the reason?

Looks like a bug in apt, as far as I can see - pkgTagFile::Resize()
has a hard-coded internal maximum buffer size of 1MiB, and
Translation-da.bz2 decompresses to 1134737 bytes. It's the first file
in dists/wheezy/main/i18n that crosses that threshold, hence it's the
one listed in the error message.

Andrey, you *may* be able to work around this problem by specifying
just the languages you want using Acquire::Languages in apt.conf. I've
not been able to test that myself yet.

Um, folks - I think this is likely to be a show-stopper for putting
translated description files on CD/DVD. Help! :-/ As to why we've not
seen this in the archive yet, I don't know...

After several days with no response at all from the apt maintainers
(:-/) I've just dug further and found the problem. Apt is hard-coded
internally to only support gzip compression for various files when
working with CDs. I'm filing a serious bug about this now as it's
going to cause hassle, and I'm also about to commit a debian-cd update
to use gzip compression for the Translation files instead.

Steve McIntyre, Cambridge, UK.
< sladen> I actually stayed in a hotel and arrived to find a post-it
note stuck to the mini-bar saying "Paul: This fridge and
fittings are the correct way around and do not need altering"


To UNSUBSCRIBE, email to
with a subject of "unsubscribe". Trouble? Contact
Archive: http://lists.debian.org/