suddenly getting errors while building OCI images

Hi, thanks for bringing this up. We are taking a look.

Was there anything changed in the way these recipes are built etc?

Hi. Not that I'm aware of. From the logs we can see the image is correctly build. It then appears to fail in https://git.launchpad.net/launchpad-buildd/tree/lpbuildd/oci.py#n158.

Comparing the last successful builds with the failed ones, I see that the Docker version has changed from v24 to v26, so I wonder if the `docker save` behaves differently now, as that's the input for the "fileobj" error.

Yes it could be that. https://git.launchpad.net/launchpad-buildd/tree/lpbuildd/oci.py#n218 is where I think the error originates.

`fileboj` is first defined in the if block at n198. The last tar file that was processed here was "repositories". I don't think there was any error, else it would have been caught by the corresponding except block.

 The "if" block at n188 is never executed, is the "layer.tar" something that has been removed from newer docker images?

Also, why there was a change in docker version?

That I'm not sure. Have the builders been updated?

I don't think there has been update around OCI builds in a long time. Likewise nothing special was done in the last few days that could affect this.

We need to figure out what led to the change of docker version.

Were there any updates on your end in the build config etc (change in Ubuntu series or any other config)?

Hi, it seems there has been an update for docker in focal-updates

> Were there any updates on your end in the build config etc (change in Ubuntu series or any other config)?

no changes on our end.

no changes on our end.

On Wed, Feb 12, 2025 at 7:40 AM Tushar Gupta <
<email address hidden>> wrote:

> Your question #820899 on Launchpad itself changed:
> https://answers.launchpad.net/launchpad/+question/820899
>
> Tushar Gupta posted a new comment:
> I don't think there has been update around OCI builds in a long time.
> Likewise nothing special was done in the last few days that could affect
> this.
>
> We need to figure out what led to the change of docker version.
>
> Were there any updates on your end in the build config etc (change in
> Ubuntu series or any other config)?
>
> --
> You received this question notification because you asked the question.
>

--
Cristovao Cordeiro (aka Cris)

Hi @cjdc, we identified the issue. There has been SRU update for docker.io-app package and the new version is failing the LP OCI builds. I have filed a regression report here: https://bugs.launchpad.net/ubuntu/+source/docker.io-app/+bug/2098106

Thanks. AFAIU, the OCI-based output of "docker save" seems to be
intentional, so future version will preserve that behavior. It might be
good anyway to adjust the OCI recipes to accommodate this change, and
possible work with both file formats.

On Wed, Feb 12, 2025 at 4:35 PM Tushar Gupta <
<email address hidden>> wrote:

> Your question #820899 on Launchpad itself changed:
> https://answers.launchpad.net/launchpad/+question/820899
>
> Tushar Gupta posted a new comment:
> Hi @cjdc, we identified the issue. There has been SRU update for
> docker.io-app package and the new version is failing the LP OCI builds.
> I have filed a regression report here:
> https://bugs.launchpad.net/ubuntu/+source/docker.io-app/+bug/2098106
>
> --
> You received this question notification because you asked the question.
>

--
Cristovao Cordeiro (aka Cris)

This question was expired because it remained in the 'Open' state without activity for the last 15 days.

A hotfix was added to use 20.x atm. LP needs to add support for 26.x docker versions now.

Relevant ticket: https://warthogs.atlassian.net/browse/LP-2303?atlOrigin=eyJpIjoiM2ExM2RhZGU1ZDYwNDcwNDgzNzVjYjUzMjNjMTFlMjAiLCJwIjoiaiJ9

Added the current status of the ticket in the latest comment.