M1 support for Docker image

M1 support for Docker image

[Claudio Di Vita]

[-- Attachment #1: Type: text/plain, Size: 104 bytes --]

Hi guys,

is there any chance to have Pandoc Docker images that works with Apple M1 ?

Thanks,

Claudio

Re: M1 support for Docker image

[Albert Krewinkel]

Claudio Di Vita <claudio.divita-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:

> is there any chance to have Pandoc Docker images that works with
> Apple M1 ?

It's on my todo list; any help is welcome.

See also <https://github.com/pandoc/dockerfiles/issues/134>.


-- 
Albert Krewinkel
GPG: 8eed e3e2 e8c5 6f18 81fe  e836 388d c0b2 1f63 1124

Re: M1 support for Docker image

['Till Grallert' via pandoc-discuss]

[-- Attachment #1.1: Type: text/plain, Size: 1271 bytes --]

Thank you for pointing me to the GitHub issue. However, I just played 
around with the Docker images on an ARM Mac and it appears that everything 
works just fine with the current `core:edge` image. Only caveat is that 
this image seemingly does not include the pandoc-crossref filter. If the 
pandoc command includes  this filter, the docker run will finish without an 
error message BUT also generating any output.

On Tuesday, October 18, 2022 at 11:17:57 PM UTC+2 Albert Krewinkel wrote:

>
> Claudio Di Vita <claudio...-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:
>
> > is there any chance to have Pandoc Docker images that works with
> > Apple M1 ?
>
> It's on my todo list; any help is welcome.
>
> See also <https://github.com/pandoc/dockerfiles/issues/134>.
>
>
> -- 
> Albert Krewinkel
> GPG: 8eed e3e2 e8c5 6f18 81fe e836 388d c0b2 1f63 1124
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/ee6644df-f0f3-4dc3-988a-97228c93f1c9n%40googlegroups.com.

[-- Attachment #1.2: Type: text/html, Size: 2142 bytes --]

Re: M1 support for Docker image

[Claudio Di Vita]

[-- Attachment #1.1: Type: text/plain, Size: 4578 bytes --]

With a support of a colleague that has an Apple M1, I'm trying to build the 
pandoc/latex:edge-ubuntu image.

The build fails due to some installation issue with TexLive:

Time used for installing the packages: 00:38
running mktexlsr /opt/texlive/texdir/texmf-dist ...
writing fmtutil.cnf to /opt/texlive/texdir/texmf-dist/web2c/fmtutil.cnf
writing updmap.cfg to /opt/texlive/texdir/texmf-dist/web2c/updmap.cfg
writing language.dat to 
/opt/texlive/texdir/texmf-var/tex/generic/config/language.dat
writing language.def to 
/opt/texlive/texdir/texmf-var/tex/generic/config/language.def
writing language.dat.lua to 
/opt/texlive/texdir/texmf-var/tex/generic/config/language.dat.lua
running mktexlsr /opt/texlive/texdir/texmf-var 
/opt/texlive/texdir/texmf-config /opt/texlive/texdir/texmf-dist ...
running updmap-sys --nohash ...done
re-running mktexlsr /opt/texlive/texdir/texmf-var 
/opt/texlive/texdir/texmf-config ...
pre-generating all format files, be patient...
running fmtutil-sys --no-error-if-no-engine=luajithbtex,luajittex,mfluajit 
--no-strict --all ...done
running package-specific postactions
finished with package-specific postactionsWelcome to TeX Live!See 
/opt/texlive/texdir/index.html for links to documentation.
The TeX Live web site (https://tug.org/texlive/) contains any updates and 
corrections. TeX Live is a joint project of the TeX user groups around the 
world; please consider supporting it by joining the group best for you. The 
list of groups is available on the web at https://tug.org/usergroups.html.Add 
/opt/texlive/texdir/texmf-dist/doc/man to MANPATH.
Add /opt/texlive/texdir/texmf-dist/doc/info to INFOPATH.
Most importantly, add /opt/texlive/texdir/bin/aarch64-linux
to your PATH for current and future sessions.
Logfile: 
/opt/texlive/texdir/install-tl.log ----------------------------------------------------------------------
 The following environment variables contain the string "tex"
 (case-independent). If you're doing anything but adding personal
 directories to the system paths, they may well cause trouble somewhere
 while running TeX. If you encounter problems, try unsetting them. Please 
ignore spurious matches unrelated to TeX. (To omit this check,
 set the environment variable 
TEXLIVE_INSTALL_ENV_NOCHECK.)  texlive_version=2022
 ----------------------------------------------------------------------
xargs: tlmgr: No such file or directory
The command '/bin/sh -c /root/install-texlive.sh $texlive_version  && sed 
-e 's/ *#.*$//' -e '/^ *$/d' /root/packages.txt |   xargs tlmgr install  && 
rm -f /root/texlive.profile      /root/install-texlive.sh      
/root/packages.txt  && TERM=dumb luaotfload-tool --update  && chmod -R o+w 
/opt/texlive/texdir/texmf-var' returned a non-zero code: 127

Any clue on the possible cause ?

Please note that I forced the TeXLive version to 2022.

In the meanwhile, I'm also trying to build multi-arch images using GitHub 
Actions but it requires a lot of work and a different approach to images 
testing due to Docker buildx way of working.

Thanks,

Claudio
Il giorno mercoledì 19 ottobre 2022 alle 13:14:26 UTC+2 
till.g...-gM/Ye1E23mwN+BqQ9rBEUg@public.gmane.org ha scritto:

> Thank you for pointing me to the GitHub issue. However, I just played 
> around with the Docker images on an ARM Mac and it appears that everything 
> works just fine with the current `core:edge` image. Only caveat is that 
> this image seemingly does not include the pandoc-crossref filter. If the 
> pandoc command includes  this filter, the docker run will finish without an 
> error message BUT also generating any output.
>
> On Tuesday, October 18, 2022 at 11:17:57 PM UTC+2 Albert Krewinkel wrote:
>
>>
>> Claudio Di Vita <claudio...-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:
>>
>> > is there any chance to have Pandoc Docker images that works with
>> > Apple M1 ?
>>
>> It's on my todo list; any help is welcome.
>>
>> See also <https://github.com/pandoc/dockerfiles/issues/134>.
>>
>>
>> -- 
>> Albert Krewinkel
>> GPG: 8eed e3e2 e8c5 6f18 81fe e836 388d c0b2 1f63 1124
>>
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/4aa8604b-23c8-4960-ba58-d168bee56bfdn%40googlegroups.com.

[-- Attachment #1.2: Type: text/html, Size: 6005 bytes --]

Re: M1 support for Docker image

[Albert Krewinkel]

Claudio Di Vita <claudio.divita-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:

> With a support of a colleague that has an Apple M1, I'm trying to
> build the pandoc/latex:edge-ubuntu image.

That's great news!

> The build fails due to some installation issue with TexLive:
>
> Time used for installing the packages: 00:38
> running mktexlsr /opt/texlive/texdir/texmf-dist ...
> [...]
> Add /opt/texlive/texdir/texmf-dist/doc/info to INFOPATH.
> Most importantly, add /opt/texlive/texdir/bin/aarch64-linux
> to your PATH for current and future sessions.
> [...]
>
> Any clue on the possible cause ?

The problem is that the Dockerfile hard-codes the path for x86-64:

    ENV PATH="/opt/texlive/texdir/bin/x86_64-linux:${PATH}"

We could probably add `arch` as another Docker build parameter, or
otherwise should find a different way to set the path to its correct
value.

Can you try to modify the line manually to see if the build succeeds
with

    ENV PATH="/opt/texlive/texdir/bin/aarch64-linux:${PATH}"

-- 
Albert Krewinkel
GPG: 8eed e3e2 e8c5 6f18 81fe  e836 388d c0b2 1f63 1124

Re: M1 support for Docker image

[Claudio Di Vita]

[-- Attachment #1.1: Type: text/plain, Size: 2767 bytes --]

I updated the Dockerfile for ubuntu replacing the PATH assignment in the 
following way:

# TeXLive binaries location
ARG texlive_bin="/opt/texlive/texdir/bin"
RUN TEXLIVE_ARCH="$(uname -p)-$(uname -s | tr '[:upper:]' '[:lower:]')" && \
    mkdir -p ${texlive_bin} && \
    ln -sf "${texlive_bin}/${TEXLIVE_ARCH}" "${texlive_bin}/default"

# Modify PATH environment variable, prepending TexLive bin directory
ENV PATH="${texlive_bin}/default:${PATH}"

Build args are not useful, because they cannot be changed based on the 
architecture, therefore I used a symbolic link to place the right directory 
within PATH.

However, I noticed that the directory /usr/share/lua/5.4 is not created 
when building the pandoc/core:edge images (that use Lua 5.4), so the module 
re.lua is not copied to the host. Is something related to changes 
introduced by Lua 5.4 ?

Moreover, while edge images build works, building from 2.19.2 fails.

Can issue a PR for updating the Dockerfile (at least for Ubuntu) to include 
the TeXLive path change ?

Cheers,

Claudio

Il giorno mercoledì 23 novembre 2022 alle 16:25:08 UTC+1 Albert Krewinkel 
ha scritto:

>
> Claudio Di Vita <claudio...-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:
>
> > With a support of a colleague that has an Apple M1, I'm trying to
> > build the pandoc/latex:edge-ubuntu image.
>
> That's great news!
>
> > The build fails due to some installation issue with TexLive:
> >
> > Time used for installing the packages: 00:38
> > running mktexlsr /opt/texlive/texdir/texmf-dist ...
> > [...]
> > Add /opt/texlive/texdir/texmf-dist/doc/info to INFOPATH.
> > Most importantly, add /opt/texlive/texdir/bin/aarch64-linux
> > to your PATH for current and future sessions.
> > [...]
> >
> > Any clue on the possible cause ?
>
> The problem is that the Dockerfile hard-codes the path for x86-64:
>
> ENV PATH="/opt/texlive/texdir/bin/x86_64-linux:${PATH}"
>
> We could probably add `arch` as another Docker build parameter, or
> otherwise should find a different way to set the path to its correct
> value.
>
> Can you try to modify the line manually to see if the build succeeds
> with
>
> ENV PATH="/opt/texlive/texdir/bin/aarch64-linux:${PATH}"
>
> -- 
> Albert Krewinkel
> GPG: 8eed e3e2 e8c5 6f18 81fe e836 388d c0b2 1f63 1124
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/39b0a0ad-5bc0-488c-ba00-5f75fe25c949n%40googlegroups.com.

[-- Attachment #1.2: Type: text/html, Size: 3625 bytes --]