Precompiled engine files for `aarch64-unknown-linux-musl` target (Alpine Linux on ARM, e.g. M1) #8478

pantharshit00 · 2021-07-28T10:49:34Z

Problem

Right now you can't use Prisma on Docker alpine on M1 mac as it requires aarch64-unknown-linux-musl binaries. As M1 will see more adoption, people will run into this frequently.

Alternatives

Ask user to compile the binary themselves
Document use node:lts instead of node:lts-alpine which is not ideal.

Additional context

#7755

Naming as unknown is intended like that, see more information internally: https://prisma-company.slack.com/archives/C016KUHB1R6/p1627469574008300?thread_ts=1626873669.001400&cid=C016KUHB1R6

The text was updated successfully, but these errors were encountered:

Brooooooklyn · 2021-07-28T13:05:28Z

I'm maintaining Docker images for cross compile: https://github.com/orgs/napi-rs/packages/container/package/napi-rs%2Fnodejs-rust.
The ghcr.io/napi-rs/napi-rs/nodejs-rust:lts-alpine is for compile aarch64-unknown-linux-musl target, see https://github.com/napi-rs/package-template/blob/main/.github/workflows/CI.yaml#L79 for example.

safareli · 2021-08-11T11:11:53Z

This could be "solved" by using docker build --platform linux/arm64 see this article

jensmeindertsma · 2021-10-15T11:58:41Z

What can I do to help get support for this implemented?

huikaihoo · 2021-11-16T01:46:41Z

Any plan or timeline to support this?

artursudnik · 2021-12-26T21:30:37Z

v3.7.0 has been released, but it seems that this issue is not fixed, is it?

janpio · 2021-12-27T15:03:55Z

The issue is not closed, hence the problem is not solved and stays open here for tracking.

kewei5zhang · 2023-01-17T21:19:10Z

Is there a recent error message change? it is failing all docker Prisma builds with the pre-compiled prisma image workaround.

One of the requirements in my case is to run a docker image build on arm self-hosted runners to reduce the docker image build time. I was able to work it around by pre-compile prisma as the docker base image to have the stack build running on arm node, but a recent error message change failed our entire build pipeline. ( The error message was changed prob around 4hours before this comment )

Error: Prisma only supports Linux Alpine on the amd64 (x86_64) system architecture. If you're running Prisma on Docker, please use Docker Buildx to simulate the amd64 architecture on your device as explained by this comment: https://github.com/prisma/prisma/issues/8478#issuecomment-1355209706

@jkomyno

kewei5zhang · 2023-01-17T21:55:32Z

NVM - fixed our code version to 4.8.0.

Is there a recent error message change? it is failing all docker Prisma builds with the pre-compiled prisma image workaround.

One of the requirements in my case is to run a docker image build on arm self-hosted runners to reduce the docker image build time. I was able to work it around by pre-compile prisma as the docker base image to have the stack build running on arm node, but a recent error message change failed our entire build pipeline. ( The error message was changed prob around 4hours before this comment )
Error: Prisma only supports Linux Alpine on the amd64 (x86_64) system architecture. If you're running Prisma on Docker, please use Docker Buildx to simulate the amd64 architecture on your device as explained by this comment: https://github.com/prisma/prisma/issues/8478#issuecomment-1355209706
@jkomyno

@jkomyno This change broke all pre-compiled workarounds on alpine 🥲.

kewei5zhang · 2023-01-17T23:29:13Z

NVM - fixed the version on 4.8.0.
Is there a recent error message change? it is failing all docker Prisma builds with the pre-compiled prisma image workaround.
One of the requirements in my case is to run a docker image build on arm self-hosted runners to reduce the docker image build time. I was able to work it around by pre-compile prisma as the docker base image to have the stack build running on arm node, but a recent error message change failed our entire build pipeline. ( The error message was changed prob around 4hours before this comment )
Error: Prisma only supports Linux Alpine on the amd64 (x86_64) system architecture. If you're running Prisma on Docker, please use Docker Buildx to simulate the amd64 architecture on your device as explained by this comment: https://github.com/prisma/prisma/issues/8478#issuecomment-1355209706
@jkomyno
@jkomyno This change broke all pre-compiled workarounds on alpine 🥲.

Those who are facing the same issue as me using pre-compiled Prisma image to run Prisma on alpine arm64.

Fix your prisma package to an older version other than 4.9.0. "prisma": "^4.8.1", -> "prisma": "4.8.1",
Update pnpx prisma generate command to pnpx prisma@4.8.1 generate

csulit · 2023-01-18T01:07:36Z

How to apply this with a docker-compose?

MaxAst · 2023-01-23T14:48:20Z

@csulit you can do it like this:

version: "3.9"
services:
  api:
    platform: linux/amd64
    ports:
      - 4000:4000

Add cross-compile images for ARM64 musl. Ref: prisma/prisma#8478 Ref: prisma/engineer#87

Build the engines for `linux-musl-arm64-openssl-1.1.x` and `linux-musl-arm64-openssl-3.0.x`. Ref: prisma/prisma#8478 Ref: prisma/engineer#87 Ref: prisma/engine-images#66

aqrln · 2023-02-03T12:56:15Z

Hi everyone! Native support for Alpine Linux on ARM64 CPUs is now merged and will be released in Prisma 4.10.0 on Tuesday. You shouldn't need any workarounds like running the image in emulation or building the engines yourselves starting with 4.10.0. Please let us know if you have any feedback!

bmxpiku · 2023-02-07T10:21:40Z

I tested this yesterday and works like a charm, error message is also clear finally :)
Updates I made to make it work:
package.json

"@prisma/client": "^4.10.0-dev.81",
"prisma": "^4.10.0-dev.81",

Dockerfile

-FROM node:16-alpine3.16 AS build
+FROM node:18-alpine3.17 AS build
+
+RUN apk add --update --no-cache openssl1.1-compat

schema.prisma

+binaryTargets = ["native", "linux-musl-openssl-3.0.x"]

Just fyi - in my case, it seems we were building docker images on different architecture then running them, hence I had to add a binary target. Also, we wanted to upgrade node to 18, which was failing before, and without a clear error message I didn't wanted to invest time in playing with building it FROM prisma source.

So thanks @aqrln :) great update

aqrln · 2023-02-07T10:34:47Z

@bmxpiku fyi you don't have to install openssl1.1-compat — Prisma supports OpenSSL 3 on Alpine since 4.8.0 (and it's better to use OpenSSL 3 when using Node.js 18 so you don't have two different versions of OpenSSL loaded in memory)

bmxpiku · 2023-02-07T11:05:32Z

oh, right - thanks 👍
I'll test it out once 4.10 is released

Romanchuk · 2023-02-15T14:42:33Z

@aqrln @bmxpiku

ARG ALPINE_VERSION=alpine3.17
ARG NODE_VERSION=18.14.0
prisma: 4.10.1

binaryTargets = ["native", "linux-musl-openssl-3.0.x"]

It is not working even if i add

RUN apk add --update --no-cache openssl1.1-compat

to my Dockerfile

2023-02-15 20:59:13 Error: Query engine library for current platform "linux-musl-openssl-3.0.x" could not be found.
2023-02-15 20:59:13 You incorrectly pinned it to linux-musl-openssl-3.0.x
2023-02-15 20:59:13 
2023-02-15 20:59:13 This probably happens, because you built Prisma Client on a different platform.
2023-02-15 20:59:13 (Prisma Client looked in "/app/node_modules/@prisma/client/runtime/libquery_engine-linux-musl-openssl-3.0.x.so.node")
2023-02-15 20:59:13 
2023-02-15 20:59:13 Searched Locations:
2023-02-15 20:59:13 
2023-02-15 20:59:13   /app/node_modules/.prisma/client
2023-02-15 20:59:13   /app/node_modules/@prisma/client
2023-02-15 20:59:13   /app/node_modules/@prisma/client
2023-02-15 20:59:13   /app/node_modules/.prisma/client
2023-02-15 20:59:13   /app/apps/plotform-server/prisma
2023-02-15 20:59:13   /tmp/prisma-engines
2023-02-15 20:59:13   /app/node_modules/.prisma/client
2023-02-15 20:59:13 
2023-02-15 20:59:13 
2023-02-15 20:59:13 To solve this problem, add the platform "linux-musl-openssl-3.0.x" to the "binaryTargets" attribute in the "generator" block in the "schema.prisma" file:
2023-02-15 20:59:13 generator client {
2023-02-15 20:59:13   provider      = "prisma-client-js"
2023-02-15 20:59:13   binaryTargets = ["native", "linux-musl", "linux-musl"]
2023-02-15 20:59:13 }
2023-02-15 20:59:13 
2023-02-15 20:59:13 Then run "prisma generate" for your changes to take effect.
2023-02-15 20:59:13 Read more about deploying Prisma Client: https://pris.ly/d/client-generator
2023-02-15 20:59:13     at DefaultLibraryLoader.getLibQueryEnginePath (/app/node_modules/@prisma/client/runtime/index.js:27476:13)
2023-02-15 20:59:13     at DefaultLibraryLoader.loadLibrary (/app/node_modules/@prisma/client/runtime/index.js:27394:33)
2023-02-15 20:59:13     at LibraryEngine.loadEngine (/app/node_modules/@prisma/client/runtime/index.js:27713:24)
2023-02-15 20:59:13     at LibraryEngine.instantiateLibrary (/app/node_modules/@prisma/client/runtime/index.js:27667:5)
2023-02-15 20:59:21 No errors found.

aqrln · 2023-02-15T16:09:23Z

@Romanchuk this just looks like the expected Query Engine library file is not present in the generated client directory for whatever reason. The "You incorrectly pinned it to linux-musl-openssl-3.0.x" part is misleading, sorry about this, it's a known issue.

Could you please open a new issue or discussion and provide your Dockerfile? Thank you!

Sakub · 2023-12-27T19:21:54Z

Hi, I'm still facing the issues, none of the given fixes work for me.

Here's my Dockerfile:

FROM node:alpine

WORKDIR /app

COPY package.json /app/package.json

RUN apk add openssl3
RUN npm install

COPY . /app
RUN npx prisma generate

EXPOSE 3000
CMD ["npm", "run", "start"]

and my schema.prisma:

generator client {
  provider      = "prisma-client-js"
  binaryTargets = ["native", "linux-musl-openssl-3.0.x"]
}

test-1 | PrismaClientInitializationError: Prisma Client could not locate the Query Engine for runtime "linux-musl-arm64-openssl-3.0.x".
test-1 |
test-1 | This happened because Prisma Client was generated for "darwin-arm64", but the actual deployment required "linux-musl-arm64-openssl-3.0.x".
test-1 | Add "linux-musl-arm64-openssl-3.0.x" to binaryTargets in the "schema.prisma" file and run prisma generate after saving it:
test-1 |
test-1 | generator client {
test-1 | provider = "prisma-client-js"
test-1 | binaryTargets = ["native", "linux-arm64-openssl-3.0.x", "linux-musl-arm64-openssl-3.0.x"]
test-1 | }

Even if I provide the suggested targets from the error message problem still occurs. I use the M2 processor. Right now I can manage to not display this error by using the node-slim image but I would really want to use the node-alpine. Could somebody help me up with this?

aqrln · 2023-12-27T20:06:16Z

@Sakub you added linux-musl-openssl-3.0.x and not linux-musl-arm64-openssl-3.0.x to your schema.

Sakub · 2023-12-27T20:41:36Z

@aqrln Even if I add linux-musl-arm64-openssl-3.0.x to my schema I'm still getting the PrismaClientInitializationError: Prisma Client could not locate the Query Engine error.

aqrln · 2023-12-27T20:48:13Z

@Sakub did you regenerate the client after that? If it doesn't help, please open a new issue with reproduction, or a new discussion if you don't think you're hitting a bug and just need help. This issue is already fixed and is unrelated to your problem, and posting here sends an email to more than 50 people that were subscribed to it.

pantharshit00 added kind/feature A request for a new feature. topic: apple silicon topic: binaryTargets topic: docker process/candidate team/client Issue for team Client. labels Jul 28, 2021

pantharshit00 mentioned this issue Jul 28, 2021

Prisma fails to generate artifacts with NodeJS Alpine image on M1 Mac #7755

Closed

dpetrick removed the process/candidate label Jul 28, 2021

janpio added the topic: binary label Jul 29, 2021

pantharshit00 mentioned this issue Sep 3, 2021

Query engine binary issues #7964

Closed

pantharshit00 mentioned this issue Oct 3, 2021

Prisma doesn't work on Linux aarch64 (through Docker on Mac M1) #9572

Closed

jonahsnider mentioned this issue Oct 5, 2021

Docker image for aarch64 zws-im/zws#263

Closed

cokemine mentioned this issue Oct 11, 2021

arm进入后台添加小鸡的管理界面报错 cokemine/nodestatus#30

Closed

aqrln added process/candidate topic: arm labels Nov 16, 2021

janpio added the tech/engines Issue for tech Engines. label Nov 26, 2021

matthewmueller assigned dpetrick Nov 30, 2021

matthewmueller added this to the 3.7.0 milestone Nov 30, 2021

matthewmueller removed the process/candidate label Nov 30, 2021

aqrln mentioned this issue Dec 2, 2021

Provide binaries for Andriod #9968

Open

mshidlov mentioned this issue Dec 6, 2021

🐛 Bug Report: Run docker image node alpine on M1 chipset amplication/amplication#2034

Closed

2 tasks

dpetrick removed their assignment Dec 17, 2021

matthewmueller assigned cprieto and unassigned cprieto Dec 21, 2021

aqrln self-assigned this Jan 17, 2023

mcbethio added this to the 4.10.0 milestone Jan 17, 2023

mcbethio added the size/m (1-2 wks) label Jan 17, 2023

jkomyno mentioned this issue Jan 18, 2023

Regression: get-platform error for non-amd64 Alpine introduced in prisma@4.9.0 prevents using custom Prisma engines #17390

Closed

This was referenced Jan 31, 2023

feat: add support for linux-musl-arm64 #17655

Merged

Add cross-compile images for Alpine ARM64 prisma/engine-images#66

Merged

aqrln added a commit to prisma/engine-images that referenced this issue Feb 2, 2023

Add cross-compile images for Alpine ARM64 (#66)

e1d24f3

Add cross-compile images for ARM64 musl. Ref: prisma/prisma#8478 Ref: prisma/engineer#87

aqrln mentioned this issue Feb 2, 2023

Update engineer to 1.47 to build ARM64 musl binaries prisma/prisma-engines#3656

Merged

jkomyno closed this as completed in #17655 Feb 3, 2023

This was referenced Feb 3, 2023

feat: update binaryTargets reference for Linux Alpine arm64 prisma/docs#4488

Closed

feat: update "binaryTargets" reference for Linux Alpine arm64 prisma/docs#4491

Merged

preetmishra mentioned this issue Feb 16, 2023

4.10.0, unexpected: errorCode: 'P1012' PrismaClientInitializationError: error: Environment variable not found: DATABASE_URL. #17797

Closed

rafael-jordao mentioned this issue Mar 24, 2023

PrismaClientInitializationError: Query engine library for current platform "linux-musl-arm64-openssl-3.0.x" could not be found #18473

Closed

davidmartos96 mentioned this issue Mar 15, 2024

Switch to non alpine node docker image to support prisma on amd64 SkillDevs/electric_dart#12

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Precompiled engine files for `aarch64-unknown-linux-musl` target (Alpine Linux on ARM, e.g. M1) #8478

Precompiled engine files for `aarch64-unknown-linux-musl` target (Alpine Linux on ARM, e.g. M1) #8478

pantharshit00 commented Jul 28, 2021 •

edited by janpio

Brooooooklyn commented Jul 28, 2021

safareli commented Aug 11, 2021

jensmeindertsma commented Oct 15, 2021

huikaihoo commented Nov 16, 2021

artursudnik commented Dec 26, 2021

janpio commented Dec 27, 2021

kewei5zhang commented Jan 17, 2023 •

edited

kewei5zhang commented Jan 17, 2023 •

edited

kewei5zhang commented Jan 17, 2023 •

edited

csulit commented Jan 18, 2023

MaxAst commented Jan 23, 2023

aqrln commented Feb 3, 2023

bmxpiku commented Feb 7, 2023 •

edited

aqrln commented Feb 7, 2023 •

edited

bmxpiku commented Feb 7, 2023

Romanchuk commented Feb 15, 2023

aqrln commented Feb 15, 2023

Sakub commented Dec 27, 2023

aqrln commented Dec 27, 2023

Sakub commented Dec 27, 2023

aqrln commented Dec 27, 2023

Precompiled engine files for aarch64-unknown-linux-musl target (Alpine Linux on ARM, e.g. M1) #8478

Precompiled engine files for aarch64-unknown-linux-musl target (Alpine Linux on ARM, e.g. M1) #8478

Comments

pantharshit00 commented Jul 28, 2021 • edited by janpio

Problem

Suggested solution

Alternatives

Additional context

Brooooooklyn commented Jul 28, 2021

safareli commented Aug 11, 2021

jensmeindertsma commented Oct 15, 2021

huikaihoo commented Nov 16, 2021

artursudnik commented Dec 26, 2021

janpio commented Dec 27, 2021

kewei5zhang commented Jan 17, 2023 • edited

kewei5zhang commented Jan 17, 2023 • edited

kewei5zhang commented Jan 17, 2023 • edited

csulit commented Jan 18, 2023

MaxAst commented Jan 23, 2023

aqrln commented Feb 3, 2023

bmxpiku commented Feb 7, 2023 • edited

aqrln commented Feb 7, 2023 • edited

bmxpiku commented Feb 7, 2023

Romanchuk commented Feb 15, 2023

aqrln commented Feb 15, 2023

Sakub commented Dec 27, 2023

aqrln commented Dec 27, 2023

Sakub commented Dec 27, 2023

aqrln commented Dec 27, 2023

Precompiled engine files for `aarch64-unknown-linux-musl` target (Alpine Linux on ARM, e.g. M1) #8478

Precompiled engine files for `aarch64-unknown-linux-musl` target (Alpine Linux on ARM, e.g. M1) #8478

pantharshit00 commented Jul 28, 2021 •

edited by janpio

kewei5zhang commented Jan 17, 2023 •

edited

kewei5zhang commented Jan 17, 2023 •

edited

kewei5zhang commented Jan 17, 2023 •

edited

bmxpiku commented Feb 7, 2023 •

edited

aqrln commented Feb 7, 2023 •

edited