Skip to content

Slim down Trino build #724

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
nightkr merged 4 commits into from
Jun 19, 2024
Merged

Slim down Trino build #724

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
ff37757
Slim down Trino build
nightkr Jun 19, 2024
c410883
Try deleting all source after Trino is built
nightkr Jun 19, 2024
5d0e0b0
Use tarball output to dedupe jars
nightkr Jun 19, 2024
55174d7
Merge branch 'main' into bugfix/trino-build-slim
nightkr Jun 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 9 additions & 3 deletions trino/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -53,9 +53,15 @@ WORKDIR /stackable

RUN curl --fail -L "https://repo.stackable.tech/repository/packages/trino-server/trino-server-${PRODUCT}-src.tar.gz" | tar -xzC .
RUN --mount=type=cache,target=/root/.m2/repository cd "trino-server-${PRODUCT}-src" && \
mvn package -DskipTests -Dmaven.gitcommitid.skip=true --projects="!docs"
RUN tar -xzf /stackable/trino-server-${PRODUCT}-src/core/trino-server/target/trino-server-${PRODUCT}.tar.gz -C /stackable && \
chown --recursive stackable /stackable/trino-server-${PRODUCT}
mvn package -DskipTests -Dmaven.gitcommitid.skip=true --projects="!docs,!core/trino-server-rpm" && \
# Delete the worst intermediate build products to free some space
rm -r /stackable/trino-server-${PRODUCT}-src/plugin/*/target /stackable/trino-server-${PRODUCT}-src/core/trino-server/target/trino-server-${PRODUCT} && \
# Extract from tarball to save space; the tarball deduplicates jars (replacing them with symlinks),
# while the raw output folder does not
tar -xzf /stackable/trino-server-${PRODUCT}-src/core/trino-server/target/trino-server-${PRODUCT}.tar.gz -C /stackable && \
chown --recursive stackable /stackable/trino-server-${PRODUCT} && \
# Delete all intermediate build products to free some more space
rm -r /stackable/trino-server-${PRODUCT}-src

COPY --from=storage-connector-builder /stackable/trino-storage-${STORAGE_CONNECTOR}-src/target/trino-storage-${STORAGE_CONNECTOR} /stackable/trino-server-${PRODUCT}/plugin/trino-storage-${STORAGE_CONNECTOR}
# # TODO: remove the following COPY statement once Trino versions 414 and 428 are removed
Expand Down