Skip to content

Deploy a Custom Build for Apache Spark OLAC

  1. Replace the plugin package in the install folder, keeping the file name the Dockerfile expects:

    Bash
    1
2
    cd ~/privacera-oss-plugin
cp <path-to-custom-package>/privacera-spark-plugin.tar.gz ./privacera-spark-plugin.tar.gz

  2. Rebuild the image:

    Bash
    1
    ./build_spark_image.sh

  3. Push the image to the internal registry.

  4. Restart the Spark pods so they pull the new image.

  1. In the portal, open the connector and add the custom property, with the tarball URL Privacera supplied:

    Key Value
    plugin.package.url <custom-tarball-url>

  2. Save the connector and download the bundle again.

  3. Re-run the bundle script, so spark/ is staged from the custom package.

  4. Build the image:

    Bash
    1
2
    cd ~/privacera-oss-plugin
./docker/build_spark_image.sh

  5. Push the image to the internal registry, then restart the Spark pods so they pull it.

Note

Remove the property and download the bundle again to go back to the released build.

Validation

The whole package is replaced, so the version the installer staged is the custom build's. Check it in the built image:

Bash
1
docker run --rm <image-name> cat /opt/spark/conf/privacera_version.txt

The installer also logs the package it unpacked when the bundle script runs.