SWAN Updates

News
1

2019-07-10

During the following days SWAN will be updated with the following improvements.
For details on the status of the update, please check the corresponding SSB (OTG0051229).
 

Jupyter extensions (v7.3)

  • UCA-317 Fix README converting all links to lowercase
  • UCA-318 Add “Help” button on the top toolbar
  • UCA-322 Update Yarn JS dependencies on Jupyter extensions (removing old dependencies with security bugs)
  • Spark improvements:
    • Propagate user python packages to executors
    • Wait for late added spark context yarn config if needed
    • Add support for distribution Spark Tokens to executors through secrets if token available
    • UCA-333 Fix error with wrong spark error page during configuration

Jupyterhub extensions (v2.4)

  • UCA-316 Look for projurl in next query parameter
  • UCA-320 Fix oAuth authenticator login url (for ScienceBox deployments)
  • UCA-296 Warn if platform/lcg combo is invalid
  • Code refactoring for Spark configurations

CC7 user Docker image (v5.1.0)

  • UCA-319 Update to latest HEP OSlibs (7.2.7)
  • Update to latest Jupyter extensions (v7.3)

SLC6 user Docker image (v3.6.0)

  • UCA-319 Update to latest HEP OSlibs (1.1.6)
  • Update to latest Jupyter extensions (v7.3)

Other updates

  • Update EOS client to 4.5.2 (fixing the recent problems with mountpoint home-a being stuck and wrong quota values)
2

2019-08-01

On August 1st, SWAN will be updated with the following improvements.
For details on the status of the update, please check the corresponding SSB OTG0051607.

Jupyter extensions (v7.4)

  • UCA-173 Fix toolbar not following document
  • UCA-348 swancontents: enable tables in readme
  • UCA-345 swankernelenv: do not remove the IPython/extensions path (allows use of autoload in Python3)

Jupyterhub extensions (v2.4)

  • Cloud containers with LCG96

CC7 user Docker image (v5.1.1)

  • Update to latest Jupyter extensions (v7.4)

SLC6 user Docker image (v3.6.1)

  • Update to latest Jupyter extensions (v7.4)

Other updates

  • Deployment of LCG 96 (Python 2, Python 3 and NXCals)
3

2019-11-12

On November 12th, SWAN will be updated with the following improvements.
For details on the status of the update, please check the corresponding SSB OTG0053211.

Jupyter extensions (v7.5)

  • [UCA-375] Disable Spark UI button
  • [UCA-371] Allow download of private gitlab repos using token
  • [UCA-361] Allow local images inside README
  • [UCA-374] Fix dependency issue causing blank timeline in SparkMonitor
  • [UCA-373] Periodic stage active updates instead of per task updates
  • [UCA-373] Reduce the rate of the messagesto frontend using spark tasks queue
  • added root.cern to the whitelist in the url checker (when downloading repos/files)

Common CSS (v2.4)

  • [UCA-361] Style for images inside README
  • [UCA-364] Fix for scratchpad nbextension

CC7 user Docker image (v5.2.0)

  • [UCA-268] Prevent Python from looking into the user EOS directory
  • ROOT JS files coming from the installation
  • [UCA-377] Added htop package
  • [UCA-372] Added support for ls and grep colors in bash

Other updates/Puppet

  • Increase timeouts for spawn
  • [UCA-378] cache all latest lcg releases
4

2020-04-02

On 2nd April, SWAN will be updated with the following improvements.
For details on the status of the update, please check the corresponding SSB OTG0055470.

Jupyter extensions (v7.6)

  • [UCA-410] Update to Jupyter 6.0.3
  • [UCA-414] fixed bug to upload large files in swanfilemanager extension
  • Adjust hdfs browser server extension to respond fully async, stream webhdfs requests in chunks
  • Decouple driver and executor blockmanager ports

CC7 user Docker image (v5.3.1)

  • Use latest Python 3.7
  • Update to notebook 6.0.3
  • [UCA-404] Fix latest Python3 from LCG incompatible with SWAN

Other updates/Puppet

  • Dynamic Configuration form
  • Mount cvmfs repository clicdp.cern.ch
  • [UCA-351] Update JupyterHub to 1.1.0
  • Deprecate SLC6 image
  • Remove of old LCG stacks
  • Update EOS to v4.5.2
6

2020-04-14

On April 14th, SWAN will be updated with the following improvements.
For details on the status of the update, please check the corresponding SSB OTG0055882

Jupyter extensions (v7.7)

  • [UCA-414] Fix uploading of large files (revert previous fix)
    • The previous fix caused a bug in the files editor: while saving, the editor appended the new content to the old file instead of replacing it.
  • [UCA-422] Adapt checkpoints to new EOS versioning.

Other updates/Puppet

  • Deployed LCG 97
  • Use Python 3 as the new default environment
  • Update EOS to v4.7.7
7

2020-10-05

From October 5th to 7th, SWAN will be updated with the following improvements.
For details on the status of the update, please check the corresponding SSB OTG0059390

CC7 user Docker image (v5.5.0)

  • VOMS support (client and all CERN certificates) for jobs submission
  • Support for LaTeX in Matplotlib
  • Update to latest Jupyter Notebook (6.1.3)
  • Early support for oAuth in EOS