jPackage repo files are broken for SL4. Please, disable it before updating if it's not needed in the update. In the case it's needed, you can either create your own local copy of jPackage or use the rpm lists to manually install the needed jPackage packages.

10.08.2010 - 3.1 Update 66

glite-SE_dpm_mysql

New version of DPM mysql

This release provides a fix for the following bugs:

• Avoid srmv2.2 daemon crash when permission denied on a GetSpaceMetadata?
• Avoid rfio_lseek64 error after hitting eof in pre-read mode
• Avoid crashes in some methods when using Python 2.5

glite-SE_dpm_disk

New version of DPM disk

This release provides a fix for the following bugs:

• Avoid rfio_lseek64 error after hitting eof in pre-read mode
• Avoid crashes in some methods when using Python 2.5

glite-LFC_mysql

New version of LFC mysql

This release provides a fix for the following bugs:

• Avoid crashes in some methods when using Python 2.5

glite-LFC_oracle

New version of LFC oracle

This release provides a fix for the following bugs:

• Avoid crashes in some methods when using Python 2.5

05.07.2010 - 3.1 Update 65

glite-WMS

New version of glite-WMS

This new version introduces the following changes (more info in the details page):

• Integration of Condor v. 7.4.1 in particular:
  • to address the "Globus error 10: data transfer to the server failed" issue
  • to fix a hard-coded limit (100) on the number of concurrent DNs having jobs submitted
  • to be able to detect intermediate status changes for jobs submitted to nordugrid resources
• Several bug fixes and improvements concerning ICE (in particular for job status changes detection)
• Ability to forward parameters from the user specified JDL to the batch system through CREAM and BLAH. The JDL CERequirements attribute sent to the CREAM CE is partially evaluated (read "flattened") by the WM against the glue schema attributes specified as a list by the key "CeForwardParameters" in the WorkloadManager section of the WMS configuration file (see: http://grid.pd.infn.it/cream/field.php?n=Main.ForwardOfRequirementsToTheBatchSystem )
• Many other bug fixes

glite-CREAM

New version of glite-CREAM

This new version introduces the following changes (more info in the details page):

• glexec calls replaced with sudo calls (glexec is used just to get the userid to be used in the sudo invocations)
• For Torque/PBS and LSF by default the new BLAH BLparser is now considered. The old parser is still supported (see http://grid.pd.infn.it/cream/field.php?n=Main.CREAMAndBlparserConfiguration )
• Introduced a new operation (queryEvent) to make more efficient the job status changes detection by ICE
• Introduced a limiter to protect CREAM (new job submissions are disabled when the machine is too loaded): see http://grid.pd.infn.it/cream/field.php?n=Main.Self-limitingCREAMBehavior
• Introduced a proxy purger which cleans from the delegationdb and from the file system the expired proxies (see: http://grid.pd.infn.it/cream/field.php?n=Main.HowToConfigureTheProxyPurger ). Please note that old proxies (i.e. referring to previous CREAM releases) under /opt/glite/var/cream are not deleted (you might want to delete them manually after having installed this patch)
• Improved CREAM startup, which is now in general faster, since CREAM asks the blparser only for the interested jobs (no more since a given timestamp)
• Improved proxy renewal operation, which is now more efficient when there are several jobs with the same delegationid
• User tomcat not added anymore to VO groups (please note that it won't be removed if it was already there because of previous version of yaim-cream-ce). With this change the group directories under /opt/glite/var/cream_sandbox are now created by yaim
• User tomcat not anymore to glexec group (please note that it won't be removed if it was already there because of previous version of yaim-cream-ce)
• Customization of the CREAM JobWrapper is now easier (see http://grid.pd.infn.it/cream/field.php?n=Main.HowToCustomizeTheCREAMJobWrapper )
• Provision of a script (to be run by CE admin) to purge jobs in non-terminal status (see: http://grid.pd.infn.it/cream/field.php?n=Main.HowToPurgeJobsFromTheCREAMDB )
• Implemented support for ISB/OSB transfers from/to gridftp servers run using user credentials
• By default cemon is not deployed anymore (not needed anymore because of the new queryevent operation)
• Several bug fixes, e.g.:
  • Several fixes in the new BLAH blparser
  • lcmaps glexec conf file fixed: now it is fully synchronized (TM) with the gridftpd one
  • Problems triggered by "strange" characters (e.g. ":" or "(") in the subject DN fixed
  • Reasons for ISB/OSB transfer failures are now reported
  • Job failure reasons now reported in the CREAM log file
  • Improved performance of some DB queries
  • GLITE_WMS_RB_BROKERINFO env variable now set in the CREAM JobWrapper

glite-SE_dpm_mysql

New version of DPM mysql v1.7.4

Bug fix release with two new features:

• Allow setting of RFIO buffersize on client side.
• Periodic cleanup of historic put, get, copy requests from the dpm database.
• It also allows an easier installation of 32 and 64 bits libraries on 64 bits platforms.

glite-SE_dpm_disk

New version of DPM disk v1.7.4

Bug fix release with one new feature:

• Allow setting of RFIO buffersize on client side.

glite-LFC_mysql

New version of LFC mysql v1.7.4

Bug fix release with two new features:

• SURLs bulk lookup.
• It also allows an easier installation of 32 and 64 bits libraries on 64 bits platforms.

glite-LFC_oracle

New version of LFC oracle v1.7.4

Bug fix release with one new feature:

• SURLs bulk lookup.

There is also an important bug fix:

• Number of DB connections can exceed the number of configured threads because of a missing ROLLBACK WORK RELEASE in closedb.

03.06.2010 - 3.1 Update 64

glite-FTA_oracle

New version of glite-FTA_oracle

It is a bugfix release. The most important bugfixes:

• Savannah bug #66744: Wrong context when aborting request in case of corrupted destination file
• Savannah bug #66507: Checksum comparison is case sensitive
• Savannah bug #65664: SRM status update/timeout problem

Detailed release notes:

https://svnweb.cern.ch/trac/glitefts/wiki/FTSRelease_2_2_4

glite-BDII

New metapackage for glite-BDII

An updated glite-BDII metapackage that contains the dependency on glite-info-provider-release.

27.04.2010 - 3.1 Update 63

glite-BDII

New version of the BDII

This new version includes a new glite-info-provider-ldap. glite-info-provider-ldap 1.2.4 allows up to 10 MB per source and the script itself is now owned by root instead of nobody.

All top-level BDIIs need to be upgraded with high priority, otherwise jobs or users at some sites may no longer see CERN or other big sites included in the information system at some point.

A top-level BDII with the current glite-info-provider-ldap will reject any site that produces more than 5 MB of information system records.

This problem already occurred on April 16, when the BNL site BDII exceeded the 5 MB limit and the site dropped out of all EGEE/WLCG top-level BDIIs.

A known issue has been identied in this release of the BDII. The dependency on glite-info-provider-release is missing, and therefore, any new clean installation wont install this package. This issue will be solve in the next release of the BDII.

16.03.2010 - 3.1 Update 62

glite-LB

New version of LB

• Extensions to LB notifications to allow export of LB data into MSG via LB harvester.
• Due to the minimalistic backport of the functionality, the implementation is not optimal wrt. LB 2.0. This patch is provided as a quick solution, sites willing to run MSG export in production should migrate to LB 2.0 ASAP.

glite-SCAS

New version of glite-security-scas

LCAS

• Solved segmentation faults when a malformed proxy was provided by the calling library or application.

SCAS

• Fixing bug #52648, which prevents user banning for the SCAS server.
• Stability of the service improved significantly.
• Several optimizations (see service release notes).

glite-SE_dpm_mysql, glite-SE_dpm_disk, glite-WN, glite-UI, glite-VOBOX, glite-LFC_mysql, glite-LFC_oracle

New version of LFC and DPM

• Bug 53568, which could cause the DPM's SRM 2.2 server to crash.
• Bug 50686, which meant a malformed request could crash the LFC or the DPNS.
• The xrootd plugin for ALICE for the DPM has been upgraded to version 2.1.0.in order to increase the stability of the service.
• WARNING: There are known issues upgrading from DPM 1.6.x (please check service release notes).

glite-MON, lcg-CE, glite-TORQUE_utils, glite-CONDOR_utils, glite-SGE_utils, glite-LSF_utils, glite-CREAM

APEL (affecting monbox and utils packages for various batch systems) with several bug fixes

• APEL will now read the CPUScalingReferenceSI00 value from the site GIIS. If this value is not available, APEL will read GlueHostbenchmarkSI00.
• SGE log files with format accounting-YYYYMMDD and accounting-YYYYMMDD.gz are now parsed.
• Problems parsing different versions of LSF log files fixed. Also fixed parsing of parallel jobs in LSF.
• APEL publisher can now use external public keys (from a file) to encrypt UserDNs.

glite-WMS

New version of WMS

This patch is meant to bring final touches to consolidating current functionality for admins and users.

gLite 3.1 Update 62 requires a workaround when a glite-WMS node type is configured on a 64-bit machine. For more information see the known issues page.

glite-UI, glite-WN, glite-VOBOX

New version of lcg-ManageVOTag

New lcg-ManageVOTag version solving the bug #52878: "VO Tags on multiple sites merged into single line"

glite-MPI_utils, glite-TORQUE_client, glite-TORQUE_server, glite-TORQUE_utils

New version of MPI_utils (backporting of fixes already deployed on SL5)

• Fix for a long known dependency issue with an incompatible torque library provided by the torque RPM.
• Minor bug fixes yaim configuration.
• Default MPI installation is now OPENMPI, which is provided by the Scientific Linux distribution.
• Support for MPICH1 and MPICH2 has been discontinued on SL4. MPICH2 is available for SL5.
• KNOWN ISSUE: bug #62612 (missing version of MPI flavor in site BDII ) is NOT fixed in this version.

18.02.2010 - 3.1 Update 61

glite-UI, glite-VOBOX, glite-WN

New version of Yaim Clients

There's now a new tag: tarball-installations

that can be used in WN_LIST as follows: tarball-installations:subcluster-id

If a WN tarball is being installed:
1) and the tag is present in wn-list.conf, then the subcluster-id will be retrieved from there.

2) the tag is not present, the subcluster-id will be deduced from CE_HOST.

New version of dCache srmclient

New version of srmclient that removes the WARNING messages. New version of dcap with override to allow forcing active or passive behavior at the environment variable level.

Consistency when passing passive/active server_mode flag to srmcp.

Fixed bug in srm-get-permissions.

Support ':' as globus port range separator

Better format "srmcp -help" output.

Need java >= 1.5

New version of FTS Clients

See the FTS release for more details.

glite-WN

Introducing gLExec tests to glite-swat-client

glite-swat (Site Wide Area Testing) is a replacement for grid-cm (Grid Configuration Monitoring). Couple of RPMs for client are merged and directory names are changed to reflect the name change.

This update include new test for glexec and a bugfix of grid_voname test for VOs that have dots or dashes in their name.

glite-AMGA_oracle, glite-AMGA_postgres, glite-BDII, glite-CONDOR_utils, glite-CREAM, glite-FTA_oracle, glite-FTM, glite-FTS_oracle, glite-HYDRA_mysql, glite-LB, glite-LFC_mysql, glite-LFC_oracle, glite-LSF_utils, glite-MON, glite-MPI_utils, glite-PX, glite-SCAS, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-SGE_utils, glite-TORQUE_client, glite-TORQUE_server, glite-TORQUE_utils, glite-UI, glite-VOBOX, glite-WMS, glite-WN, lcg-CE

New version of Yaim Core

• UNPRIVILEGED_GRIDMAPFILE per VO: This variable was before defined per site and now it can be configured per VO.
• USER_HOME_PREFIX per VO: This variable was before defined per site and now it can be configured per VO.
• EDG_HOME_DIR, EDGINFO_HOME_DIR and BDII_HOME_DIR: The home directories of system accounts can be now be configured. The suggestion is to define them as /var/lib/user_name but YAIM has left the default under /home.
• GRIDFTP_CONNECTIONS_MAX: It has been increased from 50 to 150.
• Variables that were wrongly implemented in previous yaim releases are now fixed: CONFIG_GRIDMAPDIR and USER_HOME_PREFIX.

• config_myproxy_libs: new function to be able to configure the new myproxy server and clients.
• New SAGA adapters: There's a new function called config_glite_saga that configures the SAGA gLite adapters.

• Some libraries have been added to LD_LIBRARY_PATH and ld.so.conf to be able to configure lcg CE and cream CE in SL5.
• grid environment cleaning mechanism to be able to install different WN tarball versions in the same machine.
• YAIM doesn't fail when gLite version package is not installed. This is useful for non gLite software using YAIM.
• siteinfo packaging is now fixed (-p option).

glite-WMS

Urgent patch for bug #58347 in Yaim WMS

No configuration changes.
config_lcgenv call added in /opt/glite/yaim/node-info.d/glite-wms

glite-WMS, glite-FTA_oracle

New version of Proxy Renewal

The following bugs has been fixed:

#28167 (WMS doesn't renew user proxy VOMS extension) 
#3369 (proxy renewal should try all configured VOMS servers per VO)
#43326 (proxy-renewal does not build with VDT 1.10) 
#46658 (Timestamp in proxy renewal log file) 
#48025 (Proxy renewal problem (WMS node) when using short FQANs)

After installation of the patch the renewal must be restarted using: /opt/glite/etc/init.d/glite-proxy-renewald restart

glite-SLCS_client

New version of SLCS Client

• SLCS metadata downloaded from an URL in slcs-init.xml config file. e.g.: <ShibbolethClientMetadata url=" https://slcs.switch.ch/download/slcs-metadata.switchaai.xml" />
• Package without version: glite-slcs-ui.jar
• Version numbers shown for the SLCS ui and the common packages (slcs-init -V).

• Improved authentication error checking for FORM handler.
• UZH IdP updated in metadata.

• Bug fix: correct possible race condition in PasswordReader.getPassword() https://savannah.cern.ch/bugs/index.php?50288
• Default PKCS12 filename changed to usercred.p12

• New FORM authentication handler implemented.
• Modified PUBCOOKIE authentication handler for new ETHZ PubCookie workflow.
• slcs-info lists the IdPs sorted by providerId.
• truststore contains all SwissSign and QuoVadis root CAs.
• bouncycastle 1.37 provider embedded with client.
• SWITCHaai VHO IdP definition updated in metadata.
• SWITCH IdP definition updated in metadata.
• HES-SO IdP definition added in metadata.
• EPFL IdP basic auth realm updated in metadata.

• Dependency on glite-slcs-common 1.5.0.
• SLCS truststore for SWITCHaai federation now contains the QuoVadis Root CA 2 cert.
• University of Zurich domain name changed from unizh.ch to uzh.ch.
• Bug fix: Shib SP 2.0 (SLCS server) doesn't use WAYF, but sends 'service=...' query parameter directly.

• Bug fix: IdP BASIC authN + SAML/Aritifact profile work flow corrected.
• Bug fix: IdP BASIC authN + Browser/POST profile work flow corrected.

• Shibboleth client now handles Browser/POST and SAML/Artifact profile.
• Better error handling and error messages.

• Packaging with ETICS new jakarta-commons- JPackage packages. Don't use old commons-packages anymore.
• Dependencies on JPackage jakarta-commons-* packages.
• gLite scripts slcs-init and slcs-info uses JPackages libs.

glite-FTA_oracle, glite-FTS_oracle

New version of FTS

Fix for bug #59955: FTS: agent crash when picking up a job (glite-data-agents-common v1.1.1-1 2009-12-08)

Fix for bug #60095: FTS: Couldn't set the private key (glite-data-transfer-fts v3.7.0-3 2010-01-18)

Updates for more liberal checksum handling and to relax requirements on how long an SRM TURL is kept valid.

Finalization of the checksum support.

The database schema has changed, one has to follow the instructions of the Yaim script to do the upgrade.

The ABI between the transfer-agents and transfer-url-copy has changed, so one has to stop and drain the channels before doing an upgrade.

glite-SGE_utils

New version of SGE Utils

This patch introduces the support of "GlueCEPolicyAssignedJobSlots" in SGE information provider. No reconfiguration is needed for SGE_utils

glite-FTA_oracle, glite-FTS_oracle, glite-LFC_mysql, glite-LFC_oracle, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-UI, glite-VOBOX, glite-WMS, glite-WN, lcg-CE

New version of lcg-vomscerts

This patch introduces a new version of lcg-vomscerts that adds the next cert for lcg-voms.cern.ch and removes old certs for cclcgvomsli01.in2p3.fr and vo.racf.bnl.gov

11.01.2010 - 3.1 Update 60

glite-TORQUE_client, glite-TORQUE_server, glite-TORQUE_utils, glite-MPI_utils

glite-TORQUE_server, glite-TORQUE_client, glite-TORQUE_utils

• kill_delay has been increased to 10 in the Torque server.
• ssh configuration has been updated in Torque client.
• maui configuration can be now disabled in YAIM.

• CONFIG_MAUI: By default is 'yes'. Set it to 'no' if you want to disable the maui configuration in YAIM.
• APEL_MYSQL_HOST: By default is MON_HOST. Change this value if the host where the APEL MySQL DB is installed in a different place than the MON_HOST. Bear in mind that in case you use the default value, which is MON_HOST, but MON_HOST is not defined in site-info.def, YAIM will complain APEL_MYSQL_HOST is not defined.
• CONFIG_TORQUE_NODES: Set it to 'no' if you want to disable the /var/spool/pbs/server_priv/nodes configuration in YAIM.

glite-CREAM

CeRequirements="other.GlueHostMainMemoryRAMSize > 100 &&
 other.GlueCEStateWaitingJobs <10";

GlueHostMainMemoryRAMSize_Min='100'

GlueCEStateWaitingJobs_Max='10'

GlueHostMainMemoryRAMSize_Min=100

GlueCEStateWaitingJobs_Max=10

glite-TORQUE_utils

glite-WMS

glite-FTA_oracle, glite-FTS_oracle, glite-LFC_mysql, glite-LFC_oracle, glite-PX, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-UI, glite-VOBOX, glite-VOMS_mysql, glite-VOMS_oracle, glite-WMS, glite-WN, lcg-CE

05.11.2008 - 3.1 Update 59

glite-WN, glite-UI, glite-VOBOX

New version of lcg-infosites:

The new patch is solving the bug 37572. it allows therefore the query to multiple BDIIs

28.10.2009 - 3.1 Update 58

glite-FTS_oracle, glite-FTA_oracle, glite-FTM, glite-WN, glite-UI, glite-VOBOX

• SRM-gridftp split
• Logging to syslog according to Middleware Security Audit Logging Guidelines
• Logging IP addresses in SRM calls
• Removed obsolete commands: glite-transfer-placement-submit and glite-transfer-discovery
• Added site group management tools: glite-transfer-group-addmember glite-transfer-group-list glite-transfer-group-removemember
• Added channel management methods for new channel parameters
• Merged transfer-api-c into transfer-cli.
• DB maintenance packages are part of the core FTS package: history, purge
• Compliant with the WLCG SRM MoU for spaces

glite-VOMS_mysql, glite-VOMS_oracle, glite-UI, glite-VOBOX

New version of VOMS Admin and Clients:

New VOMS Admin features:

The VOMS SAML codebase developed during the OMII project has been integrated into the codebase. Now VOMS Admin exposes a service, called VOMSSaml that can be used to obtain a SAML assertion containing signed VOMS attributes.

New VOMS Admin service properties:

• voms.aa.certificate
• voms.aa.key

The voms-admin-configure script has been extended to support flags to set these properties at configuration time.

Type voms-admin-configure --help for more information.

Updated dependencies:

VOMS SAML makes extensive use of the OpenSAML library, which requires a recent version of java xml parsing tools installed in your Java Runtime Environment.

VOMS Admin Server SAML attribute authority configuration handling:

Optional advanced parameters added.

This release introduces also automatic configuration of read-only access for anyone with a valid certificate (needed for the gridmap file generation on the relevant grid hosts). Applies only to newly created VOs.

Please check the service update pages at this link for more details

glite-CREAM, glite-FTA_oracle, glite-FTS_oracle, glite-LFC_mysql, glite-LFC_oracle, glite-PX, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-UI, glite-VOBOX, glite-VOMS_mysql, glite-VOMS_oracle, glite-WMS, glite-WN, lcg-CE

New version of lcg-vomscerts:

lcg-vomscerts-5.6.0 adds new cert for voms.fnal.gov and removes old certs for voms.fnal.gov, voms.cern.ch and voms-pilot.cern.ch

22.10.2009 - 3.1 Update 57 (rolled-back)

glite-FTS_oracle, glite-FTA_oracle, glite-FTM, glite-WN, glite-UI, glite-VOBOX

New version of FTS and Clients:

• SRM-gridftp split
• Logging to syslog according to Middleware Security Audit Logging Guidelines
• Logging IP addresses in SRM calls
• Removed obsolete commands: glite-transfer-placement-submit and glite-transfer-discovery
• Added site group management tools: glite-transfer-group-addmember glite-transfer-group-list glite-transfer-group-removemember
• Added channel management methods for new channel parameters
• Merged transfer-api-c into transfer-cli.
• DB maintenance packages are part of the core FTS package: history, purge
• Compliant with the WLCG SRM MoU for spaces

glite-VOMS_mysql, glite-VOMS_oracle, glite-UI, glite-VOBOX

New version of VOMS Admin and Clients:

New VOMS Admin features:

The VOMS SAML codebase developed during the OMII project has been integrated into the codebase. Now VOMS Admin exposes a service, called VOMSSaml that can be used to obtain a SAML assertion containing signed VOMS attributes.

New VOMS Admin service properties:

• voms.aa.certificate
• voms.aa.key

The voms-admin-configure script has been extended to support flags to set these properties at configuration time.

Type voms-admin-configure --help for more information.

Updated dependencies:

VOMS SAML makes extensive use of the OpenSAML library, which requires a recent version of java xml parsing tools installed in your Java Runtime Environment.

VOMS Admin Server SAML attribute authority configuration handling:

Optional advanced parameters added.

This release introduces also automatic configuration of read-only access for anyone with a valid certificate (needed for the gridmap file generation on the relevant grid hosts). Applies only to newly created VOs.

Please check the service update pages at this link for more details

glite-AMGA_oracle, glite-AMGA_postgres, glite-BDII, glite-CREAM, glite-FTS_oracle, glite-LB, glite-LFC_mysql, glite-LFC_oracle, glite-MON, glite-PX, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-VOBOX, glite-VOMS_mysql, glite-VOMS_oracle, glite-WMS, lcg-CE

New version of the BDII:

This updated version of the BDII contains support for GLUE 2.0 information. The GLUE 2.0 LDAP schema file has been added to the glue-schema package and the slapd.conf file used by the BDII has been modified to include the new file. A new root o=glue has been added in the slapd.conf file and the BDII has be modified to manage multiple roots.

glite-CREAM, glite-FTA_oracle, glite-FTS_oracle, glite-LFC_mysql, glite-LFC_oracle, glite-PX, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-UI, glite-VOBOX, glite-VOMS_mysql, glite-VOMS_oracle, glite-WMS, glite-WN, lcg-CE

New version of lcg-vomscerts:

lcg-vomscerts-5.6.0 adds new cert for voms.fnal.gov and removes old certs for voms.fnal.gov, voms.cern.ch and voms-pilot.cern.ch

06.10.2009 - 3.1 Update 56

glite-CREAM

• Advisory 55615
• Advisory 55616

• Migration to voms-api-java. This also means that the VOMS server host certs are not required anymore in the CREAM CE node (the /etc/grid-security/vomsdir/*/*.lsc files are sufficient)
• First release of new BLAH blparser for LSF and PBS/Torque (use of batch system status/history commands instead of parsing the log files). However due to some problems found after the first certification, it is suggested to keep using the old parser (i.e. BLPARSER_WITH_UPDATER_NOTIFIER=false, which is the default) which is still fully supported
• IPv6 support for BLAH

• Fix for a problem with purge (not deleting the job sandbox dir in some cases)
• Fix for a problem for which there could be at most 32000 active jobs per user
• Fix for a problem for which the produced accounting logs (used by APEL and DGAS) was not properly filled if the CREAM CE is not the Torque server

22.09.2009 - 3.1 Update 55

glite-WMS

• Improvements in performance and scalability
• Much less use of memory
• Use of jobdir instead of filelist as input for ICE

glite-UI, glite-WN, glite-VOBOX

31.08.2009 - 3.1 Update 54

glite-MON, lcg-CE, glite-TORQUE_utils, glite-CONDOR_utils, glite-SGE_utils, glite-LSF_utils, glite-CREAM

• Publisher OutOfMemory error when publishing large amounts of records. APEL will now publish records in batches instead of selecting all records in one go. However, there is still an out of memory error when processing large numbers of grid_jobmap files. In that case, follow this recipe.
• The value for the ExecutingCE in the accounting records will be taken from the configuration file in each CE and not from the log files, which will stop sites having records with the hostname for the scheduler.
• APEL database schema changes. Some of the fields in the APEL local database have been changed. The APEL parser needs to be run at least once with the following setting enabled to have the changes applied: <DBProcessor inspectTables="yes"/>
• YAIM changes:
  • There's a new variable APEL_PUBLISH_LIMIT, in order to be able to configure the number of records to be selected. Default value is 300000.
  • A number of outstanding YAIM bugs have been addressed.
  • The configuration no longer attempts to fix problems in the tomcat installation as this code was rather fragile. According to the precise version of tomcat you may need to set JAVA_HOME yourself in the /etc/tomcat/tomcat5.conf file.
  • YAIM no longer assumes that you have one tomcat service called tomcat5. You can set the YAIM variable TOMCAT_SERVICE if needed. It defaults to "tomcat5". The corresponding entry in /etc/sysconfig is modified.
  • ulimit is no longer set by modifying /etc/init.d/rc.d/tomcat5 but is set by a line at the end of the /etc/sysconfig/ file. This file is sourced by the init.d script.
  • YAIM sets up the glite-info-provider-service to make the R-GMA status available via the BDII.
  • There is an known problem with the version of urllib used by the MON gip plugins, where the provider does not return the correct information in the case where the site uses a HTTP proxy. The problem is due to an issue in the OS vendor supplied urllib. A workaround, which requires a minor modification to YAIM /opt/glite/yaim/functions/config_info_service_mon. This fix unsets the https_proxy variable for the duration of running the GIP scripts. Full details may be found in Bug 40764.

glite-AMGA_oracle, glite-AMGA_postgres, glite-BDII, glite-CONDOR_utils, glite-CREAM, glite-FTA_oracle, glite-FTM, glite-FTS_oracle, glite-HYDRA_mysql, glite-LB, glite-LFC_mysql, glite-LFC_oracle, glite-LSF_utils, glite-MON, glite-MPI_utils, glite-PX, glite-SE_dcache_admin_gdbm, glite-SE_dcache_admin_postgres, glite-SE_dcache_info, glite-SE_dcache_pool, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-SGE_utils, glite-TORQUE_client, glite-TORQUE_server, glite-TORQUE_utils, glite-UI, glite-VOBOX, glite-WMS, glite-WN, lcg-CE

• Configuration changes needed for a new version of trustmanager and util-java. These changes are included in a new function not used yet by any yaim module. The idea is that any service configuring tomcat will use this function in the future.
• The creation of users specifying a home directory wasn't working. This is fixed now.
• GLOBUS_TCP_PORT_RANGE is not defined for the WN and it's properly defined for the TAR UI. MYPROXY_TCP_PORT_RANGE is not defined any more.
• YAIM checks whether fetch-crl is installed and fails otherwise.
• groups.d/ structure is now available for all the node types.
• gridview is configured only if it's installed.
• The verify-proxy plugin is not present in the lcmaps configuration for gridftp.
• /opt/edg/var/info directories for the software tags are again created by yaim.
• New site-info.pre and .post variables:
  • BDII_ARCHIVE_SIZE: It is the number of dumps of the database to keep for debugging purposes. Default is 0.
  • BDII_BREATHE_TIME: It is the time in seconds between updates of the bdii. Default is 120.
  • BDII_PASSWD: This is the password for the LDAP database used by the bdii. Default is $(mkpasswd -s 0).
  • BDII_READ_TIMEOUT: It is the amount of time to wait until an information is assumed to have timed out. Default is 300.
  • CONFIG_GRIDMAPDIR: It enables or disables the creation of the gridmap file. If set to yes, it creates it. If set to no, it doesn't create the gridmap file. Default is yes.
  • TRUSTMANAGER_CRL_UPDATE_INTERVAL: This variable is used in the trustmanager configuration and it defines how often the X509_CERT_DIR is polled for changes in the files. It's a number followed by h,m or s time units. Default is 2h.
  • TOMCAT_HOSTCERT_LOCATION: path of the tomcat host certificate. Default is /etc/grid-security/tomcat-cert.pem.
  • TOMCAT_HOSTKEY_LOCATION: path of the tomcat host key. Default is /etc/grid-security/tomcat-key.pem.
  • TOMCAT_USER: tomcat user. Default is "tomcat".

glite-UI, glite-VOBOX, glite-WN, glite-SE_dcache_admin_gdbm, glite-SE_dcache_admin_postgres, glite-SE_dcache_info, glite-SE_dcache_pool

glite-UI, glite-VOBOX, glite-WN

glite-BDII, glite-CREAM, glite-FTS_oracle, glite-LB, glite-HYDRA, glite-LFC_mysql, glite-LFC_oracle, glite-SE_dpm_mysql, glite-VOBOX, glite-WMS

lcg-CE, glite-WMS, glite-SCAS, glite-GLEXEC_wn, glite-CREAM, glite-VOBOX

lcg-CE

This version fixes an issue in globus-gma that only shows up when CE suffers from overload, batch or file system malfunction. In such conditions some pool account may become irresponsive to jobmanager requests. It will cause globus-gma child processes to be killed by the parent one after a time-out (usually 60 seconds). E.g. if a bad account has 1000 associated jobs (running or queued) it will take globus-gma 17 hours to dig through and will prevent all other accounts from receiving job status updates during this time, effectively bringing the whole CE down. There's a logic in globus-gma to avoid this: after a configurable number (4 by default) of consecutive timeouts for a single account all remaining jobs belonging to it will be skipped till the next poll cycle to allow other possible healthy accounts to receive job status updates. Unfortunately this logic didn't work before as expected because of one extra line in the code. It was hard to catch this issue as it cannot be reproduced during certification/testing with a healthy CE.

glite-LSF_utils

• The new version doesn't replace the configuration file in /opt/glite/etc but creates the new template as rpmnew file.
• A new parameter can now be specified in the configuration file: LSF_CE_PRODUCTION_STATUS. It can have two possible values: "Production" or "Preproduction". If the CE state is taken from the batch system, this value is taken and reported in the information system. This allows to embed preproduction CEs in production environments.

glite-GLEXEC_wn

All the detailed information about these scripts is here. Background information: The gLExec wrapper scripts are able to preserve the process environment variable in a safe way. As a security measure gLExec will wipe all environment variables from the process to avoid tampering or exploitation. This has been a struggle for Pilot Job Framework (PJF) developers to be able to overcome this security measure. Each PJF would have to come up with their own solutions to be able to preserve the environment variables which are used a a form of global variable space, paths to specific software areas, or other unknown use cases.To help the VOs we've come up with these scripts to have a easy to use, uniform and supported way of preserving the environment variable between the users contexts in a safe way.

24.08.2009 - 3.1 Update 53

glite-WMS, glite-UI, glite-VOBOX, glite-WN

What's WMS 3.2 in gLite 3.1?: The new WMS has version 3.2 within the WMS project. This is an internal version that shouldn't be confussed with gLite 3.2. The first release of WMS 3.2 is available in gLite 3.1 and corresponds to glite-WMS 3.1.20-0 in the gLite repository.

This update contains a new release of the WMS which is a complete redesign of the service. For a summary of the changes introduced in this version, please check these web pages:

• gLite WMS 3.2 project page
• Release notes of the new version prepared by the WMS development team.

• WMS Known issues
• YAIM WMS Known issues

glite-CREAM, glite-LB, lcg-CE, glite-UI, glite-VOBOX, glite-WMS, glite-WN

This LB update provides fixes for known issues identified since the release of the previous update. The following text gives an overview of modules and respective fixes.

• client: fix edg_wll_NotifDrop prototype.
• client-interface: fix edg_wll_NotifDrop prototype.
• common: fix bug #35770.
• logger: support chconfig in startup scripts and proper kill signal handling.
• proxy:s upport chconfig in startup scripts.
• server:
  • Support for chconfig in startup scripts
  • Support for JP importer in startup scripts
  • Support for variant DN certificates
  • Recalculate subjob states after DB version upgrade
  • Ignore reseource_usage events when computing job states
  • Fix sequence code processing for Change ACL events
  • Reflect job conditions while processing queries for events

29.07.2009 - 3.1 Update 52

glite-CREAM

• Fixed a problem concerning publication in the BDII of FQAN voviews and DENY tags.
• CREAM and CEMon services publish themselves in the Information Service.
• Support for new blparser for LSF and PBS/Torque (not released yet) implemented. Since the new parser has not been released yet, don't try it.
• Implemented a workaround for the LB-locallogger restart problem.
• INNODB is not set anymore as default mysql engine (since CREAMDB tables are created specifying that INNODB should be used). Clean up your etc/my.cnf if needed.
• Variable SE_MOUNT_INFO_LIST is now compulsory
• New variable BLPARSER_WITH_UPDATER_NOTIFIER to support the use of new blparser (with updater and notifier) or the old one (which parses the log files). Values are true or false, default is false..

glite-CREAM, glite-FTA_oracle, glite-FTS_oracle, glite-LFC_mysql, glite-LFC_oracle, glite-PX, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-UI, glite-VOBOX, glite-VOMS_mysql, glite-VOMS_oracle, glite-WMS, glite-WN, lcg-CE

• Adds next certificates for voms.cern.ch and voms-pilot.cern.ch
• Removes old certificate for lcg-voms.cern.ch

glite-WN

15.07.2009 - 3.1 Update 51

glite-UI, glite-WN, glite-VOBOX

• VOBOX service provider correctly publishes the supported VOs.
• FTS endpoint can be now specified by the user.

• GLITE_LOCAL_CUSTOMISATION_DIR: This is an optional variable to define a scratch area for pool accounts via EDG_WL_SCRATCH. For more information please check glite-WN-3.0.15-3 Update
• GLITE_SD_PLUGIN: Service discovery settings to determine the FTS endpoint. Possible values are: 1) file : look for the FTS endpoint in a static file specified in GLITE_SD_SERVICES_XML. 2) bdii : look for the FTS endpoint dynamically from the BDII. Both options can be specified. The first one is tried first. Default is "file,bdii".
• GLITE_SD_SERVICES_XML: Location of the FTS services.xml cache file. This has to be used in combination with GLITE_SD_PLUGIN="file,bdii". Default is "${INSTALL_ROOT}/glite/etc/services.xml".

glite-SE_dpm_mysql, glite-SE_dpm_disk, glite-FTA_oracle, glite-FTS_oracle, glite-WN, glite-UI, glite-VOBOX

• DPM gridftp v1.7.1-2: saves the calculated checksum (via gridftp CKSM) to the name server, e.g. for later reporting via srmLs. The dpm-gridftp is able to calculate Adler32, Crc32 and MD5 checksums.
• Improved the error reporting of 'dpm-drain'.
• Clear the saved namespace checksum, if file as changed.
• Using libvomsapi, instead of the deprecated libvomsc.
• Avoiding /etc/services for rfio port lookup (wrong value).
• rfio bugfixes and improvements
• The DPM/LFC sources, configuration and init scripts have been improved for portability to SL5, Debian, OS X and Solaris.

glite-LFC_mysql, glite-LFC_oracle, glite-WN, glite-UI, glite-VOBOX

• The LFC sources, configuration and init scripts have been improved for portability to SL5, Debian, OS X and Solaris.
• Two new methods have been added to the LFC server and the API: lfc_delreplicasbysfn() and lfc_registerfiles(), for the bulk removal or addition of entries.

glite-LFC_mysql, glite-LFC_oracle

14.07.2009 - 3.1 Update 50

glite-WN

New version of grid-cm-* packages to remove /opt/glite/lib/python/logging. This is to address GGUS ticket 50148, only happening in glite-WN version 3.1.31-0. In fact this private logging version was only ever required on SL3 and can cause problems for people using private python 2.5 versions with the supplied 2.3 versions.

06.07.2009 - 3.1 Update 49

lcg-CE, glite-WMS, glite-VOBOX, glite-CREAM, glite-SCAS

Both LCAS and LCMAPS exist in library form only. They need an eco system in which they can live. This used to be the gridftp for example and nowadays glexec is used. This also means that LCAS and LCMAPS are mostly shielded from the end user and that the interaction primarely goes through glexec.

From a site point of view there is the configuration of LCAS and LCMAPS and the end user should have no control over it. Other then that, there is not much more interaction required.

glite-SCAS

New Site Central Authorization Service (SCAS). SCAS is a Web Service that allows client programs to query for an authorization decision based upon user credentials to access a particular resource. For more information please check the service node page.

SCAS YAIM configuration
====================

For a description of the YAIM variables needed to configure the SCAS server please visit: SCAS configuration variables.

The command to configure SCAS using YAIM is:
./yaim -c -s site-info.def -n SCAS

lcg-CE, glite-SGE_utils

New version of the yaim module for the lcg CE containing configuration changes as requested in:

• The WN Working Group. See WN Working group wiki (Key item B)
• The Installed Capacity Document (page 13)

• Service provider configuration
• LDIF file fixes

• CE_OTHERDESCR: This YAIM variable is used to set the GlueHostProcessorOtherDescription attribute. The value of this variable MUST be set to: Cores=<typical number of cores per CPU> [, Benchmark=<value>-HEP-SPEC06] where <typical number of cores per CPU> is equal to the number of cores per CPU of a typical Worker Node in a SubCluster. The second value of this attribute MUST be published only in the case the CPU power of the SubCluster is computed using the Benchmark HEP-SPEC06.
• CE_CAPABILITY: This YAIM variable is a blank separated list and is used to set the GlueCECapability attribute. In particular, site administrators MUST define the following values: CPUScalingReferenceSI00=<referenceCPU SI00>; the reference CPU SI00 is the internal batch scaling factor used to normalize the GlueCEMaxCPUTime. The <referenceCPU SI00> is expressed in SI00. If internal scaling is not done this capability MUST be published and its value set to the minimum value of the corresponding SubClusters GlueHostBenchmarkSI00. Share=<VO>:<share>; this value is used to express specific VO shares if set. If there is no special share, this value MUST NOT be published. <VO> is the VO name and <share> can assume values between 1 and 100 (it represents a percentage). Please note that the sum of the shares over all WLCG VOs MUST BE less than or equal to 100. The syntax is CPUScalingReferenceSI00=value [Share=vo-name1:value [Share=vo-name2:value [...]]]
• SE_MOUNT_INFO_LIST: This YAIM variable is used to set the GlueCESEBindMountInfo attribute for each defined SE. The variable is a space separated list of SE hosts from SE_LIST with the export directory from the Storage Element and the mount directory common to worker nodes part of the Computing Element like SE1:export_dir1,mount_dir1. If any SE from SE_LIST doesn't support he mount concept, don't define anything for that SE in this variable. If this is the case for all the SEs in SE_LIST, put the value none. The GlueCESEBindMountInfo will be in both cases "n.a".

• CLUSTER_HOST: this variable must be set to CE_HOST for the time being. It's defined under INSTALL_ROOT/glite/yaim/defaults/lcg-ce.post.

lcg-CE, glite-BDII, glite-PX, glite-WMS, glite-VOBOX, glite-SE_dpm_mysql, glite-AMGA_oracle, glite-AMGA_postgres

glite-AMGA_oracle, glite-AMGA_postgres, glite-BDII, glite-CREAM, glite-FTS_oracle, glite-HYDRA_mysql, glite-LB, glite-LFC_mysql, glite-LFC_oracle, glite-MON, glite-PX, glite-SE_dcache_admin_gdbm, glite-SE_dcache_admin_postgres, glite-SE_dcache_info, glite-SE_dpm_mysql, glite-VOBOX, glite-VOMS_mysql, glite-VOMS_oracle, glite-WMS, lcg-CE

glite-WMS, glite-UI, glite-VOBOX

The ability to submit jobs to ARC CEs has been included in the WMS. Any ARC CEs that wish to be used this way will need to install the gLite runtime environment. The instructions for doing this can be found here. For more details please check the documentation in ARC-WMS

lcg-CE, glite-CREAM, glite-GLEXEC_wn, glite-VOBOX, glite-SCAS, glite-WMS

• Improved error codes
• Code cleanups prevent crashes. The most interesting ones are when having to work with secondary GIDs that are not shown with their groupname, because the machine can't resolve them.
• More distinct error message reporting, every problem that is not a 202 system error will be reported on the stderr. To prevent misuse a 202 system error is not written to stderr, it will only be readable in the gLExec log.
• Added glexec.conf option "use_lcas {yes,no}" to enable or disable LCAS. Could be good to use in SCAS setups.
• Restored glexec.conf option "lcmaps_get_account_policy = scas:voms:local". You can now use multiple LCMAPS policies and specifically configured LCMAPS policies.
• Default special group is 'glexec' and not 'apache' (not used due to usage of the whitelist function).
• Added glexec.conf option "target_lock_mechanism {flock,fcntl,disabled} to select the locking mechansim for the $GLEXEC_TARGET_PROXY (or its default) location. Requested by the CREAM-BLAH-gLExec team. The default is still flock, but you can also use fcntl or bypass it (not safe) completely, see also below.
• Added glexec.conf option "input_lock_mechanism {flock,fcntl,disabled} to select the locking mechansim for the $GLEXEC_SOURCE_PROXY (if set) location and GLEXEC_CLIENT_CERT. Requested by the CREAM-BLAH-gLExec team. The default is flock, but you can also use fcntl or bypass it (not safe) completely, see also below.
• Manpages are cleaned up and reflect the current state of gLExec.
• $SSL_CLIENT_CERT is not usable anymore as this is very error prone. Use GLEXEC_CLIENT_CERT instead.
• The $GLEXEC_MODE="lcmaps_verify_account setting is disabled. This deprecated functionality is not used, functioned badly and is not supported in all the LCMAPS plugins.
• New scas-client plug-in
  • The SCAS Client will properly be able to work now with root-squashed enabled network filesystems, by lowering its effective Unix credentials to the calling user. This will allow for the SCAS Client to read in the certificate and private key with the proper credentials (similar to the gLExec code).
  • The "--endpoint <url>" option can be set multiple times in the lcmaps.db file. The maximum amount of endpoints configurable is 32.
  • New option is "--endpoint-strategy round-robin|round-robin-random-start|random": The endpoint strategy tells the client in which order the configured endpoints should be tried to be contacted. With round-robin the list of endpoints will be tried from top to bottom as written in the lcmaps.db file. The option round-robin-random-start will follow the list of endpoints as written in the lcmaps.db file, but it will randomly start somewhere in the list of end-points. The random option will randomly choose an endpoint to try. When unlucky the same endpoint could be tried twice. This is true pseudo-random. The round-robin-random-start is made default. This will automagically provide a load balancing effect by randomly selecting a configured endpoints.
  • New option: "--retry <0-9+>"This will alter the retry count when interacting with an SCAS endpoint. By default each endpoint is tried twice by default before any other endpoint is tried (this excludes the various TCP/IP layer retries that are always performed at a lower level). This option can alter this default behavior. It can be set to any number as long as its more than 1. Between two tries there is a small amount of (random) time of delay build-in.

25.06.2009 - 3.1 Update 48

glite-WN

grid-cm-* packages provide worker node configuration monitoring. For more information, please check The Worker Node Client Documentation. In this document you can find the instructions about how to disable the publisher, if needed.

glite-AMGA_oracle, glite-AMGA_postgres, glite-CREAM, glite-FTA_oracle, glite-FTS_oracle, glite-LB, glite-LFC_mysql glite-LFC_oracle, glite-MON, glite-PX, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-UI, glite-VOBOX, glite-VOMS_mysql, glite-VOMS_oracle, glite-WMS, glite-WN, lcg-CE

• Warnings and errors are now counted. If there are errors in the download or verification process for one or more CRLs, the exit status will be 1; if there are errors in the local setup or in the script invocation, the exit status will be 2.
• The installed CRLs no longer have the textual representation of the CRL, but only the PEM data blob, thus reducing IO and memory requirements.
• the CRL aging threshold is now set by default to 24 hours. The previous default was 0. The CRL aging threshold is set in the config file using CRL_AGING_THRESHOLD=<xx>, or with the "-a" command-line argument.
• Default network timeouts reduced to 10 seconds (was 30) and retries to 2.
• Added caching and conditional downloading. When CACHEDIR is set, the original downloads are preserved and wget timestamping mode enabled. When the content did not change, only the timestamp on the installed CRL is updated. If SLOPPYCRLHASHES is set, the has is calculated based on the name of the crl_url file, otherwise it is taken from the CRL itself.
• The CACHEDIR must be exclusively writable by the user running fetch-crl.
• Setting CACHEDIR significantly reduced the bandwidth used by fetch-crl.
• Added RESETPATHMODE setting in sysconfig. It defines whether or not to set re-set $PATH to "/bin:/usr/bin" before start. The search for OpenSSL may be done based on the old path. yes=always replace; searchopenssl=search for openssl first and then reset; no=keep original path, whatever that me be (may be empty if called from cron) Default="yes". This replaces the hard-coded path in the tool!
• Hidden "FORCE_OVERWRITE" option now has a regular name. This is backwards-compatible. Set FORCE_OVERWRITE=yes if you want files overwritten that have a CRL-like name and ought to have CRL content, but currently do not.

glite-SE_dcache_info, glite-SE_dcache_pool, glite-SE_dcache_admin_gdbm, glite-SE_dcache_admin_postgres, glite-VOBOX, glite-WN, glite-UI

• Info service and info provider
• Permanent registration of deleted files
• SRM Client Tools
• Log4j Runtime User Interface
• dCacheConfigure Script

lcg-CE, cream-CE

Following a requirement of the WN Working Group, the new lcg-info-dynamic-software GIP plugin now supports an additional method to load software tags for SubClusters. Software tags can now be configured in:

• in /opt/glite/var/info/<vo>/<vo>.list (old method)
• in a per-SubCluster list /opt/glite/var/info/<SubCluster>/<vo>/<vo>.list (new and recommended method).

Note: For clean installations of cream CE and lcg CE, or when adding a new VO: YAIM creates /opt/glite/var/info/<SubCluster>/<vo>/<vo>.list and, due to bug 49831, /opt/edg/var/info/<vo>/<vo>.list is no longer created. It will be created again in the upcoming yaim-core 4.0.8-7 release. For a workaround see known issues pages of lcg CE and cream CE.

• tags configured in /opt/edg/var/info/<VO> are added to all SubClusters.
• tags configured in /opt/glite/var/info/<SubCluster>/<vo> Are added to the particular subclusters.

glite-VOBOX

This patch is just for enabling the installation of CREAM and CEMon client in the VOBOX (besides the UI and the WMS). The specified RPMs are the one currently in production (patch #2845)

16.06.2009 - 3.1 Update 47

glite-AMGA_postgres, glite-AMGA_oracle, glite-SE_dpm_mysql

• The AMGA service is now published in the Information System by using the service provider.
• YAIM improvements.

lcg CE

• Fix for GGUS ticket 42981
• Workaround for Condor-G bug where Condor-G does not distinguish between different VOMS groups, roles or VOs when the proxies have the same DN (bug #40359).

glite-WN

glite-VOBOX, glite-UI, glite-WN

• gfal_open segfaults on "connection refused". Tracked in #51230

glite-VOBOX, glite-UI, glite-WN

• warning in case of mismatch between command line VO and proxy VO
• asynchronous srmLs support (dCache)
• new synchronous function gfal_bringonline() with retrying/polling mechanism
• new lcg-get-checksum command (and corresponding API function)
• SRMv2 is now used by default if available
• support of checksum verification during file transfers

• When copying a local file to an SE, checksum checking does not work. (SE -> local and SE -> SE works OK). Will be fixed for the next release.
• The lcg-rf commmand no longer prints the guid on success. The "--verbose" option has to be used in order to obtain the value. See bug #50548

12.05.2009 - 3.1 Update 46

glite-SE_dpm_mysql, glite-SE_dpm_disk, glite-LFC_mysql, glite-LFC_oracle, glite-FTA_oracle, glite-FTS_oracle, glite-WN, glite-UI, glite-VOBOX

The new version of DPM and LFC contains a series of new features and bug fixes. See the packages described below for more details.

Known Issue

bug #49369: There is a known problem when configuring DPM 1.7.0-6 using YAIM. For more details please visit the DPM disk and the DPM mysql.

LCG-DM 1.7.0-5

• srmCopy has been fully implemented
• WLCG SRM MoU requirements:
  • support for multiple groups on spaces
  • SRM2.2 srmReleaseFiles can be used without a requestToken
  • srmLs can return information about the spaces in which a file resides
• new dpm-listspaces CLI, which will also serve as information provider

• /opt/glite/etc/gip/provider/glite-info-dpm-space-tokens-provider
• /opt/glite/libexec/glite-info-dpm-space-tokens

• added ADLER32 and CRC32 checksum algorithms to CKSM handler
• Fixes #42623: DM custom packager creates rpms with invalid name

• Fixes #42623: DM custom packager creates rpms with invalid name
• gSOAP 2.7.10 has introduced a virtual destructor, which inserts a pointer to the VMT at the beginning of the 'soap' structure, making the C and C++ versions of the code binary incompatible, so we need to build C++ flavour of the libraries as well with _cpp suffix.
• Added new function, export_delegated_credentials(), to make a delegated credential token available in memory suitable for storage and later reuse by the user.
• Removed some spurious trailing newlines from error messages.
• Fixed descriptor and connection leak on the client side when the authenitcation negociation to a server fails.
• Enhanced some error messages to cover more of the error message recommendations in bug #35320.

• dpm-httpd-cmd, dpm-httpd-cp: fixing X509 environment variable names X509_USERCERT->X509_USER_CERT ... similiar X509_USERKEY & X509_USERPROXY
• Checking the default proxy location in /tmp/x509up_u* as well.

• Fixes #42623: DM custom packager creates rpms with invalid name.
• Improving stability: initialise a couple of pointers in case DPM calls fail
• fix in logrotation script to check if dpm-xrd is actually configured before sourcing the config file.

glite-SE_dpm_mysql, glite-SE_dpm_disk, glite-LFC_mysql, glite-LFC_oracle, glite-WN, glite-UI, glite-VOBOX

This is an update of the DPM and LFC path fixing some outstading issues:

• Fix memory leak in dpm_get_max_get_lifetime()
• Correct problem with bug fix 40553 (dpm-drain)
• update dpm-listspaces to v1.3.1-4

glite-FTA_oracle, glite-FTS_oracle, glite-LB, glite-LFC_mysql, glite-LFC_oracle, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-UI, glite-VOBOX, glite-VOMS_mysql, glite-VOMS_oracle, glite-WMS, glite-WN, lcg-CE

New version of the VOMS Java APIs to fix some bugs. Please, check the list of bugs in the specific service update pages for more information.

glite-WMS

New version of WMS packages to fix bug #47040

29.04.2009 - 3.1 Update 45

glite-WN

Addition of the glite-wn-info command
============================

The glite-wn-info command is designed to be executed on the WN by a job submitter. It returns information about that worker node in a grid context. Initially the following in particular is supported:

$ glite-wn-info -n GlueSubClusterUniqueId MySubCluster

The unique GlueSubCluster the batch worker is located in is returned.

The configuration file default location is ${GLITE_LOCATION:-/opt/glite}/etc/glite-wn-info.conf.

However the hard coded location /etc/glite-wn-info.conf is also supported and will override $GLITE_LOCATION/etc/glite-wn-info.conf. This last configuration is particularly useful to sites working with the a TAR_WN and allows them to configure their WNs individually.

YAIM support for glite-wn-info:

• A new function, config_wn_info, will create the configuration file needed by glite-wn-info. Please, check the description of the WN_LIST variable in the YAIM guide since a new syntax has been introduced to be able to configure glite-wn-info. More details in the relevant section of the YAIM guide.
• A new default YAIM variable has been introduced for the WN/TAR WN configuration to define the glite-wn-info configuration file. WN_INFO_CONFIG_FILE. Since a default value is provided, the sys admins don't need to worry about it unless they want a non standard configuration. More details in: section on WN variables in the YAIM guide.

glite-UI, glite-VOBOX, glite-WN

Major release of GFAL 1.11.4 and lcg_util 1.7.2
======================================

• failover to other replicas, if an SE is not available
• adjustable timeouts for each type of remote operation
• SULR canonicalization can be disabled (for VOs without BDII)
• improved Python interface (Posix I/O, error handling)
• checksum is displayed in lcg-ls
• accepting negative request ID (dCache)
• using single gridftp session (CASTOR)
• obsoletes RMC/LRC functionality (not removed yet)
• and a number of bug fixes
• lcg-del fails when specifying the LFN and the SE, a simple workaround consists in specifying the corresponding SURL.

glite-AMGA_postgres, glite-AMGA_oracle, glite-BDII, glite-CONDOR_utils, glite-CREAM, glite-FTA_oracle, glite--FTM, glite-FTS_oracle, glite-LB, glite-LFC_mysql, glite-LFC_oracle, glite-LSF_utils, glite-LFC_mysql, glite-LFC_oracle, glite-MON, glite-MPI_utils, glite-PX, glite-SE_dcache_admin_gdbm, glite-SE_dcache_admin_postgres, glite-SE_dcache_info, glite-SE_dcache_pool, glite-SE_dpm_disk, glite-SE_dpm_mysql, glite-SGE_utils, glite-TORQUE_client, glite-TORQUE_server, glite-TORQUE_utils, glite-UI, glite-VOBOX, glite-WMS, glite-WN, lcg-CE

Updates for YAIM
=============

This release contains an update for yaim clients and yaim core. Both have been updated from version 4.0.5 to version 4.0.7, but they contain also all the bug fixes made available in 4.0.6. The release pages only highlight the bugs fixed in yaim core 4.0.7. If you also want to know the list of bugs fixed in 4.0.6, please look at the list of attached bugs in the yaim core patch (#2636) and yaim client patch (#2757).

Known Issue

Bug #49831: After introducing the fix for Bug #45887, YAIM has stopped to create /opt/edg/var/info directories. This is a mistake since the version of lcg-tags that will be able to write in the new directory /opt/glite/var/info/<SubClusterUniqueId>/<vo> is released in Patch #2940 that hasn't been certified yet. Old directories need to be supported for a while. The following workaround is needed in fresh installations of the lcg CE and cream CE or when a new VO is added to an existing CE. Edit $INSTALL_ROOT/glite/yaim/functions/cofig_gip_vo_tag and add at the end the old code to create the /opt/edg/var/info directory. Visit the lcg CE and the cream CE known issues pages for the details.

• #43278: config_users is now always creating the cleanup-grid-accounts cron job, no matter if CONFIG_USERS is yes or no.
• #39389: WMS now limits concurrent GridFTP connections using a new variable, GRIDFTP_MAX_CONNECTIONS (described in the next section).

• UNPRIVILEGED_MKGRIDMAP: In case you want to create a grid-map file which only contains mappings to ordinary users. Values are 'yes' or 'no'. 'no' will create a grid-map file with special users as well, if defined in groups.conf. yes, will create a grid-mapfile containing only mappings to ordinary pool accounts. This variable is defined in site-info.pre. Default is 'no'. You can redefine it in your site-info.def.
• GRIDFTP_CONNECTIONS_MAX: Maximum number of simultaneous connections to the gridftp server. This variable is defined in site-info.pre. Default is '50'. You can redefine it in your site-info.def.
• BDII_LIST: This variable already appeared in the previous yaim core release 4.0.5-7. However, due to a bug it was recommened not to use it. It's an optional variable to define a list of top level BDIIs to support the automatic failover in the GFAL clients. The syntax is my-bdii1.$MY_DOMAIN:port1[,my-bdii22.$MY_DOMAIN:port2[...]]. Be aware that lcg-infosites doesn't work with multiple BDIIs. So it's better you don't define this variable if you need to use lcg-infosites. However gfal, lcg_utils, lcg-info and glite-sd-query work fine with multiple BDIIs.
• SE_MOUNT_INFO_LIST: This YAIM variable is used to set the GlueCESEBindMountInfo attribute for each defined SE. The variable is a space separated list of SE hosts from SE_LIST with the export directory from the Storage Element and the mount directory common to worker nodes part of the Computing Element like SE1:export_dir1,mount_dir1. If any SE from SE_LIST doesn't support the mount concept, don't define anything for that SE in this variable. If this is the case for all the SEs in SE_LIST, put the value 'none'. The GlueCESEBindMountInfo will be in both cases 'n.a'.
• CE_CAPABILITY and CE_OTHERDESCR: These variables affect cream CE and lcg CE and that's why they are included in the example site-info.def. However, they are currently not used until some modifications in the information system configuration are applyed in cream and lcg CE. They will be properly announced by then. You can ignore them for the time being.

• fetch-crl runs now on reboot. A init.d script has been created for it.
• Tomcat configuration is now defined in yaim core to be used by all the modules that need tomcat.
• grid-env.sh doesn't leave garbage in the environment. It's also possible to run the -r option in the yaim command without messing up the grid-env.sh file.
• Old lcas/lcmaps configuration files are no longer created in config_mkgridmap.
• Multiple BDIIs can now be defined for GFAL clients. See the section above for the description of BDII_LIST.
• Update of yaim clients in order to avoid duplication of PYTHONPATH/PERL5LIB definitions.
so that the grid environment has coherent values for 32bit and 64bit platforms.
• With the previous yaim core version, PYTHONPATH/PERL5LIB used to contain a mix of 32bit and 64bit grid libraries after configuring a node type (specially WNs). This is wrong since Python/perl, unlike the dynamic linker, seems not to be able to find the good library when 32bit and 64bit libraries appear in PYTHONPATH/PERL5LIB.The fix consists of:
  • If the machine is 64bit and middleware is 64bit, PYTHONPATH/PERL5LIB only contains 64bit paths.
  • If the machine is 64bit and middleware is 32bit, PYTHONPATH/PERL5LIB only contains 32bit paths.
  • If the machine is 32bit, PYTHONPATH/PERL5LIB only contains 32bit paths.
• Python version specific directories have also been added in PYTHONPATH when they are installed.
• A typo has also been fixed in config_mkgridmap so that the grid-map file generation for LFC and DPM works fine now.
• The .lsc files (files specifying the trusted VOMS servers with their DNs and CA DNs) are now created in the tarball configurations.
• VO SW tag directories are created now under /opt/glite/var/info/<SubClusterUniqueId>/<vo>. Two new variables are used CLUSTERS and CLUSTER_<cluster_name>_SUBCLUSTERS which, for the time being have a default value which is CE_HOST. Sys admins should not change this. There's a new software provider that will publish from old and new directories (not yet in production) and there's a new version of lcg-tags that will write in old and new directories (not yet in production). For the time being, this configuration change can be ignored until the new lcg-tags version is released to production. See the Known Issue described above.

14.04.2009 - 3.1 Update 44

glite-CREAM

Update of CREAM CE. The main changes are:

Configuration
==========

• A problem in BLAH configuration fixed in order to reduce the probability of jobs aborted for "killed by signal 15"
• Publications of VO software tags in a CREAM CE is now supported

• Fixed a "too many open files" problem triggered by the purge operation
• Fixed a memory leak in the BLAH Blparser for LSF
• Fixed some problems in the BLAH BLparser which caused its crash or its inability to send notifications to CREAM
• BLAH is started via a "master" process, which monitors and in case restarts the parser

glite UI, glite-WMS

Upgrade of CREAM and CEmon clients. The main changes are:

• Problem involved with staging of InputSandbox files fixed.
• It is now possible to use the CREAM client even if the relevant VO VOMS cert file is not installed in the clients, as requested by OSG.
• Support for some problems reported in IPv6
• Fixed some problems which prevented the build on sl5_x86_84

glite UI, glite VOBOX

Important fix for WMS clients:

• bug #48598: job submission fails when first WMS tried is draining !!

02.04.2009 - 3.1 Update 43

glite-UI, glite-WN, glite-VOBOX

    * New version of YAIM clients enabling configuration of Service Discovery (PATCH:2596)

glite-SGE_utils

    * New info dynamic plugin + YAIM utils
    * This update fixes a security issue. Please have a look at the corresponding advisory

glite-VOBOXglite infor provider service

    * New info dynamic plugin + YAIM utils