data-tailor tagshttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags2023-12-21T11:45:33Zhttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/3.3.03.3.0- Updated readme and install (#1282)
- Pin dependencies to decrease vulnerabilities (data-tailor-web-service#41)
- Added openssl runtime dependency to web UI to maintain compatibility with latest rockylinux (data-tailor-web-service#32)
- Unpinned krb package to keep compatibility with epct_plugin_gis Windows installation (epct_plugin_gis#58)
- Include commit short sha in development packages versions (#1250)
- Exclusively download dependencies from conda-forge (#1254)
- Upgraded GDAL version to 3.6.2 (#1173)
- Removed epct-plugin-fist-iasil1c (#909)
- Debug log level inhibited customisation cancel feature (#1259)
- EUM/MuMi/AR/5944 - Close file handler when logger is no longer used (#1232)<h2 data-sourcepos="1:1-1:20" dir="auto">
<a id="user-content-data-tailor-330" class="anchor" href="#data-tailor-330" aria-hidden="true"></a>Data Tailor 3.3.0</h2>
<h3 data-sourcepos="3:1-3:9" dir="auto">
<a id="user-content-added" class="anchor" href="#added" aria-hidden="true"></a>Added</h3>
<ul data-sourcepos="4:1-9:0" dir="auto">
<li data-sourcepos="4:1-4:55">SEVIRI HRV band can now be extracted in Native format</li>
<li data-sourcepos="5:1-5:60">Added support for GOME L1B products sensed after June 2021</li>
<li data-sourcepos="6:1-6:34">Added support for MVIRI products</li>
<li data-sourcepos="7:1-7:51">Added support for SRAL BC005 reprocessed products</li>
<li data-sourcepos="8:1-9:0">Added a new HRIT compressed output format that will produce wavelet compressed HRIT</li>
</ul>
<h3 data-sourcepos="10:1-10:11" dir="auto">
<a id="user-content-changed" class="anchor" href="#changed" aria-hidden="true"></a>Changed</h3>
<ul data-sourcepos="11:1-15:0" dir="auto">
<li data-sourcepos="11:1-11:62">Updated HRIT output to deliver the correct EPI and PRO files</li>
<li data-sourcepos="12:1-12:71">Default resampling method for reprojecting ASCAT products set to near</li>
<li data-sourcepos="13:1-13:64">Changed base data type for SEVIRI RGB PNGs from byte to 16-bit</li>
<li data-sourcepos="14:1-15:0">GDAL version updated to 3.6.2</li>
</ul>
<h3 data-sourcepos="16:1-16:9" dir="auto">
<a id="user-content-fixed" class="anchor" href="#fixed" aria-hidden="true"></a>Fixed</h3>
<ul data-sourcepos="17:1-19:73" dir="auto">
<li data-sourcepos="17:1-17:95">Fixed MSG1 and MSG2 SEVIRI products having different geographical extents after customisation</li>
<li data-sourcepos="18:1-18:99">Restored the sensing end time to output filenames, instead of having the sensing start time twice</li>
<li data-sourcepos="19:1-19:73">Fixed an issue that left job log files open after finishing the process</li>
</ul>2023-12-21T11:45:33ZGiuseppe Le Vocihttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/3.2.03.2.0- Added support to select input files from multiple directories from the GUI (desktop only) (#1209)
- Added support for configuration memory limit parameter for aggregation (#1186)
- Improved the way to collect bands filter information to be passed to plugins (#1218)
- Implemented a mechanism to distinguish input metalink "basket" from other XML files representing input file paths (#1200)
- Update minimist and json-schema to fix nodejs related vulnerabilities (data-tailor-web-service#17)
- EUM/MuMi/AR/5888 - Fixed deletion of jobs that are in FAILED state due to lack of space (#1223)
- Fixed critical code smells signalled by sonarqube, in particular decreasing cyclomatic complexity of multiple functions (#1222)
- EUM/MuMi/AR/5866 - Log kill and exit if job restarts (#1221)
- EUM/MuMi/AR/5779 - Added proper filename and extension to HRIT compressed output files (#1212)
- EUM/MuMi/AR/5748 - Fix native HRSEVIRI outputs header information (#1198)<h2 data-sourcepos="1:1-1:20" dir="auto">
<a id="user-content-data-tailor-320" class="anchor" href="#data-tailor-320" aria-hidden="true"></a>Data Tailor 3.2.0</h2>
<h3 data-sourcepos="3:1-3:9" dir="auto">
<a id="user-content-added" class="anchor" href="#added" aria-hidden="true"></a>Added</h3>
<ul data-sourcepos="4:1-20:0" dir="auto">
<li data-sourcepos="4:1-4:69">Added proper filename and extension to HRIT compressed output files</li>
<li data-sourcepos="5:1-5:91">Added support to select input files from multiple directories from the GUI (desktop only)</li>
<li data-sourcepos="6:1-6:72">Added support for configuration memory limit parameter for aggregation</li>
<li data-sourcepos="7:1-20:0">Added support for Sentinel-3 products:
<ul data-sourcepos="8:3-20:0">
<li data-sourcepos="8:3-8:84">OLCI Level 1B Full Resolution (NRT, NTC or version BC002) - Sentinel-3 (OLL1EFR)</li>
<li data-sourcepos="9:3-9:87">OLCI Level 1B Reduced Resolution (NRT, NTC or version BC002) - Sentinel-3 (OLL1ERR)</li>
<li data-sourcepos="10:3-10:95">OLCI Level 2 Ocean Colour Full Resolution (NRT, NTC, BC002 or BC003) - Sentinel-3 (OLL2WFR)</li>
<li data-sourcepos="11:3-11:98">OLCI Level 2 Ocean Colour Reduced Resolution (NRT, NTC, BC002 or BC003) - Sentinel-3 (OLL2WRR)</li>
<li data-sourcepos="12:3-12:107">SLSTR Level 1B Radiances and Brightness Temperatures (NRT, NTC or version BC003) - Sentinel-3 (SLL1RBT)</li>
<li data-sourcepos="13:3-13:69">SLSTR Level 2 Aerosol Optical Depth in NRT - Sentinel-3 (SLL2AOD)</li>
<li data-sourcepos="14:3-14:68">SLSTR Level 2 Fire Radiative Power in NRT - Sentinel 3 (SLL2FRP)</li>
<li data-sourcepos="15:3-15:98">SLSTR Level 2 Radiances and Brightness Temperatures (NRT, NTC or BC003) - Sentinel-3 (SLL2WST)</li>
<li data-sourcepos="16:3-16:89">SRAL Level 2 Altimetry Global (NRT, NTC, STC or version BC004) - Sentinel-3 (SRL2WAT)</li>
<li data-sourcepos="17:3-17:73">SRAL Level 1B (NRT, NTC, STC or version BC004) - Sentinel-3 (SRL1SRA)</li>
<li data-sourcepos="18:3-18:96">SRAL Level 1A Unpacked L0 Complex echoes (NTC, STC or version BC004) - Sentinel-3 (SRL1SRAA)</li>
<li data-sourcepos="19:3-20:0">SRAL Level 1B stack echoes (NTC, STC or version BC004) - Sentinel-3 (SRL1SRABS)</li>
</ul>
</li>
</ul>
<h3 data-sourcepos="21:1-21:11" dir="auto">
<a id="user-content-changed" class="anchor" href="#changed" aria-hidden="true"></a>Changed</h3>
<ul data-sourcepos="22:1-24:0" dir="auto">
<li data-sourcepos="22:1-22:51">Reduced DTWS image vulnerabilities and image size</li>
<li data-sourcepos="23:1-24:0">Improved the way to collect bands filter information to be passed to plugins</li>
</ul>
<h3 data-sourcepos="25:1-25:9" dir="auto">
<a id="user-content-fixed" class="anchor" href="#fixed" aria-hidden="true"></a>Fixed</h3>
<ul data-sourcepos="26:1-30:0" dir="auto">
<li data-sourcepos="26:1-26:49">Fixed invalid plugin configuration for IASSND02</li>
<li data-sourcepos="27:1-27:94">Corrected "wmo_filename" name for EO:EUM:DAT:MSG:CLM products using netcdf4_satellite output</li>
<li data-sourcepos="28:1-28:71">ASCAT Level 1 customisations to HDF5 and NetCDF don't failing anymore</li>
<li data-sourcepos="29:1-30:0">Errors when processing Moisture products (ASCSMR02, ASCSMO02) from before 2010 are fixed</li>
</ul>2023-07-27T12:01:30ZGiuseppe Le Vocihttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/3.1.03.1.0- Added changelog file to conda package (data-tailor#1126)
- Added worker plugin to ensure gdal subprocesses are interrupted on manual customisation kill (#1172)
- Bumped Swagger UI definition version to 3.0.1 (#1146)
- epct_webui: Add run-constrained section in conda/meta.yaml file to set the compatibility with epct version (#1145)
- epct_restapi: Add run-constrained section in conda/meta.yaml file to set the compatibility with epct version (#1145)
- Hide MSG1.5 products in HRIT format from the list of available product types in DTWS (#1116)
- Run button now waits for submission to be completed (#1136)
- Fixed Swagger UI security scheme definition (#1146)
- Fixed shapefile usage on run customisation (#1119)
- Update dask to latest stable version 2022.10.0 (#1166)Giuseppe Le Vocihttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/3.0.23.0.2- Updated plugin versions to latest stable releases
- Improved swagger UI definition (#1109)
- Web GUI dependencies updated to more secure versions(data-tailor-web-service#3)
- Base docker images updated to more recent/secure versions (data-tailor-web-service#3)
- Restored compatibility with legacy API call (data-tailor-web-service#7)levocihttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/3.0.13.0.1Giuseppe Le Vocihttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/3.0.03.0.0<h2 data-sourcepos="1:1-1:20" dir="auto">
<a id="user-content-data-tailor-300" class="anchor" href="#data-tailor-300" aria-hidden="true"></a>Data Tailor 3.0.0</h2>
<h3 data-sourcepos="3:1-3:9" dir="auto">
<a id="user-content-added" class="anchor" href="#added" aria-hidden="true"></a>Added</h3>
<ul data-sourcepos="4:1-9:0" dir="auto">
<li data-sourcepos="4:1-4:69">Support processing GRAS data reprocessed via EPSar tool integration</li>
<li data-sourcepos="5:1-5:94">Enabled support for converting NetCDF4 (Data Centre) to HRSEVIRI L1.5 Image Data HRV channel</li>
<li data-sourcepos="6:1-6:74">Added ROI-extraction feature for EPS-native to EPS-native customisations</li>
<li data-sourcepos="7:1-7:35">Show download progress in Web GUI</li>
<li data-sourcepos="8:1-9:0">Added content-length header in file download requests lowering memory consumption on downloads</li>
</ul>
<h3 data-sourcepos="10:1-10:11" dir="auto">
<a id="user-content-changed" class="anchor" href="#changed" aria-hidden="true"></a>Changed</h3>
<ul data-sourcepos="11:1-14:0" dir="auto">
<li data-sourcepos="11:1-11:24">Migrated to Python 3.9</li>
<li data-sourcepos="12:1-12:58">Aligned EPS product IDs with new Data Store nomenclature</li>
<li data-sourcepos="13:1-14:0">Upgraded GDAL version to 3.3.1</li>
</ul>
<h3 data-sourcepos="15:1-15:9" dir="auto">
<a id="user-content-fixed" class="anchor" href="#fixed" aria-hidden="true"></a>Fixed</h3>
<ul data-sourcepos="16:1-20:102" dir="auto">
<li data-sourcepos="16:1-16:122">Fixed installation process issue caused epct-plugin-gis building issue due to new distribution of python-eccodes package</li>
<li data-sourcepos="17:1-17:44">Download via GUI with desktop installation</li>
<li data-sourcepos="18:1-18:96">Fix deletion of customisations with output products saved directly into the user output folder</li>
<li data-sourcepos="19:1-19:103">Customization correctly produces NetCDF4 products from HRSEVIRI HRV when HRV is empty due to darkness</li>
<li data-sourcepos="20:1-20:102">Appropriate error message returned for IASISND02 older than 10-2014 to netcdf4_satellite conversions</li>
</ul>2022-06-29T12:04:50Zlevocihttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.15.02.15.0<h2 data-sourcepos="1:1-1:21" dir="auto">
<a id="user-content-data-tailor-2150" class="anchor" href="#data-tailor-2150" aria-hidden="true"></a>Data Tailor 2.15.0</h2>
<h3 data-sourcepos="3:1-3:9" dir="auto">
<a id="user-content-added" class="anchor" href="#added" aria-hidden="true"></a>Added</h3>
<ul data-sourcepos="5:1-8:0" dir="auto">
<li data-sourcepos="5:1-5:107">Experimental support added for ASCAT Level 1 SZF, SZO, SZR Climate Data Record Release 2 - Metop products</li>
<li data-sourcepos="6:1-6:56">Support for MSGCLTH (EO:EUM:DAT:MSG:CTH) product added</li>
<li data-sourcepos="7:1-8:0">Specified limitations in support of GRAS, MTP15 products</li>
</ul>
<h3 data-sourcepos="9:1-9:11" dir="auto">
<a id="user-content-changed" class="anchor" href="#changed" aria-hidden="true"></a>Changed</h3>
<ul data-sourcepos="11:1-13:0" dir="auto">
<li data-sourcepos="11:1-11:40">Updated TLS to non-deprecated versions</li>
<li data-sourcepos="12:1-13:0">Improved GUI representation of long lists of items</li>
</ul>
<h3 data-sourcepos="14:1-14:9" dir="auto">
<a id="user-content-fixed" class="anchor" href="#fixed" aria-hidden="true"></a>Fixed</h3>
<ul data-sourcepos="16:1-23:109" dir="auto">
<li data-sourcepos="16:1-16:71">WebUI of desktop installation for Windows OS is now working correctly</li>
<li data-sourcepos="17:1-17:64">Data Tailor installation on Windows OS is now working properly</li>
<li data-sourcepos="18:1-18:60">Quicklook option now does not make the HRV processing fail</li>
<li data-sourcepos="19:1-19:69">Fixed the download of job outputs composed of a big number of files</li>
<li data-sourcepos="20:1-20:79">Customisations producing fixed output filenames return now consistent results</li>
<li data-sourcepos="21:1-21:57">Ensure requests in queue do not stay on inactive status</li>
<li data-sourcepos="22:1-22:73">GDAL commands are now correctly displayed in the customisation log-file</li>
<li data-sourcepos="23:1-23:109">Correct geolocalisation of MSG2-RSS data when native format is geographically re-projected to NetCDF output</li>
</ul>2022-01-25T08:09:38Zm.bottaccio@bopen.euhttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.12.02.12.0<h3 data-sourcepos="1:1-1:9" dir="auto">
<a id="user-content-added" class="anchor" href="#added" aria-hidden="true"></a>Added</h3>
<ul data-sourcepos="3:1-4:0" dir="auto">
<li data-sourcepos="3:1-4:0">Heartbeat mechanism introduced to improve process status monitoring (#912)</li>
</ul>
<h3 data-sourcepos="5:1-5:11" dir="auto">
<a id="user-content-changed" class="anchor" href="#changed" aria-hidden="true"></a>Changed</h3>
<ul data-sourcepos="7:1-12:0" dir="auto">
<li data-sourcepos="7:1-7:45">Improved status messages and reports (#934)</li>
<li data-sourcepos="8:1-8:71">Updated installer with new dependency management system (#933) (#932)</li>
<li data-sourcepos="9:1-9:52">Logout text displayed in normal case on GUI (#866)</li>
<li data-sourcepos="10:1-10:85">NetCDF-4 types renamed as "NetCDF4 (Data Centre)" and "NetCDF4 (simplified)" (#904)</li>
<li data-sourcepos="11:1-12:0">Performance updates on the WGSI server (#948)</li>
</ul>
<h3 data-sourcepos="13:1-13:9" dir="auto">
<a id="user-content-fixed" class="anchor" href="#fixed" aria-hidden="true"></a>Fixed</h3>
<ul data-sourcepos="15:1-20:0" dir="auto">
<li data-sourcepos="15:1-15:91">UI state display not freezing anymore when killing multiple customisations at once (#927)</li>
<li data-sourcepos="16:1-16:79">Improved clean-up mechanism to avoid leftover files in user workspaces (#937)</li>
<li data-sourcepos="17:1-17:79">Cancellation of submitted customisations is now working properly (#926, #940)</li>
<li data-sourcepos="18:1-18:98">Progress estimation from log-file now reflecting the actual customisation progress status (#919)</li>
<li data-sourcepos="19:1-20:0">Remove potential security issues when submitting basket XML (#945)</li>
</ul>
<h3 data-sourcepos="21:1-21:11" dir="auto">
<a id="user-content-removed" class="anchor" href="#removed" aria-hidden="true"></a>Removed</h3>
<ul data-sourcepos="23:1-23:69" dir="auto">
<li data-sourcepos="23:1-23:69">MTG-IRS products removed from the list of supported products (#840)</li>
</ul>2021-07-09T07:54:42Zm.bottaccio@bopen.euhttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.11.02.11.0<p data-sourcepos="1:1-1:58" dir="auto">Highlights (see the changelog for the full change record):</p>
<h3 data-sourcepos="3:1-3:9" dir="auto">
<a id="user-content-added" class="anchor" href="#added" aria-hidden="true"></a>Added</h3>
<ul data-sourcepos="4:1-7:0" dir="auto">
<li data-sourcepos="4:1-4:51">Implemented xRIT channel segment selection (#897)</li>
<li data-sourcepos="5:1-5:115">Allow for GEO products the ROI extraction if the input data specifies or known to be in a known projection (#885)</li>
<li data-sourcepos="6:1-7:0">Re-projection by chunks for ASCATL1SZO and ASCATL1SZR full orbit products (#825)</li>
</ul>
<h3 data-sourcepos="8:1-8:11" dir="auto">
<a id="user-content-changed" class="anchor" href="#changed" aria-hidden="true"></a>Changed</h3>
<ul data-sourcepos="9:1-13:0" dir="auto">
<li data-sourcepos="9:1-9:49">Improve error information shown to users (#883)</li>
<li data-sourcepos="10:1-10:60">Improvements in the way static resources are served (#882)</li>
<li data-sourcepos="11:1-11:62">Updated product discovery after Data Store API change (#847)</li>
<li data-sourcepos="12:1-13:0">Data Tailor version always discoverable (#836)</li>
</ul>
<h3 data-sourcepos="14:1-14:9" dir="auto">
<a id="user-content-fixed" class="anchor" href="#fixed" aria-hidden="true"></a>Fixed</h3>
<ul data-sourcepos="15:1-15:77" dir="auto">
<li data-sourcepos="15:1-15:77">Webapp not displaying a proper error when a download operation fails (#873)</li>
</ul>2021-05-06T15:54:22ZDaniel Leehttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.10.02.10.0<p data-sourcepos="1:1-1:58" dir="auto">Highlights (see the changelog for the full change record):</p>
<h1 data-sourcepos="3:1-3:7" dir="auto">
<a id="user-content-added" class="anchor" href="#added" aria-hidden="true"></a>Added</h1>
<ul data-sourcepos="5:1-12:0" dir="auto">
<li data-sourcepos="5:1-5:67">Add UMARF plugins to installer constructor and pipelines (#823)</li>
<li data-sourcepos="6:1-6:60">Provided descriptions for OpenAPI specs definitions (#808)</li>
<li data-sourcepos="7:1-7:73">Deploy native to HRIT conda package to EUMETSAT conda repository (#803)</li>
<li data-sourcepos="8:1-8:103">Added capability to register Custom Plugins with pluggable configuration, products and formats (#802)</li>
<li data-sourcepos="9:1-9:121">Added support for multiple products and formats, for integration EUMETSAT Prototype Satellite Data Cube plugin (#796)</li>
<li data-sourcepos="10:1-10:94">Introduced mechanism signaling any ongoing or planned maintenance issues to GUI users (#771)</li>
<li data-sourcepos="11:1-12:0">HRV to netCDF conversion: Providing calibration data (#442)</li>
</ul>
<h1 data-sourcepos="13:1-13:9" dir="auto">
<a id="user-content-changed" class="anchor" href="#changed" aria-hidden="true"></a>Changed</h1>
<ul data-sourcepos="15:1-22:0" dir="auto">
<li data-sourcepos="15:1-15:58">Adapt DTWS dockerfile to execute commands as user (#853)</li>
<li data-sourcepos="16:1-16:77">Temporarily remove support for MTG IRS L1 as format is being updated (#840)</li>
<li data-sourcepos="17:1-17:107">Removing also the processing-dir (if any) when a customisation is deleted by user or administrator (#837)</li>
<li data-sourcepos="18:1-18:48">Optimised loading of status pane in GUI (#751)</li>
<li data-sourcepos="19:1-19:49">Projection and ROI enhancements from GUI (#597)</li>
<li data-sourcepos="20:1-20:55">Show feedback for uploading shapefile from GUI (#596)</li>
<li data-sourcepos="21:1-22:0">Input products downloaded from the Data Store are now automatically removed as the customisation ends (#775)</li>
</ul>
<h3 data-sourcepos="23:1-23:11" dir="auto">
<a id="user-content-removed" class="anchor" href="#removed" aria-hidden="true"></a>Removed</h3>
<ul data-sourcepos="24:2-25:0" dir="auto">
<li data-sourcepos="24:2-25:0">Removed check_olda_cache option as Data Store input products are now downloaded in temporary processing_dir (#775)</li>
</ul>
<h1 data-sourcepos="26:1-26:7" dir="auto">
<a id="user-content-fixed" class="anchor" href="#fixed" aria-hidden="true"></a>Fixed</h1>
<ul data-sourcepos="28:1-40:82" dir="auto">
<li data-sourcepos="28:1-28:91">Ensure netcdf-satellite output files can correctly be downloaded from GUI via DTWS (#865)</li>
<li data-sourcepos="29:1-29:45">Fix 50-x service pages configuration (#854)</li>
<li data-sourcepos="30:1-30:109">Conversion of full-orbit AVHRRL1 to EPS-native fixed in DTWS as ROI tab now enabled with roi_by_time (#832)</li>
<li data-sourcepos="31:1-31:110">Sanitise inputs casting ROI boundary values to float before saving them in processing_info dictionary (#798)</li>
<li data-sourcepos="32:1-32:47">Native HRV to HRIT now works correctly (#794)</li>
<li data-sourcepos="33:1-33:61">Native to netCDF did not preserve metadata correctly (#793)</li>
<li data-sourcepos="34:1-34:104">Ensure previously active fair queuing user cap mechanism is not applied anymore when turned off (#782)</li>
<li data-sourcepos="35:1-35:106">HRSEVIRI 1.5 data - ToolsUI, Panoply, & IDV could not find coordinates after converting to netCDF (#759)</li>
<li data-sourcepos="36:1-36:115">Sanitised configuration reading so that temporary configuration files are not copied to user configuration (#748)</li>
<li data-sourcepos="37:1-37:77">Fix handling of empty uuids set within Delete customisation requests (#727)</li>
<li data-sourcepos="38:1-38:52">Avoid truncated information in GUI Log Pane (#709)</li>
<li data-sourcepos="39:1-39:112">Bug fix: ASCATL1SZ0 and ASCAL1SZR longitude coordinates converted to +/-180 degrees to be read by GDAL (#587)</li>
<li data-sourcepos="40:1-40:82">ROI by sensing time not available if feature does not contain roi_by_time (#560)</li>
</ul>2021-04-06T11:54:05ZDaniel Leehttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.9.02.9.0<p data-sourcepos="1:1-1:58" dir="auto">Highlights (see the changelog for the full change record):</p>
<h1 data-sourcepos="3:1-3:7" dir="auto">
<a id="user-content-added" class="anchor" href="#added" aria-hidden="true"></a>Added</h1>
<ul data-sourcepos="5:1-8:0" dir="auto">
<li data-sourcepos="5:1-5:42">Add HRSEVIRI archive product type (#730)</li>
<li data-sourcepos="6:1-6:68">Test and document customisation timeout functionality (#666, #674)</li>
<li data-sourcepos="7:1-8:0">Allow manual deployment to EUMETSAT conda channel and use it in installs (#558)</li>
</ul>
<h1 data-sourcepos="9:1-9:9" dir="auto">
<a id="user-content-changed" class="anchor" href="#changed" aria-hidden="true"></a>Changed</h1>
<ul data-sourcepos="11:1-17:0" dir="auto">
<li data-sourcepos="11:1-11:41">Reformat creation of dask client (#732)</li>
<li data-sourcepos="12:1-12:119">Improve api.ensure_config to avoid rereading configuration when API function calls internally another function (#729)</li>
<li data-sourcepos="13:1-13:68">Updated launching scheduler service with Data Tailor plugin (#677)</li>
<li data-sourcepos="14:1-14:77">Moved support functions from api.py to a new dedicated python module (#664)</li>
<li data-sourcepos="15:1-15:59">Long-queued customisations fail when token expires (#549)</li>
<li data-sourcepos="16:1-17:0">Split epct_restapi/<strong data-sourcepos="16:22-16:29">init</strong>.py in separate python files to improve code readability and efficiency (#467)</li>
</ul>
<h1 data-sourcepos="18:1-18:7" dir="auto">
<a id="user-content-fixed" class="anchor" href="#fixed" aria-hidden="true"></a>Fixed</h1>
<ul data-sourcepos="20:1-28:107" dir="auto">
<li data-sourcepos="20:1-20:41">Timeout scheduler leaking memory (#731)</li>
<li data-sourcepos="21:1-21:44">Xrit DT plugin missing output files (#726)</li>
<li data-sourcepos="22:1-22:50">Add test data fom rect2lpToOpenMTP plugin (#723)</li>
<li data-sourcepos="23:1-23:60">Fixed and improved tests for manual killing process (#675)</li>
<li data-sourcepos="24:1-24:46">Clean scheduler plugin swap variables (#672)</li>
<li data-sourcepos="25:1-25:30">report_quota path fix (#636)</li>
<li data-sourcepos="26:1-26:36">ELK stack fixes and testing (#635)</li>
<li data-sourcepos="27:1-27:84">Fix bug as some IASISND02 products generated an error during the processing (#616)</li>
<li data-sourcepos="28:1-28:107">Improved validity check fixing error arising when basket config address used as input product path (#456)</li>
</ul>2020-12-14T15:00:56ZDaniel Leehttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.8.12.8.1<p data-sourcepos="1:1-1:58" dir="auto">Highlights (see the changelog for the full change record):</p>
<h1 data-sourcepos="2:1-2:7" dir="auto">
<a id="user-content-added" class="anchor" href="#added" aria-hidden="true"></a>Added</h1>
<ul data-sourcepos="3:1-10:0" dir="auto">
<li data-sourcepos="3:1-3:109">Added the possibility to specify the path to general configuration folder via environmental variable (#606)</li>
<li data-sourcepos="4:1-4:47">Added nginx caching of JS, CSS to DTWS (#571)</li>
<li data-sourcepos="5:1-5:55">Enforced a configurable customisation time-out (#545)</li>
<li data-sourcepos="6:1-6:48">Allowing users to housekeep their space (#544)</li>
<li data-sourcepos="7:1-7:47">Installation without internet on Linux (#540)</li>
<li data-sourcepos="8:1-8:67">DTWS: enforced a configurable timeout on long-running jobs (#465)</li>
<li data-sourcepos="9:1-10:0">DTWS: implemented the ability to monitor and control working nodes (#431)</li>
</ul>
<h1 data-sourcepos="11:1-11:7" dir="auto">
<a id="user-content-fixed" class="anchor" href="#fixed" aria-hidden="true"></a>Fixed</h1>
<ul data-sourcepos="12:1-16:0" dir="auto">
<li data-sourcepos="12:1-12:85">Preventing re-projecting geostationary products to geostationary projections (#688)</li>
<li data-sourcepos="13:1-13:30">Active user detection (#655)</li>
<li data-sourcepos="14:1-14:92">Deleting a process not working if generic username used in deployment style desktop (#641)</li>
<li data-sourcepos="15:2-16:0">Reliable kill processes in DTWS (#639)</li>
</ul>
<h1 data-sourcepos="17:1-17:9" dir="auto">
<a id="user-content-changed" class="anchor" href="#changed" aria-hidden="true"></a>Changed</h1>
<ul data-sourcepos="18:1-20:67" dir="auto">
<li data-sourcepos="18:1-18:73">Making the dask dashboard of the DTWS accessible and informative (#659)</li>
<li data-sourcepos="19:1-19:78">Restructured DTWS fair queuing logic and handling of exceptions (#632, #633)</li>
<li data-sourcepos="20:1-20:67">Webapp GUI changes for admin user to manage customisations (#600)</li>
</ul>2020-12-03T08:59:40ZDaniel Leehttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.7.12.7.1<p data-sourcepos="1:1-1:144" dir="auto">Changes introduced in this release are detailed in <a data-sourcepos="1:52-1:143" href="https://gitlab.eumetsat.int/open-source/data-tailor/-/blob/2.7.1/CHANGES.md">the changelog</a>.</p>
<p data-sourcepos="3:1-3:104" dir="auto">To install, we recommend using the pre-built conda packages that are attached to this release as assets.</p>2020-10-12T09:25:11Zm.bottaccio@bopen.euhttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.6.02.6.0<p data-sourcepos="1:1-1:144" dir="auto">Changes introduced in this release are detailed in <a data-sourcepos="1:52-1:143" href="https://gitlab.eumetsat.int/open-source/data-tailor/-/blob/2.6.0/CHANGES.md">the changelog</a>.</p>
<p data-sourcepos="3:1-3:70" dir="auto">To install, we recommend using the following pre-built conda packages:</p>
<ul data-sourcepos="4:1-5:100" dir="auto">
<li data-sourcepos="4:1-4:96"><a data-sourcepos="4:3-4:96" href="/open-source/data-tailor/uploads/55459ca735346fd419e9df8d6da02ff2/linux-conda-packages.zip" data-canonical-src="/uploads/55459ca735346fd419e9df8d6da02ff2/linux-conda-packages.zip" data-link="true" class="gfm">linux-conda-packages.zip</a></li>
<li data-sourcepos="5:1-5:100"><a data-sourcepos="5:3-5:100" href="/open-source/data-tailor/uploads/5d5d18dfa8c876e6f633c31f9b487702/windows-conda-packages.zip" data-canonical-src="/uploads/5d5d18dfa8c876e6f633c31f9b487702/windows-conda-packages.zip" data-link="true" class="gfm">windows-conda-packages.zip</a></li>
</ul>2020-08-14T13:06:42ZMarco Di Barihttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.4.02.4.0Daniel Leehttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.3.02.3.0Daniel Leehttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.2.02.2.0Daniel Leehttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.1.02.1.0Daniel Leehttps://gitlab.eumetsat.int/open-source/data-tailor/-/tags/2.0.02.0.0Maurizio Bottaccio