|
| 1 | +--- |
| 2 | +layout: page |
| 3 | +title: SystemDS 3.3.0 Release Notes |
| 4 | +description: Project Release Notes |
| 5 | +group: nav-right |
| 6 | +--- |
| 7 | +<!-- |
| 8 | +{% comment %} |
| 9 | +Licensed to the Apache Software Foundation (ASF) under one or more |
| 10 | +contributor license agreements. See the NOTICE file distributed with |
| 11 | +this work for additional information regarding copyright ownership. |
| 12 | +The ASF licenses this file to you under the Apache License, Version 2.0 |
| 13 | +(the "License"); you may not use this file except in compliance with |
| 14 | +the License. You may obtain a copy of the License at |
| 15 | +
|
| 16 | +http://www.apache.org/licenses/LICENSE-2.0 |
| 17 | +
|
| 18 | +Unless required by applicable law or agreed to in writing, software |
| 19 | +distributed under the License is distributed on an "AS IS" BASIS, |
| 20 | +WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| 21 | +See the License for the specific language governing permissions and |
| 22 | +limitations under the License. |
| 23 | +{% endcomment %} |
| 24 | +--> |
| 25 | + |
| 26 | +<section class="full-stripe full-stripe--subpage-header clear-header"> |
| 27 | + <div class="ml-container ml-container--horizontally-center"> |
| 28 | + <div class="col col-12 content-group content-group--center-content content-group--center-align"> |
| 29 | + <h1>{{ site.data.project.name }} 3.3.0 Release Notes</h1> |
| 30 | + </div> |
| 31 | + </div> |
| 32 | +</section> |
| 33 | + |
| 34 | +<section class="full-stripe full-stripe--alternate"> |
| 35 | + <div class="ml-container"> |
| 36 | + <div class="col col-12 content-group content-group--medium-bottom-margin" markdown="1"> |
| 37 | + |
| 38 | +## Release notes for SystemDS 3.3.0 |
| 39 | + |
| 40 | +SystemDS 3.3 is a minor release. Release 3.3 contains new features and major improvements to existing features. |
| 41 | + |
| 42 | +### New Features |
| 43 | + |
| 44 | +#### Built-in Functions |
| 45 | +- Added `sliceLineExtract` for efficient slicing operations. |
| 46 | +- Introduced `adasyn` for synthetic data generation in imbalanced datasets. |
| 47 | +- Added `GELU Activation Function` (approximation) for deep learning tasks. |
| 48 | +- New built-in for `vectorized simple exponential smoothing`. |
| 49 | +- **Python API Enhancements**: |
| 50 | + - Added built-ins for `solve`, `median`, `quantile`, `lu`, `qr`, `cov`, and more. |
| 51 | + - Introduced cumulative aggregate functions like `cumsum`, `cumprod`, etc. |
| 52 | + - Added support for matrix operations like `diag`, `trace`, `sqrt`, `exp`, `floor`, and `ceil`. |
| 53 | + |
| 54 | +#### Performance Enhancements |
| 55 | +- Optimized matrix multiplication, including multi-threaded dot-product operations. |
| 56 | +- Improved performance for CSV and MatrixMarket readers with parallelism. |
| 57 | +- Enhanced incremental slice-line pruning for better efficiency. |
| 58 | +- Optimized federated operations with improved threading and cost estimation. |
| 59 | + |
| 60 | +#### Federated Learning |
| 61 | +- Fixed threading bugs in federated operations. |
| 62 | +- Improved federated planner memoization and added support for weighted covariance. |
| 63 | + |
| 64 | +#### Compression |
| 65 | +- Introduced workload-aware compression for intermediates. |
| 66 | +- Enhanced compressed matrix operations with new tests and optimizations. |
| 67 | + |
| 68 | +#### Scuro Framework |
| 69 | +- Added support for multi-head attention layers and LSTM representations. |
| 70 | +- Introduced new modalities and data representations for Scuro. |
| 71 | + |
| 72 | +### Bug Fixes |
| 73 | +- Fixed robustness issues in built-in functions: |
| 74 | + - Corrected `trace` handling for non-square matrices. |
| 75 | + - Fixed `seq()` length computation for edge cases. |
| 76 | + - Resolved issues in `transformencode` for federated backends. |
| 77 | +- Addressed edge cases in matrix operations: |
| 78 | + - Sparse-dense matrix multiplication. |
| 79 | + - Incremental slice-line pruning. |
| 80 | +- Fixed federated operation bugs: |
| 81 | + - Improved robustness for federated weighted covariance. |
| 82 | + - Resolved flaky tests in federated primitives. |
| 83 | + |
| 84 | +### Code Quality and Testing |
| 85 | +- Improved test coverage: |
| 86 | + - Simplification rewrites, federated operations, and Python APIs. |
| 87 | + - Added new tests for matrix operations and compression. |
| 88 | +- Refactored and cleaned up code for better maintainability and performance. |
| 89 | + |
| 90 | +### Documentation |
| 91 | +- Updated Python API documentation with examples for new built-ins. |
| 92 | +- Improved overall documentation for better usability. |
| 93 | + |
| 94 | +### Dependency Updates |
| 95 | +- Updated library versions and dependencies: |
| 96 | + - Bumped `codecov-action` to the latest version. |
| 97 | + - Updated other dependencies for compatibility and security. |
| 98 | + |
| 99 | +### Miscellaneous |
| 100 | +- Added new rewrite rules for simplifications: |
| 101 | + - `pushdown-sum` and `rm-reorg` for better performance. |
| 102 | +- Introduced new I/O support for cloud-optimized GeoTIFF files. |
| 103 | +- Added new determinant function and kernels for matrix operations. |
0 commit comments