## Release announcements * [YugabyteDB 2.20 Unveiled: Elevating Change Data Capture for Cloud Native Applications](https://www.yugabyte.com/blog/release-220-announcement/) ## Release notes {{< tip title="LTS - Feature availability" >}} All features in stable releases are considered to be {{}} unless marked otherwise. {{< /tip >}} What follows are the release notes for the YugabyteDB v2.20 release series. Content will be added as new notable features and changes are available in the patch releases of the YugabyteDB v2.20 release series. For an RSS feed of all release series to track the latest product updates, point your feed reader to the [RSS feed for releases](../index.xml). {{< warning title="Technical Advisories" >}} * Impacts: v2.20.0.0 to 2.20.1.2 - {{}} - Index update can be wrongly applied on batch writes * Impacts: v2.20.1.0 to 2.20.1.3 - {{}} - Correctness issue for queries using SELECT DISTINCT {{< /warning >}} ## v2.20.12.0 - October 6, 2025 {#v2.20.12.0} **Build:** `2.20.12.0-b30` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.12.0/yugabytedb-2.20.12.0-b30-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.12.0/yugabytedb-anywhere-2.20.12.0-b30-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.12.0-b30 ``` ### Improvements #### YSQL * Ensures all `COPY FROM` commands in a transaction block use one transaction unit. {{}} #### DocDB * Adds data block consistency check to `sst_dump` tool. {{}} * Adds flag to allow tablet writes after a compaction failure. {{}} * Adds `remove_corrupt_data_blocks_unsafe` flag for `yb-ts-cli compact_tablet` command. {{}} * Ensures only voter peers are considered for leadership during a leader stepdown. {{}} * Fixes overflow in `FormatBytesAsStr` to prevent large memory allocations. {{}} * Upgrades OpenSSL to version 3.0.16 and enhances aarch64 support. {{}} ### Bug fixes #### YSQL * Ensures secondary index scans remain consistent during concurrent deletes in YSQL. {{}} * Reverts a previous update to stabilize `INSERT ON CONFLICT` features on partitioned tables. {{}} * Ensures accurate EXPLAIN output for forward scans with aggregate pushdown. {{}} * Eliminates spurious "Attempted to restart" errors during multi-page reads. {{}} * Ensures the correct renew strategy for `IsRenewRequired` works as expected. {{}} #### DocDB * Ensures accurate replication for transactional writes on xCluster range partitioned tables. {{}} * Ensures post-split compactions complete even if background compactions are in progress. {{}} * Ensures consistent data reads by setting propagated safe time only after successful operation replication. {{}} * Prevents incorrect query results due to invalid seek keys in internal iterator operations. {{}} * Enhances the stability of document reads by validating key prefixes before processing. {{}} * Adjusts `DocRowwiseIterator` to correctly include nulls for `NULLS FIRST` sorting. {{}} * Ensures tablets remain effectively managed during transition from RF1 to higher replication factors. {{}} * Replaces the deprecated `exec_program` command with `execute_process` in CMake, resolving issue 20481 and eliminating potential warning CMP0153 for developers. {{}} ## v2.20.11.1 - July 14, 2025 {#v2.20.11.1} **Build:** `2.20.11.1-b2` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.11.1/yugabytedb-2.20.11.1-b2-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.11.1/yugabytedb-anywhere-2.20.11.1-b2-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.11.1-b2 ``` ### Bug fix #### YSQL * Eliminates spurious ""Attempted to restart"" errors during multi-page reads. {{}} ## v2.20.11.0 - July 2, 2025 {#v2.20.11.0} **Build:** `2.20.11.0-b34` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.11.0/yugabytedb-2.20.11.0-b34-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.11.0/yugabytedb-anywhere-2.20.11.0-b34-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.11.0-b34 ``` ### Improvements #### YSQL * Enhances error reporting by including index names for missing rows. {{}} #### YCQL * Allows setting NULL in YCQL JSONB column values using UPDATE statements. {{}} #### DocDB * Upgrades OpenSSL to version 3.0.16, maintaining FIPS at 3.0.8. {{}} * Deprecates the `load_balancer_count_move_as_add` flag to simplify cluster balancing. {{}} ### Bug fixes #### YSQL * Reduces XID usage by generating one per `REFRESH MATERIALIZED VIEW CONCURRENTLY` operation. {{}} * Ensures consistent collation behavior between YSQL and DocDB by aligning default settings and adjusting expression pushdown rules. {{}} * Ensures correct column mapping for partitioned tables during `INSERT ON CONFLICT` updates. {{}},{{}} * Prevents crashes by handling non-variable expressions in single-row updates or deletes. {{}} * Enhances `yb_index_check` to verify materialized view indexes' consistency. {{}} * Ensures `ysql_dump` maintains enum sort order during backup and restore. {{}} * Allows restoration of old backups with enum types without errors by reverting to warnings and auto-generated OIDs. {{}} * Logs odd `pg_enum` OID during restore if `sortorder` is missing, enhancing troubleshooting. {{}} #### DocDB * Ensures accurate replication for transactional writes on xCluster range partitioned tables. {{}} * Ensures all transaction batches update schema versions, preventing data readability issues from aggressive metadata cleanup. {{}} * Fixes handling of `db_max_flushing_bytes` to properly limit memory usage under high write loads. {{}} * Prevents data loss by ensuring databases are flushed before updating flush markers. {{}} * Prevents deadlocks during background compaction and transaction loading. {{}} * Prevents duplicate connection destruction attempts during concurrent failures. {{}} #### CDC * Ensures only relevant `COMMIT` records are streamed, fixing gRPC connector crashes. {{}} * Prevents CDC crashes by logging a warning for dropped indexes on colocated tables. {{}} #### yugabyted * Preserves the universe key locally after enabling EAR for recovery scenarios. {{}} ## v2.20.10.0 - April 1, 2025 {#v2.20.10.0} **Build:** `2.20.10.0-b29` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.10.0/yugabytedb-2.20.10.0-b29-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.10.0/yugabytedb-anywhere-2.20.10.0-b29-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.10.0-b29 ``` ### Improvements #### YSQL * Ensures cached plans correctly depend on user roles, addressing {{}}. {{}} ### Bug fixes #### YSQL * Ensures Batched Nested Loop joins correctly check for hashable join clauses. {{}} * Fixes data race in regex pushdown by using thread-local variables. {{}} * Fixes incorrect aggregate column references in flattened subqueries. {{}} * Enhances regex to correctly identify test names with dots in Java PG regress tests. {{}} * Enhances index scans and partition pruning for BOOLEAN conditions. {{}} #### DocDB * Adds mtime and checksum to block cache key prefix to prevent conflicts. {{}} * Enhances transactional xCluster accuracy by using majority replicated OpId for ApplySafeTime calculations. {{}} * Prevents crash during transaction abort by adjusting lock handling. {{}} * Prevents false conflict detection in snapshot isolation operations. {{}} ## v2.20.9.0 - January 28, 2025 {#v2.20.9.0} **Build:** `2.20.9.0-b47` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.9.0/yugabytedb-2.20.9.0-b47-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.9.0/yugabytedb-anywhere-2.20.9.0-b47-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.9.0-b47 ``` ### Improvements #### YSQL * Enhances initdb logging, correctly handles process termination, and fixes memory leaks on abort signals. {{}} * Prevents catalog version bumps on no-op ALTER ROLE commands, saving system resources. {{}} #### YCQL * Tracks microsecond precision timestamps in YCQL with new metric `cql_microseconds_timestamps_used`. This tracking occurs if the `cql_revert_to_partial_microsecond_support` flag is true. {{}} #### DocDB * Limits concurrent remote bootstraps per TServer using `load_balancer_max_inbound_remote_bootstraps_per_tserver` flag. {{}} * Reduces unnecessary attribute map creations during Prometheus metric aggregation. {{}} * Enhances RBS throttling by focusing on active fetch sessions and adjusts expiration logic. {{}},{{}} * Introduces limits on Prometheus metric entries per scrape to prevent server overload. {{}} * Enhances stability by fixing a missing null check in tablet lookup processes. {{}} #### CDC * Automatically removes metrics when a CDC stream is deleted. {{}} ### Bug fixes #### YSQL * Reduces memory usage during YugabyteDB connection startup. {{}} * Fixes foreign key checks to avoid errors with unique indexes. {{}} * Reduces memory usage spikes by using a new memory context for `RelationBuildTriggers`. {{}} * Ensures accurate catalog version tracking during concurrent index creation. {{}} * Fixes inconsistency in index entries during concurrent writes in the backfill phase. {{}} * Automatically restarts the postmaster to prevent stuck processes when a background worker crashes. {{}} #### YCQL * Allows users to control error suppression for GROUP BY in YCQL using `ycql_ignore_group_by_error` flag. {{}} #### DocDB * TServers now reject remote bootstrap requests for previously deleted tablets. {{}} * Sets a default 10MB max size for RocksDB MANIFEST files, now configurable via flags. {{}} * Enhances visibility for unexpected rate limiter sleep times in RBS threads. {{}} * Prevents crashes when calling `ListMasterServers` RPC on a master by returning an error. {{}} * Ensures continuous xCluster task operation even if the master temporarily loses the lease but retains leadership. {{}} * Prevents crashes during compaction when `ysql_enable_packed_row` is off and existing packed rows are present. {{}} * Fixes error for select queries in large tables by adjusting backward scan bounds. {{}} * Ensures consistency between `Slice::Less` and `Slice::compare` methods. {{}} * Fixes shutdown path issues to prevent fatal errors during RPC completion. {{}} * Fixes metric attribute collisions and ensures correct metric types for tablets. {{}} * Prevents TServer crashes on executing specific queries by handling NULL pointers effectively. {{}} #### CDC * Excludes expired or irrelevant entries from metrics calculations for more accurate reporting. {{}} * Ensures accurate history retention for various replica identities in CDC. {{}} ## v2.20.8.1 - December 16, 2024 {#v2.20.8.1} **Build:** `2.20.8.1-b2` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.8.1/yugabytedb-2.20.8.1-b2-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.8.1/yugabytedb-anywhere-2.20.8.1-b2-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.8.1-b2 ``` This is a YugabyteDB Anywhere-only release, with no significant changes to YugabyteDB. ## v2.20.8.0 - December 2, 2024 {#v2.20.8.0} **Build:** `2.20.8.0-b53` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.8.0/yugabytedb-2.20.8.0-b53-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.8.0/yugabytedb-anywhere-2.20.8.0-b53-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.8.0-b53 ``` ### New features #### CDC * Enables tablet splitting on tables under CDCSDK stream by default using the GFLAG `enable_tablet_split_of_cdcsdk_streamed_tables`. {{}} ### Improvements #### YSQL * Allows preloading of foreign key lists in relcache, avoiding on-demand master fetches, controlled by `yb_enable_fkey_catcache`. {{}} * Reduces the YSQL catalog lease period to 10 seconds with a new flag `master_ts_ysql_catalog_lease_ms` improving response times during master leader changes and minimizing disruptions. {{}} #### YCQL * Resolves timestamp precision mismatches in YCQL, aligning inserts and index scans to millisecond precision. {{}},{{}} #### DocDB * Allows reduction of thread stack size to avoid Linux hugepage backing. {{}} * Blocks writes based on total bytes being flushed, not just memtable count. {{}} * Enhances load balancer to prioritize under-replicated tablets first. {{}} * Prevents overloading by correctly categorizing bootstrapping tablets in load balancing. {{}} * Upgrades non-FIPS OpenSSL to 3.0.15 and removes CentOS 7 builds. {{}} * Allows explicit addition of gFlags to `gflag_allowlist.txt` for secure callhome data collection, plus `version_info` in TServer data. {{}} ### Bug fixes #### YSQL * Modifies backup/restore process to skip column name checks for indexes, allowing for successful restoration even with renamed columns. {{}} * Enhances Postgres restart stability by refining shutdown handling and lock file management. Includes killing only Postgres-associated PIDs, using `SIGQUIT` for immediate shutdowns to reduce hang-ups, and monitoring for stuck processes on macOS {{}} * Fixes crashes caused by using a RowComparisonExpression on a reordered primary key index. {{}} * Streamlines ysql_dump process by eliminating faulty statements for colocated table unique constraint, enhancing database reliability. {{}} * Alters encoding setup order to ensure `UTF8` use instead of `SQL_ASCII` and adds `pg_collation` to preloaded tables to prevent specific errors. {{}} * Adds HELP and TYPE metadata for each metric in the YSQL Prometheus metrics endpoint for better metrics accessibility. {{}} * Prevents a possible system crash in YSQL backends manager by ensuring essential checks are in place before using the job database object. {{}} * Reduces PostgreSQL connection startup timeouts in geo-distributed clusters with a new `wait_for_ysql_backends_catalog_version_master_tserver_rpc_timeout_ms` GFlag, increasing the default timeout value to 60s from 30s. This alteration only impacts one specific RPC - WaitForYsqlBackendsCatalogVersion, not all RPCs, which should diminish time-out incidents. {{}} * Minimizes CREATE INDEX delays during master leader changes or cluster startups by ensuring the new master leader waits 10 seconds before serving YSQL Backends Catalog requests after startup or leader change. {{}} * Enhances performance during nested loop joins by ensuring correct limit resets in colocated index scans. {{}} * Reduces memory usage spikes by using a new memory context for `RelationBuildTriggers`. {{}} #### YCQL * Eliminates unexpected error during shell type definition update across multiple sessions. {{}} #### DocDB * Prevents tablet bootstrap from getting stuck when replaying a truncate operation. {{}} * Allows the packed row size to exceed its limit during repacking, preventing TServer crash after `alter table add column` commands with a default value. {{}} * Delays `min_running_ht` initialization until after tablet bootstrap completes. {{}} * Prevents incorrect marking of tablets as over-replicated during startup. {{}} ## v2.20.7.2 - November 22, 2024 {#v2.20.7.2} **Build:** `2.20.7.2-b1` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.7.2/yugabytedb-2.20.7.2-b1-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.7.2/yugabytedb-anywhere-2.20.7.2-b1-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.7.2-b1 ``` ### Bug fix #### YSQL * Reduces memory usage spikes by using a new memory context for `RelationBuildTriggers`. {{}} ## v2.20.7.1 - October 16, 2024 {#v2.20.7.1} **Build:** `2.20.7.1-b10` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.7.1/yugabytedb-2.20.7.1-b10-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.7.1/yugabytedb-anywhere-2.20.7.1-b10-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.7.1-b10 ``` ### Improvements #### DocDB * Allows reduction of thread stack size to avoid Linux huge page backing. {{}} ### Bug fixes #### DocDB * Allows the packed row size to exceed its limit during repacking, preventing TServer crash after `alter table add column` commands with a default value. {{}} ## v2.20.7.0 - September 30, 2024 {#v2.20.7.0} **Build:** `2.20.7.0-b58` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.7.0/yugabytedb-2.20.7.0-b58-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.7.0/yugabytedb-anywhere-2.20.7.0-b58-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.7.0-b58 ``` ### Improvements #### YSQL * Introduces the `yb_make_next_ddl_statement_nonincrementing` configuration parameter to reduce catalog version increments during many consecutive DDLs, lowering memory and latency spikes. {{}} * Added yb_make_next_ddl_statement_nonincrementing to YbDbAdminVariables for yb_db_admin role. {{}} #### YCQL * Updates YCQL tables `system_schema.functions` and `system_schema.aggregates` to align with Cassandra, aiding Cortex migration. {{}} #### DocDB * Enables reduction of duplicate code and custom flag filtering through `GetFlagInfos` relocation. {{}} * Adds `emergency_repair_mode` flag and yb-admin commands `dump_sys_catalog_entries` and `write_sys_catalog_entry` to address CatalogEntity data corruption issues. {{}} #### CDC * Allows dynamic table addition alongside table removal from CDC streams without needing to disable or restart. {{}} * Adds a yb-admin option to disable dynamic table addition when creating new streams. {{}} * Allows automatic cleanup for ineligible tables on CDC streams and improves the removal process by fetching tablet list from a local copy instead of the state table, improving performance. Updates include removal of flag protection for Step-1 and the replacement of the preview flag. {{}} * Enables asynchronous removal of user tables from CDC streams by adjusting how background threads process and persist stream metadata. {{}} #### yugabyted * Stops sending flag details in the callhome diagnostics to eliminate redundant data. {{}} #### Other * Updates the callhome URL to use HTTPS for enhanced security. {{}} ### Bug fixes #### YSQL * Fixes an issue related to regular expression pushdown causing inconsistency and crashes by introducing thread local cache. {{}} * Resets catalog read time after table prefetching to prevent outdated readings for on-demand loading from a master. {{}} * Corrects IndexScan's indextlist to improve accuracy of variable references in subquery scenarios. {{}} * Prevents retry of schema mismatch errors in batched execution mode to maintain transaction atomicity. {{}} * Resolves potential memory corruption by mutating pushdown expressions outside the per tuple context. {{}} * Replaces deprecated function `shared_ptr::unique` to resolve compilation errors on macOS. {{}} * Removes unnecessary DCHECK for smoother rolling upgrades from release 2.20, enhancing `ysql_enable_db_catalog_version_mode` flag functionality. {{}} #### DocDB * Limits response size by omitting per-object details from SysSnapshotEntryPB in ListSnapshotSchedules RPC. {{}} * Reduces the risk of deadlocks when making active read/write requests to a table right after a tablet-split. {{}} * Simplifies handling of large RPC responses by catching errors earlier and appropriately using `narrow_cast`. {{}} * Switches write query duration from `CoarseMonoClock` to `MonoClock` for precise nanosecond granularity. {{}} * Refactors to remove an assumption that every TServer hosts tablets, preventing crashes in certain circumstances. {{}} * Sets the `close_timestamp_micros` field for partially copied log segments to prevent time-based policy violation. {{}} * Eliminates persistent logging issue after dropping a colocated table by removing unnecessary logs. {{}} * Corrects leader balancing for geo-partitioned tables to prevent early exits and ensure accurate global leader sorting. {{}} #### CDC * Prevents TServer crash by giving each thread its own copy of `SchemaDetailsMap` during concurrent `GetChanges` calls. {{}},{{}} * Reduces disk IO overhead by optimizing the tablet-meta update process in CDCService. {{}} * Refactors CDCSDK to prevent data loss during workload with single shard transactions by ensuring WAL messages are committed before being replicated. {{}} * Introduces three new yb-admin commands for managing user tables in a CDC stream and addresses a race condition issue by removing an optimization in the `UpdateCheckpointForTabletEntriesInCDCState` method. {{}},{{}},{{}} * Obsoletes expired or unpolled tables from CDC stream and state table, reducing unnecessary resource retention and potential blocking of split tablet deletion. {{}} * Eliminates occurrence of master crashes after table drop by handling non-eligible tables cleanup in CDC stream loading. {{}} #### yugabyted * Offers corrected DB OID in the function `calculate_table_size`, now matching `YBCGetDatabaseOid(rel)` for improved reliability. {{}} ## v2.20.6.0 - August 23, 2024 {#v2.20.6.0} **Build:** `2.20.6.0-b66` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.6.0/yugabytedb-2.20.6.0-b66-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.6.0/yugabytedb-anywhere-2.20.6.0-b66-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.6.0-b66 ``` ### Improvements #### YSQL * Enhances logging for DDL transaction conflicts and PG catalog version mismatches by including the DDL command tag and specific log details outside of the `log_ysql_catalog_versions` flag. {{}} * Avoids renaming DocDb tables during legacy rewrite operations to prevent issues with backup/restore and improves handling of failed ADD/DROP primary key, ALTER TYPE operations. {{}} #### DocDB * Allows asynchronous DNS cache updating and resolution retry upon failure to reduce RPC call delays and prevent unexpected leadership changes. {{}},{{}} #### CDC * Transforms the flag `yb_enable_cdc_consistent_snapshot_streams` from a preview into a default true auto flag. {{}} #### yugabyted * Updates the cqlsh version to v3.10-yb-19 for enhanced functionality. {{}} * Reduces `collect_logs` command failures by removing the yugabyted running check even when the yugabyted process is not running. {{}} ### Bug fixes #### YSQL * Allows YB Admins to run pg_locks without requiring superuser status. {{}} * Now allows for correct backward prefix-based scanning by eliminating the problematic `kGroupEnd` marker that was leading to inaccurate seek results. {{}} * Reduces sequence cache collision by incorporating both database and sequence OIDs as the entry key. {{}} * Allows faster data inserts into tables with identity columns. {{}} * Prevents a crash related to memory release associated with TupleTableSlots in SubPlans during a Values Scan. {{}} * Reduces prefix length in the index when using distinct index scan with included columns. {{}} * Eliminates unnecessary waiting for concurrent transactions in the DEFERRABLE mode for READ ONLY serializable transactions. {{}} #### DocDB * Allows restoring a snapshot schedule from a time just before the oldest snapshot, improving usability. {{}} * Fixes issue of scans not honoring timeouts, preventing indefinite reads and reducing CPU usage. {{}} * Adds validation to RPCs `DeleteSnapshot` and `RestoreSnapshot` to prevent deletion or use of snapshots involved in ongoing processes. {{}} * Allows the persistent mapping of source-target schema versions when a new table is added to a colocated database, thus preventing replication from stalling after TServer restarts. {{}} * Updates cotable IDs in flushed frontiers during a snapshot restore, preventing potential post-restore issues. {{}} * Eliminates latency spikes in conflicting workloads by preventing redundant ProbeTransactionDeadlock RPCs. {{}} * Ensures object drops correctly cascade to dependent columns in the DocDB table, preventing inconsistencies. {{}} * Allows large bytes to be requested on RateLimiter, preventing indefinite call stalling. {{}} * Removes extra reads during the processing of `INSERT INTO ...RETURNS STATUS AS ROW` for CQL tables with a specific primary key, improving system load and efficiency. {{}} #### CDC * Resolves an issue preventing newly created tables from being added to the stream metadata and CDC state table after an existing table is dropped, by considering streams in `DELETING_METADATA` state as well as `ACTIVE` state during dynamic table addition. {{}} * Prevents newly created indexes, materialized views, and non-user tables from being added to the CDC stream metadata. {{}} * Introduces three new yb-admin commands to manage CDC streams, including disabling dynamic table addition, removing specific user tables from CDC streams, and validating CDC state table entries. {{}},{{}},{{}} * Allows removal of expired or unpolled tables from CDC stream metadata and state table, preventing potential blockages. {{}} * Conversion of `cdcsdk_enable_cleanup_of_expired_table_entries` to an auto flag now allows more consistent handling and cleanup of expired tables. {{}} * Refines the logic to remove `BEGIN` record when no DML records are added, preventing potential virtual WAL crashes. {{}} * Allows handling of non-eligible table cleanup in CDC stream loading even after table drop, preventing master crash. {{}} ## v2.20.5.0 - July 10, 2024 {#v2.20.5.0} **Build:** `2.20.5.0-b72` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.5.0/yugabytedb-2.20.5.0-b72-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.5.0/yugabytedb-anywhere-2.20.5.0-b72-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.5.0-b72 ``` ### Improvements #### YSQL * Adds new columns to `localhost:13000/statements` for more comprehensive database management, including user and database IDs along with varied block level statistics. {{}} #### DocDB * Introduces utility to dump top heap stacks when memory limit is exceeded for enhanced debugging. {{}} * Solves the potential deadlock in `DeleteTabletListAndSendRequests`, while also preventing xrepl tablets deletion due to multiple calls to the function. {{}},{{}} * Shifts tcmalloc profiling code to the Utils folder. {{}} #### CDC * Promotes the flag `yb_enable_cdc_consistent_snapshot_streams` from a preview flag to a default true auto flag. {{}} * Introduces three new yb-admin commands for managing user tables in a CDCSDK stream, enabling you to disable dynamic table addition, remove specific user tables from the CDC stream, and validate CDC state table entries for a stream. {{}},{{}} #### yugabyted * Updates the cqlsh version to `v3.10-yb-19` for enhanced functionality. {{}} ### Bug fixes #### YSQL * Fixes an error that occurs when decoding null values from a boolean column sorted as NULLS LAST in a secondary index. {{}} * Fixes YSQL upgrade single connection mode error preventing new connection attempts before the old ones are released. {{}} * Stops Batched Nest Loop (BNL) crashes by ensuring better indexing condition checks. {{}} * Refines the logic to accurately push down join clauses to batched index scans without causing conflicts. {{}} * Re-enables rechecking for RowCompareExpressions to accurately handle NULL inputs in scan bound calculations. {{}} * Grants BNL hashtable its own expression context to prevent data overwrites during query execution. {{}} * Makes `yb_get_range_split_clause` robust using PG TRY CATCH block, ensuring YB backup doesn't fail. {{}} * Prevents coredumps by ensuring YSQL webserver destruction upon receiving a termination signal. {{}} * Fixes memory leaks in ybcFetchNextHeapTuple by properly freeing the YBCStatus. {{}} * Allows `CreateNamespaceIfNotExists` function to retry on "already exists" error, preventing race conditions. {{}} * Fixes database OID collision issue by skipping 65535 for database OID allocation. {{}} * Prevents the `IN` expressions on single column from wrongly taking the tuple path, ensuring correct data processing. {{}} * Corrects the YbGetOrdinaryColumnsNeedingPgRecheck function to return table column numbers instead of index numbers, preventing unnecessary data fetches and potential crashes or errors after dropping a column. {{}} * Reduces sequence cache collision by incorporating both database and sequence OIDs as the entry key. {{}} #### DocDB * Fix ensures heartbeat processing doesn't blindly overwrite tablet replica state, avoiding potential data corruption. {{}} * Eliminates possible deadlock during setup replication by fixing the order in which locks are acquired. {{}} * Removes unnecessary flush during snapshot deletion, preventing write blocks. {{}} * Resolves a heartbeat metrics issue ensuring full xCluster error information is sent to the new master even during a leader failover, and makes `tserver_heartbeat_metrics_interval_ms` runtime updatable. {{}} * Converted the `ysql_skip_row_lock_for_update` to an auto-flag to resolve compatibility issues during upgrade, preventing incorrect DB record creations that can affect row visibility and integrity. {{}} * Changes the class of `enable_automatic_tablet_splitting` gflag from `kLocalPersisted` (class 2) to `kExternal` (class 4) to eliminate setup issues with xCluster configurations. {{}} * Prevents duplicate entries in the sequence data filter used by Snapshot schedules, ensuring successful operations. {{}} * Resolves the issue of `pg_locks` query failure due to missing host node UUID in distributed transactions. {{}} * Prevents premature metric destruction during Prometheus scrapes, resolving non-UTF8 character issues. {{}} * Ensures failed xCluster setup if the xCluster stream state update to `ACTIVE` does not occur. {{}} #### CDC * Ensures deletion of MemoryContext after each GetChanges RPC to prevent memory leaks. {{}} * Resolves an issue preventing newly created tables from being added to the stream metadata and CDC state table after an existing table is dropped, by considering streams in `DELETING_METADATA` state as well as `ACTIVE` state during dynamic table addition. {{}} * Prevents newly created indexes and materialized views from automatically being added to the CDC stream metadata. {{}} * Enables removal of non-eligible tables from Change Data Capture (CDC) streams to prevent unnecessary resource usage. Includes a background thread for dynamic table addition in CDC streams and introduces three new yb-admin commands with the auto flag `enable_cdcsdk_dynamic_tables_disable_option` for better CDC stream management. {{}},{{}},{{}} * Solves an issue where CDCSDK incorrectly deduces tablets as not interesting for stream before reaching the configured time limit. {{}} * Corrects the logic to remove the BEGIN record when no DML records are added to the GetChanges response. {{}} ## v2.20.4.1 - June 21, 2024 {#v2.20.4.1} **Build:** `2.20.4.1-b5` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.4.1/yugabytedb-2.20.4.1-b5-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.4.1/yugabytedb-anywhere-2.20.4.1-b5-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.4.1-b5 ``` ### Improvements #### DocDB * Solves the potential deadlock in DeleteTabletListAndSendRequests, while also preventing xrepl tablets deletion due to multiple calls to the function. {{}},{{}} ### Bug fixes #### YSQL * Makes `yb_get_range_split_clause` robust using PG TRY CATCH block, ensuring YB backup doesn't fail. {{}} #### DocDB * Removes unnecessary flush during snapshot deletion, preventing write blocks. {{}} #### CDC * Ensures deletion of MemoryContext after each GetChanges RPC to prevent memory leaks. {{}} ## v2.20.4.0 - May 23, 2024 {#v2.20.4.0} **Build:** `2.20.4.0-b50` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.4.0/yugabytedb-2.20.4.0-b50-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.4.0/yugabytedb-anywhere-2.20.4.0-b50-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.4.0-b50 ``` ### Improvements #### YSQL * Adds new columns to localhost:13000/statements for more comprehensive database management, including user and database IDs along with varied block level statistics. {{}} #### YCQL * Now throws an error when using the unsupported GROUP BY clause in YCQL with autoflag `ycql_suppress_group_by_error` available for compatibility issues. {{}} #### DocDB * Updates `AreNodesSafeToTakeDown` to return earlier and deliver a readable error message when hitting a timeout, using a control flag, `are_nodes_safe_to_take_down_timeout_buffer_ms` with a default setting of 2 seconds. {{}} * Allows for faster failover in xCluster DR by skipping the cleanup process when `skip_producer_stream_deletion` is set on `DeleteUniverseReplicationRequestPB`. Safe for upgrades and rollbacks. {{}} #### yugabyted * Allows a smooth restart of the second node in a cluster using the `join` flag without throwing any errors. {{}} ### Bug fixes #### YSQL * Re-enables the `Storage Rows Scanned` for `EXPLAIN (ANALYZE, DIST)` functionality in 2.20 after a successful upgrade fix, enhancing user understanding of data selectivity in filters and index conditions. {{}},{{}} * Safeguards against an out-of-bounds memory write error in HashAggregate plan node with duplicate columns by rectifying array size allocation. Imported tests ensure the fix's robustness. {{}} * Resolves colocation option issues in table creation linked to table rewriting and partitioning. Enhances the `defGetBoolean` function to parse string values "0" and "1" as false and true respectively, and shifts a verification step to a earlier spot in the CREATE TABLE execution path, ensuring successful table partition creation. {{}},{{}} * Corrects checks in YbIsScanCompatible to ensure the right-hand side (RHS) of all bound index conditions, not just inequalities, fits into the left-hand side (LHS) datatype. {{}} * Refines the YbGetOrdinaryColumnsNeedingPgRecheck condition to align with the ybIsTupMismatch implementation, ensuring Postgres rechecks index conditions when the "preliminary check" is skipped due to an invalid target key attnum. {{}} * Ensures pushed down RowCompareExpressions correctly enforce non-null column references, rectifying previous behavior and enhancing data accuracy. {{}} * Delivers consistent error messages for aborted transactions that align with those from serialization and deadlock errors. {{}} #### YCQL * Allows the deletion of the Cassandra role in YCQLsh without it regenerating upon cluster restart, by adding a flag to mark if the role was previously created. {{}} #### DocDB * Ensures `Create Table` operation fails if `Alter Replication` encounters an error, enhancing the reliability of replication setup. {{}} * Converted the `ysql_skip_row_lock_for_update` to an auto-flag to resolve compatibility issues during upgrade, preventing incorrect DB record creations that can affect row visibility and integrity. {{}} * Modifies memory consumption calculations for pending operations to ensure accurate rejection of new writes at bootstrap, preventing loading failures. {{}} * Allows DML operations on non-replicated databases and blocks DML only on databases in transactional xCluster replication STANDBY mode. Now only databases part of an inbound transactional xCluster replication group in the xCluster safe time map will have DML operations blocked. Also, certain attributes are moved from TServer to TserverXClusterContext. {{}} * Allows viewing of the RPC bind addresses in the master leader UI, especially beneficial in cases like k8s where the RPC bind address with the pod DNS is more useful than the broadcast address. {{}} * Reduces unnecessary logging during checkpoint operations by lowering INFO level logs to DEBUG_LEVEL, enhancing log readability. {{}} * Enhances load balancer efficiency by refining validation logic to block tablet replica additions only for those with a pending delete in progress on the same server, avoiding potential slowdowns during mass tablet replica moves. {{}} * Restores original order of `rpcs_.Shutdown` in `TransactionParticipant::Impl::CompleteShutdown` that was altered due to a bad backport commit. {{}} * Stops fatal errors caused by the re-use of remote log anchor session during remote bootstrap from a non-leader peer. This fix ensures shared pointers are accurately tracked for `tablet_peer` objects using the `=` operator, preventing unintentional destruction of underlying objects. {{}} * Fixes hidden split parent tablets wrongly appearing as leaderless in the master's leaderless tablet endpoint, ensuring accurate load balance status and preventing potential issues with Point-in-Time Recovery (PITR) operations. {{}} * Addresses an issue where tablet shutdown may be blocked due to a race condition between shutdown request and transaction loader thread. The fix ensures a smoother tablet shutdown process when errors occur during transaction loading or when there is a premature exit from the loader thread. {{}},{{}} #### CDC * Prevents failures in decoding change events by refreshing `cached_schema_details` when executing a new `GetChanges` request if the client indicates a necessity for the schema. {{}} ## v2.20.3.1 - May 14, 2024 {#v2.20.3.1} **Build:** `2.20.3.1-b2` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.3.1/yugabytedb-2.20.3.1-b2-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.3.1/yugabytedb-anywhere-2.20.3.1-b2-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.3.1-b2 ``` ### Bug fix #### DocDB * Converted the `ysql_skip_row_lock_for_update` to an auto-flag to resolve compatibility issues during upgrade, preventing incorrect DB record creations that can affect row visibility and integrity. {{}} ## v2.20.3.0 - April 9, 2024 {#v2.20.3.0} ### Download {{< warning title="Use v2.20.3.1 or later.">}} {{< /warning >}} ### New feature * [Roll back upgrades](/v2.20/manage/upgrade-deployment/#b-rollback-phase). Ability to roll back a database upgrade in-place and restore the cluster to its state before the upgrade. You can roll back a database upgrade _only_ to the pre-upgrade release. {{}} * Added support for Red Hat Enterprise Linux 9.3 on x86-based systems. Refer to [Operating system support](/v2.20/reference/configuration/operating-systems/) for the complete list of supported operating systems. ### Improvements #### YSQL * Alters temporary namespace naming in YB to `pg_temp__` from `pg_temp_`, making them unique across nodes and preventing temp tables overwriting or deletion. {{}} * Treats `REFRESH MATERIALIZED VIEW` as a non-disruptive change, preventing unnecessary transaction terminations. The default option, `REFRESH MATERIALIZED VIEW NONCONCURRENTLY`, modifies metadata but without making a disruptive alteration. {{}} * Displays distinct prefix keys explicitly in the explain output, enhancing the clarity of indexing for users. {{}} * Allows correct initialization and propagation of `ybDataSent` and `ybDataSentForCurrQuery` flags for both parent and child transactions, for enhanced error handling and retry mechanism. {{}} * Optimizes the `get_tablespace_distance` function, enhancing the speed of the `yb_is_local_table` YSQL function. Reduces query time by caching `GeolocationDistance` value. {{}} #### DocDB * Limits the number of rows returned per transaction per tablet in `pg_locks` to avoid potential memory issues during batch inserts, and includes additional fields to indicate partial lock info. {{}} * Introduces a new YSQL configuration parameter `yb_locks_txn_locks_per_tablet` to limit the number of rows returned by pg_locks, preventing the system from running out of memory during large transactions. {{}} * Introduces a new metric for untracked memory which eliminates the need to hardcode child memory trackers. Now users can effortlessly monitor untracked memory for better resource management. {{}} * Limits the number of tablets per node, and hastens reaching the desired number of tablets by lowering the values of FLAGS_tablet_split_low_phase_shard_count_per_node to 1 and FLAGS_tablet_split_low_phase_size_threshold_bytes to 128MB. {{}} * Adds a new retrying master-to-master task, allowing for the API `AreNodesSafeToTakeDown` to check if it's safe to remove or upgrade certain nodes without disrupting overall cluster health. {{}} * Introduces `AreNodesSafeToTakeDown` API that ensures safe node removals during cluster upgrades or maintenance operations by checking tablet health and follower lag, facilitating seamless and risk-free updates. {{}} * Enables monitoring of master leader heartbeat delays through a new RPC in the MasterAdmin, ensuring undesired lags can be readily detected and mitigated. {{}} * Introduces two new metrics to alert users when CreateTable function tries to exceed the tablet count limits and to highlight when a tablet server is managing more tablets than its capacity allows. {{}} * Adjusts the tablet guardrail mechanism to wait for TServer registrations when master leadership changes, avoiding false-positive CREATE TABLE rejections due to incomplete TServer data. A new flag now controls this wait duration. {{}} * Adds a flag `FLAGS_tablet_split_min_size_ratio` to control tablet splitting based on SST file sizes, ensuring better control over tablet size imbalance. {{}} #### CDC * Added a test to certify the `safe_time` set during `GetChanges` call, reducing data loss during network failures. Ensures consistent `safe_hybrid_time` in multiple `GetChanges` calls. {{}} ### Bug fixes #### YSQL * Eliminates unnecessary computation of range bounds in Index-Only Scan precheck condition, preventing crashes for certain queries and improving performance. {{}} * Eliminates risk of data loss by ensuring only the first statement in SQL mutation batches is retried in the event of a transaction conflict, when using PostgreSQL extended query protocol. {{}} * Temporarily reverts new field additions to the PgsqlResponsePB proto to address upgrade failures encountered when transitioning from versions 2.14/2.16 to 2.20.2. {{}} * Fixes table rewrite issue on non-colocated tables/matviews in colocated DB, ensuring the new table uses the original table's colocation setting. Includes a workaround for GH issue 20914. {{}} * Reduces excessive storage metric updates during `EXPLAIN ANALYZE` operation, enhancing performance by incorporating `storage_metrics_version` in `YBCPgExecStats` and `YbInstrumentation`. {{}} * Prevents simultaneous send of read and write operations in the same RPC request that could lead to inconsistent read results, by ensuring that, in case of multiple operations, all buffered ones are flushed first. {{}} * Redesigned expression tree walkers to properly handle NULL nodes in queries with subselects used in an index condition, preventing planner crashes. {{}} * Enforces stricter locking mechanisms during concurrent updates on different columns of the same row, to maintain data consistency and prevent 'write-skew anomaly within a row'. Adds a new flag `ysql_skip_row_lock_for_update` to toggle the new row-level locking behavior. {{}} * Adjusts heartbeat mechanism to shut down when an "Unknown Session" error occurs, reducing log alerts. This benefits idle connections with expired sessions. {{}} * Allows BNL's on outer and inner tables, even if the inner table has "unbatchable" join restrictions that can't accept batches of inputs, enhancing queries with complex join conditions. {{}} * Incorporates checks of inequality filters in the YSQL layer to avoid transmitting trivially false inequalities, preventing undesired behavior from DocDB iterators. {{}} * Allows ModifyTable EXPLAIN statements to run as a single row transactions, decreasing latency. Also enables logging for transaction types when `yb_debug_log_docdb_requests` is enabled. {{}} * Corrects an issue where certain unbatchable filters weren't detected during indexpath formation when indexpath accepted batched values from multiple relations. {{}} #### DocDB * Fixes a race condition on kv_store_.colocation_to_table to prevent undefined behavior and re-enables packed row feature for colocated tables, enhancing data writing and compaction processes. {{}} * Clears `pending_deletes_` on failed delete tasks thus preventing tablets from being incorrectly retained after task failure or completion. This rectifies a race condition and allows the Load Balancer to perform operations on specific tablets and Tablet Servers. {{}} * Enhances universe upgrade process by incrementing ClusterConfig version during an update and adds checks to prevent universe_uuid modification. Also introduces a yb-ts-cli to clear universe UUID if necessary, improving troubleshooting capabilities. {{}} * Reflects the actual columns locked in conflict resolution instead of the shared in-memory locks in `pg_locks`, providing more accurate output for waiting transactions. {{}} * Modifies the `DocDB` system by shifting the acquirement of `submit_token_` of the `WriteQuery` to the post-conflict resolution phase to prevent DDL requests from being blocked, thus optimizing both reads and writes for continued performance and enhanced data consistency. {{}} * Corrects transaction queue behavior allowing multiple waiters for a single transaction per tablet, thereby resolving conflicts and enhancing transaction handling capability. {{}} * Incorporates detection of recently aborted transactions into the transaction coordinator with a new flag `clear_deadlocked_txns_info_older_than_seconds`. {{}},{{}} * Disables the packed row feature for colocated tables, effectively preventing a possible encounter with the underlying issue in 21218 during debugging. {{}} * Prevents TServers from crashing due to duplication of tablets in two drives, occurring after repairing a faulty drive, by preventing the creation of new tablets during Raft-based system (RBS) process. {{}} * Eliminates potential issues with colocated tables during heavy DDL operations and compaction, reducing the risk of crashing on newer builds (2.20.0+) where the packed row feature is default. {{}} * Allows database drop operations to proceed smoothly by ignoring missing streams errors and skipping replication checks for already dropped tables. {{}} * Allows ListTabletServers to handle heartbeats older than 24 days by adjusting the setting to the maximum int32 value, avoiding system crash. {{}} * Includes the `indexed_table_id` with the index in table listings, eliminating the need for a second lookup to associate a main table with an index. {{}} * Corrects RPATH setting for OpenLDAP libraries that prevents system libraries being picked up or not found. Also refactors library_packager.py for improved library dependency categorization. {{}} * Reduces TPCC NewOrder latency by replacing the ThreadPoolToken with a Strand within a dedicated rpc::ThreadPool in PeerMessageQueue's NotifyObservers functions, enhancing speed and efficiency. {{}} * Early aborts transactions that fail during the promotion process, enhancing throughput in geo-partitioned workloads and offering stability in geo-partitioned tests. {{}} * Corrects block cache metrics discrepancy by ensuring Statistics object passes into LRUCache from TableCache for accurate updates. {{}} * Fixes a segmentation fault in yb-master by checking for a null pointer before dereferencing it, addressing an issue in the CDC run on `2.23.0.0-b37-arm`. {{}} * Validates the use of two arguments for `disable_tablet_splitting`, addressing a previous condition where only one was required, thereby enhancing backup process reliability. {{}} #### CDC * Introduces a fix for data loss issue caused by faulty update of `cdc_sdk_safe_time` during explicit checkpointing, along with tests to ensure validity. {{}} * Fixed the decoding of NUMERIC value in CDC records to prevent precision loss by ensuring that the decoded string is not converted to scientific notation if its length is more than 20 characters. {{}} * Fixes issue with CDC packed rows, now ensures a single record for large insert operations, providing consistent data regardless of row size. {{}} * Ensures consistency in `CDCSDKYsqlTest.TestLargeTxnWithExplicitStream` test by setting `FLAGS_cdc_max_stream_intent_records` value from 40 to 41, overcoming the issue of multiple records for a single insert when packed row size exceeds `ysql_packed_row_size_limit`. {{}} #### Other * Updates the condition for HT lease reporting to ensure accurate leaderless tablet detection in RF-1 setup, preventing false alarms. {{}} * Reduces disruptions by throttling the master process log messages related to "tablet server has a pending delete" into 20-second intervals. {{}} ## v2.20.2.4 - September 12, 2024 {#v2.20.2.4} **Build:** `2.20.2.4-b3` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.2.4/yugabytedb-2.20.2.4-b3-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.2.4/yugabytedb-anywhere-2.20.2.4-b3-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.2.4-b3 ``` ### Bug fix #### DocDB * Reduces the risk of deadlocks when making active read/write requests to a table right after a tablet-split. {{}} ## v2.20.2.3 - June 27, 2024 {#v2.20.2.3} **Build:** `2.20.2.3-b2` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.2.3/yugabytedb-2.20.2.3-b2-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.2.3/yugabytedb-anywhere-2.20.2.3-b2-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.2.3-b2 ``` This is a [YugabyteDB Anywhere-only release](../../yba-releases/v2.20/#v2.20.2.3), with no changes to YugabyteDB. ## v2.20.2.2 - April 1, 2024 {#v2.20.2.2} **Build:** `2.20.2.2-b1` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.2.2/yugabytedb-2.20.2.2-b1-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.2.2/yugabytedb-anywhere-2.20.2.2-b1-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.2.2-b1 ``` This is a [YugabyteDB Anywhere-only release](../../yba-releases/v2.20/#v2.20.2.2), with no changes to the database. ## v2.20.2.1 - March 22, 2024 {#v2.20.2.1} **Build:** `2.20.2.1-b3` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.2.1/yugabytedb-2.20.2.1-b3-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.2.1/yugabytedb-anywhere-2.20.2.1-b3-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.2.1-b3 ``` ### Bug fixes #### DocDB * Enhances universe upgrade process by incrementing ClusterConfig version during an update and adds checks to prevent universe_uuid modification. Also, introduces a yb-ts-cli to clear universe UUID if necessary, improving troubleshooting capabilities. {{}} #### CDC * Ensures numeric values are decoded without precision loss by utilizing string representation with no length limit and the PostgreSQL numeric_out method. {{}} ## v2.20.2.0 - March 4, 2024 {#v2.20.2.0} **Build:** `2.20.2.0-b145` **Third-party licenses:** [YugabyteDB](https://downloads.yugabyte.com/releases/2.20.2.0/yugabytedb-2.20.2.0-b145-third-party-licenses.html), [YugabyteDB Anywhere](https://downloads.yugabyte.com/releases/2.20.2.0/yugabytedb-anywhere-2.20.2.0-b145-third-party-licenses.html) ### Downloads

### Docker ```sh docker pull yugabytedb/yugabyte:2.20.2.0-b145 ``` ### New features * Added support for read-only mode for DR replica, currently supported for YSQL tables. * Tablet splitting now can be enabled on tables with CDC configured. {{}} * Transactional CDC now supports consistent snapshots, ensuring data integrity during replication to a sink. Snapshots, ordered by commit time across all tables and tablets, establish a reliable replication order. {{}} ### Improvements #### YSQL * Introduces `yb_silence_advisory_locks_not_supported_error` as a temporary solution, avoiding disruption while users transition from the use of advisory locks. {{}} * Shifts from the test flag "FLAGS_TEST_enable_db_catalog_version_mode" to the {{}} flag "FLAGS_ysql_enable_db_catalog_version_mode", enhancing user control over concurrent DDL execution across different databases. {{}} * Issues a notice for unsafe ALTER TABLE operations, including for ADD COLUMN...DEFAULT, to indicate existing rows won't be backfilled with the default value, enhancing user awareness. Suppression possible by setting `ysql_suppress_unsafe_alter_notice` flag to true. {{}} * Added sorting capabilities to BatchNestedLoopJoin to return the rows in the same order as NestedLoopJoin. {{}} * Replaces the `ysql_max_read_restart_attempts` and `ysql_max_write_restart_attempts` flags with `yb_max_query_layer_retries`, applies limit to Read Committed isolation statement retries, and adjusts `retry_backoff_multiplier` and `retry_min_backoff` defaults. {{}} * Disallows the creation of a temporary index with a tablespace, preventing client hangs and providing a clear error message for temporary index creation with set tablespace. {{}} * Enables index tablespace modification through the `ALTER INDEX SET TABLESPACE` command and regulates column statistics using the `ALTER INDEX ALTER COLUMN SET STATISTICS` command. Also, allows the creation and alteration of materialized views with the specified tablespace. Suppress the beta feature warning by enabling `ysql_beta_feature_tablespace_alteration` flag. {{}} * Adds function to log the memory contexts of a specified backend process, enhancing memory usage monitoring and allowing users to troubleshoot memory-related issues more effectively. {{}} #### DocDB * Allows customizing retryable request timeouts to respect client-side YCQL and YSQL timings, optimizing log replay and preventing the TServer from rejecting requests that exceed durations. Adjusts default retryable request timeout to 660 seconds and offers a configuration to eliminate server-side retention of retryable requests with `FLAGS_retryable_request_timeout_secs =0`. {{}} * Speeds up TServer Init by optimizing the handling of deleted and tombstoned tablets. It ensures faster startup by using a new flag `num_open_tablets_metadata_simultaneously`, which sets the number of threads for opening tablet metadata. This allows for parallel opening of metadata, improving response times even in cases with large numbers of tablets. Additionally, the handling of tablets marked as `Deleted` or `Tombstoned` is managed asynchronously, marking tombstoned tablets as dirty for inclusion in the next heartbeat. {{}} * Logs all instances of tablet metadata creation/updation, enabling additional insights for troubleshooting in cases of multiple meta records for the same tablet. {{}} * Adds a 10-second delay (`auto_flags_apply_delay_ms`) between AutoFlag configuration updates and their application, allowing all TServers to receive the new configuration before applying it. This change enhances configuration consistency and update safety. {{}} * Enhances thread safety by setting `Wthread-safety-reference` to check when guarded members are passed by reference and resolving all build errors resulting from this change. {{}} * Automates recovery of index tables impacted by a bug, preventing performance degradation and disk size leak, by ensuring schema.table_properties.retain_delete_markers is reset to false when index backfilling is done. {{}} * Enhances the `demote_single_auto_flag` yb-admin command by returning distinct error messages for invalid process_name, flag_name, or non-promoted flag, thereby aiding easier identification of errors. Replaces `HasSubstring` with `ASSERT_STR_CONTAINS` in the AutoFlags yb-admin test. {{}} * Introduces support for Upgrade and Downgrade of universes with xCluster links, enhancing compatibility checks for AutoFlags during these operations. Data replication between two universes is only catered if AutoFlags of the Target universe are compatible with the Source universe. The compatibility check, stored in `ProducerEntryPB`, triggers if the AutoFlag configuration changes during upgrades and rollbacks. This prevents unnecessary RPC calls if no AutoFlag configurations have changed. Also includes fixes for cds initialization bugs in `TestThreadHolder`. {{}} * Offers redesigned server level aggregation for metrics, thus introducing more metrics for enhanced debugging. Removes several unused URL parameters and makes the new output compatible with YugabyteDB Anywhere and YugabyteDB Aeon, preventing double-counting issues in charts. Drops unused JSON and Prometheus callbacks from MetricEntity for a cleaner design. {{}} * Allows a limit on the addition of new tablet replicas in a cluster to conserve CPU resources, with safeguards for downscaling. Introduces test flags for controlling memory reservation and tablet replica per core limits. {{}} * Introduces verbose logging for global and per table state transitions in the load balancer to facilitate easier debugging. {{}} * Reduces server initialization time by eliminating the accumulation of deleted tablet superblocks during startup, through a modification in the `DeleteTablet` operation. {{}} * Enables automatic recovery of index tables affected by a bug, verifying their backfilling status and correcting the `retain_delete_markers` property to enhance performance. {{}} * Includes single shard (fast-path) transactions in the pg_locks by querying single shard waiters registered with the local waiting transaction registry at the corresponding TServer, ensuring more complete transaction tracking and lock status reporting. {{}} * Creates Prometheus metrics for server hard and soft memory limits which allow detailed insight into TServer or master memory usage regardless of Google flag defaults; aids in creating dashboards charts to monitor utilization close to soft limit or TServer TCMalloc overhead. {{}} * Enables control over the batching of non-deferred indexes during backfill via a new flag, improving index management. {{}} #### yugabyted * Corrects the CPU usage reporting in the sankey diagram by filtering nodes based on region selection on the performance page. {{}} * Repairs yugabyted-ui functionality when using custom YSQL and YCQL ports by passing values to yugabyted-ui, ensuring the correct operation of the user interface. {{}} ### Bug fixes #### YSQL * Reduces Proc struct consumption by enabling cleanup for killed background workers, preventing webserver start-up failure after 8 attempts. {{}} * Frees up large volumes of unused memory from the webserver after processing queries, enhancing periodic workloads by reallocating held memory to the OS more effectively. {{}} * Introduces two new boolean flags for YSQL webserver debugging and failure identification.The first will log every endpoint access and its list of arguments before running the path handler. The second will print basic tcmalloc stats after the path handler and garbage collection have run. {{}} * Rectifies an issue causing segmentation faults when the postmaster acquires already owned LWLock, enhancing stability during process cleanup. Uses KilledProcToCleanup instead of MyProc if acquiring locks under the postmaster. {{}} * Introduces two new boolean flags for YSQL webserver debugging and failure identification.The first will log every endpoint access and its list of arguments before running the path handler. The second will print basic tcmalloc stats after the path handler and garbage collection have run. {{}} * Restarts postmaster in critical sections.This applies to backend PG code; defines and improves handling of errors in these sections. {{}} * Introduces the `pg_stat_statements.yb_qtext_size_limit` flag to control the maximum file size read into memory, preventing system crashes due to oversized or corrupt qtext files. {{}} * Caps the number of attempts to read inconsistent backend entries to 1000 for safer operation and better visibility, limiting potential infinite loops in /rpcz calls and logging every hundredth attempt. {{}} * Resolves segmentation faults in the webserver SIGHUP handler during cleanup. {{}} * Display consistent wait-start times in `pg_locks` view for waiting transactions. {{}},{{}} * Reduces excessive memory consumption during secondary index scans. {{}} * Allows the finalize_plan function to now apply finalize_primnode on PushdownExprs, ensuring Parameter nodes in subplans transfer values accurately, especially in Parallel Queries. {{}} * Return correct results when Batch Nested Loop join is used for queries involving Nested LEFT JOINs on LATERAL views. {{}},{{}} * Upgrades "Unknown session" error to FATAL permitting drivers to instantly terminate stale connections, minimizing manual user intervention. {{}} * Rectifies correctness issues when BatchNestedLoop join is used and the join condition contained a mix of equality and non-equality filters. {{}} * Mitigates incorrect data entry into the default partition by incrementing the schema version when creating a new partition, enhancing data consistency across all connections. {{}} * Rectifies correctness issue when join on inequality condition and join columns contains NULL values. {{}} * Rectifies correctness issue when queries involving outer joins and aggregate use BNL. {{}} * Corrects the Batch Nested Loop's optimization logic for proper handling of cases where the given limit matches the outer table's exact size, ensuring accurate query results. {{}} * Prevents "Not enough live tablet servers to create table" error during ALTER TABLE SET TABLESPACE by correctly supplying the placement_uuid, even when creating a table in the same tablespace. {{}} * Addresses a bug that caused backup failure due to the absence of `yb_catalog_version`, by ensuring the function's existence post-normal migration. {{}} * Corrects an error in the aggregate scans' pushdown eligibility criteria to prevent wrong results from being returned when PG recheck is not expected, but YB preliminary check is required to filter additional rows. {{}} * Ensures the Linux `PDEATH_SIG` mechanism signals child processes of their parent process's exit, by correctly configuring all PG backends immediately after their fork from the postmaster process. {{}} * Fixes a MISMATCHED_SCHEMA error when upgrading from version 2.16 to 2.21 by introducing a 2-second delay for catalog version propagation when a breaking DDL statement is detected. {{}} * Return correct result for join queries using BatchNestedLoop join and DISTINCT scan using the range Index during inner table scan. {{}} * Renders a fix for memory corruption issue that caused failure in creating a valid execution plan for `SELECT DISTINCT` queries. Enables successful execution of queries without errors and prevents server connection closures by disabling `distinct pushdown`. This fix improves the stability and effectiveness of SELECT DISTINCT queries. {{}} * Eliminates unnecessary computation of range bounds in Index-Only Scan precheck condition, preventing crashes for certain queries. {{}} #### DocDB * Resolves potential `WriteQuery` leak issue in CQL workloads, ensuring proper execution and destruction of queries, while preventing possible tablet shutdown blockages during conflict resolution failure. {{}} * Mitigates the issue of uneven tablet partitions and multiple pollers writing to the same consumer tablet by only applying intents on the consumer that match the producer tablet's key range. If some keys/values are filtered out from a batch, it will not delete the consumer's intents, as they may be needed by subsequent applications. Also guarantees idempotency, even if some apply records stutter and fetch older changes. {{}} * Reduces chances of transaction conflicts upon promotion by delaying the sending of UpdateTransactionStatusLocation RPCs until after the first PROMOTED heartbeat response is received, enhancing transaction consistency and accuracy. {{}} * Sets `kMinAutoFlagsConfigVersion` to 1 to resolve flag configuration mismatch issue. {{}} * Unblocks single shard waiters once a blocking subtransaction rolls back, by applying identical conflict check logic for both distributed transactions and single shard transactions. {{}} * Eliminates a race condition that can occur when simultaneous calls to `SendAbortToOldStatusTabletIfNeeded` try to send the abort RPC, thus preventing avoidable FATALs for failed geo promotions. {{}} * Fixes behavior of Tcmalloc sampling; deprecates the enable_process_lifetime_heap_sampling flag in favor of directly setting profiler_sample_freq_bytes for controlling tcmalloc sampling, enhancing control over sampling process. {{}} * Resolves instances of the leaderless tablet endpoint incorrectly reporting a tablet as leaderless post-leader change, by tweaking the detection logic to depend on the last occurrence of a valid leader, ensuring more accurate tablet reporting. {{}} * Allows early termination of ReadCommitted transactions with a `kConflict` error, enhancing overall system throughput by eliminating unnecessary blockages without waiting for the next RPC restart. {{}} * Fixes FATAL errors occurring during tablet participant shutdown due to in-progress RPCs by ensuring rpcs_.Shutdown is invoked after all status resolvers have been shut down. {{}} * Modifies SysCatalog tablet's retryable request retention duration to consider both YQL and YSQL client timeouts, reducing the likelihood of `request is too old` errors during YSQL DDLs. {{}} * Handles backfill responses gracefully even when they overlap across multiple operations, reducing risks of crashes and errors due to network delays or slow masters. {{}} * Reintroduces bloom filters use during multi-row insert, improving conflict resolution and rectifying missing conflict issues, while also addressing GH 20648 problem. {{}},{{}} * Fixes handling of duplicate placement blocks in under-replication endpoint for better compatibility and correct replica counting, preventing misrepresentation of under-replicated tablespaces. {{}} * Logs the first failure during setup replication instead of the last error, facilitating better error diagnosis. {{}} * Implements a retry mechanism to acquire the shared in-memory locks during waiter resumption. Rather than failing after a single attempt, it now schedules retrying until the request's deadline, reducing request failures due to heavy contention. {{}},{{}},{{}} * Reduces log warnings in normal situations by downgrading repeated waiter resumption alerts to VLOG(1), benefiting from the direct signaling of transaction resolution. {{}} * Disables the packed row feature for colocated tables to prevent possible write failures post complications, as a workaround while investigating issue 20638. {{