ION 4.1.4-b.2 (beta build 2)

Beta Build 2:

• Fixed multiple race conditions within bpcp, CFDP event queue, and tcpcli.
• Improved stability of the semaphore synchronization and reference-counting implementation for better shutdown coordination among processes/threads waiting on the same semaphore.
• Updates on bpcp and TCPCL-related regression tests.

ION Open Source Release 4.1.4-b.1 (Beta Release)

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
= NOTES ON RELEASE 4.1.4-b.1 =
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

This beta release represents a major milestone with the completion of the RTEMS 6.1
port, significant improvements to code quality and portability, new networking
capabilities, and enhanced utilities for bundle management and CFDP file transfers.

RTEMS 6.1 Real-Time Operating System Port

• Full RTEMS 6.1 Port: ION has been successfully ported to RTEMS 6.1 for ARM64
  (AArch64) platforms, featuring:
  • Support for RTEMS libbsd (FreeBSD network stack) integration
  • UDP-based LTP networking tested and verified in QEMU simulation
  • 64-bit addressing support (SPACE_ORDER=3)
  • ION Admin Public API for configuration (no configuration files required)
  • Comprehensive documentation in arch-rtems/ directory
  • Template implementation for adaptation to specific hardware platforms
  • CI/CD workflow integration for RTEMS builds

Dual-Stack IPv4/IPv6 Networking Support

IMPORTANT NOTE ON DUAL-STACK NETWORKING: The dual-stack IPv4/IPv6 capability
will automatically use the network address family returned by hostname resolution.
Most operating systems return IPv6 addresses first when available, and ION's network
stack will use the first entry returned. If a host is not properly configured for
the returned address family, this may cause network address family conflicts,
resulting in connection failures for TCP, UDP, and LTPCLA (which runs over UDP).
The most reliable approach is to use explicit IP addresses if known. If using
hostnames, ensure all hosts resolve to the correct address family as the first entry
in DNS resolution.

• LTPCL Dual-Stack: Added experimental dual-stack IPv4 and IPv6 support for the
  LTP Convergence Layer, allowing nodes to communicate over both protocol versions
  simultaneously.

• TCPCL Dual-Stack: Implemented dual-stack IPv4 and IPv6 support for the TCP
  Convergence Layer with regression tests.

• UDPCL Dual-Stack: Previously introduced in 4.1.4-a.2, further refined and tested
  for production use.

New Bundle Management Utilities

• bpinspect: New utility for inspecting, filtering, and managing bundles in ION's
  custody. Features include:

  • Bundle listing with detailed metadata
  • Filtering by source, destination, creation time, and other attributes
  • Suspend and resume operations for selective bundle processing
  • Critical bug fix for bp_suspend functionality

• bptracker: Enhanced interactive mode for demonstration of bundle tracking
  capabilities, providing fine-grained control over individual bundles with:

  • Flexible send syntax
  • Real-time bundle status monitoring
  • Source routing record (SRR) parsing improvements

• bpcrash_hard: New testing utility for validating ION's crash recovery and
  reversibility features under extreme failure conditions.

CFDP Enhancements

• Enhanced cfdptest Utility: Major improvements to the CFDP testing tool:

  • Transaction tracking and summary display
  • Per-transaction control commands (cancel, suspend, resume)
  • Terminology updates (ack → closure-reqt) for RFC compliance
  • Reset command (R) to clear source/destination filenames
  • Version command (v) for build information
  • Updated man pages and usage documentation

• Empty File Transfer: ION now correctly handles CFDP transfers of zero-byte files.

• Automatic Proxy Launch: CFDP server proxy (bpcpd) can now be automatically
  launched through cfdprc configuration file.

• Event Reporting: Enhanced CFDP event reporting API with more detailed file
  transfer status and progress information, including closureRequested field.

LTP Protocol Improvements

• Dynamic Parameter Control: New capability for direct configuration of LTP
  maxRetries and segment loss rate parameters with updated regression tests.

• Default Value Behavior: Updated default parameter handling for improved
  reliability and performance.

Code Quality and Standards Compliance

• C18/C99 Compliance: Updated build system to prefer C18 (ISO 9899:2018) standard
  with fallback to C99, ensuring maximum portability and standards compliance.

• Strict Compiler Warnings: Enforced -Wextra, -Wstrict-prototypes, and -pedantic
  compiler flags across the entire codebase, resolving hundreds of warnings to
  improve code quality and catch potential bugs.

• Thread Safety: Implemented thread-safe versions of iToa, uToa, vastToa, and
  uvastToa functions with proper type-specific conversions for 32-bit systems.

• POSIX Compliance: Refactored POSIX named semaphore implementation with reference
  counting and deferred deletion to mitigate race conditions, particularly for
  bpcp utility.

Security and Stability Fixes

• Extension Block Overflow: Fixed buffer overflow vulnerability when processing
  non-standard extension blocks. Added regression test for memory allocation
  vulnerabilities.

• BPSec Configuration: Corrected handling of bundles with no CRC and no BIB,
  with tests to verify proper rejection of invalid security configurations.

• NULL Source EID Handling: Fixed bug in handling NULL source EIDs and state
  changes between bundle list and cancel operations.

• Race Condition Fixes: Addressed semaphore cleanup race conditions in bpcp and
  resource lock initialization issues.

Contact Graph Routing (CGR) Enhancements

• Adjacent Contact Support: Prototype support for adjacent contact routing with
  documentation and test cases.

• Routing Visualization: Automated generation of routing visualization data
  through cgrfetch utility improvements, enabling graphical analysis of routing
  decisions.

• CGR Analysis Tools: Refactored cgr-test and asymmetric-range tests to produce
  sample CGR analysis data with comprehensive usage documentation.

Platform Portability Improvements

• macOS Compatibility: Resolved multiple platform-specific issues including
  compilation syntax errors and system() call restrictions with active child
  processes.

• FreeBSD Support: Updated for compatibility with FreeBSD networking stack and
  build environment, including tar-over-ssh deployment for CI/CD.

• Solaris Support: Addressed compiler warnings specific to Solaris and added
  timeout protections for test suite stability.

• ARM Architecture: Fixed ARM default unsigned char issues in tcpcli.c and other
  platform-specific type handling.

• MUSL libc: Enhanced compatibility with MUSL C library and Clang compiler, though
  semaphore limitations require single-instance deployment per host.

Build System Enhancements

• Configure Options: New options to selectively disable DGR and BSSP modules
  (--disable-dgr, --disable-bssp) for minimal builds.

• ion-core Build: Per-extension build options for customized ion-core package
  configurations.

• Development Makefiles: Continued maintenance and updates to manual Makefile.dev
  system for i86_64-fedora platform, including support for new executables:

  • SPP convergence layer (sppcli, sppclo)
  • New test utilities (entropy_test, sdr_test_util)
  • Bundle inspection tool (bpinspect)
  • Additional diagnostic tools

Testing and CI/CD Improvements

• Regression Test Suite: Enhanced test infrastructure with:

  • Optional test designation for non-critical tests
  • Improved cleanup handling for failed tests
  • Timeout mechanisms to prevent hanging tests
  • Preservation of test logs (PRESERVE_TEST_LOG default to 1)
  • Automated ION security database initialization

• GitHub Actions Workflows: Updated CI/CD pipelines with:

  • RTEMS-specific build workflow
  • Submodule initialization improvements
  • Workspace cleanup between runs
  • ion.log capture and custom timeout support
  • JSON dependency validation

• Cross-Platform Testing: Expanded test coverage across Linux, macOS, FreeBSD,
  and Solaris platforms with platform-specific accommodations.

Documentation Updates

• Public API Documentation: Added comprehensive online documentation for ION's
  public administrative API set.

• RTEMS Documentation: Complete documentation package for RTEMS 6.1 port in
  arch-rtems/ directory, including:

  • Installation and build instructions
  • Key fixes and troubleshooting guide (KEY-FIXES-SUMMARY.md)
  • UDP network status and configuration (UDP-NETWORK-STATUS.md)
  • Platform-specific customization guidelines

• Man Page Updates: Updated documentation for LTP maxRetries parameter
  clarification and deprecated maxber usage in regression tests.

Deprecations and Cleanup

• maxber Parameter: Deprecated use of maxber in regression tests; updated
  documentation to clarify proper usage.

• Legacy Code Removal: Continued cleanup of obsolete code including old dtnperf
  (now part of dtnsuite).

• SBSP References: Removed confusing SBSP references from build flags and include
  paths.

Known Issues and Limitations

• MUSL libc: Named semaphore limitations restrict deployment to one ION instance
  per host; many regression tests will fail due to this constraint.

• RTEMS Port: Template implementation requires adaptation to specific hardware
  platforms and BSPs; loopback testing defaults to 127.0.0.1.

• Dual-Stack Networking: IPv4/IPv6 dual-stack features remain experimental;
  production deployments should be thoroughly tested.

Developer Notes

• Thread Synchronization: Refactored libams to use platform abstraction layer for
  thread synchronization.

• Type Conversions: Created type-specific ToString functions (vastToa, uvastToa,
  size_tToa) for improved type safety and 32/64-bit compatibility.

This beta release includes 162 commits since ION 4.1.4-a.2, representing extensive
testing, refinement, and new capabilities. Users are encouraged to test thoroughly
in their environments and report any issues through the GitHub issue tracker.

ION Open Source 4.1.3s

%%%%%%%%%%%%%%%%%%%%%%%%%%%
= NOTES ON RELEASE 4.1.3s =
%%%%%%%%%%%%%%%%%%%%%%%%%%%

Beginning with the ION 4.1.3s release, ION will include support for compilation
with Mbed TLS cryptographic library. ION version 4.1.3s includes support for Mbed TLS version 2.28.

To enable use of Mbed TLS cryptogrpahic library in ION, you must have already built the Mbed TLS
version 2.28.x shared libraries with #define MBEDTLS_NIST_KW_C enabled (see mbedtls/include/mbedtls/config.h).

Make sure the Mbed TLS assets are installed in /usr/local/include/ and
/usr/local/lib with correct permissions, or you can define alternate
locations by running:
./configure --enable-crypto-mbedtls MBED_LIB_PATH=/path/to/libraries MBED_INC_PATH=/path/to/includes

To build Mbed TLS:

1. Download the Mbed-TLS 2.28.2 source code.
2. Open mbedtls-2.28.x/include/mbedtls/config.h and uncomment the line
   that has #define MBEDTLS_NIST_KW_C commented out by default.
3. Run the following commands:
   Linux and MacOS)
   make SHARED=1
   sudo make install
   Windows 7)
   make CC="gcc -std=c99" WINDOWS_BUILD=1 SHARED=1
   make CC="gcc -std=c99" WINDOWS_BUILD=1 install
   • NOTE: this should install things in /msys/local which is okay

To compile ION with MBEDTLS_SUITES configure with:
./configure --enable-crypto-mbedtls

To enable BPSec logging (recommended for verification of BPSec functionality and required by BPSec regression tests)
use the following configuration flag:
--enable-bpsec-debugging

The following code changes have been made to support this option:

• Added ici/MBEDTLS_SUITES folder.
• Updated configure.ac and Makefile.am to allow for linking against
  MBEDTLS libraries.

ION 4.1.3s provides a 'enable_manual_build.sh' script that switches ION from autoconf build system (the default)
to the manual developmental build system based consisting of a Makefile at the root of ION source tree and a set of Makefiles
under the directories of individual components of ION. See the online documentation for more details.

Branches included in this release:

update-4.1.3s-ion-documentation

• Update ION documentation files.

update-4.1.3s-bpcounter-delivery-release

• Updates the bpcounter.c program so it releases the pilot bundle.

update-4.1.3s-dtnnone-vulnerability

• Addresses a vulnerability that freezes ION if a bundle with
  null-endpoint were injected into ION node.

update-4.1.3s-imc-pnb-extblock-crash

• Fixes a vulnerability when a pnb extension block contains invalid eid
  (or say imc scheme for a node that does not recognize it) causing a crash
  of the bundle acquisition process.

update-4.1.4-test-suite

• General improvements to the test scripts.

update-4.1.3s-cgrfetch

• Fixes a segfault at the end of cgrfetch call.

update-4.1.3s_libmetadata_libsecypt

• Includes branch update-4.1.3s_bpsec_updates and also update-4.1.3s_secfix_testfix

feature-msys2-update

• Adds autoconf build process for Windows 10 using msys2 and mingw64.
• This update is experimental and has not been tested against MBEDTLS_SUITES
  (just NULL crypto suites).

update-4.1.3s-bpcp-and-test

• Support for how ion-core builds bpcp.
• Creates tests that can imported into ion-core for LTP and STCP
  convergence layers.

4.1.3s_makefile_correction

• Remove incorrect inclusions of libsecrypt and libmetadata from libbp.

update-4.1.4-extension-block-crc16

• Turn on CRC16 for all blocks.

bpsec-fixes-5-27-2024

• APL fix for a specific case where BPSec may allow a bundle to fail BIB/BCB
  but still be accepted.
• Allow relay nodes not to have a policy.

bpsec-fix-1-June-2024

• Fix accounting issue with ZCO when using BIBE with BPSec.

update-4.1.4-ionstart-upgrade

• Update start script to support syntax that allows multiple ionrc files
  to be specified.

update-4.1.4-bssrecv

• Updates to bssrecv program and documentation.

integration-4.1.3s-util-signals-fix

• Added signal handler for SIGINT to properly shut down child processes.
• Added signal handler for SIGTERM for graceful termination of the process.

integration-4.1.3s-smart-file-update

• Updated smart file transfer utilities with file size reporting and improved
  message logging.