v1.2.0-experimental-sql-indexing-v3

Warning

For testing only! Do not use this without knowing the risks.

Main differences from v2 experimental release:

1. batch size reduced from 5000 to 1000 to help keep per transaction memory smaller
2. cache size allocation changes -- minimal difference
3. shrink_memory usage changes
4. fixes to folder size and index status updates.

In the stable/beta releases of FileBrowser Quantum, all memory (RAM) is held in application space. A difference you may notice here is that sqlite can sometimes use more memory on docker stats or total os memory statistics like task manager. But here's an explanation for whats going on and what to look for:

Previously, all memory used by the index was critical and held by the application in a way that would OOM if there was not enough RAM available. With sqlite, its possible theres paged memory which can increase but should not cause OOM because its reclaimable by the OS.

Now, its safe and useful to place limits in docker memory if needed -- and this will actually keep memory lower in docker stats because the os will reclaim the paged cache

I also added the option to use the cgo driver if you complie with flag cgosql , but I have it compiled without it because I didn't find any benefit in using the cgo driver when enabling it (which is great!)

v1.1.4-beta

What's Changed

New Features:

• toggle to show searching results with thumbnails #1545

Notes:

• file list has loading spinner to help prevent double click issues and give better feedback
• improved cacheDir startup checks
  • warning for slow read/write speeds below 50MB/s
  • warning for low free space below 20GB
  • warning if read/write latency is slow
  • fatal for any errors reading or writing to the directory
  • links to official docs for more info
• access rule changes:
  • denied folders won't show up in parent directory listing view (#1684)
  • tools will respect access rules
  • shares will check access rules based on user that created the share

BugFixes:

• passwords with special characters not working properly (#1648)
• encoded filename navigation issue (#1711)
• Fix/Improve some behaviors in nextPrevious (#1707)
• Files recognized as folder if they have the same name as previously deleted folders #1697
• multi logger support issue #1701

New Contributors

• @StefPanther made their first contribution in #1682

Full Changelog: #1724

v1.1.0-stable

What's Changed

This update brings all 1.1.4 beta changes to stable.

New Features:

• toggle to show searching results with thumbnails #1545
• Added tools
  • file size analyser -- quickly show the largest files in an interactive graphical chart
  • duplicate finder -- find probable duplicate files larger than 1MB
  • material icon picker and previewer
• Listing View Style updates
  • Status bar for listing view #1459
  • Duration field shows up if media is shown with duration
  • More dynamic view modes with additional styling changes
  • Total display modes consolidated into 3 main groups: list, gallery, normal. "icon" and "compact" mode exist as views based on display size setting.
• Customizable sidebar links
  • Logged-in users can have their preferences saved and synced
  • Can rearrange, add custom links, and save your preferences.
  • Can customise shares with their own custom sidebar links.
• Dynamic scopes for OIDC #1414 #1363
• Share and Access Rules validation
  • If a file/path is moved/renamed in UI, its rules and shares will always follow.
  • If a file/path is moved/renamed outside UI, a warning message will show andthe ability to associate with the new path
• Cascade delete access in Access Management when deleting a User #1347
• Enhanced notifications #1331
  • Added "toast" notification type support -- most success messages show as toast now.
  • multiple stacked notifications possible
  • notification button support, such as clicking to open a folder after moving a file.
  • notification history (not including toasts)
  • Add swipe and visual timeout to notifications #1600
• Choose different bind IP via server.listen #1573
• Allow disabling clearing cache each startup via server.cacheDirCleanup: false in config #1576

Notes:

• file list has loading spinner to help prevent double click issues and give better feedback
• improved cacheDir startup checks
  • warning for slow read/write speeds below 50MB/s
  • warning for low free space below 20GB
  • warning if read/write latency is slow
  • fatal for any errors reading or writing to the directory
  • links to official docs for more info
• access rule changes:
  • denied folders won't show up in parent directory listing view (#1684)
  • tools will respect access rules
  • shares will check access rules based on user that created the share
• continue create user dir scope even if filesystem path creation fails #1509
• access control cache is cleared more aggresively to ensure no delay
• removed default .ico favicon in favor of .svg

BugFixes:

• passwords with special characters not working properly (#1648)
• Fix/Improve some behaviors in nextPrevious (#1707)
• Files recognized as folder if they have the same name as previously deleted folders #1697
• multi logger support issue #1701

Full Changelog: v1.0.3-stable...v1.1.0-stable

v1.2.0-experimental-sql-indexing

Warning

For testing only! Do not use this without knowing the risks. Do not run this without monitoring or on any critical data.

This is an experimental version which may be included in v1.2.0-beta when ready -- stores indexing data in sqlite instead of memory.

You may notice:

1. different indexing times (equivalent in my testing)
2. slower UI and API performance (equivalent in my testing)
3. reduced memory usage ( varies > 50% reduction in my testing)
4. Indexing info may not update as expected (please join the discussion to mention this if you notice it)

Please share your results on the discussion thread: #1700

v1.1.3-beta

What's Changed

Notes:

• continue create user dir scope even if filesystem path creation fails #1509
• access control cache is cleared more aggresively to ensure no delay
• removed default .ico favicon in favor of .svg

BugFixes:

• indexing used size increases over time #1685
• download progress is not shown #1687

New Contributors

• @StefPanther made their first contribution in #1682

Full Changelog: #1695

v1.0.3-stable

What's Changed

BugFixes:

• download progress is not shown #1687

Full Changelog: v1.0.2-stable...v1.0.3-stable

v1.1.2-experimental-sqlite-indexing-v2

Warning

For testing only! Do not use this without knowing the risks. Do not run this without monitoring or on any critical data.

This is an experimental version which may be included in future beta versions -- stores indexing data in sqlite instead of memory. You may notice:

1. different indexing times (equivalent in my testing)
2. slower UI and API performance (equivalent in my testing)
3. reduced memory usage ( varies - 50% reduction in my testing)

v1.1.2-beta

What's Changed

Notes:

• changes to duplicate detector
  • temp SQLite database each query to reduce memory pressure
  • max limit is 500 groups total
• Downloads from UI requests utf-8 formatted names to support chinese and other characters. Updated swagger docs. #1671
• beta releases no longer publish to latest docker tag #1675

BugFixes:

• better index status updates, fixing delays #1649
• fixed long load times for listings with media info due sequential processing of files.
• downloaded files always included utf-8 in filename #1671
• custom sidebar links allow external links like https://google.com
• html title not populated correctly for links #1676

Full Changelog: v1.1.1-beta...v1.1.2-beta

v1.0.2-stable

What's Changed

Notes:

• [docker] upgraded ffmpeg 8.0 to 8.0.1

BugFixes:

• added missing exiftool to docker image for heic conversion orientation support
• Uploading a file will silently overwrite any existing file with the same name #1564
• Unable to download folder as ZIP #1604
• issues downloading and file actions on password protected share

Full Changelog: v1.0.1-stable...v1.0.2-stable

v1.1.1-beta

What's Changed

Notes:

• [docker] upgraded ffmpeg 8.0 to 8.0.1
• stricter access control checks on file downloads.
• Wrong translation on Chinese "save" button #1650
• Incorrect Spanish Translations in Folder Creation and Rename Actions #1626
• duplicate file detector has stricter partial checksum match #1617

BugFixes:

• added missing exiftool to docker image for heic conversion orientation support
• v1.1.0-beta - Incorrect naming of 1 file in directory-info #1621
• disable only office viewing settings not applying
• OnlyOffice integration does not work behind proxy authentication #1422
• Newly created users "add on" to defined scope of previous user #1628 #1518
• disable chown on upload / file saving #1469 #1546
• Uploading a file will silently overwrite any existing file with the same name #1564
• share file url issue
• Fix drag and drop and rows in normal view #1651
• Some text based files are not able to edit. #1567

Full Changelog: https://github.com/gtsteffaniak/filebrowser/pull/1655/files