feat: search objects v2

[fenos]

What kind of change does this PR introduce?

Feature

What is the current behavior?

Super slow search functionality when there are millions of objects

What is the new behavior?

Fast, reliable and performant search functionality across hundreds of millions of objects

[za-arthur]

Thank you for the PR. In overall all looks good to me. I just left couple of comments below.

[coveralls]

Pull Request Test Coverage Report for Build 13284154280

Warning: This coverage report may be inaccurate.

This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

• For more information on this, see Tracking coverage changes with pull request builds.
• To avoid this issue with future PRs, see these Recommended CI Configurations.
• For a quick fix, rebase this PR at GitHub. Your next report should be accurate.

Details

• 311 of 685 (45.4%) changed or added relevant lines in 18 files are covered.
• 8 unchanged lines in 3 files lost coverage.
• Overall coverage decreased (-0.8%) to 76.487%

---

Changes Missing Coverage	Covered Lines	Changed/Added Lines	%
src/http/plugins/db.ts	2	3	66.67%
src/storage/events/workers.ts	7	8	87.5%
src/storage/object.ts	77	81	95.06%
src/storage/database/knex.ts	20	27	74.07%
src/internal/database/migrations/progressive.ts	0	9	0.0%
src/storage/events/run-migrations.ts	1	12	8.33%
src/internal/queue/event.ts	1	14	7.14%
src/http/routes/object/listObjectsV2.ts	51	72	70.83%
src/http/routes/admin/migrations.ts	8	37	21.62%
src/http/routes/admin/tenants.ts	15	50	30.0%

Files with Coverage Reduction	New Missed Lines	%
src/internal/database/migrations/migrate.ts	1	45.79%
src/storage/events/workers.ts	1	56.25%
src/storage/database/knex.ts	6	85.03%

Totals
Change from base Build 12952108566:	-0.8%
Covered Lines:	15408
Relevant Lines:	19996

---

💛 - Coveralls

[za-arthur]

Thank you for the changes. LGTM.

[snyk-io]

⛔ Snyk checks have failed. 1 issues have been found so far.

Icon	Severity	Issues
	Critical	0
	High	1
	Medium	0
	Low	0

⛔ code/snyk check is complete. 1 issues have been found. (View Details)

[snyk-io]

  Cross-site Scripting (XSS)

Unsanitized input from an HTTP parameter flows into send, where it is used to render an HTML page returned to the user. This may result in a Cross-Site Scripting attack (XSS).

Line 69 | CWE-79 | Priority score 789 | Learn more about this vulnerability

Data flow: 11 steps

Step 1 - 4

storage/src/http/routes/object/listObjectsV2.ts

Line 59 in 1d2d112

const { bucketName } = request.params

Step 5 - 9 src/http/routes/object/listObjectsV2.ts#L62

Step 10 - 11

storage/src/http/routes/object/listObjectsV2.ts

Line 69 in 1d2d112

return response.status(200).send(results)

[github-actions]

🎉 This PR is included in version 1.19.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀