• Lead: jayesh
• Priority: high
• Effort: ??

Description:

Define and implement an efficient structure for pagination in the data sources for swh-storage.

Pagination in the data sources (eg storage) is not very consistent and client friendly. Defining and implementing an efficient structure will be a good improvement. This will also involve re-factoring some clients.

Includes work:

• Design an efficient pagination architecture
• Refactor obj-storage to implement the pagination
• Identify and refactor existing clients that use swh-storage pagination

KPIs:

• New pagination solution in production for swh-storage
• Existing clients updated to use this solution