Indexing packages that have been uploaded to packagecloud and making them available in the package manager's metadata is handled by a set of background jobs. Adding additional parallelization to this process differs depending on the package type being indexed. Certain types of package metadata cannot be handled concurrently due to technical restrictions of that metadata format.
...
In our internal tests we are able to achieve the following reindexing times for APT and YUM repositories:
- Using a c5.9xlarge AWS EC2 instance with a db.r4.xlarge RDS instance running AWS Aurora
- Reindexes an APT repository with 50,000 Debian packages in about 1min 35s.
- Reindex a YUM repository with 50,000 RPM packages in about 1min and 13s.
Debian packages and APT repositories
The APT repository metadata for a single repository for a single version of Debian or Ubuntu cannot be parallelized by multiple processes. If you upload packages to different repositories, or different Ubuntu/Debian versions of within the same repository, these operations can be handled in parallel.
...