1
0
Fork 0
mirror of https://github.com/kubernetes-sigs/node-feature-discovery.git synced 2025-03-31 04:04:51 +00:00
node-feature-discovery/pkg/nfd-master
Markus Lehtonen 8ad6210d5c nfd-master: use separate k8s api clients for each updater
Sharing the same client between updater threads virtually serializes
access, in practice making the effective parallelism close to 1.

With this patch, in my bench cluster of 300 nodes, the time taken by
updating all nodes drops from ~2 minutes to ~12 seconds (with the
default parallelism of 10 node updater threads). This demonstrates the
10-fold increased parallelism from ~1 to 10.

There might be other solutions that could be explored, e.g. caching
nodes with an indexer/lister but otoh nfd doesn't necessarily need/want
to watch every little change in each node. We only need to get the node
when something in our own CRDs change (we don't react to any changes in
the node object itself). Using multiple clients was the most obvious
choice to solve the problem for now.
2024-04-15 19:00:30 +03:00
..
metrics.go Refactor metrics 2023-10-09 10:49:12 +03:00
nfd-api-controller.go Tidy up usage of channels for signaling 2024-04-05 14:39:58 +03:00
nfd-api-controller_test.go nfd-master: refactor api-controller object handling 2023-04-28 17:33:33 +03:00
nfd-master-internal_test.go nfd-master: use separate k8s api clients for each updater 2024-04-15 19:00:30 +03:00
nfd-master.go nfd-master: use separate k8s api clients for each updater 2024-04-15 19:00:30 +03:00
nfd-master_test.go nfd-master: parse kubeconfig even with NoPublish set 2024-04-08 14:25:27 +03:00
node-updater-pool.go nfd-master: use separate k8s api clients for each updater 2024-04-15 19:00:30 +03:00
node-updater-pool_test.go nfd-master: implement opts for modifying NfdMaster instance 2024-04-05 20:21:19 +03:00