You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 21:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sat Jul 11, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
732809994135,5cyclictest335557-21systemd-journal09:10:013
732809994135,4cyclictest335557-21systemd-journal07:30:003
732804993330,2cyclictest743289-21kworker/u8:4+events_unbound07:36:152
732809993226,4cyclictest1040005-21latency_hist12:05:013
732804993128,2cyclictest780263-21kworker/u8:3+flush-259:008:00:212
732804993128,2cyclictest780263-21kworker/u8:3+flush-259:008:00:202
732801993026,3cyclictest831585-21kworker/u8:0+events_unbound09:20:021
732799992923,4cyclictest930662-21latency_hist10:20:010
732801992826,2cyclictest800632-21kworker/u8:0+flush-259:008:25:011
732809992721,4cyclictest962296-21base6410:50:023
732809992721,4cyclictest862739-21latency_hist09:15:013
732804992723,3cyclictest1039645-21kworker/u8:1+flush-259:012:20:492
732804992622,3cyclictest831585-21kworker/u8:0+events_unbound09:25:192
732801992623,2cyclictest780263-21kworker/u8:3+flush-259:008:10:001
732801992623,2cyclictest758558-21kworker/u8:1+flush-259:007:43:551
732801992620,4cyclictest1028800-21ntpq11:50:211
732799992621,3cyclictest743059-21latency_hist07:20:000
732809992518,5cyclictest1029692-21latency_hist11:54:593
732801992521,3cyclictest925737-21kworker/u8:1+events_unbound10:29:231
732804992421,2cyclictest852387-21kworker/u8:3+events_unbound09:05:192
732804992418,4cyclictest998695-21latency_hist11:25:002
732804992417,5cyclictest737889-21latency_hist07:15:002
732801992421,2cyclictest831552-21apt-get08:43:561
732799992419,4cyclictest873056-21latency_hist09:25:010
732799992417,5cyclictest1034843-21latency_hist11:59:590
732801992320,2cyclictest998721-21kworker/u8:2+events_unbound11:30:241
732809992217,3cyclictest852360-21latency_hist09:05:013
732801992219,2cyclictest727668-21kworker/u8:2+events_unbound07:16:041
732799992219,2cyclictest857554-21kworker/u8:5+events_unbound09:30:190
732799992217,3cyclictest335557-21systemd-journal07:27:140
732809992119,1cyclictest888253-21fwupd09:37:283
732809992118,2cyclictest1019234-21kworker/u8:3+events_unbound12:10:003
732809992117,3cyclictest998721-21kworker/u8:2+flush-259:011:40:273
732809992115,4cyclictest877317-21ntpq09:25:223
732804992118,2cyclictest920107-21kworker/u8:4+flush-259:010:15:292
732804992118,2cyclictest903986-21kworker/u8:3+events_unbound10:00:002
732801992118,2cyclictest689192-21kworker/u8:0+events_unbound07:10:011
732801992117,3cyclictest920107-21kworker/u8:4+events_unbound11:15:231
732801992117,3cyclictest836899-21kworker/u8:5+events_unbound08:50:221
732801992117,3cyclictest1008735-21kworker/u8:1+events_unbound11:42:251
732799992119,2cyclictest790327-21kworker/u8:1+flush-259:008:13:250
732799992117,3cyclictest920107-21kworker/u8:4+events_unbound10:55:130
732799992116,4cyclictest780263-21kworker/u8:3+flush-259:008:00:100
732799992116,4cyclictest780263-21kworker/u8:3+flush-259:008:00:100
732809992013,5cyclictest836044-21ntpq08:45:243
732804992017,2cyclictest852387-21kworker/u8:3+events_unbound09:18:162
732804992017,2cyclictest780263-21kworker/u8:3+events_unbound08:05:172
732804992016,3cyclictest764361-21kworker/u8:2+events_unbound08:17:152
732804992014,4cyclictest780127-21cat07:55:002
732801992017,3cyclictest998721-21kworker/u8:2+events_unbound11:46:241
732801992017,2cyclictest780263-21kworker/u8:3+flush-259:008:00:181
732801992017,2cyclictest780263-21kworker/u8:3+flush-259:008:00:181
732809991916,2cyclictest0-21swapper/307:25:013
732809991913,4cyclictest335557-21systemd-journal11:35:383
732809991913,4cyclictest335557-21systemd-journal07:41:143
732809991913,4cyclictest1004140-21apt-get11:30:133
732809991912,5cyclictest993524-21latency_hist11:20:013
732804991917,2cyclictest993271-21kworker/u8:0+events_unbound11:29:252
732804991916,2cyclictest925292-21gpgv10:15:012
732804991916,2cyclictest925292-21gpgv10:15:002
732804991915,3cyclictest998721-21kworker/u8:2+flush-259:012:00:162
732804991915,3cyclictest903986-21kworker/u8:3+events_unbound10:46:002
732804991914,4cyclictest983205-21latency_hist11:10:002
732801991916,2cyclictest920107-21kworker/u8:4+flush-259:010:30:261
732801991916,2cyclictest831585-21kworker/u8:0+events_unbound09:25:251
732801991916,2cyclictest774453-21kworker/u8:0+flush-259:007:55:561
732801991916,2cyclictest1060716-21kworker/u8:0+flush-259:012:35:251
732801991915,3cyclictest821545-21apt-get08:35:121
732799991916,2cyclictest831585-21kworker/u8:0+flush-259:008:45:160
732799991916,2cyclictest821956-21kworker/u8:4+flush-259:008:45:000
732799991916,2cyclictest800632-21kworker/u8:0+events_unbound08:25:150
732809991812,4cyclictest335557-21systemd-journal07:56:143
732804991816,1cyclictest769341-21latency_hist07:45:002
732804991815,2cyclictest920107-21kworker/u8:4+events_unbound10:30:152
732804991815,2cyclictest716796-21kworker/u8:3+flush-259:007:25:232
732804991812,4cyclictest335557-21systemd-journal07:21:122
732801991815,2cyclictest993271-21kworker/u8:0+flush-259:011:22:551
732801991815,2cyclictest920107-21kworker/u8:4+events_unbound11:00:241
732801991815,2cyclictest903986-21kworker/u8:3+events_unbound10:12:261
732801991815,2cyclictest903986-21kworker/u8:3+events_unbound10:12:251
732801991815,2cyclictest1019234-21kworker/u8:3+events_unbound12:15:191
732801991815,2cyclictest0-21swapper/109:00:001
732801991813,4cyclictest955660-21ntpq10:40:231
732799991815,2cyclictest993531-21grep11:20:000
732799991815,2cyclictest790327-21kworker/u8:1+flush-259:008:10:010
732799991815,2cyclictest780263-21kworker/u8:3+flush-259:008:00:010
732799991814,3cyclictest763823-21gpgv07:40:000
732804991714,2cyclictest975962-21kthreadcore11:00:202
732804991714,2cyclictest920107-21kworker/u8:4+flush-259:010:35:252
732804991713,3cyclictest877268-21kworker/u8:1+events_unbound09:37:292
732804991713,3cyclictest1039645-21kworker/u8:1+events_unbound12:05:242
732804991712,4cyclictest335557-21systemd-journal09:14:142
732801991715,2cyclictest946165-21kworker/u8:0+events_unbound10:48:251
732801991714,2cyclictest811603-21kworker/u8:3+flush-259:008:25:261
732801991714,2cyclictest1060716-21kworker/u8:0+events_unbound12:34:261
732801991714,2cyclictest1039645-21kworker/u8:1+events_unbound12:27:231
732801991712,4cyclictest878429-21/usr/sbin/munin09:30:161
732799991714,2cyclictest893653-21kworker/u8:0+flush-259:009:50:240
732799991714,2cyclictest853647-21kthreadcore09:05:180
732799991714,2cyclictest60350irq/132-enp0s29f1:rx-012:10:230
732799991714,2cyclictest0-21swapper/012:25:000
732799991713,3cyclictest903986-21kworker/u8:3+flush-259:010:00:000
732799991711,4cyclictest940993-21latency_hist10:30:010
732809991613,2cyclictest903986-21kworker/u8:3+events_unbound11:00:003
732804991612,3cyclictest998721-21kworker/u8:2+events_unbound11:43:262
732804991610,3cyclictest509-21rs:main2
732801991613,2cyclictest988388-21sh11:15:011
732801991613,2cyclictest913768-21kworker/u8:2+events_unbound10:05:261
732801991613,2cyclictest905053-21irqcore09:55:181
732801991613,2cyclictest747853-21unixbench_singl07:20:251
732801991612,3cyclictest877268-21kworker/u8:1+events_unbound09:44:241
732799991614,1cyclictest60350irq/132-enp0s29f1:rx-012:25:260
732799991614,1cyclictest60350irq/132-enp0s29f1:rx-012:08:150
732799991614,1cyclictest60350irq/132-enp0s29f1:rx-010:10:180
732799991614,1cyclictest60350irq/132-enp0s29f1:rx-010:10:170
732799991614,1cyclictest60350irq/132-enp0s29f1:rx-007:40:260
732799991613,2cyclictest998721-21kworker/u8:2+flush-259:011:42:330
732799991613,2cyclictest946165-21kworker/u8:0+flush-259:010:45:240
732799991613,2cyclictest877268-21kworker/u8:1+events_unbound09:37:270
732799991613,2cyclictest60350irq/132-enp0s29f1:rx-012:35:200
732799991613,2cyclictest60350irq/132-enp0s29f1:rx-008:30:160
732809991511,2cyclictest998721-21kworker/u8:2+flush-259:011:45:203
732804991513,2cyclictest811603-21kworker/u8:3+events_unbound08:43:152
732804991513,2cyclictest780263-21kworker/u8:3+flush-259:008:10:252
732804991513,1cyclictest0-21swapper/211:35:002
732804991512,2cyclictest920107-21kworker/u8:4+flush-259:011:15:262
732804991512,2cyclictest831714-21kworker/u8:1+events_unbound08:45:382
732804991512,2cyclictest716796-21kworker/u8:3+events_unbound07:30:252
732804991511,3cyclictest903986-21kworker/u8:3+events_unbound11:14:262
732804991511,3cyclictest1066042-21kworker/u8:2+events_unbound12:31:252
732804991510,3cyclictest821267-21cron08:35:002
732801991513,2cyclictest920107-21kworker/u8:4+events_unbound10:35:241
732801991513,2cyclictest857554-21kworker/u8:5+events_unbound09:20:151
732801991512,2cyclictest831714-21kworker/u8:1+flush-259:008:46:451
732801991511,3cyclictest790327-21kworker/u8:1+events_unbound08:14:151
732799991513,1cyclictest60350irq/132-enp0s29f1:rx-012:00:250
732799991513,1cyclictest60350irq/132-enp0s29f1:rx-011:35:180
732799991513,1cyclictest60350irq/132-enp0s29f1:rx-011:30:250
732799991513,1cyclictest60350irq/132-enp0s29f1:rx-011:00:160
732799991513,1cyclictest60350irq/132-enp0s29f1:rx-009:15:170
732799991513,1cyclictest60350irq/132-enp0s29f1:rx-009:10:250
732799991513,1cyclictest60350irq/132-enp0s29f1:rx-008:20:150
732799991513,1cyclictest60350irq/132-enp0s29f1:rx-007:20:150
732799991512,2cyclictest826073-21unixbench_singl08:35:240
732799991512,2cyclictest60350irq/132-enp0s29f1:rx-009:00:000
732799991512,2cyclictest60350irq/132-enp0s29f1:rx-008:15:160
732799991512,2cyclictest60350irq/132-enp0s29f1:rx-007:10:210
732799991512,2cyclictest0-21swapper/010:35:000
732799991511,3cyclictest1039645-21kworker/u8:1+events_unbound12:19:270
73280999148,4cyclictest805773-21latency_hist08:20:003
732809991411,2cyclictest957207-21irqcore10:45:173
732804991412,2cyclictest877268-21kworker/u8:1+events_unbound09:30:242
732804991412,1cyclictest0-21swapper/212:19:592
732804991411,2cyclictest925737-21kworker/u8:1+events_unbound10:21:272
732804991411,2cyclictest925737-21kworker/u8:1+events_unbound10:21:272
732804991411,2cyclictest913768-21kworker/u8:2+events_unbound10:00:512
732804991411,2cyclictest1019813-21fschecks_count11:45:152
732804991410,3cyclictest877268-21kworker/u8:1+events_unbound09:41:212
732804991410,3cyclictest836899-21kworker/u8:5+events_unbound08:50:132
732801991412,2cyclictest903986-21kworker/u8:3+flush-259:011:06:541
732801991412,1cyclictest774410-21cron07:50:001
732801991411,2cyclictest920107-21kworker/u8:4+events_unbound10:18:241
732801991411,2cyclictest913768-21kworker/u8:2+events_unbound10:02:251
732801991411,2cyclictest758558-21kworker/u8:1+events_unbound07:50:181
732801991411,2cyclictest716796-21kworker/u8:3+events_unbound07:25:201
732801991411,2cyclictest1019234-21kworker/u8:3+events_unbound12:20:211
73280199141,11cyclictest897945-21sshd09:45:241
732799991413,1cyclictest60350irq/132-enp0s29f1:rx-010:37:030
732799991413,1cyclictest60350irq/132-enp0s29f1:rx-010:01:340
732799991412,1cyclictest60350irq/132-enp0s29f1:rx-011:53:580
732799991412,1cyclictest60350irq/132-enp0s29f1:rx-011:25:150
732799991412,1cyclictest60350irq/132-enp0s29f1:rx-010:50:260
732799991412,1cyclictest60350irq/132-enp0s29f1:rx-010:40:240
732799991412,1cyclictest60350irq/132-enp0s29f1:rx-009:45:300
732799991412,1cyclictest60350irq/132-enp0s29f1:rx-008:50:170
732799991412,1cyclictest0-21swapper/009:40:180
732799991411,2cyclictest60350irq/132-enp0s29f1:rx-009:00:200
73279999141,12cyclictest335557-21systemd-journal11:45:410
73280999139,3cyclictest815701-21unixbench_singl08:25:273
73280999131,2cyclictest930651-21awk10:19:593
732809991310,2cyclictest904712-21cpuspeed_turbos09:55:133
73280499139,3cyclictest800632-21kworker/u8:0+flush-259:008:25:172
732804991310,3cyclictest764361-21kworker/u8:2+events_unbound07:50:012
732804991310,2cyclictest903986-21kworker/u8:3+events_unbound10:55:252
732804991310,2cyclictest857554-21kworker/u8:5+events_unbound09:20:222
732804991310,2cyclictest831585-21kworker/u8:0+flush-259:009:02:442
732804991310,2cyclictest790327-21kworker/u8:1+events_unbound08:21:152
732804991310,2cyclictest1050306-21munin-run12:15:002
732804991310,2cyclictest1019234-21kworker/u8:3+flush-259:011:55:162
732804991310,2cyclictest1019234-21kworker/u8:3+events_unbound11:50:252
732799991312,1cyclictest60350irq/132-enp0s29f1:rx-011:14:320
732799991311,2cyclictest61150irq/133-enp0s29f1:tx-010:05:190
732799991311,1cyclictest60350irq/132-enp0s29f1:rx-011:20:170
732799991311,1cyclictest60350irq/132-enp0s29f1:rx-007:32:030
732799991310,2cyclictest758558-21kworker/u8:1+flush-259:007:50:200
73280999129,2cyclictest910030-21fschecks_time10:00:153
732809991210,1cyclictest0-21swapper/310:05:143
73280499129,2cyclictest774963-21fschecks_time07:50:152
732804991210,1cyclictest0-21swapper/212:40:002
73280199129,2cyclictest920107-21kworker/u8:4+events_unbound10:20:201
73280199129,2cyclictest920107-21kworker/u8:4+events_unbound10:20:191
73280199129,2cyclictest831585-21kworker/u8:0+flush-259:009:00:261
73280199129,2cyclictest816519-21cpuspeed_turbos08:30:121
73280199129,2cyclictest727668-21kworker/u8:2+events_unbound07:10:211
73280199127,3cyclictest335557-21systemd-journal08:15:121
73280199121,8cyclictest335557-21systemd-journal10:50:331
732801991210,1cyclictest1029937-21/usr/sbin/munin11:55:191
73279999129,2cyclictest61150irq/133-enp0s29f1:tx-012:30:150
73279999121,9cyclictest982359-21ntpq11:05:230
73280999118,2cyclictest790640-21cpuspeed_turbos08:05:133
73280499119,2cyclictest893653-21kworker/u8:0+events_unbound09:50:232
73280499118,3cyclictest727668-21kworker/u8:2+flush-259:007:15:212
73280499118,2cyclictest925737-21kworker/u8:1+flush-259:010:25:252
73280499118,2cyclictest1039645-21kworker/u8:1+flush-259:012:25:452
73280199119,1cyclictest0-21swapper/107:40:001
73280199118,2cyclictest900068-21kthreadcore09:50:171
73280199117,3cyclictest998721-21kworker/u8:2+events_unbound12:00:191
73280199117,3cyclictest743289-21kworker/u8:4+flush-259:007:30:301
73280199117,3cyclictest1039645-21kworker/u8:1+events_unbound12:13:261
73280999107,2cyclictest743059-21sh07:20:003
73280999107,2cyclictest1045182-21kworker/u8:2+events_unbound12:15:013
73280999105,4cyclictest762804-21ntpq07:35:213
73280499108,1cyclictest952023-21irqcore10:40:172
73280199107,2cyclictest993271-21kworker/u8:0+events_unbound11:25:251
7328099997,1cyclictest0-21swapper/311:05:153
7328099996,2cyclictest0-21swapper/310:30:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional