You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 11:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Wed May 27, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4115046994542,2cyclictest4094300-21kworker/u8:3+events_unbound19:40:151
4115042994538,5cyclictest8581-21latency_hist20:35:010
4115046994037,2cyclictest55597-21kworker/u8:1+events_unbound21:25:161
4115054993934,4cyclictest19107-21kworker/u8:1+flush-259:020:50:003
4115046993936,2cyclictest4176879-21kworker/u8:2+events_unbound21:10:141
4115046993936,2cyclictest4066182-21kworker/u8:2+events_unbound19:20:241
4115046993936,2cyclictest201296-21kworker/u8:0+events_unbound00:25:131
4115046993936,2cyclictest123423-21kworker/u8:2+events_unbound22:40:221
4115046993933,3cyclictest4156100-21kworker/u8:0+events_unbound19:55:231
4115046993836,2cyclictest97087-21kworker/u8:3+events_unbound22:50:221
4115046993835,2cyclictest77103-21kworker/u8:3+events_unbound21:45:201
4115046993835,2cyclictest112913-21kworker/u8:1+events_unbound22:15:211
4115046993833,4cyclictest55845-21latency_hist21:20:011
4115046993734,2cyclictest248522-21kworker/u8:4+events_unbound00:35:231
4115046993733,3cyclictest201296-21kworker/u8:0+events_unbound00:17:301
4115046993633,2cyclictest97087-21kworker/u8:3+events_unbound22:35:231
4115046993632,3cyclictest4176879-21kworker/u8:2+events_unbound20:30:231
4115046993632,3cyclictest4176879-21kworker/u8:2+events_unbound20:30:231
4115046993632,3cyclictest216996-21apt-get23:55:031
4115046993632,3cyclictest170154-21kworker/u8:1+events_unbound23:45:301
4115046993630,3cyclictest4110046-21kworker/u8:4+events_unbound19:51:261
4115042993632,3cyclictest4140948-21apt-get19:35:100
4115046993531,3cyclictest97087-21kworker/u8:3+events_unbound23:09:291
4115046993531,3cyclictest112913-21kworker/u8:1+events_unbound22:20:221
4115046993531,3cyclictest102862-21kworker/u8:0+flush-259:022:25:301
4115046993529,4cyclictest154607-21diskstats22:55:141
4115046993430,3cyclictest97087-21kworker/u8:3+events_unbound23:42:221
4115046993430,3cyclictest4156100-21kworker/u8:0+events_unbound20:05:271
4115046993330,2cyclictest4094300-21kworker/u8:3+events_unbound19:15:231
4115046993330,2cyclictest227900-21kworker/u8:3+events_unbound00:31:321
4115046993330,2cyclictest227900-21kworker/u8:3+events_unbound00:05:301
4115046993330,2cyclictest201296-21kworker/u8:0+events_unbound00:20:231
4115046993330,2cyclictest19107-21kworker/u8:1+events_unbound20:50:141
4115046993330,2cyclictest149205-21kworker/u8:4+events_unbound23:20:231
4115046993329,3cyclictest97087-21kworker/u8:3+events_unbound22:03:291
4115046993228,3cyclictest4176879-21kworker/u8:2+events_unbound20:21:271
4115046993228,3cyclictest4094300-21kworker/u8:3+events_unbound20:35:211
4115046993228,3cyclictest4094300-21kworker/u8:3+events_unbound20:10:291
4115042993226,4cyclictest142914-21ntpq22:40:190
4115050993125,4cyclictest335557-21systemd-journal21:31:302
4115046993128,2cyclictest76890-21kworker/u8:1+events_unbound21:41:321
4115046993128,2cyclictest4094300-21kworker/u8:3+events_unbound19:45:201
4115046993128,2cyclictest29229-21kworker/u8:3+flush-259:021:05:201
4115046993128,2cyclictest149205-21kworker/u8:4+events_unbound23:30:131
4115046993127,3cyclictest4110046-21kworker/u8:4+events_unbound19:39:291
4115046993127,3cyclictest149205-21kworker/u8:4+events_unbound23:10:171
4115054993024,4cyclictest4094300-21kworker/u8:3+flush-259:019:50:003
4115050993027,2cyclictest123423-21kworker/u8:2+events_unbound22:45:152
4115050993026,3cyclictest97087-21kworker/u8:3+events_unbound22:10:152
4115050993024,4cyclictest4130408-21latency_hist19:25:012
4115046993027,2cyclictest4110046-21kworker/u8:4+events_unbound19:10:151
4115046993027,2cyclictest149205-21kworker/u8:4+events_unbound23:25:221
4115046993026,3cyclictest97087-21kworker/u8:3+events_unbound22:05:301
4115042993025,3cyclictest66661-21base6421:30:010
411504299300,28cyclictest1-21systemd21:10:000
411504299300,28cyclictest1-21systemd19:28:280
4115054992922,5cyclictest65222-21ntpq21:25:203
4115046992925,3cyclictest4110046-21kworker/u8:4+events_unbound20:41:281
4115046992925,3cyclictest149205-21kworker/u8:4+events_unbound23:00:301
4115042992924,4cyclictest335557-21systemd-journal19:54:590
4115050992824,3cyclictest97087-21kworker/u8:3+flush-259:022:50:262
4115046992825,2cyclictest97087-21kworker/u8:3+events_unbound23:16:311
4115046992825,2cyclictest4094300-21kworker/u8:3+events_unbound20:15:241
4115046992824,3cyclictest97087-21kworker/u8:3+events_unbound23:36:301
4115046992824,3cyclictest4176879-21kworker/u8:2+events_unbound21:30:301
4115046992823,4cyclictest216109-21ntpq23:50:221
4115042992824,3cyclictest4176879-21kworker/u8:2+flush-259:021:10:180
411504299280,27cyclictest1-21systemd23:39:280
4115050992721,5cyclictest221741-21ntpq23:55:212
4115046992725,2cyclictest201296-21kworker/u8:0+events_unbound00:04:291
4115046992724,2cyclictest123423-21kworker/u8:2+flush-259:022:30:231
4115046992723,3cyclictest4176879-21kworker/u8:2+events_unbound21:01:311
4115042992723,3cyclictest227900-21kworker/u8:3+events_unbound00:35:010
4115042992723,3cyclictest149205-21kworker/u8:4+flush-259:023:25:170
4115042992720,5cyclictest335557-21systemd-journal22:29:590
4115054992621,4cyclictest4110046-21kworker/u8:4+flush-259:019:20:003
4115054992621,3cyclictest4192445-21apt-get20:25:113
4115054992619,5cyclictest195042-21ntpq23:30:203
4115050992623,2cyclictest97087-21kworker/u8:3+flush-259:022:30:152
4115050992623,2cyclictest102899-21apt-get22:05:092
4115046992623,3cyclictest4176879-21kworker/u8:2+events_unbound22:14:291
4115046992622,3cyclictest55597-21kworker/u8:1+events_unbound21:21:511
4115046992622,3cyclictest4176879-21kworker/u8:2+events_unbound21:57:311
4115046992619,5cyclictest233461-21diskstats00:10:141
4115042992623,2cyclictest4094300-21kworker/u8:3+events_unbound19:45:180
4115042992623,2cyclictest149205-21kworker/u8:4+events_unbound23:00:210
4115042992621,3cyclictest174434-21ntpq23:10:220
4115054992520,3cyclictest56111-21apt-get21:20:133
4115054992519,4cyclictest70871-21ntpq21:30:243
4115054992514,9cyclictest118040-21cron22:20:003
4115050992522,2cyclictest4110046-21kworker/u8:4+events_unbound19:25:162
4115050992521,3cyclictest4094300-21kworker/u8:3+events_unbound19:40:232
4115050992521,3cyclictest29229-21kworker/u8:3+events_unbound21:05:222
4115050992521,3cyclictest29229-21kworker/u8:3+events_unbound21:03:302
4115046992522,2cyclictest4176879-21kworker/u8:2+events_unbound20:26:441
4115042992522,2cyclictest4094300-21kworker/u8:3+events_unbound20:15:000
4115042992522,2cyclictest201296-21kworker/u8:0+events_unbound00:20:200
4115042992521,3cyclictest19107-21kworker/u8:1+events_unbound20:46:480
4115042992520,4cyclictest66349-21gpgv21:30:010
4115054992418,4cyclictest4176879-21kworker/u8:2+flush-259:020:20:173
4115054992417,5cyclictest253629-21apt-get00:29:193
411505499241,4cyclictest4186993-21awk20:20:013
4115054992411,2cyclictest4172189-21irqcore20:05:173
4115050992421,2cyclictest55597-21kworker/u8:1+events_unbound21:25:232
4115050992421,2cyclictest3390-21kworker/u8:0+flush-259:020:30:012
4115050992420,3cyclictest4176879-21kworker/u8:2+events_unbound21:56:312
4115050992420,3cyclictest4094300-21kworker/u8:3+events_unbound20:41:462
4115050992420,3cyclictest112913-21kworker/u8:1+events_unbound22:20:172
4115050992417,5cyclictest335557-21systemd-journal22:26:302
4115046992420,3cyclictest4176879-21kworker/u8:2+events_unbound21:39:301
4115042992420,3cyclictest149205-21kworker/u8:4+flush-259:023:55:220
4115054992319,3cyclictest159344-21apt-get23:00:013
4115054992318,3cyclictest77110-21/usr/sbin/munin21:40:133
4115054992317,4cyclictest4176912-21apt-get20:10:113
4115054992316,5cyclictest200213-21ntpq23:35:223
4115054992315,6cyclictest4160338-21ntpq19:50:213
4115054992315,5cyclictest206254-21latency_hist23:45:013
4115050992320,2cyclictest97087-21kworker/u8:3+flush-259:023:15:202
4115050992320,2cyclictest97087-21kworker/u8:3+events_unbound23:50:192
4115050992319,3cyclictest4110046-21kworker/u8:4+events_unbound20:00:272
4115050992319,3cyclictest4094300-21kworker/u8:3+events_unbound19:15:252
4115050992319,3cyclictest238199-21kworker/u8:1+events_unbound00:35:302
4115050992319,3cyclictest185364-21sshd23:22:302
4115050992317,4cyclictest335557-21systemd-journal00:25:002
4115042992320,3cyclictest66804-21kworker/u8:0+events_unbound21:35:240
4115042992320,2cyclictest4176879-21kworker/u8:2+events_unbound21:40:230
4115042992320,2cyclictest18896-21kworker/u8:0+flush-259:021:15:160
4115042992319,3cyclictest227900-21kworker/u8:3+flush-259:000:05:180
4115042992319,3cyclictest112913-21kworker/u8:1+flush-259:022:15:200
4115054992216,4cyclictest217594-21cat23:55:023
4115054992216,4cyclictest170113-21awk23:10:003
4115054992215,5cyclictest29633-21diskstats20:55:143
4115054992215,5cyclictest242510-21ntpq00:15:223
4115050992219,2cyclictest4156100-21kworker/u8:0+flush-259:020:05:152
4115050992219,2cyclictest4066182-21kworker/u8:2+flush-259:019:10:252
4115050992218,3cyclictest97087-21kworker/u8:3+events_unbound22:35:132
4115050992218,3cyclictest123423-21kworker/u8:2+events_unbound22:40:162
4115050992217,4cyclictest123423-21kworker/u8:2+events_unbound22:56:312
4115050992216,4cyclictest211613-21apt-key23:50:012
4115046992219,2cyclictest4176879-21kworker/u8:2+events_unbound21:50:371
4115046992219,2cyclictest4110046-21kworker/u8:4+events_unbound19:31:351
4115046992219,2cyclictest19107-21kworker/u8:1+events_unbound20:56:291
4115046992217,2cyclictest4110046-21kworker/u8:4+events_unbound19:27:031
4115042992219,2cyclictest4110046-21kworker/u8:4+events_unbound19:31:330
4115042992218,3cyclictest97087-21kworker/u8:3+events_unbound22:33:300
4115042992218,3cyclictest4176879-21kworker/u8:2+events_unbound21:45:120
4115042992218,3cyclictest4176879-21kworker/u8:2+events_unbound20:25:150
4115042992218,3cyclictest201296-21kworker/u8:0+events_unbound00:01:300
4115042992217,4cyclictest243362-21latency_hist00:20:000
4115054992115,4cyclictest91438-21ntpq21:50:223
4115050992117,3cyclictest149205-21kworker/u8:4+events_unbound23:10:282
4115046992117,3cyclictest19107-21kworker/u8:1+events_unbound20:47:281
4115042992119,1cyclictest107784-21cron22:10:000
4115042992118,2cyclictest4176879-21kworker/u8:2+events_unbound20:20:230
4115042992118,2cyclictest4066182-21kworker/u8:2+flush-259:019:20:210
4115042992117,3cyclictest97087-21kworker/u8:3+flush-259:022:10:180
4115042992117,3cyclictest4156100-21kworker/u8:0+events_unbound19:56:380
4115042992117,3cyclictest4066182-21kworker/u8:2+events_unbound19:10:240
4115042992116,4cyclictest4176879-21kworker/u8:2+events_unbound21:52:310
4115042992116,4cyclictest4094300-21kworker/u8:3+events_unbound19:15:150
4115042992116,3cyclictest97087-21kworker/u8:3+events_unbound22:35:170
4115054992017,2cyclictest4135586-21idleruntime-cro19:30:003
4115050992017,2cyclictest97087-21kworker/u8:3+events_unbound23:35:242
4115050992017,2cyclictest201296-21kworker/u8:0+events_unbound00:18:302
4115050992016,3cyclictest227900-21kworker/u8:3+events_unbound00:30:242
4115046992017,2cyclictest97087-21kworker/u8:3+events_unbound22:46:361
4115042992017,2cyclictest4176879-21kworker/u8:2+events_unbound21:00:210
4115042992017,2cyclictest170154-21kworker/u8:1+flush-259:023:45:160
4115042992016,3cyclictest123423-21kworker/u8:2+events_unbound22:55:220
4115054991915,2cyclictest4176879-21kworker/u8:2+flush-259:022:10:003
4115054991914,4cyclictest335557-21systemd-journal22:53:293
4115054991911,5cyclictest18873-21latency_hist20:45:003
4115050991917,2cyclictest97087-21kworker/u8:3+events_unbound23:05:232
4115050991916,3cyclictest4176879-21kworker/u8:2+events_unbound20:45:222
4115050991916,2cyclictest4094300-21kworker/u8:3+events_unbound20:10:192
4115050991916,2cyclictest227900-21kworker/u8:3+flush-259:000:10:232
4115050991915,3cyclictest77103-21kworker/u8:3+events_unbound21:45:172
4115050991915,3cyclictest4176879-21kworker/u8:2+flush-259:020:30:152
4115050991915,3cyclictest4176879-21kworker/u8:2+flush-259:020:30:152
4115050991914,4cyclictest18896-21kworker/u8:0+flush-259:021:16:352
4115046991916,2cyclictest4156100-21kworker/u8:0+events_unbound20:01:371
4115042991916,3cyclictest149205-21kworker/u8:4+events_unbound23:08:310
4115042991916,2cyclictest18896-21kworker/u8:0+events_unbound20:58:290
4115042991915,3cyclictest4176879-21kworker/u8:2+events_unbound21:20:170
4115042991915,3cyclictest4176879-21kworker/u8:2+events_unbound20:32:280
4115042991915,3cyclictest4110046-21kworker/u8:4+events_unbound20:40:220
4115054991815,2cyclictest238184-21munin-plugin-st00:15:013
4115054991815,2cyclictest211707-21latency_hist23:50:013
4115054991813,3cyclictest0-21swapper/323:15:003
4115050991815,3cyclictest4176879-21kworker/u8:2+events_unbound21:20:152
4115050991815,2cyclictest227900-21kworker/u8:3+events_unbound00:05:162
4115050991814,3cyclictest4176879-21kworker/u8:2+flush-259:021:50:282
4115050991814,3cyclictest170154-21kworker/u8:1+flush-259:023:28:332
4115050991813,3cyclictest201296-21kworker/u8:0+flush-259:000:02:322
4115042991816,1cyclictest149205-21kworker/u8:4+events_unbound23:20:210
4115042991814,3cyclictest4110046-21kworker/u8:4+events_unbound20:01:270
4115042991814,3cyclictest4094300-21kworker/u8:3+events_unbound19:41:370
4115042991814,3cyclictest201296-21kworker/u8:0+events_unbound00:25:110
4115042991814,3cyclictest170154-21kworker/u8:1+flush-259:023:40:110
4115054991714,2cyclictest49378-21ntp_kernel_err21:10:213
4115054991712,3cyclictest253999-21apt-get00:30:123
4115054991711,5cyclictest97087-21kworker/u8:3+flush-259:022:45:003
4115050991714,2cyclictest4094300-21kworker/u8:3+events_unbound20:21:432
4115050991712,4cyclictest4110046-21kworker/u8:4+events_unbound19:53:272
4115050991711,4cyclictest4176879-21kworker/u8:2+flush-259:020:50:112
4115042991715,1cyclictest4156100-21kworker/u8:0+events_unbound20:05:190
4115042991714,2cyclictest112913-21kworker/u8:1+events_unbound22:20:200
4115042991713,3cyclictest97087-21kworker/u8:3+events_unbound23:53:290
4115042991713,3cyclictest97087-21kworker/u8:3+events_unbound22:50:280
4115042991712,4cyclictest227900-21kworker/u8:3+events_unbound00:30:140
4115054991612,3cyclictest19107-21kworker/u8:1+flush-259:020:50:193
4115054991611,4cyclictest4176879-21kworker/u8:2+flush-259:021:01:593
4115054991611,4cyclictest4094300-21kworker/u8:3+flush-259:019:40:243
4115050991613,2cyclictest50611-21latency_hist21:15:002
4115050991612,3cyclictest66804-21kworker/u8:0+events_unbound21:36:422
4115050991612,3cyclictest170154-21kworker/u8:1+events_unbound23:40:152
4115050991612,3cyclictest149205-21kworker/u8:4+events_unbound23:00:222
4115050991612,3cyclictest112913-21kworker/u8:1+events_unbound22:15:172
4115042991613,2cyclictest123423-21kworker/u8:2+flush-259:022:45:250
411505499159,4cyclictest179507-21ntpq23:15:193
411505499157,5cyclictest4140686-21awk19:35:003
4115054991512,2cyclictest0-21swapper/323:55:013
4115054991512,2cyclictest0-21swapper/323:00:013
4115050991513,1cyclictest4156100-21kworker/u8:0+events_unbound19:55:122
4115050991512,2cyclictest4110046-21kworker/u8:4+flush-259:019:35:282
4115050991511,3cyclictest170154-21kworker/u8:1+events_unbound23:34:472
4115042991513,2cyclictest60350irq/132-enp0s29f1:rx-023:18:470
4115042991513,1cyclictest60350irq/132-enp0s29f1:rx-023:34:280
4115042991513,1cyclictest60350irq/132-enp0s29f1:rx-022:00:580
4115042991513,1cyclictest60350irq/132-enp0s29f1:rx-020:35:150
4115042991513,1cyclictest60350irq/132-enp0s29f1:rx-000:10:130
411505499149,4cyclictest123423-21kworker/u8:2+flush-259:022:38:593
411505499149,4cyclictest112913-21kworker/u8:1+flush-259:022:20:263
4115054991411,2cyclictest61850irq/147-enp0s29f1:tx-700:20:143
411505099149,4cyclictest76890-21kworker/u8:1+events_unbound21:40:082
4115050991411,2cyclictest4094300-21kworker/u8:3+flush-259:020:15:192
4115050991411,2cyclictest4094300-21kworker/u8:3+events_unbound20:38:502
4115050991410,3cyclictest19107-21kworker/u8:1+flush-259:020:55:252
411505499131,9cyclictest264146-21awk00:40:003
4115054991311,1cyclictest4144863-21needreboot19:35:183
411505099139,3cyclictest97087-21kworker/u8:3+events_unbound22:00:082
411505099139,3cyclictest4110046-21kworker/u8:4+events_unbound19:31:422
4115042991312,1cyclictest60350irq/132-enp0s29f1:rx-021:59:300
4115054991210,1cyclictest0-21swapper/321:05:183
411505099129,2cyclictest248829-21cpuspeed_turbos00:25:102
411505099128,3cyclictest4094300-21kworker/u8:3+flush-259:019:45:222
411505499118,2cyclictest228207-21cpuspeed_turbos00:05:163
411505499115,4cyclictest66804-21kworker/u8:0+flush-259:021:35:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional