You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-05 - 23:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Wed Aug 05, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
370419921260,2sleep33056-21PK-Backend11:14:413
367968621210,3sleep30-21swapper/310:10:213
369689021180,2sleep13056-21PK-Backend11:00:191
36588102730,3sleep33056-21PK-Backend08:15:003
139099730,60rtkit-daemon0-21swapper/307:06:023
364876526545,14sleep20-21swapper/207:06:102
364876926440,17sleep10-21swapper/107:06:131
364878826342,14sleep00-21swapper/007:06:280
36897842450,4sleep13056-21PK-Backend10:40:181
3649294993119,9cyclictest883-21dbus-daemon11:14:061
139099310,4rtkit-daemon1389-21rtkit-daemon11:19:233
139099310,4rtkit-daemon1389-21rtkit-daemon10:48:243
36530572300,6sleep10-21swapper/107:35:001
37345962290,4chrt3056-21PK-Backend12:15:130
3649303992816,9cyclictest899-21polkitd11:15:362
3649285992719,6cyclictest883-21dbus-daemon11:16:130
3649303992621,3cyclictest34-21ksoftirqd/211:13:582
3649285992520,4cyclictest2019-21gmain11:05:000
3649285992516,7cyclictest883-21dbus-daemon11:14:360
139099250,4rtkit-daemon1389-21rtkit-daemon08:48:092
139099240,3rtkit-daemon1389-21rtkit-daemon10:38:252
37397212230,4sleep00-21swapper/012:30:010
364930599230,21cyclictest3056-21PK-Backend08:56:133
3649294992315,6cyclictest883-21dbus-daemon11:15:291
3649294992311,9cyclictest883-21dbus-daemon10:13:041
139099230,4rtkit-daemon1389-21rtkit-daemon11:33:002
37328392220,4sleep30-21swapper/312:10:113
3649305992215,5cyclictest3690614-21cron10:45:003
3649305992214,6cyclictest883-21dbus-daemon12:16:113
364930599220,20cyclictest3736804-21diskstats12:20:143
364930599220,20cyclictest3056-21PK-Backend09:20:263
364930599220,20cyclictest3056-21PK-Backend07:37:183
3649303992220,1cyclictest0-21swapper/209:54:582
3649303992220,1cyclictest0-21swapper/209:06:112
3649303992220,1cyclictest0-21swapper/208:40:232
3649303992220,1cyclictest0-21swapper/207:55:212
3649303992220,1cyclictest0-21swapper/207:17:422
3649303992220,1cyclictest0-21swapper/207:17:422
364930399220,21cyclictest0-21swapper/208:29:212
3649294992220,1cyclictest3056-21PK-Backend11:28:101
3649294992220,1cyclictest3056-21PK-Backend10:47:551
3649294992220,1cyclictest0-21swapper/110:05:441
3649294992220,1cyclictest0-21swapper/109:19:061
3649294992214,6cyclictest436-20systemd-journal11:55:001
364929499220,9cyclictest36715482cpu09:50:081
3649285992214,6cyclictest436-20systemd-journal09:20:000
364928599220,20cyclictest0-21swapper/012:37:510
139099220,4rtkit-daemon1389-21rtkit-daemon08:54:122
139099220,3rtkit-daemon1389-21rtkit-daemon11:37:152
139099220,18rtkit-daemon1009-21lldpd10:37:303
3649305992119,1cyclictest3056-21PK-Backend11:03:283
364930599210,3cyclictest3673057-21munin-run09:55:013
364930599210,2cyclictest3056-21PK-Backend07:41:103
364930599210,1cyclictest3056-21PK-Backend12:37:513
364930599210,1cyclictest3056-21PK-Backend07:20:023
364930599210,1cyclictest3056-21PK-Backend07:20:013
364930599210,19cyclictest3056-21PK-Backend08:50:183
364930599210,19cyclictest3056-21PK-Backend08:26:193
3649303992119,1cyclictest3056-21PK-Backend08:23:332
3649303992119,1cyclictest0-21swapper/212:20:392
3649303992119,1cyclictest0-21swapper/211:09:272
3649303992119,1cyclictest0-21swapper/210:11:282
3649303992119,1cyclictest0-21swapper/210:07:022
3649303992119,1cyclictest0-21swapper/209:59:112
3649303992119,1cyclictest0-21swapper/209:33:022
3649303992119,1cyclictest0-21swapper/209:12:202
3649303992119,1cyclictest0-21swapper/208:06:362
3649303992119,1cyclictest0-21swapper/207:46:152
3649303992115,4cyclictest34-21ksoftirqd/212:07:352
3649303992113,6cyclictest3661750-21munin-plugin-st08:40:002
364930399210,20cyclictest0-21swapper/211:21:172
364930399210,20cyclictest0-21swapper/210:46:162
364930399210,20cyclictest0-21swapper/207:38:172
364930399210,1cyclictest3739909-21apt12:30:122
3649294992119,1cyclictest0-21swapper/111:36:011
3649294992119,1cyclictest0-21swapper/109:49:071
3649294992119,1cyclictest0-21swapper/109:33:531
3649294992119,1cyclictest0-21swapper/109:21:581
3649294992119,1cyclictest0-21swapper/108:27:351
3649294992119,1cyclictest0-21swapper/108:14:511
3649294992119,1cyclictest0-21swapper/108:06:471
3649294992119,1cyclictest0-21swapper/108:04:181
3649294992117,3cyclictest3687158-21turbostat.cron10:35:001
364929499210,20cyclictest3056-21PK-Backend11:22:291
364929499210,20cyclictest0-21swapper/107:56:051
364929499210,19cyclictest3056-21PK-Backend12:30:021
3649285992114,6cyclictest3668264-21apt-get09:30:000
364928599210,20cyclictest0-21swapper/011:27:040
364928599210,20cyclictest0-21swapper/008:11:080
364928599210,19cyclictest3056-21PK-Backend10:45:030
139099210,17rtkit-daemon3649278-21cyclictest08:23:333
3649305992018,1cyclictest3056-21PK-Backend08:30:113
3649305992018,1cyclictest0-21swapper/310:15:083
3649305992016,2cyclictest3693022-21hddtemp_smartct10:50:173
364930599200,1cyclictest3056-21PK-Backend10:20:433
364930599200,1cyclictest3056-21PK-Backend09:01:003
364930599200,1cyclictest3056-21PK-Backend08:08:143
364930599200,1cyclictest3056-21PK-Backend07:27:523
364930599200,1cyclictest0-21swapper/312:30:353
364930599200,19cyclictest3056-21PK-Backend11:53:233
364930599200,19cyclictest3056-21PK-Backend09:48:323
364930599200,19cyclictest0-21swapper/312:02:433
364930599200,19cyclictest0-21swapper/311:24:293
364930599200,19cyclictest0-21swapper/310:07:383
364930599200,19cyclictest0-21swapper/310:03:263
364930599200,18cyclictest3056-21PK-Backend09:09:253
3649303992018,1cyclictest0-21swapper/212:38:162
3649303992018,1cyclictest0-21swapper/211:55:582
3649303992018,1cyclictest0-21swapper/211:50:242
3649303992018,1cyclictest0-21swapper/211:28:342
3649303992018,1cyclictest0-21swapper/210:33:522
3649303992018,1cyclictest0-21swapper/210:28:382
3649303992018,1cyclictest0-21swapper/208:55:512
3649303992018,1cyclictest0-21swapper/208:14:412
3649303992018,1cyclictest0-21swapper/207:44:532
3649303992018,1cyclictest0-21swapper/207:27:292
3649303992018,1cyclictest0-21swapper/207:21:212
3649303992018,1cyclictest0-21swapper/207:21:212
3649303992016,3cyclictest1095-21runrttasks12:02:062
3649303992013,6cyclictest3676026-21ntp_states10:00:202
364930399200,19cyclictest0-21swapper/210:54:002
364930399200,19cyclictest0-21swapper/210:23:242
364930399200,19cyclictest0-21swapper/209:03:412
364930399200,19cyclictest0-21swapper/208:34:352
3649294992018,1cyclictest3056-21PK-Backend12:02:381
3649294992018,1cyclictest3056-21PK-Backend11:30:201
3649294992018,1cyclictest0-21swapper/112:36:311
3649294992018,1cyclictest0-21swapper/110:35:111
3649294992018,1cyclictest0-21swapper/110:20:311
3649294992018,1cyclictest0-21swapper/109:40:561
3649294992018,1cyclictest0-21swapper/109:25:211
3649294992018,1cyclictest0-21swapper/109:07:171
3649294992018,1cyclictest0-21swapper/108:51:011
3649294992018,1cyclictest0-21swapper/108:21:131
3649294992018,1cyclictest0-21swapper/108:19:171
3649294992018,1cyclictest0-21swapper/108:19:171
3649294992018,1cyclictest0-21swapper/107:35:591
3649294992018,1cyclictest0-21swapper/107:29:361
3649294992013,5cyclictest436-20systemd-journal11:45:001
364929499200,19cyclictest0-21swapper/108:56:221
3649285992018,1cyclictest0-21swapper/012:23:420
3649285992018,1cyclictest0-21swapper/011:51:580
3649285992018,1cyclictest0-21swapper/009:43:210
3649285992016,3cyclictest0-21swapper/011:07:370
3649285992012,6cyclictest883-21dbus-daemon11:57:330
364928599200,1cyclictest0-21swapper/010:41:280
364928599200,1cyclictest0-21swapper/008:40:280
364928599200,1cyclictest0-21swapper/008:03:380
364928599200,19cyclictest3056-21PK-Backend10:37:020
364928599200,19cyclictest0-21swapper/011:20:010
364928599200,19cyclictest0-21swapper/010:31:140
364928599200,19cyclictest0-21swapper/008:39:370
364928599200,19cyclictest0-21swapper/008:22:300
364928599200,19cyclictest0-21swapper/007:54:180
364928599200,19cyclictest0-21swapper/007:49:110
364928599200,19cyclictest0-21swapper/007:40:330
364928599200,19cyclictest0-21swapper/007:27:140
3649305991917,1cyclictest3056-21PK-Backend11:06:263
3649305991916,2cyclictest3056-21PK-Backend08:16:183
3649305991916,2cyclictest3056-21PK-Backend08:16:183
3649305991912,5cyclictest3673962-21strings09:55:193
3649305991911,6cyclictest42-21ksoftirqd/312:07:243
364930599190,1cyclictest3056-21PK-Backend09:18:443
364930599190,18cyclictest0-21swapper/312:29:473
364930599190,18cyclictest0-21swapper/311:25:183
364930599190,18cyclictest0-21swapper/310:58:353
364930599190,18cyclictest0-21swapper/308:39:383
364930599190,17cyclictest3056-21PK-Backend07:49:453
3649303991917,1cyclictest0-21swapper/210:40:282
3649303991917,1cyclictest0-21swapper/209:15:242
3649303991917,1cyclictest0-21swapper/208:16:382
3649303991917,1cyclictest0-21swapper/208:16:372
3649303991917,1cyclictest0-21swapper/208:04:062
364930399190,1cyclictest0-21swapper/210:18:582
364930399190,1cyclictest0-21swapper/207:32:292
364929499193,14cyclictest3650254-21systemd07:15:021
364929499193,14cyclictest3650254-21systemd07:15:011
364929499192,12cyclictest3727514-21apt11:55:101
3649294991917,1cyclictest3056-21PK-Backend10:18:001
3649294991917,1cyclictest0-21swapper/109:13:251
3649294991917,1cyclictest0-21swapper/109:04:121
3649294991917,1cyclictest0-21swapper/107:46:251
3649294991914,3cyclictest3676745-21dump-pmu-power10:05:001
3649294991912,5cyclictest3655881-21gpgv07:55:001
3649294991911,6cyclictest436-20systemd-journal07:10:021
364929499190,1cyclictest3056-21PK-Backend12:12:311
364929499190,1cyclictest3056-21PK-Backend12:07:111
364929499190,1cyclictest3056-21PK-Backend10:56:471
364929499190,1cyclictest0-21swapper/111:05:461
364929499190,1cyclictest0-21swapper/108:45:401
364929499190,18cyclictest3056-21PK-Backend10:52:211
3649285991917,1cyclictest0-21swapper/009:11:380
3649285991917,1cyclictest0-21swapper/008:47:310
3649285991916,2cyclictest3056-21PK-Backend10:50:200
3649285991912,5cyclictest3724036-21find11:45:120
3649285991912,5cyclictest3679451-21awk10:10:180
3649285991911,6cyclictest3658984-21cron08:17:000
3649285991911,6cyclictest3658984-21cron08:17:000
364928599190,1cyclictest3056-21PK-Backend12:10:220
364928599190,1cyclictest0-21swapper/012:32:440
364928599190,1cyclictest0-21swapper/009:49:060
364928599190,1cyclictest0-21swapper/008:58:130
364928599190,1cyclictest0-21swapper/008:54:000
364928599190,1cyclictest0-21swapper/008:30:150
364928599190,1cyclictest0-21swapper/007:39:110
364928599190,1cyclictest0-21swapper/007:32:490
364928599190,18cyclictest3723516-21cron11:45:000
364928599190,18cyclictest0-21swapper/011:33:190
364928599190,18cyclictest0-21swapper/010:58:250
364928599190,18cyclictest0-21swapper/010:27:210
364928599190,18cyclictest0-21swapper/010:00:320
364928599190,18cyclictest0-21swapper/008:26:220
364928599190,18cyclictest0-21swapper/007:23:370
364928599190,18cyclictest0-21swapper/007:23:360
3649305991816,1cyclictest3056-21PK-Backend11:55:473
3649305991815,2cyclictest3056-21PK-Backend10:25:433
3649305991815,1cyclictest3056-21PK-Backend09:38:043
3649305991814,2cyclictest3056-21PK-Backend07:32:183
3649305991812,5cyclictest3663140-21sed08:50:013
3649305991812,4cyclictest3719040-21if_err_enp2s011:30:173
3649305991811,5cyclictest3721784-21cron11:40:003
364930599180,1cyclictest3056-21PK-Backend08:03:033
3649303991816,1cyclictest0-21swapper/210:57:172
3649303991816,1cyclictest0-21swapper/209:39:312
3649303991813,3cyclictest34-21ksoftirqd/212:16:022
3649303991812,4cyclictest2156-21gnome-shell12:28:082
3649303991811,5cyclictest3725031-21grep11:45:232
3649294991816,1cyclictest0-21swapper/110:25:311
3649294991816,1cyclictest0-21swapper/107:41:121
3649294991813,4cyclictest26-21ksoftirqd/112:16:011
3649294991810,6cyclictest3724051-21apt11:45:131
364928599189,7cyclictest883-21dbus-daemon12:07:240
3649285991816,1cyclictest0-21swapper/012:01:180
3649285991816,1cyclictest0-21swapper/008:05:340
3649285991813,3cyclictest3683265-21timerwakeupswit10:20:220
3649285991811,5cyclictest3649081-21apt-get07:10:020
364928599180,1cyclictest0-21swapper/009:35:100
364930599172,13cyclictest3669145-21munin-run09:35:003
3649305991711,4cyclictest3662558-21cut08:45:013
364930399179,6cyclictest1-21systemd07:15:002
3649303991713,3cyclictest34-21ksoftirqd/211:45:012
3649303991712,3cyclictest34-21ksoftirqd/209:45:002
3649294991715,1cyclictest0-21swapper/108:38:031
3649294991715,1cyclictest0-21swapper/107:23:271
3649294991715,1cyclictest0-21swapper/107:23:271
364929499170,14cyclictest3661112-21sh08:35:001
364928599179,6cyclictest3720326-21apt11:35:130
3649285991715,1cyclictest0-21swapper/010:16:470
3649285991715,1cyclictest0-21swapper/009:00:430
3649285991712,4cyclictest978-21snmpd07:57:080
3649285991711,5cyclictest3667788-21ls09:25:000
3649285991710,5cyclictest436-20systemd-journal09:35:010
3649285991710,5cyclictest3650676-21python307:15:030
3649285991710,5cyclictest3650676-21python307:15:030
3649305991614,1cyclictest0-21swapper/307:10:413
3649305991611,3cyclictest3655845-21latency_hist07:55:003
3649305991610,4cyclictest42-21ksoftirqd/308:00:003
364930599160,14cyclictest978-21snmpd09:42:113
3649303991614,1cyclictest0-21swapper/207:50:142
3649303991610,5cyclictest3697107-21cat11:00:212
364930399160,14cyclictest3733166-21expr12:10:132
364928599163,11cyclictest3674774-21apt-get10:00:000
3649285991614,1cyclictest0-21swapper/010:07:350
3649285991614,1cyclictest0-21swapper/009:08:340
3649285991611,3cyclictest3671752-21cstates09:50:090
3649305991513,1cyclictest3056-21PK-Backend10:31:313
3649305991513,1cyclictest3056-21PK-Backend09:11:553
3649305991513,1cyclictest3056-21PK-Backend07:19:273
3649305991513,1cyclictest3056-21PK-Backend07:19:273
3649305991511,3cyclictest3056-21PK-Backend09:27:383
364929499158,5cyclictest3669511-21seq09:36:541
3649294991511,3cyclictest3056-21PK-Backend12:25:041
3649294991510,4cyclictest3056-21PK-Backend08:42:251
364930599149,3cyclictest3725516-21latency_hist11:50:013
364930399148,4cyclictest2156-21gnome-shell09:46:092
364930399143,9cyclictest3668340-21dpkg09:30:002
3649303991411,2cyclictest3667631-21turbostat09:25:002
3649294991412,1cyclictest3056-21PK-Backend09:59:491
3649305991311,1cyclictest3056-21PK-Backend11:40:053
3649294991210,1cyclictest3056-21PK-Backend12:20:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional