You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 20:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Wed Apr 15, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
317727924640,10sleep00-21swapper/007:05:120
317757422310,22sleep234-21ksoftirqd/207:05:182
323494021370,3sleep23233825-21/usr/sbin/munin09:45:232
322507621140,2sleep33056-21PK-Backend09:20:143
327652221080,4sleep33056-21PK-Backend11:45:023
324351121070,3sleep20-21swapper/210:10:202
322925321010,3sleep20-21swapper/209:30:182
317820727238,9sleep10-21swapper/107:07:031
31824992640,3sleep33182498-21systemd-run07:20:003
317824626243,13sleep30-21swapper/307:07:343
32245862530,4sleep20-21swapper/209:20:012
139099390,3rtkit-daemon0-21swapper/207:42:362
32505752380,3sleep10-21swapper/110:30:211
317858199301,3cyclictest26-21ksoftirqd/112:35:021
3178581992716,3cyclictest26-21ksoftirqd/112:08:231
32394432260,9sleep234-21ksoftirqd/210:00:142
317858199260,6cyclictest3254531-21apt-get10:43:351
139099260,18rtkit-daemon3056-21PK-Backend10:51:523
139099260,17rtkit-daemon0-21swapper/309:45:213
317858199252,4cyclictest26-21ksoftirqd/110:20:001
139099250,16rtkit-daemon3188775-21memory07:35:163
3178589992418,1cyclictest3056-21PK-Backend11:31:443
3178581992421,2cyclictest251rcuc/111:12:171
317858199241,3cyclictest26-21ksoftirqd/111:55:011
3178581992413,3cyclictest26-21ksoftirqd/107:42:381
317858199241,22cyclictest26-21ksoftirqd/110:45:121
317857899243,19cyclictest3267266-21nm-dispatcher11:15:440
3178578992418,4cyclictest3245706-21sh10:20:000
3178578992417,5cyclictest3274548-21cron11:40:010
139099240,16rtkit-daemon3056-21PK-Backend08:51:263
139099240,15rtkit-daemon0-21swapper/307:30:113
3178583992317,5cyclictest3199577-21switchtime08:05:212
317858199232,6cyclictest3056-21PK-Backend07:24:551
3178581992320,2cyclictest251rcuc/111:08:411
3178578992316,5cyclictest3201842-21taskset08:14:560
3178578992314,7cyclictest3228125-21idleruntime-cro09:29:590
139099230,3rtkit-daemon0-21swapper/211:19:422
139099230,16rtkit-daemon3056-21PK-Backend08:35:203
139099230,15rtkit-daemon3195709-21kernelversion07:55:182
139099230,15rtkit-daemon3056-21PK-Backend11:16:453
139099230,14rtkit-daemon0-21swapper/307:29:183
3178589992220,1cyclictest0-21swapper/307:23:303
3178589992219,2cyclictest3056-21PK-Backend10:32:293
317858999220,20cyclictest3056-21PK-Backend08:55:223
3178583992220,1cyclictest0-21swapper/212:01:322
3178583992220,1cyclictest0-21swapper/211:05:012
3178583992220,1cyclictest0-21swapper/209:58:042
3178583992220,1cyclictest0-21swapper/209:14:432
3178583992220,1cyclictest0-21swapper/208:31:382
3178583992220,1cyclictest0-21swapper/207:30:202
3178583992220,1cyclictest0-21swapper/207:21:152
3178583992219,1cyclictest0-21swapper/211:30:092
317858199229,5cyclictest26-21ksoftirqd/108:32:481
317858199223,8cyclictest26-21ksoftirqd/111:45:101
317858199222,11cyclictest26-21ksoftirqd/110:20:081
3178581992220,1cyclictest3056-21PK-Backend07:47:551
3178581992220,1cyclictest0-21swapper/110:52:291
3178581992220,1cyclictest0-21swapper/109:25:301
3178581992220,1cyclictest0-21swapper/109:10:561
3178581992219,2cyclictest251rcuc/112:11:471
3178581992219,2cyclictest251rcuc/111:27:491
3178581992219,2cyclictest251rcuc/110:58:221
3178581992219,2cyclictest251rcuc/110:58:221
3178581992219,2cyclictest251rcuc/109:35:061
3178581992219,2cyclictest251rcuc/109:18:331
3178581992219,2cyclictest251rcuc/109:08:151
3178581992219,2cyclictest251rcuc/108:35:471
3178581992218,3cyclictest251rcuc/112:25:121
3178581992214,6cyclictest3295888-21cron12:40:001
317858199221,3cyclictest26-21ksoftirqd/109:45:001
3178581992212,3cyclictest26-21ksoftirqd/108:12:461
3178581992210,8cyclictest436-20systemd-journal11:19:591
317858199220,20cyclictest0-21swapper/110:25:121
3178578992220,1cyclictest0-21swapper/011:01:250
3178578992220,1cyclictest0-21swapper/010:34:060
3178578992220,1cyclictest0-21swapper/009:47:570
3178578992220,1cyclictest0-21swapper/008:17:460
3178578992220,1cyclictest0-21swapper/007:48:060
317857899220,3cyclictest3221934-21ntp_states09:10:190
139099220,15rtkit-daemon0-21swapper/310:35:213
3178589992119,1cyclictest0-21swapper/312:00:173
3178589992119,1cyclictest0-21swapper/310:15:403
3178589992119,1cyclictest0-21swapper/307:45:413
3178589992119,1cyclictest0-21swapper/307:11:413
3178589992118,2cyclictest3056-21PK-Backend12:33:373
3178589992113,6cyclictest3278021-21cron11:50:003
3178589992112,6cyclictest436-20systemd-journal10:25:003
317858999210,20cyclictest3056-21PK-Backend12:17:403
317858999210,20cyclictest3056-21PK-Backend07:57:573
317858999210,19cyclictest3056-21PK-Backend08:20:153
3178583992119,1cyclictest3056-21PK-Backend08:23:542
3178583992119,1cyclictest0-21swapper/212:22:362
3178583992119,1cyclictest0-21swapper/212:13:302
3178583992119,1cyclictest0-21swapper/210:08:102
3178583992119,1cyclictest0-21swapper/209:43:022
3178583992119,1cyclictest0-21swapper/209:36:332
3178583992119,1cyclictest0-21swapper/209:23:502
3178583992119,1cyclictest0-21swapper/208:58:492
3178583992119,1cyclictest0-21swapper/208:50:582
317858199215,5cyclictest26-21ksoftirqd/107:40:011
3178581992119,1cyclictest0-21swapper/110:39:451
3178581992119,1cyclictest0-21swapper/109:32:471
3178581992119,1cyclictest0-21swapper/107:10:301
3178581992118,2cyclictest251rcuc/111:02:271
3178581992118,2cyclictest251rcuc/109:57:591
3178581992118,2cyclictest251rcuc/109:04:181
3178581992118,2cyclictest251rcuc/108:58:491
3178581992118,2cyclictest251rcuc/108:17:131
3178581992118,2cyclictest251rcuc/107:57:051
3178581992118,2cyclictest0-21swapper/111:23:381
3178581992117,3cyclictest251rcuc/109:22:301
317858199211,4cyclictest26-21ksoftirqd/107:30:181
3178581992113,6cyclictest436-20systemd-journal11:45:001
3178581992112,7cyclictest3236328-21ntp_states09:50:191
3178581992111,3cyclictest26-21ksoftirqd/112:03:591
317858199210,7cyclictest26-21ksoftirqd/112:15:101
317858199210,20cyclictest0-21swapper/108:46:421
317858199210,20cyclictest0-21swapper/108:06:351
317858199210,19cyclictest3056-21PK-Backend07:51:001
3178578992119,1cyclictest0-21swapper/012:35:070
3178578992119,1cyclictest0-21swapper/012:13:300
3178578992119,1cyclictest0-21swapper/011:59:450
3178578992119,1cyclictest0-21swapper/011:20:500
3178578992119,1cyclictest0-21swapper/011:06:520
3178578992119,1cyclictest0-21swapper/010:55:560
3178578992119,1cyclictest0-21swapper/010:55:560
3178578992119,1cyclictest0-21swapper/010:27:370
3178578992119,1cyclictest0-21swapper/010:09:130
3178578992119,1cyclictest0-21swapper/009:43:170
3178578992119,1cyclictest0-21swapper/009:38:380
3178578992119,1cyclictest0-21swapper/007:12:300
3178578992116,4cyclictest3271359-21awk11:30:110
317857899210,3cyclictest3283345-21chrt12:03:230
317857899210,20cyclictest0-21swapper/011:49:370
317857899210,20cyclictest0-21swapper/010:44:010
317857899210,20cyclictest0-21swapper/010:14:400
317857899210,20cyclictest0-21swapper/007:31:230
317857899210,20cyclictest0-21swapper/007:25:550
139099210,14rtkit-daemon3056-21PK-Backend11:11:203
139099210,14rtkit-daemon3056-21PK-Backend09:39:043
139099210,14rtkit-daemon3056-21PK-Backend09:02:393
139099210,14rtkit-daemon0-21swapper/312:06:463
3178589992018,1cyclictest3056-21PK-Backend12:14:033
3178589992018,1cyclictest3056-21PK-Backend11:01:223
3178589992018,1cyclictest3056-21PK-Backend10:57:443
3178589992018,1cyclictest3056-21PK-Backend10:57:443
3178589992018,1cyclictest3056-21PK-Backend10:46:023
3178589992018,1cyclictest3056-21PK-Backend09:16:463
3178589992018,1cyclictest3056-21PK-Backend08:15:353
3178589992018,1cyclictest0-21swapper/310:05:333
3178589992018,1cyclictest0-21swapper/307:41:353
3178589992017,2cyclictest3056-21PK-Backend11:50:093
3178589992012,7cyclictest3232914-21ps09:40:193
317858999200,1cyclictest3056-21PK-Backend12:21:193
317858999200,1cyclictest3056-21PK-Backend08:41:243
317858999200,1cyclictest3056-21PK-Backend08:28:473
317858999200,19cyclictest3056-21PK-Backend12:29:093
317858999200,19cyclictest3056-21PK-Backend09:33:553
317858999200,19cyclictest3056-21PK-Backend09:06:523
317858999200,19cyclictest0-21swapper/311:59:153
317858999200,19cyclictest0-21swapper/310:02:413
3178583992018,1cyclictest0-21swapper/212:27:482
3178583992018,1cyclictest0-21swapper/211:55:032
3178583992018,1cyclictest0-21swapper/211:21:382
3178583992018,1cyclictest0-21swapper/209:08:282
3178583992018,1cyclictest0-21swapper/209:00:382
3178583992018,1cyclictest0-21swapper/208:40:222
3178583992018,1cyclictest0-21swapper/208:16:242
3178583992010,8cyclictest3182070-21awk07:15:212
317858399200,1cyclictest0-21swapper/207:36:012
317858399200,19cyclictest0-21swapper/212:36:412
317858399200,19cyclictest0-21swapper/212:18:572
317858399200,19cyclictest0-21swapper/211:10:292
317858399200,19cyclictest0-21swapper/210:50:292
317858399200,19cyclictest0-21swapper/209:25:392
317858399200,19cyclictest0-21swapper/208:35:292
317858199207,4cyclictest26-21ksoftirqd/110:14:591
3178581992018,1cyclictest0-21swapper/110:00:451
3178581992017,2cyclictest3056-21PK-Backend07:17:191
3178581992017,2cyclictest251rcuc/111:36:241
3178581992017,2cyclictest251rcuc/110:07:211
3178581992017,2cyclictest251rcuc/108:53:061
3178581992012,6cyclictest3272924-21cut11:35:011
317858199200,2cyclictest0-21swapper/108:25:211
317858199200,19cyclictest3056-21PK-Backend07:27:351
317858199200,19cyclictest0-21swapper/109:45:431
317858199200,19cyclictest0-21swapper/108:41:501
3178578992018,1cyclictest3056-21PK-Backend12:06:140
3178578992018,1cyclictest3056-21PK-Backend11:50:380
3178578992018,1cyclictest0-21swapper/012:33:180
3178578992013,5cyclictest883-21dbus-daemon08:50:010
317857899200,19cyclictest3056-21PK-Backend10:01:560
317857899200,19cyclictest0-21swapper/010:54:560
317857899200,19cyclictest0-21swapper/010:21:080
317857899200,19cyclictest0-21swapper/009:50:470
317857899200,19cyclictest0-21swapper/008:55:100
317857899200,19cyclictest0-21swapper/008:42:000
317857899200,19cyclictest0-21swapper/008:36:050
317857899200,19cyclictest0-21swapper/008:31:110
317857899200,19cyclictest0-21swapper/007:37:040
139099200,14rtkit-daemon3056-21PK-Backend08:10:153
139099200,14rtkit-daemon0-21swapper/211:50:132
139099200,14rtkit-daemon0-21swapper/210:47:132
139099200,14rtkit-daemon0-21swapper/210:43:452
139099200,14rtkit-daemon0-21swapper/209:54:082
139099200,13rtkit-daemon3056-21PK-Backend08:30:463
139099200,13rtkit-daemon3056-21PK-Backend08:05:013
317858999194,13cyclictest3294579-21grep12:35:123
3178589991917,1cyclictest3056-21PK-Backend11:05:013
3178589991917,1cyclictest3056-21PK-Backend09:14:573
3178589991917,1cyclictest0-21swapper/311:24:143
3178589991916,2cyclictest3056-21PK-Backend09:57:143
3178589991916,2cyclictest3056-21PK-Backend08:01:213
3178583991917,1cyclictest0-21swapper/210:58:332
3178583991917,1cyclictest0-21swapper/210:58:332
3178583991917,1cyclictest0-21swapper/210:33:192
3178583991913,4cyclictest3244542-21expr10:15:122
317858399190,1cyclictest0-21swapper/210:36:562
317858399190,1cyclictest0-21swapper/210:21:092
317858399190,1cyclictest0-21swapper/208:12:452
317858399190,18cyclictest0-21swapper/207:27:302
3178581991915,3cyclictest251rcuc/108:21:181
3178581991913,4cyclictest3197637-21ntp_kernel_err08:00:191
3178578991917,1cyclictest0-21swapper/011:44:100
3178578991917,1cyclictest0-21swapper/011:29:080
3178578991917,1cyclictest0-21swapper/009:24:510
3178578991917,1cyclictest0-21swapper/009:19:240
3178578991917,1cyclictest0-21swapper/009:04:030
3178578991917,1cyclictest0-21swapper/008:04:080
3178578991917,1cyclictest0-21swapper/007:44:000
3178578991913,5cyclictest3195476-21expr07:55:130
317857899190,1cyclictest0-21swapper/010:47:390
317857899190,1cyclictest0-21swapper/008:20:370
317857899190,18cyclictest0-21swapper/012:29:380
317857899190,18cyclictest0-21swapper/012:22:350
317857899190,18cyclictest0-21swapper/007:20:400
139099190,13rtkit-daemon3056-21PK-Backend08:47:133
139099190,13rtkit-daemon0-21swapper/310:13:103
3178589991816,1cyclictest3056-21PK-Backend10:44:133
3178589991816,1cyclictest0-21swapper/311:25:153
3178589991816,1cyclictest0-21swapper/310:27:493
3178589991811,5cyclictest3226824-21tr09:25:113
3178583991816,1cyclictest0-21swapper/212:34:512
3178583991816,1cyclictest0-21swapper/211:27:202
3178583991816,1cyclictest0-21swapper/207:11:012
3178583991810,6cyclictest3192595-21python307:45:222
317858399180,17cyclictest0-21swapper/207:51:232
3178581991816,1cyclictest0-21swapper/112:20:441
317857899187,2cyclictest141rcu_preempt07:50:140
3178578991816,1cyclictest0-21swapper/010:35:090
3178578991816,1cyclictest0-21swapper/009:31:210
3178578991811,6cyclictest3220724-21seq09:07:360
3178578991811,5cyclictest3237979-21head09:55:160
3178578991811,2cyclictest13-21ksoftirqd/007:20:000
3178578991810,7cyclictest883-21dbus-daemon08:30:000
317857899180,1cyclictest0-21swapper/012:18:570
317857899180,1cyclictest0-21swapper/008:50:450
139099180,13rtkit-daemon0-21swapper/211:38:232
3178589991712,4cyclictest42-21ksoftirqd/307:50:113
3178583991715,1cyclictest0-21swapper/212:06:122
3178583991715,1cyclictest0-21swapper/208:45:172
3178583991711,4cyclictest978-21snmpd10:26:322
3178583991710,5cyclictest3207053-21cron08:30:002
3178578991712,3cyclictest3200124-21dump-pmu-power08:10:000
3178578991710,5cyclictest13-21ksoftirqd/011:10:120
3178589991614,1cyclictest3056-21PK-Backend11:36:253
3178589991614,1cyclictest3056-21PK-Backend09:54:243
3178583991610,4cyclictest3276701-21cut11:45:122
317858199160,5cyclictest3056-21PK-Backend11:55:121
317858399157,6cyclictest3276295-21cron11:45:002
3178583991411,2cyclictest3197299-21df08:00:142
317858399136,6cyclictest3261058-21cat11:00:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional