You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 00:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Thu Apr 09, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
407402921480,4sleep20-21swapper/212:35:112
400242121370,8sleep234-21ksoftirqd/209:09:592
401629421280,2sleep13056-21PK-Backend09:50:001
402923921080,4sleep03056-21PK-Backend10:25:170
39908922990,3sleep00-21swapper/008:35:180
39802282980,2sleep00-21swapper/008:05:190
39660732980,3sleep00-21swapper/007:25:170
139099860,72rtkit-daemon0-21swapper/307:08:393
395896826839,23sleep00-21swapper/007:09:010
395846326839,23sleep20-21swapper/207:05:262
395886926243,13sleep10-21swapper/107:07:461
40181042450,4sleep30-21swapper/309:55:003
39728152290,2sleep30-21swapper/307:45:173
3959203992816,10cyclictest3986452-21munin-run08:25:002
3959200992819,7cyclictest3975511-21cron07:55:011
3959203992519,4cyclictest34-21ksoftirqd/208:53:032
3959203992510,9cyclictest1095-21runrttasks10:10:102
139099250,17rtkit-daemon42-21ksoftirqd/308:35:533
3959200992416,6cyclictest3972045-21cron07:45:001
139099240,16rtkit-daemon3056-21PK-Backend10:27:571
395920699234,17cyclictest4056410-21ls11:45:013
395920699230,21cyclictest4034613-21ntp_states10:40:193
395920399233,17cyclictest3993436-21cron08:45:012
3959203992321,1cyclictest0-21swapper/209:31:582
3959200992320,2cyclictest3056-21PK-Backend10:08:341
3959200992315,5cyclictest4066811-21munin-plugin-st12:14:591
3959196992321,1cyclictest0-21swapper/011:09:470
3959196992321,1cyclictest0-21swapper/011:09:470
3959196992317,4cyclictest4019742-21munin-plugin-st09:59:590
139099230,15rtkit-daemon0-21swapper/307:58:453
40313012220,3sleep23056-21PK-Backend10:30:202
3959206992220,1cyclictest0-21swapper/308:14:253
3959206992220,1cyclictest0-21swapper/308:03:293
3959206992219,2cyclictest3056-21PK-Backend11:08:383
3959206992219,2cyclictest3056-21PK-Backend11:08:373
395920699220,21cyclictest0-21swapper/311:53:193
395920699220,20cyclictest4024188-21ntpq10:10:173
395920699220,20cyclictest3983303-21cat08:15:133
395920699220,1cyclictest0-21swapper/310:06:183
3959203992220,1cyclictest0-21swapper/211:57:512
3959203992220,1cyclictest0-21swapper/211:14:242
3959203992220,1cyclictest0-21swapper/210:25:112
3959203992213,7cyclictest436-20systemd-journal11:55:012
3959200992220,1cyclictest3056-21PK-Backend07:58:361
3959200992220,1cyclictest0-21swapper/108:35:401
3959200992219,2cyclictest3056-21PK-Backend09:02:511
3959200992219,2cyclictest3056-21PK-Backend08:46:271
3959200992219,2cyclictest3056-21PK-Backend08:06:331
395920099220,20cyclictest3056-21PK-Backend11:47:571
395920099220,20cyclictest3056-21PK-Backend07:38:081
3959196992220,1cyclictest0-21swapper/012:01:320
3959196992220,1cyclictest0-21swapper/008:59:200
3959196992220,1cyclictest0-21swapper/007:38:030
3959196992220,1cyclictest0-21swapper/007:12:210
395919699220,21cyclictest0-21swapper/010:13:430
139099220,14rtkit-daemon0-21swapper/308:40:163
139099220,14rtkit-daemon0-21swapper/010:24:370
3959206992119,1cyclictest3056-21PK-Backend12:14:223
3959206992119,1cyclictest0-21swapper/312:30:243
3959206992119,1cyclictest0-21swapper/312:26:583
3959206992119,1cyclictest0-21swapper/311:22:513
3959206992119,1cyclictest0-21swapper/308:59:333
3959206992118,2cyclictest978-21snmpd12:03:333
3959206992118,2cyclictest3056-21PK-Backend12:23:333
3959206992118,2cyclictest3056-21PK-Backend11:13:383
3959206992118,2cyclictest3056-21PK-Backend08:29:183
3959206992113,6cyclictest3966804-21cron07:29:593
3959206992112,7cyclictest4019998-21apt10:00:123
3959206992111,8cyclictest3996179-21/usr/sbin/munin08:50:193
395920699211,17cyclictest3961582-21/usr/sbin/munin07:15:233
395920699210,20cyclictest3056-21PK-Backend12:09:213
395920699210,20cyclictest3056-21PK-Backend12:09:213
395920699210,20cyclictest0-21swapper/311:56:433
395920699210,20cyclictest0-21swapper/310:56:353
395920699210,20cyclictest0-21swapper/309:46:053
395920699210,1cyclictest0-21swapper/309:00:213
395920699210,19cyclictest4012116-21/usr/sbin/munin09:35:193
3959203992119,1cyclictest0-21swapper/211:09:112
3959203992119,1cyclictest0-21swapper/211:09:102
3959203992119,1cyclictest0-21swapper/209:49:272
3959203992119,1cyclictest0-21swapper/209:36:572
3959203992119,1cyclictest0-21swapper/208:56:422
3959203992119,1cyclictest0-21swapper/208:34:582
3959203992119,1cyclictest0-21swapper/208:11:402
3959203992119,1cyclictest0-21swapper/207:56:472
3959203992119,1cyclictest0-21swapper/207:21:322
3959203992119,1cyclictest0-21swapper/207:13:202
3959203992114,5cyclictest4033600-21cron10:40:012
395920399210,20cyclictest0-21swapper/212:07:172
395920399210,20cyclictest0-21swapper/212:07:172
395920399210,20cyclictest0-21swapper/212:04:412
395920399210,20cyclictest0-21swapper/211:32:442
395920399210,20cyclictest0-21swapper/211:27:302
395920399210,20cyclictest0-21swapper/210:49:502
395920399210,20cyclictest0-21swapper/209:17:112
395920399210,20cyclictest0-21swapper/208:47:372
395920399210,20cyclictest0-21swapper/207:36:522
395920399210,20cyclictest0-21swapper/207:19:422
3959200992119,1cyclictest3056-21PK-Backend12:26:511
3959200992119,1cyclictest3056-21PK-Backend12:03:121
3959200992119,1cyclictest3056-21PK-Backend10:50:581
3959200992119,1cyclictest3056-21PK-Backend07:22:121
3959200992119,1cyclictest0-21swapper/111:44:321
3959200992119,1cyclictest0-21swapper/111:11:271
3959200992119,1cyclictest0-21swapper/107:33:411
3959200992118,2cyclictest3056-21PK-Backend11:51:211
3959200992116,4cyclictest3973700-21seq07:49:021
3959200992114,6cyclictest883-21dbus-daemon12:10:001
3959200992114,6cyclictest883-21dbus-daemon12:10:001
3959200992113,6cyclictest4061621-21cron12:00:001
395920099210,19cyclictest3056-21PK-Backend09:50:421
3959196992119,1cyclictest0-21swapper/012:29:100
3959196992119,1cyclictest0-21swapper/012:05:440
3959196992119,1cyclictest0-21swapper/012:05:440
3959196992119,1cyclictest0-21swapper/011:35:290
3959196992119,1cyclictest0-21swapper/011:32:520
3959196992119,1cyclictest0-21swapper/010:41:560
3959196992119,1cyclictest0-21swapper/008:19:260
3959196992119,1cyclictest0-21swapper/007:52:500
3959196992119,1cyclictest0-21swapper/007:20:310
3959196992118,2cyclictest0-21swapper/011:15:010
3959196992118,2cyclictest0-21swapper/009:21:440
3959196992114,5cyclictest883-21dbus-daemon12:18:050
395919699210,20cyclictest3056-21PK-Backend12:23:210
395919699210,20cyclictest0-21swapper/009:45:240
395919699210,20cyclictest0-21swapper/009:00:090
395919699210,20cyclictest0-21swapper/007:45:190
139099210,2rtkit-daemon3056-21PK-Backend09:44:091
139099210,14rtkit-daemon3056-21PK-Backend07:45:032
139099210,14rtkit-daemon0-21swapper/110:45:241
139099210,14rtkit-daemon0-21swapper/012:32:370
395920699203,4cyclictest4018823-21cat09:55:163
3959206992018,1cyclictest3056-21PK-Backend11:34:393
3959206992018,1cyclictest3056-21PK-Backend09:16:033
3959206992018,1cyclictest0-21swapper/311:45:423
3959206992018,1cyclictest0-21swapper/310:50:333
3959206992018,1cyclictest0-21swapper/310:28:433
3959206992018,1cyclictest0-21swapper/308:47:313
3959206992018,1cyclictest0-21swapper/308:07:363
3959206992017,2cyclictest3056-21PK-Backend09:27:453
3959206992015,3cyclictest4010664-21users09:30:203
3959206992014,4cyclictest42-21ksoftirqd/311:00:123
3959206992014,3cyclictest3964205-21python307:20:193
3959206992013,5cyclictest3960999-21date07:15:013
395920699200,8cyclictest4049730-21/usr/sbin/munin11:25:103
395920699200,1cyclictest3056-21PK-Backend07:54:313
395920699200,19cyclictest0-21swapper/309:10:293
395920699200,19cyclictest0-21swapper/309:07:183
395920699200,19cyclictest0-21swapper/308:30:553
3959203992018,1cyclictest0-21swapper/212:25:222
3959203992018,1cyclictest0-21swapper/212:22:462
3959203992018,1cyclictest0-21swapper/211:19:392
3959203992018,1cyclictest0-21swapper/211:03:572
3959203992018,1cyclictest0-21swapper/210:54:172
3959203992018,1cyclictest0-21swapper/210:21:452
3959203992018,1cyclictest0-21swapper/209:42:312
3959203992018,1cyclictest0-21swapper/209:10:482
3959203992018,1cyclictest0-21swapper/208:38:232
3959203992018,1cyclictest0-21swapper/208:29:112
3959203992013,5cyclictest4057249-21cat11:45:162
3959203992011,7cyclictest4022759-21sed10:05:222
395920399200,19cyclictest0-21swapper/209:26:102
395920399200,19cyclictest0-21swapper/208:19:252
395920099202,13cyclictest4042801-21apt11:05:121
395920099202,13cyclictest4042801-21apt11:05:121
3959200992018,1cyclictest3056-21PK-Backend11:01:131
3959200992018,1cyclictest0-21swapper/111:19:041
3959200992018,1cyclictest0-21swapper/110:38:221
3959200992018,1cyclictest0-21swapper/109:30:291
3959200992018,1cyclictest0-21swapper/107:27:261
395920099200,1cyclictest3056-21PK-Backend10:10:581
395920099200,19cyclictest3056-21PK-Backend10:58:351
395920099200,19cyclictest3056-21PK-Backend09:10:351
395920099200,19cyclictest3056-21PK-Backend08:41:271
395920099200,19cyclictest3056-21PK-Backend07:19:351
395920099200,19cyclictest0-21swapper/111:37:441
395920099200,19cyclictest0-21swapper/111:34:191
395920099200,19cyclictest0-21swapper/108:23:301
3959196992018,1cyclictest0-21swapper/011:12:240
3959196992018,1cyclictest0-21swapper/010:58:440
3959196992018,1cyclictest0-21swapper/010:33:300
3959196992018,1cyclictest0-21swapper/009:44:370
3959196992018,1cyclictest0-21swapper/009:13:480
3959196992018,1cyclictest0-21swapper/008:53:250
3959196992018,1cyclictest0-21swapper/007:17:550
3959196992016,3cyclictest0-21swapper/012:35:110
3959196992014,4cyclictest3986435-21cron08:24:590
3959196992012,6cyclictest4048891-21cat11:20:180
3959196992012,6cyclictest3971296-21ntp_kernel_err07:40:200
395919699200,19cyclictest0-21swapper/011:02:090
395919699200,19cyclictest0-21swapper/009:33:420
395919699200,19cyclictest0-21swapper/009:28:060
395919699200,19cyclictest0-21swapper/009:15:230
395919699200,19cyclictest0-21swapper/008:32:100
139099200,9rtkit-daemon0-21swapper/207:32:002
139099200,3rtkit-daemon0-21swapper/208:05:382
139099200,14rtkit-daemon3056-21PK-Backend07:40:272
139099200,14rtkit-daemon3056-21PK-Backend07:28:072
139099200,14rtkit-daemon0-21swapper/307:37:043
139099200,14rtkit-daemon0-21swapper/010:19:110
139099200,13rtkit-daemon0-21swapper/209:21:002
139099200,13rtkit-daemon0-21swapper/011:26:210
3959206991917,1cyclictest3056-21PK-Backend11:18:383
3959206991917,1cyclictest3056-21PK-Backend10:34:313
3959206991914,3cyclictest4027403-21irqstats10:20:153
395920699190,1cyclictest3056-21PK-Backend08:23:453
395920699190,1cyclictest3056-21PK-Backend07:32:403
395920699190,1cyclictest0-21swapper/309:44:293
3959203991917,1cyclictest0-21swapper/212:13:192
3959203991917,1cyclictest0-21swapper/211:21:282
3959203991917,1cyclictest0-21swapper/209:53:412
3959203991917,1cyclictest0-21swapper/207:51:532
3959203991915,2cyclictest4034549-21cut10:40:172
3959203991912,5cyclictest4039959-21cat10:55:192
3959203991911,6cyclictest883-21dbus-daemon08:05:002
3959200991916,2cyclictest3056-21PK-Backend08:12:491
3959200991912,5cyclictest4049459-21dump-pmu-power11:24:591
395920099190,1cyclictest0-21swapper/112:35:151
395920099190,1cyclictest0-21swapper/110:34:571
395920099190,1cyclictest0-21swapper/108:25:051
395920099190,1cyclictest0-21swapper/107:11:091
395919699196,11cyclictest3993262-21unattended-upgr08:43:030
3959196991917,1cyclictest0-21swapper/011:53:060
3959196991916,2cyclictest0-21swapper/011:48:540
3959196991912,6cyclictest3987620-21sed08:25:210
3959196991912,5cyclictest3982703-21cron08:15:000
3959196991911,6cyclictest3978453-21grep08:00:170
395919699190,1cyclictest0-21swapper/012:10:440
395919699190,1cyclictest0-21swapper/010:51:080
395919699190,1cyclictest0-21swapper/010:48:310
395919699190,1cyclictest0-21swapper/010:38:300
395919699190,1cyclictest0-21swapper/009:52:550
395919699190,18cyclictest0-21swapper/007:34:240
39942922180,8sleep013-21ksoftirqd/008:45:160
3959203991816,1cyclictest0-21swapper/212:15:562
3959203991816,1cyclictest0-21swapper/209:03:392
3959203991815,2cyclictest1095-21runrttasks10:02:232
3959203991810,6cyclictest4056404-21cron11:45:002
3959200991816,1cyclictest3056-21PK-Backend10:42:341
3959200991816,1cyclictest3056-21PK-Backend08:58:181
3959200991816,1cyclictest3056-21PK-Backend08:54:331
3959200991816,1cyclictest3056-21PK-Backend08:17:201
3959200991816,1cyclictest3056-21PK-Backend08:00:381
3959200991816,1cyclictest0-21swapper/112:19:131
3959200991813,3cyclictest4020639-21needreboot10:00:171
3959200991811,5cyclictest4069383-21cat12:20:161
3959200991811,5cyclictest4007620-21systemd-run09:25:011
3959196991816,1cyclictest0-21swapper/007:56:410
3959206991715,1cyclictest3056-21PK-Backend09:24:353
3959206991715,1cyclictest0-21swapper/310:47:563
3959206991715,1cyclictest0-21swapper/310:16:063
395920399178,7cyclictest4025653-21cat10:15:152
3959203991715,1cyclictest0-21swapper/212:31:232
3959200991715,1cyclictest3056-21PK-Backend11:25:061
3959200991715,1cyclictest3056-21PK-Backend10:24:081
3959200991715,1cyclictest3056-21PK-Backend09:05:141
3959200991715,1cyclictest0-21swapper/112:30:161
3959200991715,1cyclictest0-21swapper/109:57:381
3959196991715,1cyclictest0-21swapper/011:56:300
3959196991715,1cyclictest0-21swapper/010:01:260
3959196991715,1cyclictest0-21swapper/009:08:270
3959196991710,5cyclictest4011918-21expr09:35:180
3959206991614,1cyclictest3056-21PK-Backend12:18:343
395920699160,14cyclictest3970986-21hddtemp_smartct07:40:163
3959203991614,1cyclictest0-21swapper/211:37:092
395920399161,12cyclictest4019119-21python309:55:192
3959200991614,1cyclictest3056-21PK-Backend10:19:091
3959200991611,4cyclictest4009321-21cron09:30:001
395920099160,13cyclictest436-20systemd-journal09:19:591
3959196991614,1cyclictest3056-21PK-Backend11:44:420
3959196991614,1cyclictest0-21swapper/010:09:090
395920699159,5cyclictest4032635-21sed10:35:153
3959206991513,1cyclictest3056-21PK-Backend11:39:413
395920699150,13cyclictest4074373-21cat12:35:133
3959200991511,3cyclictest3056-21PK-Backend08:31:141
395920099128,3cyclictest3056-21PK-Backend09:37:501
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional