You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-12 - 15:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Sep 12, 2026 00:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
387162921330,3sleep20-21swapper/221:10:002
386132121270,9sleep013-21ksoftirqd/020:40:110
389878921220,3sleep00-21swapper/022:25:180
392551021000,4sleep13056-21PK-Backend23:40:211
39364462990,2sleep00-21swapper/000:10:190
382848027639,13sleep30-21swapper/319:07:003
139099730,60rtkit-daemon0-21swapper/219:06:282
382867126443,14sleep10-21swapper/119:09:261
382848726444,14sleep00-21swapper/019:07:040
39451862510,4sleep13056-21PK-Backend00:35:181
38691032510,4sleep03056-21PK-Backend21:00:200
38913832400,2sleep00-21swapper/022:05:170
3828855992920,4cyclictest42-21ksoftirqd/300:35:013
3828845992712,13cyclictest3924388-21cron23:40:000
3828855992516,7cyclictest436-20systemd-journal20:49:593
3828850992512,11cyclictest3843172-21unin-run19:49:592
382885599238,13cyclictest3862755-21unin-run20:44:593
382885599230,1cyclictest0-21swapper/320:09:353
3828847992320,2cyclictest3056-21PK-Backend23:29:001
3828847992314,7cyclictest3901610-21apt22:35:111
382884799231,20cyclictest3889321-21sort22:00:131
3828847992311,10cyclictest3056-21PK-Backend22:15:001
3828845992315,6cyclictest3942533-21perf00:30:000
139099230,15rtkit-daemon0-21swapper/222:01:492
382885599227,9cyclictest42-21ksoftirqd/320:25:003
3828855992218,3cyclictest42-21ksoftirqd/320:30:013
3828855992218,3cyclictest0-21swapper/319:45:203
3828855992217,4cyclictest42-21ksoftirqd/320:35:023
3828855992213,7cyclictest3870327-21fw_packets21:05:143
3828855992212,8cyclictest3845870-21ntpq19:55:193
382885599220,9cyclictest42-21ksoftirqd/320:40:013
3828850992220,1cyclictest0-21swapper/223:15:042
3828850992220,1cyclictest0-21swapper/223:11:392
3828850992220,1cyclictest0-21swapper/221:56:352
3828850992220,1cyclictest0-21swapper/200:01:202
382885099220,2cyclictest3864728-21apt20:50:112
382885099220,2cyclictest3864728-21apt20:50:102
3828847992220,1cyclictest3056-21PK-Backend20:32:301
3828847992214,6cyclictest3909278-21ntp_states22:55:201
382884799220,20cyclictest3056-21PK-Backend00:10:091
3828845992220,1cyclictest3056-21PK-Backend21:25:010
3828845992220,1cyclictest0-21swapper/023:46:490
3828845992220,1cyclictest0-21swapper/023:34:270
3828845992220,1cyclictest0-21swapper/021:43:070
3828845992220,1cyclictest0-21swapper/019:27:070
382884599221,5cyclictest3890734-21awk22:05:010
382884599220,21cyclictest0-21swapper/022:30:390
382885599215,4cyclictest42-21ksoftirqd/319:35:013
382885599214,4cyclictest0-21swapper/321:20:193
382885599213,16cyclictest3929594-21munin-run23:55:003
3828855992119,1cyclictest3056-21PK-Backend22:52:513
3828855992119,1cyclictest3056-21PK-Backend00:36:003
3828855992119,1cyclictest3056-21PK-Backend00:28:573
3828855992119,1cyclictest0-21swapper/323:37:073
3828855992119,1cyclictest0-21swapper/323:09:423
3828855992119,1cyclictest0-21swapper/320:14:483
3828855992119,1cyclictest0-21swapper/319:33:453
3828855992119,1cyclictest0-21swapper/300:18:293
3828855992119,1cyclictest0-21swapper/300:14:043
3828855992113,6cyclictest918-21rs:main3
382885599210,7cyclictest39153962wc23:15:003
382885599210,20cyclictest3056-21PK-Backend22:57:243
382885599210,20cyclictest0-21swapper/321:01:323
382885599210,19cyclictest3056-21PK-Backend22:30:083
382885099219,10cyclictest3862719-21cron20:45:002
3828850992119,1cyclictest0-21swapper/223:34:022
3828850992119,1cyclictest0-21swapper/223:27:272
3828850992119,1cyclictest0-21swapper/223:06:042
3828850992119,1cyclictest0-21swapper/222:09:332
3828850992119,1cyclictest0-21swapper/221:37:492
3828850992119,1cyclictest0-21swapper/220:55:322
3828850992119,1cyclictest0-21swapper/220:28:272
3828850992119,1cyclictest0-21swapper/220:24:492
3828850992119,1cyclictest0-21swapper/219:53:052
3828850992119,1cyclictest0-21swapper/219:10:342
382885099210,5cyclictest3908291-21awk22:54:592
382885099210,20cyclictest0-21swapper/200:05:462
3828847992119,1cyclictest3056-21PK-Backend21:01:311
3828847992119,1cyclictest3056-21PK-Backend20:21:561
3828847992119,1cyclictest3056-21PK-Backend20:10:341
3828847992119,1cyclictest0-21swapper/123:16:301
3828847992119,1cyclictest0-21swapper/123:04:591
3828847992119,1cyclictest0-21swapper/122:52:441
3828847992119,1cyclictest0-21swapper/122:33:301
3828847992119,1cyclictest0-21swapper/122:25:261
3828847992119,1cyclictest0-21swapper/122:16:331
3828847992119,1cyclictest0-21swapper/120:00:461
3828847992114,5cyclictest26-21ksoftirqd/123:55:121
3828847992114,5cyclictest26-21ksoftirqd/123:20:051
3828847992113,6cyclictest3857265-21cron20:30:001
382884799210,20cyclictest0-21swapper/122:21:411
382884799210,1cyclictest3056-21PK-Backend20:41:301
382884799210,19cyclictest3932893-21awk00:00:191
3828845992119,1cyclictest0-21swapper/022:41:190
3828845992119,1cyclictest0-21swapper/021:48:330
3828845992119,1cyclictest0-21swapper/021:20:420
3828845992119,1cyclictest0-21swapper/021:15:010
3828845992119,1cyclictest0-21swapper/021:09:200
3828845992119,1cyclictest0-21swapper/020:28:510
3828845992119,1cyclictest0-21swapper/020:14:440
3828845992119,1cyclictest0-21swapper/020:04:300
3828845992119,1cyclictest0-21swapper/019:20:450
3828845992119,1cyclictest0-21swapper/000:36:320
3828845992119,1cyclictest0-21swapper/000:00:430
382884599210,20cyclictest0-21swapper/022:38:560
382884599210,20cyclictest0-21swapper/022:18:010
382884599210,20cyclictest0-21swapper/021:31:310
382884599210,20cyclictest0-21swapper/021:14:140
382884599210,1cyclictest0-21swapper/023:19:390
139099210,15rtkit-daemon3056-21PK-Backend23:18:173
139099210,15rtkit-daemon3056-21PK-Backend22:48:323
139099210,14rtkit-daemon3056-21PK-Backend22:26:503
139099210,13rtkit-daemon3056-21PK-Backend22:37:373
139099210,13rtkit-daemon3056-21PK-Backend19:22:313
139099210,13rtkit-daemon0-21swapper/222:40:322
39422232200,18sleep2978-21snmpd00:26:142
382885599207,3cyclictest42-21ksoftirqd/320:04:093
3828855992018,1cyclictest3056-21PK-Backend00:00:583
3828855992018,1cyclictest0-21swapper/321:25:313
3828855992018,1cyclictest0-21swapper/321:12:353
3828855992018,1cyclictest0-21swapper/320:53:493
3828855992018,1cyclictest0-21swapper/320:53:493
3828855992018,1cyclictest0-21swapper/319:53:463
382885599200,7cyclictest3873663-21apt21:15:123
382885599200,1cyclictest3056-21PK-Backend22:05:553
382885599200,19cyclictest3056-21PK-Backend21:37:083
382885599200,19cyclictest0-21swapper/321:34:103
382885599200,19cyclictest0-21swapper/300:20:183
382885599200,19cyclictest0-21swapper/300:09:383
3828850992018,1cyclictest0-21swapper/223:55:182
3828850992018,1cyclictest0-21swapper/223:21:392
3828850992018,1cyclictest0-21swapper/223:00:432
3828850992018,1cyclictest0-21swapper/222:26:292
3828850992018,1cyclictest0-21swapper/221:28:232
3828850992018,1cyclictest0-21swapper/220:17:472
3828850992018,1cyclictest0-21swapper/219:36:302
3828850992018,1cyclictest0-21swapper/219:18:452
3828850992018,1cyclictest0-21swapper/200:19:052
3828850992013,5cyclictest3859033-21systemd-run20:35:002
382885099200,19cyclictest0-21swapper/222:58:202
382885099200,19cyclictest0-21swapper/222:20:352
382885099200,19cyclictest0-21swapper/222:17:382
382885099200,19cyclictest0-21swapper/222:12:312
382885099200,19cyclictest0-21swapper/221:21:552
382885099200,19cyclictest0-21swapper/220:05:442
382885099200,19cyclictest0-21swapper/220:00:432
382885099200,19cyclictest0-21swapper/200:38:102
382885099200,19cyclictest0-21swapper/200:12:492
382884799204,2cyclictest141rcu_preempt23:10:131
3828847992018,1cyclictest3056-21PK-Backend23:32:101
3828847992018,1cyclictest0-21swapper/123:52:041
3828847992018,1cyclictest0-21swapper/123:46:031
3828847992018,1cyclictest0-21swapper/121:41:451
3828847992018,1cyclictest0-21swapper/119:14:371
3828847992018,1cyclictest0-21swapper/100:28:351
3828847992018,1cyclictest0-21swapper/100:05:571
3828847992013,5cyclictest3878589-21cron21:30:011
3828847992012,6cyclictest3905468-21fw_packets22:45:141
382884799200,19cyclictest3056-21PK-Backend20:35:471
382884799200,19cyclictest0-21swapper/121:35:501
382884799200,19cyclictest0-21swapper/100:23:211
3828845992018,1cyclictest0-21swapper/023:58:050
3828845992018,1cyclictest0-21swapper/023:11:270
3828845992018,1cyclictest0-21swapper/022:56:000
3828845992018,1cyclictest0-21swapper/022:23:550
3828845992018,1cyclictest0-21swapper/020:21:470
3828845992018,1cyclictest0-21swapper/020:07:550
3828845992018,1cyclictest0-21swapper/019:58:430
3828845992014,5cyclictest3917399-21touch23:20:020
3828845992013,5cyclictest3838214-21apt19:35:110
3828845992013,5cyclictest13-21ksoftirqd/023:50:090
3828845992012,6cyclictest3905805-21ntpq22:45:170
382884599200,6cyclictest3056-21PK-Backend19:40:110
382884599200,1cyclictest0-21swapper/020:17:210
382884599200,19cyclictest0-21swapper/019:54:310
382884599200,19cyclictest0-21swapper/000:31:170
382884599200,19cyclictest0-21swapper/000:05:570
139099200,14rtkit-daemon0-21swapper/323:28:523
139099200,14rtkit-daemon0-21swapper/223:38:592
139099200,13rtkit-daemon0-21swapper/223:42:332
139099200,12rtkit-daemon3056-21PK-Backend22:18:433
382885599197,6cyclictest141rcu_preempt23:42:443
382885599197,4cyclictest42-21ksoftirqd/323:03:063
382885599196,6cyclictest42-21ksoftirqd/323:20:053
3828855991917,1cyclictest3056-21PK-Backend23:58:223
3828855991917,1cyclictest0-21swapper/320:19:143
3828855991916,2cyclictest3056-21PK-Backend22:25:003
382885599190,1cyclictest3056-21PK-Backend21:48:163
382885599190,1cyclictest3056-21PK-Backend21:40:063
382885599190,18cyclictest3056-21PK-Backend21:58:373
3828850991917,1cyclictest0-21swapper/221:31:202
3828850991917,1cyclictest0-21swapper/221:19:452
3828850991917,1cyclictest0-21swapper/221:02:272
3828850991917,1cyclictest0-21swapper/220:12:332
3828850991917,1cyclictest0-21swapper/219:25:072
3828850991915,3cyclictest978-21snmpd19:34:172
3828850991912,6cyclictest3886329-21sed21:50:172
3828850991912,6cyclictest3870824-21ls21:05:202
3828850991910,7cyclictest883-21dbus-daemon22:35:002
382885099190,1cyclictest0-21swapper/200:21:422
3828847991917,1cyclictest3056-21PK-Backend21:20:021
3828847991917,1cyclictest3056-21PK-Backend20:55:011
3828847991917,1cyclictest3056-21PK-Backend20:52:031
3828847991917,1cyclictest3056-21PK-Backend20:52:031
3828847991917,1cyclictest3056-21PK-Backend20:46:231
3828847991917,1cyclictest0-21swapper/119:26:121
3828847991913,5cyclictest26-21ksoftirqd/119:20:221
3828847991913,4cyclictest3850339-21cron20:09:591
3828847991912,5cyclictest3888207-21netstat21:55:201
3828847991911,6cyclictest3912123-21wc23:05:111
382884799190,6cyclictest3056-21PK-Backend23:35:201
382884799190,1cyclictest3056-21PK-Backend21:13:131
382884799190,1cyclictest3056-21PK-Backend19:50:181
382884799190,1cyclictest3056-21PK-Backend19:36:191
382884799190,1cyclictest0-21swapper/122:07:201
3828845991917,1cyclictest0-21swapper/020:46:500
3828845991917,1cyclictest0-21swapper/000:20:020
3828845991912,5cyclictest3829237-21grep19:10:120
382884599190,3cyclictest3056-21PK-Backend23:30:000
382884599190,1cyclictest3056-21PK-Backend23:06:410
382884599190,1cyclictest0-21swapper/019:46:050
382884599190,18cyclictest0-21swapper/021:57:320
382884599190,18cyclictest0-21swapper/020:52:440
382884599190,18cyclictest0-21swapper/020:52:430
382884599190,18cyclictest0-21swapper/020:35:470
382884599190,18cyclictest0-21swapper/020:31:280
3828855991817,1cyclictest0-21swapper/320:58:213
3828855991816,1cyclictest3056-21PK-Backend23:49:433
3828855991816,1cyclictest3056-21PK-Backend19:14:593
3828855991814,2cyclictest38903942sleep322:00:593
3828855991812,4cyclictest1095-21runrttasks21:50:133
3828855991810,6cyclictest3841396-21cron19:45:003
382885599180,9cyclictest42-21ksoftirqd/319:25:213
3828850991816,1cyclictest0-21swapper/223:51:542
3828850991816,1cyclictest0-21swapper/222:35:222
3828850991816,1cyclictest0-21swapper/221:43:302
3828850991816,1cyclictest0-21swapper/220:47:132
3828850991813,3cyclictest3845282-21grep19:55:122
3828850991811,5cyclictest3860152-21sed20:35:182
3828850991810,6cyclictest3943539-21ntp_states00:30:172
382884799182,14cyclictest3831401-21grep19:15:131
3828847991816,1cyclictest0-21swapper/121:45:511
3828847991815,2cyclictest3056-21PK-Backend21:08:341
382884799180,6cyclictest3056-21PK-Backend20:00:001
3828845991816,1cyclictest0-21swapper/021:35:160
382884599181,3cyclictest141rcu_preempt00:19:550
382884599181,15cyclictest3832756-21munin-plugin-st19:20:000
382884599180,5cyclictest3056-21PK-Backend19:30:180
39071732170,7chrt13-21ksoftirqd/022:50:110
3828855991715,1cyclictest3056-21PK-Backend22:42:583
3828855991715,1cyclictest3056-21PK-Backend19:19:113
3828855991715,1cyclictest0-21swapper/322:11:483
3828850991715,1cyclictest0-21swapper/221:46:152
3828847991715,1cyclictest3056-21PK-Backend00:34:231
3828845991715,1cyclictest0-21swapper/023:02:090
3828845991715,1cyclictest0-21swapper/022:10:440
3828845991715,1cyclictest0-21swapper/020:58:520
382884599170,5cyclictest0-21swapper/023:40:130
382885099169,5cyclictest3840005-21cat19:40:122
382884799167,8cyclictest3056-21PK-Backend21:35:011
382884799163,2cyclictest141rcu_preempt19:30:121
382884799162,2cyclictest141rcu_preempt19:40:231
3828847991613,2cyclictest3056-21PK-Backend00:19:561
3828847991610,4cyclictest26-21ksoftirqd/122:40:151
382884799160,1cyclictest3056-21PK-Backend21:51:521
382884799151,2cyclictest3056-21PK-Backend19:45:221
382884799151,2cyclictest141rcu_preempt20:15:121
3828847991510,4cyclictest3056-21PK-Backend21:19:261
382884599152,2cyclictest141rcu_preempt21:50:180
382885099149,4cyclictest34-21ksoftirqd/223:45:192
382885099149,4cyclictest2156-21gnome-shell22:45:102
3828850991412,1cyclictest0-21swapper/219:24:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional