You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 14:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Fri Apr 03, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33487421460,3sleep13056-21PK-Backend22:35:001
28554421070,2sleep3285287-21kworker/u8:120:15:003
32516221050,3sleep00-21swapper/022:05:160
26196727840,9sleep30-21swapper/319:05:483
26171327346,17sleep00-21swapper/019:05:240
26229627151,14sleep20-21swapper/219:10:002
26218827040,23sleep10-21swapper/119:08:381
2863872530,4sleep03056-21PK-Backend20:15:170
3231962520,3sleep13056-21PK-Backend22:00:121
139099380,4rtkit-daemon0-21swapper/323:15:093
139099380,3rtkit-daemon3056-21PK-Backend00:31:223
139099360,2rtkit-daemon0-21swapper/323:38:223
3239362300,14sleep342-21ksoftirqd/322:00:233
2634042280,3sleep13056-21PK-Backend19:10:181
26243399277,11cyclictest13-21ksoftirqd/022:19:590
26243399277,10cyclictest13-21ksoftirqd/020:00:020
262433992712,5cyclictest13-21ksoftirqd/019:35:010
139099270,4rtkit-daemon1389-21rtkit-daemon20:21:090
3330682260,3sleep20-21swapper/222:30:002
26243399260,3cyclictest362738-21awk23:55:000
26243399256,10cyclictest13-21ksoftirqd/000:00:010
26243399253,12cyclictest13-21ksoftirqd/020:05:160
262433992518,5cyclictest13-21ksoftirqd/023:49:500
26243399250,7cyclictest13-21ksoftirqd/000:35:000
262445992421,2cyclictest3056-21PK-Backend19:20:013
262433992410,5cyclictest13-21ksoftirqd/022:40:000
262445992318,3cyclictest322188-21users21:55:223
262445992316,4cyclictest290594-21sh20:30:003
26243799230,3cyclictest141rcu_preempt23:49:501
26243399230,8cyclictest13-21ksoftirqd/021:45:000
139099230,4rtkit-daemon1389-21rtkit-daemon20:33:190
139099230,16rtkit-daemon374570-21taskset00:26:223
3074662220,4sleep20-21swapper/221:15:182
262445992220,1cyclictest0-21swapper/321:49:403
262445992220,1cyclictest0-21swapper/319:12:303
262445992213,7cyclictest42-21ksoftirqd/320:00:003
262440992220,1cyclictest0-21swapper/223:54:102
262440992220,1cyclictest0-21swapper/222:02:012
262440992220,1cyclictest0-21swapper/221:11:262
262440992220,1cyclictest0-21swapper/219:43:252
262440992211,9cyclictest341676-21unin-run22:55:002
26244099220,21cyclictest0-21swapper/223:14:342
26244099220,21cyclictest0-21swapper/223:06:502
26244099220,21cyclictest0-21swapper/221:30:112
26244099220,21cyclictest0-21swapper/220:51:512
26244099220,21cyclictest0-21swapper/200:26:202
26243399228,4cyclictest13-21ksoftirqd/021:14:590
26243399227,2cyclictest141rcu_preempt23:27:250
262433992216,5cyclictest268063-21cron19:24:590
262433992214,6cyclictest346833-21cron23:10:000
26243399221,18cyclictest264106-21munin-run19:14:590
26243399220,20cyclictest295001-21strings20:40:170
26243399220,13cyclictest13-21ksoftirqd/022:05:010
26243399220,12cyclictest13-21ksoftirqd/000:40:010
139099220,4rtkit-daemon1389-21rtkit-daemon22:49:090
139099220,15rtkit-daemon0-21swapper/200:11:172
139099220,15rtkit-daemon0-21swapper/200:04:212
139099220,14rtkit-daemon0-21swapper/323:30:543
139099220,14rtkit-daemon0-21swapper/300:02:083
262445992119,1cyclictest3056-21PK-Backend21:25:473
262445992119,1cyclictest3056-21PK-Backend20:49:243
262445992119,1cyclictest3056-21PK-Backend19:45:433
262445992119,1cyclictest0-21swapper/323:45:053
262445992119,1cyclictest0-21swapper/323:25:313
262445992119,1cyclictest0-21swapper/323:23:293
262445992119,1cyclictest0-21swapper/323:23:293
262445992119,1cyclictest0-21swapper/323:13:423
262445992119,1cyclictest0-21swapper/322:54:233
262445992119,1cyclictest0-21swapper/322:47:393
262445992119,1cyclictest0-21swapper/322:32:593
262445992119,1cyclictest0-21swapper/322:22:113
262445992119,1cyclictest0-21swapper/322:17:183
262445992119,1cyclictest0-21swapper/322:12:243
262445992119,1cyclictest0-21swapper/321:41:223
262445992119,1cyclictest0-21swapper/321:36:423
262445992119,1cyclictest0-21swapper/321:30:143
262445992119,1cyclictest0-21swapper/320:33:083
262445992119,1cyclictest0-21swapper/320:17:063
262445992118,2cyclictest3056-21PK-Backend21:00:393
26244599210,20cyclictest3056-21PK-Backend21:12:423
26244599210,20cyclictest3056-21PK-Backend20:36:343
26244599210,20cyclictest0-21swapper/322:55:233
26244599210,20cyclictest0-21swapper/322:27:053
26244599210,20cyclictest0-21swapper/321:52:303
26244599210,19cyclictest3056-21PK-Backend21:15:193
26244599210,19cyclictest3056-21PK-Backend19:26:093
262440992119,1cyclictest0-21swapper/223:25:362
262440992119,1cyclictest0-21swapper/223:01:582
262440992119,1cyclictest0-21swapper/222:59:542
262440992119,1cyclictest0-21swapper/222:46:152
262440992119,1cyclictest0-21swapper/222:44:122
262440992119,1cyclictest0-21swapper/221:51:402
262440992119,1cyclictest0-21swapper/221:47:012
262440992119,1cyclictest0-21swapper/220:47:262
262440992119,1cyclictest0-21swapper/220:43:002
262440992119,1cyclictest0-21swapper/219:39:592
262440992119,1cyclictest0-21swapper/219:24:252
262440992119,1cyclictest0-21swapper/200:22:292
262440992119,1cyclictest0-21swapper/200:22:282
262440992119,1cyclictest0-21swapper/200:15:452
262437992110,9cyclictest291725-21python320:30:191
26243799210,20cyclictest3056-21PK-Backend23:38:151
26243799210,20cyclictest3056-21PK-Backend23:06:451
26243799210,20cyclictest3056-21PK-Backend20:00:081
26243799210,1cyclictest3056-21PK-Backend23:12:261
26243799210,19cyclictest3056-21PK-Backend23:50:381
26243799210,19cyclictest3056-21PK-Backend23:25:511
26243799210,19cyclictest3056-21PK-Backend22:48:401
26243799210,19cyclictest3056-21PK-Backend22:21:021
26243799210,19cyclictest3056-21PK-Backend19:56:231
26243799210,19cyclictest3056-21PK-Backend00:15:261
26243799210,19cyclictest3056-21PK-Backend00:00:121
26243799210,19cyclictest0-21swapper/100:22:561
26243799210,19cyclictest0-21swapper/100:22:561
26243399218,4cyclictest13-21ksoftirqd/023:21:090
26243399218,4cyclictest13-21ksoftirqd/023:21:090
26243399218,4cyclictest13-21ksoftirqd/000:12:130
26243399217,3cyclictest13-21ksoftirqd/021:33:090
26243399213,7cyclictest13-21ksoftirqd/020:55:140
262433992119,1cyclictest0-21swapper/023:31:250
262433992119,1cyclictest0-21swapper/022:30:550
262433992119,1cyclictest0-21swapper/019:42:510
262433992118,2cyclictest0-21swapper/020:35:100
262433992112,8cyclictest319712-21ls21:50:130
262433992111,3cyclictest13-21ksoftirqd/021:04:530
26243399210,8cyclictest13-21ksoftirqd/019:50:200
26243399210,8cyclictest13-21ksoftirqd/019:50:000
26243399210,11cyclictest13-21ksoftirqd/023:40:010
26244599205,13cyclictest42-21ksoftirqd/300:20:013
26244599203,15cyclictest366844-21diskstats00:05:143
262445992018,1cyclictest0-21swapper/323:58:443
262445992018,1cyclictest0-21swapper/323:44:053
262445992018,1cyclictest0-21swapper/300:38:453
262445992017,2cyclictest0-21swapper/323:06:593
262445992015,3cyclictest337088-21df_inode22:40:143
26244599201,16cyclictest335845-21python322:35:223
26244599200,1cyclictest3056-21PK-Backend21:06:423
26244599200,1cyclictest3056-21PK-Backend19:43:193
26244599200,19cyclictest0-21swapper/321:20:333
26244599200,19cyclictest0-21swapper/319:50:503
26244599200,19cyclictest0-21swapper/319:30:093
262440992018,1cyclictest0-21swapper/223:56:112
262440992018,1cyclictest0-21swapper/222:10:472
262440992018,1cyclictest0-21swapper/220:22:522
262440992018,1cyclictest0-21swapper/220:16:032
262440992018,1cyclictest0-21swapper/220:12:382
262440992018,1cyclictest0-21swapper/220:08:252
262440992018,1cyclictest0-21swapper/220:02:372
262440992018,1cyclictest0-21swapper/219:55:412
26244099200,1cyclictest0-21swapper/222:32:232
26244099200,1cyclictest0-21swapper/220:56:172
26244099200,1cyclictest0-21swapper/200:36:542
26244099200,19cyclictest0-21swapper/223:16:372
26244099200,19cyclictest0-21swapper/222:21:352
26244099200,19cyclictest0-21swapper/222:07:432
26244099200,19cyclictest0-21swapper/221:56:202
26244099200,19cyclictest0-21swapper/220:30:422
26244099200,19cyclictest0-21swapper/220:28:532
26244099200,19cyclictest0-21swapper/219:53:182
26244099200,19cyclictest0-21swapper/219:15:542
26244099200,19cyclictest0-21swapper/200:30:112
262437992018,1cyclictest3056-21PK-Backend23:03:541
262437992016,2cyclictest3056-21PK-Backend00:09:451
262437992012,6cyclictest306014-21sed21:10:231
26243799200,1cyclictest0-21swapper/100:25:471
26243799200,19cyclictest3056-21PK-Backend22:44:491
26243799200,19cyclictest3056-21PK-Backend22:36:161
26243799200,19cyclictest3056-21PK-Backend21:47:371
26243799200,19cyclictest0-21swapper/121:24:591
26243799200,19cyclictest0-21swapper/120:28:411
26243799200,19cyclictest0-21swapper/119:45:221
26243799200,19cyclictest0-21swapper/119:43:461
26243799200,18cyclictest3056-21PK-Backend23:24:491
26243799200,18cyclictest3056-21PK-Backend23:24:491
26243799200,18cyclictest3056-21PK-Backend21:51:141
26243399209,3cyclictest141rcu_preempt21:29:250
26243399206,3cyclictest3056-21PK-Backend00:00:370
26243399206,3cyclictest13-21ksoftirqd/023:13:460
26243399206,3cyclictest13-21ksoftirqd/021:57:040
26243399206,3cyclictest13-21ksoftirqd/021:36:380
26243399206,3cyclictest13-21ksoftirqd/000:15:490
262433992016,2cyclictest1788620-21WebKitWebProces19:16:080
262433992013,5cyclictest306945-21dpkg21:15:010
262433992012,6cyclictest350317-21dump-pmu-power23:20:010
26243399201,10cyclictest13-21ksoftirqd/019:25:220
26243399200,6cyclictest13-21ksoftirqd/022:55:210
26243399200,19cyclictest0-21swapper/000:20:460
26243399200,19cyclictest0-21swapper/000:20:460
3146562190,3sleep20-21swapper/221:35:162
262445991917,1cyclictest3056-21PK-Backend19:16:163
262445991917,1cyclictest0-21swapper/323:03:073
262445991917,1cyclictest0-21swapper/320:07:063
262445991917,1cyclictest0-21swapper/319:38:203
262445991912,6cyclictest369872-21sed00:15:003
262440991917,1cyclictest0-21swapper/223:43:202
262440991917,1cyclictest0-21swapper/222:35:272
262440991917,1cyclictest0-21swapper/221:22:062
262440991914,3cyclictest978-21snmpd00:09:462
26244099190,1cyclictest0-21swapper/223:36:242
26244099190,1cyclictest0-21swapper/223:30:292
26244099190,1cyclictest0-21swapper/221:41:192
26244099190,1cyclictest0-21swapper/221:07:472
26244099190,1cyclictest0-21swapper/219:11:212
26244099190,18cyclictest0-21swapper/222:15:402
26243799192,15cyclictest375810-21needreboot00:30:211
262437991917,1cyclictest3056-21PK-Backend23:57:211
262437991917,1cyclictest3056-21PK-Backend23:32:341
262437991917,1cyclictest3056-21PK-Backend21:38:301
262437991917,1cyclictest3056-21PK-Backend20:13:401
262437991917,1cyclictest3056-21PK-Backend00:10:461
262437991917,1cyclictest0-21swapper/121:00:381
262437991917,1cyclictest0-21swapper/120:52:481
262437991916,2cyclictest3056-21PK-Backend22:52:321
262437991916,2cyclictest3056-21PK-Backend22:06:491
26243799190,1cyclictest3056-21PK-Backend22:14:201
26243799190,1cyclictest3056-21PK-Backend21:40:191
26243799190,1cyclictest3056-21PK-Backend19:52:391
26243799190,18cyclictest0-21swapper/121:07:271
26243799190,18cyclictest0-21swapper/119:25:131
26243799190,18cyclictest0-21swapper/119:23:391
26243399197,5cyclictest13-21ksoftirqd/019:39:450
26243399196,4cyclictest13-21ksoftirqd/022:43:550
26243399196,4cyclictest13-21ksoftirqd/022:14:470
26243399195,5cyclictest13-21ksoftirqd/021:48:010
26243399195,3cyclictest13-21ksoftirqd/020:03:000
26243399194,4cyclictest13-21ksoftirqd/022:25:010
26243399193,8cyclictest13-21ksoftirqd/022:28:230
26243399191,9cyclictest13-21ksoftirqd/023:00:120
262433991917,1cyclictest0-21swapper/021:05:310
26243399191,6cyclictest13-21ksoftirqd/023:40:120
262433991914,3cyclictest309724-21timerwakeupswit21:20:210
26243399190,10cyclictest13-21ksoftirqd/000:25:210
262445991815,2cyclictest1119-21snapd20:03:293
262445991810,6cyclictest287764-21df_inode20:20:123
26244599180,16cyclictest3012302sleep320:59:513
262440991816,1cyclictest0-21swapper/220:35:082
262440991816,1cyclictest0-21swapper/219:46:352
26243799189,7cyclictest307850-21python321:15:231
262437991816,1cyclictest3056-21PK-Backend23:42:071
262437991816,1cyclictest3056-21PK-Backend23:16:181
262437991816,1cyclictest3056-21PK-Backend22:58:131
262437991816,1cyclictest3056-21PK-Backend22:27:441
262437991816,1cyclictest0-21swapper/100:36:071
262437991815,2cyclictest3056-21PK-Backend22:18:121
262437991812,5cyclictest270444-21cat19:30:131
262437991811,5cyclictest294260-21wc20:40:001
262437991811,5cyclictest265487-21sed19:15:161
26243799180,17cyclictest3056-21PK-Backend19:39:551
26243399186,4cyclictest13-21ksoftirqd/020:10:570
26243399186,3cyclictest13-21ksoftirqd/022:52:410
26243399186,3cyclictest13-21ksoftirqd/000:07:110
26243399184,8cyclictest13-21ksoftirqd/020:51:410
26243399181,6cyclictest13-21ksoftirqd/020:25:130
26243399180,9cyclictest13-21ksoftirqd/020:45:150
3130412170,7sleep126-21ksoftirqd/121:30:201
262445991715,1cyclictest3056-21PK-Backend20:54:373
262445991715,1cyclictest0-21swapper/300:20:073
262445991715,1cyclictest0-21swapper/300:20:073
26244599170,15cyclictest324956-21diskstats22:05:133
26244099179,6cyclictest270453-21fw_packets19:30:132
262440991715,1cyclictest0-21swapper/223:45:232
262440991715,1cyclictest0-21swapper/221:28:222
26243799179,6cyclictest295197-21python320:40:201
262437991715,1cyclictest0-21swapper/121:26:471
26243799170,3cyclictest3056-21PK-Backend20:10:001
262445991614,1cyclictest3056-21PK-Backend20:42:343
26244599160,14cyclictest361256-21apt23:50:103
26244099169,5cyclictest350647-21cat23:20:132
26244099169,5cyclictest350647-21cat23:20:122
26243799169,5cyclictest296063-21awk20:45:101
26243799166,5cyclictest141rcu_preempt20:55:141
262437991614,1cyclictest3056-21PK-Backend21:58:311
262437991614,1cyclictest0-21swapper/120:24:291
262440991513,1cyclictest0-21swapper/221:02:332
26243799152,5cyclictest141rcu_preempt20:15:131
26244099148,4cyclictest2156-21gnome-shell19:26:092
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional