You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 13:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Fri Aug 28, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
227472239163,24sleep30-21swapper/319:07:413
228612238163,23sleep20-21swapper/219:09:092
229092226193,23sleep00-21swapper/019:09:480
226362203168,24sleep10-21swapper/119:06:151
374621740,4sleep12301499cyclictest00:30:181
862721490,2sleep02300999cyclictest23:30:010
1217521490,5sleep02300999cyclictest22:23:070
1863721450,4sleep22302199cyclictest22:36:262
23021998279,2cyclictest0-21swapper/221:52:372
251082650,3sleep30-21swapper/320:25:143
234322580,3sleep00-21swapper/020:20:230
52732550,4sleep22302199cyclictest19:40:152
37972520,3sleep121-21rcuc/123:15:291
100532450,4sleep1221ktimersoftd/119:50:181
23021994340,2cyclictest0-21swapper/220:01:082
236072410,1sleep20-21swapper/220:20:252
159362380,4sleep215939-21proc_pri22:30:242
2302199331,20cyclictest0-21swapper/223:48:002
2302199331,20cyclictest0-21swapper/223:17:082
2302199331,20cyclictest0-21swapper/200:31:352
2302199331,14cyclictest0-21swapper/223:58:552
2302199331,13cyclictest0-21swapper/220:27:112
23021993310,3cyclictest9270-21kworker/u8:222:57:482
2302199330,15cyclictest0-21swapper/200:05:152
2302199321,21cyclictest0-21swapper/223:40:042
2302199321,20cyclictest0-21swapper/221:57:082
2302199321,19cyclictest0-21swapper/200:28:112
2302199321,13cyclictest11722-21diskmemload00:10:552
2302199311,15cyclictest0-21swapper/221:11:112
2302199311,15cyclictest0-21swapper/221:11:112
2302199311,12cyclictest0-21swapper/222:21:282
2302199311,12cyclictest0-21swapper/220:42:312
2302199301,13cyclictest0-21swapper/222:12:522
2302199291,19cyclictest0-21swapper/222:51:042
2302199291,17cyclictest0-21swapper/221:24:032
2302199291,17cyclictest0-21swapper/200:24:472
2302199291,14cyclictest0-21swapper/221:38:382
2302199291,13cyclictest0-21swapper/222:46:082
2302199291,12cyclictest0-21swapper/223:24:042
2302199291,11cyclictest0-21swapper/223:00:242
2302199291,11cyclictest0-21swapper/222:17:002
2302199291,11cyclictest0-21swapper/219:30:332
23021992910,2cyclictest0-21swapper/219:25:112
2302199290,12cyclictest0-21swapper/222:40:162
2302699289,6cyclictest0-21swapper/323:55:183
2302699281,6cyclictest0-21swapper/322:29:343
2302699281,6cyclictest0-21swapper/322:29:333
2302699281,6cyclictest0-21swapper/321:19:303
2302699281,6cyclictest0-21swapper/321:19:303
2302699281,6cyclictest0-21swapper/300:02:293
2302699281,5cyclictest0-21swapper/322:54:313
2302199281,15cyclictest0-21swapper/200:00:032
2302199281,13cyclictest0-21swapper/223:27:362
2302199281,12cyclictest0-21swapper/223:36:202
2302199281,12cyclictest0-21swapper/223:36:202
2302199280,12cyclictest0-21swapper/223:05:322
2300999286,4cyclictest19568-21kworker/0:320:15:590
2302699273,9cyclictest18631-40dnf22:36:243
2302699271,7cyclictest0-21swapper/323:04:133
2302699271,6cyclictest0-21swapper/323:27:343
2302199271,12cyclictest0-21swapper/221:40:542
2302199271,12cyclictest0-21swapper/219:51:552
2302199271,11cyclictest0-21swapper/223:10:082
2302199271,11cyclictest0-21swapper/219:55:072
2302199270,19cyclictest0-21swapper/221:27:262
2302199270,14cyclictest0-21swapper/220:47:162
2302199270,12cyclictest0-21swapper/222:05:482
2302199270,12cyclictest0-21swapper/221:31:102
2302199270,12cyclictest0-21swapper/221:15:502
2302199270,12cyclictest0-21swapper/221:15:502
2302199270,11cyclictest0-21swapper/220:57:272
23014992714,8cyclictest0-21swapper/100:02:281
23014992714,3cyclictest22422-21ntp_states22:45:221
23009992715,3cyclictest17772-21irqstats22:35:190
2302699268,4cyclictest12498-21cut22:25:013
2302699262,4cyclictest24542-21diskstats00:05:143
2302699261,6cyclictest0-21swapper/321:51:343
23026992615,6cyclictest2534-21/usr/sbin/munin19:35:253
2302199268,3cyclictest0-21swapper/221:47:232
2302199261,6cyclictest0-21swapper/200:35:192
2302199261,15cyclictest0-21swapper/220:18:122
2302199261,12cyclictest0-21swapper/223:55:002
2302199261,12cyclictest0-21swapper/222:25:402
2302199261,12cyclictest0-21swapper/222:25:402
2302199261,12cyclictest0-21swapper/220:13:352
2302199261,10cyclictest0-21swapper/220:07:562
2302199261,10cyclictest0-21swapper/220:07:552
2302199260,10cyclictest0-21swapper/223:30:142
23014992620,3cyclictest16731-21munin-run22:35:011
23014992614,6cyclictest0-21swapper/122:29:341
23014992614,6cyclictest0-21swapper/122:29:341
23014992613,7cyclictest0-21swapper/122:54:311
2300999261,9cyclictest11262-21tail21:05:270
38962250,2sleep00-21swapper/020:50:160
2302699251,6cyclictest0-21swapper/323:54:243
2302699251,6cyclictest0-21swapper/323:35:223
2302699251,6cyclictest0-21swapper/323:35:223
2302699251,6cyclictest0-21swapper/322:45:223
2302699251,6cyclictest0-21swapper/321:38:433
2302699251,5cyclictest0-21swapper/323:06:343
2302199251,16cyclictest0-21swapper/219:11:552
2302199250,12cyclictest0-21swapper/222:00:202
23014992513,6cyclictest0-21swapper/121:15:261
23014992513,6cyclictest0-21swapper/121:15:261
23014992512,7cyclictest0-21swapper/123:27:331
2300999257,15cyclictest15143-21idleruntime-cro23:45:010
23009992515,3cyclictest0-21swapper/023:16:350
23009992515,3cyclictest0-21swapper/022:14:120
2300999251,12cyclictest18990-21ntp_states20:10:210
2300999251,11cyclictest0-21swapper/019:34:000
23009992510,12cyclictest28846-21grep21:45:270
79322240,4sleep011-21rcuc/019:45:190
2302699241,6cyclictest0-21swapper/322:18:033
2302199241,12cyclictest0-21swapper/219:37:102
23014992414,3cyclictest0-21swapper/123:04:121
23014992413,6cyclictest4118-21uptime19:35:251
23014992413,3cyclictest0-21swapper/123:40:441
23014992412,8cyclictest0-21swapper/100:21:021
23014992412,7cyclictest0-21swapper/121:11:051
23014992412,7cyclictest0-21swapper/121:11:051
2301499241,20cyclictest31099-21unixbench_singl21:50:271
2301499241,20cyclictest26601-21fschecks_time19:15:151
23014992411,3cyclictest0-21swapper/120:12:141
2301499240,22cyclictest0-21swapper/121:35:481
2300999246,4cyclictest0-21swapper/022:26:060
2300999246,4cyclictest0-21swapper/022:26:060
23009992417,3cyclictest0-21swapper/000:05:140
23009992415,2cyclictest0-21swapper/022:18:040
23009992414,3cyclictest0-21swapper/023:39:460
23009992414,3cyclictest0-21swapper/023:39:460
23009992414,3cyclictest0-21swapper/023:08:090
23009992414,3cyclictest0-21swapper/022:56:580
23009992414,3cyclictest0-21swapper/022:02:100
23009992414,3cyclictest0-21swapper/021:16:110
23009992414,3cyclictest0-21swapper/021:16:110
23009992414,3cyclictest0-21swapper/000:34:430
2300999241,11cyclictest608-21wc00:25:130
2300999241,10cyclictest0-21swapper/000:00:140
23009992410,9cyclictest0-21swapper/000:39:070
2300999240,10cyclictest0-21swapper/023:55:170
2302699234,12cyclictest25995-21kworker/3:221:00:173
2302699231,6cyclictest0-21swapper/323:10:383
2302699231,6cyclictest0-21swapper/322:56:593
2302699231,6cyclictest0-21swapper/322:14:113
2302699231,5cyclictest0-21swapper/321:11:063
2302699231,5cyclictest0-21swapper/321:11:063
2302699231,4cyclictest0-21swapper/323:16:353
2302699231,12cyclictest808-21snmpd22:00:203
2302199231,10cyclictest7603-21hddtemp_smartct19:45:152
2302199230,16cyclictest0-21swapper/221:00:362
2301499231,4cyclictest4985-21grep23:20:151
23014992313,3cyclictest0-21swapper/123:06:331
23014992313,3cyclictest0-21swapper/100:05:091
2301499230,9cyclictest0-21swapper/120:00:261
2300999231,9cyclictest31390-21grep00:20:180
23009992314,3cyclictest0-21swapper/022:51:160
23009992314,3cyclictest0-21swapper/021:35:070
23009992314,2cyclictest0-21swapper/023:47:370
23009992314,2cyclictest0-21swapper/023:10:380
23009992313,3cyclictest0-21swapper/023:33:500
23009992313,3cyclictest0-21swapper/022:45:390
23009992313,3cyclictest0-21swapper/022:34:180
23009992313,3cyclictest0-21swapper/021:25:320
23009992312,2cyclictest12306-21entropy21:10:150
23009992312,2cyclictest12306-21entropy21:10:150
235802220,4sleep339-21rcuc/319:10:143
2302699221,6cyclictest0-21swapper/323:40:453
2302699221,6cyclictest0-21swapper/323:30:393
2302699221,6cyclictest0-21swapper/300:33:523
2302699221,5cyclictest0-21swapper/323:47:373
2302699221,4cyclictest0-21swapper/321:28:353
2302199229,3cyclictest0-21swapper/220:39:032
2302199223,7cyclictest0-21swapper/219:21:292
2302199221,6cyclictest0-21swapper/200:16:172
2302199221,14cyclictest0-21swapper/220:34:152
2302199221,13cyclictest0-21swapper/221:06:072
2302199220,10cyclictest0-21swapper/219:15:152
2301499227,3cyclictest0-21swapper/122:19:131
2301499225,4cyclictest8909-21cpuspeed_turbos23:30:121
2301499221,3cyclictest3778-21/usr/sbin/munin22:05:201
2301499221,3cyclictest26740-21df00:10:141
2301499221,20cyclictest0-21swapper/120:15:261
23014992210,8cyclictest0-21swapper/121:41:461
23014992210,8cyclictest0-21swapper/121:22:461
2301499220,9cyclictest0-21swapper/119:10:131
2301499220,5cyclictest0-21swapper/123:51:301
23009992215,3cyclictest0-21swapper/021:53:360
23009992213,2cyclictest0-21swapper/022:43:500
23009992212,3cyclictest0-21swapper/023:22:150
23009992212,3cyclictest0-21swapper/021:59:310
2300999221,16cyclictest0-21swapper/021:32:200
2300999221,10cyclictest10861-21sshd19:52:080
2300999220,20cyclictest0-21swapper/023:00:100
2302699216,2cyclictest87350irq/126-enp1s0-20:55:253
2302699213,10cyclictest15753-21cpu20:05:113
2302699213,10cyclictest15753-21cpu20:05:113
2302699211,6cyclictest0-21swapper/321:47:333
2302699211,6cyclictest0-21swapper/300:26:203
2302699211,6cyclictest0-21swapper/300:21:023
2302699211,5cyclictest0-21swapper/322:31:253
2302199211,12cyclictest0-21swapper/220:52:362
2301499214,3cyclictest0-21swapper/121:33:521
2301499213,13cyclictest87450irq/127-enp1s0-22:38:441
23014992117,3cyclictest0-21swapper/122:59:101
23014992117,2cyclictest26492-21sa120:30:011
23014992114,4cyclictest31153-21cut19:25:141
2301499211,14cyclictest0-21swapper/100:25:221
23014992111,3cyclictest0-21swapper/123:56:401
23014992111,3cyclictest0-21swapper/123:37:151
23014992111,3cyclictest0-21swapper/123:37:151
23014992111,3cyclictest0-21swapper/122:20:191
2301499211,11cyclictest53472chrt20:55:111
2300999217,3cyclictest0-21swapper/023:50:200
23009992111,3cyclictest0-21swapper/022:08:030
23009992111,3cyclictest0-21swapper/000:13:070
2300999211,10cyclictest0-21swapper/020:00:030
2300999210,19cyclictest0-21swapper/020:43:530
93952200,5sleep39-21rcu_preempt19:50:123
2302699201,7cyclictest0-21swapper/320:37:093
2302699201,5cyclictest0-21swapper/321:41:453
2302699201,4cyclictest0-21swapper/323:22:163
2302699201,4cyclictest0-21swapper/300:35:223
2302699201,4cyclictest0-21swapper/300:10:353
2302699201,3cyclictest0-21swapper/321:55:443
2302699201,11cyclictest11711-21fschecks_count19:55:143
2302699201,10cyclictest929-21/usr/sbin/munin20:45:263
2302699201,10cyclictest21176-21ntpq20:15:203
2301499209,3cyclictest24291-21latency_hist20:25:021
2301499206,3cyclictest0-21swapper/121:56:101
23014992012,3cyclictest0-21swapper/121:47:341
2301499201,18cyclictest0-21swapper/121:01:161
2301499201,18cyclictest0-21swapper/120:42:411
2301499201,16cyclictest20148-21strings22:40:201
2301499201,16cyclictest1654-21/usr/sbin/munin22:00:131
23014992010,6cyclictest0-21swapper/123:13:331
2301499200,9cyclictest0-21swapper/122:12:021
2301499200,10cyclictest0-21swapper/100:19:011
2300999209,2cyclictest0-21swapper/019:20:100
2300999205,4cyclictest25482-21df21:40:140
2300999202,16cyclictest6718-21perf19:45:010
23009992016,3cyclictest0-21swapper/021:23:350
23009992016,3cyclictest0-21swapper/000:19:340
130192201,3sleep00-21swapper/019:56:400
2302699198,3cyclictest30500-21/usr/sbin/munin19:25:243
2302699196,3cyclictest3778-21/usr/sbin/munin22:05:213
2302699191,6cyclictest0-21swapper/319:20:063
2302699191,4cyclictest22320-21/usr/sbin/munin20:20:163
2302699191,4cyclictest0-21swapper/321:30:423
2302699191,4cyclictest0-21swapper/321:22:463
2302699191,4cyclictest0-21swapper/300:16:233
2302699191,10cyclictest808-21snmpd19:44:533
2302699191,10cyclictest32696-21/usr/sbin/munin19:30:323
2302699191,10cyclictest19153-21/usr/sbin/munin22:40:223
2302699191,10cyclictest17926-21/usr/sbin/munin20:10:243
2301499199,3cyclictest0-21swapper/123:46:251
2301499197,4cyclictest5103-21cat20:54:571
23014991912,4cyclictest11715-21sh21:10:001
2301499191,17cyclictest0-21swapper/119:56:151
2301499191,16cyclictest0-21swapper/120:36:581
2301499191,15cyclictest28549-21cat19:20:111
2301499191,10cyclictest26954-21expr20:30:131
23014991910,2cyclictest8192-21smart_sda19:45:241
2300999195,3cyclictest31774-21switchtime19:25:240
2300999191,8cyclictest766-21ntpd20:09:190
2300999191,8cyclictest766-21ntpd20:09:190
23009991913,3cyclictest1063-21grep20:45:120
23009991912,4cyclictest827-21runrttasks19:10:190
2302699181,7cyclictest7009-21cat19:45:123
23026991812,3cyclictest26722-21/usr/sbin/munin20:30:233
23014991814,3cyclictest0-21swapper/120:05:141
23014991814,3cyclictest0-21swapper/120:05:141
2301499181,3cyclictest0-21swapper/119:43:471
23014991813,3cyclictest1602-21head20:45:171
2301499181,16cyclictest0-21swapper/119:32:191
2301499180,17cyclictest0-21swapper/121:25:031
2301499180,16cyclictest0-21swapper/100:35:271
2300999184,8cyclictest3703-40dnf19:35:260
2300999181,5cyclictest24521-21/usr/sbin/munin20:25:130
2300999180,9cyclictest0-21swapper/019:15:120
2302699173,5cyclictest15512-21awk20:05:013
2302699171,3cyclictest0-21swapper/320:41:343
2302699171,14cyclictest0-21swapper/319:19:033
2300999171,7cyclictest87350irq/126-enp1s0-20:40:010
2300999171,5cyclictest5348-21/usr/sbin/munin20:55:110
2300999171,4cyclictest26722-21/usr/sbin/munin20:30:180
23026991611,3cyclictest10072-21expr21:05:143
2300999160,10cyclictest0-21swapper/021:00:150
2302699151,6cyclictest0-21swapper/320:50:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional