You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 07:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot3s.osadl.org (updated Wed Sep 16, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316172239164,24sleep00-21swapper/019:06:370
317802237163,23sleep20-21swapper/219:08:442
318382228153,28sleep30-21swapper/319:09:313
318312203166,24sleep10-21swapper/119:09:241
919521640,4sleep33197899cyclictest23:10:123
2573421460,5sleep03196399cyclictest23:45:250
270521260,3sleep10-21swapper/122:55:181
31973998077,2cyclictest0-21swapper/223:33:482
31973998077,2cyclictest0-21swapper/223:33:482
14062600,4sleep01410-21gltestperf00:05:150
84452540,1sleep10-21swapper/120:40:181
101492490,1sleep00-21swapper/020:45:130
81522450,3sleep28154-21ntp_offset19:25:222
39372420,1sleep00-21swapper/019:15:250
3196399388,14cyclictest6871-21munin-run19:25:010
3197399371,7cyclictest603-21latency_hist00:05:022
3196899371,24cyclictest0-21swapper/121:21:171
31963993524,2cyclictest17347-21kworker/0:223:33:030
31963993524,2cyclictest17347-21kworker/0:223:33:030
3197899341,17cyclictest24746-21cut23:45:153
3197899341,15cyclictest0-21swapper/321:18:593
31973993410,2cyclictest87550irq/128-enp1s0-23:10:152
3196899341,12cyclictest0-21swapper/122:15:291
3196399348,12cyclictest2133-21munin-run22:55:020
3196399345,13cyclictest9081-21basename19:30:010
3196399332,19cyclictest32715-21kworker/0:300:13:230
31963993310,11cyclictest32298-21perf22:50:020
3197899321,19cyclictest0-21swapper/321:25:273
3197899321,12cyclictest0-21swapper/320:08:043
31973993220,3cyclictest0-21swapper/221:45:142
3197399321,18cyclictest0-21swapper/220:44:092
3196899320,24cyclictest0-21swapper/100:08:191
3196399322,24cyclictest16549-21kworker/0:022:12:350
31963993220,3cyclictest26164-21kworker/0:323:52:110
3196899311,23cyclictest0-21swapper/122:00:131
3196899311,12cyclictest0-21swapper/119:54:011
3196899310,17cyclictest0-21swapper/121:49:011
3196399311,11cyclictest16145-21kworker/0:021:00:150
3197899301,27cyclictest0-21swapper/320:16:073
3197899301,12cyclictest0-21swapper/322:36:393
3197399301,4cyclictest22647-21ls22:25:212
31973993014,4cyclictest15990-21ntp_states22:10:212
3197399301,19cyclictest0-21swapper/222:40:132
3197399301,12cyclictest0-21swapper/221:33:462
3196899301,21cyclictest0-21swapper/122:37:011
3196399307,3cyclictest32715-21kworker/0:300:15:230
3196399302,11cyclictest6479-21kworker/0:123:05:200
3196399302,11cyclictest30635-21kworker/0:200:03:150
31978992918,3cyclictest0-21swapper/323:28:313
3197899291,6cyclictest0-21swapper/323:07:473
3197899291,21cyclictest0-21swapper/319:18:553
3197899291,14cyclictest20290-21diskstats23:35:153
3197899291,11cyclictest0-21swapper/321:36:283
3197399293,5cyclictest1-21systemd21:30:022
3197399291,5cyclictest0-21swapper/200:20:552
3197399291,4cyclictest0-21swapper/222:35:192
3197399291,18cyclictest1779-21turbostat19:15:012
3197399291,11cyclictest0-21swapper/222:46:092
3197399290,11cyclictest0-21swapper/220:20:052
3196899291,2cyclictest0-21swapper/119:28:271
3196899291,17cyclictest0-21swapper/120:47:221
3196899291,14cyclictest2425750sshd20:02:391
3196899291,14cyclictest2425750sshd20:02:391
3196899291,14cyclictest0-21swapper/122:05:471
3196899291,13cyclictest0-21swapper/120:06:231
3196899291,12cyclictest0-21swapper/122:45:371
3196899291,11cyclictest0-21swapper/120:35:541
3196899291,11cyclictest0-21swapper/100:11:131
3196899291,10cyclictest0-21swapper/121:06:061
3196899290,12cyclictest0-21swapper/121:38:011
3196899290,10cyclictest0-21swapper/100:33:371
3196399295,10cyclictest7048-21kworker/0:100:30:230
3196399291,10cyclictest25409-21kworker/0:022:34:520
295972290,4sleep13196899cyclictest21:30:011
3197899281,9cyclictest0-21swapper/320:57:013
3197899281,18cyclictest0-21swapper/321:05:153
3197899281,11cyclictest6429-21wc00:15:233
3197899281,11cyclictest0-21swapper/300:23:233
3197899280,12cyclictest0-21swapper/300:09:013
3197899280,11cyclictest0-21swapper/321:24:553
31973992812,3cyclictest1105-21df00:05:142
3197399281,12cyclictest0-21swapper/223:23:132
3197399281,12cyclictest0-21swapper/222:55:572
3197399281,10cyclictest0-21swapper/220:57:212
31973992810,3cyclictest112162sleep223:15:132
3196899281,9cyclictest0-21swapper/121:33:231
3196899281,12cyclictest0-21swapper/119:14:051
3196899281,11cyclictest0-21swapper/123:50:211
3196899281,11cyclictest0-21swapper/100:17:451
3196899281,10cyclictest0-21swapper/100:27:091
3196899280,2cyclictest0-21swapper/121:55:311
3196899280,2cyclictest0-21swapper/119:56:551
3196899280,11cyclictest0-21swapper/123:08:341
3196399286,13cyclictest87650irq/129-enp1s0-20:00:240
3196399286,13cyclictest87650irq/129-enp1s0-20:00:240
3196399286,12cyclictest87350irq/126-enp1s0-19:36:470
3196399282,10cyclictest1309-21kworker/0:021:42:510
3196399281,12cyclictest20970-21kworker/0:222:29:080
31963992810,5cyclictest30945-21kworker/0:020:24:360
31963992810,16cyclictest13124-21munin-run23:20:010
3197899271,15cyclictest0-21swapper/319:43:403
3197899271,13cyclictest0-21swapper/323:41:353
3197899271,13cyclictest0-21swapper/322:25:273
3197899271,13cyclictest0-21swapper/320:29:133
3197899271,12cyclictest0-21swapper/322:50:593
3197899271,11cyclictest0-21swapper/320:03:243
3197899271,11cyclictest0-21swapper/320:03:243
31973992717,4cyclictest0-21swapper/223:40:142
31973992712,3cyclictest0-21swapper/222:31:412
31973992711,3cyclictest5536-21df_inode00:15:142
3197399271,13cyclictest0-21swapper/222:09:252
3197399271,11cyclictest0-21swapper/219:57:252
3197399271,10cyclictest0-21swapper/223:27:172
3197399270,12cyclictest0-21swapper/223:52:022
3197399270,10cyclictest0-21swapper/220:46:092
3196899271,12cyclictest0-21swapper/120:22:041
3196899271,11cyclictest0-21swapper/119:21:141
3196899270,12cyclictest0-21swapper/122:53:071
3196899270,11cyclictest0-21swapper/123:42:301
3196899270,11cyclictest0-21swapper/121:15:061
3196899270,10cyclictest0-21swapper/123:04:101
3196399279,8cyclictest2006-21kworker/0:322:55:200
3196399277,9cyclictest13473-21kworker/0:200:37:150
3196399276,7cyclictest12207-21kworker/0:119:41:070
3196399272,11cyclictest30635-21kworker/0:223:59:270
3196399271,9cyclictest32715-21kworker/0:300:25:150
31963992716,2cyclictest10269-21kworker/0:122:15:040
31963992711,7cyclictest23181-21kworker/0:122:36:520
3196399271,10cyclictest15292-21kworker/0:019:53:190
101612270,5sleep121-21rcuc/123:10:231
3197899261,9cyclictest0-21swapper/300:25:353
3197899261,15cyclictest12549-21ntp_states19:35:203
3197899261,13cyclictest0-21swapper/322:42:313
3197899261,12cyclictest0-21swapper/323:02:233
3197899261,11cyclictest0-21swapper/322:30:153
3197899261,11cyclictest0-21swapper/322:24:003
3197899261,11cyclictest0-21swapper/322:23:593
3197899261,11cyclictest0-21swapper/300:13:553
3197899261,10cyclictest0-21swapper/322:03:123
3197899261,10cyclictest0-21swapper/319:50:363
3197899261,10cyclictest0-21swapper/319:14:493
3197899260,10cyclictest0-21swapper/323:21:413
3197399266,3cyclictest0-21swapper/221:39:222
3197399265,3cyclictest0-21swapper/221:42:542
3197399261,9cyclictest0-21swapper/200:32:352
3197399261,5cyclictest24786-21cut20:05:132
31973992611,3cyclictest6427-21expr21:50:142
31973992611,3cyclictest0-21swapper/200:27:582
3197399261,12cyclictest25365-21cpuspeed_turbos21:20:142
3197399261,12cyclictest0-21swapper/222:52:012
3197399261,12cyclictest0-21swapper/222:22:012
3197399261,12cyclictest0-21swapper/222:22:012
3197399261,11cyclictest20676-21diskmemload00:11:102
3197399261,11cyclictest0-21swapper/221:18:302
31973992610,5cyclictest0-21swapper/223:01:372
31973992610,3cyclictest0-21swapper/223:55:182
31973992610,3cyclictest0-21swapper/220:11:092
3196899261,13cyclictest0-21swapper/120:59:101
3196899261,12cyclictest0-21swapper/122:20:371
3196899261,12cyclictest0-21swapper/122:20:371
3196899261,12cyclictest0-21swapper/120:53:381
3196899261,11cyclictest0-21swapper/123:39:101
3196899261,10cyclictest0-21swapper/123:31:421
3196899261,10cyclictest0-21swapper/123:31:421
3196899261,10cyclictest0-21swapper/120:28:581
3196899261,10cyclictest0-21swapper/119:44:011
3196899260,11cyclictest0-21swapper/100:39:491
3196899260,10cyclictest0-21swapper/120:10:551
3196399265,15cyclictest87650irq/129-enp1s0-23:25:230
3196399264,13cyclictest87650irq/129-enp1s0-21:30:270
3196399262,10cyclictest31480-21kworker/0:321:37:390
3196399262,10cyclictest22860-21kworker/0:121:16:430
31963992615,2cyclictest3045-21kworker/0:120:29:410
3196399261,24cyclictest10269-21kworker/0:122:08:510
3196399261,10cyclictest4963-21kworker/0:320:36:310
3197899256,3cyclictest0-21swapper/300:03:433
3197899251,9cyclictest0-21swapper/321:51:243
3197899251,16cyclictest0-21swapper/319:57:483
3197899251,14cyclictest0-21swapper/319:22:593
3197899251,12cyclictest0-21swapper/319:33:043
3197899251,11cyclictest0-21swapper/323:15:593
3197899251,11cyclictest0-21swapper/322:56:233
3197899251,11cyclictest0-21swapper/320:37:073
3197899251,11cyclictest0-21swapper/320:10:233
3197899251,10cyclictest0-21swapper/300:32:433
3197899250,9cyclictest0-21swapper/321:10:473
3197899250,9cyclictest0-21swapper/321:10:473
3197899250,11cyclictest0-21swapper/321:56:423
3197399259,3cyclictest20676-21diskmemload22:00:532
3197399259,3cyclictest0-21swapper/220:52:052
3197399259,3cyclictest0-21swapper/220:30:252
3197399258,4cyclictest0-21swapper/219:45:132
3197399258,3cyclictest0-21swapper/222:17:252
3197399257,3cyclictest0-21swapper/221:06:462
3197399251,8cyclictest0-21swapper/219:16:012
31973992511,3cyclictest0-21swapper/219:50:292
3197399251,12cyclictest0-21swapper/223:47:342
3197399251,11cyclictest24540-21latency_hist20:05:012
3197399251,11cyclictest24540-21latency_hist20:05:012
3197399251,11cyclictest0-21swapper/223:35:062
31973992510,3cyclictest0-21swapper/223:07:052
31973992510,3cyclictest0-21swapper/220:36:012
3196899251,9cyclictest20676-21diskmemload21:11:321
3196899251,9cyclictest20676-21diskmemload21:11:321
3196899251,9cyclictest0-21swapper/119:33:451
3196899251,10cyclictest0-21swapper/122:13:531
3196899251,10cyclictest0-21swapper/121:52:451
3196899250,12cyclictest0-21swapper/123:28:201
3196899250,12cyclictest0-21swapper/122:41:151
3196899250,11cyclictest0-21swapper/123:48:001
3196899250,10cyclictest0-21swapper/122:32:051
3196899250,10cyclictest0-21swapper/100:23:231
3196399257,3cyclictest13917-21kworker/0:120:55:550
3196399256,8cyclictest18392-21kworker/0:221:10:390
3196399256,8cyclictest18392-21kworker/0:221:10:390
3196399256,13cyclictest87650irq/129-enp1s0-23:35:250
3196399252,9cyclictest11661-21kworker/0:320:52:390
3196399252,11cyclictest17558-21kworker/0:119:46:350
3196399251,9cyclictest32068-21kworker/0:223:14:480
3196399251,9cyclictest29798-21kworker/0:022:44:080
31963992512,3cyclictest22164-21kworker/0:120:09:280
31963992511,3cyclictest26832-21kworker/0:221:22:110
3196399251,11cyclictest4963-21kworker/0:320:32:070
3196399251,10cyclictest32068-21kworker/0:223:00:080
3197899245,3cyclictest0-21swapper/320:49:573
3197899241,9cyclictest0-21swapper/320:44:053
3197899241,8cyclictest0-21swapper/321:42:123
3197899241,8cyclictest0-21swapper/300:38:363
31978992417,4cyclictest27136-21grep23:50:153
3197899241,13cyclictest0-21swapper/322:46:273
3197899241,12cyclictest0-21swapper/322:05:083
3197899241,12cyclictest0-21swapper/320:30:233
3197899241,10cyclictest0-21swapper/320:50:193
3197899240,10cyclictest0-21swapper/322:15:143
3197399246,3cyclictest0-21swapper/221:13:142
3197399246,3cyclictest0-21swapper/221:13:142
3197399241,12cyclictest0-21swapper/220:16:412
3197399241,11cyclictest0-21swapper/219:24:502
3196899241,8cyclictest0-21swapper/121:01:341
3196899241,7cyclictest0-21swapper/123:16:021
3196899240,9cyclictest0-21swapper/122:29:011
3196899240,9cyclictest0-21swapper/121:40:571
3196899240,9cyclictest0-21swapper/120:30:181
3196899240,11cyclictest0-21swapper/123:56:451
3196899240,11cyclictest0-21swapper/119:17:381
3196899240,10cyclictest0-21swapper/119:39:431
3196899240,10cyclictest0-21swapper/100:00:311
3196399247,2cyclictest9043-21kworker/0:019:33:470
3196399245,9cyclictest19050-21kworker/0:022:22:160
3196399245,9cyclictest19050-21kworker/0:022:22:160
3196399243,3cyclictest13917-21kworker/0:121:07:070
3196399242,8cyclictest7164-21kworker/0:120:44:030
3196399241,9cyclictest7048-21kworker/0:100:22:510
31963992410,3cyclictest1309-21kworker/0:021:58:030
31963992410,2cyclictest5797-21kworker/0:121:51:070
3197899238,3cyclictest0-21swapper/319:45:443
3197899231,9cyclictest0-21swapper/322:12:443
3197899231,15cyclictest0-21swapper/320:22:113
3197899231,13cyclictest0-21swapper/321:45:563
3197399238,3cyclictest0-21swapper/221:01:052
3197399231,16cyclictest0-21swapper/221:59:172
3197399231,11cyclictest0-21swapper/219:44:212
3196899231,12cyclictest0-21swapper/119:48:091
31968992311,10cyclictest6496-21kworker/u8:123:21:281
3196399236,2cyclictest10269-21kworker/0:122:00:150
3196399231,8cyclictest29279-21kworker/0:021:28:270
31963992311,2cyclictest26491-21kworker/0:320:12:120
3197899221,8cyclictest0-21swapper/323:57:593
3197899221,10cyclictest0-21swapper/321:01:593
3197399229,2cyclictest0-21swapper/219:35:182
3197399227,3cyclictest0-21swapper/219:30:062
3197399226,3cyclictest0-21swapper/220:28:092
3196899220,10cyclictest0-21swapper/120:15:111
3196399226,2cyclictest5797-21kworker/0:121:49:550
3196399222,3cyclictest19916-21kworker/0:219:58:310
3197899215,3cyclictest0-21swapper/321:34:493
3197399217,3cyclictest0-21swapper/200:39:502
3196399216,7cyclictest11143-21kworker/0:123:21:030
3196399212,11cyclictest22164-21kworker/0:120:16:000
3196399211,11cyclictest5548-21kworker/0:119:11:320
3197899209,2cyclictest0-21swapper/323:30:273
3197899209,2cyclictest0-21swapper/323:30:273
3197899200,10cyclictest0-21swapper/319:26:063
3196399207,2cyclictest19608-21kworker/0:123:40:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional