You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 21:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Aug 16, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2110699280,1cyclictest0-21swapper/212:27:182
2110699260,25cyclictest0-21swapper/212:20:542
2110699260,22cyclictest27654-21ssh11:45:372
21107992523,1cyclictest34-21ksoftirqd/312:40:003
21107992523,1cyclictest0-21swapper/310:51:313
2110799250,24cyclictest0-21swapper/311:30:303
21106992520,4cyclictest0-21swapper/212:08:402
2110699250,24cyclictest15266-21diskmemload12:10:332
2110699250,24cyclictest15266-21diskmemload10:32:442
2110699250,21cyclictest15266-21diskmemload12:15:072
2110699250,1cyclictest0-21swapper/210:21:042
21105992524,1cyclictest28791-21ssh10:49:231
2110599250,1cyclictest15266-21diskmemload10:17:531
21104992523,1cyclictest14576-21ssh10:35:070
21104992521,3cyclictest17136-21ssh10:09:540
2110499250,24cyclictest15266-21diskmemload10:51:100
2110499250,24cyclictest0-21swapper/011:11:040
21107992422,1cyclictest3798-21apt-get08:49:533
21107992422,1cyclictest0-21swapper/312:34:333
21107992422,1cyclictest0-21swapper/309:20:013
2110799240,24cyclictest0-21swapper/311:40:463
2110799240,23cyclictest3946-21sendmail07:40:003
2110799240,23cyclictest30389-21apt08:35:013
2110799240,23cyclictest0-21swapper/311:49:593
2110799240,23cyclictest0-21swapper/310:42:533
21106992423,1cyclictest0-21swapper/209:30:002
21106992422,2cyclictest0-21swapper/211:33:082
21106992422,2cyclictest0-21swapper/210:16:562
21106992421,3cyclictest0-21swapper/212:36:382
21106992420,3cyclictest0-21swapper/210:44:352
21106992420,3cyclictest0-21swapper/210:08:302
21106992420,3cyclictest0-21swapper/210:01:082
21106992420,3cyclictest0-21swapper/209:56:272
2110699240,3cyclictest0-21swapper/209:52:322
2110699240,24cyclictest0-21swapper/211:29:232
2110699240,23cyclictest5697-21ssh10:57:032
2110699240,23cyclictest0-21swapper/212:30:182
2110699240,20cyclictest0-21swapper/210:51:462
2110699240,0cyclictest15266-21diskmemload09:12:262
2110699240,0cyclictest0-21swapper/211:20:522
2110599241,22cyclictest4298-21sh12:23:581
2110599241,22cyclictest2820-21head10:25:011
2110599240,23cyclictest15266-21diskmemload10:54:081
2110599240,0cyclictest0-21swapper/109:37:351
21104992424,0cyclictest0-21swapper/011:03:500
21104992424,0cyclictest0-21swapper/009:48:330
21104992423,1cyclictest15266-21diskmemload12:19:510
21104992423,1cyclictest11891-21ssh10:34:050
21104992423,1cyclictest0-21swapper/010:24:120
21104992422,1cyclictest20501-21ssh10:12:080
21104992421,2cyclictest21762-21memory12:09:580
2110499240,23cyclictest18749-21ssh09:13:400
2110499240,23cyclictest15266-21diskmemload09:40:230
2110499240,23cyclictest13784-21sh11:34:440
2110499240,23cyclictest13740-21ssh12:02:280
21107992323,0cyclictest0-21swapper/311:25:573
21107992323,0cyclictest0-21swapper/309:53:123
21107992321,1cyclictest75-21kswapd009:55:023
21107992321,1cyclictest7340-21apt-get08:55:013
21107992321,1cyclictest2786-21perf08:45:013
21107992321,1cyclictest2668-21munin-run10:25:003
21107992321,1cyclictest0-21swapper/311:10:153
21107992321,1cyclictest0-21swapper/309:36:593
21107992320,2cyclictest14000-21sh10:05:313
2110799230,2cyclictest313-21systemd-journal07:15:013
2110799230,23cyclictest0-21swapper/312:23:043
2110799230,23cyclictest0-21swapper/311:23:333
2110799230,23cyclictest0-21swapper/310:45:583
2110799230,22cyclictest8160-21munin-run10:30:003
2110799230,22cyclictest7953-21sh12:26:133
2110799230,22cyclictest6588-21diskmemload11:55:533
2110799230,22cyclictest16462-21ssh11:35:353
2110799230,22cyclictest0-21swapper/309:10:373
2110799230,1cyclictest0-21swapper/310:32:203
2110799230,0cyclictest15266-21diskmemload11:08:013
2110799230,0cyclictest0-21swapper/310:55:513
21106992323,0cyclictest0-21swapper/211:01:202
21106992323,0cyclictest0-21swapper/209:30:172
21106992320,3cyclictest0-21swapper/211:36:222
21106992320,3cyclictest0-21swapper/211:05:252
21106992320,2cyclictest15266-21diskmemload10:25:302
21106992320,2cyclictest0-21swapper/211:10:062
2110699230,23cyclictest0-21swapper/209:17:152
2110699230,22cyclictest28634-21perf07:25:002
2110699230,22cyclictest26446-21sh11:15:062
2110699230,22cyclictest11590-21mailstats12:00:022
2110699230,22cyclictest0-21swapper/209:24:272
2110699230,0cyclictest0-21swapper/211:55:582
2110699230,0cyclictest0-21swapper/210:36:232
2110699230,0cyclictest0-21swapper/209:40:192
21105992323,0cyclictest0-21swapper/112:12:101
21105992323,0cyclictest0-21swapper/111:42:171
21105992323,0cyclictest0-21swapper/110:22:201
21105992322,1cyclictest22849-21grep08:20:001
21105992322,1cyclictest0-21swapper/109:43:041
21105992321,1cyclictest20208-21sh12:38:051
21105992321,1cyclictest15366-21ssh12:34:001
21105992321,1cyclictest11630-21sensors_fan12:00:021
21105992320,2cyclictest23438-21sh09:17:311
21105992320,2cyclictest21083-21sensors_fan11:40:011
2110599231,1cyclictest23550-21kworker/u8:112:18:021
2110599230,2cyclictest28955-21ssh11:47:291
2110599230,23cyclictest0-21swapper/111:53:181
2110599230,23cyclictest0-21swapper/110:03:051
2110599230,23cyclictest0-21swapper/109:20:471
2110599230,22cyclictest9249-21sensors_temp11:00:011
2110599230,22cyclictest20601-21ssh10:12:161
2110599230,22cyclictest20501-21apt08:15:001
2110599230,22cyclictest15266-21diskmemload09:27:581
2110599230,1cyclictest0-21swapper/112:28:021
2110599230,0cyclictest15266-21diskmemload11:33:241
2110599230,0cyclictest0-21swapper/111:11:431
2110599230,0cyclictest0-21swapper/109:58:311
21104992323,0cyclictest15266-21diskmemload11:20:230
21104992321,2cyclictest0-21swapper/010:25:220
21104992321,1cyclictest62550irq/127-eno111:38:430
21104992321,1cyclictest16755-21ssh11:07:080
21104992320,2cyclictest25265-21latency_hist08:25:000
21104992320,1cyclictest313-21systemd-journal08:20:000
2110499231,21cyclictest62550irq/127-eno110:45:250
2110499230,23cyclictest15266-21diskmemload09:36:130
2110499230,23cyclictest0-21swapper/012:26:100
2110499230,23cyclictest0-21swapper/011:56:480
2110499230,23cyclictest0-21swapper/010:19:210
2110499230,22cyclictest4694-21rm12:24:280
2110499230,22cyclictest28935-21sh11:47:270
2110499230,22cyclictest23452-21ssh12:10:500
2110499230,22cyclictest15266-21diskmemload09:25:130
2110499230,22cyclictest0-21swapper/012:31:420
2110499230,0cyclictest8049-21ssh11:29:180
2110499230,0cyclictest0-21swapper/011:52:120
2110499230,0cyclictest0-21swapper/011:41:160
21107992222,0cyclictest0-21swapper/310:00:403
21107992222,0cyclictest0-21swapper/309:29:363
21107992221,1cyclictest0-21swapper/310:10:043
21107992220,1cyclictest23282-21rm09:17:193
2110799220,21cyclictest9897-21ssh11:00:083
2110799220,21cyclictest26607-21apt-get08:29:533
2110799220,21cyclictest19358-21ssh09:42:153
2110799220,21cyclictest11380-21dump-pmu-power07:55:013
2110799220,21cyclictest10662-21apt-get12:00:023
2110799220,21cyclictest0-21swapper/312:15:473
2110799220,1cyclictest0-21swapper/312:06:103
2110799220,1cyclictest0-21swapper/310:35:433
2110799220,0cyclictest0-21swapper/309:30:063
21106992220,2cyclictest0-21swapper/209:35:212
21106992220,1cyclictest5154-21cron08:50:012
21106992220,1cyclictest0-21swapper/210:11:092
2110699220,22cyclictest15266-21diskmemload10:46:332
2110699220,21cyclictest15266-21diskmemload11:50:102
2110699220,21cyclictest1394-21apt-get08:44:532
2110699220,21cyclictest0-21swapper/209:09:522
2110699220,21cyclictest0-21swapper/208:54:532
2110699220,21cyclictest0-21swapper/208:29:522
2110699220,1cyclictest0-21swapper/211:42:242
21105992222,0cyclictest0-21swapper/112:09:181
21105992222,0cyclictest0-21swapper/111:05:241
21105992221,1cyclictest0-21swapper/110:06:121
21105992221,1cyclictest0-21swapper/109:50:351
21105992220,1cyclictest3960-21cron07:40:001
21105992220,1cyclictest0-21swapper/110:30:471
2110599220,22cyclictest15266-21diskmemload11:16:251
2110599220,22cyclictest0-21swapper/111:01:381
2110599220,21cyclictest24882-21sh09:47:051
2110599220,21cyclictest22390-21apt-get07:14:521
2110599220,21cyclictest0-21swapper/111:55:381
2110599220,21cyclictest0-21swapper/111:26:541
2110599220,21cyclictest0-21swapper/111:20:111
2110599220,1cyclictest7696-21ssh09:31:221
21104992222,0cyclictest15266-21diskmemload09:30:420
21104992222,0cyclictest0-21swapper/009:17:440
21104992221,0cyclictest0-21swapper/008:34:530
21104992220,2cyclictest0-21swapper/010:00:210
21104992220,1cyclictest27502-21find09:20:020
21104992220,1cyclictest2103-21apt-get09:55:020
21104992219,2cyclictest7650-21tr08:55:000
2110499220,22cyclictest6214-21ssh10:57:420
2110499220,21cyclictest18314-21ssh12:35:200
2110499220,21cyclictest15266-21diskmemload09:50:120
2110499220,21cyclictest0-21swapper/010:40:020
2110499220,21cyclictest0-21swapper/007:29:540
2110499220,1cyclictest0-21swapper/007:19:530
21107992120,1cyclictest12134-21apt-get07:59:533
21107992120,1cyclictest0-21swapper/311:50:083
21107992118,2cyclictest26253-21sensors_fan07:20:013
2110799210,1cyclictest6196-21apt-get08:54:533
2110799210,1cyclictest25244-21cron08:25:003
2110699210,21cyclictest0-21swapper/207:50:012
2110699210,21cyclictest0-21swapper/207:50:012
21105992119,1cyclictest0-21swapper/108:55:011
2110599210,1cyclictest18407-21perf08:10:001
2110599210,0cyclictest0-21swapper/110:35:191
21104992119,1cyclictest0-21swapper/008:50:010
2110499210,21cyclictest26400-21ssh11:15:020
21107992018,1cyclictest16096-21munin-run08:05:013
21106992020,0cyclictest32442-21apt-get07:34:522
21106992019,1cyclictest0-21swapper/207:44:512
21106992018,1cyclictest21746-21apt-get08:19:542
21106992018,1cyclictest10245-21cron09:00:002
2110699200,0cyclictest24841-21apt-get07:19:532
21105992019,1cyclictest9739-21apt-get07:54:521
21105992019,1cyclictest0-21swapper/107:19:531
21104992020,0cyclictest0-21swapper/008:55:020
21104992020,0cyclictest0-21swapper/008:09:520
21104992020,0cyclictest0-21swapper/007:39:520
2110499200,0cyclictest0-21swapper/008:29:520
2110499200,0cyclictest0-21swapper/007:54:520
21107991919,0cyclictest0-21swapper/308:14:533
21106991919,0cyclictest0-21swapper/207:39:522
21105991919,0cyclictest0-21swapper/108:44:531
21105991919,0cyclictest0-21swapper/107:44:511
21107991817,1cyclictest34-21ksoftirqd/309:10:003
2110799180,0cyclictest0-21swapper/307:29:543
21106991818,0cyclictest0-21swapper/208:24:552
21106991816,1cyclictest31181-21turbostat.cron07:30:002
21106991815,3cyclictest0-21swapper/208:09:522
2110699180,17cyclictest14550-21apt-get08:04:522
21105991818,0cyclictest0-21swapper/108:24:551
21105991817,0cyclictest0-21swapper/107:29:541
21105991816,1cyclictest0-21swapper/109:05:001
21104991816,1cyclictest20523-21munin-plugin-st08:15:000
21104991816,1cyclictest1449-21munin-run07:35:000
21107991717,0cyclictest0-21swapper/309:04:533
21107991717,0cyclictest0-21swapper/307:44:513
21107991717,0cyclictest0-21swapper/307:34:523
21107991714,2cyclictest414-21idleruntime-cro08:40:013
21106991715,1cyclictest19341-21apt-get08:14:532
21105991717,0cyclictest0-21swapper/108:29:521
21105991716,0cyclictest0-21swapper/108:39:521
21105991715,1cyclictest0-21swapper/108:34:531
21104991717,0cyclictest1394-21apt-get08:44:530
21104991716,0cyclictest0-21swapper/007:14:520
21107991616,0cyclictest0-21swapper/308:09:523
21107991615,1cyclictest0-21swapper/307:50:013
21107991615,1cyclictest0-21swapper/307:50:013
2110699160,14cyclictest0-21swapper/209:00:282
21105991616,0cyclictest0-21swapper/108:49:531
2110599160,15cyclictest6596-21cstates08:54:541
21104991615,1cyclictest31399-21apt-get08:39:520
21104991614,1cyclictest17047-21kworker/0:107:44:520
21104991614,1cyclictest15298-21munin-run09:10:000
21107991515,0cyclictest0-21swapper/308:19:543
2110599150,1cyclictest27232-21basename07:24:521
21104991515,0cyclictest0-21swapper/007:59:530
21104991513,1cyclictest0-21swapper/009:05:000
21104991513,1cyclictest0-21swapper/008:05:010
2110799140,14cyclictest0-21swapper/307:20:163
21106991414,0cyclictest0-21swapper/207:50:092
21106991414,0cyclictest0-21swapper/207:10:282
2110699140,14cyclictest0-21swapper/207:56:272
2110699140,0cyclictest0-21swapper/208:35:282
21105991414,0cyclictest0-21swapper/107:45:311
21105991414,0cyclictest0-21swapper/107:45:311
21105991414,0cyclictest0-21swapper/107:30:121
2110599140,14cyclictest0-21swapper/107:55:251
2110499140,0cyclictest0-21swapper/007:49:360
2110499140,0cyclictest0-21swapper/007:49:360
2110499140,0cyclictest0-21swapper/007:21:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional