You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-17 - 18:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Apr 17, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19907992623,2cyclictest24023-21/usr/sbin/munin09:20:013
19907992523,1cyclictest8209-21apt-get07:54:503
1990799250,24cyclictest13635-21diskmemload12:36:413
1990799250,24cyclictest13635-21diskmemload09:10:453
1990799250,24cyclictest0-21swapper/312:26:233
1990799250,24cyclictest0-21swapper/311:40:443
19903992524,0cyclictest0-21swapper/210:59:502
19903992523,1cyclictest10984-21apt-get11:49:502
1990399250,24cyclictest0-21swapper/211:52:432
19893992524,1cyclictest62550irq/127-eno111:21:420
19893992523,1cyclictest26526-21sed10:59:540
1989399250,24cyclictest313-21systemd-journal12:35:010
1989399250,1cyclictest0-21swapper/009:34:500
19907992424,0cyclictest0-21swapper/309:53:063
1990799240,24cyclictest0-21swapper/309:56:373
1990799240,23cyclictest13635-21diskmemload12:18:593
1990799240,23cyclictest13635-21diskmemload09:33:373
1990799240,23cyclictest0-21swapper/311:04:423
1990799240,23cyclictest0-21swapper/311:04:423
19903992423,1cyclictest28-21ksoftirqd/212:09:542
19903992421,2cyclictest30568-21ssh10:30:452
1990399240,23cyclictest0-21swapper/209:35:412
1990399240,23cyclictest0-21swapper/209:29:502
19901992424,0cyclictest0-21swapper/110:50:461
1990199240,24cyclictest0-21swapper/110:20:411
1990199240,24cyclictest0-21swapper/109:53:141
19893992424,0cyclictest13635-21diskmemload10:21:380
19893992423,1cyclictest0-21swapper/009:56:010
19893992421,2cyclictest19740-21ssh09:15:490
19893992421,2cyclictest1-21systemd11:05:010
19893992421,2cyclictest1-21systemd11:05:010
1989399241,1cyclictest30286-21rm12:08:080
1989399240,24cyclictest0-21swapper/010:11:150
1989399240,24cyclictest0-21swapper/010:11:150
1989399240,24cyclictest0-21swapper/009:51:420
1989399240,24cyclictest0-21swapper/009:36:280
1989399240,23cyclictest13635-21diskmemload10:17:050
1989399240,1cyclictest16587-21ssh09:14:380
1989399240,0cyclictest62550irq/127-eno110:46:270
1989399240,0cyclictest0-21swapper/009:23:280
19907992323,0cyclictest0-21swapper/312:31:583
19907992323,0cyclictest0-21swapper/312:05:043
19907992323,0cyclictest0-21swapper/311:53:143
19907992323,0cyclictest0-21swapper/309:46:453
19907992323,0cyclictest0-21swapper/309:23:353
19907992321,1cyclictest0-21swapper/309:44:133
19907992320,2cyclictest22336-21ssh10:23:393
1990799230,23cyclictest0-21swapper/312:11:013
1990799230,23cyclictest0-21swapper/311:13:513
1990799230,23cyclictest0-21swapper/310:04:463
1990799230,22cyclictest30104-21ssh09:25:473
1990799230,22cyclictest13635-21diskmemload10:55:563
1990799230,22cyclictest13635-21diskmemload10:42:483
1990799230,22cyclictest11830-21ssh11:17:053
1990799230,22cyclictest0-21swapper/312:00:203
1990799230,22cyclictest0-21swapper/311:20:423
1990799230,0cyclictest0-21swapper/310:05:383
19903992323,0cyclictest15412-21apt-get08:09:502
19903992323,0cyclictest0-21swapper/212:38:132
19903992323,0cyclictest0-21swapper/212:04:052
19903992323,0cyclictest0-21swapper/211:40:222
19903992323,0cyclictest0-21swapper/210:47:352
19903992320,3cyclictest6716-21ssh11:11:442
19903992320,0cyclictest0-21swapper/211:27:392
1990399230,2cyclictest16728-21ssh10:17:402
1990399230,23cyclictest0-21swapper/212:15:432
1990399230,22cyclictest5133-21sh10:39:052
1990399230,22cyclictest31952-21idleruntime-cro10:00:002
1990399230,22cyclictest31595-21perf08:40:012
1990399230,22cyclictest30156-21ssh11:04:112
1990399230,22cyclictest30156-21ssh11:04:112
1990399230,22cyclictest13020-21apt-get08:04:512
1990399230,22cyclictest0-21swapper/210:50:462
1990399230,0cyclictest17896-21ssh12:28:072
1990399230,0cyclictest13635-21diskmemload11:36:032
1990399230,0cyclictest13635-21diskmemload10:03:012
1990399230,0cyclictest0-21swapper/212:13:002
1990399230,0cyclictest0-21swapper/211:20:212
1990399230,0cyclictest0-21swapper/210:25:532
1990399230,0cyclictest0-21swapper/210:05:482
19901992323,0cyclictest13635-21diskmemload12:35:141
19901992323,0cyclictest13635-21diskmemload10:15:141
19901992323,0cyclictest0-21swapper/112:33:421
19901992323,0cyclictest0-21swapper/112:10:231
19901992323,0cyclictest0-21swapper/111:54:001
19901992323,0cyclictest0-21swapper/111:31:491
19901992323,0cyclictest0-21swapper/110:55:161
19901992323,0cyclictest0-21swapper/110:47:311
19901992323,0cyclictest0-21swapper/110:41:411
19901992323,0cyclictest0-21swapper/109:39:571
19901992322,1cyclictest28010-21ssh11:00:351
19901992322,1cyclictest28010-21ssh11:00:351
19901992321,1cyclictest9957-21sh07:55:011
19901992321,1cyclictest20210-21apt08:19:501
19901992321,1cyclictest0-21swapper/111:20:011
1990199231,1cyclictest4127-21ssh09:33:151
1990199231,1cyclictest27822-21ls07:25:001
1990199230,2cyclictest20640-21ssh09:17:201
1990199230,2cyclictest14810-21rm09:11:361
1990199230,23cyclictest0-21swapper/110:34:331
1990199230,23cyclictest0-21swapper/109:47:301
1990199230,22cyclictest583-21ssh10:00:421
1990199230,22cyclictest481-21ssh11:39:091
1990199230,22cyclictest29962-21sleep10:30:011
1990199230,1cyclictest0-21swapper/109:25:021
1990199230,0cyclictest0-21swapper/112:05:091
1990199230,0cyclictest0-21swapper/111:11:371
19893992323,0cyclictest13635-21diskmemload09:46:490
19893992323,0cyclictest0-21swapper/011:05:140
19893992321,1cyclictest12682-21ssh11:18:250
19893992321,1cyclictest0-21swapper/010:35:560
19893992321,1cyclictest0-21swapper/009:42:120
1989399230,2cyclictest3178-21ssh11:40:090
1989399230,2cyclictest27665-21ssh12:37:510
1989399230,2cyclictest19599-21sh11:57:360
1989399230,2cyclictest11243-21idleruntime-cro09:05:000
1989399230,23cyclictest0-21swapper/010:52:460
1989399230,22cyclictest30009-21ssh09:25:390
1989399230,22cyclictest23420-21rm12:00:410
1989399230,22cyclictest16584-21ssh12:25:550
1989399230,22cyclictest13635-21diskmemload12:15:470
1989399230,22cyclictest11091-21sh12:20:030
1989399230,21cyclictest0-21swapper/011:51:360
1989399230,0cyclictest13635-21diskmemload12:10:350
1989399230,0cyclictest13635-21diskmemload10:06:500
1989399230,0cyclictest0-21swapper/011:37:280
1989399230,0cyclictest0-21swapper/011:26:200
19907992222,0cyclictest13635-21diskmemload11:45:093
19907992222,0cyclictest0-21swapper/309:36:473
19907992221,1cyclictest0-21swapper/310:25:283
19907992221,0cyclictest13635-21diskmemload10:46:203
19907992220,1cyclictest13651-21munin-run09:10:003
1990799220,21cyclictest21987-21perf08:20:003
1990799220,21cyclictest15342-21diskmemload10:15:223
1990799220,21cyclictest13635-21diskmemload11:30:303
1990799220,21cyclictest0-21swapper/312:20:023
1990799220,21cyclictest0-21swapper/311:55:013
1990799220,21cyclictest0-21swapper/311:05:293
1990799220,21cyclictest0-21swapper/310:35:353
1990799220,21cyclictest0-21swapper/308:54:503
1990799220,21cyclictest0-21swapper/308:39:503
1990799220,21cyclictest0-21swapper/308:09:503
1990799220,1cyclictest2718-21perf07:40:013
1990799220,0cyclictest0-21swapper/311:39:393
1990799220,0cyclictest0-21swapper/307:24:493
19903992222,0cyclictest0-21swapper/209:17:342
19903992217,2cyclictest0-21swapper/209:21:062
1990399220,2cyclictest21789-21ssh12:31:212
1990399220,22cyclictest0-21swapper/209:41:272
1990399220,22cyclictest0-21swapper/209:11:402
1990399220,21cyclictest7904-21ssh10:40:172
1990399220,21cyclictest2737-21munin-plugin-st07:40:012
1990399220,21cyclictest0-21swapper/211:34:582
1990399220,21cyclictest0-21swapper/211:19:132
1990399220,21cyclictest0-21swapper/209:47:112
1990399220,21cyclictest0-21swapper/209:30:322
1990399220,1cyclictest24407-21munin-run08:25:012
1990399220,1cyclictest13635-21diskmemload10:10:272
1990399220,1cyclictest13635-21diskmemload10:10:272
1990399220,1cyclictest0-21swapper/212:23:512
1990399220,1cyclictest0-21swapper/211:56:422
1990399220,1cyclictest0-21swapper/211:08:252
1990399220,1cyclictest0-21swapper/210:21:272
19901992222,0cyclictest13635-21diskmemload11:40:431
19901992222,0cyclictest0-21swapper/111:46:341
19901992222,0cyclictest0-21swapper/109:44:061
19901992222,0cyclictest0-21swapper/109:21:511
19901992221,1cyclictest6737-21ssh12:16:081
19901992220,1cyclictest0-21swapper/112:01:241
1990199220,22cyclictest13635-21diskmemload10:05:191
1990199220,22cyclictest0-21swapper/111:58:181
1990199220,21cyclictest21251-21apt-get07:14:501
1990199220,21cyclictest16397-21ssh11:21:221
1990199220,21cyclictest13635-21diskmemload11:05:561
1990199220,1cyclictest20052-21ssh12:29:571
1990199220,0cyclictest0-21swapper/111:27:031
19893992221,1cyclictest0-21swapper/010:26:070
1989399220,21cyclictest10601-21apt-get07:59:490
1989399220,21cyclictest0-21swapper/011:10:220
1989399220,21cyclictest0-21swapper/008:44:470
1989399220,21cyclictest0-21swapper/007:44:500
1989399220,21cyclictest0-21swapper/007:40:010
1989399220,1cyclictest10663-21apt-get10:44:510
1989399220,1cyclictest0-21swapper/010:30:070
1989399220,1cyclictest0-21swapper/010:00:580
19907992121,0cyclictest0-21swapper/310:31:103
19907992120,1cyclictest0-21swapper/307:29:493
19907992119,1cyclictest26747-21cron08:30:013
1990799210,21cyclictest0-21swapper/310:10:073
1990799210,21cyclictest0-21swapper/310:10:073
1990799210,20cyclictest0-21swapper/310:50:053
1990799210,1cyclictest32615-21awk07:35:013
1990799210,0cyclictest0-21swapper/311:26:203
19903992121,0cyclictest0-21swapper/208:29:512
19903992121,0cyclictest0-21swapper/207:54:502
19903992120,1cyclictest19797-21apt-get07:10:012
1990399210,20cyclictest3363-21apt-get07:44:502
1990399210,0cyclictest0-21swapper/208:14:502
19901992121,0cyclictest0-21swapper/110:35:361
19901992121,0cyclictest0-21swapper/110:10:261
19901992121,0cyclictest0-21swapper/110:10:261
19901992119,1cyclictest11238-21perf09:05:001
19901992118,2cyclictest2723-21latency_hist07:40:011
1990199210,21cyclictest0-21swapper/112:22:071
1990199210,21cyclictest0-21swapper/108:54:501
1990199210,21cyclictest0-21swapper/107:59:491
1990199210,20cyclictest0-21swapper/108:29:511
1990199210,0cyclictest0-21swapper/109:55:051
1989399210,21cyclictest0-21swapper/011:31:270
1989399210,0cyclictest0-21swapper/008:24:510
19907992020,0cyclictest0-21swapper/308:44:483
19907992018,1cyclictest0-21swapper/308:15:003
1990799200,0cyclictest23650-21apt-get07:19:513
1990799200,0cyclictest0-21swapper/308:49:523
19903992020,0cyclictest30859-21apt-get07:34:502
19903992020,0cyclictest0-21swapper/207:29:492
19903992018,1cyclictest32228-21apt-get08:44:482
1990399200,0cyclictest0-21swapper/208:49:522
19901992020,0cyclictest0-21swapper/108:44:481
19901992020,0cyclictest0-21swapper/108:39:501
19901992020,0cyclictest0-21swapper/107:34:501
1990199200,20cyclictest0-21swapper/107:49:511
1990199200,0cyclictest28460-21apt-get07:29:491
19893992020,0cyclictest20211-21apt-get08:19:500
19893992020,0cyclictest0-21swapper/007:34:510
19893992020,0cyclictest0-21swapper/007:14:490
19893992019,1cyclictest4613-21apt-get08:54:500
19907991919,0cyclictest0-21swapper/308:05:003
19907991918,0cyclictest0-21swapper/308:24:513
19903991919,0cyclictest0-21swapper/208:59:502
19903991919,0cyclictest0-21swapper/208:34:502
19901991918,1cyclictest8818-21awk09:00:001
1990199190,0cyclictest0-21swapper/108:24:511
19893991919,0cyclictest0-21swapper/008:29:510
19893991919,0cyclictest0-21swapper/007:49:510
19893991919,0cyclictest0-21swapper/007:29:490
19893991918,1cyclictest9970-21turbostat07:55:010
19893991918,1cyclictest29814-21apt-get08:39:500
19907991818,0cyclictest0-21swapper/308:59:503
19907991817,1cyclictest12350-21cron08:00:013
19907991817,0cyclictest0-21swapper/307:44:503
19907991816,1cyclictest29182-21latency_hist08:35:013
19903991817,1cyclictest0-21swapper/209:09:512
1990399180,17cyclictest11218-21idleruntime-cro09:05:002
19893991818,0cyclictest0-21swapper/007:24:490
19901991717,0cyclictest23650-21apt-get07:19:511
19893991715,1cyclictest8816-21dump-pmu-power09:00:000
19907991615,1cyclictest0-21swapper/307:49:513
19903991616,0cyclictest0-21swapper/207:19:512
19901991616,0cyclictest27419-21apt-get08:34:501
19901991615,1cyclictest0-21swapper/108:49:521
19901991614,1cyclictest13643-21perf09:10:001
19893991614,1cyclictest3560-21mailstats08:49:590
1989399160,15cyclictest15835-21diskstats08:09:520
19903991515,0cyclictest0-21swapper/208:19:502
19903991514,1cyclictest0-21swapper/207:59:492
19903991514,1cyclictest0-21swapper/207:24:502
19901991515,0cyclictest0-21swapper/108:14:501
1989399150,15cyclictest0-21swapper/009:10:000
19907991414,0cyclictest0-21swapper/309:00:423
1990399140,0cyclictest0-21swapper/208:50:122
19901991414,0cyclictest0-21swapper/107:40:561
1990199140,14cyclictest0-21swapper/108:06:381
1990199140,0cyclictest0-21swapper/108:00:411
1989399140,14cyclictest0-21swapper/008:30:390
1989399140,14cyclictest0-21swapper/008:00:010
1989399140,14cyclictest0-21swapper/007:15:050
1989399140,0cyclictest0-21swapper/008:11:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional