You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 10:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Mar 28, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2997899260,25cyclictest11707-21ssh22:02:253
2997899250,24cyclictest0-21swapper/321:17:053
29974992523,1cyclictest30725-21taskset23:23:542
29974992520,4cyclictest21493-21ntp_states22:43:142
29970992522,2cyclictest15546-21rm23:41:091
29968992523,2cyclictest13-21ksoftirqd/020:30:000
2996899251,0cyclictest0-21swapper/023:18:060
2996899250,24cyclictest23675-21diskmemload23:00:430
2996899250,24cyclictest10092-21apt-get19:38:060
29978992423,1cyclictest23675-21diskmemload23:33:183
29978992422,1cyclictest0-21swapper/322:24:263
2997899241,22cyclictest24821-21sh00:20:393
2997899240,24cyclictest0-21swapper/323:18:373
2997899240,0cyclictest0-21swapper/323:47:093
29974992422,1cyclictest31169-21ssh00:27:472
29974992420,4cyclictest0-21swapper/221:52:132
2997499240,23cyclictest23675-21diskmemload22:54:082
2997499240,23cyclictest0-21swapper/223:34:482
2997499240,0cyclictest23675-21diskmemload22:03:452
29970992421,2cyclictest17653-21ssh23:11:551
2997099240,24cyclictest0-21swapper/121:55:531
2997099240,23cyclictest9586-21cron19:35:001
2997099240,23cyclictest29585-21sh22:18:491
2997099240,23cyclictest28722-21wc21:15:001
2997099240,23cyclictest0-21swapper/122:21:301
2997099240,0cyclictest0-21swapper/122:53:391
29968992422,2cyclictest0-21swapper/023:32:110
29968992421,2cyclictest0-21swapper/022:36:110
2996899240,24cyclictest0-21swapper/022:51:150
2996899240,24cyclictest0-21swapper/021:50:380
2996899240,23cyclictest31189-21sh22:21:040
2996899240,1cyclictest0-21swapper/023:35:540
2996899240,0cyclictest23675-21diskmemload00:38:080
2996899240,0cyclictest0-21swapper/021:46:510
29978992323,0cyclictest23675-21diskmemload21:23:243
29978992323,0cyclictest0-21swapper/323:10:113
29978992323,0cyclictest0-21swapper/322:50:273
29978992323,0cyclictest0-21swapper/322:34:303
29978992323,0cyclictest0-21swapper/322:10:563
29978992323,0cyclictest0-21swapper/300:25:233
29978992322,1cyclictest0-21swapper/322:41:393
29978992321,1cyclictest0-21swapper/300:31:433
2997899230,2cyclictest23675-21diskmemload23:57:063
2997899230,23cyclictest0-21swapper/322:36:093
2997899230,22cyclictest2880-21rm22:57:293
2997899230,22cyclictest23675-21diskmemload22:46:503
2997899230,22cyclictest0-21swapper/321:27:533
2997899230,22cyclictest0-21swapper/300:16:143
2997899230,1cyclictest23675-21diskmemload23:25:233
2997899230,1cyclictest0-21swapper/323:43:413
2997899230,0cyclictest23675-21diskmemload21:13:013
2997899230,0cyclictest10488-21ssh00:07:463
2997899230,0cyclictest0-21swapper/319:58:073
29974992323,0cyclictest23675-21diskmemload22:38:532
29974992323,0cyclictest23675-21diskmemload22:28:412
29974992323,0cyclictest0-21swapper/223:46:282
29974992323,0cyclictest0-21swapper/223:07:202
29974992323,0cyclictest0-21swapper/222:18:132
29974992321,1cyclictest24773-21ssh22:14:152
2997499230,23cyclictest0-21swapper/223:16:052
2997499230,23cyclictest0-21swapper/222:46:062
2997499230,23cyclictest0-21swapper/200:05:442
2997499230,22cyclictest7496-21ssh00:03:562
2997499230,22cyclictest23451-21sh00:19:282
2997499230,22cyclictest17364-21rm21:35:112
2997499230,0cyclictest23675-21diskmemload23:10:442
2997499230,0cyclictest0-21swapper/223:52:282
2997499230,0cyclictest0-21swapper/221:23:092
2997499230,0cyclictest0-21swapper/200:22:422
29970992323,0cyclictest0-21swapper/123:49:061
29970992323,0cyclictest0-21swapper/122:36:171
29970992323,0cyclictest0-21swapper/100:20:061
29970992322,1cyclictest32658-21ssh23:26:381
29970992321,1cyclictest0-21swapper/123:18:081
29970992321,1cyclictest0-21swapper/122:13:081
2997099230,2cyclictest22620-21rm21:40:311
2997099230,23cyclictest0-21swapper/123:37:201
2997099230,23cyclictest0-21swapper/121:25:401
2997099230,23cyclictest0-21swapper/121:17:161
2997099230,22cyclictest4800-21ls19:25:001
2997099230,22cyclictest31847-21rm23:57:061
2997099230,22cyclictest27697-21ssh23:21:481
2997099230,22cyclictest25231-21ssh23:50:231
2997099230,22cyclictest1959-21sh22:56:061
2997099230,22cyclictest15854-21sh22:05:551
2997099230,22cyclictest12481-21cat22:03:091
2997099230,22cyclictest11272-21perf23:05:011
2997099230,22cyclictest0-21swapper/122:46:521
2997099230,22cyclictest0-21swapper/122:41:551
2997099230,22cyclictest0-21swapper/121:50:161
2997099230,0cyclictest23675-21diskmemload00:16:251
2997099230,0cyclictest0-21swapper/123:08:071
2997099230,0cyclictest0-21swapper/122:30:301
2997099230,0cyclictest0-21swapper/121:35:001
2997099230,0cyclictest0-21swapper/121:23:561
29968992323,0cyclictest0-21swapper/000:34:030
29968992323,0cyclictest0-21swapper/000:28:000
29968992322,1cyclictest5882-21kworker/0:019:28:070
29968992322,1cyclictest0-21swapper/023:22:080
29968992321,1cyclictest0-21swapper/021:41:010
29968992320,2cyclictest17104-21sh23:11:050
29968992320,2cyclictest16627-21apt-get21:35:020
2996899231,1cyclictest62550irq/127-eno121:26:310
2996899230,2cyclictest22624-21ssh22:43:550
2996899230,23cyclictest23675-21diskmemload21:10:140
2996899230,23cyclictest0-21swapper/023:56:480
2996899230,23cyclictest0-21swapper/023:53:590
2996899230,23cyclictest0-21swapper/022:07:510
2996899230,23cyclictest0-21swapper/000:19:340
2996899230,22cyclictest8741-21ssh22:30:440
2996899230,22cyclictest397-21ssh23:26:560
2996899230,22cyclictest29519-21ssh21:16:020
2996899230,22cyclictest27233-21sh22:48:180
2996899230,22cyclictest2015-21ssh22:56:110
2996899230,22cyclictest15238-21sh23:40:320
2996899230,22cyclictest13303-21ssh00:09:320
2996899230,22cyclictest0-21swapper/020:43:070
2996899230,1cyclictest14754-21gzip23:08:160
2996899230,0cyclictest23675-21diskmemload23:46:030
2996899230,0cyclictest0-21swapper/022:10:290
2996899230,0cyclictest0-21swapper/021:31:060
2996899230,0cyclictest0-21swapper/000:10:480
29978992222,0cyclictest0-21swapper/323:21:263
29978992222,0cyclictest0-21swapper/322:07:073
29978992220,1cyclictest8522-21perf20:40:013
29978992220,1cyclictest21298-21basename21:05:003
29978992220,1cyclictest0-21swapper/321:50:063
2997899221,0cyclictest0-21swapper/323:02:173
2997899220,22cyclictest9216-21apt-get00:38:083
2997899220,21cyclictest23675-21diskmemload21:35:283
2997899220,21cyclictest22109-21apt-get20:03:063
2997899220,21cyclictest1803-21apt-get20:28:073
2997899220,21cyclictest12675-21tail23:38:153
2997899220,21cyclictest0-21swapper/323:51:303
2997899220,21cyclictest0-21swapper/322:15:283
2997899220,21cyclictest0-21swapper/300:10:513
2997899220,21cyclictest0-21swapper/300:00:373
2997899220,1cyclictest0-21swapper/321:40:263
2997899220,0cyclictest23675-21diskmemload21:55:273
2997899220,0cyclictest0-21swapper/321:46:323
29974992222,0cyclictest23675-21diskmemload22:55:332
29974992222,0cyclictest0-21swapper/223:57:362
29974992222,0cyclictest0-21swapper/223:25:172
29974992222,0cyclictest0-21swapper/221:15:052
29974992221,1cyclictest6516-21ssh23:00:162
29974992220,2cyclictest8727-21sh00:37:242
29974992220,1cyclictest16717-21apt-get20:55:022
2997499220,2cyclictest28720-21perf21:15:002
2997499220,22cyclictest18531-21rm00:14:482
2997499220,21cyclictest23675-21diskmemload21:45:272
2997499220,21cyclictest22358-21ssh21:40:082
2997499220,21cyclictest14644-21memory21:33:102
2997499220,21cyclictest11409-21apt-get20:48:072
2997499220,21cyclictest0-21swapper/223:40:022
2997499220,21cyclictest0-21swapper/222:06:012
2997499220,21cyclictest0-21swapper/221:55:032
2997499220,0cyclictest0-21swapper/222:31:202
29970992222,0cyclictest0-21swapper/100:30:121
29970992221,1cyclictest0-21swapper/100:05:021
29970992221,0cyclictest0-21swapper/121:45:271
29970992220,1cyclictest0-21swapper/100:25:091
2997099220,21cyclictest3729-21rm00:00:371
2997099220,21cyclictest18162-21ssh21:36:331
2997099220,21cyclictest13316-21turbostat20:50:011
2997099220,21cyclictest0-21swapper/123:30:041
2997099220,21cyclictest0-21swapper/120:08:061
2997099220,1cyclictest6273-21open_inodes22:28:121
2997099220,1cyclictest19693-21apt-get19:58:071
2997099220,1cyclictest0-21swapper/100:14:181
29968992222,0cyclictest0-21swapper/000:03:040
29968992221,1cyclictest23675-21diskmemload22:04:110
29968992221,1cyclictest0-21swapper/020:53:070
29968992220,1cyclictest1885-21ssh21:20:200
2996899220,21cyclictest23675-21diskmemload22:15:490
2996899220,21cyclictest0-21swapper/021:55:220
2996899220,1cyclictest0-21swapper/022:28:170
29978992120,0cyclictest0-21swapper/320:58:063
29978992119,1cyclictest31273-21perf20:20:003
29978992119,1cyclictest14418-21latency_hist19:45:003
2997899210,20cyclictest0-21swapper/320:23:063
2997899210,20cyclictest0-21swapper/320:13:073
29974992120,0cyclictest17300-21apt-get19:53:062
29974992119,1cyclictest2422-21idleruntime-cro19:20:012
2997499210,21cyclictest23675-21diskmemload23:36:092
2997499210,21cyclictest0-21swapper/222:20:012
2997499210,21cyclictest0-21swapper/221:25:342
2997499210,20cyclictest9610-21perf19:35:002
2997499210,20cyclictest0-21swapper/219:38:062
2997099210,21cyclictest0-21swapper/121:03:081
2996899210,21cyclictest0-21swapper/019:33:070
2996899210,0cyclictest0-21swapper/020:13:070
29978992020,0cyclictest0-21swapper/319:48:083
2997899200,0cyclictest0-21swapper/321:08:063
29974992020,0cyclictest0-21swapper/221:08:062
29974992020,0cyclictest0-21swapper/220:50:022
29974992019,0cyclictest31767-21apt-get20:23:072
29974992017,2cyclictest4803-21latency_hist19:25:002
29970992020,0cyclictest0-21swapper/119:18:061
29970992019,1cyclictest29256-21apt-get20:17:491
29968992020,0cyclictest0-21swapper/019:13:070
2996899200,0cyclictest0-21swapper/020:18:090
2996899200,0cyclictest0-21swapper/019:43:070
2996899200,0cyclictest0-21swapper/019:18:060
29978991919,0cyclictest435-21apt-get19:18:063
29978991919,0cyclictest0-21swapper/320:43:063
29978991919,0cyclictest0-21swapper/319:53:063
29978991917,1cyclictest13303-21apt-get20:50:023
29978991917,1cyclictest0-21swapper/320:50:013
29970991919,0cyclictest16984-21apt-get20:58:061
29970991919,0cyclictest0-21swapper/119:43:071
29970991917,1cyclictest1311-21munin-run20:25:001
2997099190,0cyclictest0-21swapper/120:38:081
29968991917,1cyclictest1302-21perf20:25:000
29978991818,0cyclictest0-21swapper/320:08:063
29978991811,6cyclictest0-21swapper/319:13:073
29974991817,0cyclictest6601-21apt-get20:38:092
29970991818,0cyclictest30449-21apt-get19:13:071
29970991818,0cyclictest0-21swapper/121:08:061
29968991818,0cyclictest0-21swapper/019:58:070
29968991816,1cyclictest2905-21apt-get19:23:080
29968991816,1cyclictest18873-21readlink21:00:010
2996899180,0cyclictest0-21swapper/019:48:080
29974991717,0cyclictest0-21swapper/219:58:072
29970991717,0cyclictest0-21swapper/120:53:071
2997099170,2cyclictest11963-21cron19:40:001
29968991716,1cyclictest24502-21apt-get20:08:060
2997899161,15cyclictest605-21avahi-daemon20:32:283
29974991616,0cyclictest0-21swapper/220:08:062
2997499160,15cyclictest0-21swapper/220:45:012
29970991614,1cyclictest0-21swapper/120:28:081
2997099160,13cyclictest1824-21sendmail-mta20:12:151
29968991614,1cyclictest0-21swapper/020:47:150
2996899160,0cyclictest0-21swapper/020:33:050
2997899150,1cyclictest8900-21ps19:33:143
29974991515,0cyclictest0-21swapper/221:03:082
2997499150,14cyclictest0-21swapper/220:02:322
29978991414,0cyclictest0-21swapper/319:35:293
29978991414,0cyclictest0-21swapper/319:20:353
2997899140,0cyclictest0-21swapper/319:25:123
29974991414,0cyclictest0-21swapper/220:25:292
29974991414,0cyclictest0-21swapper/220:10:082
2997499140,14cyclictest0-21swapper/220:30:102
2997499140,14cyclictest0-21swapper/220:15:052
2997499140,14cyclictest0-21swapper/219:41:352
2997499140,14cyclictest0-21swapper/219:26:292
2997499140,14cyclictest0-21swapper/219:11:352
2997499140,0cyclictest0-21swapper/219:45:092
29970991414,0cyclictest0-21swapper/120:30:111
29970991414,0cyclictest0-21swapper/119:53:111
2997099140,14cyclictest0-21swapper/120:00:541
29968991414,0cyclictest0-21swapper/019:50:110
2996899140,14cyclictest0-21swapper/021:05:050
2996899140,14cyclictest0-21swapper/020:36:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional