You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 18:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jun 03, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17988992721,5cyclictest14438-21cpuspeed_turbos09:13:492
1798899270,26cyclictest0-21swapper/209:58:462
17988992622,3cyclictest12980-21ssh09:41:452
17988992619,5cyclictest19503-21rm10:18:202
1798899260,25cyclictest25458-21cat12:23:492
1798899260,25cyclictest0-21swapper/212:29:052
17990992523,1cyclictest0-21swapper/308:30:003
1799099250,24cyclictest5545-21sh09:34:123
1799099250,24cyclictest5545-21sh09:34:123
17988992520,4cyclictest14976-21rm10:13:512
17988992520,4cyclictest10959-21diskmemload09:47:442
17988992510,15cyclictest0-21swapper/209:16:252
1798899250,24cyclictest8610-21ssh11:07:562
1798899250,24cyclictest375-21ssh09:29:292
1798899250,24cyclictest19127-21ssh12:17:482
1798899250,24cyclictest18441-21ssh11:46:202
1798899250,24cyclictest1488-21ssh12:00:352
1798899250,24cyclictest10959-21diskmemload11:33:502
1798899250,24cyclictest10959-21diskmemload11:16:202
1798899250,24cyclictest10959-21diskmemload10:42:572
1798899250,24cyclictest0-21swapper/211:26:072
1798899250,24cyclictest0-21swapper/210:57:332
1798899250,24cyclictest0-21swapper/210:37:482
1798899250,24cyclictest0-21swapper/210:05:002
1798899250,24cyclictest0-21swapper/209:40:012
1798499250,24cyclictest0-21swapper/111:52:201
17979992524,1cyclictest0-21swapper/009:42:520
17990992420,1cyclictest151rcu_preempt12:07:443
1799099241,22cyclictest22748-21cron07:20:013
1799099240,23cyclictest24767-21sh10:23:123
1799099240,23cyclictest10959-21diskmemload11:15:073
1799099240,1cyclictest0-21swapper/311:00:563
17988992419,4cyclictest13391-21ssh11:41:512
1798899240,3cyclictest0-21swapper/212:11:172
1798899240,23cyclictest0-21swapper/212:36:512
1798899240,23cyclictest0-21swapper/212:33:162
1798899240,23cyclictest0-21swapper/212:06:382
1798899240,23cyclictest0-21swapper/211:24:482
1798899240,23cyclictest0-21swapper/211:11:012
1798899240,23cyclictest0-21swapper/210:32:342
1798899240,23cyclictest0-21swapper/209:34:162
1798899240,23cyclictest0-21swapper/209:34:162
1798899240,23cyclictest0-21swapper/209:23:072
17984992421,2cyclictest7035-21sh11:35:191
1798499240,24cyclictest0-21swapper/110:54:241
17979992423,1cyclictest62550irq/127-eno112:25:060
17979992422,1cyclictest0-21swapper/012:23:530
1797999241,21cyclictest0-21swapper/011:37:570
1797999240,24cyclictest0-21swapper/011:40:030
1797999240,23cyclictest9905-21ntp_states10:08:520
1797999240,23cyclictest10959-21diskmemload09:30:580
1797999240,23cyclictest10959-21diskmemload09:30:580
1797999240,23cyclictest0-21swapper/010:54:250
1797999240,22cyclictest10959-21diskmemload10:23:520
1797999240,1cyclictest0-21swapper/011:49:240
1797999240,0cyclictest0-21swapper/010:18:580
17990992323,0cyclictest0-21swapper/312:20:223
17990992323,0cyclictest0-21swapper/312:15:123
17990992323,0cyclictest0-21swapper/312:11:063
17990992323,0cyclictest0-21swapper/310:09:473
17990992322,1cyclictest9139-21apt-get11:08:483
17990992321,1cyclictest7453-21sh10:36:093
17990992320,2cyclictest13604-21ssh10:42:113
1799099230,23cyclictest0-21swapper/309:49:513
1799099230,22cyclictest2755-21sh12:02:253
1799099230,22cyclictest26021-21ntp_states09:23:543
1799099230,1cyclictest1096-21perf11:00:003
1799099230,0cyclictest10959-21diskmemload11:23:503
1799099230,0cyclictest0-21swapper/311:59:373
1799099230,0cyclictest0-21swapper/311:52:573
1799099230,0cyclictest0-21swapper/311:32:443
1799099230,0cyclictest0-21swapper/310:03:443
1799099230,0cyclictest0-21swapper/309:54:193
1799099230,0cyclictest0-21swapper/309:36:543
17988992323,0cyclictest10959-21diskmemload10:51:312
17988992320,2cyclictest8644-21ssh10:08:372
1798899230,23cyclictest0-21swapper/211:55:472
1798899230,23cyclictest0-21swapper/210:21:492
1798899230,22cyclictest32551-21ssh10:29:112
1798899230,22cyclictest19815-21ssh10:48:252
1798899230,22cyclictest0-21swapper/211:38:182
1798899230,0cyclictest0-21swapper/211:50:412
17984992323,0cyclictest3069-21apt-get07:48:471
17984992323,0cyclictest10959-21diskmemload12:05:241
17984992323,0cyclictest10959-21diskmemload10:10:001
17984992323,0cyclictest0-21swapper/111:47:081
17984992323,0cyclictest0-21swapper/111:44:341
17984992323,0cyclictest0-21swapper/109:51:391
17984992321,1cyclictest313-21systemd-journal10:00:001
17984992321,1cyclictest0-21swapper/112:20:071
17984992321,1cyclictest0-21swapper/111:32:071
17984992321,1cyclictest0-21swapper/110:59:461
17984992320,2cyclictest7210-21ssh11:05:521
17984992320,2cyclictest2171-21rm09:31:411
17984992320,2cyclictest2171-21rm09:31:411
1798499230,2cyclictest8852-21ssh09:38:381
1798499230,2cyclictest13081-21ssh09:12:051
1798499230,23cyclictest0-21swapper/111:11:071
1798499230,23cyclictest0-21swapper/109:17:401
1798499230,22cyclictest305-21sh11:59:151
1798499230,22cyclictest1893-21ssh10:30:521
1798499230,22cyclictest10959-21diskmemload12:25:061
1798499230,22cyclictest10959-21diskmemload11:15:391
1798499230,22cyclictest10959-21diskmemload09:21:251
1798499230,22cyclictest0-21swapper/110:23:471
1798499230,22cyclictest0-21swapper/109:46:471
1798499230,0cyclictest0-21swapper/112:04:241
1798499230,0cyclictest0-21swapper/110:10:191
1798499230,0cyclictest0-21swapper/109:42:571
17979992323,0cyclictest10959-21diskmemload11:51:280
17979992323,0cyclictest0-21swapper/012:38:450
17979992323,0cyclictest0-21swapper/011:23:570
17979992323,0cyclictest0-21swapper/009:30:000
17979992322,1cyclictest19042-21ssh11:17:350
17979992322,0cyclictest0-21swapper/012:16:020
17979992321,1cyclictest7075-21rm12:05:550
17979992321,1cyclictest20108-21apt-get10:48:460
17979992321,1cyclictest0-21swapper/010:28:160
17979992321,1cyclictest0-21swapper/010:11:370
17979992321,1cyclictest0-21swapper/007:15:010
17979992320,2cyclictest0-21swapper/009:35:090
17979992319,3cyclictest3643-21ssh11:33:460
1797999230,23cyclictest0-21swapper/011:55:310
1797999230,23cyclictest0-21swapper/011:10:220
1797999230,23cyclictest0-21swapper/011:05:260
1797999230,23cyclictest0-21swapper/009:55:140
1797999230,22cyclictest6498-21dump-pmu-power10:35:010
1797999230,22cyclictest31381-21cron08:45:010
1797999230,22cyclictest3131-21sh12:33:250
1797999230,22cyclictest1250-21ssh12:00:160
1797999230,22cyclictest0-21swapper/010:36:060
1797999230,22cyclictest0-21swapper/010:00:080
1797999230,22cyclictest0-21swapper/009:50:080
1797999230,1cyclictest6449-21apt11:05:000
17990992222,0cyclictest0-21swapper/311:42:293
17990992221,0cyclictest17600-21ssh10:45:083
17990992220,1cyclictest12141-21munin-run08:05:013
17990992220,1cyclictest0-21swapper/312:25:043
17990992220,1cyclictest0-21swapper/311:10:103
17990992220,1cyclictest0-21swapper/307:15:013
1799099220,21cyclictest27485-21apt-get09:25:023
1799099220,21cyclictest14117-21apt-get10:13:473
1799099220,21cyclictest10959-21diskmemload10:31:233
1799099220,21cyclictest10959-21diskmemload09:41:433
1799099220,21cyclictest0-21swapper/312:30:423
1799099220,21cyclictest0-21swapper/311:28:483
1799099220,21cyclictest0-21swapper/310:15:043
1799099220,21cyclictest0-21swapper/309:56:243
1799099220,21cyclictest0-21swapper/307:48:473
1799099220,1cyclictest26772-21rm10:53:533
1799099220,1cyclictest0-21swapper/312:37:163
1799099220,0cyclictest10959-21diskmemload10:26:593
1799099220,0cyclictest0-21swapper/309:14:093
17988992220,1cyclictest28971-21turbostat08:40:002
17988992220,1cyclictest21743-21perf08:25:002
17988992218,4cyclictest0-21swapper/207:53:472
17988992218,3cyclictest0-21swapper/207:18:462
1798899220,21cyclictest0-21swapper/209:50:202
1798899220,21cyclictest0-21swapper/207:38:472
17984992222,0cyclictest10959-21diskmemload11:21:081
17984992222,0cyclictest0-21swapper/112:30:061
17984992222,0cyclictest0-21swapper/110:45:311
17984992220,1cyclictest6759-21ssh12:35:451
17984992220,1cyclictest12655-21ssh10:40:541
17984992220,1cyclictest0-21swapper/109:25:341
1798499220,22cyclictest0-21swapper/110:38:351
1798499220,21cyclictest30559-21apt-get07:38:471
1798499220,21cyclictest30026-21munin-run07:35:001
1798499220,21cyclictest0-21swapper/112:15:051
1798499220,21cyclictest0-21swapper/110:00:111
1798499220,21cyclictest0-21swapper/108:03:461
1798499220,1cyclictest2439-21ssh11:01:421
1798499220,0cyclictest0-21swapper/111:28:401
17979992222,0cyclictest0-21swapper/012:10:170
17979992222,0cyclictest0-21swapper/010:43:460
17979992222,0cyclictest0-21swapper/009:15:520
17979992220,1cyclictest0-21swapper/009:25:010
1797999221,21cyclictest62550irq/127-eno110:56:340
1797999220,22cyclictest0-21swapper/009:10:400
1797999220,21cyclictest606-21dbus-daemon08:10:010
1797999220,21cyclictest28078-21ssh11:25:040
1797999220,21cyclictest16909-21apt08:15:010
1797999220,21cyclictest0-21swapper/009:47:320
1797999220,21cyclictest0-21swapper/008:03:460
1797999220,1cyclictest1380-21munin-run08:50:010
1797999220,1cyclictest0-21swapper/008:35:000
17990992121,0cyclictest0-21swapper/307:43:463
17990992120,0cyclictest0-21swapper/309:08:463
17990992119,2cyclictest16927-21cat08:15:013
17990992119,1cyclictest17065-21sh09:15:033
1799099210,21cyclictest0-21swapper/311:45:103
1799099210,20cyclictest0-21swapper/308:48:483
1799099210,20cyclictest0-21swapper/308:43:473
1799099210,1cyclictest17974-21cyclictest07:33:473
1798899210,20cyclictest10456-21systemctl09:08:532
1798899210,0cyclictest0-21swapper/208:58:472
1798899210,0cyclictest0-21swapper/207:23:462
17984992120,1cyclictest31942-21apt-get08:48:481
17984992119,1cyclictest27557-21idleruntime-cro07:30:001
1798499210,20cyclictest23321-21apt-get07:23:461
1798499210,0cyclictest6738-21apt-get09:03:461
1798499210,0cyclictest0-21swapper/112:10:161
17979992121,0cyclictest0-21swapper/007:53:470
17990992020,0cyclictest0-21swapper/307:28:473
17990992019,0cyclictest151rcu_preempt08:20:003
1799099200,19cyclictest6188-21perf09:00:013
17988992020,0cyclictest0-21swapper/208:28:472
17988992020,0cyclictest0-21swapper/208:03:472
17988992018,1cyclictest3790-21munin-run08:55:012
1798899200,19cyclictest17730-21cstates08:18:482
1798899200,0cyclictest0-21swapper/208:13:462
17984992020,0cyclictest0-21swapper/108:08:471
17984992019,0cyclictest0-21swapper/108:38:461
1798499200,2cyclictest21733-21awk08:25:001
17979992019,1cyclictest0-21swapper/007:43:460
17979992019,0cyclictest0-21swapper/007:33:470
17979992019,0cyclictest0-21swapper/007:23:460
17979992017,2cyclictest9741-21cut08:00:010
1797999200,19cyclictest22753-21cron07:20:010
1797999200,0cyclictest27076-21apt-get08:38:460
1797999200,0cyclictest0-21swapper/008:58:460
1797999200,0cyclictest0-21swapper/007:48:470
17990991919,0cyclictest24684-21apt-get08:33:473
17990991918,1cyclictest0-21swapper/307:38:473
17988991919,0cyclictest0-21swapper/208:48:482
17988991919,0cyclictest0-21swapper/207:48:472
17988991916,2cyclictest29982-21cron07:35:002
1798899190,18cyclictest0-21swapper/208:40:012
1798899190,18cyclictest0-21swapper/208:33:492
1798899190,18cyclictest0-21swapper/208:00:012
1798899190,18cyclictest0-21swapper/207:13:482
17979991918,0cyclictest0-21swapper/007:38:470
17979991917,1cyclictest8582-21perf09:05:000
17990991818,0cyclictest0-21swapper/308:53:473
17990991818,0cyclictest0-21swapper/307:58:453
17984991818,0cyclictest18506-21apt-get07:13:451
17984991818,0cyclictest0-21swapper/108:28:471
17984991818,0cyclictest0-21swapper/107:58:461
17984991815,2cyclictest19308-21turbostat08:20:001
1798499180,17cyclictest0-21swapper/108:43:551
17990991716,1cyclictest5469-21apt-get07:53:473
17988991717,0cyclictest0-21swapper/207:28:472
17988991715,1cyclictest2534-21perf07:45:002
1799099160,15cyclictest28949-21cron08:40:013
17979991616,0cyclictest0-21swapper/008:53:460
17979991616,0cyclictest0-21swapper/008:28:470
1797999160,15cyclictest27562-21perf07:30:000
17988991515,0cyclictest0-21swapper/209:03:462
1798899150,0cyclictest0-21swapper/208:07:102
1799099140,14cyclictest0-21swapper/309:00:443
1799099140,14cyclictest0-21swapper/308:20:013
1799099140,14cyclictest0-21swapper/308:05:563
1799099140,0cyclictest0-21swapper/307:20:113
17984991414,0cyclictest0-21swapper/108:55:071
17984991414,0cyclictest0-21swapper/108:10:281
17984991414,0cyclictest0-21swapper/107:50:241
17984991414,0cyclictest0-21swapper/107:40:351
17984991414,0cyclictest0-21swapper/107:15:301
1798499140,14cyclictest0-21swapper/109:05:251
1798499140,0cyclictest0-21swapper/108:50:091
1798499140,0cyclictest0-21swapper/108:30:251
1797999140,14cyclictest0-21swapper/008:15:360
1797999140,0cyclictest0-21swapper/009:05:270
1797999140,0cyclictest0-21swapper/008:20:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional