You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 12:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Jul 02, 2026 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18351992522,2cyclictest29467-21sh23:19:343
1835199250,24cyclictest7431-21ssh22:01:183
1835199250,24cyclictest15131-21apt-get21:41:073
1834999250,24cyclictest0-21swapper/223:14:032
18345992525,0cyclictest0-21swapper/120:26:071
1834599250,1cyclictest9498-21sh21:36:091
18344992523,1cyclictest21649-21sh00:37:530
18344992523,1cyclictest21649-21sh00:37:530
1834499250,24cyclictest11984-21diskmemload21:14:150
1834499250,24cyclictest11984-21diskmemload00:23:230
18351992421,2cyclictest313-21systemd-journal19:35:003
18351992421,2cyclictest25440-21ssh21:21:093
1835199240,24cyclictest0-21swapper/323:08:153
1835199240,23cyclictest28997-21sh21:52:183
1835199240,23cyclictest16077-21hddtemp_smartct23:36:113
18349992424,0cyclictest25380-1kworker/u9:022:49:402
18349992422,1cyclictest4248-21sh23:54:592
18349992421,0cyclictest0-21swapper/221:15:252
18349992418,5cyclictest7299-21rm00:25:522
1834999240,24cyclictest0-21swapper/200:05:512
1834999240,23cyclictest606-21dbus-daemon22:00:002
1834999240,23cyclictest0-21swapper/221:36:352
1834999240,1cyclictest7486-21awk19:55:002
18345992424,0cyclictest0-21swapper/121:27:011
18345992423,0cyclictest11984-21diskmemload22:25:181
18345992422,1cyclictest0-21swapper/122:50:211
18345992422,1cyclictest0-21swapper/100:06:151
1834599240,23cyclictest0-21swapper/121:10:381
1834599240,23cyclictest0-21swapper/100:13:191
1834599240,1cyclictest13607-21memory22:36:111
1834499240,24cyclictest0-21swapper/021:46:210
1834499240,23cyclictest11984-21diskmemload23:57:350
1834499240,23cyclictest11984-21diskmemload23:43:280
1834499240,23cyclictest11186-21sh22:34:290
1834499240,23cyclictest0-21swapper/023:49:590
1834499240,23cyclictest0-21swapper/021:51:080
1834499240,23cyclictest0-21swapper/000:32:250
1834499240,23cyclictest0-21swapper/000:26:370
1834499240,1cyclictest62550irq/127-eno123:53:020
1834499240,0cyclictest0-21swapper/022:06:440
18351992323,0cyclictest0-21swapper/323:26:023
18351992323,0cyclictest0-21swapper/322:45:423
18351992323,0cyclictest0-21swapper/322:20:463
18351992323,0cyclictest0-21swapper/321:58:143
18351992323,0cyclictest0-21swapper/321:35:433
18351992322,1cyclictest0-21swapper/322:43:303
18351992321,1cyclictest11999-21apt-get21:10:013
18351992321,1cyclictest0-21swapper/322:25:213
18351992321,1cyclictest0-21swapper/321:27:423
18351992321,1cyclictest0-21swapper/300:31:373
18351992320,2cyclictest10308-21ssh23:01:223
1835199230,2cyclictest6612-21sh22:58:593
1835199230,23cyclictest0-21swapper/322:50:033
1835199230,23cyclictest0-21swapper/300:26:193
1835199230,23cyclictest0-21swapper/300:19:373
1835199230,22cyclictest0-21swapper/323:10:013
1835199230,22cyclictest0-21swapper/322:11:003
1835199230,22cyclictest0-21swapper/321:31:083
1835199230,0cyclictest11984-21diskmemload22:35:303
1835199230,0cyclictest0-21swapper/323:45:063
1835199230,0cyclictest0-21swapper/322:34:183
1835199230,0cyclictest0-21swapper/322:07:363
18349992323,0cyclictest2767-21ssh23:24:422
18349992323,0cyclictest11984-21diskmemload23:56:062
18349992323,0cyclictest11984-21diskmemload23:16:202
18349992323,0cyclictest11984-21diskmemload22:40:042
18349992323,0cyclictest11984-21diskmemload22:27:262
18349992323,0cyclictest0-21swapper/222:24:052
18349992323,0cyclictest0-21swapper/222:11:042
18349992323,0cyclictest0-21swapper/200:35:142
18349992323,0cyclictest0-21swapper/200:35:142
18349992323,0cyclictest0-21swapper/200:31:372
18349992320,0cyclictest0-21swapper/221:25:142
18349992320,0cyclictest0-21swapper/221:10:332
18349992319,0cyclictest0-21swapper/223:43:572
18349992318,4cyclictest11984-21diskmemload00:21:542
1834999230,23cyclictest0-21swapper/221:52:382
1834999230,23cyclictest0-21swapper/200:10:472
1834999230,22cyclictest5362-21ssh22:00:532
1834999230,22cyclictest30298-21ls19:35:002
1834999230,22cyclictest19155-21ssh23:39:002
1834999230,0cyclictest16743-21ssh22:39:242
1834999230,0cyclictest11984-21diskmemload23:49:042
1834999230,0cyclictest0-21swapper/223:01:472
1834999230,0cyclictest0-21swapper/222:51:042
1834999230,0cyclictest0-21swapper/221:20:162
18345992323,0cyclictest11984-21diskmemload23:53:161
18345992323,0cyclictest0-21swapper/122:42:501
18345992323,0cyclictest0-21swapper/122:17:001
18345992323,0cyclictest0-21swapper/122:17:001
18345992323,0cyclictest0-21swapper/121:58:101
18345992323,0cyclictest0-21swapper/121:44:541
18345992323,0cyclictest0-21swapper/100:16:121
18345992322,1cyclictest27749-21ssh22:20:331
18345992322,0cyclictest0-21swapper/123:48:401
18345992321,1cyclictest2888-21ssh23:24:521
18345992321,1cyclictest0-21swapper/100:35:431
18345992321,1cyclictest0-21swapper/100:35:431
18345992320,2cyclictest5069-21ssh23:55:511
1834599230,2cyclictest9302-21ssh22:31:511
1834599230,23cyclictest11984-21diskmemload23:02:521
1834599230,23cyclictest11984-21diskmemload21:23:561
1834599230,23cyclictest0-21swapper/121:30:131
1834599230,22cyclictest4846-21ssh22:00:051
1834599230,22cyclictest17702-21munin-run00:35:011
1834599230,22cyclictest11984-21diskmemload23:30:191
1834599230,22cyclictest11984-21diskmemload21:16:551
1834599230,22cyclictest10427-21ssh22:05:011
1834599230,22cyclictest10285-21sh00:27:331
1834599230,22cyclictest0-21swapper/123:41:071
1834599230,1cyclictest15401-21apt-get23:36:091
1834599230,0cyclictest11984-21diskmemload00:03:451
1834599230,0cyclictest0-21swapper/123:15:071
1834599230,0cyclictest0-21swapper/122:56:231
1834599230,0cyclictest0-21swapper/121:48:411
1834599230,0cyclictest0-21swapper/100:21:551
18344992323,0cyclictest11984-21diskmemload23:08:000
18344992323,0cyclictest11984-21diskmemload22:40:350
18344992323,0cyclictest0-21swapper/023:37:000
18344992323,0cyclictest0-21swapper/022:50:140
18344992323,0cyclictest0-21swapper/022:35:340
18344992323,0cyclictest0-21swapper/000:15:430
18344992322,1cyclictest62550irq/127-eno121:38:120
18344992322,0cyclictest0-21swapper/022:00:020
18344992321,1cyclictest27212-21sh23:16:260
18344992321,1cyclictest0-21swapper/021:27:370
1834499231,21cyclictest7144-21latency_hist21:00:010
1834499231,21cyclictest0-21swapper/021:06:060
1834499230,23cyclictest62550irq/127-eno121:16:060
1834499230,23cyclictest0-21swapper/022:49:400
1834499230,23cyclictest0-21swapper/021:59:440
1834499230,22cyclictest5857-21sh22:29:560
1834499230,22cyclictest31398-21fschecks_time23:21:110
1834499230,22cyclictest18834-21sh21:43:440
1834499230,22cyclictest0-21swapper/023:26:380
1834499230,22cyclictest0-21swapper/022:55:210
1834499230,22cyclictest0-21swapper/022:18:330
1834499230,22cyclictest0-21swapper/022:18:330
1834499230,0cyclictest0-21swapper/023:04:590
1834499230,0cyclictest0-21swapper/000:02:300
18351992222,0cyclictest11984-21diskmemload00:20:333
18351992222,0cyclictest0-21swapper/323:41:233
18351992220,1cyclictest5090-21apt-get20:56:073
1835199220,22cyclictest0-21swapper/300:12:123
1835199220,21cyclictest9710-21apt-get23:31:073
1835199220,21cyclictest9608-21perf21:05:003
1835199220,21cyclictest31425-21diskmemload23:50:073
1835199220,21cyclictest20989-21ssh00:36:553
1835199220,21cyclictest20989-21ssh00:36:553
1835199220,21cyclictest0-21swapper/323:55:363
1835199220,21cyclictest0-21swapper/320:46:083
1835199220,21cyclictest0-21swapper/319:41:073
1835199220,21cyclictest0-21swapper/300:05:023
1835199220,1cyclictest18634-21ssh21:15:333
1835199220,1cyclictest0-21swapper/300:00:063
1835199220,0cyclictest0-21swapper/322:15:023
1835199220,0cyclictest0-21swapper/322:15:023
1835199220,0cyclictest0-21swapper/321:45:423
18349992222,0cyclictest11984-21diskmemload23:28:062
18349992222,0cyclictest11984-21diskmemload22:55:232
18349992222,0cyclictest0-21swapper/200:02:092
18349992220,2cyclictest12103-21ssh22:06:112
18349992220,1cyclictest20571-21rm21:45:512
1834999220,22cyclictest11984-21diskmemload21:31:562
1834999220,22cyclictest0-21swapper/221:40:352
1834999220,21cyclictest6326-21ssh22:30:132
1834999220,21cyclictest27921-21ssh00:15:062
1834999220,1cyclictest25863-21apt-get19:26:072
18345992221,1cyclictest22-21ksoftirqd/123:06:291
18345992221,1cyclictest1675-21kworker/1:323:26:411
18345992221,1cyclictest0-21swapper/122:12:271
18345992220,1cyclictest32362-21dump-pmu-power20:45:001
1834599220,21cyclictest24774-21/usr/sbin/munin22:46:111
1834599220,21cyclictest12008-21latency_hist21:10:001
1834599220,21cyclictest11984-21diskmemload23:10:101
1834599220,21cyclictest0-21swapper/121:50:121
1834599220,21cyclictest0-21swapper/120:16:081
18344992222,0cyclictest0-21swapper/021:22:490
18344992222,0cyclictest0-21swapper/000:10:220
18344992221,1cyclictest0-21swapper/023:31:510
1834499220,21cyclictest16321-21sh22:10:160
1834499220,21cyclictest0-21swapper/021:30:340
1834499220,21cyclictest0-21swapper/000:05:010
1834499220,1cyclictest0-21swapper/023:12:360
1834499220,0cyclictest0-21swapper/022:23:030
1834499220,0cyclictest0-21swapper/019:16:070
18351992119,1cyclictest7518-21munin-run19:55:003
1835199210,1cyclictest27900-21apt-get20:36:073
1835199210,0cyclictest0-21swapper/323:20:063
18349992121,0cyclictest0-21swapper/223:05:342
18349992120,1cyclictest633-21apt-get19:41:072
18349992120,1cyclictest18654-21apt-get19:11:062
18349992120,1cyclictest18654-21apt-get19:11:062
18349992119,1cyclictest0-21swapper/222:15:152
18349992119,1cyclictest0-21swapper/222:15:152
1834999210,21cyclictest0-21swapper/223:30:062
1834999210,20cyclictest0-21swapper/220:36:072
1834999210,0cyclictest30658-21apt-get19:36:082
1834599210,21cyclictest0-21swapper/120:06:061
1834599210,0cyclictest32711-21apt-get20:46:081
1834599210,0cyclictest0-21swapper/119:36:071
18344992120,1cyclictest20382-21sendmail-msp20:20:000
18344992120,1cyclictest0-21swapper/020:21:060
18344992120,0cyclictest0-21swapper/020:51:070
18344992120,0cyclictest0-21swapper/020:05:020
1834499210,0cyclictest0-21swapper/020:00:020
18351992020,0cyclictest0-21swapper/319:46:083
18351992019,1cyclictest7845-21apt-get19:56:073
18351992019,1cyclictest7845-21apt-get19:56:073
18351992018,1cyclictest20363-21munin-run20:20:003
1835199200,0cyclictest23105-21apt-get20:26:073
18349992020,0cyclictest0-21swapper/220:26:082
18349992020,0cyclictest0-21swapper/220:00:022
18349992018,1cyclictest20711-21apt-get20:21:062
18345992020,0cyclictest0-21swapper/119:26:071
18345992019,1cyclictest0-21swapper/120:31:061
18345992019,1cyclictest0-21swapper/119:51:071
18345992017,2cyclictest22-21ksoftirqd/119:25:011
1834599200,0cyclictest0-21swapper/120:51:071
1834499200,0cyclictest0-21swapper/019:46:080
18351991919,0cyclictest0-21swapper/319:11:063
18351991919,0cyclictest0-21swapper/319:11:063
18349991919,0cyclictest25505-21apt-get20:31:062
18349991918,1cyclictest0-21swapper/219:46:082
18345991919,0cyclictest0-21swapper/119:56:071
18345991919,0cyclictest0-21swapper/119:56:071
18344991919,0cyclictest0-21swapper/020:46:080
18344991918,1cyclictest0-21swapper/020:26:080
1835199180,0cyclictest0-21swapper/320:41:083
18349991818,0cyclictest0-21swapper/219:16:072
18345991818,0cyclictest0-21swapper/119:35:001
18345991817,1cyclictest7506-21apt-get21:01:071
18344991818,0cyclictest0-21swapper/019:36:070
18344991816,1cyclictest32360-21idleruntime-cro20:45:000
18351991717,0cyclictest0-21swapper/320:00:023
18351991715,1cyclictest15559-21munin-plugin-st20:10:013
18349991717,0cyclictest13494-21apt-get20:06:062
18349991716,0cyclictest0-21swapper/220:46:072
18345991717,0cyclictest0-21swapper/120:21:061
1834599170,16cyclictest3673-21sed19:46:101
1834599170,16cyclictest23184-21munin-run19:20:011
18344991716,0cyclictest0-21swapper/019:26:070
18351991616,0cyclictest0-21swapper/320:51:073
18351991616,0cyclictest0-21swapper/319:36:073
18351991614,1cyclictest0-21swapper/319:20:013
18349991615,1cyclictest0-21swapper/220:56:072
1834599160,1cyclictest0-21swapper/120:05:011
1834599160,15cyclictest2723-21perf19:45:001
1834499167,8cyclictest783-21snmpd19:34:070
18344991614,1cyclictest0-21swapper/020:31:060
1834499160,1cyclictest7504-21latency_hist19:55:000
1834499160,1cyclictest29991-21latency_hist20:40:000
1834499160,15cyclictest1-21systemd21:01:240
1834499160,15cyclictest10041-21munin-run20:00:010
1834499160,15cyclictest10041-21munin-run20:00:010
18349991515,0cyclictest9952-21apt-get21:06:062
18349991515,0cyclictest0-21swapper/221:01:072
1834999150,1cyclictest9619-21users19:56:162
1834999150,1cyclictest9619-21users19:56:162
18351991414,0cyclictest0-21swapper/321:05:113
18351991414,0cyclictest0-21swapper/319:20:183
1835199140,14cyclictest0-21swapper/320:30:033
1835199140,14cyclictest0-21swapper/320:11:493
1835199140,0cyclictest0-21swapper/319:25:223
18349991414,0cyclictest0-21swapper/220:12:162
1834999140,14cyclictest0-21swapper/220:50:112
1834999140,14cyclictest0-21swapper/220:42:492
1834999140,14cyclictest0-21swapper/220:16:002
1834999140,14cyclictest0-21swapper/219:20:182
1834599140,14cyclictest0-21swapper/120:10:151
1834599140,14cyclictest0-21swapper/119:10:111
1834599140,14cyclictest0-21swapper/119:10:111
1834599140,0cyclictest0-21swapper/120:35:251
18344991414,0cyclictest0-21swapper/020:10:240
18344991414,0cyclictest0-21swapper/019:10:100
18344991414,0cyclictest0-21swapper/019:10:100
1834499140,14cyclictest0-21swapper/019:40:490
1834499140,14cyclictest0-21swapper/019:20:320
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional