You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 11:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Sep 01, 2026 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
169499260,25cyclictest27773-21diskmemload22:08:343
169499260,25cyclictest27773-21diskmemload22:08:343
169499250,24cyclictest27773-21diskmemload23:41:253
169099250,24cyclictest0-21swapper/223:42:252
169099250,24cyclictest0-21swapper/223:16:512
169099250,1cyclictest0-21swapper/221:45:202
1689992522,2cyclictest7835-21rm23:41:351
168999250,1cyclictest0-21swapper/122:32:391
168899250,24cyclictest0-21swapper/000:30:010
169499240,23cyclictest27773-21diskmemload21:34:493
169499240,23cyclictest27773-21diskmemload21:16:063
169499240,23cyclictest0-21swapper/321:54:573
169499240,23cyclictest0-21swapper/320:31:093
1690992424,0cyclictest0-21swapper/200:08:452
1690992423,1cyclictest0-21swapper/200:25:442
169099240,23cyclictest27773-21diskmemload22:54:022
169099240,23cyclictest27773-21diskmemload21:40:272
169099240,23cyclictest0-21swapper/223:30:562
169099240,1cyclictest0-21swapper/221:18:392
1689992424,0cyclictest0-21swapper/121:27:071
168999240,23cyclictest26828-21sh23:59:281
168999240,1cyclictest2152-21diskmemload23:36:331
168999240,0cyclictest0-21swapper/123:05:021
1688992421,2cyclictest9713-21ssh22:18:030
1688992421,2cyclictest27828-21ssh21:36:280
1688992421,2cyclictest12499-21sh21:51:410
168899240,24cyclictest0-21swapper/022:04:360
168899240,23cyclictest27773-21diskmemload23:30:200
168899240,23cyclictest0-21swapper/000:35:290
168899240,22cyclictest28956-21cut22:06:140
168899240,22cyclictest28956-21cut22:06:140
168899240,1cyclictest16837-21ssh23:50:470
1694992323,0cyclictest0-21swapper/322:20:043
1694992323,0cyclictest0-21swapper/300:18:383
1694992322,1cyclictest15228-21apt-get23:21:093
1694992322,1cyclictest0-21swapper/322:35:543
1694992322,0cyclictest25861-21apt-get21:36:103
1694992321,1cyclictest0-21swapper/323:57:053
1694992321,1cyclictest0-21swapper/323:35:013
1694992321,1cyclictest0-21swapper/323:31:103
1694992321,1cyclictest0-21swapper/321:41:233
1694992321,1cyclictest0-21swapper/300:06:113
169499231,21cyclictest24784-21apt-get23:01:093
169499230,23cyclictest0-21swapper/323:09:063
169499230,23cyclictest0-21swapper/322:10:103
169499230,22cyclictest4674-21ssh21:46:073
169499230,22cyclictest4513-21ssh00:38:153
169499230,22cyclictest0-21swapper/322:48:403
169499230,22cyclictest0-21swapper/321:11:133
169499230,1cyclictest0-21swapper/322:50:573
169499230,0cyclictest27773-21diskmemload22:41:173
169499230,0cyclictest27773-21diskmemload00:22:363
169499230,0cyclictest0-21swapper/323:45:343
169499230,0cyclictest0-21swapper/323:10:173
169499230,0cyclictest0-21swapper/321:20:573
1690992323,0cyclictest27773-21diskmemload23:54:062
1690992323,0cyclictest27773-21diskmemload23:45:322
1690992323,0cyclictest0-21swapper/222:49:112
1690992323,0cyclictest0-21swapper/200:30:372
1690992323,0cyclictest0-21swapper/200:16:302
1690992321,1cyclictest29361-21apt-get23:05:022
1690992321,1cyclictest0-21swapper/223:22:202
1690992320,2cyclictest27773-21diskmemload21:50:502
1690992319,0cyclictest0-21swapper/221:30:032
169099230,2cyclictest26460-21sed22:05:012
169099230,23cyclictest0-21swapper/222:40:462
169099230,23cyclictest0-21swapper/222:13:362
169099230,23cyclictest0-21swapper/222:06:192
169099230,23cyclictest0-21swapper/222:06:192
169099230,23cyclictest0-21swapper/221:12:422
169099230,23cyclictest0-21swapper/200:39:222
169099230,22cyclictest24968-21tr23:01:102
169099230,0cyclictest27773-21diskmemload21:36:012
169099230,0cyclictest27773-21diskmemload00:12:152
169099230,0cyclictest0-21swapper/223:56:112
169099230,0cyclictest0-21swapper/223:25:232
169099230,0cyclictest0-21swapper/222:57:202
1689992323,0cyclictest0-21swapper/122:47:101
1689992323,0cyclictest0-21swapper/121:58:261
1689992323,0cyclictest0-21swapper/121:47:271
1689992323,0cyclictest0-21swapper/121:32:051
1689992323,0cyclictest0-21swapper/100:15:151
1689992322,1cyclictest27773-21diskmemload00:26:021
1689992321,1cyclictest19945-21ssh23:52:351
1689992321,1cyclictest0-21swapper/121:11:461
1689992320,2cyclictest18789-21ssh22:55:321
1689992320,2cyclictest10871-21rm21:21:211
168999230,2cyclictest2941-21sh21:44:041
168999230,23cyclictest0-21swapper/123:46:071
168999230,23cyclictest0-21swapper/123:00:391
168999230,23cyclictest0-21swapper/122:05:371
168999230,23cyclictest0-21swapper/122:05:371
168999230,23cyclictest0-21swapper/121:50:541
168999230,22cyclictest6129-21idleruntime-cro20:25:001
168999230,22cyclictest4723-21ssh00:38:301
168999230,22cyclictest28103-21acpi00:31:101
168999230,22cyclictest27796-21perf21:10:001
168999230,22cyclictest27773-21diskmemload23:10:211
168999230,22cyclictest26295-21awk22:05:001
168999230,22cyclictest1214-21sh00:05:381
168999230,0cyclictest0-21swapper/122:23:201
168999230,0cyclictest0-21swapper/100:10:541
1688992323,0cyclictest62550irq/127-eno123:10:530
1688992323,0cyclictest27773-21diskmemload21:33:480
1688992323,0cyclictest0-21swapper/022:41:340
1688992323,0cyclictest0-21swapper/022:13:510
1688992323,0cyclictest0-21swapper/021:47:280
1688992323,0cyclictest0-21swapper/021:13:280
1688992323,0cyclictest0-21swapper/000:13:570
1688992322,1cyclictest27773-21diskmemload23:40:220
1688992320,2cyclictest14869-21sh22:51:160
168899230,2cyclictest15965-21ssh21:56:070
168899230,23cyclictest27773-21diskmemload23:15:130
168899230,23cyclictest27773-21diskmemload21:23:430
168899230,23cyclictest0-21swapper/023:45:030
168899230,22cyclictest6881-21grep19:20:000
168899230,22cyclictest4125-21sh23:39:180
168899230,22cyclictest22376-21sh23:55:380
168899230,22cyclictest19606-21kworker/u8:021:05:000
168899230,22cyclictest19327-21cron19:45:010
168899230,22cyclictest19327-21cron19:45:010
168899230,1cyclictest29753-21ps00:01:170
168899230,0cyclictest1014-21ssh21:41:260
1694992222,0cyclictest0-21swapper/322:57:023
1694992222,0cyclictest0-21swapper/322:15:143
1694992221,1cyclictest18069-21ssh21:56:343
1694992220,1cyclictest22354-21apt-get00:26:093
1694992220,1cyclictest0-21swapper/322:00:403
169499220,2cyclictest20879-21ssh23:26:083
169499220,21cyclictest8207-21sh00:12:303
169499220,21cyclictest4812-21apt-get19:16:093
169499220,21cyclictest27773-21diskmemload23:50:553
169499220,21cyclictest27773-21diskmemload00:00:443
169499220,21cyclictest16664-21sh21:26:413
169499220,21cyclictest0-21swapper/323:15:093
169499220,21cyclictest0-21swapper/322:33:123
169499220,21cyclictest0-21swapper/322:26:003
169499220,21cyclictest0-21swapper/320:06:103
169499220,1cyclictest0-21swapper/320:50:013
169499220,0cyclictest0-21swapper/300:30:173
1690992222,0cyclictest0-21swapper/223:35:152
1690992222,0cyclictest0-21swapper/222:30:122
1690992222,0cyclictest0-21swapper/221:25:272
1690992220,1cyclictest0-21swapper/222:26:192
169099220,21cyclictest6570-21apt-get22:16:102
169099220,21cyclictest0-21swapper/223:11:282
169099220,21cyclictest0-21swapper/222:23:012
169099220,21cyclictest0-21swapper/221:55:422
169099220,21cyclictest0-21swapper/221:20:322
169099220,21cyclictest0-21swapper/220:51:102
169099220,21cyclictest0-21swapper/200:00:362
169099220,1cyclictest313-21systemd-journal19:40:002
169099220,1cyclictest0-21swapper/222:35:422
169099220,1cyclictest0-21swapper/200:21:462
1689992222,0cyclictest0-21swapper/123:28:461
1689992222,0cyclictest0-21swapper/122:35:401
1689992222,0cyclictest0-21swapper/122:17:031
1689992222,0cyclictest0-21swapper/100:00:581
1689992220,1cyclictest606-21dbus-daemon20:45:011
1689992220,1cyclictest14678-21sh23:20:211
168999220,22cyclictest32676-21ssh22:10:171
168999220,22cyclictest0-21swapper/122:29:201
168999220,22cyclictest0-21swapper/121:38:421
168999220,21cyclictest19331-21sh19:45:011
168999220,21cyclictest19331-21sh19:45:011
168999220,21cyclictest12138-21grep19:30:001
168999220,21cyclictest0-21swapper/122:40:201
168999220,1cyclictest0-21swapper/123:31:401
168999220,1cyclictest0-21swapper/100:20:171
1688992222,0cyclictest27773-21diskmemload00:05:400
1688992222,0cyclictest0-21swapper/023:01:060
1688992221,1cyclictest0-21swapper/021:15:190
1688992220,2cyclictest0-21swapper/000:25:100
1688992220,1cyclictest16951-21perf19:40:000
1688992220,1cyclictest0-21swapper/021:10:000
168899220,22cyclictest11502-21ssh22:48:370
168899220,22cyclictest0-21swapper/023:26:520
168899220,21cyclictest28723-21ssh22:35:340
168899220,21cyclictest14723-21ssh23:20:240
168899220,21cyclictest14332-21ssh21:25:510
168899220,21cyclictest0-21swapper/023:07:140
168899220,21cyclictest0-21swapper/022:56:300
168899220,21cyclictest0-21swapper/020:36:080
168899220,1cyclictest23243-21ssh22:30:460
1694992119,1cyclictest0-21swapper/320:25:003
169499210,20cyclictest0-21swapper/319:46:093
169499210,1cyclictest20590-21perf20:55:003
1690992121,0cyclictest10077-21apt-get19:26:082
169099210,21cyclictest0-21swapper/219:15:022
169099210,20cyclictest22080-21apt-get19:51:092
1689992120,1cyclictest16142-21apt-get20:46:101
168999210,21cyclictest27773-21diskmemload22:50:181
168999210,21cyclictest0-21swapper/120:56:091
168999210,0cyclictest0-21swapper/119:36:081
1688992121,0cyclictest62550irq/127-eno122:25:370
1688992121,0cyclictest27773-21diskmemload00:20:130
1688992121,0cyclictest0-21swapper/020:16:100
1688992120,0cyclictest0-21swapper/019:46:090
1688992119,2cyclictest10230-21ssh00:15:030
168899210,21cyclictest0-21swapper/019:56:090
168899210,20cyclictest0-21swapper/020:01:100
168899210,0cyclictest27773-21diskmemload22:22:190
1694992020,0cyclictest0-21swapper/319:11:093
1694992018,1cyclictest622-21gdbus20:05:003
1690992020,0cyclictest0-21swapper/221:01:092
1690992020,0cyclictest0-21swapper/220:01:102
1690992018,1cyclictest2022-21apt-get19:11:092
169099200,20cyclictest0-21swapper/220:41:082
169099200,0cyclictest0-21swapper/219:56:082
1689992020,0cyclictest1659-21apt-get20:16:101
1689992019,1cyclictest0-21swapper/120:35:011
168999200,0cyclictest0-21swapper/120:06:091
1688992020,0cyclictest0-21swapper/019:31:100
1688992020,0cyclictest0-21swapper/019:21:090
1694991919,0cyclictest0-21swapper/320:56:093
1694991919,0cyclictest0-21swapper/319:51:093
1694991917,1cyclictest0-21swapper/321:05:003
1689991919,0cyclictest7234-21apt-get19:21:091
1689991919,0cyclictest4812-21apt-get19:16:091
1689991919,0cyclictest0-21swapper/119:11:091
1694991818,0cyclictest0-21swapper/319:25:023
1694991817,0cyclictest11327-21apt-get20:36:083
1690991818,0cyclictest12478-21apt-get19:31:102
1690991818,0cyclictest0-21swapper/220:21:092
1690991818,0cyclictest0-21swapper/219:21:092
1689991818,0cyclictest24475-21apt-get19:56:081
1689991816,1cyclictest8544-21munin-run20:30:001
1689991816,1cyclictest0-21swapper/120:05:001
1688991818,0cyclictest0-21swapper/020:26:100
1688991818,0cyclictest0-21swapper/019:30:000
1688991817,1cyclictest10996-21awk20:35:010
1694991717,0cyclictest0-21swapper/319:31:103
1694991717,0cyclictest0-21swapper/319:21:093
1694991715,1cyclictest8536-21perf20:30:003
1690991717,0cyclictest0-21swapper/220:06:102
1690991717,0cyclictest0-21swapper/219:46:092
1689991717,0cyclictest0-21swapper/119:31:101
168899170,1cyclictest1318-21awk20:15:000
1690991616,0cyclictest0-21swapper/220:16:102
1690991614,1cyclictest160692sleep220:45:362
1689991616,0cyclictest0-21swapper/120:51:101
1688991614,1cyclictest20903-21/usr/sbin/munin20:56:100
168899160,1cyclictest15988-21munin-run20:45:010
1694991513,1cyclictest313-21systemd-journal20:19:133
1694991513,1cyclictest24472-21awk19:56:083
1690991515,0cyclictest0-21swapper/220:26:102
1690991514,1cyclictest31679-21apt-get20:11:092
1688991515,0cyclictest4088-21apt-get20:21:090
1688991513,1cyclictest18540-21apt-get20:51:100
169499140,14cyclictest0-21swapper/321:05:053
169499140,14cyclictest0-21swapper/320:40:103
169499140,14cyclictest0-21swapper/319:40:553
169499140,14cyclictest0-21swapper/319:40:553
169499140,14cyclictest0-21swapper/319:35:053
169499140,0cyclictest0-21swapper/320:10:153
169099140,14cyclictest0-21swapper/221:05:402
169099140,14cyclictest0-21swapper/220:56:312
169099140,14cyclictest0-21swapper/220:30:012
169099140,14cyclictest0-21swapper/219:41:232
169099140,14cyclictest0-21swapper/219:41:232
169099140,0cyclictest0-21swapper/220:35:182
1689991414,0cyclictest0-21swapper/119:50:141
168999140,14cyclictest0-21swapper/121:00:021
168999140,14cyclictest0-21swapper/120:35:091
1688991414,0cyclictest0-21swapper/020:45:330
1688991414,0cyclictest0-21swapper/020:05:500
168899140,14cyclictest0-21swapper/019:50:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional