You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 15:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat May 16, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30079992623,2cyclictest22380-21sh22:33:472
3007999260,25cyclictest75-21kswapd000:12:142
3007899260,3cyclictest7519-21cut21:52:211
3008199250,24cyclictest1460-21ssh22:15:483
30079992519,3cyclictest23656-21diskmemload22:10:582
3007999250,1cyclictest19579-21ssh00:25:242
30078992525,0cyclictest0-21swapper/123:04:591
3007899250,24cyclictest0-21swapper/122:15:021
3007899250,24cyclictest0-21swapper/122:12:411
30077992524,1cyclictest0-21swapper/021:40:450
3007799250,24cyclictest23656-21diskmemload22:58:170
3008199240,24cyclictest0-21swapper/321:24:323
3007999240,23cyclictest30154-21ssh00:06:252
3007999240,23cyclictest0-21swapper/223:35:382
3007999240,23cyclictest0-21swapper/223:12:272
3007999240,1cyclictest23656-21diskmemload22:47:162
3007999240,0cyclictest0-21swapper/223:57:472
3007999240,0cyclictest0-21swapper/221:33:562
3007999240,0cyclictest0-21swapper/221:33:562
3007899240,24cyclictest0-21swapper/121:40:471
3007899240,24cyclictest0-21swapper/100:16:531
3007899240,23cyclictest23656-21diskmemload21:33:281
3007899240,23cyclictest23656-21diskmemload21:33:281
3007899240,23cyclictest23656-21diskmemload21:13:141
3007899240,23cyclictest23287-21idleruntime-cro22:35:011
3007899240,23cyclictest0-21swapper/122:48:561
3007899240,23cyclictest0-21swapper/122:20:541
3007899240,23cyclictest0-21swapper/100:11:451
3007899240,23cyclictest0-21swapper/100:04:381
30077992423,1cyclictest23656-21diskmemload00:24:400
30077992422,1cyclictest20885-21apt-get00:27:130
30077992422,1cyclictest0-21swapper/023:12:040
3007799240,23cyclictest25106-21rm23:05:010
3007799240,23cyclictest23656-21diskmemload23:29:140
3007799240,23cyclictest23656-21diskmemload21:47:010
3007799240,23cyclictest17579-21ssh22:02:140
3007799240,23cyclictest0-21swapper/022:25:060
3007799240,23cyclictest0-21swapper/022:16:370
3007799240,0cyclictest0-21swapper/021:31:410
3007799240,0cyclictest0-21swapper/021:31:410
30081992323,0cyclictest23656-21diskmemload21:57:323
30081992323,0cyclictest0-21swapper/323:57:013
30081992323,0cyclictest0-21swapper/323:24:023
30081992323,0cyclictest0-21swapper/323:08:213
30081992323,0cyclictest0-21swapper/321:35:533
30081992323,0cyclictest0-21swapper/300:26:043
3008199230,2cyclictest4647-21ssh23:15:233
3008199230,23cyclictest23656-21diskmemload22:55:543
3008199230,23cyclictest0-21swapper/323:51:043
3008199230,23cyclictest0-21swapper/323:29:193
3008199230,23cyclictest0-21swapper/322:03:033
3008199230,22cyclictest3640-21ssh00:11:453
3008199230,22cyclictest31607-21ssh00:36:183
3008199230,22cyclictest18196-21ssh00:23:523
3008199230,0cyclictest23656-21diskmemload21:11:183
3008199230,0cyclictest0-21swapper/323:38:483
3008199230,0cyclictest0-21swapper/321:54:033
3008199230,0cyclictest0-21swapper/300:00:543
30079992323,0cyclictest0-21swapper/223:40:162
30079992323,0cyclictest0-21swapper/223:00:012
30079992323,0cyclictest0-21swapper/221:16:392
30079992322,0cyclictest0-21swapper/200:19:352
30079992319,3cyclictest0-21swapper/200:39:092
3007999231,22cyclictest5780-1kworker/u9:100:03:282
3007999230,22cyclictest26345-21ssh23:06:412
3007999230,22cyclictest15879-21latency_hist23:25:012
3007999230,22cyclictest10727-21rm23:48:322
3007999230,22cyclictest10488-21ssh21:55:162
3007999230,1cyclictest29285-21ssh21:42:282
3007999230,0cyclictest23656-21diskmemload22:35:082
3007999230,0cyclictest0-21swapper/223:52:262
3007999230,0cyclictest0-21swapper/223:33:442
3007999230,0cyclictest0-21swapper/222:43:532
3007999230,0cyclictest0-21swapper/222:26:412
3007999230,0cyclictest0-21swapper/222:21:472
3007999230,0cyclictest0-21swapper/221:53:312
3007999230,0cyclictest0-21swapper/221:36:252
3007999230,0cyclictest0-21swapper/200:24:512
30078992323,0cyclictest0-21swapper/122:26:521
30078992323,0cyclictest0-21swapper/122:05:301
30078992323,0cyclictest0-21swapper/100:35:321
30078992323,0cyclictest0-21swapper/100:20:111
30078992322,1cyclictest0-21swapper/122:50:411
30078992322,1cyclictest0-21swapper/122:01:491
30078992321,1cyclictest2846-21apt-get19:22:131
30078992321,1cyclictest0-21swapper/123:19:501
30078992321,1cyclictest0-21swapper/122:37:201
30078992321,1cyclictest0-21swapper/121:27:371
3007899230,23cyclictest0-21swapper/122:44:381
3007899230,22cyclictest32529-21ssh23:11:531
3007899230,22cyclictest30449-21sh21:16:141
3007899230,22cyclictest30414-21kworker/u8:221:20:071
3007899230,22cyclictest18771-21rm23:56:271
3007899230,22cyclictest17308-21ssh23:26:341
3007899230,22cyclictest0-21swapper/123:38:371
3007899230,22cyclictest0-21swapper/123:30:321
3007899230,22cyclictest0-21swapper/100:28:221
3007899230,21cyclictest313-21systemd-journal21:10:001
3007899230,1cyclictest23915-21sh21:37:551
3007899230,1cyclictest0-21swapper/123:50:231
3007899230,1cyclictest0-21swapper/123:40:091
3007899230,1cyclictest0-21swapper/123:06:221
30077992323,0cyclictest62550irq/127-eno122:05:360
30077992323,0cyclictest23656-21diskmemload23:15:130
30077992323,0cyclictest23656-21diskmemload22:41:140
30077992323,0cyclictest0-21swapper/023:01:460
30077992323,0cyclictest0-21swapper/021:29:160
30077992323,0cyclictest0-21swapper/021:10:460
30077992323,0cyclictest0-21swapper/000:18:570
30077992323,0cyclictest0-21swapper/000:02:140
30077992322,1cyclictest0-21swapper/022:21:420
30077992322,0cyclictest14272-21ssh21:58:070
30077992321,1cyclictest0-21swapper/023:20:330
30077992321,1cyclictest0-21swapper/021:37:240
30077992320,2cyclictest4986-21ssh23:43:210
3007799230,2cyclictest25409-21sh00:30:370
3007799230,2cyclictest10662-21ssh23:48:260
3007799230,23cyclictest23656-21diskmemload22:52:360
3007799230,22cyclictest24803-21apt20:05:010
3007799230,22cyclictest23656-21diskmemload00:13:180
3007799230,22cyclictest19755-21df23:57:150
3007799230,22cyclictest141rcuc/023:52:090
3007799230,22cyclictest0-21swapper/022:49:400
3007799230,22cyclictest0-21swapper/022:30:260
3007799230,1cyclictest3734-21ssh21:21:220
3007799230,0cyclictest23656-21diskmemload22:11:450
3007799230,0cyclictest0-21swapper/023:33:380
3007799230,0cyclictest0-21swapper/022:38:120
3007799230,0cyclictest0-21swapper/021:52:420
3007799230,0cyclictest0-21swapper/000:07:070
30081992222,0cyclictest23656-21diskmemload23:33:283
30081992222,0cyclictest0-21swapper/322:41:273
30081992221,1cyclictest8931-21ssh00:16:243
30081992221,1cyclictest0-21swapper/323:12:423
30081992220,1cyclictest30841-21ssh00:07:143
3008199220,2cyclictest22644-21ssh22:06:253
3008199220,22cyclictest0-21swapper/322:46:263
3008199220,22cyclictest0-21swapper/321:42:573
3008199220,21cyclictest31779-21ssh21:45:253
3008199220,21cyclictest29724-21ssh21:15:113
3008199220,21cyclictest25205-21rm00:30:223
3008199220,21cyclictest19553-21ssh23:00:063
3008199220,21cyclictest16061-21ssh22:27:563
3008199220,21cyclictest0-21swapper/322:30:343
3008199220,1cyclictest16465-21dump-pmu-power20:55:013
3008199220,1cyclictest0-21swapper/323:47:143
3008199220,1cyclictest0-21swapper/322:35:443
3008199220,1cyclictest0-21swapper/321:28:263
30079992222,0cyclictest0-21swapper/222:58:202
30079992221,1cyclictest22306-21ssh22:05:592
30079992221,1cyclictest0-21swapper/222:18:062
30079992220,1cyclictest7638-21apt-get19:32:112
30079992220,1cyclictest0-21swapper/221:10:252
3007999220,21cyclictest0-21swapper/222:01:502
3007999220,21cyclictest0-21swapper/221:02:132
3007999220,1cyclictest4426-21ssh23:15:072
3007999220,1cyclictest0-21swapper/223:25:562
3007999220,1cyclictest0-21swapper/221:25:102
3007999220,1cyclictest0-21swapper/221:22:182
30078992220,1cyclictest0-21swapper/122:55:031
30078992220,1cyclictest0-21swapper/121:55:531
3007899220,22cyclictest0-21swapper/100:05:221
3007899220,21cyclictest0-21swapper/121:02:131
3007899220,21cyclictest0-21swapper/120:32:121
3007899220,21cyclictest0-21swapper/100:32:111
3007899220,1cyclictest29664-21turbostat.cron20:15:011
3007899220,0cyclictest0-21swapper/121:47:521
30077992222,0cyclictest0-21swapper/023:37:260
30077992221,1cyclictest31695-21diskmemload00:36:250
30077992220,1cyclictest7289-21apt-get20:37:130
30077992220,1cyclictest2048-21idleruntime-cro20:25:000
3007799220,22cyclictest0-21swapper/021:17:210
3007799220,21cyclictest0-21swapper/020:52:140
3007799220,21cyclictest0-21swapper/020:42:130
3007799220,21cyclictest0-21swapper/020:27:140
3007799220,1cyclictest0-21swapper/021:00:010
30081992119,1cyclictest847-21sh23:40:053
30081992119,1cyclictest0-21swapper/320:30:003
3008199210,21cyclictest0-21swapper/322:20:593
3008199210,21cyclictest0-21swapper/320:22:143
3008199210,0cyclictest5243-21apt-get19:27:143
3008199210,0cyclictest0-21swapper/321:33:213
3008199210,0cyclictest0-21swapper/321:33:213
3008199210,0cyclictest0-21swapper/319:47:143
3007999210,20cyclictest0-21swapper/220:17:142
3007999210,20cyclictest0-21swapper/219:52:142
3007999210,1cyclictest4819-21grep19:25:012
3007999210,0cyclictest12456-21apt-get19:42:132
3007999210,0cyclictest0-21swapper/221:07:152
3007999210,0cyclictest0-21swapper/220:52:142
30078992120,1cyclictest0-21swapper/119:57:141
3007899210,20cyclictest0-21swapper/120:47:141
3007899210,20cyclictest0-21swapper/120:07:131
3007899210,1cyclictest23656-21diskmemload23:45:231
3007899210,0cyclictest0-21swapper/119:32:121
3007899210,0cyclictest0-21swapper/119:17:141
30077992120,0cyclictest0-21swapper/021:07:150
30077992120,0cyclictest0-21swapper/020:17:140
30081992020,0cyclictest0-21swapper/320:47:153
30081992020,0cyclictest0-21swapper/319:22:133
3008199200,0cyclictest0-21swapper/319:32:113
30079992019,0cyclictest15245-21apt-get19:47:142
30079992018,1cyclictest7227-21basename19:30:002
3007999200,20cyclictest0-21swapper/220:32:132
3007999200,0cyclictest0-21swapper/220:22:142
3007999200,0cyclictest0-21swapper/219:57:142
30078992020,0cyclictest0-21swapper/120:52:141
30077992020,0cyclictest0-21swapper/019:27:130
30077992020,0cyclictest0-21swapper/019:12:140
30081991918,1cyclictest9704-21apt-get20:42:133
30079991919,0cyclictest0-21swapper/219:17:142
30079991918,1cyclictest2494-21apt-get20:27:142
30079991917,1cyclictest0-21swapper/220:05:012
30078991919,0cyclictest0-21swapper/120:37:141
30078991919,0cyclictest0-21swapper/120:27:141
30078991919,0cyclictest0-21swapper/119:47:141
30078991919,0cyclictest0-21swapper/119:27:141
30078991917,1cyclictest32092-21munin-run20:20:001
30077991919,0cyclictest0-21swapper/019:47:140
30077991919,0cyclictest0-21swapper/019:22:130
30081991818,0cyclictest20035-21apt-get19:57:143
30081991818,0cyclictest0-21swapper/319:37:123
30081991817,1cyclictest0-21swapper/320:07:133
3008199180,0cyclictest17640-21apt-get19:52:143
30079991818,0cyclictest0-21swapper/220:57:152
30079991818,0cyclictest0-21swapper/219:12:142
30078991816,1cyclictest32424-21latency_hist19:15:011
30078991816,1cyclictest12003-21dump-pmu-power19:40:001
30078991816,1cyclictest0-21swapper/120:00:021
3007799189,8cyclictest13-21ksoftirqd/019:20:010
30077991818,0cyclictest0-21swapper/021:02:130
30081991717,0cyclictest4894-21apt-get20:32:123
30081991717,0cyclictest22847-21apt-get20:02:133
30081991717,0cyclictest21701-21apt-get21:07:153
30079991717,0cyclictest0-21swapper/220:12:142
30078991717,0cyclictest0-21swapper/120:57:151
30078991715,1cyclictest14430-21latency_hist19:45:001
30078991715,1cyclictest0-21swapper/120:42:121
30077991717,0cyclictest0-21swapper/019:42:130
30081991616,0cyclictest379-21apt-get19:17:143
30081991616,0cyclictest19305-21apt-get21:02:133
30081991616,0cyclictest0-21swapper/320:37:133
30081991616,0cyclictest0-21swapper/319:42:133
30079991616,0cyclictest0-21swapper/220:47:152
30079991616,0cyclictest0-21swapper/220:37:142
30079991614,1cyclictest12035-21munin-run19:40:002
30079991614,1cyclictest0-21swapper/220:07:152
30078991616,0cyclictest0-21swapper/119:52:141
30077991616,0cyclictest27692-21apt-get20:12:140
30077991513,1cyclictest12014-21perf19:40:000
3007799150,1cyclictest22010-21perf20:00:010
30081991414,0cyclictest0-21swapper/320:10:423
3008199140,0cyclictest0-21swapper/320:15:243
3007999140,14cyclictest0-21swapper/220:40:112
3007899140,14cyclictest0-21swapper/120:21:541
30077991414,0cyclictest0-21swapper/020:05:130
30077991414,0cyclictest0-21swapper/019:52:390
3007799140,14cyclictest0-21swapper/020:45:350
3007799140,14cyclictest0-21swapper/019:30:300
3007799140,0cyclictest0-21swapper/020:30:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional