You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 07:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Jul 27, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1893099270,23cyclictest0-21swapper/123:56:221
1893099270,21cyclictest606-21dbus-daemon23:55:001
1893099270,1cyclictest23029-21apt23:15:001
1893099270,0cyclictest0-21swapper/100:04:341
1892999274,22cyclictest0-21swapper/022:40:010
18929992725,1cyclictest12232-21diskmemload22:26:580
1892999272,24cyclictest12232-21diskmemload21:54:330
18930992621,4cyclictest25555-21apt-get23:18:111
18930992621,4cyclictest25555-21apt-get23:18:111
1893099260,21cyclictest22968-21apt-get22:18:121
1892999262,23cyclictest0-21swapper/000:07:410
18932992520,4cyclictest13596-21ssh22:08:432
1893299250,25cyclictest0-21swapper/223:52:382
18930992520,4cyclictest12232-21diskmemload23:05:491
1893099250,24cyclictest3024-21ssh23:26:271
1893099250,24cyclictest23534-21ssh22:47:021
1893099250,24cyclictest12232-21diskmemload22:37:531
1893099250,24cyclictest12232-21diskmemload22:12:191
1893099250,24cyclictest12232-21diskmemload00:21:211
1893099250,24cyclictest0-21swapper/121:27:101
1893099250,1cyclictest6181-21ssh22:59:571
1892999253,21cyclictest0-21swapper/023:25:010
18929992523,1cyclictest62550irq/127-eno121:13:540
18929992523,1cyclictest0-21swapper/020:25:010
18929992523,1cyclictest0-21swapper/000:14:400
1892999252,2cyclictest0-21swapper/000:33:180
1892999252,22cyclictest19226-21ssh23:12:180
1892999250,24cyclictest11061-21ssh22:07:310
1892999250,24cyclictest0-21swapper/023:15:560
1892999250,24cyclictest0-21swapper/023:15:560
18936992423,1cyclictest12232-21diskmemload23:25:333
18936992422,1cyclictest24945-21sh22:18:313
1893699240,23cyclictest0-21swapper/323:45:013
1893699240,23cyclictest0-21swapper/323:05:253
1893699240,1cyclictest0-21swapper/323:55:573
1893699240,1cyclictest0-21swapper/323:41:293
18932992424,0cyclictest0-21swapper/221:32:562
18932992422,2cyclictest21459-21ssh21:47:592
18932992422,1cyclictest9428-21ssh23:32:232
1893299240,23cyclictest12232-21diskmemload23:18:162
1893299240,23cyclictest12232-21diskmemload23:18:162
1893299240,23cyclictest12232-21diskmemload00:18:362
1893299240,23cyclictest0-21swapper/221:22:232
1893299240,0cyclictest12232-21diskmemload22:31:082
18930992421,3cyclictest0-21swapper/121:46:561
18930992419,4cyclictest19570-21ssh23:41:011
1893099240,3cyclictest15723-21awk00:35:001
1893099240,24cyclictest12232-21diskmemload00:36:321
1893099240,23cyclictest11455-21ssh22:08:101
1893099240,23cyclictest0-21swapper/123:24:561
1893099240,23cyclictest0-21swapper/121:50:301
1893099240,21cyclictest12232-21diskmemload22:30:191
1893099240,1cyclictest0-21swapper/122:29:301
1893099240,0cyclictest0-21swapper/122:42:491
1893099240,0cyclictest0-21swapper/121:44:311
1893099240,0cyclictest0-21swapper/121:44:311
1893099240,0cyclictest0-21swapper/121:39:551
1893099240,0cyclictest0-21swapper/100:10:151
1892999243,1cyclictest12232-21diskmemload22:03:590
18929992423,1cyclictest12232-21diskmemload21:39:220
18929992423,1cyclictest0-21swapper/020:58:110
1892999242,2cyclictest12232-21diskmemload23:31:300
1892999242,21cyclictest2833-21sh21:59:200
18929992422,1cyclictest21265-21cron19:15:000
18929992422,1cyclictest12232-21diskmemload23:08:380
1892999242,1cyclictest0-21swapper/022:39:300
1892999242,1cyclictest0-21swapper/021:34:540
18929992421,2cyclictest8624-21idleruntime-cro00:00:000
18929992421,2cyclictest2880-21unixbench_singl00:23:220
1892999240,23cyclictest0-21swapper/023:28:450
1892999240,23cyclictest0-21swapper/021:28:530
18936992323,0cyclictest0-21swapper/323:36:473
18936992323,0cyclictest0-21swapper/322:33:283
18936992323,0cyclictest0-21swapper/322:26:453
18936992323,0cyclictest0-21swapper/321:35:393
18936992321,1cyclictest10993-21ssh22:35:363
1893699232,0cyclictest0-21swapper/322:42:153
18936992320,2cyclictest9171-21ssh22:05:013
18936992320,2cyclictest30453-21ssh23:50:453
18936992320,2cyclictest23711-21perf19:20:013
18936992320,2cyclictest14685-21ssh00:05:253
1893699230,23cyclictest0-21swapper/322:56:563
1893699230,23cyclictest0-21swapper/321:32:113
1893699230,23cyclictest0-21swapper/321:25:463
1893699230,23cyclictest0-21swapper/300:26:123
1893699230,22cyclictest7982-21sh23:02:003
1893699230,22cyclictest30679-21sh22:23:373
1893699230,22cyclictest11656-21ssh00:31:483
1893699230,22cyclictest0-21swapper/323:10:513
1893699230,22cyclictest0-21swapper/322:10:103
1893699230,22cyclictest0-21swapper/300:03:553
1893699230,1cyclictest606-21dbus-daemon19:45:003
1893699230,0cyclictest0-21swapper/300:36:493
18932992323,0cyclictest0-21swapper/223:55:142
18932992323,0cyclictest0-21swapper/223:22:142
18932992323,0cyclictest0-21swapper/223:05:382
18932992323,0cyclictest0-21swapper/200:22:052
18932992323,0cyclictest0-21swapper/200:10:302
18932992321,2cyclictest15547-21ssh21:42:242
18932992321,2cyclictest15547-21ssh21:42:242
18932992321,1cyclictest29301-21ssh21:53:422
18932992321,1cyclictest0-21swapper/222:47:472
1893299230,2cyclictest9865-21perf21:05:012
1893299230,2cyclictest9116-21rm21:36:072
1893299230,23cyclictest0-21swapper/223:44:192
1893299230,23cyclictest0-21swapper/223:25:392
1893299230,23cyclictest0-21swapper/222:15:592
1893299230,22cyclictest6947-21rm23:00:352
1893299230,22cyclictest3100-21apt-get20:53:122
1893299230,22cyclictest29889-21ssh21:25:322
1893299230,22cyclictest27595-21sh22:21:472
1893299230,22cyclictest12232-21diskmemload00:26:352
1893299230,22cyclictest0-21swapper/221:58:482
1893299230,1cyclictest21276-21awk19:15:002
1893299230,0cyclictest12232-21diskmemload22:38:432
1893299230,0cyclictest0-21swapper/222:55:272
1893299230,0cyclictest0-21swapper/200:00:502
18930992323,0cyclictest0-21swapper/122:22:591
18930992323,0cyclictest0-21swapper/122:00:541
18930992323,0cyclictest0-21swapper/100:16:511
18930992321,2cyclictest0-21swapper/123:36:311
18930992321,1cyclictest0-21swapper/123:30:061
18930992320,2cyclictest23002-21awk20:25:011
1893099230,22cyclictest3930-21ssh21:31:361
1893099230,22cyclictest0-21swapper/123:03:201
1893099230,22cyclictest0-21swapper/121:15:081
1893099230,1cyclictest13004-21apt-get20:05:021
1893099230,0cyclictest12232-21diskmemload22:50:221
18929992323,0cyclictest12232-21diskmemload00:28:000
18929992322,1cyclictest0-21swapper/022:51:440
18929992322,1cyclictest0-21swapper/022:20:580
18929992322,1cyclictest0-21swapper/022:15:070
18929992322,1cyclictest0-21swapper/021:22:210
18929992322,1cyclictest0-21swapper/000:35:130
1892999232,0cyclictest30134-21ssh23:50:090
18929992320,2cyclictest5963-21sh22:59:420
1892999230,2cyclictest23853-21ssh23:44:330
1892999230,23cyclictest0-21swapper/023:03:370
1892999230,22cyclictest5804-21apt19:50:000
1892999230,22cyclictest15797-21ls20:10:010
1892999230,1cyclictest0-21swapper/023:46:330
18936992220,1cyclictest896-21awk19:40:013
18936992220,1cyclictest0-21swapper/322:00:553
18936992220,1cyclictest0-21swapper/300:11:443
1893699221,1cyclictest8496-21ssh23:31:033
1893699220,2cyclictest25353-21ssh21:50:353
1893699220,21cyclictest26436-21ssh00:16:033
1893699220,21cyclictest23542-21sh23:15:333
1893699220,21cyclictest23542-21sh23:15:333
1893699220,21cyclictest18415-21ssh21:15:013
1893699220,21cyclictest0-21swapper/323:20:113
1893699220,21cyclictest0-21swapper/321:40:263
1893699220,21cyclictest0-21swapper/321:40:263
1893699220,1cyclictest23764-21sh22:47:193
1893699220,1cyclictest12232-21diskmemload21:10:293
1893699220,0cyclictest12232-21diskmemload22:50:483
18932992222,0cyclictest0-21swapper/223:10:332
18932992222,0cyclictest0-21swapper/200:32:212
18932992220,1cyclictest3903-21apt-get19:48:112
18932992220,1cyclictest0-21swapper/221:16:032
1893299220,22cyclictest0-21swapper/222:40:032
1893299220,22cyclictest0-21swapper/200:36:132
1893299220,21cyclictest0-21swapper/222:00:392
1893299220,1cyclictest28489-21ssh22:51:052
1893299220,1cyclictest0-21swapper/223:35:122
1893299220,1cyclictest0-21swapper/222:26:162
1893299220,0cyclictest0-21swapper/200:05:512
18930992222,0cyclictest0-21swapper/121:56:091
18930992222,0cyclictest0-21swapper/100:25:371
18930992219,2cyclictest30230-21awk20:40:001
1893099220,21cyclictest24739-21ssh23:45:211
1893099220,21cyclictest15528-21runrttasks00:06:271
1893099220,21cyclictest0-21swapper/121:20:241
1893099220,21cyclictest0-21swapper/121:10:271
18929992222,0cyclictest0-21swapper/022:45:270
18929992222,0cyclictest0-21swapper/020:33:110
18929992220,1cyclictest25317-21phc2sys-jitter19:23:160
1892999220,22cyclictest0-21swapper/022:30:040
1892999220,22cyclictest0-21swapper/020:03:120
1892999220,21cyclictest16212-21ssh22:11:270
1892999220,21cyclictest0-21swapper/021:45:170
1892999220,21cyclictest0-21swapper/020:13:130
1892999220,21cyclictest0-21swapper/019:38:120
1892999220,21cyclictest0-21swapper/019:18:120
1892999220,1cyclictest2612-21munin-run20:50:000
1892999220,1cyclictest0-21swapper/021:16:310
18936992121,0cyclictest0-21swapper/321:55:013
18936992121,0cyclictest0-21swapper/321:45:073
18936992119,1cyclictest20605-21dump-pmu-power20:20:013
1893699210,0cyclictest0-21swapper/320:48:103
18932992120,1cyclictest31404-21apt-get19:38:132
18932992119,1cyclictest0-21swapper/220:25:012
18932992119,1cyclictest0-21swapper/219:45:002
1893299210,0cyclictest0-21swapper/223:45:322
18930992120,0cyclictest0-21swapper/119:58:101
18930992120,0cyclictest0-21swapper/119:43:111
18930992119,1cyclictest0-21swapper/120:03:121
1893099210,0cyclictest0-21swapper/121:08:121
18929992121,0cyclictest0-21swapper/019:28:110
18936992020,0cyclictest0-21swapper/320:58:113
18936992019,0cyclictest30722-21apt-get20:43:123
1893699200,0cyclictest0-21swapper/319:58:103
1893699200,0cyclictest0-21swapper/319:13:113
18932992020,0cyclictest6300-21apt-get19:53:112
18932992020,0cyclictest13902-21apt-get20:08:132
18932992020,0cyclictest0-21swapper/220:03:122
18930992020,0cyclictest0-21swapper/120:28:111
18930992019,0cyclictest0-21swapper/120:18:121
1893099200,20cyclictest0-21swapper/119:48:111
1893099200,19cyclictest0-21swapper/119:23:091
18929992020,0cyclictest0-21swapper/020:18:110
18936991919,0cyclictest0-21swapper/321:08:123
18936991919,0cyclictest0-21swapper/321:03:093
18936991919,0cyclictest0-21swapper/320:33:113
18936991917,1cyclictest26123-21munin-run19:25:013
18936991917,1cyclictest11112-21apt-get20:03:123
18932991919,0cyclictest0-21swapper/219:18:122
18930991919,0cyclictest0-21swapper/120:13:131
18930991919,0cyclictest0-21swapper/119:55:001
1892999198,10cyclictest0-21swapper/019:55:010
18929991918,0cyclictest0-21swapper/021:08:120
18929991917,1cyclictest5065-21munin-run20:55:010
18929991917,1cyclictest0-21swapper/020:28:110
18932991818,0cyclictest0-21swapper/220:13:132
18930991817,0cyclictest5547-21apt-get20:58:111
1893099180,16cyclictest313-21systemd-journal20:35:001
18929991817,1cyclictest0-21swapper/020:38:210
18929991816,1cyclictest8548-21chrt19:56:410
18929991816,1cyclictest3345-21awk19:45:000
18936991717,0cyclictest0-21swapper/319:28:113
18932991716,0cyclictest25910-21apt-get20:33:112
1893099170,16cyclictest5069-21latency_hist20:55:011
18929991717,0cyclictest0-21swapper/021:03:090
18929991715,1cyclictest32613-21awk20:45:000
1893699160,15cyclictest6930-21sed19:53:133
18932991616,0cyclictest24207-21apt-get19:23:092
18932991615,1cyclictest28304-21apt-get20:38:122
18930991614,1cyclictest31349-21gltestperf20:43:141
18930991614,1cyclictest0-21swapper/119:13:191
1893099160,15cyclictest583-21runrttasks20:47:381
18936991513,1cyclictest24551-21ntp_states20:28:163
18932991515,0cyclictest672-21apt-get20:48:102
18932991515,0cyclictest0-21swapper/219:58:102
18932991513,1cyclictest12247-21apt21:10:012
1893299150,8cyclictest0-21swapper/219:28:112
18929991515,0cyclictest0-21swapper/019:33:110
18936991414,0cyclictest0-21swapper/319:45:153
1893699140,14cyclictest0-21swapper/320:52:013
1893699140,14cyclictest0-21swapper/320:22:253
1893699140,14cyclictest0-21swapper/320:11:103
1893699140,14cyclictest0-21swapper/320:06:323
1893699140,0cyclictest0-21swapper/320:36:173
1893699140,0cyclictest0-21swapper/319:32:313
18932991414,0cyclictest0-21swapper/219:33:112
1893299140,14cyclictest0-21swapper/220:57:332
1893299140,14cyclictest0-21swapper/220:25:172
1893299140,0cyclictest0-21swapper/220:40:352
1893299140,0cyclictest0-21swapper/220:15:242
1893099140,14cyclictest0-21swapper/121:03:021
1893099140,14cyclictest0-21swapper/119:26:191
1893099140,0cyclictest0-21swapper/119:35:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional