You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 08:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Tue Mar 31, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
576999274,22cyclictest62550irq/127-eno121:22:570
5772992624,1cyclictest0-21swapper/121:56:551
577999250,24cyclictest31428-21diskmemload23:47:523
577699250,1cyclictest31428-21diskmemload23:23:292
577299250,24cyclictest0-21swapper/123:33:291
577299250,24cyclictest0-21swapper/122:57:361
577299250,24cyclictest0-21swapper/100:05:261
577299250,24cyclictest0-21swapper/100:01:171
5769992524,1cyclictest62550irq/127-eno123:30:130
5769992523,1cyclictest24915-21cron19:50:000
5769992523,1cyclictest0-21swapper/022:04:550
5769992523,1cyclictest0-21swapper/021:30:020
576999250,24cyclictest31428-21diskmemload23:15:560
576999250,24cyclictest0-21swapper/021:53:230
576999250,24cyclictest0-21swapper/000:07:510
576999250,1cyclictest0-21swapper/023:07:480
576999250,1cyclictest0-21swapper/022:58:230
5779992421,2cyclictest5688-21awk00:25:013
577999240,0cyclictest0-21swapper/323:03:243
5776992422,1cyclictest31428-21diskmemload23:38:222
5776992422,1cyclictest29343-21ssh00:17:052
577699240,24cyclictest1740-21ssh22:16:362
577699240,23cyclictest0-21swapper/223:14:122
577699240,1cyclictest0-21swapper/222:06:222
577699240,1cyclictest0-21swapper/200:08:582
577299240,23cyclictest0-21swapper/123:57:241
577299240,0cyclictest0-21swapper/121:39:561
5769992422,1cyclictest0-21swapper/000:23:240
5769992421,2cyclictest16103-21nvmesmart_nvme000:03:290
576999241,0cyclictest62550irq/127-eno123:54:040
576999240,23cyclictest31428-21diskmemload21:40:090
576999240,23cyclictest0-21swapper/022:30:290
576999240,1cyclictest0-21swapper/022:18:260
5779992323,0cyclictest31428-21diskmemload22:39:163
5779992323,0cyclictest31428-21diskmemload00:26:473
5779992323,0cyclictest0-21swapper/323:35:003
5779992323,0cyclictest0-21swapper/323:28:093
5779992323,0cyclictest0-21swapper/322:46:553
5779992323,0cyclictest0-21swapper/321:26:583
5779992323,0cyclictest0-21swapper/300:12:203
5779992323,0cyclictest0-21swapper/300:00:043
5779992322,1cyclictest31428-21diskmemload21:20:473
5779992321,1cyclictest6241-21sh21:18:083
5779992321,1cyclictest24949-21ls19:50:003
5779992321,1cyclictest0-21swapper/322:11:583
5779992320,2cyclictest462-21latency_hist00:20:013
5779992320,2cyclictest3491-21latency_hist23:20:013
577999230,2cyclictest2361-21ssh22:17:413
577999230,23cyclictest31428-21diskmemload21:48:313
577999230,23cyclictest0-21swapper/323:35:393
577999230,23cyclictest0-21swapper/321:42:133
577999230,22cyclictest9899-21ssh22:23:433
577999230,22cyclictest4107-21ssh23:20:583
577999230,22cyclictest32668-21rm21:11:363
577999230,22cyclictest31428-21diskmemload23:40:493
577999230,22cyclictest23013-21ssh22:05:073
577999230,22cyclictest21425-21sh23:06:253
577999230,22cyclictest12077-21ssh22:26:083
577999230,22cyclictest10527-21ssh22:55:193
577999230,22cyclictest0-21swapper/322:50:033
577999230,0cyclictest31428-21diskmemload00:35:563
577999230,0cyclictest0-21swapper/323:53:093
577999230,0cyclictest0-21swapper/322:44:143
5776992323,0cyclictest0-21swapper/223:29:222
5776992323,0cyclictest0-21swapper/222:37:572
5776992323,0cyclictest0-21swapper/219:53:212
5776992322,1cyclictest32676-21ssh23:48:312
5776992321,2cyclictest16733-21ssh22:30:312
5776992321,1cyclictest606-21dbus-daemon20:35:002
5776992321,1cyclictest30789-21sh23:15:012
5776992321,1cyclictest20299-21ssh00:39:062
5776992320,3cyclictest0-21swapper/223:55:562
5776992320,2cyclictest607-21in:imuxsock19:15:002
5776992320,2cyclictest10042-21ssh21:20:572
5776992318,4cyclictest0-21swapper/221:46:162
577699230,2cyclictest6146-21ssh00:25:222
577699230,2cyclictest5323-21sh00:24:322
577699230,23cyclictest0-21swapper/223:08:142
577699230,23cyclictest0-21swapper/222:22:342
577699230,23cyclictest0-21swapper/221:58:202
577699230,22cyclictest27991-21sh23:43:382
577699230,22cyclictest12280-21ssh21:54:432
577699230,22cyclictest10791-21rm22:55:422
577699230,1cyclictest0-21swapper/222:12:482
577699230,0cyclictest31428-21diskmemload22:48:472
577699230,0cyclictest31428-21diskmemload21:35:282
577699230,0cyclictest0-21swapper/221:26:152
577699230,0cyclictest0-21swapper/221:18:352
5772992323,0cyclictest0-21swapper/122:22:461
5772992323,0cyclictest0-21swapper/121:41:161
5772992321,1cyclictest606-21dbus-daemon20:40:001
5772992321,1cyclictest30086-21sh23:45:541
5772992321,1cyclictest25620-21munin-plugin-st23:10:001
5772992321,1cyclictest0-21swapper/123:53:051
5772992321,1cyclictest0-21swapper/123:43:261
5772992321,1cyclictest0-21swapper/122:26:311
5772992321,1cyclictest0-21swapper/122:17:551
5772992320,2cyclictest2618-21pmu-power21:13:301
577299230,22cyclictest6074-21ssh22:51:181
577299230,22cyclictest17935-21sh00:38:011
577299230,22cyclictest0-21swapper/123:35:541
577299230,22cyclictest0-21swapper/122:30:581
577299230,22cyclictest0-21swapper/122:11:121
577299230,1cyclictest9205-21basename21:20:011
577299230,1cyclictest0-21swapper/121:52:421
577299230,0cyclictest0-21swapper/123:25:201
577299230,0cyclictest0-21swapper/123:11:301
577299230,0cyclictest0-21swapper/122:45:081
577299230,0cyclictest0-21swapper/122:01:431
577299230,0cyclictest0-21swapper/121:25:351
577299230,0cyclictest0-21swapper/100:33:131
5769992323,0cyclictest31428-21diskmemload23:02:270
5769992323,0cyclictest0-21swapper/021:36:350
576999232,21cyclictest62550irq/127-eno100:15:080
5769992321,2cyclictest0-21swapper/021:45:190
5769992321,1cyclictest0-21swapper/021:28:070
5769992321,1cyclictest0-21swapper/000:36:280
5769992320,2cyclictest24311-21sh23:40:380
576999230,23cyclictest0-21swapper/021:14:010
576999230,23cyclictest0-21swapper/000:12:430
576999230,22cyclictest10761-21ssh23:28:240
576999230,22cyclictest0-21swapper/022:10:250
576999230,22cyclictest0-21swapper/000:25:460
576999230,1cyclictest0-21swapper/023:39:510
576999230,0cyclictest0-21swapper/023:55:210
576999230,0cyclictest0-21swapper/022:37:110
576999230,0cyclictest0-21swapper/022:29:360
5779992222,0cyclictest0-21swapper/321:30:343
5779992222,0cyclictest0-21swapper/300:31:563
5779992220,1cyclictest2190-21perf20:10:013
5779992220,1cyclictest13894-21sh21:56:533
5779992219,2cyclictest17935-21ssh22:00:123
577999220,2cyclictest17076-21ssh22:31:023
577999220,22cyclictest0-21swapper/323:12:163
577999220,21cyclictest8377-21ssh23:56:453
577999220,21cyclictest31428-21diskmemload21:50:263
5776992222,0cyclictest31428-21diskmemload22:52:222
5776992220,1cyclictest0-21swapper/200:32:292
5776992219,2cyclictest12955-21munin-run19:25:012
577699220,2cyclictest27623-21sh22:40:132
577699220,22cyclictest0-21swapper/223:32:522
577699220,22cyclictest0-21swapper/221:11:162
577699220,21cyclictest19916-21apt-get20:48:222
577699220,21cyclictest15854-21apt-get19:33:222
577699220,21cyclictest15664-21ssh23:00:222
577699220,21cyclictest11406-21ssh22:25:082
577699220,21cyclictest0-21swapper/222:00:112
577699220,1cyclictest23810-21sh00:11:192
577699220,1cyclictest0-21swapper/200:03:242
5772992222,0cyclictest0-21swapper/123:21:391
5772992222,0cyclictest0-21swapper/123:16:111
5772992222,0cyclictest0-21swapper/121:31:021
577299220,22cyclictest28482-21ssh00:15:351
577299220,22cyclictest0-21swapper/100:21:181
577299220,21cyclictest22693-21sh22:36:171
577299220,21cyclictest0-21swapper/121:20:121
577299220,21cyclictest0-21swapper/121:08:231
577299220,21cyclictest0-21swapper/120:58:241
577299220,1cyclictest23716-21sh22:06:191
577299220,1cyclictest10555-21turbostat19:20:011
577299220,1cyclictest0-21swapper/122:40:031
577299220,1cyclictest0-21swapper/121:45:521
577299220,1cyclictest0-21swapper/100:27:431
577299220,0cyclictest0-21swapper/100:11:121
5769992222,0cyclictest0-21swapper/021:16:020
5769992221,0cyclictest0-21swapper/022:05:070
576999220,2cyclictest4026-21sh23:20:510
576999220,21cyclictest29496-21ssh23:45:020
576999220,21cyclictest0-21swapper/020:48:220
576999220,21cyclictest0-21swapper/020:33:230
576999220,21cyclictest0-21swapper/000:31:480
576999220,1cyclictest31428-21diskmemload22:20:160
576999220,1cyclictest28215-21ssh22:41:050
576999220,1cyclictest1274-21ssh22:46:450
576999220,1cyclictest0-21swapper/023:11:450
5779992121,0cyclictest27906-21apt-get19:58:223
5779992121,0cyclictest0-21swapper/320:53:223
5779992121,0cyclictest0-21swapper/319:38:233
5779992120,1cyclictest6250-21apt-get19:13:223
5779992119,1cyclictest14592-21latency_hist20:35:003
577999210,21cyclictest0-21swapper/300:05:223
577999210,20cyclictest0-21swapper/320:03:223
577999210,0cyclictest31428-21diskmemload21:35:083
5776992121,0cyclictest31428-21diskmemload21:40:072
5776992119,1cyclictest6962-21cron20:20:012
577699210,21cyclictest31428-21diskmemload21:31:192
577699210,1cyclictest622-21gdbus20:45:002
577699210,0cyclictest0-21swapper/223:51:332
5772992120,1cyclictest0-21swapper/119:28:221
577299210,20cyclictest0-21swapper/120:23:221
577299210,1cyclictest0-21swapper/119:50:001
5769992120,1cyclictest0-21swapper/021:08:230
5769992120,0cyclictest0-21swapper/020:53:220
576999210,20cyclictest0-21swapper/020:13:220
576999210,0cyclictest0-21swapper/021:55:410
576999210,0cyclictest0-21swapper/019:43:210
577999200,1cyclictest0-21swapper/319:45:003
577999200,0cyclictest11064-21apt-get19:23:223
577999200,0cyclictest0-21swapper/321:03:233
577999200,0cyclictest0-21swapper/319:28:223
5776992020,0cyclictest0-21swapper/220:03:222
5776992020,0cyclictest0-21swapper/219:58:222
5772992020,0cyclictest0-21swapper/120:18:231
5772992018,1cyclictest21808-21munin-plugin-st20:50:001
577299200,0cyclictest0-21swapper/120:13:221
5769992020,0cyclictest0-21swapper/020:38:210
5769992020,0cyclictest0-21swapper/020:08:220
5769992018,1cyclictest32178-21cron20:05:000
5769992018,1cyclictest19390-21cron20:45:000
5779991919,0cyclictest2698-21apt-get20:13:223
5779991919,0cyclictest0-21swapper/319:33:223
5779991918,1cyclictest19408-21awk20:45:003
5779991918,0cyclictest8646-21apt-get19:18:223
5779991917,1cyclictest31455-21perf21:10:013
5776991919,0cyclictest0-21swapper/219:18:222
5772991919,0cyclictest0-21swapper/119:43:211
5769991917,1cyclictest0-21swapper/019:28:220
577999180,17cyclictest0-21swapper/320:38:213
5776991818,0cyclictest7521-21apt-get20:23:222
5776991818,0cyclictest27175-21apt-get21:03:232
5776991818,0cyclictest18253-21apt-get19:38:232
5772991816,1cyclictest12933-21cron19:25:011
5772991816,1cyclictest0-21swapper/119:40:011
5769991818,0cyclictest0-21swapper/020:18:240
5769991818,0cyclictest0-21swapper/019:33:220
5769991818,0cyclictest0-21swapper/019:15:000
5769991816,1cyclictest0-21swapper/020:00:000
5776991717,0cyclictest0-21swapper/220:13:222
5776991715,1cyclictest22311-21apt-get20:53:222
5769991715,1cyclictest26622-21basename21:00:010
5776991616,0cyclictest0-21swapper/220:28:232
5769991616,0cyclictest18253-21apt-get19:38:220
5769991616,0cyclictest0-21swapper/020:28:230
5776991515,0cyclictest29569-21apt-get21:08:232
577699150,6cyclictest0-21swapper/219:45:002
577699150,14cyclictest15103-21apt-get20:38:222
577299155,10cyclictest605-21avahi-daemon20:53:141
5772991515,0cyclictest30322-21apt-get20:03:221
577299150,14cyclictest0-21swapper/119:11:341
5779991414,0cyclictest0-21swapper/320:45:203
577999140,14cyclictest0-21swapper/320:20:273
577999140,14cyclictest0-21swapper/320:15:513
577999140,14cyclictest0-21swapper/319:50:583
577999140,0cyclictest0-21swapper/320:55:173
577999140,0cyclictest0-21swapper/320:25:043
577699140,14cyclictest0-21swapper/220:08:112
577699140,14cyclictest0-21swapper/219:45:242
577699140,14cyclictest0-21swapper/219:25:522
577699140,0cyclictest0-21swapper/220:55:162
5772991414,0cyclictest0-21swapper/120:25:051
5772991414,0cyclictest0-21swapper/119:55:181
5772991414,0cyclictest0-21swapper/119:50:221
577299140,14cyclictest0-21swapper/120:40:101
577299140,14cyclictest0-21swapper/120:06:201
577299140,0cyclictest0-21swapper/121:00:521
5769991414,0cyclictest0-21swapper/021:00:520
5769991414,0cyclictest0-21swapper/020:20:110
5769991414,0cyclictest0-21swapper/019:15:500
576999140,14cyclictest0-21swapper/019:50:560
576999140,14cyclictest0-21swapper/019:20:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional