You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-15 - 08:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Fri May 15, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2038992623,2cyclictest31366-21interrupts23:07:163
203899250,24cyclictest0-21swapper/323:18:343
2034992523,1cyclictest0-21swapper/221:55:102
203499250,24cyclictest32043-21ssh00:05:342
203499250,24cyclictest28052-21diskmemload22:33:022
203499250,24cyclictest28052-21diskmemload00:01:592
203499250,1cyclictest0-21swapper/221:13:152
203499250,1cyclictest0-21swapper/220:42:092
203399250,24cyclictest22271-21ssh21:32:211
203399250,24cyclictest0-21swapper/123:21:411
203399250,24cyclictest0-21swapper/100:28:311
2032992523,1cyclictest0-21swapper/021:57:090
203299250,24cyclictest0-21swapper/022:46:200
203899240,24cyclictest28052-21diskmemload22:20:533
203899240,23cyclictest28052-21diskmemload23:34:033
203899240,23cyclictest18473-21basename20:50:013
203899240,23cyclictest0-21swapper/321:45:133
203899240,23cyclictest0-21swapper/300:34:563
203899240,23cyclictest0-21swapper/300:12:363
203899240,1cyclictest30850-21ssh21:40:593
2034992422,1cyclictest0-21swapper/222:13:172
2034992422,1cyclictest0-21swapper/222:13:172
203499240,23cyclictest0-21swapper/221:43:192
203399240,23cyclictest6277-21sh23:42:151
203399240,23cyclictest5720-21sh21:18:201
203399240,23cyclictest28052-21diskmemload22:58:051
203399240,23cyclictest28052-21diskmemload21:52:411
203399240,23cyclictest0-21swapper/122:51:331
203399240,23cyclictest0-21swapper/121:43:371
203399240,23cyclictest0-21swapper/100:30:321
203399240,1cyclictest28052-21diskmemload21:26:071
203399240,0cyclictest0-21swapper/123:52:141
2032992424,0cyclictest28052-21diskmemload21:37:140
2032992423,1cyclictest28052-21diskmemload23:31:460
203299242,0cyclictest0-21swapper/022:23:530
203299240,24cyclictest0-21swapper/000:03:120
203299240,23cyclictest6598-21rm21:19:330
203299240,23cyclictest32522-21sh22:39:470
203299240,23cyclictest28092-21idleruntime-cro21:10:000
203299240,1cyclictest20281-21ssh21:32:020
203299240,1cyclictest0-21swapper/000:30:000
203299240,0cyclictest0-21swapper/000:23:370
203299240,0cyclictest0-21swapper/000:18:260
2038992323,0cyclictest28052-21diskmemload22:01:113
2038992323,0cyclictest14104-21apt-get20:42:083
2038992323,0cyclictest0-21swapper/323:01:353
2038992323,0cyclictest0-21swapper/300:20:393
2038992322,1cyclictest28052-21diskmemload22:05:203
2038992321,1cyclictest0-21swapper/322:58:003
2038992321,1cyclictest0-21swapper/322:41:383
2038992321,1cyclictest0-21swapper/322:17:493
2038992321,1cyclictest0-21swapper/300:25:333
203899230,23cyclictest0-21swapper/323:57:333
203899230,23cyclictest0-21swapper/323:38:033
203899230,23cyclictest0-21swapper/322:46:033
203899230,23cyclictest0-21swapper/322:37:123
203899230,23cyclictest0-21swapper/322:11:213
203899230,23cyclictest0-21swapper/322:11:213
203899230,23cyclictest0-21swapper/321:55:013
203899230,23cyclictest0-21swapper/300:06:093
203899230,22cyclictest6478-21perf20:25:003
203899230,22cyclictest29993-21ssh00:02:593
203899230,22cyclictest22687-21ssh22:31:343
203899230,22cyclictest21288-21apt-get20:57:093
203899230,22cyclictest14842-21ssh23:21:593
203899230,1cyclictest0-21swapper/321:20:043
203899230,0cyclictest28052-21diskmemload22:28:263
203899230,0cyclictest28052-21diskmemload21:39:373
203899230,0cyclictest0-21swapper/322:54:403
203899230,0cyclictest0-21swapper/321:12:483
2034992323,0cyclictest28052-21diskmemload22:45:192
2034992323,0cyclictest0-21swapper/223:43:492
2034992323,0cyclictest0-21swapper/200:35:352
2034992321,1cyclictest0-21swapper/223:16:152
2034992321,1cyclictest0-21swapper/223:12:342
2034992321,1cyclictest0-21swapper/222:57:292
2034992321,1cyclictest0-21swapper/221:48:062
2034992320,2cyclictest11162-21sh22:21:112
203499231,21cyclictest15630-21ssh23:51:112
203499230,2cyclictest10713-21ssh23:47:102
203499230,23cyclictest0-21swapper/200:26:512
203499230,22cyclictest28052-21diskmemload00:17:002
203499230,22cyclictest21351-21latency_hist22:30:012
203499230,22cyclictest0-21swapper/223:56:092
203499230,22cyclictest0-21swapper/223:20:132
203499230,22cyclictest0-21swapper/221:27:102
203499230,1cyclictest0-21swapper/221:30:332
203499230,0cyclictest0-21swapper/222:51:242
203499230,0cyclictest0-21swapper/221:20:382
2033992323,0cyclictest0-21swapper/123:57:051
2033992323,0cyclictest0-21swapper/123:05:321
2033992323,0cyclictest0-21swapper/122:14:151
2033992323,0cyclictest0-21swapper/122:14:151
2033992323,0cyclictest0-21swapper/122:05:041
2033992323,0cyclictest0-21swapper/121:55:251
2033992323,0cyclictest0-21swapper/121:10:291
2033992323,0cyclictest0-21swapper/100:00:341
2033992321,1cyclictest619-21polkitd21:10:001
2033992321,1cyclictest4833-21apt-get19:17:071
2033992320,2cyclictest11280-21ssh23:17:321
203399230,23cyclictest0-21swapper/123:38:551
203399230,22cyclictest7125-21ssh22:45:531
203399230,22cyclictest5666-21ssh00:11:051
203399230,22cyclictest4554-21sh22:42:401
203399230,22cyclictest15042-21ssh22:24:051
203399230,22cyclictest10312-21apt-get00:15:021
203399230,1cyclictest0-21swapper/121:47:401
203399230,0cyclictest0-21swapper/123:48:281
2032992323,0cyclictest28052-21diskmemload00:37:060
2032992323,0cyclictest0-21swapper/022:15:200
2032992322,1cyclictest14463-21cron23:50:010
2032992321,1cyclictest21562-21rm22:01:570
2032992320,2cyclictest6747-21/usr/sbin/munin21:47:200
203299230,2cyclictest25824-21ssh22:33:290
203299230,23cyclictest0-21swapper/022:56:430
203299230,22cyclictest4434-21ssh22:42:300
203299230,22cyclictest31351-21dump-pmu-power22:10:010
203299230,22cyclictest13676-21perf20:40:010
203299230,1cyclictest32675-21ssh21:13:320
203299230,0cyclictest28052-21diskmemload23:35:040
203299230,0cyclictest28052-21diskmemload21:40:050
203299230,0cyclictest28052-21diskmemload00:13:050
203299230,0cyclictest16404-21ssh22:25:360
203299230,0cyclictest0-21swapper/023:57:380
203299230,0cyclictest0-21swapper/021:22:480
2038992222,0cyclictest28052-21diskmemload23:50:253
2038992222,0cyclictest0-21swapper/300:38:123
2038992222,0cyclictest0-21swapper/300:17:533
2038992221,1cyclictest0-21swapper/323:26:023
2038992220,1cyclictest18823-21ssh21:30:053
2038992220,1cyclictest0-21swapper/321:25:093
203899220,22cyclictest28052-21diskmemload21:18:063
203899220,22cyclictest0-21swapper/323:40:373
203899220,21cyclictest9366-21sh21:50:333
203899220,21cyclictest9287-21ssh23:45:133
203899220,21cyclictest2183-21sh23:10:093
203899220,21cyclictest0-21swapper/320:12:083
203899220,21cyclictest0-21swapper/319:27:083
203899220,1cyclictest24829-21apt-get19:57:083
2034992222,0cyclictest28052-21diskmemload00:31:092
2034992220,1cyclictest23283-21munin-run21:00:002
2034992220,1cyclictest13662-21sendmail20:40:012
2034992220,1cyclictest0-21swapper/200:20:042
203499220,22cyclictest0-21swapper/223:09:092
203499220,22cyclictest0-21swapper/222:35:462
203499220,21cyclictest28052-21diskmemload22:00:242
203499220,21cyclictest0-21swapper/222:40:152
203499220,21cyclictest0-21swapper/222:15:042
203499220,21cyclictest0-21swapper/221:50:122
203499220,21cyclictest0-21swapper/200:11:252
203499220,1cyclictest7645-21apt-get19:22:072
203499220,1cyclictest3042-21sh21:17:002
203499220,1cyclictest246742sleep221:35:252
203499220,1cyclictest22029-21munin-run19:50:012
203499220,1cyclictest0-21swapper/222:05:212
203499220,0cyclictest28052-21diskmemload23:25:162
2033992222,0cyclictest28052-21diskmemload23:10:321
2033992222,0cyclictest0-21swapper/123:00:191
2033992221,0cyclictest22434-21apt-get19:52:091
2033992220,1cyclictest4058-21latency_hist20:20:001
2033992220,1cyclictest28052-21diskmemload21:20:011
2033992220,1cyclictest17181-21cron19:40:001
2033992220,1cyclictest0-21swapper/100:20:481
203399220,21cyclictest23704-21apt-get21:02:081
203399220,21cyclictest0-21swapper/123:31:241
203399220,21cyclictest0-21swapper/123:26:261
203399220,21cyclictest0-21swapper/122:15:171
203399220,21cyclictest0-21swapper/122:00:321
203399220,21cyclictest0-21swapper/121:35:341
203399220,21cyclictest0-21swapper/119:25:001
203399220,1cyclictest5947-21ssh00:39:281
203399220,1cyclictest0-21swapper/100:05:571
203399220,0cyclictest0-21swapper/119:12:081
2032992222,0cyclictest62550irq/127-eno123:00:110
2032992220,1cyclictest32318-21sh22:11:060
2032992220,1cyclictest32318-21sh22:11:060
203299220,22cyclictest9249-21diskmemload21:50:230
203299220,22cyclictest3295-21ssh00:08:070
203299220,22cyclictest0-21swapper/023:10:510
203299220,22cyclictest0-21swapper/022:50:160
203299220,21cyclictest6490-21munin-run20:25:000
203299220,21cyclictest14093-21ssh23:21:020
203299220,21cyclictest0-21swapper/023:26:070
203299220,21cyclictest0-21swapper/019:57:080
203299220,21cyclictest0-21swapper/019:12:080
203299220,1cyclictest29047-21ssh23:05:130
203299220,1cyclictest28052-21diskmemload23:17:090
203299220,0cyclictest28052-21diskmemload23:50:480
203299220,0cyclictest14709-21ssh21:27:060
203299220,0cyclictest0-21swapper/000:30:230
2038992120,1cyclictest0-21swapper/319:17:083
2038992119,1cyclictest11271-21grep20:35:013
203899210,20cyclictest14425-21apt-get19:35:023
203899210,20cyclictest11686-21apt-get20:37:083
203899210,20cyclictest0-21swapper/320:17:073
2034992119,1cyclictest29271-21apt20:05:012
203499210,0cyclictest0-21swapper/220:52:092
203499210,0cyclictest0-21swapper/219:57:082
203499210,0cyclictest0-21swapper/219:52:092
2033992120,0cyclictest14104-21apt-get20:42:091
2032992121,0cyclictest0-21swapper/020:57:090
2032992119,1cyclictest24387-21cron19:55:010
203299210,21cyclictest7451-21apt-get19:20:030
203299210,0cyclictest0-21swapper/019:17:080
2038992020,0cyclictest0-21swapper/320:02:103
2038992020,0cyclictest0-21swapper/319:52:083
2034992020,0cyclictest0-21swapper/219:37:082
2034992020,0cyclictest0-21swapper/219:12:082
2033992020,0cyclictest0-21swapper/120:57:091
2033992020,0cyclictest0-21swapper/120:21:451
203399200,0cyclictest32088-21apt-get20:12:081
203399200,0cyclictest0-21swapper/120:52:081
203399200,0cyclictest0-21swapper/120:27:081
2032992020,0cyclictest0-21swapper/020:42:090
2032992020,0cyclictest0-21swapper/020:32:100
2032992020,0cyclictest0-21swapper/020:02:100
203299200,20cyclictest0-21swapper/020:52:090
203299200,0cyclictest0-21swapper/019:47:090
2038991918,1cyclictest20040-21apt-get19:47:093
2034991919,0cyclictest0-21swapper/220:12:082
2034991918,0cyclictest0-21swapper/219:27:082
203499190,2cyclictest31644-21cron20:10:002
2033991919,0cyclictest0-21swapper/120:47:081
2033991916,2cyclictest13688-21latency_hist20:40:011
2032991917,1cyclictest17240-21basename19:40:000
2038991818,0cyclictest17646-21apt-get19:42:093
2038991817,1cyclictest0-21swapper/321:02:083
2038991816,1cyclictest20859-21cron20:55:013
2034991818,0cyclictest2080-21apt-get20:17:072
2034991818,0cyclictest0-21swapper/220:47:082
2034991818,0cyclictest0-21swapper/219:17:072
2033991818,0cyclictest0-21swapper/120:32:101
2033991818,0cyclictest0-21swapper/119:42:091
2033991816,1cyclictest27248-21apt-get20:02:101
2032991818,0cyclictest0-21swapper/020:17:070
2032991818,0cyclictest0-21swapper/020:12:080
2032991818,0cyclictest0-21swapper/019:32:080
2038991717,0cyclictest0-21swapper/319:32:083
2038991716,0cyclictest0-21swapper/319:22:073
2034991715,1cyclictest606-21dbus-daemon21:10:002
203399170,2cyclictest27023-21latency_hist20:00:011
2038991616,0cyclictest0-21swapper/319:15:013
2033991616,0cyclictest0-21swapper/119:32:081
2032991616,0cyclictest16496-21apt-get20:47:080
2032991616,0cyclictest0-21swapper/021:02:080
2032991616,0cyclictest0-21swapper/019:42:090
2034991515,0cyclictest6893-21apt-get20:27:082
2033991515,0cyclictest0-21swapper/119:47:091
2032991515,0cyclictest0-21swapper/019:27:080
203299150,13cyclictest29691-21apt-get20:07:080
203899140,14cyclictest0-21swapper/321:05:113
203899140,14cyclictest0-21swapper/320:26:223
203899140,14cyclictest0-21swapper/320:05:593
203499140,14cyclictest0-21swapper/220:30:452
203499140,14cyclictest0-21swapper/220:20:042
203499140,14cyclictest0-21swapper/219:40:522
203499140,0cyclictest0-21swapper/219:31:212
203399140,14cyclictest0-21swapper/119:25:141
2032991414,0cyclictest0-21swapper/020:25:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional