You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 06:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jun 12, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2834899260,25cyclictest32429-21basename20:25:010
28358992524,1cyclictest0-21swapper/323:06:423
28358992523,1cyclictest0-21swapper/321:59:303
2835899250,24cyclictest0-21swapper/322:06:273
2834999252,22cyclictest21667-21diskmemload00:08:211
2834999252,22cyclictest21667-21diskmemload00:08:211
2834999250,24cyclictest21703-21awk21:10:011
2834999250,24cyclictest0-21swapper/122:49:301
2834999250,24cyclictest0-21swapper/119:19:281
28348992523,1cyclictest0-21swapper/022:45:230
2834899250,24cyclictest26942-21turbostat21:15:010
2834899250,24cyclictest26347-21ssh23:15:090
2834899250,24cyclictest10848-21ssh23:31:170
2834899250,24cyclictest0-21swapper/019:19:280
28358992423,0cyclictest0-21swapper/321:49:293
28358992422,1cyclictest13225-21apt-get23:04:293
28358992422,1cyclictest0-21swapper/323:57:113
28358992422,1cyclictest0-21swapper/321:34:293
28358992421,2cyclictest783-21snmpd22:16:203
2835899240,2cyclictest627-21sh00:23:153
2835899240,23cyclictest21667-21diskmemload22:33:043
2835899240,23cyclictest0-21swapper/323:36:483
2835899240,23cyclictest0-21swapper/322:35:173
2835899240,23cyclictest0-21swapper/322:12:533
2835899240,23cyclictest0-21swapper/321:38:523
2835899240,23cyclictest0-21swapper/321:19:003
2835899240,1cyclictest0-21swapper/323:43:443
2835899240,0cyclictest0-21swapper/322:00:293
28353992423,1cyclictest0-21swapper/223:35:192
28353992421,2cyclictest0-21swapper/221:25:092
2835399240,23cyclictest21667-21diskmemload21:13:202
2835399240,23cyclictest0-21swapper/221:47:272
2835399240,23cyclictest0-21swapper/200:15:242
28349992423,1cyclictest12535-21ssh22:02:201
28349992422,1cyclictest1063-21sh21:51:121
2834999240,24cyclictest0-21swapper/100:32:371
2834999240,23cyclictest4211-21sed23:55:011
2834999240,23cyclictest28067-21rm21:45:561
2834999240,23cyclictest26150-21ssh23:45:071
2834999240,23cyclictest11318-21sh23:31:571
2834999240,23cyclictest0-21swapper/121:20:011
2834999240,1cyclictest29055-21ssh22:18:031
2834999240,1cyclictest21652-21ssh23:41:211
2834999240,0cyclictest21667-21diskmemload23:56:371
2834999240,0cyclictest0-21swapper/122:33:171
2834999240,0cyclictest0-21swapper/122:13:111
2834899243,21cyclictest62550irq/127-eno123:58:350
2834899240,24cyclictest30684-21perf00:20:010
2834899240,24cyclictest0-21swapper/022:09:110
2834899240,23cyclictest5503-21ssh22:25:150
2834899240,23cyclictest10753-21sendmail-msp22:00:010
28358992323,0cyclictest0-21swapper/321:50:063
28358992323,0cyclictest0-21swapper/321:12:373
28358992321,1cyclictest21845-21sh23:11:223
28358992321,1cyclictest0-21swapper/323:25:123
28358992321,1cyclictest0-21swapper/322:56:223
28358992321,1cyclictest0-21swapper/300:29:293
2835899231,1cyclictest11168-21sh00:02:173
2835899230,23cyclictest0-21swapper/323:54:333
2835899230,23cyclictest0-21swapper/323:24:013
2835899230,22cyclictest585-21apt-get20:29:293
2835899230,22cyclictest5646-21rm22:25:273
2835899230,22cyclictest0-21swapper/323:18:583
2835899230,22cyclictest0-21swapper/322:52:093
2835899230,22cyclictest0-21swapper/300:15:323
2835899230,22cyclictest0-21swapper/300:12:163
2835899230,0cyclictest0-21swapper/323:49:313
28353992323,0cyclictest21667-21diskmemload21:51:582
28353992323,0cyclictest0-21swapper/223:58:442
28353992323,0cyclictest0-21swapper/223:20:022
28353992323,0cyclictest0-21swapper/222:47:482
28353992323,0cyclictest0-21swapper/221:41:022
28353992323,0cyclictest0-21swapper/221:31:392
28353992323,0cyclictest0-21swapper/200:24:102
28353992323,0cyclictest0-21swapper/200:01:542
28353992321,1cyclictest0-21swapper/223:09:302
28353992321,1cyclictest0-21swapper/222:35:492
28353992321,1cyclictest0-21swapper/222:29:102
28353992320,2cyclictest22020-21ssh23:41:522
2835399230,23cyclictest0-21swapper/222:24:382
2835399230,22cyclictest6133-21apt-get19:34:282
2835399230,22cyclictest19282-21latency_hist21:05:012
2835399230,0cyclictest21667-21diskmemload22:51:032
2835399230,0cyclictest21667-21diskmemload00:12:552
2835399230,0cyclictest0-21swapper/223:54:332
2835399230,0cyclictest0-21swapper/223:47:072
2835399230,0cyclictest0-21swapper/222:42:082
2835399230,0cyclictest0-21swapper/222:06:082
2835399230,0cyclictest0-21swapper/222:02:202
2835399230,0cyclictest0-21swapper/200:05:172
2835399230,0cyclictest0-21swapper/200:05:172
28349992323,0cyclictest0-21swapper/121:41:501
28349992323,0cyclictest0-21swapper/121:25:291
28349992322,1cyclictest1657-21ssh22:22:301
28349992321,1cyclictest701-21ssh22:51:471
28349992321,1cyclictest0-21swapper/121:16:101
28349992321,1cyclictest0-21swapper/121:05:011
2834999230,2cyclictest26903-21sh21:14:591
2834999230,23cyclictest21667-21diskmemload22:05:161
2834999230,23cyclictest0-21swapper/121:37:361
2834999230,23cyclictest0-21swapper/100:15:441
2834999230,22cyclictest21667-21diskmemload22:40:181
2834999230,22cyclictest20262-21ssh00:10:031
2834999230,22cyclictest18249-21apt-get19:55:021
2834999230,22cyclictest14661-21ssh00:05:001
28348992323,0cyclictest0-21swapper/023:01:310
28348992323,0cyclictest0-21swapper/022:52:130
28348992323,0cyclictest0-21swapper/022:14:080
28348992323,0cyclictest0-21swapper/000:35:430
28348992323,0cyclictest0-21swapper/000:08:580
28348992323,0cyclictest0-21swapper/000:08:580
28348992322,1cyclictest62550irq/127-eno121:40:460
28348992321,1cyclictest0-21swapper/023:44:230
28348992320,2cyclictest6686-21rm23:28:320
2834899231,22cyclictest62550irq/127-eno100:03:560
2834899231,1cyclictest62550irq/127-eno123:05:480
2834899230,2cyclictest17036-21ssh22:36:340
2834899230,23cyclictest0-21swapper/023:11:490
2834899230,23cyclictest0-21swapper/022:57:150
2834899230,23cyclictest0-21swapper/021:32:310
2834899230,22cyclictest18321-21rm21:37:180
2834899230,22cyclictest16150-21ssh23:36:080
2834899230,22cyclictest0-21swapper/022:30:070
2834899230,21cyclictest31134-21ssh00:20:180
2834899230,1cyclictest21667-21diskmemload00:28:350
2834899230,1cyclictest0-21swapper/020:09:280
2834899230,0cyclictest0-21swapper/023:48:320
28358992222,0cyclictest0-21swapper/321:20:553
28358992222,0cyclictest0-21swapper/300:31:323
28358992220,1cyclictest6595-21ssh21:25:433
2835899220,21cyclictest16878-21turbostat.cron21:00:013
2835899220,21cyclictest0-21swapper/322:45:033
2835899220,21cyclictest0-21swapper/322:24:403
2835899220,21cyclictest0-21swapper/321:40:283
2835899220,21cyclictest0-21swapper/320:24:273
2835899220,21cyclictest0-21swapper/319:39:283
2835899220,21cyclictest0-21swapper/319:34:293
2835899220,21cyclictest0-21swapper/300:05:123
2835899220,21cyclictest0-21swapper/300:05:123
2835899220,1cyclictest606-21dbus-daemon19:15:003
28353992222,0cyclictest21667-21diskmemload23:00:202
28353992222,0cyclictest0-21swapper/223:32:212
28353992222,0cyclictest0-21swapper/221:20:032
28353992220,1cyclictest704-21perf19:20:012
28353992220,1cyclictest3731-21apt-get19:29:282
28353992220,1cyclictest0-21swapper/200:25:192
2835399220,22cyclictest0-21swapper/221:37:142
2835399220,21cyclictest14783-21rm00:35:232
2835399220,21cyclictest0-21swapper/223:25:432
2835399220,21cyclictest0-21swapper/222:55:062
2835399220,21cyclictest0-21swapper/222:15:102
2835399220,21cyclictest0-21swapper/221:56:412
2835399220,21cyclictest0-21swapper/219:45:002
2835399220,21cyclictest0-21swapper/219:39:282
2835399220,1cyclictest0-21swapper/223:17:142
2835399220,1cyclictest0-21swapper/223:11:062
2835399220,1cyclictest0-21swapper/222:30:042
2835399220,0cyclictest0-21swapper/222:10:132
2834999220,22cyclictest0-21swapper/122:27:041
2834999220,21cyclictest606-21dbus-daemon22:40:011
2834999220,21cyclictest21667-21diskmemload00:35:011
2834999220,21cyclictest0-21swapper/123:25:091
2834999220,21cyclictest0-21swapper/123:07:341
2834999220,1cyclictest14112-21ssh21:34:051
2834999220,1cyclictest0-21swapper/123:18:211
2834999220,1cyclictest0-21swapper/123:10:061
2834999220,1cyclictest0-21swapper/119:44:491
2834999220,0cyclictest21667-21diskmemload22:56:021
2834999220,0cyclictest0-21swapper/123:36:441
2834999220,0cyclictest0-21swapper/100:25:181
28348992222,0cyclictest0-21swapper/021:17:380
28348992220,1cyclictest606-21dbus-daemon20:30:000
28348992220,1cyclictest31664-21ssh23:20:150
28348992220,1cyclictest21667-21diskmemload22:40:380
28348992220,1cyclictest0-21swapper/021:25:050
2834899220,22cyclictest3298-21ssh21:24:190
2834899220,22cyclictest0-21swapper/022:20:160
2834899220,21cyclictest3991-21turbostat23:55:000
2834899220,21cyclictest21667-21diskmemload22:15:040
2834899220,21cyclictest21667-21diskmemload00:12:170
2834899220,21cyclictest0-21swapper/021:50:230
2834899220,1cyclictest29020-21ssh21:47:220
2834899220,1cyclictest13385-21apt-get19:49:270
2834899220,1cyclictest11642-21ssh00:33:380
28358992121,0cyclictest0-21swapper/322:40:283
28358992121,0cyclictest0-21swapper/320:54:283
28358992121,0cyclictest0-21swapper/300:36:293
28358992120,1cyclictest0-21swapper/321:09:293
28358992119,1cyclictest1325-21apt-get19:24:273
2835899210,20cyclictest0-21swapper/323:30:373
28353992121,0cyclictest23433-21apt-get20:09:282
28353992119,1cyclictest7249-21perf20:40:002
2835399210,0cyclictest0-21swapper/200:30:332
28349992121,0cyclictest0-21swapper/123:20:021
28349992121,0cyclictest0-21swapper/119:29:281
28349992120,1cyclictest8526-21apt-get19:39:281
28349992120,1cyclictest17641-21perf19:55:001
28349992119,1cyclictest3132-21apt19:25:011
2834999210,21cyclictest30928-21ssh00:20:011
2834999210,0cyclictest0-21swapper/120:14:281
28348992121,0cyclictest0-21swapper/020:14:290
28348992119,1cyclictest0-21swapper/022:00:070
2834899210,1cyclictest28935-21apt-get19:14:280
28358992020,0cyclictest0-21swapper/320:09:283
28358992020,0cyclictest0-21swapper/319:29:283
28353992020,0cyclictest30646-21apt-get20:24:272
28353992020,0cyclictest17637-21apt-get19:55:022
28353992020,0cyclictest0-21swapper/219:49:272
28353992020,0cyclictest0-21swapper/219:24:272
28353992018,1cyclictest0-21swapper/219:14:302
2835399200,0cyclictest0-21swapper/220:04:292
28349992020,0cyclictest0-21swapper/120:04:291
28349992020,0cyclictest0-21swapper/119:34:281
28349992018,1cyclictest30729-21perf19:15:011
2834999200,0cyclictest0-21swapper/120:24:271
28348992020,0cyclictest0-21swapper/020:59:280
28348992020,0cyclictest0-21swapper/020:19:280
28348992020,0cyclictest0-21swapper/019:54:280
28348992018,1cyclictest7940-21perf19:35:010
28348992018,1cyclictest0-21swapper/020:05:010
28358991919,0cyclictest0-21swapper/320:39:283
28358991919,0cyclictest0-21swapper/319:44:293
28358991917,1cyclictest17626-21latency_hist19:55:003
28353991919,0cyclictest0-21swapper/221:09:292
28353991919,0cyclictest0-21swapper/220:44:282
28353991919,0cyclictest0-21swapper/219:54:282
28353991917,1cyclictest28224-21apt-get20:19:282
28349991919,0cyclictest0-21swapper/120:09:281
28349991917,1cyclictest0-21swapper/120:40:001
28348991919,0cyclictest0-21swapper/020:49:280
28358991818,0cyclictest0-21swapper/320:44:283
28358991818,0cyclictest0-21swapper/319:55:023
28358991816,1cyclictest30023-21grep20:20:013
28353991816,2cyclictest1272-21sort20:29:312
28349991818,0cyclictest0-21swapper/119:49:271
28348991818,0cyclictest0-21swapper/019:55:020
28348991818,0cyclictest0-21swapper/019:29:280
28348991816,1cyclictest19286-21latency_hist21:05:010
28358991717,0cyclictest0-21swapper/320:34:283
28358991716,0cyclictest0-21swapper/321:04:273
28353991716,0cyclictest0-21swapper/220:59:282
28353991715,1cyclictest3029-21apt-get20:34:282
28349991717,0cyclictest7843-21apt-get20:44:281
28348991717,0cyclictest0-21swapper/020:54:280
28348991717,0cyclictest0-21swapper/019:44:290
28358991616,0cyclictest0-21swapper/320:04:293
28353991616,0cyclictest0-21swapper/220:54:282
28349991616,0cyclictest585-21apt-get20:29:281
28348991616,0cyclictest0-21swapper/021:09:290
28348991616,0cyclictest0-21swapper/019:24:270
28358991514,0cyclictest0-21swapper/320:49:283
28353991515,0cyclictest0-21swapper/220:49:282
28349991514,0cyclictest15029-21apt-get20:59:281
28348991513,1cyclictest7244-21munin-run20:40:000
28358991414,0cyclictest0-21swapper/319:45:323
2835899140,0cyclictest0-21swapper/320:11:583
28353991414,0cyclictest0-21swapper/220:11:272
28349991414,0cyclictest0-21swapper/120:30:101
2834999140,14cyclictest0-21swapper/120:45:021
2834999140,0cyclictest0-21swapper/120:50:121
2834899140,14cyclictest0-21swapper/020:40:110
2834899140,14cyclictest0-21swapper/020:30:280
2834899140,14cyclictest0-21swapper/019:35:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional