You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 13:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Sat Aug 15, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16075992927,1cyclictest9367-21diskmemload21:19:453
1606499290,28cyclictest21009-21dpkg23:15:010
1606499280,23cyclictest24518-21ssh23:19:050
1606499280,1cyclictest606-21dbus-daemon22:10:000
1606499270,27cyclictest0-21swapper/021:59:190
1606499270,1cyclictest606-21dbus-daemon20:05:010
1606499270,1cyclictest0-21swapper/000:30:020
1606499270,0cyclictest0-21swapper/021:15:460
16069992621,4cyclictest29081-21kworker/u8:022:19:512
1606599260,24cyclictest313-21systemd-journal00:29:461
16064992621,5cyclictest19378-21ssh00:10:250
1606499260,25cyclictest62550irq/127-eno122:32:520
1606499260,21cyclictest9367-21diskmemload23:54:270
1606499260,21cyclictest22846-21ssh21:50:050
1606499260,21cyclictest0-21swapper/021:23:530
1606499260,1cyclictest0-21swapper/023:47:010
1606499260,1cyclictest0-21swapper/022:01:040
1606499260,1cyclictest0-21swapper/000:09:490
1606499260,0cyclictest0-21swapper/020:34:420
1607599250,24cyclictest9367-21diskmemload21:55:523
1607599250,24cyclictest9367-21diskmemload21:49:083
1606999250,24cyclictest30055-21ssh21:57:102
1606999250,24cyclictest13397-21ssh21:42:312
1606999250,24cyclictest0-21swapper/222:45:422
16065992523,1cyclictest16606-21cpu00:09:461
1606599250,24cyclictest9367-21diskmemload22:07:461
1606599250,24cyclictest15339-21ssh22:13:321
1606599250,24cyclictest12309-21ssh23:35:521
1606599250,24cyclictest0-21swapper/123:20:401
1606599250,24cyclictest0-21swapper/120:44:441
16064992522,3cyclictest0-21swapper/021:34:160
16064992522,3cyclictest0-21swapper/021:34:160
16064992521,4cyclictest0-21swapper/023:59:500
16064992520,4cyclictest0-21swapper/023:05:360
16064992518,6cyclictest23247-21latency_hist19:25:010
1606499250,24cyclictest9367-21diskmemload22:36:450
1606499250,24cyclictest9367-21diskmemload00:27:160
1606499250,24cyclictest9367-21diskmemload00:03:520
1606499250,24cyclictest0-21swapper/023:38:190
1606499250,24cyclictest0-21swapper/021:47:180
1606499250,24cyclictest0-21swapper/021:25:070
1606499250,0cyclictest25779-21ssh22:50:060
1606499250,0cyclictest25428-21ssh22:49:580
1606499250,0cyclictest0-21swapper/023:23:430
1606499250,0cyclictest0-21swapper/023:02:170
1607599240,23cyclictest9367-21diskmemload21:32:053
1607599240,23cyclictest9367-21diskmemload21:32:053
1607599240,23cyclictest0-21swapper/323:40:543
1607599240,23cyclictest0-21swapper/321:54:563
1607599240,23cyclictest0-21swapper/319:49:413
16069992423,1cyclictest0-21swapper/223:30:512
16069992420,3cyclictest15215-21apt-get23:39:462
16069992420,2cyclictest2194-21sh22:59:312
1606999241,2cyclictest0-21swapper/222:44:442
1606999240,0cyclictest9367-21diskmemload22:22:042
1606999240,0cyclictest0-21swapper/200:18:552
16065992424,0cyclictest9367-21diskmemload22:19:091
16065992422,1cyclictest9804-21ssh00:31:031
16065992422,1cyclictest32332-21sh22:28:421
1606599240,24cyclictest0-21swapper/122:51:471
1606599240,23cyclictest9367-21diskmemload21:59:251
1606599240,23cyclictest9367-21diskmemload21:41:281
1606599240,23cyclictest9367-21diskmemload21:20:221
1606599240,23cyclictest22666-21ssh22:48:341
1606599240,23cyclictest19514-21ssh23:43:001
1606599240,1cyclictest9367-21diskmemload21:45:371
1606599240,1cyclictest4489-21ssh22:03:591
1606599240,1cyclictest13889-21apt-get23:09:451
16064992420,4cyclictest0-21swapper/023:40:570
16064992420,3cyclictest9367-21diskmemload23:34:440
16064992420,3cyclictest9367-21diskmemload22:43:460
16064992419,4cyclictest25441-21sh00:16:020
1606499240,24cyclictest0-21swapper/022:55:590
1606499240,24cyclictest0-21swapper/022:21:070
1606499240,23cyclictest9367-21diskmemload00:20:120
1606499240,23cyclictest23868-21apt-get19:29:450
1606499240,1cyclictest0-21swapper/022:19:170
1606499240,1cyclictest0-21swapper/021:36:070
1606499240,0cyclictest9367-21diskmemload22:26:040
1606499240,0cyclictest0-21swapper/023:26:580
1606499240,0cyclictest0-21swapper/021:42:260
1606499240,0cyclictest0-21swapper/021:10:190
16075992323,0cyclictest0-21swapper/323:01:583
16075992323,0cyclictest0-21swapper/322:01:063
16075992321,1cyclictest27453-21sh23:20:223
16075992321,1cyclictest0-21swapper/322:29:563
1607599230,23cyclictest9367-21diskmemload22:16:143
1607599230,23cyclictest0-21swapper/323:25:043
1607599230,22cyclictest9654-21sh22:36:043
1607599230,22cyclictest7360-21ssh21:37:263
1607599230,22cyclictest4507-21ssh22:32:153
1607599230,22cyclictest21543-21sh00:13:273
1607599230,22cyclictest0-21swapper/323:16:203
1607599230,22cyclictest0-21swapper/321:25:093
1607599230,0cyclictest9367-21diskmemload00:38:373
1607599230,0cyclictest9367-21diskmemload00:38:373
1607599230,0cyclictest9367-21diskmemload00:32:373
1607599230,0cyclictest0-21swapper/323:52:233
1607599230,0cyclictest0-21swapper/322:46:273
1607599230,0cyclictest0-21swapper/322:12:283
16069992323,0cyclictest0-21swapper/221:11:332
1606999232,20cyclictest0-21swapper/221:20:252
16069992321,1cyclictest11025-21ls21:40:012
16069992321,1cyclictest0-21swapper/222:04:462
16069992321,1cyclictest0-21swapper/200:36:462
16069992321,1cyclictest0-21swapper/200:36:462
16069992320,2cyclictest5373-21ssh00:27:482
16069992320,1cyclictest26366-21apt-get23:49:452
1606999230,2cyclictest17708-21cron20:20:002
1606999230,23cyclictest0-21swapper/200:12:492
1606999230,23cyclictest0-21swapper/200:03:302
1606999230,22cyclictest358-21apt-get20:54:452
1606999230,22cyclictest0-21swapper/223:22:042
1606999230,22cyclictest0-21swapper/222:27:202
1606999230,0cyclictest10077-21ssh22:08:552
16065992323,0cyclictest0-21swapper/123:47:061
16065992323,0cyclictest0-21swapper/123:14:491
16065992323,0cyclictest0-21swapper/122:22:331
16065992322,0cyclictest9367-21diskmemload21:12:311
16065992321,1cyclictest8251-21munin-run22:35:011
16065992321,1cyclictest7614-21apt-get21:09:451
16065992321,1cyclictest23270-21sh21:50:381
16065992321,1cyclictest0-21swapper/123:30:191
16065992321,1cyclictest0-21swapper/121:18:391
1606599230,2cyclictest10863-21rm22:37:411
1606599230,22cyclictest950-21ssh21:31:211
1606599230,22cyclictest950-21ssh21:31:211
1606599230,22cyclictest6517-21sh21:36:221
1606599230,22cyclictest15987-21ssh00:36:561
1606599230,22cyclictest15987-21ssh00:36:561
1606599230,22cyclictest0-21swapper/100:16:241
1606599230,1cyclictest9367-21diskmemload22:44:541
1606499230,1cyclictest30423-21apt-get20:49:440
1606499230,1cyclictest0-21swapper/020:54:490
1606499230,0cyclictest9367-21diskmemload00:36:080
1606499230,0cyclictest9367-21diskmemload00:36:080
1606499230,0cyclictest0-21swapper/021:04:450
16075992222,0cyclictest0-21swapper/323:49:303
16075992222,0cyclictest0-21swapper/323:11:593
16075992222,0cyclictest0-21swapper/300:01:003
16075992220,1cyclictest6291-21ssh23:30:173
16075992220,1cyclictest0-21swapper/323:56:233
1607599220,21cyclictest9367-21diskmemload22:23:373
1607599220,21cyclictest9367-21diskmemload22:06:203
1607599220,21cyclictest14114-21ssh23:38:173
1607599220,21cyclictest11770-21ssh23:06:483
1607599220,21cyclictest0-21swapper/322:59:303
1607599220,21cyclictest0-21swapper/321:21:043
1607599220,21cyclictest0-21swapper/320:30:003
1607599220,1cyclictest6346-21apt-get19:59:433
1607599220,1cyclictest331rcuc/321:40:023
1607599220,1cyclictest29109-21apt-get19:39:433
1607599220,1cyclictest28031-21apt-get20:44:443
1607599220,1cyclictest0-21swapper/300:18:583
1607599220,0cyclictest9367-21diskmemload21:10:413
1607599220,0cyclictest9367-21diskmemload00:27:073
1607599220,0cyclictest0-21swapper/322:51:393
1607599220,0cyclictest0-21swapper/320:54:453
16069992222,0cyclictest0-21swapper/223:54:432
16069992222,0cyclictest0-21swapper/223:25:572
16069992222,0cyclictest0-21swapper/223:05:272
16069992222,0cyclictest0-21swapper/223:00:212
16069992222,0cyclictest0-21swapper/221:30:282
16069992222,0cyclictest0-21swapper/221:30:282
16069992221,0cyclictest9367-21diskmemload21:16:102
16069992220,1cyclictest0-21swapper/222:31:432
16069992220,1cyclictest0-21swapper/220:25:002
16069992219,2cyclictest622-21gdbus19:35:002
1606999220,22cyclictest0-21swapper/221:50:482
1606999220,21cyclictest27319-21idleruntime-cro20:40:002
1606999220,21cyclictest25625-21dump-pmu-power19:30:002
1606999220,21cyclictest10092-21ssh00:31:252
1606999220,21cyclictest0-21swapper/223:15:332
1606999220,21cyclictest0-21swapper/223:10:572
1606999220,21cyclictest0-21swapper/222:51:232
1606999220,1cyclictest27047-21ssh21:25:262
1606999220,1cyclictest18449-21munin-run19:15:012
1606999220,1cyclictest0-21swapper/221:47:132
1606999220,0cyclictest0-21swapper/200:20:022
16065992221,1cyclictest26994-21sh21:25:231
16065992220,1cyclictest0-21swapper/100:10:011
1606599220,21cyclictest15325-21dump-pmu-power20:15:011
1606599220,21cyclictest0-21swapper/123:25:121
1606599220,21cyclictest0-21swapper/122:55:271
1606599220,21cyclictest0-21swapper/119:59:441
1606599220,21cyclictest0-21swapper/119:54:441
1606599220,21cyclictest0-21swapper/100:00:081
1606599220,1cyclictest30837-21ssh00:20:471
1606599220,0cyclictest0-21swapper/123:00:301
1606499220,1cyclictest8105-21apt20:00:010
1606499220,1cyclictest14143-21ssh22:11:510
1606499220,1cyclictest0-21swapper/020:24:460
1606499220,0cyclictest27310-21ntp_states19:34:480
16075992121,0cyclictest0-21swapper/322:40:533
16069992121,0cyclictest23164-21apt-get20:34:432
16069992119,1cyclictest929-21perf19:45:002
1606999210,0cyclictest0-21swapper/222:36:242
1606999210,0cyclictest0-21swapper/220:09:452
1606599210,20cyclictest0-21swapper/120:49:441
16064992119,1cyclictest622-21gdbus20:20:000
1606499210,2cyclictest4356-21expr19:54:450
1606499210,20cyclictest0-21swapper/019:19:460
1606499210,1cyclictest0-21swapper/020:44:450
1606499210,1cyclictest0-21swapper/020:09:460
1606499210,0cyclictest31999-21diskstats19:44:460
16075992020,0cyclictest0-21swapper/321:09:453
16075992020,0cyclictest0-21swapper/320:39:473
16075992020,0cyclictest0-21swapper/319:44:443
16075992020,0cyclictest0-21swapper/319:29:453
16075992018,1cyclictest32196-21idleruntime-cro20:50:013
16075992018,1cyclictest28111-21perf19:35:003
16069992020,0cyclictest0-21swapper/219:19:462
16069992019,1cyclictest0-21swapper/220:14:452
1606999200,0cyclictest28100-21apt-get19:35:022
1606999200,0cyclictest0-21swapper/220:59:452
1606999200,0cyclictest0-21swapper/219:49:412
1606599200,0cyclictest0-21swapper/120:34:421
1606499200,0cyclictest0-21swapper/020:59:450
1606499200,0cyclictest0-21swapper/019:39:430
16075991919,0cyclictest0-21swapper/321:04:453
16069991919,0cyclictest0-21swapper/221:09:452
16069991919,0cyclictest0-21swapper/221:04:452
16065991919,0cyclictest0-21swapper/120:54:451
16065991919,0cyclictest0-21swapper/120:24:441
16065991919,0cyclictest0-21swapper/120:09:451
16065991919,0cyclictest0-21swapper/119:39:431
1606499190,18cyclictest9369-21ssh21:10:000
1606499190,18cyclictest0-21swapper/019:49:490
16075991818,0cyclictest0-21swapper/320:24:443
16075991818,0cyclictest0-21swapper/320:14:453
16069991818,0cyclictest21472-21apt-get19:24:442
16069991816,1cyclictest29803-21apt20:45:012
16065991818,0cyclictest0-21swapper/119:34:431
16065991816,1cyclictest19060-21apt-get19:19:461
16064991818,0cyclictest0-21swapper/020:29:440
1606499180,17cyclictest0-21swapper/020:37:110
1607599170,16cyclictest17716-21cat20:20:003
1607599170,0cyclictest0-21swapper/319:19:463
16069991717,0cyclictest0-21swapper/219:59:442
16065991715,1cyclictest27353-21munin-run20:40:001
16065991715,1cyclictest23256-21cat19:25:011
16065991715,1cyclictest18434-21ls19:15:011
1607599160,0cyclictest0-21swapper/319:54:443
16069991614,1cyclictest9566-21irqstats20:04:492
1606999160,15cyclictest605-21avahi-daemon20:27:542
16065991614,1cyclictest0-21swapper/120:29:471
16065991614,1cyclictest0-21swapper/120:19:451
1606499160,16cyclictest0-21swapper/020:14:550
1606499160,16cyclictest0-21swapper/019:10:360
1607599150,14cyclictest22376-21memory19:24:483
16069991513,1cyclictest0-21swapper/220:49:542
16075991414,0cyclictest0-21swapper/320:07:123
1607599140,14cyclictest0-21swapper/320:57:143
1607599140,14cyclictest0-21swapper/320:04:113
1607599140,0cyclictest0-21swapper/320:30:453
1607599140,0cyclictest0-21swapper/319:10:193
1606999140,0cyclictest0-21swapper/219:50:442
16065991414,0cyclictest0-21swapper/119:40:231
1606599140,14cyclictest0-21swapper/119:45:331
1606599140,0cyclictest0-21swapper/121:00:271
1606599140,0cyclictest0-21swapper/120:55:071
1606599140,0cyclictest0-21swapper/119:28:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional